2024-05-14T08:51:51.530 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-14T08:51:51.530 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} --name vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi --verbose -- /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/orig.config.yaml 2024-05-14T08:51:51.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T08:51:51.682 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657 branch: wip-vshankar-testing-20240509.053109-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} email: vshankar@redhat.com first_in_suite: false job_id: '7705657' kernel: flavor: default kdb: true sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240509.053109-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: e2b755a64f0d72176b57299d02e880cf0620d780 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: e2b755a64f0d72176b57299d02e880cf0620d780 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240509.053109-debug sha1: e2b755a64f0d72176b57299d02e880cf0620d780 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6285 sha1: e2b755a64f0d72176b57299d02e880cf0620d780 sleep_before_teardown: 0 subset: 548/1024 suite: fs suite_branch: wip-vshankar-testing-20240509.053109-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2b755a64f0d72176b57299d02e880cf0620d780 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2p+UR98t+MYnbA6LmOisQwAus48sHU2XtZfQKIINlBNuoNayko8NMp3kK9MuLroG9P8Y49ZzRvDIA4vrjlgsU= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5LN3hI4r8IdID0AGWS++wTcqbgAky2q5PyUJghdL+SkcoPE92Y6FxETVk+LDz+WszcUy8jRIMd+MVEgYv5Ph0= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBkKODTgVpSecuLASI37Fag6v61hGrVG3tpACYrrfW2NK2qeygjGCFL2XYYnD3SNAmJVqwezg5RkiwEOekigDQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-14_07:04:04 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-14T08:51:51.682 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa; will attempt to use it 2024-05-14T08:51:51.683 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks 2024-05-14T08:51:51.683 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-14T08:51:51.685 INFO:teuthology.task.internal:Checking packages... 2024-05-14T08:51:51.709 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e2b755a64f0d72176b57299d02e880cf0620d780' 2024-05-14T08:51:51.709 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-14T08:51:51.709 INFO:teuthology.packaging:ref: None 2024-05-14T08:51:51.709 INFO:teuthology.packaging:tag: None 2024-05-14T08:51:51.709 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240509.053109-debug 2024-05-14T08:51:51.709 INFO:teuthology.packaging:sha1: e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T08:51:51.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240509.053109-debug 2024-05-14T08:51:51.942 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3588.ge2b755a6 2024-05-14T08:51:51.944 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-14T08:51:51.951 INFO:teuthology.task.internal:no buildpackages task found 2024-05-14T08:51:51.951 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-14T08:51:51.960 INFO:teuthology.task.internal:Saving configuration 2024-05-14T08:51:51.982 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-14T08:51:51.990 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T08:51:52.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 08:46:30.109943', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2p+UR98t+MYnbA6LmOisQwAus48sHU2XtZfQKIINlBNuoNayko8NMp3kK9MuLroG9P8Y49ZzRvDIA4vrjlgsU='} 2024-05-14T08:51:52.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 08:46:30.111927', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5LN3hI4r8IdID0AGWS++wTcqbgAky2q5PyUJghdL+SkcoPE92Y6FxETVk+LDz+WszcUy8jRIMd+MVEgYv5Ph0='} 2024-05-14T08:51:52.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 08:46:30.113272', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBkKODTgVpSecuLASI37Fag6v61hGrVG3tpACYrrfW2NK2qeygjGCFL2XYYnD3SNAmJVqwezg5RkiwEOekigDQ='} 2024-05-14T08:51:52.059 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-14T08:51:52.070 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-14T08:51:52.070 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-14T08:51:52.070 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-14T08:51:52.070 INFO:teuthology.run_tasks:Running task console_log... 2024-05-14T08:51:52.175 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f85ffbbe0d0>, signals=[15]) 2024-05-14T08:51:52.175 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-14T08:51:52.181 INFO:teuthology.task.internal:Opening connections... 2024-05-14T08:51:52.181 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T08:51:52.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:51:52.264 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-05-14T08:51:52.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:51:52.337 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-05-14T08:51:52.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:51:52.410 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-14T08:51:52.423 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-05-14T08:51:52.443 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-05-14T08:51:52.443 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-05-14T08:51:52.500 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-05-14T08:51:52.500 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-05-14T08:51:52.500 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-05-14T08:51:52.500 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T08:51:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T08:51:52.502 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-05-14T08:51:52.525 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-05-14T08:51:52.543 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-05-14T08:51:52.543 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-05-14T08:51:52.600 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-05-14T08:51:52.600 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T08:51:52.601 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T08:51:52.601 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-05-14T08:51:52.627 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-05-14T08:51:52.645 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-05-14T08:51:52.645 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T08:51:52.703 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T08:51:52.704 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-05-14T08:51:52.725 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-14T08:51:52.736 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-14T08:51:52.743 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-14T08:51:52.743 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-05-14T08:51:52.746 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-05-14T08:51:52.748 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-05-14T08:51:52.764 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-14T08:51:52.772 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-14T08:51:52.772 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-05-14T08:51:52.802 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-05-14T08:51:52.805 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-05-14T08:51:52.903 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-14T08:51:52.980 INFO:teuthology.run_tasks:Running task kernel... 2024-05-14T08:51:52.994 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'} 2024-05-14T08:51:52.995 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}}, timeout 300 2024-05-14T08:51:52.995 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T08:51:52.995 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T08:51:52.996 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T08:51:53.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T08:51:53.012 DEBUG:teuthology.task.kernel:sha1 for mon.b is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T08:51:53.013 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-05-14T08:51:53.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T08:51:53.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T08:51:53.014 DEBUG:teuthology.task.kernel:sha1 for mon.c is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.014 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T08:51:53.015 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-05-14T08:51:53.015 DEBUG:teuthology.task.kernel:sha1 for mon.a is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.015 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T08:51:53.015 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-05-14T08:51:53.069 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-437.el9.x86_64 2024-05-14T08:51:53.069 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.070 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T08:51:53.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.074 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-437.el9.x86_64 2024-05-14T08:51:53.074 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-437.el9.x86_64 2024-05-14T08:51:53.075 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.075 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T08:51:53.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.076 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.076 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T08:51:53.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:51:53.228 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum upgrade -y linux-firmware 2024-05-14T08:51:53.289 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum upgrade -y linux-firmware 2024-05-14T08:51:53.300 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum upgrade -y linux-firmware 2024-05-14T08:51:56.603 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.1 MB 00:01 2024-05-14T08:51:57.526 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.1 MB 00:02 2024-05-14T08:51:58.487 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-14T08:51:59.463 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.1 MB 00:04 2024-05-14T08:52:02.613 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-05-14T08:52:04.271 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-05-14T08:52:05.834 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-14T08:52:10.939 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-14T08:52:12.973 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-05-14T08:52:12.974 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-05-14T08:52:12.974 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-05-14T08:52:13.076 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.c... 2024-05-14T08:52:13.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:52:13.307 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T08:52:13.308 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T08:52:13.310 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi175.front.sepia.ceph.com to complete... 2024-05-14T08:52:14.754 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-05-14T08:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-05-14T08:52:19.673 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.2 MB 00:00 2024-05-14T08:52:20.630 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.2 MB 00:02 2024-05-14T08:52:21.258 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-05-14T08:52:22.264 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-05-14T08:52:23.109 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-14T08:52:25.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14 08:52:25 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T08:52:25.467 INFO:teuthology.orchestra.run.smithi175.stderr:FINISHED --2024-05-14 08:52:25-- 2024-05-14T08:52:25.467 INFO:teuthology.orchestra.run.smithi175.stderr:Total wall clock time: 12s 2024-05-14T08:52:25.467 INFO:teuthology.orchestra.run.smithi175.stderr:Downloaded: 1 files, 341M in 12s (28.8 MB/s) 2024-05-14T08:52:25.469 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.c... 2024-05-14T08:52:25.470 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T08:52:27.595 INFO:teuthology.orchestra.run.smithi175.stdout:Verifying... ######################################## 2024-05-14T08:52:27.733 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing... ######################################## 2024-05-14T08:52:27.854 INFO:teuthology.orchestra.run.smithi175.stdout:Updating / installing... 2024-05-14T08:52:28.234 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-14T08:52:30.367 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-05-14T08:52:30.368 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-05-14T08:52:30.368 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-05-14T08:52:30.480 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T08:52:30.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:52:30.640 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T08:52:30.640 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T08:52:30.643 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi120.front.sepia.ceph.com to complete... 2024-05-14T08:52:35.865 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T08:52:41.833 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-05-14T08:52:42.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14 08:52:42 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T08:52:42.978 INFO:teuthology.orchestra.run.smithi120.stderr:FINISHED --2024-05-14 08:52:42-- 2024-05-14T08:52:42.978 INFO:teuthology.orchestra.run.smithi120.stderr:Total wall clock time: 12s 2024-05-14T08:52:42.978 INFO:teuthology.orchestra.run.smithi120.stderr:Downloaded: 1 files, 341M in 12s (28.6 MB/s) 2024-05-14T08:52:42.981 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T08:52:42.981 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T08:52:45.114 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying... ######################################## 2024-05-14T08:52:45.303 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing... ######################################## 2024-05-14T08:52:45.422 INFO:teuthology.orchestra.run.smithi120.stdout:Updating / installing... 2024-05-14T08:52:46.880 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-05-14T08:52:48.924 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-05-14T08:52:48.925 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-05-14T08:52:48.925 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-05-14T08:52:49.044 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T08:52:49.045 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T08:52:49.195 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T08:52:49.195 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T08:52:49.197 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi152.front.sepia.ceph.com to complete... 2024-05-14T08:52:53.345 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T08:53:01.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14 08:53:01 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T08:53:01.413 INFO:teuthology.orchestra.run.smithi152.stderr:FINISHED --2024-05-14 08:53:01-- 2024-05-14T08:53:01.413 INFO:teuthology.orchestra.run.smithi152.stderr:Total wall clock time: 12s 2024-05-14T08:53:01.413 INFO:teuthology.orchestra.run.smithi152.stderr:Downloaded: 1 files, 341M in 12s (28.8 MB/s) 2024-05-14T08:53:01.416 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T08:53:01.417 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T08:53:03.545 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying... ######################################## 2024-05-14T08:53:03.950 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing... ######################################## 2024-05-14T08:53:04.064 INFO:teuthology.orchestra.run.smithi152.stdout:Updating / installing... 2024-05-14T08:53:12.059 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T08:53:15.195 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T08:53:15.196 DEBUG:teuthology.orchestra.run.smithi175:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T08:53:15.279 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:15.279 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:15.279 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T08:53:15.280 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T08:53:15.281 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T08:53:15.282 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T08:53:15.283 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T08:53:15.284 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T08:53:15.285 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T08:53:15.286 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T08:53:15.287 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T08:53:15.288 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T08:53:15.289 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T08:53:15.290 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T08:53:15.291 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T08:53:15.292 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T08:53:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T08:53:15.294 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T08:53:15.295 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T08:53:15.296 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T08:53:15.297 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T08:53:15.298 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T08:53:15.299 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T08:53:15.300 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T08:53:15.301 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T08:53:15.302 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T08:53:15.303 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T08:53:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T08:53:15.305 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T08:53:15.306 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T08:53:15.307 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T08:53:15.308 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T08:53:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T08:53:15.310 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T08:53:15.311 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T08:53:15.312 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T08:53:15.313 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T08:53:15.314 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T08:53:15.315 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T08:53:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T08:53:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T08:53:15.318 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T08:53:15.319 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T08:53:15.320 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T08:53:15.321 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T08:53:15.322 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T08:53:15.323 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T08:53:15.324 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T08:53:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T08:53:15.326 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T08:53:15.327 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T08:53:15.328 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T08:53:15.329 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T08:53:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T08:53:15.331 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T08:53:15.332 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T08:53:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T08:53:15.334 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T08:53:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T08:53:15.336 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T08:53:15.337 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T08:53:15.338 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T08:53:15.339 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T08:53:15.340 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T08:53:15.341 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T08:53:15.342 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T08:53:15.343 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T08:53:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T08:53:15.345 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T08:53:15.346 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T08:53:15.347 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T08:53:15.348 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T08:53:15.349 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T08:53:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T08:53:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T08:53:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T08:53:15.353 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T08:53:15.354 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T08:53:15.355 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T08:53:15.356 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T08:53:15.357 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T08:53:15.358 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T08:53:15.359 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T08:53:15.360 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T08:53:15.361 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T08:53:15.362 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T08:53:15.363 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T08:53:15.364 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T08:53:15.365 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T08:53:15.366 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T08:53:15.367 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T08:53:15.368 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T08:53:15.369 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T08:53:15.370 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T08:53:15.371 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T08:53:15.372 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T08:53:15.373 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T08:53:15.374 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T08:53:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T08:53:15.376 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T08:53:15.377 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T08:53:15.378 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T08:53:15.379 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T08:53:15.380 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T08:53:15.381 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T08:53:15.382 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T08:53:15.383 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T08:53:15.384 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T08:53:15.385 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T08:53:15.386 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T08:53:15.387 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T08:53:15.388 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T08:53:15.389 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T08:53:15.390 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T08:53:15.391 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T08:53:15.392 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T08:53:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T08:53:15.394 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T08:53:15.395 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T08:53:15.396 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T08:53:15.397 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T08:53:15.398 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T08:53:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T08:53:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T08:53:15.401 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T08:53:15.402 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T08:53:15.403 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T08:53:15.404 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T08:53:15.405 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T08:53:15.406 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T08:53:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T08:53:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T08:53:15.409 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T08:53:15.410 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T08:53:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T08:53:15.412 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T08:53:15.413 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T08:53:15.414 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T08:53:15.415 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T08:53:15.416 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T08:53:15.417 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T08:53:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T08:53:15.419 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T08:53:15.420 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T08:53:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T08:53:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T08:53:15.423 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T08:53:15.424 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T08:53:15.425 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T08:53:15.426 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T08:53:15.427 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T08:53:15.427 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T08:53:15.427 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T08:53:15.427 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T08:53:15.427 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T08:53:15.427 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T08:53:15.427 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T08:53:15.431 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:15.431 DEBUG:teuthology.orchestra.run.smithi175:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T08:53:15.455 INFO:teuthology.orchestra.run.smithi175.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout:for file in vmlinuz System.map config; do 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout: fi 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout:done 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:15.456 INFO:teuthology.orchestra.run.smithi175.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:15.457 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-05-14T08:53:15.458 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 68.el9 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8264254 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2024-05-14T08:53:15.532 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T08:53:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2024-05-14T08:53:15.534 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T08:53:15.534 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T08:53:15.535 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T08:53:15.535 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:15.535 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T08:53:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-05-14T08:53:17.576 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T08:53:17.608 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-05-14T08:53:17.610 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-05-14T08:53:17.669 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.ON4YHSL2x6 2024-05-14T08:53:17.669 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ON4YHSL2x6 2024-05-14T08:53:17.693 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.ON4YHSL2x6 2024-05-14T08:53:17.837 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.ON4YHSL2x6 is 6KB 2024-05-14T08:53:17.887 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.ON4YHSL2x6 2024-05-14T08:53:17.901 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T08:53:17.963 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T08:53:17.963 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T08:53:17.963 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T08:53:17.963 INFO:teuthology.orchestra.run.smithi175.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T08:53:17.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:18.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-05-14T08:53:33.366 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T08:53:33.366 DEBUG:teuthology.orchestra.run.smithi120:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T08:53:33.453 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T08:53:33.454 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T08:53:33.455 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T08:53:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T08:53:33.457 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T08:53:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T08:53:33.459 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T08:53:33.460 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T08:53:33.461 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T08:53:33.462 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T08:53:33.463 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T08:53:33.464 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T08:53:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T08:53:33.466 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T08:53:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T08:53:33.468 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T08:53:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T08:53:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T08:53:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T08:53:33.472 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T08:53:33.473 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T08:53:33.474 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T08:53:33.475 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T08:53:33.476 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T08:53:33.477 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T08:53:33.478 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T08:53:33.479 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T08:53:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T08:53:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T08:53:33.482 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T08:53:33.483 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T08:53:33.484 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T08:53:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T08:53:33.486 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T08:53:33.487 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T08:53:33.488 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T08:53:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T08:53:33.490 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T08:53:33.491 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T08:53:33.492 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T08:53:33.493 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T08:53:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T08:53:33.495 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T08:53:33.496 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T08:53:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T08:53:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T08:53:33.499 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T08:53:33.500 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T08:53:33.501 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T08:53:33.502 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T08:53:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T08:53:33.504 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T08:53:33.505 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T08:53:33.506 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T08:53:33.507 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T08:53:33.508 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T08:53:33.509 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T08:53:33.510 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T08:53:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T08:53:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T08:53:33.513 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T08:53:33.514 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T08:53:33.515 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T08:53:33.516 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T08:53:33.517 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T08:53:33.518 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T08:53:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T08:53:33.520 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T08:53:33.521 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T08:53:33.522 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T08:53:33.523 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T08:53:33.524 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T08:53:33.525 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T08:53:33.526 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T08:53:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T08:53:33.528 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T08:53:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T08:53:33.530 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T08:53:33.531 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T08:53:33.532 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T08:53:33.533 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T08:53:33.534 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T08:53:33.535 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T08:53:33.536 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T08:53:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T08:53:33.538 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T08:53:33.539 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T08:53:33.540 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T08:53:33.541 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T08:53:33.542 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T08:53:33.543 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T08:53:33.544 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T08:53:33.545 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T08:53:33.546 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T08:53:33.547 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T08:53:33.548 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T08:53:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T08:53:33.550 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T08:53:33.551 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T08:53:33.552 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T08:53:33.553 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T08:53:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T08:53:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T08:53:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T08:53:33.557 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T08:53:33.558 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T08:53:33.559 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T08:53:33.560 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T08:53:33.561 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T08:53:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T08:53:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T08:53:33.564 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T08:53:33.565 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T08:53:33.566 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T08:53:33.567 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T08:53:33.568 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T08:53:33.569 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T08:53:33.570 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T08:53:33.571 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T08:53:33.572 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T08:53:33.573 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T08:53:33.574 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T08:53:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T08:53:33.576 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T08:53:33.577 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T08:53:33.578 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T08:53:33.579 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T08:53:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T08:53:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T08:53:33.582 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T08:53:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T08:53:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T08:53:33.585 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T08:53:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T08:53:33.590 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:33.590 DEBUG:teuthology.orchestra.run.smithi120:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout:for file in vmlinuz System.map config; do 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: fi 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout:done 2024-05-14T08:53:33.613 INFO:teuthology.orchestra.run.smithi120.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:33.614 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-05-14T08:53:33.615 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-05-14T08:53:33.688 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-05-14T08:53:33.688 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-05-14T08:53:33.688 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-05-14T08:53:33.688 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 68.el9 2024-05-14T08:53:33.688 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-05-14T08:53:33.688 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8264254 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T08:53:33.689 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T08:53:33.690 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T08:53:33.690 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-05-14T08:53:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T08:53:33.690 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T08:53:33.691 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T08:53:33.691 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:33.691 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T08:53:34.254 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-05-14T08:53:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T08:53:35.682 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-05-14T08:53:35.685 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-05-14T08:53:35.724 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.clRlK1Tmhh 2024-05-14T08:53:35.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.clRlK1Tmhh 2024-05-14T08:53:35.790 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.clRlK1Tmhh 2024-05-14T08:53:35.928 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.clRlK1Tmhh is 6KB 2024-05-14T08:53:35.948 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.clRlK1Tmhh 2024-05-14T08:53:35.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T08:53:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T08:53:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T08:53:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T08:53:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T08:53:36.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:36.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-05-14T08:53:48.141 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-05-14T08:53:48.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-14T08:53:48.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:53:51.853 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T08:53:51.853 DEBUG:teuthology.orchestra.run.smithi152:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T08:53:51.932 INFO:teuthology.orchestra.run.smithi152.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:51.932 INFO:teuthology.orchestra.run.smithi152.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:51.932 INFO:teuthology.orchestra.run.smithi152.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:51.932 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T08:53:51.933 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T08:53:51.934 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T08:53:51.935 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T08:53:51.936 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T08:53:51.937 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T08:53:51.938 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T08:53:51.939 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T08:53:51.940 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T08:53:51.941 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T08:53:51.942 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T08:53:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T08:53:51.944 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T08:53:51.945 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T08:53:51.946 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T08:53:51.947 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T08:53:51.948 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T08:53:51.949 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T08:53:51.950 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T08:53:51.951 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T08:53:51.952 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T08:53:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T08:53:51.954 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T08:53:51.955 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T08:53:51.956 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T08:53:51.957 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T08:53:51.958 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T08:53:51.959 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T08:53:51.960 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T08:53:51.961 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T08:53:51.962 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T08:53:51.963 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T08:53:51.964 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T08:53:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T08:53:51.966 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T08:53:51.967 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T08:53:51.968 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T08:53:51.969 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T08:53:51.970 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T08:53:51.971 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T08:53:51.972 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T08:53:51.973 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T08:53:51.974 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T08:53:51.975 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T08:53:51.976 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T08:53:51.977 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T08:53:51.978 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T08:53:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T08:53:51.980 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T08:53:51.981 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T08:53:51.982 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T08:53:51.983 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T08:53:51.984 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T08:53:51.985 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T08:53:51.986 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T08:53:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T08:53:51.988 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T08:53:51.989 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T08:53:51.990 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T08:53:51.991 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T08:53:51.992 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T08:53:51.993 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T08:53:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T08:53:51.995 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T08:53:51.996 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T08:53:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T08:53:51.998 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T08:53:51.999 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T08:53:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T08:53:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T08:53:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T08:53:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T08:53:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T08:53:52.005 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T08:53:52.006 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T08:53:52.007 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T08:53:52.008 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T08:53:52.009 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T08:53:52.010 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T08:53:52.011 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T08:53:52.012 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T08:53:52.013 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T08:53:52.014 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T08:53:52.015 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T08:53:52.016 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T08:53:52.017 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T08:53:52.018 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T08:53:52.019 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T08:53:52.020 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T08:53:52.021 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T08:53:52.022 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T08:53:52.023 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T08:53:52.024 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T08:53:52.025 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T08:53:52.026 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T08:53:52.027 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T08:53:52.028 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T08:53:52.029 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T08:53:52.030 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T08:53:52.031 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T08:53:52.032 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T08:53:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T08:53:52.034 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T08:53:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T08:53:52.036 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T08:53:52.037 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T08:53:52.038 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T08:53:52.039 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T08:53:52.040 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T08:53:52.041 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T08:53:52.042 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T08:53:52.043 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T08:53:52.044 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T08:53:52.045 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T08:53:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T08:53:52.047 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T08:53:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T08:53:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T08:53:52.050 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T08:53:52.051 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T08:53:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T08:53:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T08:53:52.054 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T08:53:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T08:53:52.056 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T08:53:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T08:53:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T08:53:52.059 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T08:53:52.060 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T08:53:52.061 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T08:53:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T08:53:52.063 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T08:53:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T08:53:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T08:53:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T08:53:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T08:53:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T08:53:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T08:53:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T08:53:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T08:53:52.068 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:52.068 DEBUG:teuthology.orchestra.run.smithi152:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T08:53:52.091 INFO:teuthology.orchestra.run.smithi152.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T08:53:52.091 INFO:teuthology.orchestra.run.smithi152.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T08:53:52.091 INFO:teuthology.orchestra.run.smithi152.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T08:53:52.091 INFO:teuthology.orchestra.run.smithi152.stdout:fi 2024-05-14T08:53:52.091 INFO:teuthology.orchestra.run.smithi152.stdout:for file in vmlinuz System.map config; do 2024-05-14T08:53:52.091 INFO:teuthology.orchestra.run.smithi152.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout: fi 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:done 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:fi 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:fi 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:fi 2024-05-14T08:53:52.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 68.el9 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8264254 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T08:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T08:53:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T08:53:52.179 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T08:53:52.179 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:52.179 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T08:53:52.761 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-05-14T08:53:54.185 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T08:53:54.211 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-05-14T08:53:54.213 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-05-14T08:53:54.241 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.Qjc7jcTWhb 2024-05-14T08:53:54.241 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Qjc7jcTWhb 2024-05-14T08:53:54.316 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.Qjc7jcTWhb 2024-05-14T08:53:54.452 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.Qjc7jcTWhb is 6KB 2024-05-14T08:53:54.501 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.Qjc7jcTWhb 2024-05-14T08:53:54.515 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T08:53:54.576 INFO:teuthology.orchestra.run.smithi152.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T08:53:54.577 INFO:teuthology.orchestra.run.smithi152.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T08:53:54.577 INFO:teuthology.orchestra.run.smithi152.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T08:53:54.577 INFO:teuthology.orchestra.run.smithi152.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T08:53:54.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:53:54.728 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-05-14T08:54:06.211 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-14T08:54:06.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-05-14T08:54:06.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:54:06.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-05-14T08:54:15.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-14T08:54:15.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:54:24.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-14T08:54:24.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-05-14T08:54:24.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:54:43.231 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-05-14T08:54:52.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-05-14T08:54:52.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:54:55.294 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-05-14T08:55:06.223 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T08:55:07.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-05-14T08:55:07.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:55:15.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-05-14T08:55:15.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:55:15.635 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T08:55:18.741 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-05-14T08:55:19.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-05-14T08:55:19.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T08:55:19.396 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-05-14T08:55:19.440 INFO:teuthology.orchestra.run.smithi120.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:55:19.440 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:55:19.440 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T08:55:19.440 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T08:55:20.441 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-14T08:55:20.441 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T08:55:20.564 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-05-14T08:55:20.600 DEBUG:teuthology.parallel:result is None 2024-05-14T08:55:27.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-14T08:55:27.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:55:28.081 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-05-14T08:55:28.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-14T08:55:28.672 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T08:55:28.673 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-05-14T08:55:28.726 INFO:teuthology.orchestra.run.smithi175.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:55:28.726 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:55:28.726 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T08:55:28.726 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T08:55:29.727 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-05-14T08:55:29.727 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T08:55:30.114 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-05-14T08:55:30.181 DEBUG:teuthology.parallel:result is None 2024-05-14T08:56:07.299 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T08:56:22.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-05-14T08:56:22.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T08:56:22.696 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-05-14T08:56:23.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-05-14T08:56:23.322 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T08:56:23.322 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-05-14T08:56:23.374 INFO:teuthology.orchestra.run.smithi152.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:56:23.374 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T08:56:23.374 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T08:56:23.374 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T08:56:24.374 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-14T08:56:24.375 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T08:56:24.502 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-05-14T08:56:24.568 DEBUG:teuthology.parallel:result is None 2024-05-14T08:56:24.568 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-14T08:56:24.575 INFO:teuthology.task.internal:Creating test directory... 2024-05-14T08:56:24.575 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T08:56:24.585 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T08:56:24.592 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T08:56:24.650 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-14T08:56:24.657 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-14T08:56:24.667 INFO:teuthology.task.internal:Creating archive directory... 2024-05-14T08:56:24.667 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T08:56:24.674 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T08:56:24.681 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T08:56:24.779 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-14T08:56:24.786 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-14T08:56:24.787 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T08:56:24.794 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T08:56:24.801 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T08:56:24.889 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T08:56:24.892 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T08:56:24.908 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T08:56:24.921 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T08:56:24.925 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T08:56:24.941 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T08:56:24.946 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-14T08:56:24.953 INFO:teuthology.task.internal:Configuring sudo... 2024-05-14T08:56:24.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T08:56:24.959 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T08:56:24.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T08:56:25.049 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-14T08:56:25.058 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-14T08:56:25.058 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T08:56:25.065 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T08:56:25.070 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T08:56:25.124 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T08:56:25.209 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T08:56:25.328 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T08:56:25.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T08:56:25.491 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T08:56:25.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T08:56:25.573 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T08:56:25.657 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T08:56:25.752 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T08:56:25.835 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T08:56:25.925 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T08:56:25.926 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T08:56:26.010 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T08:56:26.098 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T08:56:26.197 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T08:56:26.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T08:56:26.360 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T08:56:26.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T08:56:26.444 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-05-14T08:56:26.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-05-14T08:56:26.460 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-05-14T08:56:26.557 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T08:56:26.565 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T08:56:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T08:56:27.043 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-14T08:56:27.051 INFO:teuthology.task.internal:Starting timer... 2024-05-14T08:56:27.051 INFO:teuthology.run_tasks:Running task pcp... 2024-05-14T08:56:27.061 INFO:teuthology.run_tasks:Running task selinux... 2024-05-14T08:56:27.070 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-14T08:56:27.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-05-14T08:56:27.202 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-05-14T08:56:27.206 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-05-14T08:56:27.339 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-05-14T08:56:27.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-05-14T08:56:27.476 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-05-14T08:56:27.482 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-14T08:56:27.482 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-05-14T08:56:27.544 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-05-14T08:56:27.544 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-05-14T08:56:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-05-14T08:56:27.608 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-05-14T08:56:27.664 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-05-14T08:56:27.664 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-05-14T08:56:27.664 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T08:56:27.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T08:56:27.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T08:56:27.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T08:56:27.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T08:56:27.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T08:56:27.883 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-14T08:56:27.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-05-14T08:56:27.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-05-14T08:56:28.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-05-14T08:56:28.104 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-14T08:56:28.114 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-14T08:56:28.130 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-14T08:56:28.131 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi152.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-14T09:02:45.072 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-05-14T09:02:45.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-05-14T09:02:45.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:02:45.186 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-05-14T09:02:45.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-05-14T09:02:45.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-05-14T09:02:45.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:02:45.441 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-05-14T09:02:45.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-05-14T09:02:45.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-14T09:02:45.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:02:45.710 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-05-14T09:02:45.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-05-14T09:02:45.866 INFO:teuthology.run_tasks:Running task clock... 2024-05-14T09:02:45.877 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-14T09:02:45.878 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T09:02:45.878 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T09:02:45.886 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T09:02:45.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T09:02:45.893 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T09:02:45.894 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T09:02:45.971 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T09:02:45.978 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T09:02:45.989 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T09:02:46.015 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T09:02:46.020 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T09:02:46.033 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T09:02:46.084 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-05-14T09:02:46.090 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-05-14T09:02:46.105 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-05-14T09:02:46.115 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-05-14T09:02:46.120 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-05-14T09:02:46.134 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-05-14T09:02:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T09:02:46.158 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T09:02:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T09:02:46.195 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T09:02:46.200 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T09:02:46.213 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T09:02:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-05-14T09:02:46.337 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T09:02:46.337 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-05-14T09:02:46.337 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.337 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.337 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.337 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.338 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-05-14T09:02:46.346 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T09:02:46.346 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-05-14T09:02:46.347 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.347 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.347 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.347 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-05-14T09:02:46.370 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T09:02:46.370 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-05-14T09:02:46.370 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.370 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.370 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.370 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:02:46.372 INFO:teuthology.run_tasks:Running task install... 2024-05-14T09:02:46.380 DEBUG:teuthology.task.install:project ceph 2024-05-14T09:02:46.380 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}} 2024-05-14T09:02:46.380 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'} 2024-05-14T09:02:46.380 INFO:teuthology.task.install:Using flavor: default 2024-05-14T09:02:46.386 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-14T09:02:46.386 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-14T09:02:46.386 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T09:02:46.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:02:46.389 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T09:02:46.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:02:46.390 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T09:02:46.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:02:46.546 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T09:02:46.546 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T09:02:46.550 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T09:02:46.550 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T09:02:46.613 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T09:02:46.613 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T09:02:46.661 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T09:02:46.661 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:02:46.662 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T09:02:46.664 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T09:02:46.665 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:02:46.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T09:02:46.753 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T09:02:46.754 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T09:02:46.755 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T09:02:46.755 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T09:02:46.784 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T09:02:46.784 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:02:46.784 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T09:02:46.872 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T09:02:46.873 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T09:02:46.877 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T09:02:46.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T09:02:46.988 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T09:02:46.993 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T09:02:46.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T09:02:47.064 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-05-14T09:02:47.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-05-14T09:02:47.073 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-05-14T09:02:47.077 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-05-14T09:02:47.111 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T09:02:47.191 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-05-14T09:02:47.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-05-14T09:02:47.395 INFO:teuthology.orchestra.run.smithi120.stdout:57 files removed 2024-05-14T09:02:47.407 INFO:teuthology.orchestra.run.smithi152.stdout:57 files removed 2024-05-14T09:02:47.433 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T09:02:47.445 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T09:02:47.522 INFO:teuthology.orchestra.run.smithi175.stdout:57 files removed 2024-05-14T09:02:47.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T09:02:48.299 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 199 kB/s | 84 kB 00:00 2024-05-14T09:02:48.375 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 165 kB/s | 84 kB 00:00 2024-05-14T09:02:48.552 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 150 kB/s | 84 kB 00:00 2024-05-14T09:02:48.967 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-05-14T09:02:49.051 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-05-14T09:02:49.069 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-05-14T09:02:49.537 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-05-14T09:02:49.768 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-05-14T09:02:49.801 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 2.9 kB/s | 1.9 kB 00:00 2024-05-14T09:02:50.377 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-14T09:02:50.641 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-05-14T09:02:50.708 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.1 MB 00:00 2024-05-14T09:02:52.636 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-05-14T09:02:54.959 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-05-14T09:02:57.178 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.2 MB 00:00 2024-05-14T09:02:58.776 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 19 MB 00:06 2024-05-14T09:02:59.087 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-14T09:03:00.451 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.2 MB 00:01 2024-05-14T09:03:00.547 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-14T09:03:02.035 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 16 kB 00:00 2024-05-14T09:03:03.376 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-05-14T09:03:04.096 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-14T09:03:05.086 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-05-14T09:03:06.655 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-05-14T09:03:09.172 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:03:09.172 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:03:09.183 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T09:03:09.184 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T09:03:09.185 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T09:03:09.186 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T09:03:09.188 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T09:03:09.190 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T09:03:09.191 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T09:03:09.255 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-05-14T09:03:09.278 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-05-14T09:03:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T09:03:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T09:03:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T09:03:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T09:03:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T09:03:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T09:03:09.284 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T09:03:09.285 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T09:03:09.286 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T09:03:09.287 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T09:03:09.288 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T09:03:09.289 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:03:09.290 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-05-14T09:03:09.291 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-05-14T09:03:09.291 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-05-14T09:03:09.291 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 8 Packages 2024-05-14T09:03:09.291 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:03:09.291 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 219 M 2024-05-14T09:03:09.291 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-05-14T09:03:09.751 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 4.7 MB/s | 21 MB 00:04 2024-05-14T09:03:10.246 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-14T09:03:10.648 INFO:teuthology.orchestra.run.smithi175.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-05-14T09:03:10.965 INFO:teuthology.orchestra.run.smithi175.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 2.7 MB/s | 863 kB 00:00 2024-05-14T09:03:11.032 INFO:teuthology.orchestra.run.smithi175.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 2.2 MB/s | 147 kB 00:00 2024-05-14T09:03:11.282 INFO:teuthology.orchestra.run.smithi175.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 9.1 MB/s | 2.3 MB 00:00 2024-05-14T09:03:11.457 INFO:teuthology.orchestra.run.smithi175.stdout:(5/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-05-14T09:03:11.858 INFO:teuthology.orchestra.run.smithi175.stdout:(6/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 12 MB/s | 4.9 MB 00:00 2024-05-14T09:03:11.975 INFO:teuthology.orchestra.run.smithi175.stdout:(7/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 3.3 MB/s | 5.4 MB 00:01 2024-05-14T09:03:12.839 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:03:12.840 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:03:12.861 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T09:03:12.863 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T09:03:12.863 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T09:03:12.865 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T09:03:12.867 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T09:03:12.871 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T09:03:12.872 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T09:03:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-05-14T09:03:12.969 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2024-05-14T09:03:12.969 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-05-14T09:03:12.969 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2024-05-14T09:03:12.969 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-05-14T09:03:12.969 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T09:03:12.969 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T09:03:12.970 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T09:03:12.971 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T09:03:12.972 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T09:03:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T09:03:12.974 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T09:03:12.975 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T09:03:12.976 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T09:03:12.977 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T09:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T09:03:12.979 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T09:03:12.980 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T09:03:12.981 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout:Install 148 Packages 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 8 Packages 2024-05-14T09:03:12.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:03:12.983 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 219 M 2024-05-14T09:03:12.983 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-05-14T09:03:13.141 INFO:teuthology.orchestra.run.smithi175.stdout:(8/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x86 14 MB/s | 18 MB 00:01 2024-05-14T09:03:13.241 INFO:teuthology.orchestra.run.smithi175.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 254 kB/s | 25 kB 00:00 2024-05-14T09:03:13.400 INFO:teuthology.orchestra.run.smithi175.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 7.1 MB/s | 10 MB 00:01 2024-05-14T09:03:13.517 INFO:teuthology.orchestra.run.smithi175.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 1.9 MB/s | 224 kB 00:00 2024-05-14T09:03:13.617 INFO:teuthology.orchestra.run.smithi175.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 272 kB/s | 27 kB 00:00 2024-05-14T09:03:13.726 INFO:teuthology.orchestra.run.smithi175.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 295 kB/s | 32 kB 00:00 2024-05-14T09:03:13.876 INFO:teuthology.orchestra.run.smithi175.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 5.0 MB/s | 756 kB 00:00 2024-05-14T09:03:13.993 INFO:teuthology.orchestra.run.smithi175.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 1.3 MB/s | 157 kB 00:00 2024-05-14T09:03:14.098 INFO:teuthology.orchestra.run.smithi152.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-05-14T09:03:14.268 INFO:teuthology.orchestra.run.smithi175.stdout:(16/156): ceph-common-19.0.0-3588.ge2b755a6.el9 5.0 MB/s | 20 MB 00:03 2024-05-14T09:03:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:(17/156): librados-devel-19.0.0-3588.ge2b755a6. 423 kB/s | 127 kB 00:00 2024-05-14T09:03:14.394 INFO:teuthology.orchestra.run.smithi175.stdout:(18/156): libradosstriper1-19.0.0-3588.ge2b755a 3.9 MB/s | 497 kB 00:00 2024-05-14T09:03:14.544 INFO:teuthology.orchestra.run.smithi175.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 303 kB/s | 45 kB 00:00 2024-05-14T09:03:14.669 INFO:teuthology.orchestra.run.smithi175.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 1.1 MB/s | 135 kB 00:00 2024-05-14T09:03:14.840 INFO:teuthology.orchestra.run.smithi175.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 952 kB/s | 162 kB 00:00 2024-05-14T09:03:14.923 INFO:teuthology.orchestra.run.smithi152.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.0 MB/s | 863 kB 00:00 2024-05-14T09:03:14.978 INFO:teuthology.orchestra.run.smithi175.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 2.3 MB/s | 321 kB 00:00 2024-05-14T09:03:15.098 INFO:teuthology.orchestra.run.smithi152.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 844 kB/s | 147 kB 00:00 2024-05-14T09:03:15.162 INFO:teuthology.orchestra.run.smithi175.stdout:(23/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 5.9 MB/s | 5.2 MB 00:00 2024-05-14T09:03:15.195 INFO:teuthology.orchestra.run.smithi175.stdout:(24/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 1.4 MB/s | 301 kB 00:00 2024-05-14T09:03:15.271 INFO:teuthology.orchestra.run.smithi175.stdout:(25/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 924 kB/s | 100 kB 00:00 2024-05-14T09:03:15.304 INFO:teuthology.orchestra.run.smithi175.stdout:(26/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 794 kB/s | 86 kB 00:00 2024-05-14T09:03:15.421 INFO:teuthology.orchestra.run.smithi175.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.4 MB/s | 170 kB 00:00 2024-05-14T09:03:15.530 INFO:teuthology.orchestra.run.smithi175.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 318 kB/s | 34 kB 00:00 2024-05-14T09:03:15.705 INFO:teuthology.orchestra.run.smithi175.stdout:(29/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 7.0 MB/s | 3.0 MB 00:00 2024-05-14T09:03:15.739 INFO:teuthology.orchestra.run.smithi175.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 685 kB/s | 142 kB 00:00 2024-05-14T09:03:15.870 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-14T09:03:16.148 INFO:teuthology.orchestra.run.smithi152.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 2.2 MB/s | 2.3 MB 00:01 2024-05-14T09:03:16.164 INFO:teuthology.orchestra.run.smithi175.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 7.7 MB/s | 3.5 MB 00:00 2024-05-14T09:03:16.256 INFO:teuthology.orchestra.run.smithi175.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 3.0 MB/s | 274 kB 00:00 2024-05-14T09:03:16.339 INFO:teuthology.orchestra.run.smithi175.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 595 kB/s | 49 kB 00:00 2024-05-14T09:03:16.423 INFO:teuthology.orchestra.run.smithi175.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 200 kB/s | 16 kB 00:00 2024-05-14T09:03:16.432 INFO:teuthology.orchestra.run.smithi152.stdout:(5/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 7.1 MB/s | 20 MB 00:02 2024-05-14T09:03:16.523 INFO:teuthology.orchestra.run.smithi175.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.7 MB/s | 273 kB 00:00 2024-05-14T09:03:16.657 INFO:teuthology.orchestra.run.smithi175.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 5.6 MB/s | 763 kB 00:00 2024-05-14T09:03:16.741 INFO:teuthology.orchestra.run.smithi175.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 221 kB/s | 18 kB 00:00 2024-05-14T09:03:16.749 INFO:teuthology.orchestra.run.smithi152.stdout:(6/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 2.5 MB/s | 1.5 MB 00:00 2024-05-14T09:03:16.916 INFO:teuthology.orchestra.run.smithi175.stdout:(38/156): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2024-05-14T09:03:17.291 INFO:teuthology.orchestra.run.smithi152.stdout:(7/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 5.7 MB/s | 4.9 MB 00:00 2024-05-14T09:03:17.458 INFO:teuthology.orchestra.run.smithi175.stdout:(39/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 10 MB/s | 43 MB 00:04 2024-05-14T09:03:17.483 INFO:teuthology.orchestra.run.smithi175.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 108 kB/s | 80 kB 00:00 2024-05-14T09:03:17.908 INFO:teuthology.orchestra.run.smithi175.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 596 kB/s | 253 kB 00:00 2024-05-14T09:03:17.975 INFO:teuthology.orchestra.run.smithi175.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 759 kB/s | 803 kB 00:01 2024-05-14T09:03:18.009 INFO:teuthology.orchestra.run.smithi175.stdout:(43/156): libquadmath-11.4.1-3.el9.x86_64.rpm 355 kB/s | 195 kB 00:00 2024-05-14T09:03:18.084 INFO:teuthology.orchestra.run.smithi175.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 988 kB/s | 106 kB 00:00 2024-05-14T09:03:18.158 INFO:teuthology.orchestra.run.smithi152.stdout:(8/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-05-14T09:03:18.193 INFO:teuthology.orchestra.run.smithi175.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-14T09:03:18.218 INFO:teuthology.orchestra.run.smithi175.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 649 kB/s | 135 kB 00:00 2024-05-14T09:03:18.241 INFO:teuthology.orchestra.run.smithi152.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 306 kB/s | 25 kB 00:00 2024-05-14T09:03:18.327 INFO:teuthology.orchestra.run.smithi175.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-05-14T09:03:18.360 INFO:teuthology.orchestra.run.smithi175.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-05-14T09:03:18.414 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:03:18.416 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:03:18.435 INFO:teuthology.orchestra.run.smithi175.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-05-14T09:03:18.436 INFO:teuthology.orchestra.run.smithi120.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T09:03:18.438 INFO:teuthology.orchestra.run.smithi120.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T09:03:18.439 INFO:teuthology.orchestra.run.smithi120.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T09:03:18.440 INFO:teuthology.orchestra.run.smithi120.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T09:03:18.443 INFO:teuthology.orchestra.run.smithi120.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T09:03:18.446 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T09:03:18.447 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T09:03:18.475 INFO:teuthology.orchestra.run.smithi152.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 8.6 MB/s | 10 MB 00:01 2024-05-14T09:03:18.477 INFO:teuthology.orchestra.run.smithi175.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 527 kB/s | 21 kB 00:00 2024-05-14T09:03:18.503 INFO:teuthology.orchestra.run.smithi175.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-05-14T09:03:18.518 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-05-14T09:03:18.525 INFO:teuthology.orchestra.run.smithi152.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 4.5 MB/s | 224 kB 00:00 2024-05-14T09:03:18.532 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-05-14T09:03:18.532 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-05-14T09:03:18.532 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-05-14T09:03:18.532 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T09:03:18.533 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T09:03:18.534 INFO:teuthology.orchestra.run.smithi120.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T09:03:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T09:03:18.536 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T09:03:18.537 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T09:03:18.538 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T09:03:18.539 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T09:03:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T09:03:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T09:03:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T09:03:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T09:03:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:03:18.545 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-05-14T09:03:18.546 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-05-14T09:03:18.546 INFO:teuthology.orchestra.run.smithi120.stdout:Install 148 Packages 2024-05-14T09:03:18.546 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 8 Packages 2024-05-14T09:03:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:03:18.547 INFO:teuthology.orchestra.run.smithi175.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-05-14T09:03:18.547 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 219 M 2024-05-14T09:03:18.547 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-05-14T09:03:18.570 INFO:teuthology.orchestra.run.smithi175.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 494 kB/s | 33 kB 00:00 2024-05-14T09:03:18.600 INFO:teuthology.orchestra.run.smithi152.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 364 kB/s | 27 kB 00:00 2024-05-14T09:03:18.620 INFO:teuthology.orchestra.run.smithi175.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-05-14T09:03:18.646 INFO:teuthology.orchestra.run.smithi175.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 244 kB/s | 18 kB 00:00 2024-05-14T09:03:18.671 INFO:teuthology.orchestra.run.smithi175.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 225 kB/s | 11 kB 00:00 2024-05-14T09:03:18.676 INFO:teuthology.orchestra.run.smithi152.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 426 kB/s | 32 kB 00:00 2024-05-14T09:03:18.707 INFO:teuthology.orchestra.run.smithi175.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-14T09:03:18.722 INFO:teuthology.orchestra.run.smithi175.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 915 kB/s | 45 kB 00:00 2024-05-14T09:03:18.780 INFO:teuthology.orchestra.run.smithi175.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-05-14T09:03:18.793 INFO:teuthology.orchestra.run.smithi152.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 6.4 MB/s | 756 kB 00:00 2024-05-14T09:03:18.814 INFO:teuthology.orchestra.run.smithi175.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 782 kB/s | 25 kB 00:00 2024-05-14T09:03:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 3.1 MB/s | 157 kB 00:00 2024-05-14T09:03:18.858 INFO:teuthology.orchestra.run.smithi175.stdout:(61/156): libtool-2.4.6-45.el9.x86_64.rpm 4.3 MB/s | 582 kB 00:00 2024-05-14T09:03:18.881 INFO:teuthology.orchestra.run.smithi175.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 718 kB/s | 47 kB 00:00 2024-05-14T09:03:18.893 INFO:teuthology.orchestra.run.smithi152.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 2.5 MB/s | 127 kB 00:00 2024-05-14T09:03:18.914 INFO:teuthology.orchestra.run.smithi175.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-14T09:03:18.990 INFO:teuthology.orchestra.run.smithi175.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-05-14T09:03:19.011 INFO:teuthology.orchestra.run.smithi152.stdout:(17/156): libradosstriper1-19.0.0-3588.ge2b755a 4.2 MB/s | 497 kB 00:00 2024-05-14T09:03:19.015 INFO:teuthology.orchestra.run.smithi175.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 354 kB/s | 35 kB 00:00 2024-05-14T09:03:19.049 INFO:teuthology.orchestra.run.smithi175.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-05-14T09:03:19.157 INFO:teuthology.orchestra.run.smithi175.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-14T09:03:19.224 INFO:teuthology.orchestra.run.smithi175.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 911 kB 00:00 2024-05-14T09:03:19.316 INFO:teuthology.orchestra.run.smithi175.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-14T09:03:19.351 INFO:teuthology.orchestra.run.smithi175.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-05-14T09:03:19.475 INFO:teuthology.orchestra.run.smithi175.stdout:(71/156): openblas-openmp-0.3.21-2.el9.x86_64.r 9.8 MB/s | 4.7 MB 00:00 2024-05-14T09:03:19.517 INFO:teuthology.orchestra.run.smithi175.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-05-14T09:03:19.530 INFO:teuthology.orchestra.run.smithi152.stdout:(18/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 10 MB/s | 5.2 MB 00:00 2024-05-14T09:03:19.547 INFO:teuthology.orchestra.run.smithi120.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-05-14T09:03:19.595 INFO:teuthology.orchestra.run.smithi152.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 688 kB/s | 45 kB 00:00 2024-05-14T09:03:19.617 INFO:teuthology.orchestra.run.smithi175.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2024-05-14T09:03:19.653 INFO:teuthology.orchestra.run.smithi152.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 2.3 MB/s | 135 kB 00:00 2024-05-14T09:03:19.667 INFO:teuthology.orchestra.run.smithi175.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-14T09:03:19.720 INFO:teuthology.orchestra.run.smithi152.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 2.4 MB/s | 162 kB 00:00 2024-05-14T09:03:19.772 INFO:teuthology.orchestra.run.smithi120.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 3.8 MB/s | 863 kB 00:00 2024-05-14T09:03:19.784 INFO:teuthology.orchestra.run.smithi175.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-14T09:03:19.818 INFO:teuthology.orchestra.run.smithi175.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-05-14T09:03:19.843 INFO:teuthology.orchestra.run.smithi175.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 443 kB/s | 26 kB 00:00 2024-05-14T09:03:19.847 INFO:teuthology.orchestra.run.smithi120.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 1.9 MB/s | 147 kB 00:00 2024-05-14T09:03:19.862 INFO:teuthology.orchestra.run.smithi152.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 2.2 MB/s | 321 kB 00:00 2024-05-14T09:03:19.868 INFO:teuthology.orchestra.run.smithi175.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 388 kB/s | 19 kB 00:00 2024-05-14T09:03:19.902 INFO:teuthology.orchestra.run.smithi175.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-14T09:03:19.927 INFO:teuthology.orchestra.run.smithi175.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 603 kB/s | 35 kB 00:00 2024-05-14T09:03:19.977 INFO:teuthology.orchestra.run.smithi175.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-05-14T09:03:20.021 INFO:teuthology.orchestra.run.smithi152.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 1.9 MB/s | 301 kB 00:00 2024-05-14T09:03:20.071 INFO:teuthology.orchestra.run.smithi152.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 2.0 MB/s | 100 kB 00:00 2024-05-14T09:03:20.073 INFO:teuthology.orchestra.run.smithi120.stdout:(4/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 6.9 MB/s | 5.4 MB 00:00 2024-05-14T09:03:20.111 INFO:teuthology.orchestra.run.smithi175.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-05-14T09:03:20.130 INFO:teuthology.orchestra.run.smithi152.stdout:(25/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.5 MB/s | 86 kB 00:00 2024-05-14T09:03:20.153 INFO:teuthology.orchestra.run.smithi175.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-05-14T09:03:20.173 INFO:teuthology.orchestra.run.smithi120.stdout:(5/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 7.0 MB/s | 2.3 MB 00:00 2024-05-14T09:03:20.179 INFO:teuthology.orchestra.run.smithi175.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-05-14T09:03:20.212 INFO:teuthology.orchestra.run.smithi175.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 732 kB/s | 42 kB 00:00 2024-05-14T09:03:20.246 INFO:teuthology.orchestra.run.smithi175.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-14T09:03:20.248 INFO:teuthology.orchestra.run.smithi120.stdout:(6/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-05-14T09:03:20.280 INFO:teuthology.orchestra.run.smithi175.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-14T09:03:20.313 INFO:teuthology.orchestra.run.smithi175.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-14T09:03:20.338 INFO:teuthology.orchestra.run.smithi175.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 885 kB/s | 51 kB 00:00 2024-05-14T09:03:20.364 INFO:teuthology.orchestra.run.smithi175.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-05-14T09:03:20.406 INFO:teuthology.orchestra.run.smithi175.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-05-14T09:03:20.447 INFO:teuthology.orchestra.run.smithi175.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-05-14T09:03:20.480 INFO:teuthology.orchestra.run.smithi152.stdout:(26/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 4.8 MB/s | 18 MB 00:03 2024-05-14T09:03:20.584 INFO:teuthology.orchestra.run.smithi175.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-05-14T09:03:20.623 INFO:teuthology.orchestra.run.smithi175.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-05-14T09:03:20.640 INFO:teuthology.orchestra.run.smithi175.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 648 kB/s | 36 kB 00:00 2024-05-14T09:03:20.665 INFO:teuthology.orchestra.run.smithi175.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-14T09:03:20.699 INFO:teuthology.orchestra.run.smithi175.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-05-14T09:03:20.716 INFO:teuthology.orchestra.run.smithi175.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-14T09:03:20.741 INFO:teuthology.orchestra.run.smithi175.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-05-14T09:03:20.755 INFO:teuthology.orchestra.run.smithi152.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 619 kB/s | 170 kB 00:00 2024-05-14T09:03:20.766 INFO:teuthology.orchestra.run.smithi175.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-14T09:03:20.792 INFO:teuthology.orchestra.run.smithi175.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-05-14T09:03:20.817 INFO:teuthology.orchestra.run.smithi175.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 452 kB/s | 22 kB 00:00 2024-05-14T09:03:20.839 INFO:teuthology.orchestra.run.smithi152.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 414 kB/s | 34 kB 00:00 2024-05-14T09:03:20.844 INFO:teuthology.orchestra.run.smithi120.stdout:(7/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 7.3 MB/s | 4.9 MB 00:00 2024-05-14T09:03:20.884 INFO:teuthology.orchestra.run.smithi175.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 9.2 MB/s | 863 kB 00:00 2024-05-14T09:03:20.923 INFO:teuthology.orchestra.run.smithi152.stdout:(29/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 3.8 MB/s | 3.0 MB 00:00 2024-05-14T09:03:20.956 INFO:teuthology.orchestra.run.smithi152.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 1.2 MB/s | 142 kB 00:00 2024-05-14T09:03:21.284 INFO:teuthology.orchestra.run.smithi175.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-05-14T09:03:21.435 INFO:teuthology.orchestra.run.smithi175.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 131 kB/s | 19 kB 00:00 2024-05-14T09:03:21.485 INFO:teuthology.orchestra.run.smithi175.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 822 kB/s | 548 kB 00:00 2024-05-14T09:03:21.510 INFO:teuthology.orchestra.run.smithi175.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 494 kB/s | 309 kB 00:00 2024-05-14T09:03:21.735 INFO:teuthology.orchestra.run.smithi175.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-14T09:03:21.769 INFO:teuthology.orchestra.run.smithi175.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 104 kB/s | 26 kB 00:00 2024-05-14T09:03:21.794 INFO:teuthology.orchestra.run.smithi175.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 177 kB/s | 49 kB 00:00 2024-05-14T09:03:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 3.8 MB/s | 3.5 MB 00:00 2024-05-14T09:03:21.861 INFO:teuthology.orchestra.run.smithi175.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-14T09:03:21.894 INFO:teuthology.orchestra.run.smithi175.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-14T09:03:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 4.7 MB/s | 274 kB 00:00 2024-05-14T09:03:21.945 INFO:teuthology.orchestra.run.smithi175.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-05-14T09:03:21.949 INFO:teuthology.orchestra.run.smithi120.stdout:(8/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x86 10 MB/s | 18 MB 00:01 2024-05-14T09:03:21.991 INFO:teuthology.orchestra.run.smithi152.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 666 kB/s | 49 kB 00:00 2024-05-14T09:03:21.995 INFO:teuthology.orchestra.run.smithi175.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-05-14T09:03:21.999 INFO:teuthology.orchestra.run.smithi120.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 515 kB/s | 25 kB 00:00 2024-05-14T09:03:22.020 INFO:teuthology.orchestra.run.smithi175.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 628 kB/s | 43 kB 00:00 2024-05-14T09:03:22.045 INFO:teuthology.orchestra.run.smithi175.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 342 kB/s | 32 kB 00:00 2024-05-14T09:03:22.071 INFO:teuthology.orchestra.run.smithi175.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 203 kB/s | 15 kB 00:00 2024-05-14T09:03:22.074 INFO:teuthology.orchestra.run.smithi152.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 199 kB/s | 16 kB 00:00 2024-05-14T09:03:22.121 INFO:teuthology.orchestra.run.smithi175.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2024-05-14T09:03:22.133 INFO:teuthology.orchestra.run.smithi152.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 4.6 MB/s | 273 kB 00:00 2024-05-14T09:03:22.154 INFO:teuthology.orchestra.run.smithi175.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-05-14T09:03:22.180 INFO:teuthology.orchestra.run.smithi175.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-05-14T09:03:22.183 INFO:teuthology.orchestra.run.smithi120.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 7.6 MB/s | 10 MB 00:01 2024-05-14T09:03:22.205 INFO:teuthology.orchestra.run.smithi175.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 456 kB/s | 35 kB 00:00 2024-05-14T09:03:22.255 INFO:teuthology.orchestra.run.smithi175.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-14T09:03:22.292 INFO:teuthology.orchestra.run.smithi120.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 2.0 MB/s | 224 kB 00:00 2024-05-14T09:03:22.317 INFO:teuthology.orchestra.run.smithi152.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 4.1 MB/s | 763 kB 00:00 2024-05-14T09:03:22.350 INFO:teuthology.orchestra.run.smithi120.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 472 kB/s | 27 kB 00:00 2024-05-14T09:03:22.355 INFO:teuthology.orchestra.run.smithi175.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-14T09:03:22.381 INFO:teuthology.orchestra.run.smithi175.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 826 kB/s | 144 kB 00:00 2024-05-14T09:03:22.406 INFO:teuthology.orchestra.run.smithi175.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 77 kB/s | 11 kB 00:00 2024-05-14T09:03:22.409 INFO:teuthology.orchestra.run.smithi152.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 201 kB/s | 18 kB 00:00 2024-05-14T09:03:22.426 INFO:teuthology.orchestra.run.smithi120.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 427 kB/s | 32 kB 00:00 2024-05-14T09:03:22.448 INFO:teuthology.orchestra.run.smithi175.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 269 kB/s | 18 kB 00:00 2024-05-14T09:03:22.473 INFO:teuthology.orchestra.run.smithi175.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 256 kB/s | 23 kB 00:00 2024-05-14T09:03:22.498 INFO:teuthology.orchestra.run.smithi175.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-05-14T09:03:22.540 INFO:teuthology.orchestra.run.smithi175.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 300 kB/s | 20 kB 00:00 2024-05-14T09:03:22.599 INFO:teuthology.orchestra.run.smithi175.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-05-14T09:03:22.616 INFO:teuthology.orchestra.run.smithi120.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 3.9 MB/s | 756 kB 00:00 2024-05-14T09:03:22.624 INFO:teuthology.orchestra.run.smithi175.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 371 kB/s | 46 kB 00:00 2024-05-14T09:03:22.649 INFO:teuthology.orchestra.run.smithi175.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 803 kB/s | 79 kB 00:00 2024-05-14T09:03:22.691 INFO:teuthology.orchestra.run.smithi175.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 890 kB/s | 58 kB 00:00 2024-05-14T09:03:22.701 INFO:teuthology.orchestra.run.smithi120.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 1.8 MB/s | 157 kB 00:00 2024-05-14T09:03:22.725 INFO:teuthology.orchestra.run.smithi175.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-05-14T09:03:22.750 INFO:teuthology.orchestra.run.smithi175.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-14T09:03:22.775 INFO:teuthology.orchestra.run.smithi175.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-05-14T09:03:22.777 INFO:teuthology.orchestra.run.smithi120.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 1.7 MB/s | 127 kB 00:00 2024-05-14T09:03:22.817 INFO:teuthology.orchestra.run.smithi175.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 435 kB/s | 28 kB 00:00 2024-05-14T09:03:22.835 INFO:teuthology.orchestra.run.smithi152.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 189 kB/s | 80 kB 00:00 2024-05-14T09:03:22.842 INFO:teuthology.orchestra.run.smithi175.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 342 kB/s | 31 kB 00:00 2024-05-14T09:03:22.887 INFO:teuthology.orchestra.run.smithi175.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-05-14T09:03:22.918 INFO:teuthology.orchestra.run.smithi175.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 605 kB/s | 59 kB 00:00 2024-05-14T09:03:22.961 INFO:teuthology.orchestra.run.smithi120.stdout:(17/156): libradosstriper1-19.0.0-3588.ge2b755a 2.7 MB/s | 497 kB 00:00 2024-05-14T09:03:23.010 INFO:teuthology.orchestra.run.smithi175.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 296 kB/s | 36 kB 00:00 2024-05-14T09:03:23.035 INFO:teuthology.orchestra.run.smithi175.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 350 kB/s | 51 kB 00:00 2024-05-14T09:03:23.060 INFO:teuthology.orchestra.run.smithi175.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-05-14T09:03:23.086 INFO:teuthology.orchestra.run.smithi175.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-14T09:03:23.144 INFO:teuthology.orchestra.run.smithi175.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.1 MB/s | 427 kB 00:00 2024-05-14T09:03:23.169 INFO:teuthology.orchestra.run.smithi175.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 186 kB/s | 20 kB 00:00 2024-05-14T09:03:23.195 INFO:teuthology.orchestra.run.smithi175.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-05-14T09:03:23.278 INFO:teuthology.orchestra.run.smithi175.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-14T09:03:23.368 INFO:teuthology.orchestra.run.smithi152.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-05-14T09:03:23.485 INFO:teuthology.orchestra.run.smithi152.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-05-14T09:03:23.610 INFO:teuthology.orchestra.run.smithi152.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-05-14T09:03:23.619 INFO:teuthology.orchestra.run.smithi120.stdout:(18/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 7.8 MB/s | 5.2 MB 00:00 2024-05-14T09:03:23.720 INFO:teuthology.orchestra.run.smithi120.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 456 kB/s | 45 kB 00:00 2024-05-14T09:03:23.820 INFO:teuthology.orchestra.run.smithi120.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 1.3 MB/s | 135 kB 00:00 2024-05-14T09:03:23.911 INFO:teuthology.orchestra.run.smithi152.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-05-14T09:03:23.928 INFO:teuthology.orchestra.run.smithi120.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.5 MB/s | 162 kB 00:00 2024-05-14T09:03:24.019 INFO:teuthology.orchestra.run.smithi152.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 991 kB/s | 106 kB 00:00 2024-05-14T09:03:24.029 INFO:teuthology.orchestra.run.smithi120.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 3.2 MB/s | 321 kB 00:00 2024-05-14T09:03:24.112 INFO:teuthology.orchestra.run.smithi175.stdout:(149/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-05-14T09:03:24.113 INFO:teuthology.orchestra.run.smithi120.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 3.6 MB/s | 301 kB 00:00 2024-05-14T09:03:24.171 INFO:teuthology.orchestra.run.smithi120.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.7 MB/s | 100 kB 00:00 2024-05-14T09:03:24.212 INFO:teuthology.orchestra.run.smithi175.stdout:(150/156): librados2-19.0.0-3588.ge2b755a6.el9. 3.3 MB/s | 3.3 MB 00:01 2024-05-14T09:03:24.236 INFO:teuthology.orchestra.run.smithi152.stdout:(44/156): ceph-mgr-diskprediction-local-19.0.0- 2.3 MB/s | 7.4 MB 00:03 2024-05-14T09:03:24.238 INFO:teuthology.orchestra.run.smithi120.stdout:(25/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-14T09:03:24.262 INFO:teuthology.orchestra.run.smithi152.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 559 kB/s | 135 kB 00:00 2024-05-14T09:03:24.370 INFO:teuthology.orchestra.run.smithi152.stdout:(46/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-14T09:03:24.446 INFO:teuthology.orchestra.run.smithi175.stdout:(151/156): NetworkManager-1.47.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-05-14T09:03:24.496 INFO:teuthology.orchestra.run.smithi152.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-05-14T09:03:24.539 INFO:teuthology.orchestra.run.smithi120.stdout:(26/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 10 MB/s | 3.0 MB 00:00 2024-05-14T09:03:24.563 INFO:teuthology.orchestra.run.smithi175.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 119 kB/s | 41 kB 00:00 2024-05-14T09:03:24.596 INFO:teuthology.orchestra.run.smithi175.stdout:(153/156): NetworkManager-tui-1.47.90-1.el9.x86 1.6 MB/s | 248 kB 00:00 2024-05-14T09:03:24.597 INFO:teuthology.orchestra.run.smithi120.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-14T09:03:24.646 INFO:teuthology.orchestra.run.smithi152.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 6.1 MB/s | 943 kB 00:00 2024-05-14T09:03:24.647 INFO:teuthology.orchestra.run.smithi120.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 697 kB/s | 34 kB 00:00 2024-05-14T09:03:24.672 INFO:teuthology.orchestra.run.smithi152.stdout:(49/156): python3-requests-2.25.1-8.el9.noarch. 288 kB/s | 125 kB 00:00 2024-05-14T09:03:24.714 INFO:teuthology.orchestra.run.smithi120.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 2.1 MB/s | 142 kB 00:00 2024-05-14T09:03:24.755 INFO:teuthology.orchestra.run.smithi152.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 991 kB/s | 107 kB 00:00 2024-05-14T09:03:24.797 INFO:teuthology.orchestra.run.smithi152.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 172 kB/s | 21 kB 00:00 2024-05-14T09:03:24.872 INFO:teuthology.orchestra.run.smithi152.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-14T09:03:24.921 INFO:teuthology.orchestra.run.smithi175.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.4 MB/s | 2.4 MB 00:00 2024-05-14T09:03:24.931 INFO:teuthology.orchestra.run.smithi152.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 246 kB/s | 33 kB 00:00 2024-05-14T09:03:25.072 INFO:teuthology.orchestra.run.smithi175.stdout:(155/156): NetworkManager-libnm-1.47.90-1.el9.x 1.9 MB/s | 1.8 MB 00:00 2024-05-14T09:03:25.081 INFO:teuthology.orchestra.run.smithi152.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 122 kB/s | 18 kB 00:00 2024-05-14T09:03:25.082 INFO:teuthology.orchestra.run.smithi120.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 9.7 MB/s | 3.5 MB 00:00 2024-05-14T09:03:25.207 INFO:teuthology.orchestra.run.smithi152.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 90 kB/s | 11 kB 00:00 2024-05-14T09:03:25.297 INFO:teuthology.orchestra.run.smithi175.stdout:(156/156): openssl-3.2.1-1.el9.x86_64.rpm 1.8 MB/s | 1.3 MB 00:00 2024-05-14T09:03:25.307 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-05-14T09:03:25.307 INFO:teuthology.orchestra.run.smithi175.stdout:Total 14 MB/s | 219 MB 00:16 2024-05-14T09:03:25.399 INFO:teuthology.orchestra.run.smithi152.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 839 kB/s | 160 kB 00:00 2024-05-14T09:03:25.524 INFO:teuthology.orchestra.run.smithi152.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 364 kB/s | 45 kB 00:00 2024-05-14T09:03:25.649 INFO:teuthology.orchestra.run.smithi120.stdout:(31/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 12 MB/s | 43 MB 00:03 2024-05-14T09:03:25.732 INFO:teuthology.orchestra.run.smithi120.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 3.3 MB/s | 274 kB 00:00 2024-05-14T09:03:25.774 INFO:teuthology.orchestra.run.smithi120.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 1.2 MB/s | 49 kB 00:00 2024-05-14T09:03:25.799 INFO:teuthology.orchestra.run.smithi152.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2024-05-14T09:03:25.816 INFO:teuthology.orchestra.run.smithi120.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 403 kB/s | 16 kB 00:00 2024-05-14T09:03:25.934 INFO:teuthology.orchestra.run.smithi152.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 4.3 MB/s | 582 kB 00:00 2024-05-14T09:03:25.967 INFO:teuthology.orchestra.run.smithi120.stdout:(35/156): ceph-mgr-diskprediction-local-19.0.0- 8.4 MB/s | 7.4 MB 00:00 2024-05-14T09:03:26.000 INFO:teuthology.orchestra.run.smithi120.stdout:(36/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 1.5 MB/s | 273 kB 00:00 2024-05-14T09:03:26.051 INFO:teuthology.orchestra.run.smithi120.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 371 kB/s | 18 kB 00:00 2024-05-14T09:03:26.067 INFO:teuthology.orchestra.run.smithi152.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 192 kB/s | 25 kB 00:00 2024-05-14T09:03:26.093 INFO:teuthology.orchestra.run.smithi120.stdout:(38/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 6.0 MB/s | 763 kB 00:00 2024-05-14T09:03:26.217 INFO:teuthology.orchestra.run.smithi152.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 318 kB/s | 47 kB 00:00 2024-05-14T09:03:26.360 INFO:teuthology.orchestra.run.smithi152.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-05-14T09:03:26.368 INFO:teuthology.orchestra.run.smithi120.stdout:(39/156): ceph-common-19.0.0-3588.ge2b755a6.el9 2.8 MB/s | 20 MB 00:07 2024-05-14T09:03:26.393 INFO:teuthology.orchestra.run.smithi120.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 235 kB/s | 80 kB 00:00 2024-05-14T09:03:26.468 INFO:teuthology.orchestra.run.smithi152.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-14T09:03:26.494 INFO:teuthology.orchestra.run.smithi120.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-05-14T09:03:26.528 INFO:teuthology.orchestra.run.smithi120.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-05-14T09:03:26.553 INFO:teuthology.orchestra.run.smithi120.stdout:(43/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-05-14T09:03:26.578 INFO:teuthology.orchestra.run.smithi120.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-14T09:03:26.602 INFO:teuthology.orchestra.run.smithi152.stdout:(64/156): openblas-0.3.21-2.el9.x86_64.rpm 265 kB/s | 35 kB 00:00 2024-05-14T09:03:26.611 INFO:teuthology.orchestra.run.smithi120.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-14T09:03:26.645 INFO:teuthology.orchestra.run.smithi120.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-14T09:03:26.679 INFO:teuthology.orchestra.run.smithi120.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-14T09:03:26.737 INFO:teuthology.orchestra.run.smithi120.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-05-14T09:03:26.788 INFO:teuthology.orchestra.run.smithi120.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 4.8 MB/s | 689 kB 00:00 2024-05-14T09:03:26.797 INFO:teuthology.orchestra.run.smithi152.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.6 MB/s | 3.0 MB 00:01 2024-05-14T09:03:26.813 INFO:teuthology.orchestra.run.smithi120.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-05-14T09:03:26.847 INFO:teuthology.orchestra.run.smithi120.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 372 kB/s | 21 kB 00:00 2024-05-14T09:03:26.880 INFO:teuthology.orchestra.run.smithi120.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-05-14T09:03:26.914 INFO:teuthology.orchestra.run.smithi120.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 494 kB/s | 33 kB 00:00 2024-05-14T09:03:26.981 INFO:teuthology.orchestra.run.smithi120.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-05-14T09:03:27.006 INFO:teuthology.orchestra.run.smithi120.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 200 kB/s | 18 kB 00:00 2024-05-14T09:03:27.040 INFO:teuthology.orchestra.run.smithi120.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-05-14T09:03:27.074 INFO:teuthology.orchestra.run.smithi120.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-05-14T09:03:27.099 INFO:teuthology.orchestra.run.smithi120.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 782 kB/s | 45 kB 00:00 2024-05-14T09:03:27.150 INFO:teuthology.orchestra.run.smithi120.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-05-14T09:03:27.192 INFO:teuthology.orchestra.run.smithi120.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 6.3 MB/s | 582 kB 00:00 2024-05-14T09:03:27.209 INFO:teuthology.orchestra.run.smithi120.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 439 kB/s | 25 kB 00:00 2024-05-14T09:03:27.234 INFO:teuthology.orchestra.run.smithi120.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-14T09:03:27.268 INFO:teuthology.orchestra.run.smithi120.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-14T09:03:27.301 INFO:teuthology.orchestra.run.smithi120.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-05-14T09:03:27.328 INFO:teuthology.orchestra.run.smithi120.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-05-14T09:03:27.411 INFO:teuthology.orchestra.run.smithi120.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.7 MB/s | 3.0 MB 00:00 2024-05-14T09:03:27.511 INFO:teuthology.orchestra.run.smithi120.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-05-14T09:03:27.611 INFO:teuthology.orchestra.run.smithi120.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-05-14T09:03:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-05-14T09:03:27.745 INFO:teuthology.orchestra.run.smithi120.stdout:(70/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-14T09:03:27.779 INFO:teuthology.orchestra.run.smithi120.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 800 kB/s | 133 kB 00:00 2024-05-14T09:03:27.821 INFO:teuthology.orchestra.run.smithi120.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-05-14T09:03:27.863 INFO:teuthology.orchestra.run.smithi120.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-05-14T09:03:27.913 INFO:teuthology.orchestra.run.smithi120.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 4.9 MB/s | 244 kB 00:00 2024-05-14T09:03:27.963 INFO:teuthology.orchestra.run.smithi120.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-14T09:03:28.005 INFO:teuthology.orchestra.run.smithi120.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 628 kB/s | 26 kB 00:00 2024-05-14T09:03:28.072 INFO:teuthology.orchestra.run.smithi120.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 291 kB/s | 19 kB 00:00 2024-05-14T09:03:28.123 INFO:teuthology.orchestra.run.smithi120.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-14T09:03:28.231 INFO:teuthology.orchestra.run.smithi120.stdout:(79/156): postgresql-server-13.14-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-05-14T09:03:28.256 INFO:teuthology.orchestra.run.smithi120.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 261 kB/s | 35 kB 00:00 2024-05-14T09:03:28.307 INFO:teuthology.orchestra.run.smithi120.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-05-14T09:03:28.334 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-05-14T09:03:28.424 INFO:teuthology.orchestra.run.smithi120.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-05-14T09:03:28.457 INFO:teuthology.orchestra.run.smithi120.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-05-14T09:03:28.483 INFO:teuthology.orchestra.run.smithi120.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-14T09:03:28.508 INFO:teuthology.orchestra.run.smithi120.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 849 kB/s | 42 kB 00:00 2024-05-14T09:03:28.542 INFO:teuthology.orchestra.run.smithi120.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-05-14T09:03:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-05-14T09:03:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-05-14T09:03:28.576 INFO:teuthology.orchestra.run.smithi120.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-14T09:03:28.609 INFO:teuthology.orchestra.run.smithi120.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-14T09:03:28.635 INFO:teuthology.orchestra.run.smithi120.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 882 kB/s | 51 kB 00:00 2024-05-14T09:03:28.660 INFO:teuthology.orchestra.run.smithi120.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-05-14T09:03:28.693 INFO:teuthology.orchestra.run.smithi120.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.3 MB/s | 42 kB 00:00 2024-05-14T09:03:28.727 INFO:teuthology.orchestra.run.smithi120.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-05-14T09:03:28.778 INFO:teuthology.orchestra.run.smithi120.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 221 kB 00:00 2024-05-14T09:03:28.878 INFO:teuthology.orchestra.run.smithi120.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.9 MB/s | 5.1 MB 00:00 2024-05-14T09:03:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 288 kB/s | 36 kB 00:00 2024-05-14T09:03:28.929 INFO:teuthology.orchestra.run.smithi120.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 957 kB/s | 47 kB 00:00 2024-05-14T09:03:28.962 INFO:teuthology.orchestra.run.smithi120.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-05-14T09:03:28.987 INFO:teuthology.orchestra.run.smithi120.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-14T09:03:29.013 INFO:teuthology.orchestra.run.smithi120.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-14T09:03:29.038 INFO:teuthology.orchestra.run.smithi120.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-14T09:03:29.063 INFO:teuthology.orchestra.run.smithi120.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-05-14T09:03:29.089 INFO:teuthology.orchestra.run.smithi120.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 450 kB/s | 22 kB 00:00 2024-05-14T09:03:29.156 INFO:teuthology.orchestra.run.smithi120.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 9.2 MB/s | 863 kB 00:00 2024-05-14T09:03:29.515 INFO:teuthology.orchestra.run.smithi120.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-05-14T09:03:29.694 INFO:teuthology.orchestra.run.smithi152.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 1.5 MB/s | 4.7 MB 00:03 2024-05-14T09:03:29.698 INFO:teuthology.orchestra.run.smithi120.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 109 kB/s | 19 kB 00:00 2024-05-14T09:03:29.741 INFO:teuthology.orchestra.run.smithi120.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 843 kB/s | 548 kB 00:00 2024-05-14T09:03:29.774 INFO:teuthology.orchestra.run.smithi120.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 564 kB/s | 309 kB 00:00 2024-05-14T09:03:29.850 INFO:teuthology.orchestra.run.smithi120.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 248 kB/s | 26 kB 00:00 2024-05-14T09:03:29.875 INFO:teuthology.orchestra.run.smithi120.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 502 kB/s | 49 kB 00:00 2024-05-14T09:03:30.000 INFO:teuthology.orchestra.run.smithi120.stdout:(110/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-14T09:03:30.025 INFO:teuthology.orchestra.run.smithi120.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 489 kB/s | 67 kB 00:00 2024-05-14T09:03:30.050 INFO:teuthology.orchestra.run.smithi120.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 929 kB/s | 151 kB 00:00 2024-05-14T09:03:30.101 INFO:teuthology.orchestra.run.smithi120.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.4 MB/s | 839 kB 00:00 2024-05-14T09:03:30.143 INFO:teuthology.orchestra.run.smithi120.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-05-14T09:03:30.168 INFO:teuthology.orchestra.run.smithi120.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 402 kB/s | 43 kB 00:00 2024-05-14T09:03:30.193 INFO:teuthology.orchestra.run.smithi120.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 360 kB/s | 32 kB 00:00 2024-05-14T09:03:30.244 INFO:teuthology.orchestra.run.smithi120.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 151 kB/s | 15 kB 00:00 2024-05-14T09:03:30.277 INFO:teuthology.orchestra.run.smithi120.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-14T09:03:30.302 INFO:teuthology.orchestra.run.smithi120.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-05-14T09:03:30.336 INFO:teuthology.orchestra.run.smithi120.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.4 MB/s | 303 kB 00:00 2024-05-14T09:03:30.370 INFO:teuthology.orchestra.run.smithi120.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 558 kB/s | 35 kB 00:00 2024-05-14T09:03:30.403 INFO:teuthology.orchestra.run.smithi120.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.1 MB/s | 206 kB 00:00 2024-05-14T09:03:30.504 INFO:teuthology.orchestra.run.smithi120.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-14T09:03:30.529 INFO:teuthology.orchestra.run.smithi120.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 924 kB/s | 144 kB 00:00 2024-05-14T09:03:30.555 INFO:teuthology.orchestra.run.smithi120.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 76 kB/s | 11 kB 00:00 2024-05-14T09:03:30.596 INFO:teuthology.orchestra.run.smithi120.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 269 kB/s | 18 kB 00:00 2024-05-14T09:03:30.621 INFO:teuthology.orchestra.run.smithi120.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 255 kB/s | 23 kB 00:00 2024-05-14T09:03:30.647 INFO:teuthology.orchestra.run.smithi120.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 214 kB/s | 19 kB 00:00 2024-05-14T09:03:30.689 INFO:teuthology.orchestra.run.smithi120.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 299 kB/s | 20 kB 00:00 2024-05-14T09:03:30.739 INFO:teuthology.orchestra.run.smithi120.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2024-05-14T09:03:30.764 INFO:teuthology.orchestra.run.smithi120.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 397 kB/s | 46 kB 00:00 2024-05-14T09:03:30.789 INFO:teuthology.orchestra.run.smithi120.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 873 kB/s | 79 kB 00:00 2024-05-14T09:03:30.832 INFO:teuthology.orchestra.run.smithi120.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 888 kB/s | 58 kB 00:00 2024-05-14T09:03:30.873 INFO:teuthology.orchestra.run.smithi120.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-05-14T09:03:30.890 INFO:teuthology.orchestra.run.smithi120.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-14T09:03:30.916 INFO:teuthology.orchestra.run.smithi120.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-05-14T09:03:30.949 INFO:teuthology.orchestra.run.smithi120.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 497 kB/s | 28 kB 00:00 2024-05-14T09:03:30.975 INFO:teuthology.orchestra.run.smithi120.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 375 kB/s | 31 kB 00:00 2024-05-14T09:03:31.009 INFO:teuthology.orchestra.run.smithi120.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-05-14T09:03:31.034 INFO:teuthology.orchestra.run.smithi120.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 709 kB/s | 59 kB 00:00 2024-05-14T09:03:31.059 INFO:teuthology.orchestra.run.smithi120.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 438 kB/s | 36 kB 00:00 2024-05-14T09:03:31.085 INFO:teuthology.orchestra.run.smithi120.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 685 kB/s | 51 kB 00:00 2024-05-14T09:03:31.118 INFO:teuthology.orchestra.run.smithi120.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-14T09:03:31.136 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-05-14T09:03:31.137 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-05-14T09:03:31.143 INFO:teuthology.orchestra.run.smithi120.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-14T09:03:31.177 INFO:teuthology.orchestra.run.smithi120.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.7 MB/s | 427 kB 00:00 2024-05-14T09:03:31.202 INFO:teuthology.orchestra.run.smithi120.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 242 kB/s | 20 kB 00:00 2024-05-14T09:03:31.236 INFO:teuthology.orchestra.run.smithi120.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.1 MB/s | 192 kB 00:00 2024-05-14T09:03:31.328 INFO:teuthology.orchestra.run.smithi120.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-14T09:03:31.528 INFO:teuthology.orchestra.run.smithi120.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-05-14T09:03:31.612 INFO:teuthology.orchestra.run.smithi120.stdout:(150/156): librados2-19.0.0-3588.ge2b755a6.el9. 8.2 MB/s | 3.3 MB 00:00 2024-05-14T09:03:31.696 INFO:teuthology.orchestra.run.smithi120.stdout:(151/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 6.9 MB/s | 3.1 MB 00:00 2024-05-14T09:03:31.721 INFO:teuthology.orchestra.run.smithi120.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 384 kB/s | 41 kB 00:00 2024-05-14T09:03:31.788 INFO:teuthology.orchestra.run.smithi120.stdout:(153/156): NetworkManager-libnm-1.47.90-1.el9.x 7.0 MB/s | 1.8 MB 00:00 2024-05-14T09:03:31.811 INFO:teuthology.orchestra.run.smithi152.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 769 kB/s | 1.6 MB 00:02 2024-05-14T09:03:31.855 INFO:teuthology.orchestra.run.smithi120.stdout:(154/156): NetworkManager-tui-1.47.90-1.el9.x86 1.5 MB/s | 248 kB 00:00 2024-05-14T09:03:31.938 INFO:teuthology.orchestra.run.smithi120.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-05-14T09:03:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:(156/156): openssl-3.2.1-1.el9.x86_64.rpm 4.9 MB/s | 1.3 MB 00:00 2024-05-14T09:03:32.008 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-05-14T09:03:32.008 INFO:teuthology.orchestra.run.smithi120.stdout:Total 16 MB/s | 219 MB 00:13 2024-05-14T09:03:32.986 INFO:teuthology.orchestra.run.smithi152.stdout:(68/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 2.9 MB/s | 43 MB 00:14 2024-05-14T09:03:33.203 INFO:teuthology.orchestra.run.smithi152.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 707 kB/s | 4.4 MB 00:06 2024-05-14T09:03:33.253 INFO:teuthology.orchestra.run.smithi152.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 632 kB/s | 911 kB 00:01 2024-05-14T09:03:33.420 INFO:teuthology.orchestra.run.smithi152.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-05-14T09:03:33.554 INFO:teuthology.orchestra.run.smithi152.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 658 kB/s | 87 kB 00:00 2024-05-14T09:03:33.663 INFO:teuthology.orchestra.run.smithi152.stdout:(73/156): postgresql-private-libs-13.14-1.el9.x 197 kB/s | 133 kB 00:00 2024-05-14T09:03:33.871 INFO:teuthology.orchestra.run.smithi152.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-05-14T09:03:34.071 INFO:teuthology.orchestra.run.smithi152.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-05-14T09:03:34.205 INFO:teuthology.orchestra.run.smithi152.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-05-14T09:03:34.356 INFO:teuthology.orchestra.run.smithi152.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 128 kB/s | 19 kB 00:00 2024-05-14T09:03:34.498 INFO:teuthology.orchestra.run.smithi152.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-05-14T09:03:34.640 INFO:teuthology.orchestra.run.smithi152.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 246 kB/s | 35 kB 00:00 2024-05-14T09:03:35.073 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-05-14T09:03:35.316 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-05-14T09:03:35.316 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-05-14T09:03:35.431 INFO:teuthology.orchestra.run.smithi152.stdout:(80/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.4 MB/s | 5.1 MB 00:00 2024-05-14T09:03:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 701 kB/s | 250 kB 00:00 2024-05-14T09:03:36.074 INFO:teuthology.orchestra.run.smithi152.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 785 kB/s | 222 kB 00:00 2024-05-14T09:03:36.291 INFO:teuthology.orchestra.run.smithi152.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 358 kB/s | 77 kB 00:00 2024-05-14T09:03:36.441 INFO:teuthology.orchestra.run.smithi152.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 282 kB/s | 42 kB 00:00 2024-05-14T09:03:36.741 INFO:teuthology.orchestra.run.smithi152.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 901 kB/s | 269 kB 00:00 2024-05-14T09:03:36.934 INFO:teuthology.orchestra.run.smithi152.stdout:(86/156): postgresql-server-13.14-1.el9.x86_64. 1.5 MB/s | 5.8 MB 00:03 2024-05-14T09:03:36.967 INFO:teuthology.orchestra.run.smithi152.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 704 kB/s | 159 kB 00:00 2024-05-14T09:03:37.101 INFO:teuthology.orchestra.run.smithi152.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 384 kB/s | 51 kB 00:00 2024-05-14T09:03:37.251 INFO:teuthology.orchestra.run.smithi152.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 360 kB/s | 54 kB 00:00 2024-05-14T09:03:37.426 INFO:teuthology.orchestra.run.smithi152.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 567 kB/s | 279 kB 00:00 2024-05-14T09:03:37.481 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-05-14T09:03:37.569 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T09:03:37.577 INFO:teuthology.orchestra.run.smithi152.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 278 kB/s | 42 kB 00:00 2024-05-14T09:03:37.642 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T09:03:37.745 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T09:03:37.760 INFO:teuthology.orchestra.run.smithi152.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 242 kB/s | 44 kB 00:00 2024-05-14T09:03:37.794 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T09:03:37.834 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-05-14T09:03:37.835 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-05-14T09:03:37.837 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T09:03:37.931 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T09:03:38.352 INFO:teuthology.orchestra.run.smithi152.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 373 kB/s | 221 kB 00:00 2024-05-14T09:03:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T09:03:38.478 INFO:teuthology.orchestra.run.smithi152.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 289 kB/s | 36 kB 00:00 2024-05-14T09:03:38.503 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:03:38.645 INFO:teuthology.orchestra.run.smithi152.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 285 kB/s | 47 kB 00:00 2024-05-14T09:03:38.661 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:03:38.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:03:38.813 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:03:38.860 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T09:03:39.128 INFO:teuthology.orchestra.run.smithi152.stdout:(96/156): socat-1.7.4.1-5.el9.x86_64.rpm 632 kB/s | 305 kB 00:00 2024-05-14T09:03:39.156 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T09:03:39.224 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T09:03:39.249 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:03:39.253 INFO:teuthology.orchestra.run.smithi152.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 462 kB/s | 58 kB 00:00 2024-05-14T09:03:39.397 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:03:39.433 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T09:03:39.462 INFO:teuthology.orchestra.run.smithi152.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 451 kB/s | 94 kB 00:00 2024-05-14T09:03:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T09:03:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T09:03:39.612 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T09:03:39.679 INFO:teuthology.orchestra.run.smithi152.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 294 kB/s | 64 kB 00:00 2024-05-14T09:03:39.805 INFO:teuthology.orchestra.run.smithi152.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 359 kB/s | 45 kB 00:00 2024-05-14T09:03:39.897 INFO:teuthology.orchestra.run.smithi152.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 245 kB/s | 22 kB 00:00 2024-05-14T09:03:39.898 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T09:03:40.039 INFO:teuthology.orchestra.run.smithi152.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.0 MB/s | 863 kB 00:00 2024-05-14T09:03:40.156 INFO:teuthology.orchestra.run.smithi152.stdout:(103/156): python3-babel-2.9.1-2.el9.noarch.rpm 925 kB/s | 6.0 MB 00:06 2024-05-14T09:03:40.233 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T09:03:40.464 INFO:teuthology.orchestra.run.smithi152.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-05-14T09:03:40.483 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T09:03:40.498 INFO:teuthology.orchestra.run.smithi152.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-05-14T09:03:40.557 INFO:teuthology.orchestra.run.smithi152.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 212 kB/s | 19 kB 00:00 2024-05-14T09:03:40.632 INFO:teuthology.orchestra.run.smithi152.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 350 kB/s | 26 kB 00:00 2024-05-14T09:03:40.708 INFO:teuthology.orchestra.run.smithi152.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 654 kB/s | 49 kB 00:00 2024-05-14T09:03:40.752 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T09:03:40.825 INFO:teuthology.orchestra.run.smithi152.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-14T09:03:40.850 INFO:teuthology.orchestra.run.smithi152.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 477 kB/s | 67 kB 00:00 2024-05-14T09:03:40.883 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:03:40.892 INFO:teuthology.orchestra.run.smithi152.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-14T09:03:40.967 INFO:teuthology.orchestra.run.smithi152.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2024-05-14T09:03:41.009 INFO:teuthology.orchestra.run.smithi152.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 839 kB 00:00 2024-05-14T09:03:41.019 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:03:41.034 INFO:teuthology.orchestra.run.smithi152.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 655 kB/s | 43 kB 00:00 2024-05-14T09:03:41.093 INFO:teuthology.orchestra.run.smithi152.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 389 kB/s | 32 kB 00:00 2024-05-14T09:03:41.118 INFO:teuthology.orchestra.run.smithi152.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 181 kB/s | 15 kB 00:00 2024-05-14T09:03:41.160 INFO:teuthology.orchestra.run.smithi152.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-05-14T09:03:41.227 INFO:teuthology.orchestra.run.smithi152.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-14T09:03:41.261 INFO:teuthology.orchestra.run.smithi152.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-05-14T09:03:41.286 INFO:teuthology.orchestra.run.smithi152.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 611 kB/s | 35 kB 00:00 2024-05-14T09:03:41.312 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:03:41.328 INFO:teuthology.orchestra.run.smithi152.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-05-14T09:03:41.404 INFO:teuthology.orchestra.run.smithi152.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-05-14T09:03:41.471 INFO:teuthology.orchestra.run.smithi152.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-05-14T09:03:41.496 INFO:teuthology.orchestra.run.smithi152.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2024-05-14T09:03:41.498 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T09:03:41.530 INFO:teuthology.orchestra.run.smithi152.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 305 kB/s | 18 kB 00:00 2024-05-14T09:03:41.534 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T09:03:41.555 INFO:teuthology.orchestra.run.smithi152.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 400 kB/s | 23 kB 00:00 2024-05-14T09:03:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T09:03:41.588 INFO:teuthology.orchestra.run.smithi152.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 335 kB/s | 19 kB 00:00 2024-05-14T09:03:41.643 INFO:teuthology.orchestra.run.smithi152.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 226 kB/s | 20 kB 00:00 2024-05-14T09:03:41.691 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T09:03:41.706 INFO:teuthology.orchestra.run.smithi152.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2024-05-14T09:03:41.731 INFO:teuthology.orchestra.run.smithi152.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 530 kB/s | 46 kB 00:00 2024-05-14T09:03:41.739 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T09:03:41.773 INFO:teuthology.orchestra.run.smithi152.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-05-14T09:03:41.799 INFO:teuthology.orchestra.run.smithi152.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 867 kB/s | 58 kB 00:00 2024-05-14T09:03:41.805 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T09:03:41.841 INFO:teuthology.orchestra.run.smithi152.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-14T09:03:41.854 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T09:03:41.866 INFO:teuthology.orchestra.run.smithi152.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2024-05-14T09:03:41.892 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T09:03:41.899 INFO:teuthology.orchestra.run.smithi152.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-14T09:03:41.933 INFO:teuthology.orchestra.run.smithi152.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 425 kB/s | 28 kB 00:00 2024-05-14T09:03:41.968 INFO:teuthology.orchestra.run.smithi152.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 462 kB/s | 31 kB 00:00 2024-05-14T09:03:42.000 INFO:teuthology.orchestra.run.smithi152.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-05-14T09:03:42.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T09:03:42.034 INFO:teuthology.orchestra.run.smithi152.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 890 kB/s | 59 kB 00:00 2024-05-14T09:03:42.069 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T09:03:42.085 INFO:teuthology.orchestra.run.smithi152.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 430 kB/s | 36 kB 00:00 2024-05-14T09:03:42.102 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T09:03:42.110 INFO:teuthology.orchestra.run.smithi152.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2024-05-14T09:03:42.152 INFO:teuthology.orchestra.run.smithi152.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-05-14T09:03:42.154 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T09:03:42.177 INFO:teuthology.orchestra.run.smithi152.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-14T09:03:42.255 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T09:03:42.289 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T09:03:42.333 INFO:teuthology.orchestra.run.smithi152.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-05-14T09:03:42.336 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T09:03:42.369 INFO:teuthology.orchestra.run.smithi152.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 104 kB/s | 20 kB 00:00 2024-05-14T09:03:42.370 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T09:03:42.403 INFO:teuthology.orchestra.run.smithi152.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 2.7 MB/s | 192 kB 00:00 2024-05-14T09:03:42.480 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T09:03:42.501 INFO:teuthology.orchestra.run.smithi152.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-14T09:03:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T09:03:42.675 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T09:03:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T09:03:42.918 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T09:03:43.196 INFO:teuthology.orchestra.run.smithi152.stdout:(148/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 4.5 MB/s | 3.1 MB 00:00 2024-05-14T09:03:43.471 INFO:teuthology.orchestra.run.smithi152.stdout:(149/156): librados2-19.0.0-3588.ge2b755a6.el9. 3.1 MB/s | 3.3 MB 00:01 2024-05-14T09:03:43.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T09:03:43.906 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T09:03:43.960 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T09:03:44.006 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T09:03:44.047 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T09:03:44.088 INFO:teuthology.orchestra.run.smithi152.stdout:(150/156): NetworkManager-1.47.90-1.el9.x86_64. 2.6 MB/s | 2.3 MB 00:00 2024-05-14T09:03:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T09:03:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-05-14T09:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 300 kB/s | 41 kB 00:00 2024-05-14T09:03:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T09:03:44.346 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T09:03:44.347 INFO:teuthology.orchestra.run.smithi152.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 2.0 MB/s | 248 kB 00:00 2024-05-14T09:03:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T09:03:44.413 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T09:03:44.414 INFO:teuthology.orchestra.run.smithi152.stdout:(153/156): NetworkManager-libnm-1.47.90-1.el9.x 1.9 MB/s | 1.8 MB 00:00 2024-05-14T09:03:44.497 INFO:teuthology.orchestra.run.smithi152.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 9.0 MB/s | 1.3 MB 00:00 2024-05-14T09:03:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T09:03:44.542 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T09:03:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T09:03:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T09:03:44.618 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T09:03:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T09:03:44.704 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T09:03:44.739 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T09:03:44.766 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T09:03:44.828 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T09:03:44.876 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T09:03:44.937 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T09:03:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T09:03:45.143 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T09:03:45.198 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T09:03:45.258 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T09:03:45.279 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:03:45.296 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T09:03:45.348 INFO:teuthology.orchestra.run.smithi152.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.6 MB/s | 2.4 MB 00:00 2024-05-14T09:03:45.353 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T09:03:45.465 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:03:45.491 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T09:03:45.531 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:03:45.537 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T09:03:45.582 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T09:03:45.618 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T09:03:45.651 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T09:03:45.663 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:03:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T09:03:45.865 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T09:03:45.964 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T09:03:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T09:03:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:03:46.055 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T09:03:46.091 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T09:03:46.137 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T09:03:46.184 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T09:03:46.196 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:03:46.229 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T09:03:46.242 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T09:03:46.296 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T09:03:46.314 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T09:03:46.344 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T09:03:46.347 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T09:03:46.389 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T09:03:46.409 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T09:03:46.440 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T09:03:46.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T09:03:46.547 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T09:03:46.685 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T09:03:46.738 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T09:03:46.751 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T09:03:46.795 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T09:03:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T09:03:47.021 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T09:03:47.092 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T09:03:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T09:03:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T09:03:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T09:03:47.536 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:03:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:03:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:03:48.062 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T09:03:48.107 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T09:03:48.140 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T09:03:48.200 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T09:03:48.230 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T09:03:48.258 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T09:03:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T09:03:48.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T09:03:48.391 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T09:03:48.443 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T09:03:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T09:03:48.492 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T09:03:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T09:03:48.555 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T09:03:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T09:03:48.705 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T09:03:48.724 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T09:03:48.756 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T09:03:48.775 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T09:03:48.814 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T09:03:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T09:03:48.867 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T09:03:48.977 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T09:03:49.018 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T09:03:49.066 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T09:03:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T09:03:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T09:03:49.279 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T09:03:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T09:03:49.560 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T09:03:49.650 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T09:03:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T09:03:49.813 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T09:03:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T09:03:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T09:03:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T09:03:50.562 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T09:03:50.602 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T09:03:50.665 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T09:03:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T09:03:50.935 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T09:03:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T09:03:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T09:03:51.232 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T09:03:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T09:03:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T09:03:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T09:03:51.393 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T09:03:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T09:03:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T09:03:51.497 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T09:03:51.532 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T09:03:51.568 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T09:03:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T09:03:51.961 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T09:03:52.001 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T09:03:52.120 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T09:03:52.123 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T09:03:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T09:03:52.174 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T09:03:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T09:03:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T09:03:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T09:03:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T09:03:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T09:03:52.520 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T09:03:52.561 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T09:03:52.594 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T09:03:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T09:03:52.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T09:03:52.830 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T09:03:52.963 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T09:03:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T09:03:52.990 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T09:03:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T09:03:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T09:03:53.099 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T09:03:53.188 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T09:03:53.242 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T09:03:53.289 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T09:03:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T09:03:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T09:03:53.463 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T09:03:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T09:03:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T09:03:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T09:03:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T09:03:53.835 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T09:03:53.981 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T09:03:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T09:03:54.966 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T09:03:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T09:03:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T09:03:55.187 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T09:03:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T09:03:55.364 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T09:03:55.411 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T09:03:55.643 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T09:03:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:03:55.675 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T09:03:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:03:55.778 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T09:03:56.370 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:03:56.415 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T09:03:56.576 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T09:03:56.577 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T09:03:56.577 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T09:03:56.577 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:03:56.602 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T09:03:56.624 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T09:03:56.760 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T09:03:58.395 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T09:03:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T09:03:58.524 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T09:03:58.559 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T09:03:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T09:03:59.001 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T09:03:59.122 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T09:03:59.157 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T09:03:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T09:03:59.770 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T09:03:59.804 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T09:03:59.903 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T09:03:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T09:04:01.308 INFO:teuthology.orchestra.run.smithi152.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 692 kB/s | 16 MB 00:24 2024-05-14T09:04:01.314 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-05-14T09:04:01.315 INFO:teuthology.orchestra.run.smithi152.stdout:Total 4.5 MB/s | 219 MB 00:48 2024-05-14T09:04:02.514 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:04:02.560 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:04:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:04:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T09:04:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T09:04:03.455 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T09:04:03.455 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T09:04:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T09:04:04.380 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-05-14T09:04:04.608 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-05-14T09:04:04.608 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-05-14T09:04:07.200 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-05-14T09:04:07.201 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-05-14T09:04:09.825 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T09:04:09.825 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-05-14T09:04:09.825 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-05-14T09:04:09.825 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-05-14T09:04:09.825 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-05-14T09:04:09.825 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-05-14T09:04:09.825 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-05-14T09:04:09.826 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-05-14T09:04:09.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:10.064 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T09:04:10.111 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T09:04:10.111 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:10.111 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T09:04:10.111 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:11.886 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T09:04:11.989 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T09:04:11.989 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:11.989 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T09:04:11.989 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:04:11.989 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:04:11.989 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:12.236 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T09:04:12.320 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T09:04:12.320 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:12.320 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T09:04:12.320 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:04:12.320 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:04:12.320 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:12.828 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T09:04:12.916 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T09:04:12.916 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:12.916 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T09:04:12.916 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:04:12.916 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:04:12.916 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:13.063 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T09:04:13.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T09:04:13.349 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T09:04:13.608 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T09:04:13.667 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T09:04:13.738 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-05-14T09:04:13.767 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T09:04:13.839 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T09:04:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T09:04:13.917 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T09:04:14.046 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T09:04:14.066 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T09:04:14.117 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T09:04:14.139 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T09:04:14.165 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T09:04:14.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T09:04:14.223 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T09:04:14.278 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T09:04:14.723 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T09:04:14.840 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:04:14.875 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T09:04:14.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T09:04:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T09:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:04:15.058 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:04:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T09:04:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T09:04:15.186 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:04:15.224 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T09:04:15.517 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T09:04:15.589 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T09:04:15.613 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:04:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:04:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T09:04:15.918 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T09:04:15.949 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T09:04:16.023 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T09:04:16.221 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T09:04:16.221 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-05-14T09:04:16.221 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-05-14T09:04:16.221 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-05-14T09:04:16.221 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-05-14T09:04:16.221 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-05-14T09:04:16.221 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-05-14T09:04:16.222 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-05-14T09:04:16.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T09:04:16.445 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T09:04:16.445 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T09:04:16.491 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T09:04:16.491 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:16.491 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T09:04:16.491 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:16.496 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T09:04:16.617 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T09:04:16.822 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T09:04:16.911 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T09:04:17.092 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:04:17.192 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:04:17.509 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T09:04:17.597 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T09:04:17.629 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T09:04:17.697 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T09:04:17.740 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T09:04:17.785 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T09:04:17.799 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T09:04:17.915 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T09:04:17.972 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T09:04:17.973 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T09:04:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T09:04:18.040 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T09:04:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T09:04:18.076 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:18.076 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T09:04:18.076 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:04:18.076 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:04:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:18.127 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T09:04:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T09:04:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T09:04:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T09:04:18.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T09:04:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T09:04:18.251 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:18.251 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T09:04:18.251 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:04:18.251 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:04:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T09:04:18.299 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T09:04:18.356 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T09:04:18.370 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T09:04:18.409 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T09:04:18.466 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T09:04:18.497 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T09:04:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T09:04:18.565 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:18.565 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T09:04:18.565 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:04:18.565 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:04:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:18.574 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T09:04:18.614 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T09:04:18.663 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T09:04:18.694 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T09:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T09:04:18.873 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T09:04:18.972 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T09:04:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T09:04:19.149 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T09:04:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T09:04:19.157 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:19.158 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T09:04:19.158 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:04:19.158 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:04:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:19.210 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T09:04:19.300 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T09:04:19.362 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T09:04:19.370 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T09:04:19.410 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T09:04:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T09:04:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T09:04:19.489 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:19.489 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T09:04:19.489 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:04:19.489 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:04:19.489 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:19.536 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T09:04:19.603 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T09:04:19.604 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:19.604 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T09:04:19.604 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:19.687 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T09:04:19.690 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T09:04:19.745 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T09:04:19.789 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T09:04:19.789 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:19.789 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T09:04:19.789 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:04:19.790 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:04:19.790 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:19.830 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T09:04:19.900 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T09:04:19.947 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T09:04:20.000 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T09:04:20.045 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T09:04:20.089 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T09:04:20.115 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T09:04:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T09:04:20.173 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T09:04:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T09:04:20.195 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T09:04:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T09:04:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T09:04:20.274 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T09:04:20.274 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:20.275 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T09:04:20.275 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:04:20.275 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:04:20.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:20.379 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T09:04:20.446 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T09:04:20.573 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T09:04:20.648 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T09:04:20.751 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T09:04:20.798 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T09:04:20.837 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T09:04:20.898 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T09:04:20.901 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T09:04:20.937 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T09:04:20.945 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T09:04:20.991 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T09:04:21.006 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T09:04:21.065 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T09:04:21.100 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T09:04:21.138 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T09:04:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T09:04:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T09:04:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T09:04:21.439 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T09:04:21.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T09:04:21.615 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T09:04:21.695 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T09:04:21.731 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T09:04:21.764 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T09:04:21.959 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T09:04:22.138 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T09:04:22.187 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T09:04:22.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T09:04:22.276 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T09:04:22.346 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T09:04:22.425 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T09:04:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T09:04:22.467 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T09:04:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T09:04:22.512 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T09:04:22.562 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T09:04:22.640 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T09:04:22.686 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T09:04:22.828 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T09:04:22.888 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T09:04:22.925 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T09:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T09:04:23.140 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T09:04:23.213 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T09:04:23.579 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T09:04:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T09:04:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T09:04:23.959 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T09:04:23.991 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T09:04:24.061 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T09:04:24.061 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:24.061 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T09:04:24.062 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:04:24.062 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:04:24.062 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T09:04:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T09:04:24.179 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T09:04:24.238 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T09:04:24.266 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T09:04:24.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T09:04:24.336 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T09:04:24.393 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T09:04:24.466 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T09:04:24.560 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T09:04:24.607 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T09:04:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T09:04:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T09:04:24.976 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T09:04:24.985 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T09:04:25.031 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T09:04:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T09:04:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T09:04:25.167 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T09:04:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T09:04:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T09:04:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T09:04:25.445 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:25.445 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T09:04:25.446 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:04:25.446 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:04:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:25.449 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T09:04:25.510 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T09:04:25.528 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T09:04:25.540 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T09:04:25.583 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T09:04:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T09:04:25.596 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:25.596 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T09:04:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:25.641 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T09:04:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T09:04:25.737 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T09:04:25.737 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:25.737 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T09:04:25.737 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:04:25.737 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:04:25.737 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:25.805 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T09:04:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T09:04:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T09:04:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T09:04:26.172 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:26.172 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T09:04:26.172 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:04:26.172 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:04:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:26.503 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:04:26.546 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:04:26.602 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:04:27.544 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T09:04:27.645 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T09:04:27.681 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T09:04:27.716 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T09:04:27.920 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T09:04:28.019 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T09:04:28.084 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T09:04:28.085 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T09:04:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T09:04:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T09:04:28.265 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T09:04:28.278 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T09:04:28.298 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T09:04:28.316 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T09:04:28.316 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T09:04:28.355 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T09:04:28.443 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T09:04:28.490 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T09:04:28.491 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T09:04:28.627 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T09:04:28.666 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T09:04:28.705 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:04:28.705 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:04:28.919 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T09:04:28.953 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T09:04:29.020 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:04:29.021 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T09:04:29.044 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T09:04:29.071 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T09:04:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T09:04:29.279 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:04:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:04:29.523 INFO:teuthology.orchestra.run.smithi175.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T09:04:29.523 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T09:04:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T09:04:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T09:04:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T09:04:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T09:04:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T09:04:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T09:04:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T09:04:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T09:04:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T09:04:31.729 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:04:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T09:04:32.497 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T09:04:32.520 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:04:32.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:04:32.618 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:04:32.669 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T09:04:32.669 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T09:04:32.669 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T09:04:32.669 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:32.738 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T09:04:33.960 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T09:04:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T09:04:34.142 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T09:04:34.293 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T09:04:34.331 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T09:04:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T09:04:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T09:04:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T09:04:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T09:04:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T09:04:34.680 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T09:04:34.728 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T09:04:34.762 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:04:34.763 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:04:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:04:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T09:04:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T09:04:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T09:04:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T09:04:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T09:04:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T09:04:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T09:04:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T09:04:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T09:04:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T09:04:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T09:04:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T09:04:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T09:04:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T09:04:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T09:04:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T09:04:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T09:04:35.245 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T09:04:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:04:35.631 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:04:35.631 INFO:teuthology.orchestra.run.smithi120.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T09:04:35.631 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:37.376 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:04:37.376 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:37.376 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-05-14T09:04:37.376 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.377 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.378 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T09:04:37.379 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T09:04:37.380 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T09:04:37.381 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T09:04:37.382 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T09:04:37.383 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T09:04:37.384 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T09:04:37.385 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T09:04:37.386 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T09:04:37.387 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T09:04:37.388 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T09:04:37.388 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T09:04:37.388 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T09:04:37.388 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:04:37.388 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-05-14T09:04:38.022 DEBUG:teuthology.parallel:result is None 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:04:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T09:04:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T09:04:41.552 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T09:04:41.552 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T09:04:41.552 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T09:04:41.552 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T09:04:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T09:04:41.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T09:04:41.567 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T09:04:41.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T09:04:41.569 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T09:04:41.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T09:04:41.571 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T09:04:41.572 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T09:04:41.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T09:04:41.574 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T09:04:41.575 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T09:04:41.576 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T09:04:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:04:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:43.745 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-05-14T09:04:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T09:04:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T09:04:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T09:04:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T09:04:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T09:04:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T09:04:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T09:04:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T09:04:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T09:04:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T09:04:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T09:04:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T09:04:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:04:43.758 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-05-14T09:04:44.360 DEBUG:teuthology.parallel:result is None 2024-05-14T09:04:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-05-14T09:04:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:46.135 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T09:04:46.183 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T09:04:46.183 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:46.183 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T09:04:46.183 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:47.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T09:04:47.964 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T09:04:47.964 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:47.964 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T09:04:47.964 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:04:47.964 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:04:47.964 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:48.211 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T09:04:48.280 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T09:04:48.280 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:48.280 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T09:04:48.280 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:04:48.280 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:04:48.280 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:48.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T09:04:48.857 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T09:04:48.857 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:48.857 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T09:04:48.857 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:04:48.857 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:04:48.858 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:49.005 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T09:04:49.068 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T09:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T09:04:49.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T09:04:49.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T09:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T09:04:49.773 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T09:04:49.975 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T09:04:50.025 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T09:04:50.065 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T09:04:50.107 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T09:04:50.837 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T09:04:50.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T09:04:50.944 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T09:04:51.052 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T09:04:51.119 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T09:04:52.444 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T09:04:52.490 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T09:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T09:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T09:04:53.770 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T09:04:53.961 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T09:04:54.001 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T09:04:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T09:04:54.076 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:54.076 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T09:04:54.076 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:04:54.076 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:04:54.076 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T09:04:54.215 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T09:04:54.353 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T09:04:54.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T09:04:55.502 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T09:04:55.549 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T09:04:55.643 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T09:04:55.643 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:55.643 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T09:04:55.643 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:04:55.643 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:04:55.643 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:55.691 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T09:04:55.772 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T09:04:55.772 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:55.773 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T09:04:55.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:55.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T09:04:55.970 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T09:04:55.970 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:55.970 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T09:04:55.970 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:04:55.970 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:04:55.970 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:04:56.359 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T09:04:56.429 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T09:04:56.429 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:04:56.429 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T09:04:56.429 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:04:56.429 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:04:56.429 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:05:01.115 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T09:05:01.178 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T09:05:01.234 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T09:05:01.271 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T09:05:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T09:05:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T09:05:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T09:05:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T09:05:01.733 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T09:05:01.782 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T09:05:02.772 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:05:02.820 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:05:02.884 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T09:05:04.258 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T09:05:04.368 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T09:05:04.442 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T09:05:04.588 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T09:05:04.636 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T09:05:04.673 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T09:05:04.673 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T09:05:04.801 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T09:05:04.848 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T09:05:04.848 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T09:05:04.993 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T09:05:05.041 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T09:05:05.078 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:05:05.079 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:05:05.428 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T09:05:05.429 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T09:05:05.565 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T09:05:05.694 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:05:05.952 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:05:05.952 INFO:teuthology.orchestra.run.smithi152.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T09:05:05.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:05:12.287 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T09:05:12.287 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T09:05:12.287 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T09:05:12.287 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T09:05:12.287 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T09:05:12.287 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T09:05:12.287 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T09:05:12.288 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T09:05:12.289 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T09:05:12.289 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T09:05:12.289 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T09:05:12.302 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T09:05:12.303 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T09:05:12.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T09:05:12.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T09:05:12.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T09:05:12.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T09:05:12.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T09:05:12.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T09:05:12.310 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T09:05:12.311 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T09:05:12.312 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T09:05:12.312 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T09:05:12.312 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T09:05:12.312 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T09:05:12.312 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T09:05:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.635 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.636 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T09:05:14.637 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T09:05:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T09:05:14.639 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T09:05:14.640 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T09:05:14.641 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T09:05:14.642 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.643 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.644 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-05-14T09:05:14.645 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-05-14T09:05:15.345 DEBUG:teuthology.parallel:result is None 2024-05-14T09:05:15.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:05:15.501 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T09:05:15.575 INFO:teuthology.orchestra.run.smithi120.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T09:05:15.575 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T09:05:15.576 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T09:05:15.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:05:15.721 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T09:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T09:05:15.776 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T09:05:15.776 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T09:05:15.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:05:16.058 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T09:05:16.128 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T09:05:16.128 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T09:05:16.129 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T09:05:16.130 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-14T09:05:16.131 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:05:16.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T09:05:16.232 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:05:16.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T09:05:16.303 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:05:16.303 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T09:05:16.395 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-14T09:05:16.395 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:05:16.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T09:05:16.483 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T09:05:16.607 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:05:16.607 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T09:05:16.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T09:05:16.778 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:05:16.778 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T09:05:16.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T09:05:16.974 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-14T09:05:16.975 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:05:16.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T09:05:17.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T09:05:17.191 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:05:17.191 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T09:05:17.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T09:05:17.367 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:05:17.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T09:05:17.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T09:05:17.550 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-14T09:05:17.551 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:05:17.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T09:05:17.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T09:05:17.722 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:05:17.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T09:05:17.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T09:05:17.896 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:05:17.897 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T09:05:17.970 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T09:05:18.080 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-14T09:05:18.183 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'subvols': {'create': 2}} 2024-05-14T09:05:18.183 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:05:18.184 INFO:tasks.cephadm:Cluster fsid is 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:05:18.184 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-14T09:05:18.184 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.120', 'mon.b': '172.21.15.152', 'mon.c': '172.21.15.175'} 2024-05-14T09:05:18.184 INFO:tasks.cephadm:First mon is mon.a on smithi120 2024-05-14T09:05:18.184 INFO:tasks.cephadm:First mgr is x 2024-05-14T09:05:18.184 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-14T09:05:18.184 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname $(hostname -s) 2024-05-14T09:05:18.277 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2024-05-14T09:05:18.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-05-14T09:05:18.444 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-14T09:05:18.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:05:18.591 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79237/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3588-ge2b755a6', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3588.ge2b755a6'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-09 07:03:10.506903', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240509.053109-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79236/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3588-ge2b755a6', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3588.ge2b755a6'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-09 06:43:33.316648', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240509.053109-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-14T09:05:18.736 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20240509.053109-debug, sha1 e2b755a64f0d72176b57299d02e880cf0620d780 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:05:18.738 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm 2024-05-14T09:05:18.738 DEBUG:teuthology.orchestra.run.smithi120:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:19.265 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 09:05 /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:19.265 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:19.973 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 09:05 /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:19.974 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:20.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 09:05 /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:20.499 DEBUG:teuthology.orchestra.run.smithi120:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:20.560 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:20.620 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T09:05:20.694 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 on all hosts... 2024-05-14T09:05:20.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T09:05:20.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T09:05:20.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T09:05:21.810 INFO:teuthology.orchestra.run.smithi120.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T09:05:21.877 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T09:05:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T09:06:01.372 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-14T09:06:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T09:06:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T09:06:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-05-14T09:06:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T09:06:01.373 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-05-14T09:06:01.373 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-14T09:06:07.350 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:06:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T09:06:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T09:06:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "repo_digests": [ 2024-05-14T09:06:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T09:06:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:06:07.350 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:06:08.842 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-05-14T09:06:08.843 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T09:06:08.843 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T09:06:08.843 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2024-05-14T09:06:08.843 INFO:teuthology.orchestra.run.smithi152.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T09:06:08.843 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-05-14T09:06:08.843 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-05-14T09:06:08.909 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph 2024-05-14T09:06:09.003 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2024-05-14T09:06:09.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-05-14T09:06:09.185 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /etc/ceph 2024-05-14T09:06:09.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2024-05-14T09:06:09.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-05-14T09:06:09.450 INFO:tasks.cephadm:Writing seed config... 2024-05-14T09:06:09.451 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-14T09:06:09.451 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-14T09:06:09.451 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-14T09:06:09.451 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-14T09:06:09.451 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-14T09:06:09.451 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-14T09:06:09.451 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-14T09:06:09.452 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-14T09:06:09.453 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-14T09:06:09.454 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-14T09:06:09.454 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-14T09:06:09.454 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-14T09:06:09.454 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-14T09:06:09.454 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:06:09.454 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-14T09:06:09.507 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 15b5acb4-11d1-11ef-bc98-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-14T09:06:09.507 DEBUG:teuthology.orchestra.run.smithi120:mon.a> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a.service 2024-05-14T09:06:09.554 DEBUG:teuthology.orchestra.run.smithi120:mgr.x> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.x.service 2024-05-14T09:06:09.599 INFO:tasks.cephadm:Bootstrapping... 2024-05-14T09:06:09.599 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 -v bootstrap --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.120 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:06:09.869 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-05-14T09:06:09.869 INFO:teuthology.orchestra.run.smithi120.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780', '-v', 'bootstrap', '--fsid', '15b5acb4-11d1-11ef-bc98-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.120', '--skip-admin-label'] 2024-05-14T09:06:09.870 INFO:teuthology.orchestra.run.smithi120.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-14T09:06:09.870 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying podman|docker is present... 2024-05-14T09:06:09.929 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stdout 5.0.2 2024-05-14T09:06:09.929 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying lvm2 is present... 2024-05-14T09:06:09.930 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying time synchronization is in place... 2024-05-14T09:06:09.946 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-14T09:06:09.946 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-14T09:06:09.965 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-14T09:06:09.965 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-05-14T09:06:09.988 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout enabled 2024-05-14T09:06:10.009 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout active 2024-05-14T09:06:10.009 INFO:teuthology.orchestra.run.smithi120.stdout:Unit chronyd.service is enabled and running 2024-05-14T09:06:10.009 INFO:teuthology.orchestra.run.smithi120.stdout:Repeating the final host check... 2024-05-14T09:06:10.070 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stdout 5.0.2 2024-05-14T09:06:10.071 INFO:teuthology.orchestra.run.smithi120.stdout:podman (/bin/podman) version 5.0.2 is present 2024-05-14T09:06:10.071 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl is present 2024-05-14T09:06:10.071 INFO:teuthology.orchestra.run.smithi120.stdout:lvcreate is present 2024-05-14T09:06:10.087 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-14T09:06:10.087 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-14T09:06:10.105 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-14T09:06:10.105 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-05-14T09:06:10.130 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout enabled 2024-05-14T09:06:10.152 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout active 2024-05-14T09:06:10.153 INFO:teuthology.orchestra.run.smithi120.stdout:Unit chronyd.service is enabled and running 2024-05-14T09:06:10.153 INFO:teuthology.orchestra.run.smithi120.stdout:Host looks OK 2024-05-14T09:06:10.153 INFO:teuthology.orchestra.run.smithi120.stdout:Cluster fsid: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:10.153 INFO:teuthology.orchestra.run.smithi120.stdout:Acquiring lock 140181087715280 on /run/cephadm/15b5acb4-11d1-11ef-bc98-c7b262605968.lock 2024-05-14T09:06:10.154 INFO:teuthology.orchestra.run.smithi120.stdout:Lock 140181087715280 acquired on /run/cephadm/15b5acb4-11d1-11ef-bc98-c7b262605968.lock 2024-05-14T09:06:10.155 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying IP 172.21.15.120 port 3300 ... 2024-05-14T09:06:10.156 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying IP 172.21.15.120 port 6789 ... 2024-05-14T09:06:10.156 INFO:teuthology.orchestra.run.smithi120.stdout:Base mon IP(s) is [172.21.15.120:3300, 172.21.15.120:6789], mon addrv is [v2:172.21.15.120:3300,v1:172.21.15.120:6789] 2024-05-14T09:06:10.171 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.120 metric 100 2024-05-14T09:06:10.171 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.120 metric 100 2024-05-14T09:06:10.184 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-14T09:06:10.184 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-14T09:06:10.184 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1787sec hoplimit 64 pref medium 2024-05-14T09:06:10.194 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-14T09:06:10.195 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-14T09:06:10.195 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-14T09:06:10.195 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-14T09:06:10.195 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-05-14T09:06:10.195 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-14T09:06:10.197 INFO:teuthology.orchestra.run.smithi120.stdout:Mon IP `172.21.15.120` is in CIDR network `172.21.0.0/20` 2024-05-14T09:06:10.198 INFO:teuthology.orchestra.run.smithi120.stdout:Mon IP `172.21.15.120` is in CIDR network `172.21.0.0/20` 2024-05-14T09:06:10.198 INFO:teuthology.orchestra.run.smithi120.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-14T09:06:10.200 INFO:teuthology.orchestra.run.smithi120.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-14T09:06:10.203 INFO:teuthology.orchestra.run.smithi120.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T09:06:11.039 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stdout bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 2024-05-14T09:06:11.039 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T09:06:11.039 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Getting image source signatures 2024-05-14T09:06:11.039 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-14T09:06:11.040 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Copying blob sha256:d2511a189d36a438cd7259d98515a840197dc63bdcef8f78efcfd8f43785c919 2024-05-14T09:06:11.040 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Copying config sha256:bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 2024-05-14T09:06:11.040 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-14T09:06:12.319 INFO:teuthology.orchestra.run.smithi120.stdout:ceph: stdout ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T09:06:12.319 INFO:teuthology.orchestra.run.smithi120.stdout:Ceph version: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T09:06:12.320 INFO:teuthology.orchestra.run.smithi120.stdout:Extracting ceph user uid/gid from container image... 2024-05-14T09:06:13.490 INFO:teuthology.orchestra.run.smithi120.stdout:stat: stdout 167 167 2024-05-14T09:06:13.491 INFO:teuthology.orchestra.run.smithi120.stdout:Creating initial keys... 2024-05-14T09:06:14.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph-authtool: stdout AQCGKUNmwgU6ARAA15znrc+2Xa+jg0rLYZdBOw== 2024-05-14T09:06:15.874 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph-authtool: stdout AQCHKUNmTX7NDBAA8dyT7R5CzJrkkt8EcQHvJA== 2024-05-14T09:06:17.052 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph-authtool: stdout AQCIKUNmwFC8GhAA4ietKkr5dL6LdTdpBmOk3g== 2024-05-14T09:06:17.054 INFO:teuthology.orchestra.run.smithi120.stdout:Creating initial monmap... 2024-05-14T09:06:18.242 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-14T09:06:18.242 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-14T09:06:18.242 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:18.242 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-14T09:06:18.242 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool for a [v2:172.21.15.120:3300,v1:172.21.15.120:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-14T09:06:18.242 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = quincy 2024-05-14T09:06:18.242 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: set fsid to 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:18.243 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-14T09:06:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:06:18.243 INFO:teuthology.orchestra.run.smithi120.stdout:Creating mon... 2024-05-14T09:06:19.447 INFO:teuthology.orchestra.run.smithi120.stdout:create mon.a on 2024-05-14T09:06:19.825 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-14T09:06:20.063 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-14T09:06:20.342 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968.target. 2024-05-14T09:06:20.342 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968.target. 2024-05-14T09:06:20.696 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a 2024-05-14T09:06:20.696 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to reset failed state of unit ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a.service: Unit ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a.service not loaded. 2024-05-14T09:06:20.980 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968.target.wants/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a.service → /etc/systemd/system/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@.service. 2024-05-14T09:06:21.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:21 smithi120 podman[30698]: 2024-05-14 09:06:21.619493656 +0000 UTC m=+0.371860627 container start b999ece2bc5a6816452df36a55dc7f6573e488feee31243eab5d92d11cd228dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:06:21.756 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T09:06:21.756 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-05-14T09:06:21.771 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T09:06:21.771 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-05-14T09:06:21.772 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-05-14T09:06:21.772 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to enable service . firewalld.service is not available 2024-05-14T09:06:21.772 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mon to start... 2024-05-14T09:06:21.772 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mon... 2024-05-14T09:06:22.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:21 smithi120 bash[30698]: b999ece2bc5a6816452df36a55dc7f6573e488feee31243eab5d92d11cd228dc 2024-05-14T09:06:22.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:21 smithi120 systemd[1]: Started Ceph mon.a for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:06:22.069 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:21 smithi120 ceph-mon[30717]: mkfs 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:22.069 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:21 smithi120 ceph-mon[30717]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: monmap epoch 1 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: last_changed 2024-05-14T09:06:17.594241+0000 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: min_mon_release 19 (squid) 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: election_strategy: 1 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: fsmap 2024-05-14T09:06:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: osdmap e1: 0 total, 0 up, 0 in 2024-05-14T09:06:23.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: mgrmap e1: no daemons active 2024-05-14T09:06:23.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:22 smithi120 ceph-mon[30717]: from='client.? 172.21.15.120:0/2102863126' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-14T09:06:23.238 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout cluster: 2024-05-14T09:06:23.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout id: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout services: 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.758705s) 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout data: 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-14T09:06:23.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout pgs: 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.439+0000 7f0da3600700 1 Processor -- start 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.439+0000 7f0da3600700 1 -- start start 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.440+0000 7f0da3600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c10b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.440+0000 7f0da3600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1094e0 con 0x7f0d9c10aee0 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.440+0000 7f0da0c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c10b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.440+0000 7f0da0c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c10b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41416/0 (socket says 172.21.15.120:41416) 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.440+0000 7f0da0c00700 1 -- 172.21.15.120:0/4183879076 learned_addr learned my addr 172.21.15.120:0/4183879076 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.441+0000 7f0da0c00700 1 -- 172.21.15.120:0/4183879076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c109660 con 0x7f0d9c10aee0 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.441+0000 7f0da0c00700 1 --2- 172.21.15.120:0/4183879076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c10b2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0d900098a0 tx=0x7f0d90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2985481cb46e1ba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.442+0000 7f0d9b400700 1 -- 172.21.15.120:0/4183879076 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d90004160 con 0x7f0d9c10aee0 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.442+0000 7f0d9b400700 1 -- 172.21.15.120:0/4183879076 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d90004300 con 0x7f0d9c10aee0 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.442+0000 7f0d9b400700 1 -- 172.21.15.120:0/4183879076 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d900036a0 con 0x7f0d9c10aee0 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.442+0000 7f0da3600700 1 -- 172.21.15.120:0/4183879076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 msgr2=0x7f0d9c10b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.442+0000 7f0da3600700 1 --2- 172.21.15.120:0/4183879076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c10b2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0d900098a0 tx=0x7f0d90009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.442+0000 7f0da3600700 1 -- 172.21.15.120:0/4183879076 shutdown_connections 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.443+0000 7f0da3600700 1 --2- 172.21.15.120:0/4183879076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c10b2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.443+0000 7f0da3600700 1 -- 172.21.15.120:0/4183879076 >> 172.21.15.120:0/4183879076 conn(0x7f0d9c104f10 msgr2=0x7f0d9c1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.443+0000 7f0da3600700 1 -- 172.21.15.120:0/4183879076 shutdown_connections 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.443+0000 7f0da3600700 1 -- 172.21.15.120:0/4183879076 wait complete. 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.444+0000 7f0da3600700 1 Processor -- start 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.444+0000 7f0da3600700 1 -- start start 2024-05-14T09:06:23.248 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.444+0000 7f0da3600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.444+0000 7f0da3600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c109b90 con 0x7f0d9c10aee0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.445+0000 7f0da0c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.445+0000 7f0da0c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41428/0 (socket says 172.21.15.120:41428) 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.445+0000 7f0da0c00700 1 -- 172.21.15.120:0/2102863126 learned_addr learned my addr 172.21.15.120:0/2102863126 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.445+0000 7f0da0c00700 1 -- 172.21.15.120:0/2102863126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c19fc40 con 0x7f0d9c10aee0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.445+0000 7f0da0c00700 1 --2- 172.21.15.120:0/2102863126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c19f700 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000c00 tx=0x7f0d90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.446+0000 7f0d99600700 1 -- 172.21.15.120:0/2102863126 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d90003db0 con 0x7f0d9c10aee0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.446+0000 7f0d99600700 1 -- 172.21.15.120:0/2102863126 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d90011630 con 0x7f0d9c10aee0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.446+0000 7f0d99600700 1 -- 172.21.15.120:0/2102863126 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d90011950 con 0x7f0d9c10aee0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.446+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c19fed0 con 0x7f0d9c10aee0 2024-05-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.446+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1a2ae0 con 0x7f0d9c10aee0 2024-05-14T09:06:23.250 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.446+0000 7f0d99600700 1 -- 172.21.15.120:0/2102863126 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d9001a460 con 0x7f0d9c10aee0 2024-05-14T09:06:23.250 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.446+0000 7f0d99600700 1 -- 172.21.15.120:0/2102863126 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0d9001b780 con 0x7f0d9c10aee0 2024-05-14T09:06:23.250 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.447+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c064e20 con 0x7f0d9c10aee0 2024-05-14T09:06:23.250 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.450+0000 7f0d99600700 1 -- 172.21.15.120:0/2102863126 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0d90031020 con 0x7f0d9c10aee0 2024-05-14T09:06:23.250 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.528+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f0d9c1a2cb0 con 0x7f0d9c10aee0 2024-05-14T09:06:23.250 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.529+0000 7f0d99600700 1 -- 172.21.15.120:0/2102863126 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f0d9001b980 con 0x7f0d9c10aee0 2024-05-14T09:06:23.251 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.531+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 msgr2=0x7f0d9c19f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:23.251 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.531+0000 7f0da3600700 1 --2- 172.21.15.120:0/2102863126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c19f700 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000c00 tx=0x7f0d90004750 comp rx=0 tx=0).stop 2024-05-14T09:06:23.251 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.531+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 shutdown_connections 2024-05-14T09:06:23.251 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.531+0000 7f0da3600700 1 --2- 172.21.15.120:0/2102863126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d9c10aee0 0x7f0d9c19f700 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:23.251 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.531+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 >> 172.21.15.120:0/2102863126 conn(0x7f0d9c104f10 msgr2=0x7f0d9c07d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:23.251 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.532+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 shutdown_connections 2024-05-14T09:06:23.252 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:22.532+0000 7f0da3600700 1 -- 172.21.15.120:0/2102863126 wait complete. 2024-05-14T09:06:23.252 INFO:teuthology.orchestra.run.smithi120.stdout:mon is available 2024-05-14T09:06:23.252 INFO:teuthology.orchestra.run.smithi120.stdout:Assimilating anything we can from ceph.conf... 2024-05-14T09:06:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:24 smithi120 ceph-mon[30717]: from='client.? 172.21.15.120:0/550835773' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-14T09:06:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:24 smithi120 ceph-mon[30717]: from='client.? 172.21.15.120:0/550835773' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-14T09:06:24.638 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:24.639 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [global] 2024-05-14T09:06:24.639 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout fsid = 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:24.639 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-14T09:06:24.639 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.120:3300,v1:172.21.15.120:6789] 2024-05-14T09:06:24.640 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-14T09:06:24.640 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-14T09:06:24.640 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [osd] 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-14T09:06:24.642 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-14T09:06:24.643 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-14T09:06:24.647 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.929+0000 7f503b800700 1 Processor -- start 2024-05-14T09:06:24.647 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.929+0000 7f503b800700 1 -- start start 2024-05-14T09:06:24.647 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.930+0000 7f503b800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503410b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.930+0000 7f503b800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f50341094e0 con 0x7f503410aee0 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.931+0000 7f5038e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503410b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.931+0000 7f5038e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503410b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41438/0 (socket says 172.21.15.120:41438) 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.931+0000 7f5038e00700 1 -- 172.21.15.120:0/3107887639 learned_addr learned my addr 172.21.15.120:0/3107887639 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.931+0000 7f5038e00700 1 -- 172.21.15.120:0/3107887639 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5034109660 con 0x7f503410aee0 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.931+0000 7f5038e00700 1 --2- 172.21.15.120:0/3107887639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503410b2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f50280098a0 tx=0x7f5028009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c0eeb837efe273 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.932+0000 7f5033400700 1 -- 172.21.15.120:0/3107887639 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5028004160 con 0x7f503410aee0 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.932+0000 7f5033400700 1 -- 172.21.15.120:0/3107887639 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5028004300 con 0x7f503410aee0 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.932+0000 7f5033400700 1 -- 172.21.15.120:0/3107887639 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50280036a0 con 0x7f503410aee0 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.933+0000 7f503b800700 1 -- 172.21.15.120:0/3107887639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 msgr2=0x7f503410b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.933+0000 7f503b800700 1 --2- 172.21.15.120:0/3107887639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503410b2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f50280098a0 tx=0x7f5028009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.933+0000 7f503b800700 1 -- 172.21.15.120:0/3107887639 shutdown_connections 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.933+0000 7f503b800700 1 --2- 172.21.15.120:0/3107887639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503410b2f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.933+0000 7f503b800700 1 -- 172.21.15.120:0/3107887639 >> 172.21.15.120:0/3107887639 conn(0x7f5034104f10 msgr2=0x7f50341073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.933+0000 7f503b800700 1 -- 172.21.15.120:0/3107887639 shutdown_connections 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.933+0000 7f503b800700 1 -- 172.21.15.120:0/3107887639 wait complete. 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.934+0000 7f503b800700 1 Processor -- start 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.934+0000 7f503b800700 1 -- start start 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.935+0000 7f503b800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503407e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.935+0000 7f503b800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5034109b90 con 0x7f503410aee0 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.935+0000 7f5038e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503407e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.935+0000 7f5038e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503407e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41442/0 (socket says 172.21.15.120:41442) 2024-05-14T09:06:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.935+0000 7f5038e00700 1 -- 172.21.15.120:0/550835773 learned_addr learned my addr 172.21.15.120:0/550835773 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.935+0000 7f5038e00700 1 -- 172.21.15.120:0/550835773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503407ef20 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.936+0000 7f5038e00700 1 --2- 172.21.15.120:0/550835773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503407e9e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5028000c00 tx=0x7f5028004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.936+0000 7f5031600700 1 -- 172.21.15.120:0/550835773 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5028003db0 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.936+0000 7f5031600700 1 -- 172.21.15.120:0/550835773 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5028011630 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.936+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503407d170 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.936+0000 7f5031600700 1 -- 172.21.15.120:0/550835773 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5028011950 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.936+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503407d650 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.936+0000 7f5031600700 1 -- 172.21.15.120:0/550835773 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f502801a460 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.937+0000 7f5031600700 1 -- 172.21.15.120:0/550835773 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f502801b780 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.937+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5034064e20 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:23.940+0000 7f5031600700 1 -- 172.21.15.120:0/550835773 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5028032080 con 0x7f503410aee0 2024-05-14T09:06:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.016+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f5034196540 con 0x7f503410aee0 2024-05-14T09:06:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.024+0000 7f5031600700 1 -- 172.21.15.120:0/550835773 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+467 (secure 0 0 0) 0x7f502801ba80 con 0x7f503410aee0 2024-05-14T09:06:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.026+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 msgr2=0x7f503407e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.026+0000 7f503b800700 1 --2- 172.21.15.120:0/550835773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503407e9e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5028000c00 tx=0x7f5028004750 comp rx=0 tx=0).stop 2024-05-14T09:06:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.026+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 shutdown_connections 2024-05-14T09:06:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.026+0000 7f503b800700 1 --2- 172.21.15.120:0/550835773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f503410aee0 0x7f503407e9e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.026+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 >> 172.21.15.120:0/550835773 conn(0x7f5034104f10 msgr2=0x7f5034193b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.026+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 shutdown_connections 2024-05-14T09:06:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:24.026+0000 7f503b800700 1 -- 172.21.15.120:0/550835773 wait complete. 2024-05-14T09:06:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:Generating new minimal ceph.conf... 2024-05-14T09:06:25.773 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:25 smithi120 ceph-mon[30717]: from='client.? 172.21.15.120:0/1740217455' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.324+0000 7f0aed000700 1 Processor -- start 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.325+0000 7f0aed000700 1 -- start start 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.325+0000 7f0aed000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae807daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.325+0000 7f0aed000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae807dfe0 con 0x7f0ae807f5d0 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.326+0000 7f0ae5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae807daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.326+0000 7f0ae5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae807daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41454/0 (socket says 172.21.15.120:41454) 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.326+0000 7f0ae5e00700 1 -- 172.21.15.120:0/4006635585 learned_addr learned my addr 172.21.15.120:0/4006635585 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.326+0000 7f0ae5e00700 1 -- 172.21.15.120:0/4006635585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae807e160 con 0x7f0ae807f5d0 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.326+0000 7f0ae5e00700 1 --2- 172.21.15.120:0/4006635585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae807daa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80098a0 tx=0x7f0ad8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af54f543a813310c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.327+0000 7f0ae4a00700 1 -- 172.21.15.120:0/4006635585 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad8004160 con 0x7f0ae807f5d0 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.327+0000 7f0ae4a00700 1 -- 172.21.15.120:0/4006635585 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0ad8004300 con 0x7f0ae807f5d0 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.327+0000 7f0ae4a00700 1 -- 172.21.15.120:0/4006635585 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad80119e0 con 0x7f0ae807f5d0 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.327+0000 7f0aed000700 1 -- 172.21.15.120:0/4006635585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 msgr2=0x7f0ae807daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.327+0000 7f0aed000700 1 --2- 172.21.15.120:0/4006635585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae807daa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80098a0 tx=0x7f0ad8009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.328+0000 7f0aed000700 1 -- 172.21.15.120:0/4006635585 shutdown_connections 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.328+0000 7f0aed000700 1 --2- 172.21.15.120:0/4006635585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae807daa0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.328+0000 7f0aed000700 1 -- 172.21.15.120:0/4006635585 >> 172.21.15.120:0/4006635585 conn(0x7f0ae8104ef0 msgr2=0x7f0ae8107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.328+0000 7f0aed000700 1 -- 172.21.15.120:0/4006635585 shutdown_connections 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.328+0000 7f0aed000700 1 -- 172.21.15.120:0/4006635585 wait complete. 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.329+0000 7f0aed000700 1 Processor -- start 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.329+0000 7f0aed000700 1 -- start start 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.329+0000 7f0aed000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:26.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.329+0000 7f0aed000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae810fdb0 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.330+0000 7f0ae5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.330+0000 7f0ae5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae819fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41466/0 (socket says 172.21.15.120:41466) 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.330+0000 7f0ae5e00700 1 -- 172.21.15.120:0/1740217455 learned_addr learned my addr 172.21.15.120:0/1740217455 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.330+0000 7f0ae5e00700 1 -- 172.21.15.120:0/1740217455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae81a0250 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.330+0000 7f0ae5e00700 1 --2- 172.21.15.120:0/1740217455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae819fd10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80116a0 tx=0x7f0ad8011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.331+0000 7f0adea00700 1 -- 172.21.15.120:0/1740217455 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad8003970 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.331+0000 7f0adea00700 1 -- 172.21.15.120:0/1740217455 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0ad8003b10 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.331+0000 7f0adea00700 1 -- 172.21.15.120:0/1740217455 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad8019550 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.331+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae81a04e0 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.331+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae81a30e0 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.331+0000 7f0adea00700 1 -- 172.21.15.120:0/1740217455 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0ad8019b50 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.331+0000 7f0adea00700 1 -- 172.21.15.120:0/1740217455 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ad800b720 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.332+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae8064e20 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.335+0000 7f0adea00700 1 -- 172.21.15.120:0/1740217455 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0ad801aa50 con 0x7f0ae807f5d0 2024-05-14T09:06:26.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.412+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0ae81a32b0 con 0x7f0ae807f5d0 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.412+0000 7f0adea00700 1 -- 172.21.15.120:0/1740217455 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f0ad801a430 con 0x7f0ae807f5d0 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.414+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 msgr2=0x7f0ae819fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.414+0000 7f0aed000700 1 --2- 172.21.15.120:0/1740217455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae819fd10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80116a0 tx=0x7f0ad8011a60 comp rx=0 tx=0).stop 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.414+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 shutdown_connections 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.414+0000 7f0aed000700 1 --2- 172.21.15.120:0/1740217455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ae807f5d0 0x7f0ae819fd10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.414+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 >> 172.21.15.120:0/1740217455 conn(0x7f0ae8104ef0 msgr2=0x7f0ae81057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.414+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 shutdown_connections 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:25.414+0000 7f0aed000700 1 -- 172.21.15.120:0/1740217455 wait complete. 2024-05-14T09:06:26.077 INFO:teuthology.orchestra.run.smithi120.stdout:Restarting the monitor... 2024-05-14T09:06:26.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:26 smithi120 systemd[1]: Stopping Ceph mon.a for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:06:31.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[30713]: 2024-05-14T09:06:30.859+0000 7faf61a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:06:31.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[30713]: 2024-05-14T09:06:30.859+0000 7faf61a00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-14T09:06:31.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:30 smithi120 podman[30960]: 2024-05-14 09:06:30.99367062 +0000 UTC m=+4.575579424 container died b999ece2bc5a6816452df36a55dc7f6573e488feee31243eab5d92d11cd228dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-14T09:06:36.073 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:35 smithi120 podman[30960]: 2024-05-14 09:06:35.830139095 +0000 UTC m=+9.412047925 container cleanup b999ece2bc5a6816452df36a55dc7f6573e488feee31243eab5d92d11cd228dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-14T09:06:36.073 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:35 smithi120 bash[30960]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a 2024-05-14T09:06:36.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:36 smithi120 podman[30974]: 2024-05-14 09:06:36.072740028 +0000 UTC m=+5.060663644 container remove b999ece2bc5a6816452df36a55dc7f6573e488feee31243eab5d92d11cd228dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-14T09:06:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:36 smithi120 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-14T09:06:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:36 smithi120 systemd[1]: Stopped Ceph mon.a for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:06:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:36 smithi120 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a.service: Consumed 2.017s CPU time. 2024-05-14T09:06:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:36 smithi120 systemd[1]: Starting Ceph mon.a for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:06:37.217 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:36 smithi120 podman[31065]: 2024-05-14 09:06:36.793978787 +0000 UTC m=+0.031434193 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:06:37.217 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:36 smithi120 podman[31065]: 2024-05-14 09:06:36.90703092 +0000 UTC m=+0.144486341 container create 44b134424df38e531ac57ab5a15b96b5c3968f8573b5b2aa724f46699ff026b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:06:37.217 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 podman[31065]: 2024-05-14 09:06:37.118789461 +0000 UTC m=+0.356244958 container init 44b134424df38e531ac57ab5a15b96b5c3968f8573b5b2aa724f46699ff026b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-05-14T09:06:37.217 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 podman[31065]: 2024-05-14 09:06:37.130001817 +0000 UTC m=+0.367457266 container start 44b134424df38e531ac57ab5a15b96b5c3968f8573b5b2aa724f46699ff026b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:06:37.230 INFO:teuthology.orchestra.run.smithi120.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-14T09:06:37.529 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 bash[31065]: 44b134424df38e531ac57ab5a15b96b5c3968f8573b5b2aa724f46699ff026b7 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 systemd[1]: Started Ceph mon.a for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: set uid:gid to 167:167 (ceph:ceph) 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev), process ceph-mon, pid 2 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: pidfile_write: ignore empty --pid-file 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: load: jerasure load: lrc 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: RocksDB version: 7.9.2 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Git sha 0 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Compile date 2024-05-09 05:50:40 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: DB SUMMARY 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: DB Session ID: BA8Y5O3L8XC1390X44FH 2024-05-14T09:06:37.530 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: CURRENT file: CURRENT 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: IDENTITY file: IDENTITY 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103006 ; 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.error_if_exists: 0 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.create_if_missing: 0 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.paranoid_checks: 1 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.env: 0x556913164500 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.fs: PosixFileSystem 2024-05-14T09:06:37.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.info_log: 0x55691f852060 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_file_opening_threads: 16 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.statistics: (nil) 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.use_fsync: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_log_file_size: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.keep_log_file_num: 1000 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.recycle_log_file_num: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.allow_fallocate: 1 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.allow_mmap_reads: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.allow_mmap_writes: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.use_direct_reads: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-14T09:06:37.532 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.create_missing_column_families: 0 2024-05-14T09:06:37.533 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.db_log_dir: 2024-05-14T09:06:37.533 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.wal_dir: 2024-05-14T09:06:37.533 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.advise_random_on_open: 1 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.db_write_buffer_size: 0 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.write_buffer_manager: 0x55691f71c8c0 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.rate_limiter: (nil) 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-14T09:06:37.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.wal_recovery_mode: 2 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.enable_thread_tracking: 0 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.enable_pipelined_write: 0 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.unordered_write: 0 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.row_cache: None 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.wal_filter: None 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.allow_ingest_behind: 0 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.two_write_queues: 0 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.manual_wal_flush: 0 2024-05-14T09:06:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.wal_compression: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.atomic_flush: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.log_readahead_size: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.best_efforts_recovery: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.allow_data_in_errors: 0 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.db_host_id: __hostname__ 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_background_jobs: 2 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_background_compactions: -1 2024-05-14T09:06:37.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_subcompactions: 1 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_total_wal_size: 0 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_open_files: -1 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bytes_per_sync: 0 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_readahead_size: 0 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_background_flushes: -1 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Compression algorithms supported: 2024-05-14T09:06:37.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kZSTD supported: 0 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kXpressCompression supported: 0 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kLZ4HCCompression supported: 1 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kZlibCompression supported: 1 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kSnappyCompression supported: 1 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kLZ4Compression supported: 1 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: kBZip2Compression supported: 0 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.merge_operator: 2024-05-14T09:06:37.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_filter: None 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_filter_factory: None 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.sst_partitioner_factory: None 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55691f852220) 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: cache_index_and_filter_blocks: 1 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: pin_top_level_index_and_filter: 1 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: index_type: 0 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: data_block_index_type: 0 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: index_shortening: 1 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: checksum: 4 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: no_block_cache: 0 2024-05-14T09:06:37.539 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache: 0x55691f74f1f0 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache_name: BinnedLRUCache 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache_options: 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: capacity : 536870912 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: num_shard_bits : 4 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: strict_capacity_limit : 0 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: high_pri_pool_ratio: 0.000 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache_compressed: (nil) 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: persistent_cache: (nil) 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_size: 4096 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_size_deviation: 10 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_restart_interval: 16 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: index_block_restart_interval: 1 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: metadata_block_size: 4096 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: partition_filters: 0 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: use_delta_encoding: 1 2024-05-14T09:06:37.540 INFO:journalctl@ceph.mon.a.smithi120.stdout: filter_policy: bloomfilter 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: whole_key_filtering: 1 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: verify_compression: 0 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: read_amp_bytes_per_bit: 0 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: format_version: 5 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: enable_index_compression: 1 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_align: 0 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: max_auto_readahead_size: 262144 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: prepopulate_block_cache: 0 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: initial_auto_readahead_size: 8192 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout: num_file_reads_for_auto_readahead: 2 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.write_buffer_size: 33554432 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_write_buffer_number: 2 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression: NoCompression 2024-05-14T09:06:37.541 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression: Disabled 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.prefix_extractor: nullptr 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.num_levels: 7 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-14T09:06:37.542 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.level: 32767 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.strategy: 0 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.enabled: false 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.target_file_size_base: 67108864 2024-05-14T09:06:37.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.arena_block_size: 1048576 2024-05-14T09:06:37.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-14T09:06:37.545 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-14T09:06:37.545 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.disable_auto_compactions: 0 2024-05-14T09:06:37.545 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-14T09:06:37.545 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.inplace_update_support: 0 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-14T09:06:37.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.bloom_locality: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.max_successive_merges: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.paranoid_file_checks: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.force_consistency_checks: 1 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.report_bg_io_stats: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.ttl: 2592000 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.enable_blob_files: false 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.min_blob_size: 0 2024-05-14T09:06:37.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.blob_file_size: 268435456 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.blob_file_starting_level: 0 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e62254c7-60e2-443c-8b5d-b631e01b25ef 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677597259407, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677597261165, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 98284, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 96272, "index_size": 268, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13651, "raw_average_key_size": 49, "raw_value_size": 88820, "raw_average_value_size": 320, "num_data_blocks": 12, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715677597, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e62254c7-60e2-443c-8b5d-b631e01b25ef", "db_session_id": "BA8Y5O3L8XC1390X44FH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-14T09:06:37.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677597261454, "job": 1, "event": "recovery_finished"} 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55691f733c00 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: DB pointer 0x556924526000 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** DB Stats ** 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T09:06:37.549 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** Compaction Stats [default] ** 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: L0 2/0 97.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: Sum 2/0 97.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** Compaction Stats [default] ** 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-14T09:06:37.550 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative compaction: 0.00 GB write, 12.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval compaction: 0.00 GB write, 12.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: Block cache BinnedLRUCache@0x55691f74f1f0#2 capacity: 512.00 MB usage: 1.38 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.91 KB,0.000172853%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: starting mon.a rank 0 at public addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] at bind addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:37.551 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???) e1 preinit fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???).mds e1 new map 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???).mds e1 print_map 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout: e1 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout: legacy client fscid: -1 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout: No filesystems configured 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:06:37.552 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: monmap epoch 1 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: last_changed 2024-05-14T09:06:17.594241+0000 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: min_mon_release 19 (squid) 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: election_strategy: 1 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: fsmap 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: osdmap e1: 0 total, 0 up, 0 in 2024-05-14T09:06:37.553 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:37 smithi120 ceph-mon[31085]: mgrmap e1: no daemons active 2024-05-14T09:06:38.577 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.878+0000 7f5ad9800700 1 Processor -- start 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.878+0000 7f5ad9800700 1 -- start start 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.878+0000 7f5ad9800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad4109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.878+0000 7f5ad9800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad410a0b0 con 0x7f5ad41096b0 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.879+0000 7f5ad3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad4109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.879+0000 7f5ad3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad4109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47066/0 (socket says 172.21.15.120:47066) 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.879+0000 7f5ad3e00700 1 -- 172.21.15.120:0/864951415 learned_addr learned my addr 172.21.15.120:0/864951415 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.880+0000 7f5ad3e00700 1 -- 172.21.15.120:0/864951415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad410a7e0 con 0x7f5ad41096b0 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.880+0000 7f5ad3e00700 1 --2- 172.21.15.120:0/864951415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad4109ac0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40098a0 tx=0x7f5ac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510c27d6a5e7a13c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.880+0000 7f5ad2a00700 1 -- 172.21.15.120:0/864951415 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac4004160 con 0x7f5ad41096b0 2024-05-14T09:06:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.880+0000 7f5ad2a00700 1 -- 172.21.15.120:0/864951415 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5ac4004300 con 0x7f5ad41096b0 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.880+0000 7f5ad2a00700 1 -- 172.21.15.120:0/864951415 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac40119e0 con 0x7f5ad41096b0 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.881+0000 7f5ad9800700 1 -- 172.21.15.120:0/864951415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 msgr2=0x7f5ad4109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.881+0000 7f5ad9800700 1 --2- 172.21.15.120:0/864951415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad4109ac0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40098a0 tx=0x7f5ac4009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.881+0000 7f5ad9800700 1 -- 172.21.15.120:0/864951415 shutdown_connections 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.881+0000 7f5ad9800700 1 --2- 172.21.15.120:0/864951415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad4109ac0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.881+0000 7f5ad9800700 1 -- 172.21.15.120:0/864951415 >> 172.21.15.120:0/864951415 conn(0x7f5ad4104d70 msgr2=0x7f5ad41071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.882+0000 7f5ad9800700 1 -- 172.21.15.120:0/864951415 shutdown_connections 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.882+0000 7f5ad9800700 1 -- 172.21.15.120:0/864951415 wait complete. 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.883+0000 7f5ad9800700 1 Processor -- start 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.883+0000 7f5ad9800700 1 -- start start 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.883+0000 7f5ad9800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.883+0000 7f5ad9800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad410db90 con 0x7f5ad41096b0 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.883+0000 7f5ad3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:38.583 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.884+0000 7f5ad3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad419d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47074/0 (socket says 172.21.15.120:47074) 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.884+0000 7f5ad3e00700 1 -- 172.21.15.120:0/873071036 learned_addr learned my addr 172.21.15.120:0/873071036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.884+0000 7f5ad3e00700 1 -- 172.21.15.120:0/873071036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad419df30 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.884+0000 7f5ad3e00700 1 --2- 172.21.15.120:0/873071036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad419d9f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40046e0 tx=0x7f5ac4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.885+0000 7f5ad0c00700 1 -- 172.21.15.120:0/873071036 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac40039e0 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.885+0000 7f5ad0c00700 1 -- 172.21.15.120:0/873071036 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5ac4003b80 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.885+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad419e1c0 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.885+0000 7f5ad0c00700 1 -- 172.21.15.120:0/873071036 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac4024700 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.885+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad41a0dd0 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.886+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad4064e20 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.886+0000 7f5ad0c00700 1 -- 172.21.15.120:0/873071036 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ac4022020 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.886+0000 7f5ad0c00700 1 -- 172.21.15.120:0/873071036 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5ac401a890 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.889+0000 7f5ad0c00700 1 -- 172.21.15.120:0/873071036 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5ac401a430 con 0x7f5ad41096b0 2024-05-14T09:06:38.584 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.965+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f5ad41a10e0 con 0x7f5ad41096b0 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.968+0000 7f5ad0c00700 1 -- 172.21.15.120:0/873071036 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f5ac401ab30 con 0x7f5ad41096b0 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.970+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 msgr2=0x7f5ad419d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.970+0000 7f5ad9800700 1 --2- 172.21.15.120:0/873071036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad419d9f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40046e0 tx=0x7f5ac4011a60 comp rx=0 tx=0).stop 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.970+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 shutdown_connections 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.970+0000 7f5ad9800700 1 --2- 172.21.15.120:0/873071036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad41096b0 0x7f5ad419d9f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.970+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 >> 172.21.15.120:0/873071036 conn(0x7f5ad4104d70 msgr2=0x7f5ad41066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.970+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 shutdown_connections 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:37.970+0000 7f5ad9800700 1 -- 172.21.15.120:0/873071036 wait complete. 2024-05-14T09:06:38.585 INFO:teuthology.orchestra.run.smithi120.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-14T09:06:38.623 INFO:teuthology.orchestra.run.smithi120.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:06:38.623 INFO:teuthology.orchestra.run.smithi120.stdout:Creating mgr... 2024-05-14T09:06:38.624 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-14T09:06:38.625 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-14T09:06:39.035 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.x 2024-05-14T09:06:39.035 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to reset failed state of unit ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.x.service: Unit ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.x.service not loaded. 2024-05-14T09:06:39.291 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968.target.wants/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@.service. 2024-05-14T09:06:39.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:38 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/873071036' entity='client.admin' 2024-05-14T09:06:39.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:39 smithi120 systemd[1]: Starting Ceph mgr.x for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:06:39.946 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:39 smithi120 podman[31311]: 2024-05-14 09:06:39.575441102 +0000 UTC m=+0.029849721 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:06:39.946 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:39 smithi120 podman[31311]: 2024-05-14 09:06:39.692101418 +0000 UTC m=+0.146510075 container create b226b2d5171a1191a840c5b9d83a4e7a98adb89ff329a93958b10f99b79a55b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-14T09:06:39.946 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:39 smithi120 podman[31311]: 2024-05-14 09:06:39.945520287 +0000 UTC m=+0.399928951 container init b226b2d5171a1191a840c5b9d83a4e7a98adb89ff329a93958b10f99b79a55b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T09:06:40.072 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T09:06:40.072 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-05-14T09:06:40.089 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T09:06:40.089 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-05-14T09:06:40.089 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-05-14T09:06:40.090 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to enable service . firewalld.service is not available 2024-05-14T09:06:40.108 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T09:06:40.108 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-05-14T09:06:40.124 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T09:06:40.124 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-05-14T09:06:40.124 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-05-14T09:06:40.124 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-14T09:06:40.124 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr to start... 2024-05-14T09:06:40.124 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr... 2024-05-14T09:06:40.274 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:39 smithi120 podman[31311]: 2024-05-14 09:06:39.95511606 +0000 UTC m=+0.409524707 container start b226b2d5171a1191a840c5b9d83a4e7a98adb89ff329a93958b10f99b79a55b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-14T09:06:40.274 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:40 smithi120 bash[31311]: b226b2d5171a1191a840c5b9d83a4e7a98adb89ff329a93958b10f99b79a55b8 2024-05-14T09:06:40.274 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:40 smithi120 systemd[1]: Started Ceph mgr.x for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:06:40.561 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:40.283+0000 7f5ef6ad1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T09:06:40.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:40.559+0000 7f5ef6ad1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:06:40.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:40.696+0000 7f5ef6ad1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T09:06:41.216 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:41.110+0000 7f5ef6ad1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T09:06:41.562 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:41.230+0000 7f5ef6ad1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T09:06:41.562 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:41 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3777271654' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T09:06:41.874 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 0 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T09:06:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T09:06:41.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T09:06:21.774171+0000", 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T09:06:41.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.126+0000 7fb70b800700 1 Processor -- start 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.126+0000 7fb70b800700 1 -- start start 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.126+0000 7fb70b800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70410b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.127+0000 7fb70b800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041094e0 con 0x7fb70410aee0 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.127+0000 7fb708e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70410b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.127+0000 7fb708e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70410b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50312/0 (socket says 172.21.15.120:50312) 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.127+0000 7fb708e00700 1 -- 172.21.15.120:0/3888992708 learned_addr learned my addr 172.21.15.120:0/3888992708 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.128+0000 7fb708e00700 1 -- 172.21.15.120:0/3888992708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb704109660 con 0x7fb70410aee0 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.128+0000 7fb708e00700 1 --2- 172.21.15.120:0/3888992708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70410b2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80098a0 tx=0x7fb6f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d5f5aa5a909c4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.128+0000 7fb703400700 1 -- 172.21.15.120:0/3888992708 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f8004160 con 0x7fb70410aee0 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.128+0000 7fb703400700 1 -- 172.21.15.120:0/3888992708 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fb6f8004300 con 0x7fb70410aee0 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.128+0000 7fb703400700 1 -- 172.21.15.120:0/3888992708 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f80119e0 con 0x7fb70410aee0 2024-05-14T09:06:41.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.129+0000 7fb70b800700 1 -- 172.21.15.120:0/3888992708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 msgr2=0x7fb70410b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.129+0000 7fb70b800700 1 --2- 172.21.15.120:0/3888992708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70410b2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80098a0 tx=0x7fb6f8009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.129+0000 7fb70b800700 1 -- 172.21.15.120:0/3888992708 shutdown_connections 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.129+0000 7fb70b800700 1 --2- 172.21.15.120:0/3888992708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70410b2f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.129+0000 7fb70b800700 1 -- 172.21.15.120:0/3888992708 >> 172.21.15.120:0/3888992708 conn(0x7fb704104f10 msgr2=0x7fb7041073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.130+0000 7fb70b800700 1 -- 172.21.15.120:0/3888992708 shutdown_connections 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.130+0000 7fb70b800700 1 -- 172.21.15.120:0/3888992708 wait complete. 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.131+0000 7fb70b800700 1 Processor -- start 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.131+0000 7fb70b800700 1 -- start start 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.131+0000 7fb70b800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70407e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.131+0000 7fb70b800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb70410dd80 con 0x7fb70410aee0 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.131+0000 7fb708e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70407e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.132+0000 7fb708e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70407e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50326/0 (socket says 172.21.15.120:50326) 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.132+0000 7fb708e00700 1 -- 172.21.15.120:0/3777271654 learned_addr learned my addr 172.21.15.120:0/3777271654 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:41.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.132+0000 7fb708e00700 1 -- 172.21.15.120:0/3777271654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70407ef20 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.132+0000 7fb708e00700 1 --2- 172.21.15.120:0/3777271654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70407e9e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80119b0 tx=0x7fb6f8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.133+0000 7fb701600700 1 -- 172.21.15.120:0/3777271654 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f8003af0 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.133+0000 7fb701600700 1 -- 172.21.15.120:0/3777271654 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fb6f801a8a0 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.133+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70407d170 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.133+0000 7fb701600700 1 -- 172.21.15.120:0/3777271654 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f8024780 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.133+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70407d650 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.133+0000 7fb701600700 1 -- 172.21.15.120:0/3777271654 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb6f8022020 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.133+0000 7fb701600700 1 -- 172.21.15.120:0/3777271654 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb6f802dd50 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.134+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb704064e20 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.137+0000 7fb701600700 1 -- 172.21.15.120:0/3777271654 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb6f801aa50 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.216+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb70407dc00 con 0x7fb70410aee0 2024-05-14T09:06:41.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.217+0000 7fb701600700 1 -- 172.21.15.120:0/3777271654 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb6f8032030 con 0x7fb70410aee0 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.219+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 msgr2=0x7fb70407e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.219+0000 7fb70b800700 1 --2- 172.21.15.120:0/3777271654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70407e9e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80119b0 tx=0x7fb6f8011a90 comp rx=0 tx=0).stop 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.219+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 shutdown_connections 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.219+0000 7fb70b800700 1 --2- 172.21.15.120:0/3777271654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70410aee0 0x7fb70407e9e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.219+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 >> 172.21.15.120:0/3777271654 conn(0x7fb704104f10 msgr2=0x7fb7041058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.219+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 shutdown_connections 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:41.219+0000 7fb70b800700 1 -- 172.21.15.120:0/3777271654 wait complete. 2024-05-14T09:06:41.895 INFO:teuthology.orchestra.run.smithi120.stdout:mgr not available, waiting (1/15)... 2024-05-14T09:06:43.134 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:42 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:42.806+0000 7f5ef6ad1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T09:06:43.134 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:43.031+0000 7f5ef6ad1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T09:06:43.621 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:43.244+0000 7f5ef6ad1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T09:06:43.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:43.621+0000 7f5ef6ad1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T09:06:43.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:43.742+0000 7f5ef6ad1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T09:06:44.258 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:43.994+0000 7f5ef6ad1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T09:06:44.258 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:44 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:44.258+0000 7f5ef6ad1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:06:44.883 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:44 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2422673324' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T09:06:45.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:45.111+0000 7f5ef6ad1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T09:06:45.648 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:45.396+0000 7f5ef6ad1200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 0 2024-05-14T09:06:45.652 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T09:06:45.653 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T09:06:45.661 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T09:06:45.661 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T09:06:45.661 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T09:06:45.661 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:45.662 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T09:06:21.774171+0000", 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.590+0000 7f100e600700 1 Processor -- start 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.590+0000 7f100e600700 1 -- start start 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.591+0000 7f100e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f1008109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.591+0000 7f100e600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f100810a0b0 con 0x7f10081096b0 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.591+0000 7f100d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f1008109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:45.664 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.591+0000 7f100d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f1008109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50338/0 (socket says 172.21.15.120:50338) 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.591+0000 7f100d200700 1 -- 172.21.15.120:0/3689661664 learned_addr learned my addr 172.21.15.120:0/3689661664 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.592+0000 7f100d200700 1 -- 172.21.15.120:0/3689661664 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100810a7e0 con 0x7f10081096b0 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.592+0000 7f100d200700 1 --2- 172.21.15.120:0/3689661664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f1008109ac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098a0 tx=0x7f0ffc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50472eb7a1af46 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.592+0000 7f1007400700 1 -- 172.21.15.120:0/3689661664 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ffc004160 con 0x7f10081096b0 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.593+0000 7f1007400700 1 -- 172.21.15.120:0/3689661664 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0ffc004300 con 0x7f10081096b0 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.593+0000 7f1007400700 1 -- 172.21.15.120:0/3689661664 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ffc0119e0 con 0x7f10081096b0 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.593+0000 7f100e600700 1 -- 172.21.15.120:0/3689661664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 msgr2=0x7f1008109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.593+0000 7f100e600700 1 --2- 172.21.15.120:0/3689661664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f1008109ac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098a0 tx=0x7f0ffc009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.594+0000 7f100e600700 1 -- 172.21.15.120:0/3689661664 shutdown_connections 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.594+0000 7f100e600700 1 --2- 172.21.15.120:0/3689661664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f1008109ac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.594+0000 7f100e600700 1 -- 172.21.15.120:0/3689661664 >> 172.21.15.120:0/3689661664 conn(0x7f1008104d70 msgr2=0x7f10081071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.594+0000 7f100e600700 1 -- 172.21.15.120:0/3689661664 shutdown_connections 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.594+0000 7f100e600700 1 -- 172.21.15.120:0/3689661664 wait complete. 2024-05-14T09:06:45.665 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.595+0000 7f100e600700 1 Processor -- start 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.595+0000 7f100e600700 1 -- start start 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.595+0000 7f100e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f100807e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.595+0000 7f100e600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f100810db90 con 0x7f10081096b0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.596+0000 7f100d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f100807e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.596+0000 7f100d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f100807e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50340/0 (socket says 172.21.15.120:50340) 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.596+0000 7f100d200700 1 -- 172.21.15.120:0/2422673324 learned_addr learned my addr 172.21.15.120:0/2422673324 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.596+0000 7f100d200700 1 -- 172.21.15.120:0/2422673324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100807ef20 con 0x7f10081096b0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.596+0000 7f100d200700 1 --2- 172.21.15.120:0/2422673324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f100807e9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0046e0 tx=0x7f0ffc011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.596+0000 7f1005600700 1 -- 172.21.15.120:0/2422673324 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ffc0039e0 con 0x7f10081096b0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.597+0000 7f1005600700 1 -- 172.21.15.120:0/2422673324 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0ffc003b80 con 0x7f10081096b0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.597+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100807d170 con 0x7f10081096b0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.597+0000 7f1005600700 1 -- 172.21.15.120:0/2422673324 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ffc024700 con 0x7f10081096b0 2024-05-14T09:06:45.666 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.597+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100807d650 con 0x7f10081096b0 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.597+0000 7f1005600700 1 -- 172.21.15.120:0/2422673324 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0ffc022020 con 0x7f10081096b0 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.597+0000 7f1005600700 1 -- 172.21.15.120:0/2422673324 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ffc02dd40 con 0x7f10081096b0 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.598+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1008064e20 con 0x7f10081096b0 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.603+0000 7f1005600700 1 -- 172.21.15.120:0/2422673324 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0ffc01ab30 con 0x7f10081096b0 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.682+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f100807dd40 con 0x7f10081096b0 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.683+0000 7f1005600700 1 -- 172.21.15.120:0/2422673324 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0ffc02d3f0 con 0x7f10081096b0 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.685+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 msgr2=0x7f100807e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.685+0000 7f100e600700 1 --2- 172.21.15.120:0/2422673324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f100807e9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0046e0 tx=0x7f0ffc011a60 comp rx=0 tx=0).stop 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.685+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 shutdown_connections 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.685+0000 7f100e600700 1 --2- 172.21.15.120:0/2422673324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10081096b0 0x7f100807e9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.685+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 >> 172.21.15.120:0/2422673324 conn(0x7f1008104d70 msgr2=0x7f10081066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.686+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 shutdown_connections 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:44.686+0000 7f100e600700 1 -- 172.21.15.120:0/2422673324 wait complete. 2024-05-14T09:06:45.667 INFO:teuthology.orchestra.run.smithi120.stdout:mgr not available, waiting (2/15)... 2024-05-14T09:06:46.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:45.950+0000 7f5ef6ad1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T09:06:46.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:46.077+0000 7f5ef6ad1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T09:06:46.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:46.535+0000 7f5ef6ad1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T09:06:47.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:46.985+0000 7f5ef6ad1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T09:06:47.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:47.108+0000 7f5ef6ad1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T09:06:47.738 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:47.428+0000 7f5ef6ad1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T09:06:47.738 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:47.609+0000 7f5ef6ad1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T09:06:47.738 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:47.738+0000 7f5ef6ad1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T09:06:48.374 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:48.146+0000 7f5ef6ad1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T09:06:48.374 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:48.275+0000 7f5ef6ad1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T09:06:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:48 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2400750955' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T09:06:49.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 0 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T09:06:49.011 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T09:06:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T09:06:49.020 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T09:06:49.020 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T09:06:49.020 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T09:06:49.020 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T09:06:49.021 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T09:06:49.022 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T09:06:21.774171+0000", 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.286+0000 7f797f000700 1 Processor -- start 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.286+0000 7f797f000700 1 -- start start 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.286+0000 7f797f000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f797807d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.286+0000 7f797f000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f797807d7e0 con 0x7f797807edf0 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.287+0000 7f7977e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f797807d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.287+0000 7f7977e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f797807d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50008/0 (socket says 172.21.15.120:50008) 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.287+0000 7f7977e00700 1 -- 172.21.15.120:0/1621549593 learned_addr learned my addr 172.21.15.120:0/1621549593 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.287+0000 7f7977e00700 1 -- 172.21.15.120:0/1621549593 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797807d960 con 0x7f797807edf0 2024-05-14T09:06:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.287+0000 7f7977e00700 1 --2- 172.21.15.120:0/1621549593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f797807d210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f79680098a0 tx=0x7f7968009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dfb45b63f5ab68 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.288+0000 7f7976a00700 1 -- 172.21.15.120:0/1621549593 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7968004160 con 0x7f797807edf0 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.288+0000 7f7976a00700 1 -- 172.21.15.120:0/1621549593 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7968004300 con 0x7f797807edf0 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.288+0000 7f7976a00700 1 -- 172.21.15.120:0/1621549593 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79680119e0 con 0x7f797807edf0 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.289+0000 7f797f000700 1 -- 172.21.15.120:0/1621549593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 msgr2=0x7f797807d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.289+0000 7f797f000700 1 --2- 172.21.15.120:0/1621549593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f797807d210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f79680098a0 tx=0x7f7968009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.289+0000 7f797f000700 1 -- 172.21.15.120:0/1621549593 shutdown_connections 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.289+0000 7f797f000700 1 --2- 172.21.15.120:0/1621549593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f797807d210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.289+0000 7f797f000700 1 -- 172.21.15.120:0/1621549593 >> 172.21.15.120:0/1621549593 conn(0x7f7978104f10 msgr2=0x7f79781073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.289+0000 7f797f000700 1 -- 172.21.15.120:0/1621549593 shutdown_connections 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.289+0000 7f797f000700 1 -- 172.21.15.120:0/1621549593 wait complete. 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.290+0000 7f797f000700 1 Processor -- start 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.290+0000 7f797f000700 1 -- start start 2024-05-14T09:06:49.024 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.290+0000 7f797f000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f79781a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.290+0000 7f797f000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f797810bab0 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.291+0000 7f7977e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f79781a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.291+0000 7f7977e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f79781a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50024/0 (socket says 172.21.15.120:50024) 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.291+0000 7f7977e00700 1 -- 172.21.15.120:0/2400750955 learned_addr learned my addr 172.21.15.120:0/2400750955 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.291+0000 7f7977e00700 1 -- 172.21.15.120:0/2400750955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79781a4820 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.291+0000 7f7977e00700 1 --2- 172.21.15.120:0/2400750955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f79781a42e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79680119b0 tx=0x7f7968011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.292+0000 7f7974c00700 1 -- 172.21.15.120:0/2400750955 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7968003af0 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.292+0000 7f7974c00700 1 -- 172.21.15.120:0/2400750955 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f796801a8a0 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.292+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79781a4ab0 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.292+0000 7f7974c00700 1 -- 172.21.15.120:0/2400750955 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7968024830 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.292+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79781a76c0 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.292+0000 7f7974c00700 1 -- 172.21.15.120:0/2400750955 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7968022020 con 0x7f797807edf0 2024-05-14T09:06:49.025 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.292+0000 7f7974c00700 1 -- 172.21.15.120:0/2400750955 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f796802dde0 con 0x7f797807edf0 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.293+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978064e20 con 0x7f797807edf0 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.295+0000 7f7974c00700 1 -- 172.21.15.120:0/2400750955 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f796801aa50 con 0x7f797807edf0 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.374+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f797802e840 con 0x7f797807edf0 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.375+0000 7f7974c00700 1 -- 172.21.15.120:0/2400750955 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f7968032030 con 0x7f797807edf0 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.376+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 msgr2=0x7f79781a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.376+0000 7f797f000700 1 --2- 172.21.15.120:0/2400750955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f79781a42e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79680119b0 tx=0x7f7968011a90 comp rx=0 tx=0).stop 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.376+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 shutdown_connections 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.376+0000 7f797f000700 1 --2- 172.21.15.120:0/2400750955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f797807edf0 0x7f79781a42e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.376+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 >> 172.21.15.120:0/2400750955 conn(0x7f7978104f10 msgr2=0x7f797819ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.377+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 shutdown_connections 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:48.377+0000 7f797f000700 1 -- 172.21.15.120:0/2400750955 wait complete. 2024-05-14T09:06:49.026 INFO:teuthology.orchestra.run.smithi120.stdout:mgr not available, waiting (3/15)... 2024-05-14T09:06:49.367 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:49.081+0000 7f5ef6ad1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T09:06:49.367 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:49.366+0000 7f5ef6ad1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T09:06:49.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: Activating manager daemon x 2024-05-14T09:06:49.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: mgrmap e2: x(active, starting, since 0.00698559s) 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: Manager daemon x is now available 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' 2024-05-14T09:06:49.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:49 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' 2024-05-14T09:06:50.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:50 smithi120 ceph-mon[31085]: from='mgr.14100 172.21.15.120:0/73849976' entity='mgr.x' 2024-05-14T09:06:50.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:50 smithi120 ceph-mon[31085]: mgrmap e3: x(active, since 1.02476s) 2024-05-14T09:06:52.787 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:52 smithi120 ceph-mon[31085]: mgrmap e4: x(active, since 2s) 2024-05-14T09:06:52.787 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:52 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2531529861' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T09:06:52.796 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:52.796 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:06:52.796 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:06:52.796 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T09:06:52.796 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T09:06:52.796 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T09:06:52.797 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 0 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T09:06:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:52.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T09:06:52.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:52.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T09:06:52.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T09:06:52.810 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T09:06:52.810 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T09:06:52.810 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T09:06:52.810 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T09:06:52.810 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T09:06:52.811 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T09:06:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T09:06:21.774171+0000", 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.732+0000 7f98c0e00700 1 Processor -- start 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.732+0000 7f98c0e00700 1 -- start start 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.733+0000 7f98c0e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc10b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.733+0000 7f98c0e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1094e0 con 0x7f98bc10aee0 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.733+0000 7f98b9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc10b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.733+0000 7f98b9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc10b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50100/0 (socket says 172.21.15.120:50100) 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.733+0000 7f98b9e00700 1 -- 172.21.15.120:0/493982435 learned_addr learned my addr 172.21.15.120:0/493982435 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:52.813 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.734+0000 7f98b9e00700 1 -- 172.21.15.120:0/493982435 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc109660 con 0x7f98bc10aee0 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.734+0000 7f98b9e00700 1 --2- 172.21.15.120:0/493982435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc10b2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0098a0 tx=0x7f98ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2ca62989f2003e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.734+0000 7f98b8a00700 1 -- 172.21.15.120:0/493982435 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac004160 con 0x7f98bc10aee0 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.734+0000 7f98b8a00700 1 -- 172.21.15.120:0/493982435 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f98ac004300 con 0x7f98bc10aee0 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.734+0000 7f98b8a00700 1 -- 172.21.15.120:0/493982435 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac0119e0 con 0x7f98bc10aee0 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.735+0000 7f98c0e00700 1 -- 172.21.15.120:0/493982435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 msgr2=0x7f98bc10b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.735+0000 7f98c0e00700 1 --2- 172.21.15.120:0/493982435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc10b2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0098a0 tx=0x7f98ac009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.735+0000 7f98c0e00700 1 -- 172.21.15.120:0/493982435 shutdown_connections 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.735+0000 7f98c0e00700 1 --2- 172.21.15.120:0/493982435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc10b2f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.735+0000 7f98c0e00700 1 -- 172.21.15.120:0/493982435 >> 172.21.15.120:0/493982435 conn(0x7f98bc104f10 msgr2=0x7f98bc1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.736+0000 7f98c0e00700 1 -- 172.21.15.120:0/493982435 shutdown_connections 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.736+0000 7f98c0e00700 1 -- 172.21.15.120:0/493982435 wait complete. 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.737+0000 7f98c0e00700 1 Processor -- start 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.737+0000 7f98c0e00700 1 -- start start 2024-05-14T09:06:52.814 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.737+0000 7f98c0e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc19ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.737+0000 7f98c0e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc10dd80 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.738+0000 7f98b9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc19ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.738+0000 7f98b9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc19ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50102/0 (socket says 172.21.15.120:50102) 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.738+0000 7f98b9e00700 1 -- 172.21.15.120:0/2531529861 learned_addr learned my addr 172.21.15.120:0/2531529861 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.738+0000 7f98b9e00700 1 -- 172.21.15.120:0/2531529861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc1a0450 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.738+0000 7f98b9e00700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc19ff10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0119b0 tx=0x7f98ac011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.739+0000 7f98b2a00700 1 -- 172.21.15.120:0/2531529861 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac003af0 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.739+0000 7f98b2a00700 1 -- 172.21.15.120:0/2531529861 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f98ac01a8a0 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.739+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98bc1a06e0 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.739+0000 7f98b2a00700 1 -- 172.21.15.120:0/2531529861 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac024780 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.739+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98bc1a32f0 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.740+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98bc064e20 con 0x7f98bc10aee0 2024-05-14T09:06:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.740+0000 7f98b2a00700 1 -- 172.21.15.120:0/2531529861 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f98ac022020 con 0x7f98bc10aee0 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.741+0000 7f98b2a00700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f98a003e470 0x7f98a0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.741+0000 7f98b2a00700 1 -- 172.21.15.120:0/2531529861 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f98ac053660 con 0x7f98bc10aee0 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.741+0000 7f98b9400700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f98a003e470 0x7f98a0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.742+0000 7f98b9400700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f98a003e470 0x7f98a0040980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f98a8006fd0 tx=0x7f98a8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:51.748+0000 7f98b2a00700 1 -- 172.21.15.120:0/2531529861 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f98ac00b3e0 con 0x7f98bc10aee0 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.067+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f98bc1a3860 con 0x7f98bc10aee0 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.068+0000 7f98b2a00700 1 -- 172.21.15.120:0/2531529861 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f98ac010380 con 0x7f98bc10aee0 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f98a003e470 msgr2=0x7f98a0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f98a003e470 0x7f98a0040980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f98a8006fd0 tx=0x7f98a8006e40 comp rx=0 tx=0).stop 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 msgr2=0x7f98bc19ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc19ff10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0119b0 tx=0x7f98ac011a90 comp rx=0 tx=0).stop 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 shutdown_connections 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f98a003e470 0x7f98a0040980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 --2- 172.21.15.120:0/2531529861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98bc10aee0 0x7f98bc19ff10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 >> 172.21.15.120:0/2531529861 conn(0x7f98bc104f10 msgr2=0x7f98bc1058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.071+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 shutdown_connections 2024-05-14T09:06:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:52.072+0000 7f98c0e00700 1 -- 172.21.15.120:0/2531529861 wait complete. 2024-05-14T09:06:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:mgr is available 2024-05-14T09:06:54.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:53 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3362942613' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-14T09:06:54.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:54.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [global] 2024-05-14T09:06:54.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout fsid = 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:06:54.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-14T09:06:54.360 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-14T09:06:54.360 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-14T09:06:54.360 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-14T09:06:54.360 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-14T09:06:54.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:54.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-14T09:06:54.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-14T09:06:54.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-05-14T09:06:54.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [osd] 2024-05-14T09:06:54.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-14T09:06:54.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-14T09:06:54.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.505+0000 7f3538e00700 1 Processor -- start 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.505+0000 7f3538e00700 1 -- start start 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.505+0000 7f3538e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353410be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.505+0000 7f3538e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f353410c480 con 0x7f353410ba80 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.506+0000 7f3531e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353410be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.506+0000 7f3531e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353410be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50114/0 (socket says 172.21.15.120:50114) 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.506+0000 7f3531e00700 1 -- 172.21.15.120:0/2415403639 learned_addr learned my addr 172.21.15.120:0/2415403639 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.506+0000 7f3531e00700 1 -- 172.21.15.120:0/2415403639 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353410cbb0 con 0x7f353410ba80 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.507+0000 7f3531e00700 1 --2- 172.21.15.120:0/2415403639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353410be90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f35240098a0 tx=0x7f3524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3f976608dd00e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.507+0000 7f3530a00700 1 -- 172.21.15.120:0/2415403639 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3524004160 con 0x7f353410ba80 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.507+0000 7f3530a00700 1 -- 172.21.15.120:0/2415403639 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3524004300 con 0x7f353410ba80 2024-05-14T09:06:54.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.507+0000 7f3530a00700 1 -- 172.21.15.120:0/2415403639 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35240119e0 con 0x7f353410ba80 2024-05-14T09:06:54.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.508+0000 7f3538e00700 1 -- 172.21.15.120:0/2415403639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 msgr2=0x7f353410be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:54.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.508+0000 7f3538e00700 1 --2- 172.21.15.120:0/2415403639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353410be90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f35240098a0 tx=0x7f3524009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:54.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.508+0000 7f3538e00700 1 -- 172.21.15.120:0/2415403639 shutdown_connections 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.508+0000 7f3538e00700 1 --2- 172.21.15.120:0/2415403639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353410be90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.508+0000 7f3538e00700 1 -- 172.21.15.120:0/2415403639 >> 172.21.15.120:0/2415403639 conn(0x7f353407ef40 msgr2=0x7f353407f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.508+0000 7f3538e00700 1 -- 172.21.15.120:0/2415403639 shutdown_connections 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.508+0000 7f3538e00700 1 -- 172.21.15.120:0/2415403639 wait complete. 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.509+0000 7f3538e00700 1 Processor -- start 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.510+0000 7f3538e00700 1 -- start start 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.510+0000 7f3538e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.510+0000 7f3538e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f353410ff60 con 0x7f353410ba80 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.510+0000 7f3531e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.510+0000 7f3531e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50118/0 (socket says 172.21.15.120:50118) 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.510+0000 7f3531e00700 1 -- 172.21.15.120:0/3362942613 learned_addr learned my addr 172.21.15.120:0/3362942613 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.511+0000 7f3531e00700 1 -- 172.21.15.120:0/3362942613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35341a02e0 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.511+0000 7f3531e00700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353419fda0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f35240046e0 tx=0x7f3524011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.511+0000 7f352aa00700 1 -- 172.21.15.120:0/3362942613 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35240039e0 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.511+0000 7f352aa00700 1 -- 172.21.15.120:0/3362942613 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3524003b80 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.511+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35341a0570 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.511+0000 7f352aa00700 1 -- 172.21.15.120:0/3362942613 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3524024700 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.511+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35341a3180 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.513+0000 7f352aa00700 1 -- 172.21.15.120:0/3362942613 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f3524022020 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.513+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3534064e20 con 0x7f353410ba80 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.513+0000 7f352aa00700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f351803e470 0x7f3518040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.513+0000 7f352aa00700 1 -- 172.21.15.120:0/3362942613 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f35240536b0 con 0x7f353410ba80 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.513+0000 7f3531400700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f351803e470 0x7f3518040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.514+0000 7f3531400700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f351803e470 0x7f3518040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f351c006fd0 tx=0x7f351c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.519+0000 7f352aa00700 1 -- 172.21.15.120:0/3362942613 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f352401a910 con 0x7f353410ba80 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.747+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f35341a4980 con 0x7f353410ba80 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.749+0000 7f352aa00700 1 -- 172.21.15.120:0/3362942613 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f3524053410 con 0x7f353410ba80 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.752+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f351803e470 msgr2=0x7f3518040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.752+0000 7f3538e00700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f351803e470 0x7f3518040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f351c006fd0 tx=0x7f351c006e40 comp rx=0 tx=0).stop 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.752+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 msgr2=0x7f353419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.752+0000 7f3538e00700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353419fda0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f35240046e0 tx=0x7f3524011a60 comp rx=0 tx=0).stop 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.753+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 shutdown_connections 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.753+0000 7f3538e00700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f351803e470 0x7f3518040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.753+0000 7f3538e00700 1 --2- 172.21.15.120:0/3362942613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f353410ba80 0x7f353419fda0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.753+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 >> 172.21.15.120:0/3362942613 conn(0x7f353407ef40 msgr2=0x7f3534108a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.753+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 shutdown_connections 2024-05-14T09:06:54.371 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:53.753+0000 7f3538e00700 1 -- 172.21.15.120:0/3362942613 wait complete. 2024-05-14T09:06:54.372 INFO:teuthology.orchestra.run.smithi120.stdout:Enabling cephadm module... 2024-05-14T09:06:55.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:55 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1413842188' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-14T09:06:55.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: ignoring --setuser ceph since I am not root 2024-05-14T09:06:55.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: ignoring --setgroup ceph since I am not root 2024-05-14T09:06:56.078 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:55.743+0000 7f975de85200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T09:06:56.078 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:55.984+0000 7f975de85200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.013+0000 7f6b0f200700 1 Processor -- start 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.013+0000 7f6b0f200700 1 -- start start 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.014+0000 7f6b0f200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b08109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.014+0000 7f6b0f200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0810a0b0 con 0x7f6b081096b0 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.014+0000 7f6b0de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b08109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.014+0000 7f6b0de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b08109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50120/0 (socket says 172.21.15.120:50120) 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.014+0000 7f6b0de00700 1 -- 172.21.15.120:0/2295309857 learned_addr learned my addr 172.21.15.120:0/2295309857 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.015+0000 7f6b0de00700 1 -- 172.21.15.120:0/2295309857 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0810a7e0 con 0x7f6b081096b0 2024-05-14T09:06:56.094 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.015+0000 7f6b0de00700 1 --2- 172.21.15.120:0/2295309857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b08109ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0098a0 tx=0x7f6afc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f6d5507496212 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.015+0000 7f6b0ca00700 1 -- 172.21.15.120:0/2295309857 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc004160 con 0x7f6b081096b0 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.015+0000 7f6b0ca00700 1 -- 172.21.15.120:0/2295309857 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6afc004300 con 0x7f6b081096b0 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.015+0000 7f6b0ca00700 1 -- 172.21.15.120:0/2295309857 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc0119e0 con 0x7f6b081096b0 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.016+0000 7f6b0f200700 1 -- 172.21.15.120:0/2295309857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 msgr2=0x7f6b08109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.016+0000 7f6b0f200700 1 --2- 172.21.15.120:0/2295309857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b08109ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0098a0 tx=0x7f6afc009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.016+0000 7f6b0f200700 1 -- 172.21.15.120:0/2295309857 shutdown_connections 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.016+0000 7f6b0f200700 1 --2- 172.21.15.120:0/2295309857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b08109ac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.016+0000 7f6b0f200700 1 -- 172.21.15.120:0/2295309857 >> 172.21.15.120:0/2295309857 conn(0x7f6b08104d70 msgr2=0x7f6b081071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.017+0000 7f6b0f200700 1 -- 172.21.15.120:0/2295309857 shutdown_connections 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.017+0000 7f6b0f200700 1 -- 172.21.15.120:0/2295309857 wait complete. 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.018+0000 7f6b0f200700 1 Processor -- start 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.018+0000 7f6b0f200700 1 -- start start 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.019+0000 7f6b0f200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b0819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:56.095 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.019+0000 7f6b0f200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0810db90 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.019+0000 7f6b0de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b0819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.019+0000 7f6b0de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b0819d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50136/0 (socket says 172.21.15.120:50136) 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.019+0000 7f6b0de00700 1 -- 172.21.15.120:0/1413842188 learned_addr learned my addr 172.21.15.120:0/1413842188 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.019+0000 7f6b0de00700 1 -- 172.21.15.120:0/1413842188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0819ded0 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.020+0000 7f6b0de00700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b0819d990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0046e0 tx=0x7f6afc011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.020+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc0039e0 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.020+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6afc003b80 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.020+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0819e160 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.020+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc024700 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.020+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b081a0d70 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.021+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b08064e20 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.021+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f6afc022020 con 0x7f6b081096b0 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.022+0000 7f6b02a00700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f6af003e470 0x7f6af0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:56.096 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.022+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6afc053580 con 0x7f6b081096b0 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.022+0000 7f6b0d400700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f6af003e470 0x7f6af0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.023+0000 7f6b0d400700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f6af003e470 0x7f6af0040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6af8006fd0 tx=0x7f6af8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.028+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6afc00fdd0 con 0x7f6b081096b0 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.319+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f6b081a13f0 con 0x7f6b081096b0 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.372+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f6afc0532e0 con 0x7f6b081096b0 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.376+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f6af003e470 msgr2=0x7f6af0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.376+0000 7f6b0f200700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f6af003e470 0x7f6af0040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6af8006fd0 tx=0x7f6af8006e40 comp rx=0 tx=0).stop 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.376+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 msgr2=0x7f6b0819d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.376+0000 7f6b02a00700 1 -- 172.21.15.120:0/1413842188 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f6afc01ab30 con 0x7f6b081096b0 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.376+0000 7f6b0f200700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b0819d990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0046e0 tx=0x7f6afc011a60 comp rx=0 tx=0).stop 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.377+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 shutdown_connections 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.377+0000 7f6b0f200700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f6af003e470 0x7f6af0040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.377+0000 7f6b0f200700 1 --2- 172.21.15.120:0/1413842188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b081096b0 0x7f6b0819d990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.377+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 >> 172.21.15.120:0/1413842188 conn(0x7f6b08104d70 msgr2=0x7f6b08106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:56.097 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.377+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 shutdown_connections 2024-05-14T09:06:56.098 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:55.377+0000 7f6b0f200700 1 -- 172.21.15.120:0/1413842188 wait complete. 2024-05-14T09:06:56.379 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:56.121+0000 7f975de85200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T09:06:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:56 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1413842188' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-14T09:06:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:56 smithi120 ceph-mon[31085]: mgrmap e5: x(active, since 6s) 2024-05-14T09:06:56.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:56.530+0000 7f975de85200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T09:06:56.966 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:56.649+0000 7f975de85200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T09:06:57.734 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:06:57 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/854108915' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.755+0000 7fd823800700 1 Processor -- start 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.755+0000 7fd823800700 1 -- start start 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.756+0000 7fd823800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c10b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.756+0000 7fd823800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1094e0 con 0x7fd81c10aee0 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.756+0000 7fd820e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c10b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.756+0000 7fd820e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c10b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50162/0 (socket says 172.21.15.120:50162) 2024-05-14T09:06:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.756+0000 7fd820e00700 1 -- 172.21.15.120:0/3899226467 learned_addr learned my addr 172.21.15.120:0/3899226467 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.757+0000 7fd820e00700 1 -- 172.21.15.120:0/3899226467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81c109660 con 0x7fd81c10aee0 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.757+0000 7fd820e00700 1 --2- 172.21.15.120:0/3899226467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c10b2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd8100098a0 tx=0x7fd810009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0090513803d9d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.757+0000 7fd81b400700 1 -- 172.21.15.120:0/3899226467 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd810004160 con 0x7fd81c10aee0 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.757+0000 7fd81b400700 1 -- 172.21.15.120:0/3899226467 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd810004300 con 0x7fd81c10aee0 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.757+0000 7fd81b400700 1 -- 172.21.15.120:0/3899226467 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8100119e0 con 0x7fd81c10aee0 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.758+0000 7fd823800700 1 -- 172.21.15.120:0/3899226467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 msgr2=0x7fd81c10b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.758+0000 7fd823800700 1 --2- 172.21.15.120:0/3899226467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c10b2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd8100098a0 tx=0x7fd810009bb0 comp rx=0 tx=0).stop 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.758+0000 7fd823800700 1 -- 172.21.15.120:0/3899226467 shutdown_connections 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.758+0000 7fd823800700 1 --2- 172.21.15.120:0/3899226467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c10b2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.758+0000 7fd823800700 1 -- 172.21.15.120:0/3899226467 >> 172.21.15.120:0/3899226467 conn(0x7fd81c104f10 msgr2=0x7fd81c1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.758+0000 7fd823800700 1 -- 172.21.15.120:0/3899226467 shutdown_connections 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.758+0000 7fd823800700 1 -- 172.21.15.120:0/3899226467 wait complete. 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.759+0000 7fd823800700 1 Processor -- start 2024-05-14T09:06:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.760+0000 7fd823800700 1 -- start start 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.760+0000 7fd823800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c19ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.760+0000 7fd823800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c10dd80 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.760+0000 7fd820e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c19ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.760+0000 7fd820e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c19ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50174/0 (socket says 172.21.15.120:50174) 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.760+0000 7fd820e00700 1 -- 172.21.15.120:0/854108915 learned_addr learned my addr 172.21.15.120:0/854108915 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.761+0000 7fd820e00700 1 -- 172.21.15.120:0/854108915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81c1a0450 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.761+0000 7fd820e00700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c19ff10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd8100119b0 tx=0x7fd810011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.761+0000 7fd819600700 1 -- 172.21.15.120:0/854108915 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd810003af0 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.761+0000 7fd819600700 1 -- 172.21.15.120:0/854108915 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd81001a8a0 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.761+0000 7fd819600700 1 -- 172.21.15.120:0/854108915 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd810024780 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.761+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81c1a06e0 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.761+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81c1a32f0 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.763+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd81c064e20 con 0x7fd81c10aee0 2024-05-14T09:06:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.763+0000 7fd819600700 1 -- 172.21.15.120:0/854108915 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fd810022020 con 0x7fd81c10aee0 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.763+0000 7fd819600700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 0x7fd804040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.763+0000 7fd819600700 1 -- 172.21.15.120:0/854108915 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd8100535a0 con 0x7fd81c10aee0 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.763+0000 7fd81be00700 1 -- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 msgr2=0x7fd804040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.764+0000 7fd81be00700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 0x7fd804040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.769+0000 7fd819600700 1 -- 172.21.15.120:0/854108915 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd8100212c0 con 0x7fd81c10aee0 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.965+0000 7fd81be00700 1 -- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 msgr2=0x7fd804040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:56.965+0000 7fd81be00700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 0x7fd804040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.055+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd81c1a3860 con 0x7fd81c10aee0 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.056+0000 7fd819600700 1 -- 172.21.15.120:0/854108915 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fd81001aa50 con 0x7fd81c10aee0 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 msgr2=0x7fd804040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 0x7fd804040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 msgr2=0x7fd81c19ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c19ff10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd8100119b0 tx=0x7fd810011a90 comp rx=0 tx=0).stop 2024-05-14T09:06:57.759 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 shutdown_connections 2024-05-14T09:06:57.760 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7fd80403e470 0x7fd804040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:57.760 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 --2- 172.21.15.120:0/854108915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd81c10aee0 0x7fd81c19ff10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:06:57.760 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.059+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 >> 172.21.15.120:0/854108915 conn(0x7fd81c104f10 msgr2=0x7fd81c07d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:06:57.760 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.060+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 shutdown_connections 2024-05-14T09:06:57.760 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:57.060+0000 7fd823800700 1 -- 172.21.15.120:0/854108915 wait complete. 2024-05-14T09:06:57.760 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for the mgr to restart... 2024-05-14T09:06:57.760 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr epoch 5... 2024-05-14T09:06:58.312 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:58 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:58.234+0000 7f975de85200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T09:06:58.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:58 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:58.473+0000 7f975de85200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T09:06:59.042 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:58 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:58.689+0000 7f975de85200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T09:06:59.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:59 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:59.066+0000 7f975de85200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T09:06:59.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:59 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:59.188+0000 7f975de85200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T09:06:59.690 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:59 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:59.438+0000 7f975de85200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T09:07:00.134 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:06:59 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:06:59.689+0000 7f975de85200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:07:00.752 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:00.469+0000 7f975de85200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T09:07:01.134 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:00.752+0000 7f975de85200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T09:07:01.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:01 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:01.299+0000 7f975de85200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T09:07:01.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:01 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:01.426+0000 7f975de85200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T09:07:02.338 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:01 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:01.889+0000 7f975de85200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T09:07:02.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:02.337+0000 7f975de85200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T09:07:02.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:02.461+0000 7f975de85200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T09:07:03.093 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:02.783+0000 7f975de85200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T09:07:03.093 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:02.963+0000 7f975de85200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T09:07:03.093 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:03.091+0000 7f975de85200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T09:07:03.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:03.492+0000 7f975de85200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T09:07:03.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:03.615+0000 7f975de85200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T09:07:04.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:04 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:04.367+0000 7f975de85200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T09:07:05.134 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:04 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:04.650+0000 7f975de85200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T09:07:05.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: Active manager daemon x restarted 2024-05-14T09:07:05.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: Activating manager daemon x 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: osdmap e2: 0 total, 0 up, 0 in 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: mgrmap e6: x(active, starting, since 0.00628022s) 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: Manager daemon x is now available 2024-05-14T09:07:05.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:04 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:06.075 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: Found migration_current of "None". Setting to last migration. 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:06.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:05 smithi120 ceph-mon[31085]: mgrmap e7: x(active, since 1.01313s) 2024-05-14T09:07:06.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:07:06.610 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-14T09:07:06.610 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-14T09:07:06.611 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:07:06.611 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.430+0000 7f904e400700 1 Processor -- start 2024-05-14T09:07:06.611 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.430+0000 7f904e400700 1 -- start start 2024-05-14T09:07:06.611 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.431+0000 7f904e400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904810b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:06.612 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.431+0000 7f904e400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f90481094e0 con 0x7f904810aee0 2024-05-14T09:07:06.612 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.431+0000 7f9047400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904810b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:06.612 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.431+0000 7f9047400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904810b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38810/0 (socket says 172.21.15.120:38810) 2024-05-14T09:07:06.612 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.431+0000 7f9047400700 1 -- 172.21.15.120:0/1478748693 learned_addr learned my addr 172.21.15.120:0/1478748693 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:06.613 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.432+0000 7f9047400700 1 -- 172.21.15.120:0/1478748693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9048109660 con 0x7f904810aee0 2024-05-14T09:07:06.613 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.432+0000 7f9047400700 1 --2- 172.21.15.120:0/1478748693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904810b2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f90380098a0 tx=0x7f9038009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b6564cbee173ee server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:06.614 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.432+0000 7f9046000700 1 -- 172.21.15.120:0/1478748693 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9038004160 con 0x7f904810aee0 2024-05-14T09:07:06.614 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.432+0000 7f9046000700 1 -- 172.21.15.120:0/1478748693 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9038004300 con 0x7f904810aee0 2024-05-14T09:07:06.614 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.432+0000 7f9046000700 1 -- 172.21.15.120:0/1478748693 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90380119e0 con 0x7f904810aee0 2024-05-14T09:07:06.614 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.433+0000 7f904e400700 1 -- 172.21.15.120:0/1478748693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 msgr2=0x7f904810b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.433+0000 7f904e400700 1 --2- 172.21.15.120:0/1478748693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904810b2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f90380098a0 tx=0x7f9038009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.433+0000 7f904e400700 1 -- 172.21.15.120:0/1478748693 shutdown_connections 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.433+0000 7f904e400700 1 --2- 172.21.15.120:0/1478748693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904810b2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.433+0000 7f904e400700 1 -- 172.21.15.120:0/1478748693 >> 172.21.15.120:0/1478748693 conn(0x7f9048104f10 msgr2=0x7f90481073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.433+0000 7f904e400700 1 -- 172.21.15.120:0/1478748693 shutdown_connections 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.433+0000 7f904e400700 1 -- 172.21.15.120:0/1478748693 wait complete. 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.434+0000 7f904e400700 1 Processor -- start 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.434+0000 7f904e400700 1 -- start start 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.435+0000 7f904e400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904819ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.435+0000 7f904e400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f904810dd80 con 0x7f904810aee0 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.435+0000 7f9047400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904819ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.435+0000 7f9047400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904819ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38812/0 (socket says 172.21.15.120:38812) 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.435+0000 7f9047400700 1 -- 172.21.15.120:0/136786244 learned_addr learned my addr 172.21.15.120:0/136786244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:06.616 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.436+0000 7f9047400700 1 -- 172.21.15.120:0/136786244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90481a0440 con 0x7f904810aee0 2024-05-14T09:07:06.620 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.436+0000 7f9047400700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904819ff00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90380119b0 tx=0x7f9038011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:06.620 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.436+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9038003af0 con 0x7f904810aee0 2024-05-14T09:07:06.620 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.436+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f903801a8a0 con 0x7f904810aee0 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.436+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9038024780 con 0x7f904810aee0 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.436+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90481a06d0 con 0x7f904810aee0 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.436+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90481a32e0 con 0x7f904810aee0 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.438+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f9038022020 con 0x7f904810aee0 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.438+0000 7f903fe00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.438+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 --> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f902c041090 con 0x7f902c03e470 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.439+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9038053730 con 0x7f904810aee0 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.439+0000 7f9046a00700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 msgr2=0x7f902c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.439+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.640+0000 7f9046a00700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 msgr2=0x7f902c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:58.640+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:59.041+0000 7f9046a00700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 msgr2=0x7f902c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:59.041+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:59.842+0000 7f9046a00700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 msgr2=0x7f902c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:07:06.621 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:06:59.842+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:01.444+0000 7f9046a00700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 msgr2=0x7f902c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:01.444+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:04.647+0000 7f9046a00700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 msgr2=0x7f902c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/3992386407 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:04.648+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:04.660+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f9038018a40 con 0x7f904810aee0 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:04.660+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 msgr2=0x7f902c040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:04.660+0000 7f903fe00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.665+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f9038055440 con 0x7f904810aee0 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.666+0000 7f903fe00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f902c041db0 0x7f902c0441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.666+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9038052000 con 0x7f902c041db0 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.668+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f902c041db0 0x7f902c0441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.669+0000 7f9046a00700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f902c041db0 0x7f902c0441d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9034003a10 tx=0x7f9034009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:06.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.671+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f9038052000 con 0x7f902c041db0 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.686+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9048064e20 con 0x7f902c041db0 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.687+0000 7f903fe00700 1 -- 172.21.15.120:0/136786244 <== mgr.14120 v2:172.21.15.120:6800/975840748 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f9048064e20 con 0x7f902c041db0 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.687+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f902c041db0 msgr2=0x7f902c0441d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.687+0000 7f904e400700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f902c041db0 0x7f902c0441d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9034003a10 tx=0x7f9034009290 comp rx=0 tx=0).stop 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.687+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 msgr2=0x7f904819ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904819ff00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90380119b0 tx=0x7f9038011a90 comp rx=0 tx=0).stop 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 shutdown_connections 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f902c041db0 0x7f902c0441d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f904810aee0 0x7f904819ff00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:06.623 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 --2- 172.21.15.120:0/136786244 >> [v2:172.21.15.120:6800/3992386407,v1:172.21.15.120:6801/3992386407] conn(0x7f902c03e470 0x7f902c040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:06.624 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 >> 172.21.15.120:0/136786244 conn(0x7f9048104f10 msgr2=0x7f904807d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:06.624 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 shutdown_connections 2024-05-14T09:07:06.624 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:05.688+0000 7f904e400700 1 -- 172.21.15.120:0/136786244 wait complete. 2024-05-14T09:07:06.624 INFO:teuthology.orchestra.run.smithi120.stdout:mgr epoch 5 is available 2024-05-14T09:07:06.624 INFO:teuthology.orchestra.run.smithi120.stdout:Setting orchestrator backend to cephadm... 2024-05-14T09:07:07.069 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:06 smithi120 ceph-mon[31085]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-14T09:07:07.069 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:06 smithi120 ceph-mon[31085]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-14T09:07:07.069 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:06 smithi120 ceph-mon[31085]: [14/May/2024:09:07:05] ENGINE Bus STARTING 2024-05-14T09:07:07.069 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:06 smithi120 ceph-mon[31085]: [14/May/2024:09:07:05] ENGINE Serving on https://172.21.15.120:7150 2024-05-14T09:07:07.070 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:06 smithi120 ceph-mon[31085]: [14/May/2024:09:07:06] ENGINE Serving on http://172.21.15.120:8765 2024-05-14T09:07:07.070 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:06 smithi120 ceph-mon[31085]: [14/May/2024:09:07:06] ENGINE Bus STARTED 2024-05-14T09:07:07.070 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:06 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:07:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:07 smithi120 ceph-mon[31085]: mgrmap e8: x(active, since 2s) 2024-05-14T09:07:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:07 smithi120 ceph-mon[31085]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:07 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:07.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:07 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:07:08.315 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.295+0000 7ff7a5600700 1 Processor -- start 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.295+0000 7ff7a5600700 1 -- start start 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.295+0000 7ff7a5600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a010b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.295+0000 7ff7a5600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01094e0 con 0x7ff7a010aee0 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.296+0000 7ff79ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a010b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.296+0000 7ff79ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a010b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38880/0 (socket says 172.21.15.120:38880) 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.296+0000 7ff79ea00700 1 -- 172.21.15.120:0/2646259101 learned_addr learned my addr 172.21.15.120:0/2646259101 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.296+0000 7ff79ea00700 1 -- 172.21.15.120:0/2646259101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a0109660 con 0x7ff7a010aee0 2024-05-14T09:07:08.321 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.297+0000 7ff79ea00700 1 --2- 172.21.15.120:0/2646259101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a010b2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7900098a0 tx=0x7ff790009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99a658188965db0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.297+0000 7ff79d600700 1 -- 172.21.15.120:0/2646259101 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff790004160 con 0x7ff7a010aee0 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.297+0000 7ff79d600700 1 -- 172.21.15.120:0/2646259101 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff790004300 con 0x7ff7a010aee0 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.297+0000 7ff79d600700 1 -- 172.21.15.120:0/2646259101 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7900119e0 con 0x7ff7a010aee0 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.298+0000 7ff7a5600700 1 -- 172.21.15.120:0/2646259101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 msgr2=0x7ff7a010b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.298+0000 7ff7a5600700 1 --2- 172.21.15.120:0/2646259101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a010b2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7900098a0 tx=0x7ff790009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.298+0000 7ff7a5600700 1 -- 172.21.15.120:0/2646259101 shutdown_connections 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.298+0000 7ff7a5600700 1 --2- 172.21.15.120:0/2646259101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a010b2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.298+0000 7ff7a5600700 1 -- 172.21.15.120:0/2646259101 >> 172.21.15.120:0/2646259101 conn(0x7ff7a0104f10 msgr2=0x7ff7a01073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.298+0000 7ff7a5600700 1 -- 172.21.15.120:0/2646259101 shutdown_connections 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.298+0000 7ff7a5600700 1 -- 172.21.15.120:0/2646259101 wait complete. 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.299+0000 7ff7a5600700 1 Processor -- start 2024-05-14T09:07:08.322 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.300+0000 7ff7a5600700 1 -- start start 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.300+0000 7ff7a5600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a019dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.300+0000 7ff7a5600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a010dd80 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.300+0000 7ff79ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a019dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.300+0000 7ff79ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a019dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38892/0 (socket says 172.21.15.120:38892) 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.300+0000 7ff79ea00700 1 -- 172.21.15.120:0/3230972618 learned_addr learned my addr 172.21.15.120:0/3230972618 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.301+0000 7ff79ea00700 1 -- 172.21.15.120:0/3230972618 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a019e260 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.301+0000 7ff79ea00700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a019dd20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7900119b0 tx=0x7ff790011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.301+0000 7ff797400700 1 -- 172.21.15.120:0/3230972618 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff790003af0 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.301+0000 7ff797400700 1 -- 172.21.15.120:0/3230972618 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff79001a8a0 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.301+0000 7ff797400700 1 -- 172.21.15.120:0/3230972618 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff790024780 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.301+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a019e4f0 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.302+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a01a10f0 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.303+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a0064e20 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.303+0000 7ff797400700 1 -- 172.21.15.120:0/3230972618 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7ff790022020 con 0x7ff7a010aee0 2024-05-14T09:07:08.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.304+0000 7ff797400700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7ff78403e4c0 0x7ff7840409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.304+0000 7ff797400700 1 -- 172.21.15.120:0/3230972618 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff790053b90 con 0x7ff7a010aee0 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.304+0000 7ff79e000700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7ff78403e4c0 0x7ff7840409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.305+0000 7ff79e000700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7ff78403e4c0 0x7ff7840409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff788006fd0 tx=0x7ff788006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.310+0000 7ff797400700 1 -- 172.21.15.120:0/3230972618 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff79000b3e0 con 0x7ff7a010aee0 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.561+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7ff7a0106020 con 0x7ff78403e4c0 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.577+0000 7ff797400700 1 -- 172.21.15.120:0/3230972618 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff7a0106020 con 0x7ff78403e4c0 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.580+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7ff78403e4c0 msgr2=0x7ff7840409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.580+0000 7ff7a5600700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7ff78403e4c0 0x7ff7840409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff788006fd0 tx=0x7ff788006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.580+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 msgr2=0x7ff7a019dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.580+0000 7ff7a5600700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a019dd20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7900119b0 tx=0x7ff790011a90 comp rx=0 tx=0).stop 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.581+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 shutdown_connections 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.581+0000 7ff7a5600700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7ff78403e4c0 0x7ff7840409d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:08.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.581+0000 7ff7a5600700 1 --2- 172.21.15.120:0/3230972618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7a010aee0 0x7ff7a019dd20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:08.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.581+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 >> 172.21.15.120:0/3230972618 conn(0x7ff7a0104f10 msgr2=0x7ff7a01058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:08.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.581+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 shutdown_connections 2024-05-14T09:07:08.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:07.581+0000 7ff7a5600700 1 -- 172.21.15.120:0/3230972618 wait complete. 2024-05-14T09:07:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:09 smithi120 ceph-mon[31085]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:09.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-14T09:07:09.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.993+0000 7f77afc00700 1 Processor -- start 2024-05-14T09:07:09.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.994+0000 7f77afc00700 1 -- start start 2024-05-14T09:07:09.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.994+0000 7f77afc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a810c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:09.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.994+0000 7f77afc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f77a807cd50 con 0x7f77a810a370 2024-05-14T09:07:09.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.994+0000 7f77ad200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a810c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.995+0000 7f77ad200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a810c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37224/0 (socket says 172.21.15.120:37224) 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.995+0000 7f77ad200700 1 -- 172.21.15.120:0/2285184668 learned_addr learned my addr 172.21.15.120:0/2285184668 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.995+0000 7f77ad200700 1 -- 172.21.15.120:0/2285184668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a810ccd0 con 0x7f77a810a370 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.995+0000 7f77ad200700 1 --2- 172.21.15.120:0/2285184668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a810c790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f779c0098a0 tx=0x7f779c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5163c45f9454fc30 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.996+0000 7f77a7400700 1 -- 172.21.15.120:0/2285184668 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c004160 con 0x7f77a810a370 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.996+0000 7f77a7400700 1 -- 172.21.15.120:0/2285184668 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f779c004300 con 0x7f77a810a370 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.996+0000 7f77a7400700 1 -- 172.21.15.120:0/2285184668 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c0119e0 con 0x7f77a810a370 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.996+0000 7f77afc00700 1 -- 172.21.15.120:0/2285184668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 msgr2=0x7f77a810c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.996+0000 7f77afc00700 1 --2- 172.21.15.120:0/2285184668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a810c790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f779c0098a0 tx=0x7f779c009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.997+0000 7f77afc00700 1 -- 172.21.15.120:0/2285184668 shutdown_connections 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.997+0000 7f77afc00700 1 --2- 172.21.15.120:0/2285184668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a810c790 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.997+0000 7f77afc00700 1 -- 172.21.15.120:0/2285184668 >> 172.21.15.120:0/2285184668 conn(0x7f77a8103e30 msgr2=0x7f77a8106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.997+0000 7f77afc00700 1 -- 172.21.15.120:0/2285184668 shutdown_connections 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.997+0000 7f77afc00700 1 -- 172.21.15.120:0/2285184668 wait complete. 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.998+0000 7f77afc00700 1 Processor -- start 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.998+0000 7f77afc00700 1 -- start start 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.998+0000 7f77afc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.998+0000 7f77afc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f77a810db70 con 0x7f77a810a370 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.999+0000 7f77ad200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.999+0000 7f77ad200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37234/0 (socket says 172.21.15.120:37234) 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.999+0000 7f77ad200700 1 -- 172.21.15.120:0/155636894 learned_addr learned my addr 172.21.15.120:0/155636894 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.999+0000 7f77ad200700 1 -- 172.21.15.120:0/155636894 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a81a02b0 con 0x7f77a810a370 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:08.999+0000 7f77ad200700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a819fd70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f779c0116a0 tx=0x7f779c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.000+0000 7f77a5600700 1 -- 172.21.15.120:0/155636894 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c003970 con 0x7f77a810a370 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.000+0000 7f77a5600700 1 -- 172.21.15.120:0/155636894 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f779c003b10 con 0x7f77a810a370 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.000+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a81a0540 con 0x7f77a810a370 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.000+0000 7f77a5600700 1 -- 172.21.15.120:0/155636894 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c019550 con 0x7f77a810a370 2024-05-14T09:07:09.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.000+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a81a3150 con 0x7f77a810a370 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.001+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a8064e20 con 0x7f77a810a370 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.001+0000 7f77a5600700 1 -- 172.21.15.120:0/155636894 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f779c0197c0 con 0x7f77a810a370 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.002+0000 7f77a5600700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f779003e4c0 0x7f77900409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.002+0000 7f77a5600700 1 -- 172.21.15.120:0/155636894 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f779c053a40 con 0x7f77a810a370 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.002+0000 7f77a7e00700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f779003e4c0 0x7f77900409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.003+0000 7f77a7e00700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f779003e4c0 0x7f77900409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7794006fd0 tx=0x7f7794006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.007+0000 7f77a5600700 1 -- 172.21.15.120:0/155636894 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f779c053390 con 0x7f77a810a370 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.242+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f77a8108970 con 0x7f779003e4c0 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.244+0000 7f77a5600700 1 -- 172.21.15.120:0/155636894 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f77a8108970 con 0x7f779003e4c0 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f779003e4c0 msgr2=0x7f77900409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f779003e4c0 0x7f77900409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7794006fd0 tx=0x7f7794006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 msgr2=0x7f77a819fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a819fd70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f779c0116a0 tx=0x7f779c011a60 comp rx=0 tx=0).stop 2024-05-14T09:07:09.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 shutdown_connections 2024-05-14T09:07:09.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f779003e4c0 0x7f77900409d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:09.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 --2- 172.21.15.120:0/155636894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77a810a370 0x7f77a819fd70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:09.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 >> 172.21.15.120:0/155636894 conn(0x7f77a8103e30 msgr2=0x7f77a8108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:09.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 shutdown_connections 2024-05-14T09:07:09.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:09.247+0000 7f77afc00700 1 -- 172.21.15.120:0/155636894 wait complete. 2024-05-14T09:07:09.977 INFO:teuthology.orchestra.run.smithi120.stdout:Generating ssh key... 2024-05-14T09:07:11.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: Generating public/private rsa key pair. 2024-05-14T09:07:11.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: Your identification has been saved in /tmp/tmpeg7g89qj/key. 2024-05-14T09:07:11.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: Your public key has been saved in /tmp/tmpeg7g89qj/key.pub. 2024-05-14T09:07:11.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: The key fingerprint is: 2024-05-14T09:07:11.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: SHA256:YCRuPmSeU/53zgWX0ywmI+59592oU3pv0LRvIOerKAY ceph-15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:07:11.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: The key's randomart image is: 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: +---[RSA 3072]----+ 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | . . | 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | . o | 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | = + | 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | * = . +.| 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | * . S . + *o+| 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | oE. . ..*=+.| 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | .. o .*.o.| 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | oo *o.+.B| 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: | . .o **oB=| 2024-05-14T09:07:11.636 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: +----[SHA256]-----+ 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.700+0000 7f6331e00700 1 Processor -- start 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.700+0000 7f6331e00700 1 -- start start 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.701+0000 7f6331e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c07da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.701+0000 7f6331e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f632c07dfa0 con 0x7f632c07f590 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.701+0000 7f632aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c07da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.701+0000 7f632aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c07da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37240/0 (socket says 172.21.15.120:37240) 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.701+0000 7f632aa00700 1 -- 172.21.15.120:0/1599923706 learned_addr learned my addr 172.21.15.120:0/1599923706 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.702+0000 7f632aa00700 1 -- 172.21.15.120:0/1599923706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c07e120 con 0x7f632c07f590 2024-05-14T09:07:12.006 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.702+0000 7f632aa00700 1 --2- 172.21.15.120:0/1599923706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c07da60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f631c0098a0 tx=0x7f631c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bd1f09cd9033a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.703+0000 7f632a000700 1 -- 172.21.15.120:0/1599923706 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f631c004160 con 0x7f632c07f590 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.703+0000 7f632a000700 1 -- 172.21.15.120:0/1599923706 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f631c004300 con 0x7f632c07f590 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.703+0000 7f632a000700 1 -- 172.21.15.120:0/1599923706 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f631c0119e0 con 0x7f632c07f590 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.704+0000 7f6331e00700 1 -- 172.21.15.120:0/1599923706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 msgr2=0x7f632c07da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.704+0000 7f6331e00700 1 --2- 172.21.15.120:0/1599923706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c07da60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f631c0098a0 tx=0x7f631c009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.704+0000 7f6331e00700 1 -- 172.21.15.120:0/1599923706 shutdown_connections 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.704+0000 7f6331e00700 1 --2- 172.21.15.120:0/1599923706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c07da60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.704+0000 7f6331e00700 1 -- 172.21.15.120:0/1599923706 >> 172.21.15.120:0/1599923706 conn(0x7f632c104f20 msgr2=0x7f632c107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:12.007 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.704+0000 7f6331e00700 1 -- 172.21.15.120:0/1599923706 shutdown_connections 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.704+0000 7f6331e00700 1 -- 172.21.15.120:0/1599923706 wait complete. 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.705+0000 7f6331e00700 1 Processor -- start 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.705+0000 7f6331e00700 1 -- start start 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.706+0000 7f6331e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.706+0000 7f6331e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f632c10fda0 con 0x7f632c07f590 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.706+0000 7f632aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.706+0000 7f632aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37254/0 (socket says 172.21.15.120:37254) 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.706+0000 7f632aa00700 1 -- 172.21.15.120:0/2298589963 learned_addr learned my addr 172.21.15.120:0/2298589963 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.707+0000 7f632aa00700 1 -- 172.21.15.120:0/2298589963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c1a0280 con 0x7f632c07f590 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.707+0000 7f632aa00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c19fd40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f631c0116a0 tx=0x7f631c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.707+0000 7f6330a00700 1 -- 172.21.15.120:0/2298589963 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f631c003970 con 0x7f632c07f590 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.707+0000 7f6330a00700 1 -- 172.21.15.120:0/2298589963 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f631c003b10 con 0x7f632c07f590 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.707+0000 7f6330a00700 1 -- 172.21.15.120:0/2298589963 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f631c019550 con 0x7f632c07f590 2024-05-14T09:07:12.008 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.707+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c1a0510 con 0x7f632c07f590 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.708+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c1a3110 con 0x7f632c07f590 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.709+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c064e20 con 0x7f632c07f590 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.709+0000 7f6330a00700 1 -- 172.21.15.120:0/2298589963 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f631c01aa50 con 0x7f632c07f590 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.709+0000 7f6330a00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f631003e4c0 0x7f63100409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.709+0000 7f6330a00700 1 -- 172.21.15.120:0/2298589963 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f631c053800 con 0x7f632c07f590 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.710+0000 7f6323e00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f631003e4c0 0x7f63100409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.710+0000 7f6323e00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f631003e4c0 0x7f63100409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6314006fd0 tx=0x7f6314006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.715+0000 7f6330a00700 1 -- 172.21.15.120:0/2298589963 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f631c055d00 con 0x7f632c07f590 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:10.947+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f632c105ea0 con 0x7f631003e4c0 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.281+0000 7f6330a00700 1 -- 172.21.15.120:0/2298589963 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f632c105ea0 con 0x7f631003e4c0 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.285+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f631003e4c0 msgr2=0x7f63100409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.285+0000 7f6331e00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f631003e4c0 0x7f63100409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6314006fd0 tx=0x7f6314006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:12.009 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.285+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 msgr2=0x7f632c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.285+0000 7f6331e00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c19fd40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f631c0116a0 tx=0x7f631c011a60 comp rx=0 tx=0).stop 2024-05-14T09:07:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.286+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 shutdown_connections 2024-05-14T09:07:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.286+0000 7f6331e00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f631003e4c0 0x7f63100409d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.286+0000 7f6331e00700 1 --2- 172.21.15.120:0/2298589963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f632c07f590 0x7f632c19fd40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.286+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 >> 172.21.15.120:0/2298589963 conn(0x7f632c104f20 msgr2=0x7f632c105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.286+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 shutdown_connections 2024-05-14T09:07:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:11.286+0000 7f6331e00700 1 -- 172.21.15.120:0/2298589963 wait complete. 2024-05-14T09:07:12.594 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:12 smithi120 ceph-mon[31085]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:12.594 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:12 smithi120 ceph-mon[31085]: Generating ssh key... 2024-05-14T09:07:12.594 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:12 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:12.594 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:12 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:13.601 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73uK4FvvSr3VyLNhNOFwszQzWauD2I1CBsKbwFQCOVCRIeegSQtFBklQ3wbjVqC/QSg9oZUS4zf9C8Y2rc75BqV8Ysy8tx2axM62PEV2lz0f7ZdrSbkgMnth8qrjILq/Wqgog0mRzz6IFP7GDonlk+2plilQ3ckdpfuHEPds8kyu97qAjD8LUH9zeVK2OAL8gpmIN6Nz3EfM+9dZluREg71V5coBSVnn0Ehsig1x0V59e3T5Ahz9mHV0F3v3t9ivTJIENWaJjf4fQzKGmu5sJOLqgGldjfIbaJ0oPT1fR0W8zTSMSb9ZkKvZGq1aOm7/VZ/Ww+flf5Zh9UPpPrmhyV1AED0YSMvvnLyrYQN6r8eTWLMIuGXEikewiYF24dvhBY8q4dwPvVWOj6J93CFUSpO7ZULNj7Y42Iw/8R4MBCwPwsN3xKy3hUWEcUuYfokZHLygcRM/Pgo3OhEPCdRhLwa2ru1Zhs0Q+ErXUDtRuwKxzPDsx0jOLnw6Xv0S60KM= ceph-15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:07:13.601 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.695+0000 7f8901600700 1 Processor -- start 2024-05-14T09:07:13.601 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.695+0000 7f8901600700 1 -- start start 2024-05-14T09:07:13.601 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.696+0000 7f8901600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc10b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:13.601 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.696+0000 7f8901600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1094e0 con 0x7f88fc10aee0 2024-05-14T09:07:13.601 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.696+0000 7f88faa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc10b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.696+0000 7f88faa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc10b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37262/0 (socket says 172.21.15.120:37262) 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.696+0000 7f88faa00700 1 -- 172.21.15.120:0/2367042985 learned_addr learned my addr 172.21.15.120:0/2367042985 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.697+0000 7f88faa00700 1 -- 172.21.15.120:0/2367042985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc109660 con 0x7f88fc10aee0 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.697+0000 7f88faa00700 1 --2- 172.21.15.120:0/2367042985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc10b2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0098a0 tx=0x7f88ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bbe618ed12087f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.697+0000 7f88fa000700 1 -- 172.21.15.120:0/2367042985 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec004160 con 0x7f88fc10aee0 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.697+0000 7f88fa000700 1 -- 172.21.15.120:0/2367042985 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f88ec004300 con 0x7f88fc10aee0 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.697+0000 7f88fa000700 1 -- 172.21.15.120:0/2367042985 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec0119e0 con 0x7f88fc10aee0 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.698+0000 7f8901600700 1 -- 172.21.15.120:0/2367042985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 msgr2=0x7f88fc10b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.698+0000 7f8901600700 1 --2- 172.21.15.120:0/2367042985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc10b2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0098a0 tx=0x7f88ec009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.698+0000 7f8901600700 1 -- 172.21.15.120:0/2367042985 shutdown_connections 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.698+0000 7f8901600700 1 --2- 172.21.15.120:0/2367042985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc10b2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.698+0000 7f8901600700 1 -- 172.21.15.120:0/2367042985 >> 172.21.15.120:0/2367042985 conn(0x7f88fc104f10 msgr2=0x7f88fc1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:13.602 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.698+0000 7f8901600700 1 -- 172.21.15.120:0/2367042985 shutdown_connections 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.698+0000 7f8901600700 1 -- 172.21.15.120:0/2367042985 wait complete. 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.699+0000 7f8901600700 1 Processor -- start 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.700+0000 7f8901600700 1 -- start start 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.700+0000 7f8901600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc07e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.700+0000 7f8901600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc10dd80 con 0x7f88fc10aee0 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.700+0000 7f88faa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc07e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.700+0000 7f88faa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc07e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37272/0 (socket says 172.21.15.120:37272) 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.700+0000 7f88faa00700 1 -- 172.21.15.120:0/2139620369 learned_addr learned my addr 172.21.15.120:0/2139620369 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.701+0000 7f88faa00700 1 -- 172.21.15.120:0/2139620369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc07ef20 con 0x7f88fc10aee0 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.701+0000 7f88faa00700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc07e9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0119b0 tx=0x7f88ec011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.701+0000 7f88f3400700 1 -- 172.21.15.120:0/2139620369 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec003af0 con 0x7f88fc10aee0 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.701+0000 7f88f3400700 1 -- 172.21.15.120:0/2139620369 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f88ec01a8a0 con 0x7f88fc10aee0 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.701+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc07d170 con 0x7f88fc10aee0 2024-05-14T09:07:13.603 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.701+0000 7f88f3400700 1 -- 172.21.15.120:0/2139620369 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec024780 con 0x7f88fc10aee0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.701+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc07d650 con 0x7f88fc10aee0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.703+0000 7f88f3400700 1 -- 172.21.15.120:0/2139620369 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f88ec022020 con 0x7f88fc10aee0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.703+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88fc064e20 con 0x7f88fc10aee0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.703+0000 7f88f3400700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f88e003e470 0x7f88e0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.703+0000 7f88f3400700 1 -- 172.21.15.120:0/2139620369 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f88ec053960 con 0x7f88fc10aee0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.704+0000 7f88f3e00700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f88e003e470 0x7f88e0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.704+0000 7f88f3e00700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f88e003e470 0x7f88e0040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88e4006fd0 tx=0x7f88e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.710+0000 7f88f3400700 1 -- 172.21.15.120:0/2139620369 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88ec01aa50 con 0x7f88fc10aee0 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.945+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f88fc07dcf0 con 0x7f88e003e470 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.946+0000 7f88f3400700 1 -- 172.21.15.120:0/2139620369 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f88fc07dcf0 con 0x7f88e003e470 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.949+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f88e003e470 msgr2=0x7f88e0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.949+0000 7f8901600700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f88e003e470 0x7f88e0040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88e4006fd0 tx=0x7f88e4006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.949+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 msgr2=0x7f88fc07e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.949+0000 7f8901600700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc07e9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0119b0 tx=0x7f88ec011a90 comp rx=0 tx=0).stop 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.950+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 shutdown_connections 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.950+0000 7f8901600700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f88e003e470 0x7f88e0040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.950+0000 7f8901600700 1 --2- 172.21.15.120:0/2139620369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88fc10aee0 0x7f88fc07e9e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.950+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 >> 172.21.15.120:0/2139620369 conn(0x7f88fc104f10 msgr2=0x7f88fc1058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.950+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 shutdown_connections 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:12.950+0000 7f8901600700 1 -- 172.21.15.120:0/2139620369 wait complete. 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-14T09:07:13.605 INFO:teuthology.orchestra.run.smithi120.stdout:Adding key to root@localhost authorized_keys... 2024-05-14T09:07:13.606 INFO:teuthology.orchestra.run.smithi120.stdout:Adding host smithi120... 2024-05-14T09:07:13.881 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:13 smithi120 ceph-mon[31085]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:14.832 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:14 smithi120 ceph-mon[31085]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi120", "addr": "172.21.15.120", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:16.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:16 smithi120 ceph-mon[31085]: Deploying cephadm binary to smithi120 2024-05-14T09:07:20.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Added host 'smithi120' with addr '172.21.15.120' 2024-05-14T09:07:20.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.259+0000 7eff2a800700 1 Processor -- start 2024-05-14T09:07:20.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.260+0000 7eff2a800700 1 -- start start 2024-05-14T09:07:20.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.260+0000 7eff2a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2407d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:20.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.260+0000 7eff2a800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7eff2407d7c0 con 0x7eff2407edd0 2024-05-14T09:07:20.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.261+0000 7eff23400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2407d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.261+0000 7eff23400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2407d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37274/0 (socket says 172.21.15.120:37274) 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.261+0000 7eff23400700 1 -- 172.21.15.120:0/1341643865 learned_addr learned my addr 172.21.15.120:0/1341643865 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.261+0000 7eff23400700 1 -- 172.21.15.120:0/1341643865 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2407d940 con 0x7eff2407edd0 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.261+0000 7eff23400700 1 --2- 172.21.15.120:0/1341643865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2407d1f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff140098a0 tx=0x7eff14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f10a7546072b8a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.262+0000 7eff22a00700 1 -- 172.21.15.120:0/1341643865 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff14004160 con 0x7eff2407edd0 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.262+0000 7eff22a00700 1 -- 172.21.15.120:0/1341643865 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7eff14004300 con 0x7eff2407edd0 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.262+0000 7eff22a00700 1 -- 172.21.15.120:0/1341643865 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff140119e0 con 0x7eff2407edd0 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.263+0000 7eff2a800700 1 -- 172.21.15.120:0/1341643865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 msgr2=0x7eff2407d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.263+0000 7eff2a800700 1 --2- 172.21.15.120:0/1341643865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2407d1f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff140098a0 tx=0x7eff14009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.263+0000 7eff2a800700 1 -- 172.21.15.120:0/1341643865 shutdown_connections 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.263+0000 7eff2a800700 1 --2- 172.21.15.120:0/1341643865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2407d1f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.263+0000 7eff2a800700 1 -- 172.21.15.120:0/1341643865 >> 172.21.15.120:0/1341643865 conn(0x7eff24104f10 msgr2=0x7eff241073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.263+0000 7eff2a800700 1 -- 172.21.15.120:0/1341643865 shutdown_connections 2024-05-14T09:07:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.263+0000 7eff2a800700 1 -- 172.21.15.120:0/1341643865 wait complete. 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.264+0000 7eff2a800700 1 Processor -- start 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.264+0000 7eff2a800700 1 -- start start 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.265+0000 7eff2a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2419fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.265+0000 7eff2a800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7eff2410fee0 con 0x7eff2407edd0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.265+0000 7eff23400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2419fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.265+0000 7eff23400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2419fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37280/0 (socket says 172.21.15.120:37280) 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.265+0000 7eff23400700 1 -- 172.21.15.120:0/3181498830 learned_addr learned my addr 172.21.15.120:0/3181498830 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.265+0000 7eff23400700 1 -- 172.21.15.120:0/3181498830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff241a0430 con 0x7eff2407edd0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.266+0000 7eff23400700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2419fef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff140119b0 tx=0x7eff14011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.266+0000 7eff20c00700 1 -- 172.21.15.120:0/3181498830 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff14003af0 con 0x7eff2407edd0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.266+0000 7eff20c00700 1 -- 172.21.15.120:0/3181498830 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7eff1401a8a0 con 0x7eff2407edd0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.266+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff241a06c0 con 0x7eff2407edd0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.266+0000 7eff20c00700 1 -- 172.21.15.120:0/3181498830 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff14024830 con 0x7eff2407edd0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.266+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff241a32d0 con 0x7eff2407edd0 2024-05-14T09:07:20.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.268+0000 7eff20c00700 1 -- 172.21.15.120:0/3181498830 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7eff14022020 con 0x7eff2407edd0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.268+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff24064e20 con 0x7eff2407edd0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.268+0000 7eff20c00700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7eff0803e4c0 0x7eff080409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.268+0000 7eff20c00700 1 -- 172.21.15.120:0/3181498830 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7eff14053900 con 0x7eff2407edd0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.269+0000 7eff1aa00700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7eff0803e4c0 0x7eff080409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.269+0000 7eff1aa00700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7eff0803e4c0 0x7eff080409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff0c006fd0 tx=0x7eff0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.274+0000 7eff20c00700 1 -- 172.21.15.120:0/3181498830 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7eff1400b3e0 con 0x7eff2407edd0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:14.506+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi120", "addr": "172.21.15.120", "target": ["mon-mgr", ""]}) -- 0x7eff24106030 con 0x7eff0803e4c0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.301+0000 7eff20c00700 1 -- 172.21.15.120:0/3181498830 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7eff24106030 con 0x7eff0803e4c0 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7eff0803e4c0 msgr2=0x7eff080409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7eff0803e4c0 0x7eff080409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff0c006fd0 tx=0x7eff0c006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 msgr2=0x7eff2419fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2419fef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff140119b0 tx=0x7eff14011a90 comp rx=0 tx=0).stop 2024-05-14T09:07:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 shutdown_connections 2024-05-14T09:07:20.978 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7eff0803e4c0 0x7eff080409d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:20.978 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 --2- 172.21.15.120:0/3181498830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2407edd0 0x7eff2419fef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:20.978 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.305+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 >> 172.21.15.120:0/3181498830 conn(0x7eff24104f10 msgr2=0x7eff241058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:20.978 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.306+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 shutdown_connections 2024-05-14T09:07:20.978 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:20.306+0000 7eff2a800700 1 -- 172.21.15.120:0/3181498830 wait complete. 2024-05-14T09:07:20.978 INFO:teuthology.orchestra.run.smithi120.stdout:Deploying unmanaged mon service... 2024-05-14T09:07:21.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:21 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:21.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:21 smithi120 ceph-mon[31085]: Added host smithi120 2024-05-14T09:07:21.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:21 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:07:22.819 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-14T09:07:22.820 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.682+0000 7fd08c400700 1 Processor -- start 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.683+0000 7fd08c400700 1 -- start start 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.683+0000 7fd08c400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08410bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.683+0000 7fd08c400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd08410c510 con 0x7fd08410bb10 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.684+0000 7fd089a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08410bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.684+0000 7fd089a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08410bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49634/0 (socket says 172.21.15.120:49634) 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.684+0000 7fd089a00700 1 -- 172.21.15.120:0/2417120537 learned_addr learned my addr 172.21.15.120:0/2417120537 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.684+0000 7fd089a00700 1 -- 172.21.15.120:0/2417120537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08410cc40 con 0x7fd08410bb10 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.685+0000 7fd089a00700 1 --2- 172.21.15.120:0/2417120537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08410bf20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0780098a0 tx=0x7fd078009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92e8511758dca69 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.685+0000 7fd083e00700 1 -- 172.21.15.120:0/2417120537 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078004160 con 0x7fd08410bb10 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.685+0000 7fd083e00700 1 -- 172.21.15.120:0/2417120537 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd078004300 con 0x7fd08410bb10 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.685+0000 7fd083e00700 1 -- 172.21.15.120:0/2417120537 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0780119e0 con 0x7fd08410bb10 2024-05-14T09:07:22.821 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.686+0000 7fd08c400700 1 -- 172.21.15.120:0/2417120537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 msgr2=0x7fd08410bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.686+0000 7fd08c400700 1 --2- 172.21.15.120:0/2417120537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08410bf20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0780098a0 tx=0x7fd078009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.686+0000 7fd08c400700 1 -- 172.21.15.120:0/2417120537 shutdown_connections 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.686+0000 7fd08c400700 1 --2- 172.21.15.120:0/2417120537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08410bf20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.686+0000 7fd08c400700 1 -- 172.21.15.120:0/2417120537 >> 172.21.15.120:0/2417120537 conn(0x7fd084107430 msgr2=0x7fd084109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.686+0000 7fd08c400700 1 -- 172.21.15.120:0/2417120537 shutdown_connections 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.686+0000 7fd08c400700 1 -- 172.21.15.120:0/2417120537 wait complete. 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.687+0000 7fd08c400700 1 Processor -- start 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.687+0000 7fd08c400700 1 -- start start 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.688+0000 7fd08c400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.688+0000 7fd08c400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd08410fe70 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.688+0000 7fd089a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.688+0000 7fd089a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49636/0 (socket says 172.21.15.120:49636) 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.688+0000 7fd089a00700 1 -- 172.21.15.120:0/3410340427 learned_addr learned my addr 172.21.15.120:0/3410340427 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.689+0000 7fd089a00700 1 -- 172.21.15.120:0/3410340427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0841a0320 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.689+0000 7fd089a00700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08419fde0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0780119b0 tx=0x7fd078011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.689+0000 7fd082000700 1 -- 172.21.15.120:0/3410340427 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078003970 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.689+0000 7fd082000700 1 -- 172.21.15.120:0/3410340427 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd078003b10 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.689+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0841a05b0 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.690+0000 7fd082000700 1 -- 172.21.15.120:0/3410340427 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078024610 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.690+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0841a31c0 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.691+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd084064e20 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.691+0000 7fd082000700 1 -- 172.21.15.120:0/3410340427 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fd07801a430 con 0x7fd08410bb10 2024-05-14T09:07:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.691+0000 7fd082000700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd06c03e4c0 0x7fd06c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.692+0000 7fd082000700 1 -- 172.21.15.120:0/3410340427 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd0780539d0 con 0x7fd08410bb10 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.692+0000 7fd089000700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd06c03e4c0 0x7fd06c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.692+0000 7fd089000700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd06c03e4c0 0x7fd06c0409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd070006fd0 tx=0x7fd070006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.698+0000 7fd082000700 1 -- 172.21.15.120:0/3410340427 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd0780212a0 con 0x7fd08410bb10 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.953+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fd0841093c0 con 0x7fd06c03e4c0 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.962+0000 7fd082000700 1 -- 172.21.15.120:0/3410340427 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd0841093c0 con 0x7fd06c03e4c0 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd06c03e4c0 msgr2=0x7fd06c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd06c03e4c0 0x7fd06c0409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd070006fd0 tx=0x7fd070006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 msgr2=0x7fd08419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08419fde0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0780119b0 tx=0x7fd078011a90 comp rx=0 tx=0).stop 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 shutdown_connections 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd06c03e4c0 0x7fd06c0409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 --2- 172.21.15.120:0/3410340427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08410bb10 0x7fd08419fde0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:22.829 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 >> 172.21.15.120:0/3410340427 conn(0x7fd084107430 msgr2=0x7fd084108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:22.829 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.965+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 shutdown_connections 2024-05-14T09:07:22.829 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:21.966+0000 7fd08c400700 1 -- 172.21.15.120:0/3410340427 wait complete. 2024-05-14T09:07:22.829 INFO:teuthology.orchestra.run.smithi120.stdout:Deploying unmanaged mgr service... 2024-05-14T09:07:23.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:22 smithi120 ceph-mon[31085]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:23.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:22 smithi120 ceph-mon[31085]: Saving service mon spec with placement count:5 2024-05-14T09:07:23.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:22 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.760+0000 7fd0e0e00700 1 Processor -- start 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.760+0000 7fd0e0e00700 1 -- start start 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.761+0000 7fd0e0e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc07d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.761+0000 7fd0e0e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc07d7c0 con 0x7fd0dc07edd0 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.761+0000 7fd0d9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc07d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.761+0000 7fd0d9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc07d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49644/0 (socket says 172.21.15.120:49644) 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.762+0000 7fd0d9e00700 1 -- 172.21.15.120:0/1025895415 learned_addr learned my addr 172.21.15.120:0/1025895415 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.762+0000 7fd0d9e00700 1 -- 172.21.15.120:0/1025895415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc07d940 con 0x7fd0dc07edd0 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.762+0000 7fd0d9e00700 1 --2- 172.21.15.120:0/1025895415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc07d1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0098a0 tx=0x7fd0cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2406e1b9ef82a69 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:24.799 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.763+0000 7fd0d8a00700 1 -- 172.21.15.120:0/1025895415 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0cc004160 con 0x7fd0dc07edd0 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.763+0000 7fd0d8a00700 1 -- 172.21.15.120:0/1025895415 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd0cc004300 con 0x7fd0dc07edd0 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.763+0000 7fd0d8a00700 1 -- 172.21.15.120:0/1025895415 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0cc0119e0 con 0x7fd0dc07edd0 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.763+0000 7fd0e0e00700 1 -- 172.21.15.120:0/1025895415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 msgr2=0x7fd0dc07d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.763+0000 7fd0e0e00700 1 --2- 172.21.15.120:0/1025895415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc07d1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0098a0 tx=0x7fd0cc009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.764+0000 7fd0e0e00700 1 -- 172.21.15.120:0/1025895415 shutdown_connections 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.764+0000 7fd0e0e00700 1 --2- 172.21.15.120:0/1025895415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc07d1f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.764+0000 7fd0e0e00700 1 -- 172.21.15.120:0/1025895415 >> 172.21.15.120:0/1025895415 conn(0x7fd0dc104f10 msgr2=0x7fd0dc1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.764+0000 7fd0e0e00700 1 -- 172.21.15.120:0/1025895415 shutdown_connections 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.764+0000 7fd0e0e00700 1 -- 172.21.15.120:0/1025895415 wait complete. 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.765+0000 7fd0e0e00700 1 Processor -- start 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.765+0000 7fd0e0e00700 1 -- start start 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.765+0000 7fd0e0e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.765+0000 7fd0e0e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc10fee0 con 0x7fd0dc07edd0 2024-05-14T09:07:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.766+0000 7fd0d9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.766+0000 7fd0d9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc19fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49648/0 (socket says 172.21.15.120:49648) 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.766+0000 7fd0d9e00700 1 -- 172.21.15.120:0/548472685 learned_addr learned my addr 172.21.15.120:0/548472685 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.766+0000 7fd0d9e00700 1 -- 172.21.15.120:0/548472685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc1a0430 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.766+0000 7fd0d9e00700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc19fef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0119b0 tx=0x7fd0cc011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.767+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0cc003af0 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.767+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd0cc01a8a0 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.767+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc1a06c0 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.767+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0cc024830 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.767+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1a32d0 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.768+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc064e20 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.768+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fd0cc022020 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.769+0000 7fd0d2a00700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd0c003e4c0 0x7fd0c00409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.769+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd0cc053910 con 0x7fd0dc07edd0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.769+0000 7fd0d9400700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd0c003e4c0 0x7fd0c00409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:24.801 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.770+0000 7fd0d9400700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd0c003e4c0 0x7fd0c00409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8006fd0 tx=0x7fd0c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.775+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd0cc00e260 con 0x7fd0dc07edd0 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:23.980+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mon.0 v2:172.21.15.120:3300/0 7 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0cc059080 con 0x7fd0dc07edd0 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.030+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fd0dc106030 con 0x7fd0c003e4c0 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.037+0000 7fd0d2a00700 1 -- 172.21.15.120:0/548472685 <== mgr.14120 v2:172.21.15.120:6800/975840748 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd0dc106030 con 0x7fd0c003e4c0 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd0c003e4c0 msgr2=0x7fd0c00409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd0c003e4c0 0x7fd0c00409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8006fd0 tx=0x7fd0c8006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 msgr2=0x7fd0dc19fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc19fef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0119b0 tx=0x7fd0cc011a90 comp rx=0 tx=0).stop 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 shutdown_connections 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fd0c003e4c0 0x7fd0c00409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 --2- 172.21.15.120:0/548472685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0dc07edd0 0x7fd0dc19fef0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 >> 172.21.15.120:0/548472685 conn(0x7fd0dc104f10 msgr2=0x7fd0dc1058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 shutdown_connections 2024-05-14T09:07:24.802 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:24.040+0000 7fd0e0e00700 1 -- 172.21.15.120:0/548472685 wait complete. 2024-05-14T09:07:25.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:24 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:25.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:24 smithi120 ceph-mon[31085]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:25.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:24 smithi120 ceph-mon[31085]: Saving service mgr spec with placement count:2 2024-05-14T09:07:25.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:24 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:26.347 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:25 smithi120 ceph-mon[31085]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:07:26.347 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:25 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:26.347 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:25 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1558726278' entity='client.admin' 2024-05-14T09:07:26.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.459+0000 7fe381400700 1 Processor -- start 2024-05-14T09:07:26.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.460+0000 7fe381400700 1 -- start start 2024-05-14T09:07:26.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.460+0000 7fe381400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c10b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:26.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.460+0000 7fe381400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1094e0 con 0x7fe37c10aee0 2024-05-14T09:07:26.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.461+0000 7fe37a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c10b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:26.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.461+0000 7fe37a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c10b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49654/0 (socket says 172.21.15.120:49654) 2024-05-14T09:07:26.356 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.461+0000 7fe37a800700 1 -- 172.21.15.120:0/3734505142 learned_addr learned my addr 172.21.15.120:0/3734505142 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:26.356 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.461+0000 7fe37a800700 1 -- 172.21.15.120:0/3734505142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c109660 con 0x7fe37c10aee0 2024-05-14T09:07:26.356 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.462+0000 7fe37a800700 1 --2- 172.21.15.120:0/3734505142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c10b2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0098a0 tx=0x7fe36c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1119ae9c95c6e1ee server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:26.357 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.462+0000 7fe379400700 1 -- 172.21.15.120:0/3734505142 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe36c004160 con 0x7fe37c10aee0 2024-05-14T09:07:26.357 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.462+0000 7fe379400700 1 -- 172.21.15.120:0/3734505142 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe36c004300 con 0x7fe37c10aee0 2024-05-14T09:07:26.357 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.462+0000 7fe379400700 1 -- 172.21.15.120:0/3734505142 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe36c011960 con 0x7fe37c10aee0 2024-05-14T09:07:26.358 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.463+0000 7fe381400700 1 -- 172.21.15.120:0/3734505142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 msgr2=0x7fe37c10b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:26.358 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.463+0000 7fe381400700 1 --2- 172.21.15.120:0/3734505142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c10b2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0098a0 tx=0x7fe36c009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:26.358 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.463+0000 7fe381400700 1 -- 172.21.15.120:0/3734505142 shutdown_connections 2024-05-14T09:07:26.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.463+0000 7fe381400700 1 --2- 172.21.15.120:0/3734505142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c10b2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:26.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.463+0000 7fe381400700 1 -- 172.21.15.120:0/3734505142 >> 172.21.15.120:0/3734505142 conn(0x7fe37c104f10 msgr2=0x7fe37c1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:26.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.463+0000 7fe381400700 1 -- 172.21.15.120:0/3734505142 shutdown_connections 2024-05-14T09:07:26.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.463+0000 7fe381400700 1 -- 172.21.15.120:0/3734505142 wait complete. 2024-05-14T09:07:26.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.464+0000 7fe381400700 1 Processor -- start 2024-05-14T09:07:26.359 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.465+0000 7fe381400700 1 -- start start 2024-05-14T09:07:26.360 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.465+0000 7fe381400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c19dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:26.360 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.465+0000 7fe381400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c10dd80 con 0x7fe37c10aee0 2024-05-14T09:07:26.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.465+0000 7fe37a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c19dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:26.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.465+0000 7fe37a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c19dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49662/0 (socket says 172.21.15.120:49662) 2024-05-14T09:07:26.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.465+0000 7fe37a800700 1 -- 172.21.15.120:0/1558726278 learned_addr learned my addr 172.21.15.120:0/1558726278 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:26.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.466+0000 7fe37a800700 1 -- 172.21.15.120:0/1558726278 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c19e270 con 0x7fe37c10aee0 2024-05-14T09:07:26.361 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.466+0000 7fe37a800700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c19dd30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe36c011980 tx=0x7fe36c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.466+0000 7fe373400700 1 -- 172.21.15.120:0/1558726278 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe36c003a60 con 0x7fe37c10aee0 2024-05-14T09:07:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.466+0000 7fe373400700 1 -- 172.21.15.120:0/1558726278 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe36c01b8d0 con 0x7fe37c10aee0 2024-05-14T09:07:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.466+0000 7fe373400700 1 -- 172.21.15.120:0/1558726278 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe36c0237d0 con 0x7fe37c10aee0 2024-05-14T09:07:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.466+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c19e500 con 0x7fe37c10aee0 2024-05-14T09:07:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.467+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c1a1100 con 0x7fe37c10aee0 2024-05-14T09:07:26.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.468+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37c064e20 con 0x7fe37c10aee0 2024-05-14T09:07:26.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.469+0000 7fe373400700 1 -- 172.21.15.120:0/1558726278 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe36c01b440 con 0x7fe37c10aee0 2024-05-14T09:07:26.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.469+0000 7fe373400700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fe36003e470 0x7fe360040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:26.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.470+0000 7fe373400700 1 -- 172.21.15.120:0/1558726278 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe36c054370 con 0x7fe37c10aee0 2024-05-14T09:07:26.363 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.470+0000 7fe379e00700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fe36003e470 0x7fe360040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:26.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.471+0000 7fe379e00700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fe36003e470 0x7fe360040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe368006fd0 tx=0x7fe368006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:26.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.475+0000 7fe373400700 1 -- 172.21.15.120:0/1558726278 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe36c028060 con 0x7fe37c10aee0 2024-05-14T09:07:26.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.711+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fe37c1a15a0 con 0x7fe37c10aee0 2024-05-14T09:07:26.364 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.715+0000 7fe373400700 1 -- 172.21.15.120:0/1558726278 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fe36c01f030 con 0x7fe37c10aee0 2024-05-14T09:07:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fe36003e470 msgr2=0x7fe360040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fe36003e470 0x7fe360040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe368006fd0 tx=0x7fe368006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 msgr2=0x7fe37c19dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c19dd30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe36c011980 tx=0x7fe36c011a60 comp rx=0 tx=0).stop 2024-05-14T09:07:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 shutdown_connections 2024-05-14T09:07:26.366 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fe36003e470 0x7fe360040980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:26.366 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 --2- 172.21.15.120:0/1558726278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe37c10aee0 0x7fe37c19dd30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:26.366 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 >> 172.21.15.120:0/1558726278 conn(0x7fe37c104f10 msgr2=0x7fe37c105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:26.366 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 shutdown_connections 2024-05-14T09:07:26.366 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:25.718+0000 7fe381400700 1 -- 172.21.15.120:0/1558726278 wait complete. 2024-05-14T09:07:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:28 smithi120 ceph-mon[31085]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:07:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:28 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:28 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1614969081' entity='client.admin' 2024-05-14T09:07:28.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.680+0000 7f4c27e00700 1 Processor -- start 2024-05-14T09:07:28.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.680+0000 7f4c27e00700 1 -- start start 2024-05-14T09:07:28.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.680+0000 7f4c27e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2007dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:28.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.680+0000 7f4c27e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2007e140 con 0x7f4c2007f730 2024-05-14T09:07:28.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.681+0000 7f4c25400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2007dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:28.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.681+0000 7f4c25400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2007dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49678/0 (socket says 172.21.15.120:49678) 2024-05-14T09:07:28.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.681+0000 7f4c25400700 1 -- 172.21.15.120:0/96257025 learned_addr learned my addr 172.21.15.120:0/96257025 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.681+0000 7f4c25400700 1 -- 172.21.15.120:0/96257025 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2007e2c0 con 0x7f4c2007f730 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.682+0000 7f4c25400700 1 --2- 172.21.15.120:0/96257025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2007dc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c140098a0 tx=0x7f4c14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929c4e605d4c6b53 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.682+0000 7f4c1fe00700 1 -- 172.21.15.120:0/96257025 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c14004160 con 0x7f4c2007f730 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.682+0000 7f4c1fe00700 1 -- 172.21.15.120:0/96257025 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c14004300 con 0x7f4c2007f730 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.682+0000 7f4c1fe00700 1 -- 172.21.15.120:0/96257025 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c14011960 con 0x7f4c2007f730 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.683+0000 7f4c27e00700 1 -- 172.21.15.120:0/96257025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 msgr2=0x7f4c2007dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.683+0000 7f4c27e00700 1 --2- 172.21.15.120:0/96257025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2007dc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c140098a0 tx=0x7f4c14009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.683+0000 7f4c27e00700 1 -- 172.21.15.120:0/96257025 shutdown_connections 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.683+0000 7f4c27e00700 1 --2- 172.21.15.120:0/96257025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2007dc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.683+0000 7f4c27e00700 1 -- 172.21.15.120:0/96257025 >> 172.21.15.120:0/96257025 conn(0x7f4c20104f80 msgr2=0x7f4c20107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.683+0000 7f4c27e00700 1 -- 172.21.15.120:0/96257025 shutdown_connections 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.683+0000 7f4c27e00700 1 -- 172.21.15.120:0/96257025 wait complete. 2024-05-14T09:07:28.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.685+0000 7f4c27e00700 1 Processor -- start 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.685+0000 7f4c27e00700 1 -- start start 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.686+0000 7f4c27e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.686+0000 7f4c27e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2010fe60 con 0x7f4c2007f730 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.686+0000 7f4c25400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.686+0000 7f4c25400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49690/0 (socket says 172.21.15.120:49690) 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.686+0000 7f4c25400700 1 -- 172.21.15.120:0/1614969081 learned_addr learned my addr 172.21.15.120:0/1614969081 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.686+0000 7f4c25400700 1 -- 172.21.15.120:0/1614969081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c201a0340 con 0x7f4c2007f730 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.687+0000 7f4c25400700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2019fe00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c14011670 tx=0x7f4c14011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.687+0000 7f4c1e000700 1 -- 172.21.15.120:0/1614969081 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c14003aa0 con 0x7f4c2007f730 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.687+0000 7f4c1e000700 1 -- 172.21.15.120:0/1614969081 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1401b8d0 con 0x7f4c2007f730 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.687+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c201a05d0 con 0x7f4c2007f730 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.687+0000 7f4c1e000700 1 -- 172.21.15.120:0/1614969081 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c140197f0 con 0x7f4c2007f730 2024-05-14T09:07:28.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.687+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201a31e0 con 0x7f4c2007f730 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.689+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c20064e20 con 0x7f4c2007f730 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.689+0000 7f4c1e000700 1 -- 172.21.15.120:0/1614969081 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4c14019990 con 0x7f4c2007f730 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.689+0000 7f4c1e000700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f4c0803e420 0x7f4c08040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.689+0000 7f4c1e000700 1 -- 172.21.15.120:0/1614969081 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4c14054110 con 0x7f4c2007f730 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.690+0000 7f4c24a00700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f4c0803e420 0x7f4c08040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.690+0000 7f4c24a00700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f4c0803e420 0x7f4c08040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c006fd0 tx=0x7f4c0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.695+0000 7f4c1e000700 1 -- 172.21.15.120:0/1614969081 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4c1401f030 con 0x7f4c2007f730 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.925+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f4c201a33b0 con 0x7f4c2007f730 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.933+0000 7f4c1e000700 1 -- 172.21.15.120:0/1614969081 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f4c14018d60 con 0x7f4c2007f730 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f4c0803e420 msgr2=0x7f4c08040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f4c0803e420 0x7f4c08040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c006fd0 tx=0x7f4c0c006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 msgr2=0x7f4c2019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2019fe00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c14011670 tx=0x7f4c14011a30 comp rx=0 tx=0).stop 2024-05-14T09:07:28.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 shutdown_connections 2024-05-14T09:07:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f4c0803e420 0x7f4c08040930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 --2- 172.21.15.120:0/1614969081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2007f730 0x7f4c2019fe00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.936+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 >> 172.21.15.120:0/1614969081 conn(0x7f4c20104f80 msgr2=0x7f4c20105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.937+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 shutdown_connections 2024-05-14T09:07:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:27.937+0000 7f4c27e00700 1 -- 172.21.15.120:0/1614969081 wait complete. 2024-05-14T09:07:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:Enabling the dashboard module... 2024-05-14T09:07:30.607 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:30 smithi120 ceph-mon[31085]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:07:30.608 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:30 smithi120 ceph-mon[31085]: from='mgr.14120 172.21.15.120:0/3571312812' entity='mgr.x' 2024-05-14T09:07:30.608 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:30 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2132981043' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-14T09:07:30.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: ignoring --setuser ceph since I am not root 2024-05-14T09:07:30.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: ignoring --setgroup ceph since I am not root 2024-05-14T09:07:31.255 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:31.011+0000 7f75cc62b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T09:07:31.528 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:31.259+0000 7f75cc62b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:07:31.528 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:31.393+0000 7f75cc62b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T09:07:31.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:31 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2132981043' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-14T09:07:31.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:31 smithi120 ceph-mon[31085]: mgrmap e9: x(active, since 25s) 2024-05-14T09:07:31.920 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.387+0000 7fea81600700 1 Processor -- start 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.387+0000 7fea81600700 1 -- start start 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.388+0000 7fea81600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c10bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.388+0000 7fea81600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c10c4d0 con 0x7fea7c10bad0 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.388+0000 7fea7aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c10bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.388+0000 7fea7aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c10bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60834/0 (socket says 172.21.15.120:60834) 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.388+0000 7fea7aa00700 1 -- 172.21.15.120:0/4177823989 learned_addr learned my addr 172.21.15.120:0/4177823989 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.389+0000 7fea7aa00700 1 -- 172.21.15.120:0/4177823989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c10cc00 con 0x7fea7c10bad0 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.389+0000 7fea7aa00700 1 --2- 172.21.15.120:0/4177823989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c10bee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0098a0 tx=0x7fea6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4bdc0ad38905f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.389+0000 7fea79600700 1 -- 172.21.15.120:0/4177823989 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea6c004160 con 0x7fea7c10bad0 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.390+0000 7fea79600700 1 -- 172.21.15.120:0/4177823989 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea6c004300 con 0x7fea7c10bad0 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.390+0000 7fea79600700 1 -- 172.21.15.120:0/4177823989 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea6c011960 con 0x7fea7c10bad0 2024-05-14T09:07:31.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.390+0000 7fea81600700 1 -- 172.21.15.120:0/4177823989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 msgr2=0x7fea7c10bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.390+0000 7fea81600700 1 --2- 172.21.15.120:0/4177823989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c10bee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0098a0 tx=0x7fea6c009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.391+0000 7fea81600700 1 -- 172.21.15.120:0/4177823989 shutdown_connections 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.391+0000 7fea81600700 1 --2- 172.21.15.120:0/4177823989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c10bee0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.391+0000 7fea81600700 1 -- 172.21.15.120:0/4177823989 >> 172.21.15.120:0/4177823989 conn(0x7fea7c107430 msgr2=0x7fea7c109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.391+0000 7fea81600700 1 -- 172.21.15.120:0/4177823989 shutdown_connections 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.391+0000 7fea81600700 1 -- 172.21.15.120:0/4177823989 wait complete. 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.392+0000 7fea81600700 1 Processor -- start 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.392+0000 7fea81600700 1 -- start start 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.393+0000 7fea81600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.393+0000 7fea81600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c10ffb0 con 0x7fea7c10bad0 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.393+0000 7fea7aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.393+0000 7fea7aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60842/0 (socket says 172.21.15.120:60842) 2024-05-14T09:07:31.922 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.393+0000 7fea7aa00700 1 -- 172.21.15.120:0/2132981043 learned_addr learned my addr 172.21.15.120:0/2132981043 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.393+0000 7fea7aa00700 1 -- 172.21.15.120:0/2132981043 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c1a0330 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.394+0000 7fea7aa00700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c19fdf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea6c011980 tx=0x7fea6c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.394+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea6c01f070 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.394+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea6c003aa0 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.394+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c1a05c0 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.394+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea6c019560 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.394+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c1a3190 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.396+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fea6c022070 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.395+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7c064e20 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.396+0000 7fea73400700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fea6003e470 0x7fea60040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.396+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fea6c053960 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.396+0000 7fea7a000700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fea6003e470 0x7fea60040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.397+0000 7fea7a000700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fea6003e470 0x7fea60040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fea68006fd0 tx=0x7fea68006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.407+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fea6c019e20 con 0x7fea7c10bad0 2024-05-14T09:07:31.923 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:29.707+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fea7c1a3480 con 0x7fea7c10bad0 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.603+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fea6c0172b0 con 0x7fea7c10bad0 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.607+0000 7fea73400700 1 -- 172.21.15.120:0/2132981043 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fea6c00bd00 con 0x7fea7c10bad0 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fea6003e470 msgr2=0x7fea60040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fea6003e470 0x7fea60040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fea68006fd0 tx=0x7fea68006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 msgr2=0x7fea7c19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c19fdf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea6c011980 tx=0x7fea6c011a60 comp rx=0 tx=0).stop 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 shutdown_connections 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7fea6003e470 0x7fea60040980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 --2- 172.21.15.120:0/2132981043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7c10bad0 0x7fea7c19fdf0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea6c011980 tx=0x7fea6c011a60 comp rx=0 tx=0).stop 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.609+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 >> 172.21.15.120:0/2132981043 conn(0x7fea7c107430 msgr2=0x7fea7c108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.610+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 shutdown_connections 2024-05-14T09:07:31.924 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:30.610+0000 7fea81600700 1 -- 172.21.15.120:0/2132981043 wait complete. 2024-05-14T09:07:32.119 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:31.790+0000 7f75cc62b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T09:07:32.120 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:31.907+0000 7f75cc62b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T09:07:33.522 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:33 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2689388347' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-14T09:07:33.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:33.522+0000 7f75cc62b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T09:07:33.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:33.755+0000 7f75cc62b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T09:07:33.944 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:07:33.944 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-14T09:07:33.944 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T09:07:33.944 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-14T09:07:33.944 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-14T09:07:33.944 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.956+0000 7f35f7c00700 1 Processor -- start 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.956+0000 7f35f7c00700 1 -- start start 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.956+0000 7f35f7c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f007d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.956+0000 7f35f7c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f35f007d7e0 con 0x7f35f007edf0 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.957+0000 7f35f5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f007d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.957+0000 7f35f5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f007d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60878/0 (socket says 172.21.15.120:60878) 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.957+0000 7f35f5200700 1 -- 172.21.15.120:0/2726071756 learned_addr learned my addr 172.21.15.120:0/2726071756 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.957+0000 7f35f5200700 1 -- 172.21.15.120:0/2726071756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f007d960 con 0x7f35f007edf0 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.957+0000 7f35f5200700 1 --2- 172.21.15.120:0/2726071756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f007d210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35e40098a0 tx=0x7f35e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a11b839da79ae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.958+0000 7f35ef400700 1 -- 172.21.15.120:0/2726071756 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4004160 con 0x7f35f007edf0 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.958+0000 7f35ef400700 1 -- 172.21.15.120:0/2726071756 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35e4004300 con 0x7f35f007edf0 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.958+0000 7f35ef400700 1 -- 172.21.15.120:0/2726071756 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4011960 con 0x7f35f007edf0 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.959+0000 7f35f7c00700 1 -- 172.21.15.120:0/2726071756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 msgr2=0x7f35f007d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:33.945 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.959+0000 7f35f7c00700 1 --2- 172.21.15.120:0/2726071756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f007d210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35e40098a0 tx=0x7f35e4009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.959+0000 7f35f7c00700 1 -- 172.21.15.120:0/2726071756 shutdown_connections 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.959+0000 7f35f7c00700 1 --2- 172.21.15.120:0/2726071756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f007d210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.959+0000 7f35f7c00700 1 -- 172.21.15.120:0/2726071756 >> 172.21.15.120:0/2726071756 conn(0x7f35f0104f10 msgr2=0x7f35f01073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.959+0000 7f35f7c00700 1 -- 172.21.15.120:0/2726071756 shutdown_connections 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.959+0000 7f35f7c00700 1 -- 172.21.15.120:0/2726071756 wait complete. 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.960+0000 7f35f7c00700 1 Processor -- start 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.960+0000 7f35f7c00700 1 -- start start 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.960+0000 7f35f7c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f019ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.960+0000 7f35f7c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f35f010ff10 con 0x7f35f007edf0 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.961+0000 7f35f5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f019ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.961+0000 7f35f5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f019ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60894/0 (socket says 172.21.15.120:60894) 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.961+0000 7f35f5200700 1 -- 172.21.15.120:0/2689388347 learned_addr learned my addr 172.21.15.120:0/2689388347 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.961+0000 7f35f5200700 1 -- 172.21.15.120:0/2689388347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f01a0450 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.962+0000 7f35f5200700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f019ff10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35e4011670 tx=0x7f35e4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.962+0000 7f35ed600700 1 -- 172.21.15.120:0/2689388347 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4003a60 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.962+0000 7f35ed600700 1 -- 172.21.15.120:0/2689388347 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35e401b8d0 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.962+0000 7f35ed600700 1 -- 172.21.15.120:0/2689388347 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4023790 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.962+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f01a06e0 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.962+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f01a32f0 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.963+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f0064e20 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.964+0000 7f35ed600700 1 -- 172.21.15.120:0/2689388347 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f35e4023a40 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.964+0000 7f35ed600700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 0x7f35d8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.964+0000 7f35ed600700 1 -- 172.21.15.120:0/2689388347 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f35e4054080 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.964+0000 7f35efe00700 1 -- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 msgr2=0x7f35d8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/975840748 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.964+0000 7f35efe00700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 0x7f35d8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:32.970+0000 7f35ed600700 1 -- 172.21.15.120:0/2689388347 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f35e401f030 con 0x7f35f007edf0 2024-05-14T09:07:33.947 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.165+0000 7f35efe00700 1 -- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 msgr2=0x7f35d8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/975840748 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.165+0000 7f35efe00700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 0x7f35d8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.261+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f35f01a37e0 con 0x7f35f007edf0 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.262+0000 7f35ed600700 1 -- 172.21.15.120:0/2689388347 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f35e4019e20 con 0x7f35f007edf0 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 msgr2=0x7f35d8040a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 0x7f35d8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 msgr2=0x7f35f019ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f019ff10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35e4011670 tx=0x7f35e4011a30 comp rx=0 tx=0).stop 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 shutdown_connections 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f35d803e520 0x7f35d8040a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 --2- 172.21.15.120:0/2689388347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35f007edf0 0x7f35f019ff10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.265+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 >> 172.21.15.120:0/2689388347 conn(0x7f35f0104f10 msgr2=0x7f35f01058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.266+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 shutdown_connections 2024-05-14T09:07:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:33.266+0000 7f35f7c00700 1 -- 172.21.15.120:0/2689388347 wait complete. 2024-05-14T09:07:33.949 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for the mgr to restart... 2024-05-14T09:07:33.949 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr epoch 9... 2024-05-14T09:07:34.212 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:33.975+0000 7f75cc62b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T09:07:34.485 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:34.367+0000 7f75cc62b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T09:07:34.757 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:34.498+0000 7f75cc62b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T09:07:35.016 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:34.758+0000 7f75cc62b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T09:07:35.017 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:35 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:35.015+0000 7f75cc62b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:07:36.030 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:35 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:35.830+0000 7f75cc62b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T09:07:36.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:36.130+0000 7f75cc62b200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T09:07:36.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:36.704+0000 7f75cc62b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T09:07:36.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:36.833+0000 7f75cc62b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T09:07:37.631 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:37.297+0000 7f75cc62b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T09:07:37.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:37.746+0000 7f75cc62b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T09:07:37.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:37.873+0000 7f75cc62b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T09:07:38.502 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:38.193+0000 7f75cc62b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T09:07:38.502 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:38.373+0000 7f75cc62b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T09:07:38.502 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:38.501+0000 7f75cc62b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T09:07:39.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:38.897+0000 7f75cc62b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T09:07:39.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:39 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:39.022+0000 7f75cc62b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T09:07:40.062 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:39 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:39.774+0000 7f75cc62b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:07:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:07:40.061+0000 7f75cc62b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: Active manager daemon x restarted 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: Activating manager daemon x 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: osdmap e3: 0 total, 0 up, 0 in 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: mgrmap e10: x(active, starting, since 0.0134391s) 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T09:07:40.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T09:07:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T09:07:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T09:07:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:40 smithi120 ceph-mon[31085]: Manager daemon x is now available 2024-05-14T09:07:41.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:07:41.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T09:07:41.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T09:07:41.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: [14/May/2024:09:07:40] ENGINE Bus STARTING 2024-05-14T09:07:41.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: [14/May/2024:09:07:40] ENGINE Serving on https://172.21.15.120:7150 2024-05-14T09:07:41.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: [14/May/2024:09:07:40] ENGINE Serving on http://172.21.15.120:8765 2024-05-14T09:07:41.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: [14/May/2024:09:07:40] ENGINE Bus STARTED 2024-05-14T09:07:41.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:41 smithi120 ceph-mon[31085]: mgrmap e11: x(active, since 1.01145s) 2024-05-14T09:07:41.778 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-05-14T09:07:41.778 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.619+0000 7f8d67a00700 1 Processor -- start 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.619+0000 7f8d67a00700 1 -- start start 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.619+0000 7f8d67a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6010b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.619+0000 7f8d67a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601094e0 con 0x7f8d6010aee0 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.620+0000 7f8d65000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6010b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.620+0000 7f8d65000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6010b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60908/0 (socket says 172.21.15.120:60908) 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.620+0000 7f8d65000700 1 -- 172.21.15.120:0/3141682709 learned_addr learned my addr 172.21.15.120:0/3141682709 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.620+0000 7f8d65000700 1 -- 172.21.15.120:0/3141682709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d60109660 con 0x7f8d6010aee0 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.620+0000 7f8d65000700 1 --2- 172.21.15.120:0/3141682709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6010b2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d540098a0 tx=0x7f8d54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ddadcd2206791d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.621+0000 7f8d5f400700 1 -- 172.21.15.120:0/3141682709 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d54004160 con 0x7f8d6010aee0 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.621+0000 7f8d5f400700 1 -- 172.21.15.120:0/3141682709 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d54004300 con 0x7f8d6010aee0 2024-05-14T09:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.621+0000 7f8d5f400700 1 -- 172.21.15.120:0/3141682709 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d54011960 con 0x7f8d6010aee0 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.622+0000 7f8d67a00700 1 -- 172.21.15.120:0/3141682709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 msgr2=0x7f8d6010b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.622+0000 7f8d67a00700 1 --2- 172.21.15.120:0/3141682709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6010b2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d540098a0 tx=0x7f8d54009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.622+0000 7f8d67a00700 1 -- 172.21.15.120:0/3141682709 shutdown_connections 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.622+0000 7f8d67a00700 1 --2- 172.21.15.120:0/3141682709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6010b2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.622+0000 7f8d67a00700 1 -- 172.21.15.120:0/3141682709 >> 172.21.15.120:0/3141682709 conn(0x7f8d60104f10 msgr2=0x7f8d601073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.622+0000 7f8d67a00700 1 -- 172.21.15.120:0/3141682709 shutdown_connections 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.622+0000 7f8d67a00700 1 -- 172.21.15.120:0/3141682709 wait complete. 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.623+0000 7f8d67a00700 1 Processor -- start 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.623+0000 7f8d67a00700 1 -- start start 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.624+0000 7f8d67a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6019dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.624+0000 7f8d67a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6010dd80 con 0x7f8d6010aee0 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.624+0000 7f8d65000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6019dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.624+0000 7f8d65000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6019dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60910/0 (socket says 172.21.15.120:60910) 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.624+0000 7f8d65000700 1 -- 172.21.15.120:0/2083358255 learned_addr learned my addr 172.21.15.120:0/2083358255 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.624+0000 7f8d65000700 1 -- 172.21.15.120:0/2083358255 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6019e260 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.625+0000 7f8d65000700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6019dd20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d54000c00 tx=0x7f8d54011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.625+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d54003a60 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.625+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6019e4f0 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.625+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d5401b8d0 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.625+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d54019780 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.625+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601a10f0 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.627+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f8d54019a30 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.627+0000 7f8d5d600700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.627+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 --> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8d48041140 con 0x7f8d4803e520 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.627+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8d54053e10 con 0x7f8d6010aee0 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.627+0000 7f8d5fe00700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 msgr2=0x7f8d48040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/975840748 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.627+0000 7f8d5fe00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.828+0000 7f8d5fe00700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 msgr2=0x7f8d48040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/975840748 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:34.828+0000 7f8d5fe00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:35.228+0000 7f8d5fe00700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 msgr2=0x7f8d48040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/975840748 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:35.228+0000 7f8d5fe00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:36.029+0000 7f8d5fe00700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 msgr2=0x7f8d48040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/975840748 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:36.029+0000 7f8d5fe00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:37.631+0000 7f8d5fe00700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 msgr2=0x7f8d48040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/975840748 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:37.631+0000 7f8d5fe00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:40.073+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f8d5401ba80 con 0x7f8d6010aee0 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:40.074+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 msgr2=0x7f8d48040a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:40.074+0000 7f8d5d600700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.072+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f8d54055bd0 con 0x7f8d6010aee0 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.073+0000 7f8d5d600700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8d540539a0 0x7f8d48044000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.073+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8d54013e70 con 0x7f8d540539a0 2024-05-14T09:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.074+0000 7f8d5fe00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8d540539a0 0x7f8d48044000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.075+0000 7f8d5fe00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8d540539a0 0x7f8d48044000 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c003a10 tx=0x7f8d4c009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.076+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f8d54013e70 con 0x7f8d540539a0 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.084+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8d60064e20 con 0x7f8d540539a0 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.085+0000 7f8d5d600700 1 -- 172.21.15.120:0/2083358255 <== mgr.14152 v2:172.21.15.120:6800/197404993 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f8d60064e20 con 0x7f8d540539a0 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.085+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8d540539a0 msgr2=0x7f8d48044000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.085+0000 7f8d67a00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8d540539a0 0x7f8d48044000 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c003a10 tx=0x7f8d4c009270 comp rx=0 tx=0).stop 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.085+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 msgr2=0x7f8d6019dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.085+0000 7f8d67a00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6019dd20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d54000c00 tx=0x7f8d54011a30 comp rx=0 tx=0).stop 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.086+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 shutdown_connections 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.086+0000 7f8d67a00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8d540539a0 0x7f8d48044000 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.086+0000 7f8d67a00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d6010aee0 0x7f8d6019dd20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.086+0000 7f8d67a00700 1 --2- 172.21.15.120:0/2083358255 >> [v2:172.21.15.120:6800/975840748,v1:172.21.15.120:6801/975840748] conn(0x7f8d4803e520 0x7f8d48040a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.086+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 >> 172.21.15.120:0/2083358255 conn(0x7f8d60104f10 msgr2=0x7f8d601058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.086+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 shutdown_connections 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:41.086+0000 7f8d67a00700 1 -- 172.21.15.120:0/2083358255 wait complete. 2024-05-14T09:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:mgr epoch 9 is available 2024-05-14T09:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout:Generating a dashboard self-signed certificate... 2024-05-14T09:07:42.381 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:42 smithi120 ceph-mon[31085]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-14T09:07:42.381 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:42 smithi120 ceph-mon[31085]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-14T09:07:43.348 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:43 smithi120 ceph-mon[31085]: mgrmap e12: x(active, since 2s) 2024-05-14T09:07:43.349 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:44.184 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-14T09:07:44.184 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.095+0000 7f69fa200700 1 Processor -- start 2024-05-14T09:07:44.184 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.095+0000 7f69fa200700 1 -- start start 2024-05-14T09:07:44.184 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.096+0000 7f69fa200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f410b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:44.184 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.096+0000 7f69fa200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f69f41094e0 con 0x7f69f410aee0 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.096+0000 7f69f3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f410b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.096+0000 7f69f3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f410b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38526/0 (socket says 172.21.15.120:38526) 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.096+0000 7f69f3400700 1 -- 172.21.15.120:0/721640172 learned_addr learned my addr 172.21.15.120:0/721640172 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.097+0000 7f69f3400700 1 -- 172.21.15.120:0/721640172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f4109660 con 0x7f69f410aee0 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.097+0000 7f69f3400700 1 --2- 172.21.15.120:0/721640172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f410b2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69e40098a0 tx=0x7f69e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3697f2ed093c3ace server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.097+0000 7f69f2000700 1 -- 172.21.15.120:0/721640172 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e4004160 con 0x7f69f410aee0 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.097+0000 7f69f2000700 1 -- 172.21.15.120:0/721640172 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69e4004300 con 0x7f69f410aee0 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.098+0000 7f69f2000700 1 -- 172.21.15.120:0/721640172 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e4011960 con 0x7f69f410aee0 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.098+0000 7f69fa200700 1 -- 172.21.15.120:0/721640172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 msgr2=0x7f69f410b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.098+0000 7f69fa200700 1 --2- 172.21.15.120:0/721640172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f410b2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69e40098a0 tx=0x7f69e4009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.099+0000 7f69fa200700 1 -- 172.21.15.120:0/721640172 shutdown_connections 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.099+0000 7f69fa200700 1 --2- 172.21.15.120:0/721640172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f410b2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:44.185 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.099+0000 7f69fa200700 1 -- 172.21.15.120:0/721640172 >> 172.21.15.120:0/721640172 conn(0x7f69f4104f10 msgr2=0x7f69f41073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.099+0000 7f69fa200700 1 -- 172.21.15.120:0/721640172 shutdown_connections 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.099+0000 7f69fa200700 1 -- 172.21.15.120:0/721640172 wait complete. 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.100+0000 7f69fa200700 1 Processor -- start 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.100+0000 7f69fa200700 1 -- start start 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.100+0000 7f69fa200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f419ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.100+0000 7f69fa200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f69f410dd80 con 0x7f69f410aee0 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.101+0000 7f69f3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f419ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.101+0000 7f69f3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f419ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38528/0 (socket says 172.21.15.120:38528) 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.101+0000 7f69f3400700 1 -- 172.21.15.120:0/3972995102 learned_addr learned my addr 172.21.15.120:0/3972995102 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.101+0000 7f69f3400700 1 -- 172.21.15.120:0/3972995102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f41a0470 con 0x7f69f410aee0 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.101+0000 7f69f3400700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f419ff30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69e4000c00 tx=0x7f69e4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.102+0000 7f69ebe00700 1 -- 172.21.15.120:0/3972995102 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e4003a60 con 0x7f69f410aee0 2024-05-14T09:07:44.186 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.102+0000 7f69ebe00700 1 -- 172.21.15.120:0/3972995102 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69e401b8d0 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.102+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f41a0700 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.102+0000 7f69ebe00700 1 -- 172.21.15.120:0/3972995102 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e4019780 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.102+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f41a3310 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.103+0000 7f69ebe00700 1 -- 172.21.15.120:0/3972995102 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f69e4019a40 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.103+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f4064e20 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.104+0000 7f69ebe00700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f69d803e4c0 0x7f69d80409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.104+0000 7f69ebe00700 1 -- 172.21.15.120:0/3972995102 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f69e4053f20 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.104+0000 7f69f2a00700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f69d803e4c0 0x7f69d80409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.105+0000 7f69f2a00700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f69d803e4c0 0x7f69d80409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69e0006fd0 tx=0x7f69e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.110+0000 7f69ebe00700 1 -- 172.21.15.120:0/3972995102 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f69e401f030 con 0x7f69f410aee0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.347+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f69f407d840 con 0x7f69d803e4c0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.462+0000 7f69ebe00700 1 -- 172.21.15.120:0/3972995102 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f69f407d840 con 0x7f69d803e4c0 2024-05-14T09:07:44.187 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f69d803e4c0 msgr2=0x7f69d80409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f69d803e4c0 0x7f69d80409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69e0006fd0 tx=0x7f69e0006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 msgr2=0x7f69f419ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f419ff30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69e4000c00 tx=0x7f69e4011a30 comp rx=0 tx=0).stop 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 shutdown_connections 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f69d803e4c0 0x7f69d80409d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 --2- 172.21.15.120:0/3972995102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69f410aee0 0x7f69f419ff30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 >> 172.21.15.120:0/3972995102 conn(0x7f69f4104f10 msgr2=0x7f69f407d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 shutdown_connections 2024-05-14T09:07:44.188 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:43.465+0000 7f69fa200700 1 -- 172.21.15.120:0/3972995102 wait complete. 2024-05-14T09:07:44.189 INFO:teuthology.orchestra.run.smithi120.stdout:Creating initial admin user... 2024-05-14T09:07:44.825 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:44 smithi120 ceph-mon[31085]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:44.825 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:44.825 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:46.087 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:46.087 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:46.102 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$dA9NUIFAJWcpt8EVZH61F.bF6eruVTaG9ppHxMgo6H6mSyK4jgK4a", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715677665, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-14T09:07:46.102 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.824+0000 7fa53ca00700 1 Processor -- start 2024-05-14T09:07:46.102 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.824+0000 7fa53ca00700 1 -- start start 2024-05-14T09:07:46.102 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.825+0000 7fa53ca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53810aee0 0x7fa53810b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:46.102 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.825+0000 7fa53ca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381094e0 con 0x7fa53810aee0 2024-05-14T09:07:46.103 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.825+0000 7fa535e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53810aee0 0x7fa53810b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:46.103 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.825+0000 7fa535e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53810aee0 0x7fa53810b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38534/0 (socket says 172.21.15.120:38534) 2024-05-14T09:07:46.103 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.825+0000 7fa535e00700 1 -- 172.21.15.120:0/2560175606 learned_addr learned my addr 172.21.15.120:0/2560175606 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.826+0000 7fa535e00700 1 -- 172.21.15.120:0/2560175606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa538109660 con 0x7fa53810aee0 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.826+0000 7fa535e00700 1 --2- 172.21.15.120:0/2560175606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53810aee0 0x7fa53810b2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5280098a0 tx=0x7fa528009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c011985e872a07 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.826+0000 7fa535400700 1 -- 172.21.15.120:0/2560175606 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa528004160 con 0x7fa53810aee0 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.826+0000 7fa535400700 1 -- 172.21.15.120:0/2560175606 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa528004300 con 0x7fa53810aee0 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.826+0000 7fa535400700 1 -- 172.21.15.120:0/2560175606 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa528011960 con 0x7fa53810aee0 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.827+0000 7fa53ca00700 1 -- 172.21.15.120:0/2560175606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53810aee0 msgr2=0x7fa53810b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.827+0000 7fa53ca00700 1 --2- 172.21.15.120:0/2560175606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53810aee0 0x7fa53810b2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5280098a0 tx=0x7fa528009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.827+0000 7fa53ca00700 1 -- 172.21.15.120:0/2560175606 shutdown_connections 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.827+0000 7fa53ca00700 1 --2- 172.21.15.120:0/2560175606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53810aee0 0x7fa53810b2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:46.108 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.827+0000 7fa53ca00700 1 -- 172.21.15.120:0/2560175606 >> 172.21.15.120:0/2560175606 conn(0x7fa538104f10 msgr2=0x7fa5381073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.828+0000 7fa53ca00700 1 -- 172.21.15.120:0/2560175606 shutdown_connections 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.828+0000 7fa53ca00700 1 -- 172.21.15.120:0/2560175606 wait complete. 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.829+0000 7fa53ca00700 1 Processor -- start 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.829+0000 7fa53ca00700 1 -- start start 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.829+0000 7fa53ca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53807e960 0x7fa53807d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.829+0000 7fa53ca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa53810dd80 con 0x7fa53807e960 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.830+0000 7fa535e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53807e960 0x7fa53807d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.830+0000 7fa535e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53807e960 0x7fa53807d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38544/0 (socket says 172.21.15.120:38544) 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.830+0000 7fa535e00700 1 -- 172.21.15.120:0/363516469 learned_addr learned my addr 172.21.15.120:0/363516469 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.830+0000 7fa535e00700 1 -- 172.21.15.120:0/363516469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53807edd0 con 0x7fa53807e960 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.830+0000 7fa535e00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53807e960 0x7fa53807d170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5280098a0 tx=0x7fa528012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.831+0000 7fa52ea00700 1 -- 172.21.15.120:0/363516469 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa528011900 con 0x7fa53807e960 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.831+0000 7fa52ea00700 1 -- 172.21.15.120:0/363516469 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa528003b30 con 0x7fa53807e960 2024-05-14T09:07:46.109 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.831+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53807f060 con 0x7fa53807e960 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.831+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53807d9c0 con 0x7fa53807e960 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.831+0000 7fa52ea00700 1 -- 172.21.15.120:0/363516469 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa52801bbf0 con 0x7fa53807e960 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.832+0000 7fa52ea00700 1 -- 172.21.15.120:0/363516469 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fa52801c450 con 0x7fa53807e960 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.832+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa514005360 con 0x7fa53807e960 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.833+0000 7fa52ea00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa51c03e520 0x7fa51c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.833+0000 7fa52ea00700 1 -- 172.21.15.120:0/363516469 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa5280541a0 con 0x7fa53807e960 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.833+0000 7fa52fe00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa51c03e520 0x7fa51c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.834+0000 7fa52fe00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa51c03e520 0x7fa51c040a30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa520006fd0 tx=0x7fa520006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:44.839+0000 7fa52ea00700 1 -- 172.21.15.120:0/363516469 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa52802a260 con 0x7fa53807e960 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.094+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fa514002430 con 0x7fa51c03e520 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.359+0000 7fa52ea00700 1 -- 172.21.15.120:0/363516469 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fa514002430 con 0x7fa51c03e520 2024-05-14T09:07:46.110 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.363+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa51c03e520 msgr2=0x7fa51c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.363+0000 7fa53ca00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa51c03e520 0x7fa51c040a30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa520006fd0 tx=0x7fa520006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53807e960 msgr2=0x7fa53807d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53807e960 0x7fa53807d170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5280098a0 tx=0x7fa528012f00 comp rx=0 tx=0).stop 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 shutdown_connections 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa51c03e520 0x7fa51c040a30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 --2- 172.21.15.120:0/363516469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa53807e960 0x7fa53807d170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 >> 172.21.15.120:0/363516469 conn(0x7fa538104f10 msgr2=0x7fa538105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 shutdown_connections 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:45.364+0000 7fa53ca00700 1 -- 172.21.15.120:0/363516469 wait complete. 2024-05-14T09:07:46.111 INFO:teuthology.orchestra.run.smithi120.stdout:Fetching dashboard port number... 2024-05-14T09:07:47.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:46 smithi120 ceph-mon[31085]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:07:48.013 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:47 smithi120 ceph-mon[31085]: mgrmap e13: x(active, since 6s) 2024-05-14T09:07:48.013 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:47 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/217817323' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 8443 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.829+0000 7fba7e600700 1 Processor -- start 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.829+0000 7fba7e600700 1 -- start start 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.829+0000 7fba7e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba78080400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.829+0000 7fba7e600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fba78080a10 con 0x7fba7807fff0 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.830+0000 7fba77400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba78080400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.830+0000 7fba77400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba78080400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38558/0 (socket says 172.21.15.120:38558) 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.830+0000 7fba77400700 1 -- 172.21.15.120:0/3766081352 learned_addr learned my addr 172.21.15.120:0/3766081352 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.830+0000 7fba77400700 1 -- 172.21.15.120:0/3766081352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba78081170 con 0x7fba7807fff0 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.830+0000 7fba77400700 1 --2- 172.21.15.120:0/3766081352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba78080400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba680098a0 tx=0x7fba68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114ad8c9cc925bc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.831+0000 7fba76000700 1 -- 172.21.15.120:0/3766081352 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba68004160 con 0x7fba7807fff0 2024-05-14T09:07:48.026 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.831+0000 7fba76000700 1 -- 172.21.15.120:0/3766081352 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba68004300 con 0x7fba7807fff0 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.831+0000 7fba76000700 1 -- 172.21.15.120:0/3766081352 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba68011960 con 0x7fba7807fff0 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.832+0000 7fba7e600700 1 -- 172.21.15.120:0/3766081352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 msgr2=0x7fba78080400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.832+0000 7fba7e600700 1 --2- 172.21.15.120:0/3766081352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba78080400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba680098a0 tx=0x7fba68009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.832+0000 7fba7e600700 1 -- 172.21.15.120:0/3766081352 shutdown_connections 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.832+0000 7fba7e600700 1 --2- 172.21.15.120:0/3766081352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba78080400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.832+0000 7fba7e600700 1 -- 172.21.15.120:0/3766081352 >> 172.21.15.120:0/3766081352 conn(0x7fba7807ef40 msgr2=0x7fba7807f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.832+0000 7fba7e600700 1 -- 172.21.15.120:0/3766081352 shutdown_connections 2024-05-14T09:07:48.027 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.832+0000 7fba7e600700 1 -- 172.21.15.120:0/3766081352 wait complete. 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.833+0000 7fba7e600700 1 Processor -- start 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.833+0000 7fba7e600700 1 -- start start 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.833+0000 7fba7e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba781a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.833+0000 7fba7e600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fba78082530 con 0x7fba7807fff0 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.834+0000 7fba77400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba781a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.834+0000 7fba77400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba781a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38570/0 (socket says 172.21.15.120:38570) 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.834+0000 7fba77400700 1 -- 172.21.15.120:0/217817323 learned_addr learned my addr 172.21.15.120:0/217817323 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.834+0000 7fba77400700 1 -- 172.21.15.120:0/217817323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba781a4680 con 0x7fba7807fff0 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.834+0000 7fba77400700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba781a4140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba68011670 tx=0x7fba68011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:48.028 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.835+0000 7fba6fe00700 1 -- 172.21.15.120:0/217817323 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba6801f070 con 0x7fba7807fff0 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.835+0000 7fba6fe00700 1 -- 172.21.15.120:0/217817323 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba68003b20 con 0x7fba7807fff0 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.835+0000 7fba6fe00700 1 -- 172.21.15.120:0/217817323 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba68019580 con 0x7fba7807fff0 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.835+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba781a4910 con 0x7fba7807fff0 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.835+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba781a7520 con 0x7fba7807fff0 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.836+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba78064e20 con 0x7fba7807fff0 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.836+0000 7fba6fe00700 1 -- 172.21.15.120:0/217817323 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7fba68022070 con 0x7fba7807fff0 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.837+0000 7fba6fe00700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba5c03e5c0 0x7fba5c040ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:48.029 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.837+0000 7fba6fe00700 1 -- 172.21.15.120:0/217817323 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fba68053c20 con 0x7fba7807fff0 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.837+0000 7fba76a00700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba5c03e5c0 0x7fba5c040ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.838+0000 7fba76a00700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba5c03e5c0 0x7fba5c040ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba64006fd0 tx=0x7fba64006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:46.843+0000 7fba6fe00700 1 -- 172.21.15.120:0/217817323 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba6801ba80 con 0x7fba7807fff0 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.079+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fba780643d0 con 0x7fba7807fff0 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.080+0000 7fba6fe00700 1 -- 172.21.15.120:0/217817323 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fba6802ca40 con 0x7fba7807fff0 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.083+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba5c03e5c0 msgr2=0x7fba5c040ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.083+0000 7fba7e600700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba5c03e5c0 0x7fba5c040ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba64006fd0 tx=0x7fba64006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.083+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 msgr2=0x7fba781a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:48.030 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.083+0000 7fba7e600700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba781a4140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba68011670 tx=0x7fba68011a30 comp rx=0 tx=0).stop 2024-05-14T09:07:48.031 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.084+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 shutdown_connections 2024-05-14T09:07:48.031 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.084+0000 7fba7e600700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba5c03e5c0 0x7fba5c040ad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:48.031 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.084+0000 7fba7e600700 1 --2- 172.21.15.120:0/217817323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba7807fff0 0x7fba781a4140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:48.031 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.084+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 >> 172.21.15.120:0/217817323 conn(0x7fba7807ef40 msgr2=0x7fba7819aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:48.031 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.084+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 shutdown_connections 2024-05-14T09:07:48.031 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:47.084+0000 7fba7e600700 1 -- 172.21.15.120:0/217817323 wait complete. 2024-05-14T09:07:48.049 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T09:07:48.049 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-05-14T09:07:48.069 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T09:07:48.070 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-05-14T09:07:48.070 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-05-14T09:07:48.070 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-14T09:07:48.073 INFO:teuthology.orchestra.run.smithi120.stdout:Ceph Dashboard is now available at: 2024-05-14T09:07:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: URL: https://smithi120.front.sepia.ceph.com:8443/ 2024-05-14T09:07:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: User: admin 2024-05-14T09:07:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: Password: cxw2q21273 2024-05-14T09:07:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:48.074 INFO:teuthology.orchestra.run.smithi120.stdout:Saving cluster configuration to /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config directory 2024-05-14T09:07:48.075 INFO:teuthology.orchestra.run.smithi120.stdout:Enabling autotune for osd_memory_target 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.194+0000 7fb9bf800700 1 Processor -- start 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.194+0000 7fb9bf800700 1 -- start start 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.195+0000 7fb9bf800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81117c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.195+0000 7fb9bf800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8111dd0 con 0x7fb9b81113b0 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.195+0000 7fb9bce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.195+0000 7fb9bce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81117c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56478/0 (socket says 172.21.15.120:56478) 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.195+0000 7fb9bce00700 1 -- 172.21.15.120:0/2066393138 learned_addr learned my addr 172.21.15.120:0/2066393138 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.196+0000 7fb9bce00700 1 -- 172.21.15.120:0/2066393138 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b810fc40 con 0x7fb9b81113b0 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.196+0000 7fb9bce00700 1 --2- 172.21.15.120:0/2066393138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81117c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098a0 tx=0x7fb9ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d96c073320f1be4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.196+0000 7fb9b7400700 1 -- 172.21.15.120:0/2066393138 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac004160 con 0x7fb9b81113b0 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.196+0000 7fb9b7400700 1 -- 172.21.15.120:0/2066393138 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9ac004300 con 0x7fb9b81113b0 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.196+0000 7fb9b7400700 1 -- 172.21.15.120:0/2066393138 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac011960 con 0x7fb9b81113b0 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.197+0000 7fb9bf800700 1 -- 172.21.15.120:0/2066393138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 msgr2=0x7fb9b81117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.197+0000 7fb9bf800700 1 --2- 172.21.15.120:0/2066393138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81117c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098a0 tx=0x7fb9ac009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.197+0000 7fb9bf800700 1 -- 172.21.15.120:0/2066393138 shutdown_connections 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.197+0000 7fb9bf800700 1 --2- 172.21.15.120:0/2066393138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81117c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.197+0000 7fb9bf800700 1 -- 172.21.15.120:0/2066393138 >> 172.21.15.120:0/2066393138 conn(0x7fb9b807efe0 msgr2=0x7fb9b8081400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.197+0000 7fb9bf800700 1 -- 172.21.15.120:0/2066393138 shutdown_connections 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.197+0000 7fb9bf800700 1 -- 172.21.15.120:0/2066393138 wait complete. 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.199+0000 7fb9bf800700 1 Processor -- start 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.199+0000 7fb9bf800700 1 -- start start 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.199+0000 7fb9bf800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.199+0000 7fb9bf800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b81143f0 con 0x7fb9b81113b0 2024-05-14T09:07:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.199+0000 7fb9bce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.199+0000 7fb9bce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56482/0 (socket says 172.21.15.120:56482) 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.199+0000 7fb9bce00700 1 -- 172.21.15.120:0/2762660029 learned_addr learned my addr 172.21.15.120:0/2762660029 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.200+0000 7fb9bce00700 1 -- 172.21.15.120:0/2762660029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b81a4810 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.200+0000 7fb9bce00700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81a42d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac000c00 tx=0x7fb9ac011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.200+0000 7fb9b5600700 1 -- 172.21.15.120:0/2762660029 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac003a60 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.200+0000 7fb9b5600700 1 -- 172.21.15.120:0/2762660029 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9ac01b8d0 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.200+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b81a4aa0 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.200+0000 7fb9b5600700 1 -- 172.21.15.120:0/2762660029 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac019760 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.201+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b81a76b0 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.202+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b8064e20 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.202+0000 7fb9b5600700 1 -- 172.21.15.120:0/2762660029 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7fb9ac019990 con 0x7fb9b81113b0 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.202+0000 7fb9b5600700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb9a003e5c0 0x7fb9a0040ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.202+0000 7fb9b5600700 1 -- 172.21.15.120:0/2762660029 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb9ac054020 con 0x7fb9b81113b0 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.203+0000 7fb9b7e00700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb9a003e5c0 0x7fb9a0040ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.203+0000 7fb9b7e00700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb9a003e5c0 0x7fb9a0040ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8006fd0 tx=0x7fb9a8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.209+0000 7fb9b5600700 1 -- 172.21.15.120:0/2762660029 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb9ac01f030 con 0x7fb9b81113b0 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.436+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fb9b81a7c10 con 0x7fb9b81113b0 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.437+0000 7fb9b5600700 1 -- 172.21.15.120:0/2762660029 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fb9ac0223b0 con 0x7fb9b81113b0 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb9a003e5c0 msgr2=0x7fb9a0040ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb9a003e5c0 0x7fb9a0040ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8006fd0 tx=0x7fb9a8006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 msgr2=0x7fb9b81a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81a42d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac000c00 tx=0x7fb9ac011a30 comp rx=0 tx=0).stop 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 shutdown_connections 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb9a003e5c0 0x7fb9a0040ad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 --2- 172.21.15.120:0/2762660029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b81113b0 0x7fb9b81a42d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 >> 172.21.15.120:0/2762660029 conn(0x7fb9b807efe0 msgr2=0x7fb9b807f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:50.131 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 shutdown_connections 2024-05-14T09:07:50.132 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:49.441+0000 7fb9bf800700 1 -- 172.21.15.120:0/2762660029 wait complete. 2024-05-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.814+0000 7f6938600700 1 Processor -- start 2024-05-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.814+0000 7f6938600700 1 -- start start 2024-05-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.815+0000 7f6938600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693010be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.815+0000 7f6938600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f693010c480 con 0x7f693010ba80 2024-05-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.815+0000 7f6935c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693010be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.815+0000 7f6935c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693010be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56484/0 (socket says 172.21.15.120:56484) 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.815+0000 7f6935c00700 1 -- 172.21.15.120:0/814034589 learned_addr learned my addr 172.21.15.120:0/814034589 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.815+0000 7f6935c00700 1 -- 172.21.15.120:0/814034589 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693010cbb0 con 0x7f693010ba80 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.816+0000 7f6935c00700 1 --2- 172.21.15.120:0/814034589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693010be90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69240098a0 tx=0x7f6924009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24bf10ee6511f6a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.816+0000 7f692fe00700 1 -- 172.21.15.120:0/814034589 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6924004160 con 0x7f693010ba80 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.816+0000 7f692fe00700 1 -- 172.21.15.120:0/814034589 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6924004300 con 0x7f693010ba80 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.816+0000 7f692fe00700 1 -- 172.21.15.120:0/814034589 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6924011960 con 0x7f693010ba80 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.817+0000 7f6938600700 1 -- 172.21.15.120:0/814034589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 msgr2=0x7f693010be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.817+0000 7f6938600700 1 --2- 172.21.15.120:0/814034589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693010be90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69240098a0 tx=0x7f6924009bb0 comp rx=0 tx=0).stop 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.817+0000 7f6938600700 1 -- 172.21.15.120:0/814034589 shutdown_connections 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.817+0000 7f6938600700 1 --2- 172.21.15.120:0/814034589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693010be90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.817+0000 7f6938600700 1 -- 172.21.15.120:0/814034589 >> 172.21.15.120:0/814034589 conn(0x7f693007ef40 msgr2=0x7f693007f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.817+0000 7f6938600700 1 -- 172.21.15.120:0/814034589 shutdown_connections 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.817+0000 7f6938600700 1 -- 172.21.15.120:0/814034589 wait complete. 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.818+0000 7f6938600700 1 Processor -- start 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.818+0000 7f6938600700 1 -- start start 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.819+0000 7f6938600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.819+0000 7f6938600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f693010ff60 con 0x7f693010ba80 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.819+0000 7f6935c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.819+0000 7f6935c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693019fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56492/0 (socket says 172.21.15.120:56492) 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.819+0000 7f6935c00700 1 -- 172.21.15.120:0/688852498 learned_addr learned my addr 172.21.15.120:0/688852498 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.819+0000 7f6935c00700 1 -- 172.21.15.120:0/688852498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69301a0320 con 0x7f693010ba80 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.820+0000 7f6935c00700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693019fde0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69240119b0 tx=0x7f6924011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.820+0000 7f692e000700 1 -- 172.21.15.120:0/688852498 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6924003aa0 con 0x7f693010ba80 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.820+0000 7f692e000700 1 -- 172.21.15.120:0/688852498 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f692401b8d0 con 0x7f693010ba80 2024-05-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.820+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69301a05b0 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.820+0000 7f692e000700 1 -- 172.21.15.120:0/688852498 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69240237d0 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.820+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69301a3180 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.821+0000 7f692e000700 1 -- 172.21.15.120:0/688852498 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f692401b440 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.821+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6930064e20 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.822+0000 7f692e000700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f691803e570 0x7f6918040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.822+0000 7f692e000700 1 -- 172.21.15.120:0/688852498 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6924054070 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.822+0000 7f6935200700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f691803e570 0x7f6918040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.823+0000 7f6935200700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f691803e570 0x7f6918040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f691c006fd0 tx=0x7f691c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:50.828+0000 7f692e000700 1 -- 172.21.15.120:0/688852498 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f692401f030 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.178+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f69301a3850 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.185+0000 7f692e000700 1 -- 172.21.15.120:0/688852498 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f692401bd80 con 0x7f693010ba80 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f691803e570 msgr2=0x7f6918040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f691803e570 0x7f6918040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f691c006fd0 tx=0x7f691c006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 msgr2=0x7f693019fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693019fde0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69240119b0 tx=0x7f6924011a90 comp rx=0 tx=0).stop 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 shutdown_connections 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f691803e570 0x7f6918040a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 --2- 172.21.15.120:0/688852498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693010ba80 0x7f693019fde0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 >> 172.21.15.120:0/688852498 conn(0x7f693007ef40 msgr2=0x7f6930108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.188+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 shutdown_connections 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-05-14T09:07:51.189+0000 7f6938600700 1 -- 172.21.15.120:0/688852498 wait complete. 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout:Or, if you are only running a single cluster on this host: 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi120.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout: ceph telemetry on 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout:For more information see: 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi120.stdout:Bootstrap complete. 2024-05-14T09:07:52.042 INFO:tasks.cephadm:Fetching config... 2024-05-14T09:07:52.043 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:07:52.043 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-14T09:07:52.099 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-14T09:07:52.099 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:07:52.099 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-14T09:07:52.140 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-14T09:07:52.140 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:07:52.141 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-14T09:07:52.236 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:52 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/688852498' entity='client.admin' 2024-05-14T09:07:52.251 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-14T09:07:52.251 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:07:52.251 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-14T09:07:52.342 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-14T09:07:52.342 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73uK4FvvSr3VyLNhNOFwszQzWauD2I1CBsKbwFQCOVCRIeegSQtFBklQ3wbjVqC/QSg9oZUS4zf9C8Y2rc75BqV8Ysy8tx2axM62PEV2lz0f7ZdrSbkgMnth8qrjILq/Wqgog0mRzz6IFP7GDonlk+2plilQ3ckdpfuHEPds8kyu97qAjD8LUH9zeVK2OAL8gpmIN6Nz3EfM+9dZluREg71V5coBSVnn0Ehsig1x0V59e3T5Ahz9mHV0F3v3t9ivTJIENWaJjf4fQzKGmu5sJOLqgGldjfIbaJ0oPT1fR0W8zTSMSb9ZkKvZGq1aOm7/VZ/Ww+flf5Zh9UPpPrmhyV1AED0YSMvvnLyrYQN6r8eTWLMIuGXEikewiYF24dvhBY8q4dwPvVWOj6J93CFUSpO7ZULNj7Y42Iw/8R4MBCwPwsN3xKy3hUWEcUuYfokZHLygcRM/Pgo3OhEPCdRhLwa2ru1Zhs0Q+ErXUDtRuwKxzPDsx0jOLnw6Xv0S60KM= ceph-15b5acb4-11d1-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T09:07:52.506 INFO:teuthology.orchestra.run.smithi120.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73uK4FvvSr3VyLNhNOFwszQzWauD2I1CBsKbwFQCOVCRIeegSQtFBklQ3wbjVqC/QSg9oZUS4zf9C8Y2rc75BqV8Ysy8tx2axM62PEV2lz0f7ZdrSbkgMnth8qrjILq/Wqgog0mRzz6IFP7GDonlk+2plilQ3ckdpfuHEPds8kyu97qAjD8LUH9zeVK2OAL8gpmIN6Nz3EfM+9dZluREg71V5coBSVnn0Ehsig1x0V59e3T5Ahz9mHV0F3v3t9ivTJIENWaJjf4fQzKGmu5sJOLqgGldjfIbaJ0oPT1fR0W8zTSMSb9ZkKvZGq1aOm7/VZ/Ww+flf5Zh9UPpPrmhyV1AED0YSMvvnLyrYQN6r8eTWLMIuGXEikewiYF24dvhBY8q4dwPvVWOj6J93CFUSpO7ZULNj7Y42Iw/8R4MBCwPwsN3xKy3hUWEcUuYfokZHLygcRM/Pgo3OhEPCdRhLwa2ru1Zhs0Q+ErXUDtRuwKxzPDsx0jOLnw6Xv0S60KM= ceph-15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:07:52.561 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73uK4FvvSr3VyLNhNOFwszQzWauD2I1CBsKbwFQCOVCRIeegSQtFBklQ3wbjVqC/QSg9oZUS4zf9C8Y2rc75BqV8Ysy8tx2axM62PEV2lz0f7ZdrSbkgMnth8qrjILq/Wqgog0mRzz6IFP7GDonlk+2plilQ3ckdpfuHEPds8kyu97qAjD8LUH9zeVK2OAL8gpmIN6Nz3EfM+9dZluREg71V5coBSVnn0Ehsig1x0V59e3T5Ahz9mHV0F3v3t9ivTJIENWaJjf4fQzKGmu5sJOLqgGldjfIbaJ0oPT1fR0W8zTSMSb9ZkKvZGq1aOm7/VZ/Ww+flf5Zh9UPpPrmhyV1AED0YSMvvnLyrYQN6r8eTWLMIuGXEikewiYF24dvhBY8q4dwPvVWOj6J93CFUSpO7ZULNj7Y42Iw/8R4MBCwPwsN3xKy3hUWEcUuYfokZHLygcRM/Pgo3OhEPCdRhLwa2ru1Zhs0Q+ErXUDtRuwKxzPDsx0jOLnw6Xv0S60KM= ceph-15b5acb4-11d1-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T09:07:52.677 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73uK4FvvSr3VyLNhNOFwszQzWauD2I1CBsKbwFQCOVCRIeegSQtFBklQ3wbjVqC/QSg9oZUS4zf9C8Y2rc75BqV8Ysy8tx2axM62PEV2lz0f7ZdrSbkgMnth8qrjILq/Wqgog0mRzz6IFP7GDonlk+2plilQ3ckdpfuHEPds8kyu97qAjD8LUH9zeVK2OAL8gpmIN6Nz3EfM+9dZluREg71V5coBSVnn0Ehsig1x0V59e3T5Ahz9mHV0F3v3t9ivTJIENWaJjf4fQzKGmu5sJOLqgGldjfIbaJ0oPT1fR0W8zTSMSb9ZkKvZGq1aOm7/VZ/Ww+flf5Zh9UPpPrmhyV1AED0YSMvvnLyrYQN6r8eTWLMIuGXEikewiYF24dvhBY8q4dwPvVWOj6J93CFUSpO7ZULNj7Y42Iw/8R4MBCwPwsN3xKy3hUWEcUuYfokZHLygcRM/Pgo3OhEPCdRhLwa2ru1Zhs0Q+ErXUDtRuwKxzPDsx0jOLnw6Xv0S60KM= ceph-15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:07:52.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73uK4FvvSr3VyLNhNOFwszQzWauD2I1CBsKbwFQCOVCRIeegSQtFBklQ3wbjVqC/QSg9oZUS4zf9C8Y2rc75BqV8Ysy8tx2axM62PEV2lz0f7ZdrSbkgMnth8qrjILq/Wqgog0mRzz6IFP7GDonlk+2plilQ3ckdpfuHEPds8kyu97qAjD8LUH9zeVK2OAL8gpmIN6Nz3EfM+9dZluREg71V5coBSVnn0Ehsig1x0V59e3T5Ahz9mHV0F3v3t9ivTJIENWaJjf4fQzKGmu5sJOLqgGldjfIbaJ0oPT1fR0W8zTSMSb9ZkKvZGq1aOm7/VZ/Ww+flf5Zh9UPpPrmhyV1AED0YSMvvnLyrYQN6r8eTWLMIuGXEikewiYF24dvhBY8q4dwPvVWOj6J93CFUSpO7ZULNj7Y42Iw/8R4MBCwPwsN3xKy3hUWEcUuYfokZHLygcRM/Pgo3OhEPCdRhLwa2ru1Zhs0Q+ErXUDtRuwKxzPDsx0jOLnw6Xv0S60KM= ceph-15b5acb4-11d1-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T09:07:52.829 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73uK4FvvSr3VyLNhNOFwszQzWauD2I1CBsKbwFQCOVCRIeegSQtFBklQ3wbjVqC/QSg9oZUS4zf9C8Y2rc75BqV8Ysy8tx2axM62PEV2lz0f7ZdrSbkgMnth8qrjILq/Wqgog0mRzz6IFP7GDonlk+2plilQ3ckdpfuHEPds8kyu97qAjD8LUH9zeVK2OAL8gpmIN6Nz3EfM+9dZluREg71V5coBSVnn0Ehsig1x0V59e3T5Ahz9mHV0F3v3t9ivTJIENWaJjf4fQzKGmu5sJOLqgGldjfIbaJ0oPT1fR0W8zTSMSb9ZkKvZGq1aOm7/VZ/Ww+flf5Zh9UPpPrmhyV1AED0YSMvvnLyrYQN6r8eTWLMIuGXEikewiYF24dvhBY8q4dwPvVWOj6J93CFUSpO7ZULNj7Y42Iw/8R4MBCwPwsN3xKy3hUWEcUuYfokZHLygcRM/Pgo3OhEPCdRhLwa2ru1Zhs0Q+ErXUDtRuwKxzPDsx0jOLnw6Xv0S60KM= ceph-15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:07:52.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-14T09:07:53.290 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.564+0000 7f9e00000700 1 -- 172.21.15.120:0/1669767386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 msgr2=0x7f9df81028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.564+0000 7f9e00000700 1 --2- 172.21.15.120:0/1669767386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df81028f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009910 tx=0x7f9dec009c20 comp rx=0 tx=0).stop 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.564+0000 7f9e00000700 1 -- 172.21.15.120:0/1669767386 shutdown_connections 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.564+0000 7f9e00000700 1 --2- 172.21.15.120:0/1669767386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df81028f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.564+0000 7f9e00000700 1 -- 172.21.15.120:0/1669767386 >> 172.21.15.120:0/1669767386 conn(0x7f9df80fe110 msgr2=0x7f9df81005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.564+0000 7f9e00000700 1 -- 172.21.15.120:0/1669767386 shutdown_connections 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.564+0000 7f9e00000700 1 -- 172.21.15.120:0/1669767386 wait complete. 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.565+0000 7f9e00000700 1 Processor -- start 2024-05-14T09:07:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.565+0000 7f9e00000700 1 -- start start 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.566+0000 7f9e00000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.566+0000 7f9e00000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9df810bc60 con 0x7f9df81024e0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.566+0000 7f9dfd600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.566+0000 7f9dfd600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56512/0 (socket says 172.21.15.120:56512) 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.566+0000 7f9dfd600700 1 -- 172.21.15.120:0/334269750 learned_addr learned my addr 172.21.15.120:0/334269750 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.566+0000 7f9dfd600700 1 -- 172.21.15.120:0/334269750 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df819bd70 con 0x7f9df81024e0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.567+0000 7f9dfd600700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df819b830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dec005120 tx=0x7f9dec005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.567+0000 7f9df6000700 1 -- 172.21.15.120:0/334269750 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec027070 con 0x7f9df81024e0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.567+0000 7f9df6000700 1 -- 172.21.15.120:0/334269750 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dec00bdf0 con 0x7f9df81024e0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.567+0000 7f9df6000700 1 -- 172.21.15.120:0/334269750 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec00fd70 con 0x7f9df81024e0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.567+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df819c000 con 0x7f9df81024e0 2024-05-14T09:07:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.567+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df819ec10 con 0x7f9df81024e0 2024-05-14T09:07:56.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.568+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df810c3e0 con 0x7f9df81024e0 2024-05-14T09:07:56.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.569+0000 7f9df6000700 1 -- 172.21.15.120:0/334269750 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f9dec00f610 con 0x7f9df81024e0 2024-05-14T09:07:56.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.570+0000 7f9df6000700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9de003e510 0x7f9de0040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:07:56.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.570+0000 7f9df6000700 1 -- 172.21.15.120:0/334269750 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9dec053ae0 con 0x7f9df81024e0 2024-05-14T09:07:56.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.570+0000 7f9dfcc00700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9de003e510 0x7f9de0040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:07:56.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.571+0000 7f9dfcc00700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9de003e510 0x7f9de0040a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9de4006fd0 tx=0x7f9de4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:07:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.576+0000 7f9df6000700 1 -- 172.21.15.120:0/334269750 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9dec013070 con 0x7f9df81024e0 2024-05-14T09:07:56.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.807+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f9df802e700 con 0x7f9df81024e0 2024-05-14T09:07:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.813+0000 7f9df6000700 1 -- 172.21.15.120:0/334269750 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f9dec0142b0 con 0x7f9df81024e0 2024-05-14T09:07:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.816+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9de003e510 msgr2=0x7f9de0040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.816+0000 7f9e00000700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9de003e510 0x7f9de0040a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9de4006fd0 tx=0x7f9de4006e40 comp rx=0 tx=0).stop 2024-05-14T09:07:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.816+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 msgr2=0x7f9df819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:07:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.816+0000 7f9e00000700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df819b830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dec005120 tx=0x7f9dec005810 comp rx=0 tx=0).stop 2024-05-14T09:07:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.817+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 shutdown_connections 2024-05-14T09:07:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.817+0000 7f9e00000700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9de003e510 0x7f9de0040a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.817+0000 7f9e00000700 1 --2- 172.21.15.120:0/334269750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df81024e0 0x7f9df819b830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:07:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.817+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 >> 172.21.15.120:0/334269750 conn(0x7f9df80fe110 msgr2=0x7f9df80fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:07:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.817+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 shutdown_connections 2024-05-14T09:07:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:07:56.817+0000 7f9e00000700 1 -- 172.21.15.120:0/334269750 wait complete. 2024-05-14T09:07:57.585 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-14T09:07:57.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-14T09:07:58.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:57 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/334269750' entity='client.admin' 2024-05-14T09:07:58.455 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:07:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi120", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:07:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:07:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:07:59.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:07:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.518+0000 7f6a4ae00700 1 -- 172.21.15.120:0/55326015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 msgr2=0x7f6a44106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.518+0000 7f6a4ae00700 1 --2- 172.21.15.120:0/55326015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a44106b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009910 tx=0x7f6a34009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.518+0000 7f6a4ae00700 1 -- 172.21.15.120:0/55326015 shutdown_connections 2024-05-14T09:08:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.518+0000 7f6a4ae00700 1 --2- 172.21.15.120:0/55326015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a44106b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.518+0000 7f6a4ae00700 1 -- 172.21.15.120:0/55326015 >> 172.21.15.120:0/55326015 conn(0x7f6a440fe130 msgr2=0x7f6a441005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.519+0000 7f6a4ae00700 1 -- 172.21.15.120:0/55326015 shutdown_connections 2024-05-14T09:08:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.519+0000 7f6a4ae00700 1 -- 172.21.15.120:0/55326015 wait complete. 2024-05-14T09:08:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.520+0000 7f6a4ae00700 1 Processor -- start 2024-05-14T09:08:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.520+0000 7f6a4ae00700 1 -- start start 2024-05-14T09:08:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.520+0000 7f6a4ae00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a4419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.520+0000 7f6a4ae00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a44109a40 con 0x7f6a44104730 2024-05-14T09:08:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.521+0000 7f6a43e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a4419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.521+0000 7f6a43e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a4419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32980/0 (socket says 172.21.15.120:32980) 2024-05-14T09:08:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.521+0000 7f6a43e00700 1 -- 172.21.15.120:0/3889882584 learned_addr learned my addr 172.21.15.120:0/3889882584 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:08:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.521+0000 7f6a43e00700 1 -- 172.21.15.120:0/3889882584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4419bdb0 con 0x7f6a44104730 2024-05-14T09:08:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.521+0000 7f6a43e00700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a4419b870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005120 tx=0x7f6a34005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.522+0000 7f6a40c00700 1 -- 172.21.15.120:0/3889882584 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a34027070 con 0x7f6a44104730 2024-05-14T09:08:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.522+0000 7f6a40c00700 1 -- 172.21.15.120:0/3889882584 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a3400bdf0 con 0x7f6a44104730 2024-05-14T09:08:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.522+0000 7f6a40c00700 1 -- 172.21.15.120:0/3889882584 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a3400fd70 con 0x7f6a44104730 2024-05-14T09:08:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.522+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4419c040 con 0x7f6a44104730 2024-05-14T09:08:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.522+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4419ec50 con 0x7f6a44104730 2024-05-14T09:08:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.523+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4410a1c0 con 0x7f6a44104730 2024-05-14T09:08:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.524+0000 7f6a40c00700 1 -- 172.21.15.120:0/3889882584 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f6a3402a070 con 0x7f6a44104730 2024-05-14T09:08:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.524+0000 7f6a40c00700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6a2803e570 0x7f6a28040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.524+0000 7f6a40c00700 1 -- 172.21.15.120:0/3889882584 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6a340539c0 con 0x7f6a44104730 2024-05-14T09:08:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.524+0000 7f6a43400700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6a2803e570 0x7f6a28040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.525+0000 7f6a43400700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6a2803e570 0x7f6a28040a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a30006fd0 tx=0x7f6a30006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:00.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.530+0000 7f6a40c00700 1 -- 172.21.15.120:0/3889882584 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6a34013070 con 0x7f6a44104730 2024-05-14T09:08:00.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.763+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f6a4402e700 con 0x7f6a2803e570 2024-05-14T09:08:00.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.773+0000 7f6a40c00700 1 -- 172.21.15.120:0/3889882584 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6a4402e700 con 0x7f6a2803e570 2024-05-14T09:08:00.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6a2803e570 msgr2=0x7f6a28040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:00.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6a2803e570 0x7f6a28040a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a30006fd0 tx=0x7f6a30006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:00.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 msgr2=0x7f6a4419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:00.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a4419b870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005120 tx=0x7f6a34005810 comp rx=0 tx=0).stop 2024-05-14T09:08:00.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 shutdown_connections 2024-05-14T09:08:00.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6a2803e570 0x7f6a28040a80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:00.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 --2- 172.21.15.120:0/3889882584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a44104730 0x7f6a4419b870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:00.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 >> 172.21.15.120:0/3889882584 conn(0x7f6a440fe130 msgr2=0x7f6a441005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:00.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 shutdown_connections 2024-05-14T09:08:00.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:00.776+0000 7f6a4ae00700 1 -- 172.21.15.120:0/3889882584 wait complete. 2024-05-14T09:08:01.502 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2024-05-14T09:08:01.503 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:08:01.503 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2024-05-14T09:08:01.559 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:08:01.559 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:01.653 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2024-05-14T09:08:01.653 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch host add smithi152 2024-05-14T09:08:02.055 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:08:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:01 smithi120 ceph-mon[31085]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:01 smithi120 ceph-mon[31085]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:08:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:08:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:01 smithi120 ceph-mon[31085]: Updating smithi120:/etc/ceph/ceph.conf 2024-05-14T09:08:03.038 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:02 smithi120 ceph-mon[31085]: Updating smithi120:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:03.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:03 smithi120 ceph-mon[31085]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:03.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:03 smithi120 ceph-mon[31085]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:03.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:03 smithi120 ceph-mon[31085]: Updating smithi120:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T09:08:03.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:03.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:03.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:04.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.166+0000 7f2ea1200700 1 -- 172.21.15.120:0/1530901209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 msgr2=0x7f2e9c105120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:04.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.166+0000 7f2ea1200700 1 --2- 172.21.15.120:0/1530901209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c105120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009910 tx=0x7f2e8c009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:04.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.166+0000 7f2ea1200700 1 -- 172.21.15.120:0/1530901209 shutdown_connections 2024-05-14T09:08:04.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.166+0000 7f2ea1200700 1 --2- 172.21.15.120:0/1530901209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c105120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:04.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.166+0000 7f2ea1200700 1 -- 172.21.15.120:0/1530901209 >> 172.21.15.120:0/1530901209 conn(0x7f2e9c0fe560 msgr2=0x7f2e9c1009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.166+0000 7f2ea1200700 1 -- 172.21.15.120:0/1530901209 shutdown_connections 2024-05-14T09:08:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.166+0000 7f2ea1200700 1 -- 172.21.15.120:0/1530901209 wait complete. 2024-05-14T09:08:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.167+0000 7f2ea1200700 1 Processor -- start 2024-05-14T09:08:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.168+0000 7f2ea1200700 1 -- start start 2024-05-14T09:08:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.168+0000 7f2ea1200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.168+0000 7f2ea1200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c10dfb0 con 0x7f2e9c104d10 2024-05-14T09:08:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.168+0000 7f2e99e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.168+0000 7f2e99e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c1a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32988/0 (socket says 172.21.15.120:32988) 2024-05-14T09:08:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.168+0000 7f2e99e00700 1 -- 172.21.15.120:0/2069212933 learned_addr learned my addr 172.21.15.120:0/2069212933 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:08:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.169+0000 7f2e99e00700 1 -- 172.21.15.120:0/2069212933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c1a1c40 con 0x7f2e9c104d10 2024-05-14T09:08:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.169+0000 7f2e99e00700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c1a1700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c005660 tx=0x7f2e8c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:04.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.170+0000 7f2e92a00700 1 -- 172.21.15.120:0/2069212933 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c026070 con 0x7f2e9c104d10 2024-05-14T09:08:04.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.170+0000 7f2e92a00700 1 -- 172.21.15.120:0/2069212933 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e8c00b750 con 0x7f2e9c104d10 2024-05-14T09:08:04.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.170+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9c1a1ed0 con 0x7f2e9c104d10 2024-05-14T09:08:04.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.170+0000 7f2e92a00700 1 -- 172.21.15.120:0/2069212933 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c003810 con 0x7f2e9c104d10 2024-05-14T09:08:04.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.170+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9c19b920 con 0x7f2e9c104d10 2024-05-14T09:08:04.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.171+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9c06c110 con 0x7f2e9c104d10 2024-05-14T09:08:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.171+0000 7f2e92a00700 1 -- 172.21.15.120:0/2069212933 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f2e8c029070 con 0x7f2e9c104d10 2024-05-14T09:08:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.172+0000 7f2e92a00700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e8003e570 0x7f2e80040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.172+0000 7f2e92a00700 1 -- 172.21.15.120:0/2069212933 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2e8c01e070 con 0x7f2e9c104d10 2024-05-14T09:08:04.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.172+0000 7f2e99400700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e8003e570 0x7f2e80040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:04.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.173+0000 7f2e99400700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e8003e570 0x7f2e80040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2e88006fd0 tx=0x7f2e88006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:04.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.178+0000 7f2e92a00700 1 -- 172.21.15.120:0/2069212933 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e8c013070 con 0x7f2e9c104d10 2024-05-14T09:08:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:04.416+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) -- 0x7f2e9c19ce50 con 0x7f2e8003e570 2024-05-14T09:08:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:05 smithi120 ceph-mon[31085]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:05 smithi120 ceph-mon[31085]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:07.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:06 smithi120 ceph-mon[31085]: Deploying cephadm binary to smithi152 2024-05-14T09:08:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:07 smithi120 ceph-mon[31085]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:09 smithi120 ceph-mon[31085]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:10.412 INFO:teuthology.orchestra.run.smithi120.stdout:Added host 'smithi152' with addr '172.21.15.152' 2024-05-14T09:08:10.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.411+0000 7f2e92a00700 1 -- 172.21.15.120:0/2069212933 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2e9c19ce50 con 0x7f2e8003e570 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e8003e570 msgr2=0x7f2e80040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e8003e570 0x7f2e80040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2e88006fd0 tx=0x7f2e88006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 msgr2=0x7f2e9c1a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c1a1700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c005660 tx=0x7f2e8c005740 comp rx=0 tx=0).stop 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 shutdown_connections 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e8003e570 0x7f2e80040a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 --2- 172.21.15.120:0/2069212933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9c104d10 0x7f2e9c1a1700 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 >> 172.21.15.120:0/2069212933 conn(0x7f2e9c0fe560 msgr2=0x7f2e9c109e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:10.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 shutdown_connections 2024-05-14T09:08:10.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:10.415+0000 7f2ea1200700 1 -- 172.21.15.120:0/2069212933 wait complete. 2024-05-14T09:08:11.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-14T09:08:11.578 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:08:11.729 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:11 smithi120 ceph-mon[31085]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:11.729 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:11.729 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:11 smithi120 ceph-mon[31085]: Added host smithi152 2024-05-14T09:08:11.729 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:08:11.729 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:13.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:13 smithi120 ceph-mon[31085]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:13.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.586+0000 7f4b02600700 1 -- 172.21.15.120:0/1306531124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 msgr2=0x7f4afc10a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.586+0000 7f4b02600700 1 --2- 172.21.15.120:0/1306531124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc10a850 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009910 tx=0x7f4aec009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.587+0000 7f4b02600700 1 -- 172.21.15.120:0/1306531124 shutdown_connections 2024-05-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.587+0000 7f4b02600700 1 --2- 172.21.15.120:0/1306531124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc10a850 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.587+0000 7f4b02600700 1 -- 172.21.15.120:0/1306531124 >> 172.21.15.120:0/1306531124 conn(0x7f4afc079960 msgr2=0x7f4afc1085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.587+0000 7f4b02600700 1 -- 172.21.15.120:0/1306531124 shutdown_connections 2024-05-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.587+0000 7f4b02600700 1 -- 172.21.15.120:0/1306531124 wait complete. 2024-05-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.588+0000 7f4b02600700 1 Processor -- start 2024-05-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.588+0000 7f4b02600700 1 -- start start 2024-05-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.589+0000 7f4b02600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.589+0000 7f4b02600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc114590 con 0x7f4afc10a440 2024-05-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.589+0000 7f4afb400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.589+0000 7f4afb400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc19fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50708/0 (socket says 172.21.15.120:50708) 2024-05-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.589+0000 7f4afb400700 1 -- 172.21.15.120:0/537702075 learned_addr learned my addr 172.21.15.120:0/537702075 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.590+0000 7f4afb400700 1 -- 172.21.15.120:0/537702075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc1a0380 con 0x7f4afc10a440 2024-05-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.590+0000 7f4afb400700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc19fe40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4aec006010 tx=0x7f4aec005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.590+0000 7f4af3e00700 1 -- 172.21.15.120:0/537702075 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aec026070 con 0x7f4afc10a440 2024-05-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.590+0000 7f4af3e00700 1 -- 172.21.15.120:0/537702075 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aec00b6f0 con 0x7f4afc10a440 2024-05-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.590+0000 7f4af3e00700 1 -- 172.21.15.120:0/537702075 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aec003810 con 0x7f4afc10a440 2024-05-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.590+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc1a0670 con 0x7f4afc10a440 2024-05-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.591+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc1a4670 con 0x7f4afc10a440 2024-05-14T09:08:13.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.592+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4afc10b8a0 con 0x7f4afc10a440 2024-05-14T09:08:13.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.592+0000 7f4af3e00700 1 -- 172.21.15.120:0/537702075 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f4aec029070 con 0x7f4afc10a440 2024-05-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.592+0000 7f4af3e00700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ae003e510 0x7f4ae0040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.593+0000 7f4af3e00700 1 -- 172.21.15.120:0/537702075 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4aec01e070 con 0x7f4afc10a440 2024-05-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.593+0000 7f4afaa00700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ae003e510 0x7f4ae0040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:13.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.593+0000 7f4afaa00700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ae003e510 0x7f4ae0040a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8006fd0 tx=0x7f4ae8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:13.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.599+0000 7f4af3e00700 1 -- 172.21.15.120:0/537702075 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4aec013070 con 0x7f4afc10a440 2024-05-14T09:08:13.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.836+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4afc1a11a0 con 0x7f4ae003e510 2024-05-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.839+0000 7f4af3e00700 1 -- 172.21.15.120:0/537702075 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f4afc1a11a0 con 0x7f4ae003e510 2024-05-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi120.stdout:[{"addr": "172.21.15.120", "hostname": "smithi120", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2024-05-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ae003e510 msgr2=0x7f4ae0040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ae003e510 0x7f4ae0040a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8006fd0 tx=0x7f4ae8006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 msgr2=0x7f4afc19fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc19fe40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4aec006010 tx=0x7f4aec005710 comp rx=0 tx=0).stop 2024-05-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 shutdown_connections 2024-05-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ae003e510 0x7f4ae0040a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 --2- 172.21.15.120:0/537702075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4afc10a440 0x7f4afc19fe40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.842+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 >> 172.21.15.120:0/537702075 conn(0x7f4afc079960 msgr2=0x7f4afc10bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.843+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 shutdown_connections 2024-05-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:13.843+0000 7f4b02600700 1 -- 172.21.15.120:0/537702075 wait complete. 2024-05-14T09:08:14.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:14 smithi120 ceph-mon[31085]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:08:14.614 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-05-14T09:08:14.614 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:08:14.614 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-05-14T09:08:14.669 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:08:14.670 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:14.766 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-05-14T09:08:14.766 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch host add smithi175 2024-05-14T09:08:15.215 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:08:15.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:15 smithi120 ceph-mon[31085]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:15.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:17.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.289+0000 7fbab6a00700 1 -- 172.21.15.120:0/4032570893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 msgr2=0x7fbab0104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:17.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.289+0000 7fbab6a00700 1 --2- 172.21.15.120:0/4032570893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab0104200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009910 tx=0x7fbaa0009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:17.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.289+0000 7fbab6a00700 1 -- 172.21.15.120:0/4032570893 shutdown_connections 2024-05-14T09:08:17.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.289+0000 7fbab6a00700 1 --2- 172.21.15.120:0/4032570893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab0104200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:17.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.289+0000 7fbab6a00700 1 -- 172.21.15.120:0/4032570893 >> 172.21.15.120:0/4032570893 conn(0x7fbab00ff6a0 msgr2=0x7fbab0101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:17.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.289+0000 7fbab6a00700 1 -- 172.21.15.120:0/4032570893 shutdown_connections 2024-05-14T09:08:17.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.289+0000 7fbab6a00700 1 -- 172.21.15.120:0/4032570893 wait complete. 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.290+0000 7fbab6a00700 1 Processor -- start 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.290+0000 7fbab6a00700 1 -- start start 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.291+0000 7fbab6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.291+0000 7fbab6a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbab010df90 con 0x7fbab0103df0 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.291+0000 7fbaafe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.291+0000 7fbaafe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab019f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50728/0 (socket says 172.21.15.120:50728) 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.291+0000 7fbaafe00700 1 -- 172.21.15.120:0/694763875 learned_addr learned my addr 172.21.15.120:0/694763875 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:08:17.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.292+0000 7fbaafe00700 1 -- 172.21.15.120:0/694763875 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab019fa90 con 0x7fbab0103df0 2024-05-14T09:08:17.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.292+0000 7fbaafe00700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab019f550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0006010 tx=0x7fbaa0005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:17.292 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:17 smithi120 ceph-mon[31085]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:17.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.292+0000 7fbaacc00700 1 -- 172.21.15.120:0/694763875 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa0026070 con 0x7fbab0103df0 2024-05-14T09:08:17.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.292+0000 7fbaacc00700 1 -- 172.21.15.120:0/694763875 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbaa000b6f0 con 0x7fbab0103df0 2024-05-14T09:08:17.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.292+0000 7fbaacc00700 1 -- 172.21.15.120:0/694763875 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa0003810 con 0x7fbab0103df0 2024-05-14T09:08:17.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.292+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab019fd80 con 0x7fbab0103df0 2024-05-14T09:08:17.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.293+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab01998b0 con 0x7fbab0103df0 2024-05-14T09:08:17.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.294+0000 7fbaacc00700 1 -- 172.21.15.120:0/694763875 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7fbaa0029070 con 0x7fbab0103df0 2024-05-14T09:08:17.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.294+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab01052a0 con 0x7fbab0103df0 2024-05-14T09:08:17.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.295+0000 7fbaacc00700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba9403e510 0x7fba94040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:17.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.295+0000 7fbaacc00700 1 -- 172.21.15.120:0/694763875 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbaa001e070 con 0x7fbab0103df0 2024-05-14T09:08:17.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.295+0000 7fbaaf400700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba9403e510 0x7fba94040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:17.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.296+0000 7fbaaf400700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba9403e510 0x7fba94040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006fd0 tx=0x7fba9c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:17.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.301+0000 7fbaacc00700 1 -- 172.21.15.120:0/694763875 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbaa0013070 con 0x7fbab0103df0 2024-05-14T09:08:17.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:17.539+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}) -- 0x7fbab019ac50 con 0x7fba9403e510 2024-05-14T09:08:18.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:18 smithi120 ceph-mon[31085]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:19.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:19 smithi120 ceph-mon[31085]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:19.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:19 smithi120 ceph-mon[31085]: Deploying cephadm binary to smithi175 2024-05-14T09:08:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:20.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:20.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:08:20.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:20.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:08:20.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:20 smithi120 ceph-mon[31085]: Updating smithi152:/etc/ceph/ceph.conf 2024-05-14T09:08:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:21 smithi120 ceph-mon[31085]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.636+0000 7fbaacc00700 1 -- 172.21.15.120:0/694763875 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fbab019ac50 con 0x7fba9403e510 2024-05-14T09:08:23.638 INFO:teuthology.orchestra.run.smithi120.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-05-14T09:08:23.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba9403e510 msgr2=0x7fba94040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:23.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba9403e510 0x7fba94040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006fd0 tx=0x7fba9c006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:23.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 msgr2=0x7fbab019f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:23.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab019f550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0006010 tx=0x7fbaa0005710 comp rx=0 tx=0).stop 2024-05-14T09:08:23.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 shutdown_connections 2024-05-14T09:08:23.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba9403e510 0x7fba94040a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:23.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 --2- 172.21.15.120:0/694763875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbab0103df0 0x7fbab019f550 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:23.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.641+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 >> 172.21.15.120:0/694763875 conn(0x7fbab00ff6a0 msgr2=0x7fbab0109920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:23.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.642+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 shutdown_connections 2024-05-14T09:08:23.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:23.642+0000 7fbab6a00700 1 -- 172.21.15.120:0/694763875 wait complete. 2024-05-14T09:08:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:23 smithi120 ceph-mon[31085]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:24.392 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-14T09:08:24.821 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:08:24.968 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:24 smithi120 ceph-mon[31085]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:24.968 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:24 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:24.968 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:24 smithi120 ceph-mon[31085]: Added host smithi175 2024-05-14T09:08:24.968 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:24 smithi120 ceph-mon[31085]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:25.981 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:25 smithi120 ceph-mon[31085]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:25.981 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:25 smithi120 ceph-mon[31085]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T09:08:25.981 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:25.981 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:25.981 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:26.697 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:26 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:08:26.698 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:26 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.938+0000 7f0356800700 1 -- 172.21.15.120:0/450520002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 msgr2=0x7f0350076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.938+0000 7f0356800700 1 --2- 172.21.15.120:0/450520002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f0350076140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0340009910 tx=0x7f0340009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.938+0000 7f0356800700 1 -- 172.21.15.120:0/450520002 shutdown_connections 2024-05-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.938+0000 7f0356800700 1 --2- 172.21.15.120:0/450520002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f0350076140 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.938+0000 7f0356800700 1 -- 172.21.15.120:0/450520002 >> 172.21.15.120:0/450520002 conn(0x7f03500ff6a0 msgr2=0x7f0350101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.938+0000 7f0356800700 1 -- 172.21.15.120:0/450520002 shutdown_connections 2024-05-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.938+0000 7f0356800700 1 -- 172.21.15.120:0/450520002 wait complete. 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.939+0000 7f0356800700 1 Processor -- start 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.939+0000 7f0356800700 1 -- start start 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.940+0000 7f0356800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f03501a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.940+0000 7f0356800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f03501101d0 con 0x7f0350075d30 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.940+0000 7f034f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f03501a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.940+0000 7f034f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f03501a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34650/0 (socket says 172.21.15.120:34650) 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.940+0000 7f034f400700 1 -- 172.21.15.120:0/1097174513 learned_addr learned my addr 172.21.15.120:0/1097174513 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.940+0000 7f034f400700 1 -- 172.21.15.120:0/1097174513 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03501a1c40 con 0x7f0350075d30 2024-05-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.941+0000 7f034f400700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f03501a1700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0340006010 tx=0x7f0340005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.941+0000 7f034cc00700 1 -- 172.21.15.120:0/1097174513 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340026070 con 0x7f0350075d30 2024-05-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.941+0000 7f034cc00700 1 -- 172.21.15.120:0/1097174513 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f034000b750 con 0x7f0350075d30 2024-05-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.941+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03501a1ed0 con 0x7f0350075d30 2024-05-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.941+0000 7f034cc00700 1 -- 172.21.15.120:0/1097174513 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03400038a0 con 0x7f0350075d30 2024-05-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.941+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035019b920 con 0x7f0350075d30 2024-05-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.942+0000 7f034cc00700 1 -- 172.21.15.120:0/1097174513 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f0340029070 con 0x7f0350075d30 2024-05-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.943+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03500772a0 con 0x7f0350075d30 2024-05-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.943+0000 7f034cc00700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f033403e570 0x7f0334040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.943+0000 7f034cc00700 1 -- 172.21.15.120:0/1097174513 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f034001e070 con 0x7f0350075d30 2024-05-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.943+0000 7f0346a00700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f033403e570 0x7f0334040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.944+0000 7f0346a00700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f033403e570 0x7f0334040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0338006fd0 tx=0x7f0338006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:26.949+0000 7f034cc00700 1 -- 172.21.15.120:0/1097174513 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0340013070 con 0x7f0350075d30 2024-05-14T09:08:27.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.186+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f035019ce50 con 0x7f033403e570 2024-05-14T09:08:27.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.189+0000 7f034cc00700 1 -- 172.21.15.120:0/1097174513 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f035019ce50 con 0x7f033403e570 2024-05-14T09:08:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:08:27.190 INFO:teuthology.orchestra.run.smithi120.stdout:[{"addr": "172.21.15.120", "hostname": "smithi120", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f033403e570 msgr2=0x7f0334040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f033403e570 0x7f0334040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0338006fd0 tx=0x7f0338006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 msgr2=0x7f03501a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f03501a1700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0340006010 tx=0x7f0340005710 comp rx=0 tx=0).stop 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 shutdown_connections 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f033403e570 0x7f0334040a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 --2- 172.21.15.120:0/1097174513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0350075d30 0x7f03501a1700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 >> 172.21.15.120:0/1097174513 conn(0x7f03500ff6a0 msgr2=0x7f035010c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 shutdown_connections 2024-05-14T09:08:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:27.192+0000 7f0356800700 1 -- 172.21.15.120:0/1097174513 wait complete. 2024-05-14T09:08:27.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:27 smithi120 ceph-mon[31085]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:27.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:27.905 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-14T09:08:27.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd crush tunables default 2024-05-14T09:08:28.329 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:08:28.821 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:28 smithi120 ceph-mon[31085]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:08:30.006 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:29 smithi120 ceph-mon[31085]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:30.006 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.562+0000 7f1818600700 1 -- 172.21.15.120:0/653061377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 msgr2=0x7f1810106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.562+0000 7f1818600700 1 --2- 172.21.15.120:0/653061377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f1810106410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1804009910 tx=0x7f1804009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.562+0000 7f1818600700 1 -- 172.21.15.120:0/653061377 shutdown_connections 2024-05-14T09:08:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.562+0000 7f1818600700 1 --2- 172.21.15.120:0/653061377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f1810106410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.562+0000 7f1818600700 1 -- 172.21.15.120:0/653061377 >> 172.21.15.120:0/653061377 conn(0x7f1810101890 msgr2=0x7f1810103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.562+0000 7f1818600700 1 -- 172.21.15.120:0/653061377 shutdown_connections 2024-05-14T09:08:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.562+0000 7f1818600700 1 -- 172.21.15.120:0/653061377 wait complete. 2024-05-14T09:08:30.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.563+0000 7f1818600700 1 Processor -- start 2024-05-14T09:08:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.563+0000 7f1818600700 1 -- start start 2024-05-14T09:08:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.564+0000 7f1818600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f18101a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.564+0000 7f1818600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f18101101a0 con 0x7f1810106000 2024-05-14T09:08:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.564+0000 7f1815c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f18101a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.564+0000 7f1815c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f18101a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51104/0 (socket says 172.21.15.120:51104) 2024-05-14T09:08:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.564+0000 7f1815c00700 1 -- 172.21.15.120:0/1438827831 learned_addr learned my addr 172.21.15.120:0/1438827831 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:08:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.564+0000 7f1815c00700 1 -- 172.21.15.120:0/1438827831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18101a1bb0 con 0x7f1810106000 2024-05-14T09:08:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.565+0000 7f1815c00700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f18101a1670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1804006010 tx=0x7f1804005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.565+0000 7f180e000700 1 -- 172.21.15.120:0/1438827831 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1804026070 con 0x7f1810106000 2024-05-14T09:08:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.565+0000 7f180e000700 1 -- 172.21.15.120:0/1438827831 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f180400b6f0 con 0x7f1810106000 2024-05-14T09:08:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.565+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18101a1ea0 con 0x7f1810106000 2024-05-14T09:08:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.565+0000 7f180e000700 1 -- 172.21.15.120:0/1438827831 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1804003810 con 0x7f1810106000 2024-05-14T09:08:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.565+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181019b890 con 0x7f1810106000 2024-05-14T09:08:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.566+0000 7f180e000700 1 -- 172.21.15.120:0/1438827831 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f1804029070 con 0x7f1810106000 2024-05-14T09:08:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.566+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18101074b0 con 0x7f1810106000 2024-05-14T09:08:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.567+0000 7f180e000700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17f803e510 0x7f17f8040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.567+0000 7f180e000700 1 -- 172.21.15.120:0/1438827831 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f180401e070 con 0x7f1810106000 2024-05-14T09:08:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.567+0000 7f1815200700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17f803e510 0x7f17f8040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.568+0000 7f1815200700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17f803e510 0x7f17f8040a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1800006fd0 tx=0x7f1800006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:30.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.573+0000 7f180e000700 1 -- 172.21.15.120:0/1438827831 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1804013070 con 0x7f1810106000 2024-05-14T09:08:30.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:30.815+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f181019cdc0 con 0x7f1810106000 2024-05-14T09:08:31.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.666+0000 7f180e000700 1 -- 172.21.15.120:0/1438827831 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f180400e3e0 con 0x7f1810106000 2024-05-14T09:08:31.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17f803e510 msgr2=0x7f17f8040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17f803e510 0x7f17f8040a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1800006fd0 tx=0x7f1800006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 msgr2=0x7f18101a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f18101a1670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1804006010 tx=0x7f1804005710 comp rx=0 tx=0).stop 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 shutdown_connections 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17f803e510 0x7f17f8040a20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 --2- 172.21.15.120:0/1438827831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1810106000 0x7f18101a1670 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 >> 172.21.15.120:0/1438827831 conn(0x7f1810101890 msgr2=0x7f1810103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 shutdown_connections 2024-05-14T09:08:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:08:31.671+0000 7f1818600700 1 -- 172.21.15.120:0/1438827831 wait complete. 2024-05-14T09:08:31.673 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-05-14T09:08:32.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:31 smithi120 ceph-mon[31085]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:32.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:31 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1438827831' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T09:08:32.479 INFO:tasks.cephadm:Adding mon.a on smithi120 2024-05-14T09:08:32.480 INFO:tasks.cephadm:Adding mon.b on smithi152 2024-05-14T09:08:32.480 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-05-14T09:08:32.480 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch apply mon '3;smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c' 2024-05-14T09:08:32.905 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-14T09:08:33.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:32 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1438827831' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T09:08:33.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:32 smithi120 ceph-mon[31085]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:08:34.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:33 smithi120 ceph-mon[31085]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.703+0000 7f6f9f600700 1 -- 172.21.15.175:0/2873992471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 msgr2=0x7f6f98106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.703+0000 7f6f9f600700 1 --2- 172.21.15.175:0/2873992471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98106b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009910 tx=0x7f6f8c009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.703+0000 7f6f9f600700 1 -- 172.21.15.175:0/2873992471 shutdown_connections 2024-05-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.703+0000 7f6f9f600700 1 --2- 172.21.15.175:0/2873992471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98106b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.703+0000 7f6f9f600700 1 -- 172.21.15.175:0/2873992471 >> 172.21.15.175:0/2873992471 conn(0x7f6f980fe170 msgr2=0x7f6f98100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.703+0000 7f6f9f600700 1 -- 172.21.15.175:0/2873992471 shutdown_connections 2024-05-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.703+0000 7f6f9f600700 1 -- 172.21.15.175:0/2873992471 wait complete. 2024-05-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.705+0000 7f6f9f600700 1 Processor -- start 2024-05-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.705+0000 7f6f9f600700 1 -- start start 2024-05-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.705+0000 7f6f9f600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.705+0000 7f6f9f600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98109a80 con 0x7f6f98104710 2024-05-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.706+0000 7f6f9cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.706+0000 7f6f9cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.175:46248/0 (socket says 172.21.15.175:46248) 2024-05-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.706+0000 7f6f9cc00700 1 -- 172.21.15.175:0/3799411227 learned_addr learned my addr 172.21.15.175:0/3799411227 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.707+0000 7f6f9cc00700 1 -- 172.21.15.175:0/3799411227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f98199b90 con 0x7f6f98104710 2024-05-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.707+0000 7f6f9cc00700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98199650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c005120 tx=0x7f6f8c005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.708+0000 7f6f95600700 1 -- 172.21.15.175:0/3799411227 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c027070 con 0x7f6f98104710 2024-05-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.708+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f98199e20 con 0x7f6f98104710 2024-05-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.708+0000 7f6f95600700 1 -- 172.21.15.175:0/3799411227 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f8c00bdf0 con 0x7f6f98104710 2024-05-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.708+0000 7f6f95600700 1 -- 172.21.15.175:0/3799411227 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c00fd70 con 0x7f6f98104710 2024-05-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.708+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9819ca30 con 0x7f6f98104710 2024-05-14T09:08:35.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.709+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9810a200 con 0x7f6f98104710 2024-05-14T09:08:35.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.710+0000 7f6f95600700 1 -- 172.21.15.175:0/3799411227 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f6f8c02a070 con 0x7f6f98104710 2024-05-14T09:08:35.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.710+0000 7f6f95600700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f8003e570 0x7f6f80040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:35.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.710+0000 7f6f95600700 1 -- 172.21.15.175:0/3799411227 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6f8c0538c0 con 0x7f6f98104710 2024-05-14T09:08:35.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.711+0000 7f6f97e00700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f8003e570 0x7f6f80040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:35.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.712+0000 7f6f97e00700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f8003e570 0x7f6f80040a80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f84006fd0 tx=0x7f6f84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:35.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.728+0000 7f6f95600700 1 -- 172.21.15.175:0/3799411227 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6f8c013070 con 0x7f6f98104710 2024-05-14T09:08:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:08:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:08:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:35 smithi120 ceph-mon[31085]: Updating smithi175:/etc/ceph/ceph.conf 2024-05-14T09:08:35.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.973+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}) -- 0x7f6f9802e880 con 0x7f6f8003e570 2024-05-14T09:08:35.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.992+0000 7f6f95600700 1 -- 172.21.15.175:0/3799411227 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6f9802e880 con 0x7f6f8003e570 2024-05-14T09:08:35.992 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-05-14T09:08:35.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f8003e570 msgr2=0x7f6f80040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:35.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f8003e570 0x7f6f80040a80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f84006fd0 tx=0x7f6f84006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:35.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 msgr2=0x7f6f98199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:35.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98199650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c005120 tx=0x7f6f8c005810 comp rx=0 tx=0).stop 2024-05-14T09:08:35.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 shutdown_connections 2024-05-14T09:08:35.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f8003e570 0x7f6f80040a80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:35.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 --2- 172.21.15.175:0/3799411227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f98104710 0x7f6f98199650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:35.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 >> 172.21.15.175:0/3799411227 conn(0x7f6f980fe170 msgr2=0x7f6f980feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:35.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 shutdown_connections 2024-05-14T09:08:35.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:35.995+0000 7f6f9f600700 1 -- 172.21.15.175:0/3799411227 wait complete. 2024-05-14T09:08:36.735 DEBUG:teuthology.orchestra.run.smithi152:mon.b> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.b.service 2024-05-14T09:08:36.744 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.c.service 2024-05-14T09:08:36.748 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T09:08:36.748 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T09:08:36.817 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:36 smithi120 ceph-mon[31085]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:36.817 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:37.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: Saving service mon spec with placement smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c;count:3 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:08:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:38.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:38 smithi120 ceph-mon[31085]: Deploying daemon mon.c on smithi175 2024-05-14T09:08:39.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.688+0000 7f2241c00700 1 -- 172.21.15.175:0/470698289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 msgr2=0x7f223c104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:39.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.688+0000 7f2241c00700 1 --2- 172.21.15.175:0/470698289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c104f40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f222c009910 tx=0x7f222c009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:39.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.688+0000 7f2241c00700 1 -- 172.21.15.175:0/470698289 shutdown_connections 2024-05-14T09:08:39.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.688+0000 7f2241c00700 1 --2- 172.21.15.175:0/470698289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c104f40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:39.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.688+0000 7f2241c00700 1 -- 172.21.15.175:0/470698289 >> 172.21.15.175:0/470698289 conn(0x7f223c0fe3c0 msgr2=0x7f223c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:39.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.689+0000 7f2241c00700 1 -- 172.21.15.175:0/470698289 shutdown_connections 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.689+0000 7f2241c00700 1 -- 172.21.15.175:0/470698289 wait complete. 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.690+0000 7f2241c00700 1 Processor -- start 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.690+0000 7f2241c00700 1 -- start start 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.690+0000 7f2241c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.690+0000 7f2241c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f223c10ddd0 con 0x7f223c104b30 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.691+0000 7f223be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c1a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.691+0000 7f223be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c1a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.175:46274/0 (socket says 172.21.15.175:46274) 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.691+0000 7f223be00700 1 -- 172.21.15.175:0/1584888802 learned_addr learned my addr 172.21.15.175:0/1584888802 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.692+0000 7f223be00700 1 -- 172.21.15.175:0/1584888802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c1a1b10 con 0x7f223c104b30 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.692+0000 7f223be00700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c1a15d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f222c005660 tx=0x7f222c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.692+0000 7f2238c00700 1 -- 172.21.15.175:0/1584888802 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f222c026070 con 0x7f223c104b30 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.693+0000 7f2238c00700 1 -- 172.21.15.175:0/1584888802 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f222c00b750 con 0x7f223c104b30 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.693+0000 7f2238c00700 1 -- 172.21.15.175:0/1584888802 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f222c0037b0 con 0x7f223c104b30 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.693+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c1a1da0 con 0x7f223c104b30 2024-05-14T09:08:39.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.693+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c19b760 con 0x7f223c104b30 2024-05-14T09:08:39.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.694+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223c06c1f0 con 0x7f223c104b30 2024-05-14T09:08:39.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.695+0000 7f2238c00700 1 -- 172.21.15.175:0/1584888802 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f222c029070 con 0x7f223c104b30 2024-05-14T09:08:39.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.695+0000 7f2238c00700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f222003e570 0x7f2220040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:39.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.695+0000 7f2238c00700 1 -- 172.21.15.175:0/1584888802 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f222c01e070 con 0x7f223c104b30 2024-05-14T09:08:39.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.696+0000 7f223b400700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f222003e570 0x7f2220040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:39.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.697+0000 7f223b400700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f222003e570 0x7f2220040a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2228006fd0 tx=0x7f2228006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:39.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:39.712+0000 7f2238c00700 1 -- 172.21.15.175:0/1584888802 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f222c013070 con 0x7f223c104b30 2024-05-14T09:08:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:39 smithi120 ceph-mon[31085]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:40.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.035+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f223c064e20 con 0x7f223c104b30 2024-05-14T09:08:40.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.036+0000 7f2238c00700 1 -- 172.21.15.175:0/1584888802 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f222c030090 con 0x7f223c104b30 2024-05-14T09:08:40.036 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:08:40.036 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","modified":"2024-05-14T09:06:17.594241Z","created":"2024-05-14T09:06:17.594241Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-14T09:08:40.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f222003e570 msgr2=0x7f2220040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f222003e570 0x7f2220040a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2228006fd0 tx=0x7f2228006e40 comp rx=0 tx=0).stop 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 msgr2=0x7f223c1a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c1a15d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f222c005660 tx=0x7f222c005740 comp rx=0 tx=0).stop 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 shutdown_connections 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f222003e570 0x7f2220040a80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 --2- 172.21.15.175:0/1584888802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f223c104b30 0x7f223c1a15d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.039+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 >> 172.21.15.175:0/1584888802 conn(0x7f223c0fe3c0 msgr2=0x7f223c109ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.040+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 shutdown_connections 2024-05-14T09:08:40.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:40.040+0000 7f2241c00700 1 -- 172.21.15.175:0/1584888802 wait complete. 2024-05-14T09:08:40.041 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-05-14T09:08:40.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:40 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/1584888802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:08:41.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:41 smithi120 ceph-mon[31085]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:42.273 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T09:08:42.273 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T09:08:42.864 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:08:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:43 smithi175 systemd[1]: Starting Ceph mon.c for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:08:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:43 smithi120 ceph-mon[31085]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:44.465 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 podman[35312]: 2024-05-14 09:08:44.226581876 +0000 UTC m=+0.034097313 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:08:44.465 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 podman[35312]: 2024-05-14 09:08:44.355332453 +0000 UTC m=+0.162847914 container create d5aa159258ef1bc67c16130904635ec090aa036f19fe6bd3eb655318c7eeae2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-05-14T09:08:45.086 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 podman[35312]: 2024-05-14 09:08:44.777291416 +0000 UTC m=+0.584806843 container init d5aa159258ef1bc67c16130904635ec090aa036f19fe6bd3eb655318c7eeae2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-14T09:08:45.086 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 podman[35312]: 2024-05-14 09:08:44.787600856 +0000 UTC m=+0.595116283 container start d5aa159258ef1bc67c16130904635ec090aa036f19fe6bd3eb655318c7eeae2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: set uid:gid to 167:167 (ceph:ceph) 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev), process ceph-mon, pid 2 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pidfile_write: ignore empty --pid-file 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: load: jerasure load: lrc 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: RocksDB version: 7.9.2 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Git sha 0 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Compile date 2024-05-09 05:50:40 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: DB SUMMARY 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: DB Session ID: 8FX56EXIGEWND4IMR7J1 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: CURRENT file: CURRENT 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: IDENTITY file: IDENTITY 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-14T09:08:45.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.error_if_exists: 0 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.create_if_missing: 0 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.paranoid_checks: 1 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.env: 0x564d284d3500 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.fs: PosixFileSystem 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.info_log: 0x564d4ff4a060 2024-05-14T09:08:45.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_file_opening_threads: 16 2024-05-14T09:08:45.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.statistics: (nil) 2024-05-14T09:08:45.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.use_fsync: 0 2024-05-14T09:08:45.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_log_file_size: 0 2024-05-14T09:08:45.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-14T09:08:45.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.keep_log_file_num: 1000 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.recycle_log_file_num: 0 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.allow_fallocate: 1 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.allow_mmap_reads: 0 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.allow_mmap_writes: 0 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.use_direct_reads: 0 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.create_missing_column_families: 0 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.db_log_dir: 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.wal_dir: 2024-05-14T09:08:45.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.advise_random_on_open: 1 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.db_write_buffer_size: 0 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.write_buffer_manager: 0x564d4fe148c0 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.rate_limiter: (nil) 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-14T09:08:45.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.wal_recovery_mode: 2 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.enable_thread_tracking: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.enable_pipelined_write: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.unordered_write: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.row_cache: None 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.wal_filter: None 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.allow_ingest_behind: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.two_write_queues: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.manual_wal_flush: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.wal_compression: 0 2024-05-14T09:08:45.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.atomic_flush: 0 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.log_readahead_size: 0 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.best_efforts_recovery: 0 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.allow_data_in_errors: 0 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.db_host_id: __hostname__ 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_background_jobs: 2 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_background_compactions: -1 2024-05-14T09:08:45.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_subcompactions: 1 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_total_wal_size: 0 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_open_files: -1 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bytes_per_sync: 0 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_readahead_size: 0 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_background_flushes: -1 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Compression algorithms supported: 2024-05-14T09:08:45.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kZSTD supported: 0 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kXpressCompression supported: 0 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kLZ4HCCompression supported: 1 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kZlibCompression supported: 1 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kSnappyCompression supported: 1 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kLZ4Compression supported: 1 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: kBZip2Compression supported: 0 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.merge_operator: 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_filter: None 2024-05-14T09:08:45.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_filter_factory: None 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.sst_partitioner_factory: None 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564d4ff4a220) 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks: 1 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_top_level_index_and_filter: 1 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_type: 0 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_index_type: 0 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_shortening: 1 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: checksum: 4 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: no_block_cache: 0 2024-05-14T09:08:45.097 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache: 0x564d4fe471f0 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_name: BinnedLRUCache 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_options: 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: capacity : 536870912 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_shard_bits : 4 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: strict_capacity_limit : 0 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: high_pri_pool_ratio: 0.000 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_compressed: (nil) 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: persistent_cache: (nil) 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size: 4096 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size_deviation: 10 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_restart_interval: 16 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_block_restart_interval: 1 2024-05-14T09:08:45.098 INFO:journalctl@ceph.mon.c.smithi175.stdout: metadata_block_size: 4096 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: partition_filters: 0 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: use_delta_encoding: 1 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: filter_policy: bloomfilter 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: whole_key_filtering: 1 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: verify_compression: 0 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: read_amp_bytes_per_bit: 0 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: format_version: 5 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_index_compression: 1 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_align: 0 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: max_auto_readahead_size: 262144 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: prepopulate_block_cache: 0 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: initial_auto_readahead_size: 8192 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_file_reads_for_auto_readahead: 2 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.write_buffer_size: 33554432 2024-05-14T09:08:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_write_buffer_number: 2 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression: NoCompression 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression: Disabled 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.prefix_extractor: nullptr 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.num_levels: 7 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-14T09:08:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.level: 32767 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.strategy: 0 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.enabled: false 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-14T09:08:45.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.target_file_size_base: 67108864 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-14T09:08:45.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.arena_block_size: 1048576 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.disable_auto_compactions: 0 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-14T09:08:45.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.inplace_update_support: 0 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-14T09:08:45.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.bloom_locality: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.max_successive_merges: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.paranoid_file_checks: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.force_consistency_checks: 1 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.report_bg_io_stats: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.ttl: 2592000 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.enable_blob_files: false 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.min_blob_size: 0 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.blob_file_size: 268435456 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-14T09:08:45.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.blob_file_starting_level: 0 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9bb70616-74d0-46fa-bcc7-dca836e90e64 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677724925171, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677724926259, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715677724, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9bb70616-74d0-46fa-bcc7-dca836e90e64", "db_session_id": "8FX56EXIGEWND4IMR7J1", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677724926498, "job": 1, "event": "recovery_finished"} 2024-05-14T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564d4fe2bc00 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: DB pointer 0x564d54c1e000 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** DB Stats ** 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T09:08:45.107 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-05-14T09:08:45.108 INFO:journalctl@ceph.mon.c.smithi175.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache BinnedLRUCache@0x564d4fe471f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-14T09:08:45.109 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: using public_addr v2:172.21.15.175:0/0 -> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: starting mon.c rank -1 at public addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] at bind addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(???) e0 preinit fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).mds e1 new map 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: e1 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: legacy client fscid: -1 2024-05-14T09:08:45.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: No filesystems configured 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.111 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.112 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.112 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Added host smithi152 2024-05-14T09:08:45.112 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:08:45.112 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Deploying cephadm binary to smithi175 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 bash[35312]: d5aa159258ef1bc67c16130904635ec090aa036f19fe6bd3eb655318c7eeae2b 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi152:/etc/ceph/ceph.conf 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Added host smithi175 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1438827831' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1438827831' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi175:/etc/ceph/ceph.conf 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Saving service mon spec with placement smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c;count:3 2024-05-14T09:08:45.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: Deploying daemon mon.c on smithi175 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/1584888802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 ceph-mon[35353]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-14T09:08:45.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:44 smithi175 systemd[1]: Started Ceph mon.c for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:08:50.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:08:50.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: mon.a calling monitor election 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: mon.c calling monitor election 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: monmap epoch 2 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:08:50.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: last_changed 2024-05-14T09:08:44.977615+0000 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: min_mon_release 19 (squid) 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: election_strategy: 1 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: fsmap 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: mgrmap e13: x(active, since 69s) 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: overall HEALTH_OK 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:50.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: mon.a calling monitor election 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: mon.c calling monitor election 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:50.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: monmap epoch 2 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: last_changed 2024-05-14T09:08:44.977615+0000 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: min_mon_release 19 (squid) 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: election_strategy: 1 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: fsmap 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: mgrmap e13: x(active, since 69s) 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: overall HEALTH_OK 2024-05-14T09:08:50.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:50.481 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:51.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.111+0000 7feb4ec00700 1 -- 172.21.15.175:0/3574246108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 msgr2=0x7feb2c008140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:51.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.111+0000 7feb4ec00700 1 --2- 172.21.15.175:0/3574246108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb2c008140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb4806b880 tx=0x7feb3800ff00 comp rx=0 tx=0).stop 2024-05-14T09:08:51.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.111+0000 7feb4ec00700 1 -- 172.21.15.175:0/3574246108 shutdown_connections 2024-05-14T09:08:51.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.111+0000 7feb4ec00700 1 --2- 172.21.15.175:0/3574246108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb2c008140 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:51.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.111+0000 7feb4ec00700 1 -- 172.21.15.175:0/3574246108 >> 172.21.15.175:0/3574246108 conn(0x7feb480fe670 msgr2=0x7feb48100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:51.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.111+0000 7feb4ec00700 1 -- 172.21.15.175:0/3574246108 shutdown_connections 2024-05-14T09:08:51.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.112+0000 7feb4ec00700 1 -- 172.21.15.175:0/3574246108 wait complete. 2024-05-14T09:08:51.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.113+0000 7feb4ec00700 1 Processor -- start 2024-05-14T09:08:51.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.114+0000 7feb4ec00700 1 -- start start 2024-05-14T09:08:51.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb4ec00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb48102ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:51.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb4ec00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 0x7feb48103400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:51.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb4ec00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feb4810bac0 con 0x7feb2c005cc0 2024-05-14T09:08:51.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb4ec00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb4810b940 con 0x7feb48102ff0 2024-05-14T09:08:51.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb47e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb48102ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:51.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb47e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb48102ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.175:46706/0 (socket says 172.21.15.175:46706) 2024-05-14T09:08:51.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb47e00700 1 -- 172.21.15.175:0/130968946 learned_addr learned my addr 172.21.15.175:0/130968946 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:08:51.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.115+0000 7feb47400700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 0x7feb48103400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.116+0000 7feb47400700 1 -- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 msgr2=0x7feb48103400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.116+0000 7feb47400700 1 -- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 msgr2=0x7feb48103400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.116+0000 7feb47400700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 0x7feb48103400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.116+0000 7feb47400700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 0x7feb48103400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.116+0000 7feb47e00700 1 -- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 msgr2=0x7feb48103400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.116+0000 7feb47e00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 0x7feb48103400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.116+0000 7feb47e00700 1 -- 172.21.15.175:0/130968946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb481049e0 con 0x7feb2c005cc0 2024-05-14T09:08:51.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.117+0000 7feb47e00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb48102ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb38005fd0 tx=0x7feb3801da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:51.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.117+0000 7feb44c00700 1 -- 172.21.15.175:0/130968946 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7feb38005400 con 0x7feb2c005cc0 2024-05-14T09:08:51.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.118+0000 7feb44c00700 1 -- 172.21.15.175:0/130968946 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb380044c0 con 0x7feb2c005cc0 2024-05-14T09:08:51.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.118+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb481a5e00 con 0x7feb2c005cc0 2024-05-14T09:08:51.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.118+0000 7feb44c00700 1 -- 172.21.15.175:0/130968946 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7feb38003680 con 0x7feb2c005cc0 2024-05-14T09:08:51.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.118+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb481a6300 con 0x7feb2c005cc0 2024-05-14T09:08:51.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.119+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4806bb30 con 0x7feb2c005cc0 2024-05-14T09:08:51.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.120+0000 7feb44c00700 1 -- 172.21.15.175:0/130968946 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7feb38011440 con 0x7feb2c005cc0 2024-05-14T09:08:51.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.120+0000 7feb44c00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feb2803e320 0x7feb28040830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:51.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.120+0000 7feb44c00700 1 -- 172.21.15.175:0/130968946 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feb380557a0 con 0x7feb2c005cc0 2024-05-14T09:08:51.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.121+0000 7feb47400700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feb2803e320 0x7feb28040830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:51.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.122+0000 7feb47400700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feb2803e320 0x7feb28040830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb48192b30 tx=0x7feb34008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:51.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.138+0000 7feb44c00700 1 -- 172.21.15.175:0/130968946 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feb380056c0 con 0x7feb2c005cc0 2024-05-14T09:08:51.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:51.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:08:51.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:51.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:51 smithi120 ceph-mon[31085]: Deploying daemon mon.b on smithi152 2024-05-14T09:08:51.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:51 smithi120 ceph-mon[31085]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:51.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:08:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:51 smithi175 ceph-mon[35353]: Deploying daemon mon.b on smithi152 2024-05-14T09:08:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:51 smithi175 ceph-mon[35353]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:51.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.489+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7feb481a66c0 con 0x7feb2c005cc0 2024-05-14T09:08:51.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.490+0000 7feb44c00700 1 -- 172.21.15.175:0/130968946 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7feb38011b00 con 0x7feb2c005cc0 2024-05-14T09:08:51.490 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:08:51.490 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","modified":"2024-05-14T09:08:44.977615Z","created":"2024-05-14T09:06:17.594241Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-14T09:08:51.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feb2803e320 msgr2=0x7feb28040830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feb2803e320 0x7feb28040830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb48192b30 tx=0x7feb34008040 comp rx=0 tx=0).stop 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 msgr2=0x7feb48102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb48102ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb38005fd0 tx=0x7feb3801da60 comp rx=0 tx=0).stop 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 shutdown_connections 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feb2803e320 0x7feb28040830 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb2c005cc0 0x7feb48102ab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 --2- 172.21.15.175:0/130968946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb48102ff0 0x7feb48103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 >> 172.21.15.175:0/130968946 conn(0x7feb480fe670 msgr2=0x7feb481018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.494+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 shutdown_connections 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:51.495+0000 7feb4ec00700 1 -- 172.21.15.175:0/130968946 wait complete. 2024-05-14T09:08:51.495 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-05-14T09:08:52.163 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:52 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/130968946' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:08:52.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:52 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/130968946' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:08:52.384 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:08:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:08:51.979+0000 7f7591400700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-14T09:08:53.225 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T09:08:53.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T09:08:53.380 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:53 smithi175 ceph-mon[35353]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:53 smithi120 ceph-mon[31085]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:53.648 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:08:55.456 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:08:55 smithi175 ceph-mon[35353]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:55.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:08:55 smithi120 ceph-mon[31085]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.701+0000 7fbbb6400700 1 -- 172.21.15.175:0/2092791990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0103ec0 msgr2=0x7fbbb01042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.701+0000 7fbbb6400700 1 --2- 172.21.15.175:0/2092791990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0103ec0 0x7fbbb01042d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009910 tx=0x7fbba0009c20 comp rx=0 tx=0).stop 2024-05-14T09:08:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.701+0000 7fbbb6400700 1 -- 172.21.15.175:0/2092791990 shutdown_connections 2024-05-14T09:08:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.701+0000 7fbbb6400700 1 --2- 172.21.15.175:0/2092791990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0103ec0 0x7fbbb01042d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.701+0000 7fbbb6400700 1 -- 172.21.15.175:0/2092791990 >> 172.21.15.175:0/2092791990 conn(0x7fbbb00ff770 msgr2=0x7fbbb0101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:08:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.701+0000 7fbbb6400700 1 -- 172.21.15.175:0/2092791990 shutdown_connections 2024-05-14T09:08:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.702+0000 7fbbb6400700 1 -- 172.21.15.175:0/2092791990 wait complete. 2024-05-14T09:08:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.703+0000 7fbbb6400700 1 Processor -- start 2024-05-14T09:08:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.703+0000 7fbbb6400700 1 -- start start 2024-05-14T09:08:55.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbb6400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbb0103ec0 0x7fbbb0075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:55.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbb6400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0076000 0x7fbbb0076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:55.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbb6400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb010e060 con 0x7fbbb0076000 2024-05-14T09:08:55.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbb6400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb010dee0 con 0x7fbbb0103ec0 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbaf400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbb0103ec0 0x7fbbb0075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbaf400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbb0103ec0 0x7fbbb0075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33846/0 (socket says 172.21.15.175:33846) 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbaf400700 1 -- 172.21.15.175:0/3488198052 learned_addr learned my addr 172.21.15.175:0/3488198052 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.704+0000 7fbbaea00700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0076000 0x7fbbb0076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbbaf400700 1 -- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0076000 msgr2=0x7fbbb0076410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbbaf400700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0076000 0x7fbbb0076410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbbaf400700 1 -- 172.21.15.175:0/3488198052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb00779f0 con 0x7fbbb0103ec0 2024-05-14T09:08:55.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbbaea00700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0076000 0x7fbbb0076410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:08:55.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbbaf400700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbb0103ec0 0x7fbbb0075ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbba0005b40 tx=0x7fbba0005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:55.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbba0005dc0 con 0x7fbbb0103ec0 2024-05-14T09:08:55.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbba000bdf0 con 0x7fbbb0103ec0 2024-05-14T09:08:55.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb01a5de0 con 0x7fbbb0103ec0 2024-05-14T09:08:55.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbba0022cf0 con 0x7fbbb0103ec0 2024-05-14T09:08:55.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.705+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb01a62e0 con 0x7fbbb0103ec0 2024-05-14T09:08:55.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.707+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb0105370 con 0x7fbbb0103ec0 2024-05-14T09:08:55.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.707+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7fbba002a070 con 0x7fbbb0103ec0 2024-05-14T09:08:55.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.708+0000 7fbba7e00700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb9403e300 0x7fbb94040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:08:55.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.708+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbba001e030 con 0x7fbbb0103ec0 2024-05-14T09:08:55.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.709+0000 7fbbaea00700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb9403e300 0x7fbb94040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:08:55.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 podman[34848]: 2024-05-14 09:08:55.560706275 +0000 UTC m=+0.151799757 container create 75509f1e0e4134b46a713f62ebdd76144e691ea5657599e3ed0bb531a0bb8908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5) 2024-05-14T09:08:55.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.710+0000 7fbbaea00700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb9403e300 0x7fbb94040810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbbb010c120 tx=0x7fbb9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:08:55.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:55.715+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbba0013070 con 0x7fbbb0103ec0 2024-05-14T09:08:56.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:56.016+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbbb01a6600 con 0x7fbbb0103ec0 2024-05-14T09:08:56.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:08:56.016+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba002baa0 con 0x7fbbb0103ec0 2024-05-14T09:08:56.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 podman[34848]: 2024-05-14 09:08:55.814106106 +0000 UTC m=+0.405199571 container init 75509f1e0e4134b46a713f62ebdd76144e691ea5657599e3ed0bb531a0bb8908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T09:08:56.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 podman[34848]: 2024-05-14 09:08:55.824724797 +0000 UTC m=+0.415818276 container start 75509f1e0e4134b46a713f62ebdd76144e691ea5657599e3ed0bb531a0bb8908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 bash[34848]: 75509f1e0e4134b46a713f62ebdd76144e691ea5657599e3ed0bb531a0bb8908 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 systemd[1]: Started Ceph mon.b for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: set uid:gid to 167:167 (ceph:ceph) 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev), process ceph-mon, pid 2 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: pidfile_write: ignore empty --pid-file 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: load: jerasure load: lrc 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: RocksDB version: 7.9.2 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Git sha 0 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Compile date 2024-05-09 05:50:40 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: DB SUMMARY 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: DB Session ID: LOWDEXA7LNRGBSC1FHSX 2024-05-14T09:08:56.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: CURRENT file: CURRENT 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: IDENTITY file: IDENTITY 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.error_if_exists: 0 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.create_if_missing: 0 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.paranoid_checks: 1 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.env: 0x555bbdf8b500 2024-05-14T09:08:56.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.fs: PosixFileSystem 2024-05-14T09:08:56.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.info_log: 0x555bd145c060 2024-05-14T09:08:56.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_file_opening_threads: 16 2024-05-14T09:08:56.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.statistics: (nil) 2024-05-14T09:08:56.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.use_fsync: 0 2024-05-14T09:08:56.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_log_file_size: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.keep_log_file_num: 1000 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.recycle_log_file_num: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.allow_fallocate: 1 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.allow_mmap_reads: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.allow_mmap_writes: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.use_direct_reads: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.create_missing_column_families: 0 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.db_log_dir: 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.wal_dir: 2024-05-14T09:08:56.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.advise_random_on_open: 1 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.db_write_buffer_size: 0 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.write_buffer_manager: 0x555bd13268c0 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-14T09:08:56.214 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.rate_limiter: (nil) 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.wal_recovery_mode: 2 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.enable_thread_tracking: 0 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.enable_pipelined_write: 0 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.unordered_write: 0 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.row_cache: None 2024-05-14T09:08:56.215 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.wal_filter: None 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.allow_ingest_behind: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.two_write_queues: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.manual_wal_flush: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.wal_compression: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.atomic_flush: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.log_readahead_size: 0 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-14T09:08:56.216 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.best_efforts_recovery: 0 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.allow_data_in_errors: 0 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.db_host_id: __hostname__ 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_background_jobs: 2 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_background_compactions: -1 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_subcompactions: 1 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_total_wal_size: 0 2024-05-14T09:08:56.217 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_open_files: -1 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bytes_per_sync: 0 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_readahead_size: 0 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_background_flushes: -1 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Compression algorithms supported: 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kZSTD supported: 0 2024-05-14T09:08:56.218 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kXpressCompression supported: 0 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kLZ4HCCompression supported: 1 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kZlibCompression supported: 1 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kSnappyCompression supported: 1 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kLZ4Compression supported: 1 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: kBZip2Compression supported: 0 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-14T09:08:56.219 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.merge_operator: 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_filter: None 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_filter_factory: None 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.sst_partitioner_factory: None 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555bd145c220) 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: cache_index_and_filter_blocks: 1 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: pin_top_level_index_and_filter: 1 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: index_type: 0 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: data_block_index_type: 0 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: index_shortening: 1 2024-05-14T09:08:56.220 INFO:journalctl@ceph.mon.b.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: checksum: 4 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: no_block_cache: 0 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache: 0x555bd13591f0 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache_name: BinnedLRUCache 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache_options: 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: capacity : 536870912 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: num_shard_bits : 4 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: strict_capacity_limit : 0 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: high_pri_pool_ratio: 0.000 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache_compressed: (nil) 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: persistent_cache: (nil) 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_size: 4096 2024-05-14T09:08:56.221 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_size_deviation: 10 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_restart_interval: 16 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: index_block_restart_interval: 1 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: metadata_block_size: 4096 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: partition_filters: 0 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: use_delta_encoding: 1 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: filter_policy: bloomfilter 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: whole_key_filtering: 1 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: verify_compression: 0 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: read_amp_bytes_per_bit: 0 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: format_version: 5 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: enable_index_compression: 1 2024-05-14T09:08:56.222 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_align: 0 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout: max_auto_readahead_size: 262144 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout: prepopulate_block_cache: 0 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout: initial_auto_readahead_size: 8192 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.write_buffer_size: 33554432 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_write_buffer_number: 2 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression: NoCompression 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression: Disabled 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.prefix_extractor: nullptr 2024-05-14T09:08:56.224 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.num_levels: 7 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-14T09:08:56.225 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.level: 32767 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.strategy: 0 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.enabled: false 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-14T09:08:56.226 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.target_file_size_base: 67108864 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-14T09:08:56.227 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.arena_block_size: 1048576 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.disable_auto_compactions: 0 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-14T09:08:56.228 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.inplace_update_support: 0 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.bloom_locality: 0 2024-05-14T09:08:56.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.max_successive_merges: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.paranoid_file_checks: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.force_consistency_checks: 1 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.report_bg_io_stats: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.ttl: 2592000 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.enable_blob_files: false 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.min_blob_size: 0 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.blob_file_size: 268435456 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-14T09:08:56.230 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.blob_file_starting_level: 0 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 45042e15-338d-45e3-9e48-bd0deebb82bd 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677735949889, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677735950735, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715677735, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "45042e15-338d-45e3-9e48-bd0deebb82bd", "db_session_id": "LOWDEXA7LNRGBSC1FHSX", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715677735951002, "job": 1, "event": "recovery_finished"} 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-14T09:08:56.231 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555bd133dc00 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: DB pointer 0x555bd6130000 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** DB Stats ** 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** Compaction Stats [default] ** 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T09:08:56.232 INFO:journalctl@ceph.mon.b.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** Compaction Stats [default] ** 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-14T09:08:56.233 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: Block cache BinnedLRUCache@0x555bd13591f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: using public_addr v2:172.21.15.152:0/0 -> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: starting mon.b rank -1 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(???) e0 preinit fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).mds e1 new map 2024-05-14T09:08:56.234 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout: e1 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout: legacy client fscid: -1 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout: No filesystems configured 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-14T09:08:56.235 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: Added host smithi152 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:55 smithi152 ceph-mon[34868]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.236 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Deploying cephadm binary to smithi175 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi152:/etc/ceph/ceph.conf 2024-05-14T09:08:56.237 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Added host smithi175 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.238 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1438827831' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1438827831' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.239 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi175:/etc/ceph/ceph.conf 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Saving service mon spec with placement smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c;count:3 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.240 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Deploying daemon mon.c on smithi175 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/1584888802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.241 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: mon.a calling monitor election 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: mon.c calling monitor election 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: monmap epoch 2 2024-05-14T09:08:56.242 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: last_changed 2024-05-14T09:08:44.977615+0000 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: min_mon_release 19 (squid) 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: election_strategy: 1 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: fsmap 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: mgrmap e13: x(active, since 69s) 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: overall HEALTH_OK 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:08:56.243 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: Deploying daemon mon.b on smithi152 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/130968946' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:08:56.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:08:56 smithi152 ceph-mon[34868]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-05-14T09:09:01.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.038+0000 7fbba7e00700 1 -- 172.21.15.175:0/3488198052 <== mon.1 v2:172.21.15.175:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1289 (secure 0 0 0) 0x7fbba0031090 con 0x7fbbb0103ec0 2024-05-14T09:09:01.039 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-05-14T09:09:01.039 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","modified":"2024-05-14T09:08:56.011149Z","created":"2024-05-14T09:06:17.594241Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.042+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb9403e300 msgr2=0x7fbb94040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.042+0000 7fbbb6400700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb9403e300 0x7fbb94040810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbbb010c120 tx=0x7fbb9c008040 comp rx=0 tx=0).stop 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.042+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbb0103ec0 msgr2=0x7fbbb0075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbb0103ec0 0x7fbbb0075ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbba0005b40 tx=0x7fbba0005780 comp rx=0 tx=0).stop 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 shutdown_connections 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb9403e300 0x7fbb94040810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbb0103ec0 0x7fbbb0075ac0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 --2- 172.21.15.175:0/3488198052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb0076000 0x7fbbb0076410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 >> 172.21.15.175:0/3488198052 conn(0x7fbbb00ff770 msgr2=0x7fbbb010b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 shutdown_connections 2024-05-14T09:09:01.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:01.043+0000 7fbbb6400700 1 -- 172.21.15.175:0/3488198052 wait complete. 2024-05-14T09:09:01.044 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-05-14T09:09:01.370 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: mon.a calling monitor election 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/3488198052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: mon.c calling monitor election 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: mon.b calling monitor election 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: monmap epoch 3 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: last_changed 2024-05-14T09:08:56.011149+0000 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: min_mon_release 19 (squid) 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: election_strategy: 1 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: fsmap 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: mgrmap e13: x(active, since 80s) 2024-05-14T09:09:01.372 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: overall HEALTH_OK 2024-05-14T09:09:01.373 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.373 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.373 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: mon.a calling monitor election 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/3488198052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: mon.c calling monitor election 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: mon.b calling monitor election 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: monmap epoch 3 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: last_changed 2024-05-14T09:08:56.011149+0000 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: min_mon_release 19 (squid) 2024-05-14T09:09:01.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: election_strategy: 1 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: fsmap 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: mgrmap e13: x(active, since 80s) 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: overall HEALTH_OK 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: mon.a calling monitor election 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/3488198052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: mon.c calling monitor election 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: mon.b calling monitor election 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: monmap epoch 3 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: last_changed 2024-05-14T09:08:56.011149+0000 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: created 2024-05-14T09:06:17.594241+0000 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: min_mon_release 19 (squid) 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: election_strategy: 1 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: fsmap 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: mgrmap e13: x(active, since 80s) 2024-05-14T09:09:01.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: overall HEALTH_OK 2024-05-14T09:09:01.462 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.462 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.462 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:01.711 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-14T09:09:01.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph config generate-minimal-conf 2024-05-14T09:09:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:09:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:09:03.321 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:03 smithi120 ceph-mon[31085]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:03.322 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:09:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:09:03.012+0000 7f7591400700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-14T09:09:03.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:03 smithi175 ceph-mon[35353]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:03.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:03 smithi152 ceph-mon[34868]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.377+0000 7f3659600700 1 -- 172.21.15.120:0/2295421351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654075d30 msgr2=0x7f3654076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.377+0000 7f3659600700 1 --2- 172.21.15.120:0/2295421351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654075d30 0x7f3654076140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3644009910 tx=0x7f3644009c20 comp rx=0 tx=0).stop 2024-05-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.377+0000 7f3659600700 1 -- 172.21.15.120:0/2295421351 shutdown_connections 2024-05-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.377+0000 7f3659600700 1 --2- 172.21.15.120:0/2295421351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654075d30 0x7f3654076140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.377+0000 7f3659600700 1 -- 172.21.15.120:0/2295421351 >> 172.21.15.120:0/2295421351 conn(0x7f36540ff690 msgr2=0x7f3654101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.377+0000 7f3659600700 1 -- 172.21.15.120:0/2295421351 shutdown_connections 2024-05-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.377+0000 7f3659600700 1 -- 172.21.15.120:0/2295421351 wait complete. 2024-05-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.378+0000 7f3659600700 1 Processor -- start 2024-05-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.379+0000 7f3659600700 1 -- start start 2024-05-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.379+0000 7f3659600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3654075d30 0x7f365419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.379+0000 7f3659600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f365419c3b0 0x7f36541a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.379+0000 7f3659600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36541a0be0 0x7f36541a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.379+0000 7f3659600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f36541101e0 con 0x7f36541a0be0 2024-05-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.379+0000 7f3659600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3654110060 con 0x7f365419c3b0 2024-05-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.379+0000 7f3659600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3654110360 con 0x7f3654075d30 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3654075d30 0x7f365419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3654075d30 0x7f365419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:52936/0 (socket says 172.21.15.120:52936) 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 -- 172.21.15.120:0/395254919 learned_addr learned my addr 172.21.15.120:0/395254919 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3653400700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36541a0be0 0x7f36541a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 -- 172.21.15.120:0/395254919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f365419c3b0 msgr2=0x7f36541a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f365419c3b0 0x7f36541a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 -- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36541a0be0 msgr2=0x7f36541a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36541a0be0 0x7f36541a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.380+0000 7f3652a00700 1 -- 172.21.15.120:0/395254919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36541a8950 con 0x7f3654075d30 2024-05-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.381+0000 7f3653400700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36541a0be0 0x7f36541a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.381+0000 7f3652a00700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3654075d30 0x7f365419be70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3644009fd0 tx=0x7f364400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.381+0000 7f364b400700 1 -- 172.21.15.120:0/395254919 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644026070 con 0x7f3654075d30 2024-05-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.381+0000 7f364b400700 1 -- 172.21.15.120:0/395254919 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3644004050 con 0x7f3654075d30 2024-05-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.381+0000 7f364b400700 1 -- 172.21.15.120:0/395254919 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644003b10 con 0x7f3654075d30 2024-05-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.382+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36541a8b20 con 0x7f3654075d30 2024-05-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.382+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36541a9010 con 0x7f3654075d30 2024-05-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.383+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3654064e20 con 0x7f3654075d30 2024-05-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.383+0000 7f364b400700 1 -- 172.21.15.120:0/395254919 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f3644029070 con 0x7f3654075d30 2024-05-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.384+0000 7f364b400700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f363803e9a0 0x7f3638040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.384+0000 7f364b400700 1 -- 172.21.15.120:0/395254919 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3644053450 con 0x7f3654075d30 2024-05-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.384+0000 7f3652000700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f363803e9a0 0x7f3638040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.385+0000 7f3652000700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f363803e9a0 0x7f3638040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3654109490 tx=0x7f3640006dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.392+0000 7f364b400700 1 -- 172.21.15.120:0/395254919 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3644013070 con 0x7f3654075d30 2024-05-14T09:09:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: Updating smithi120:/etc/ceph/ceph.conf 2024-05-14T09:09:04.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: Updating smithi152:/etc/ceph/ceph.conf 2024-05-14T09:09:04.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:04 smithi120 ceph-mon[31085]: Updating smithi175:/etc/ceph/ceph.conf 2024-05-14T09:09:04.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.663+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f36541a9340 con 0x7f3654075d30 2024-05-14T09:09:04.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.664+0000 7f364b400700 1 -- 172.21.15.120:0/395254919 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f36440163a0 con 0x7f3654075d30 2024-05-14T09:09:04.664 INFO:teuthology.orchestra.run.smithi120.stdout:# minimal ceph.conf for 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:09:04.665 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-05-14T09:09:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:09:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: mon_host = [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-05-14T09:09:04.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.666+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f363803e9a0 msgr2=0x7f3638040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:04.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.666+0000 7f3659600700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f363803e9a0 0x7f3638040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3654109490 tx=0x7f3640006dd0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3654075d30 msgr2=0x7f365419be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3654075d30 0x7f365419be70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3644009fd0 tx=0x7f364400f690 comp rx=0 tx=0).stop 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 shutdown_connections 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f363803e9a0 0x7f3638040eb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36541a0be0 0x7f36541a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3654075d30 0x7f365419be70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 --2- 172.21.15.120:0/395254919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f365419c3b0 0x7f36541a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 >> 172.21.15.120:0/395254919 conn(0x7f36540ff690 msgr2=0x7f365410c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 shutdown_connections 2024-05-14T09:09:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:04.667+0000 7f3659600700 1 -- 172.21.15.120:0/395254919 wait complete. 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: Updating smithi120:/etc/ceph/ceph.conf 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: Updating smithi152:/etc/ceph/ceph.conf 2024-05-14T09:09:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:04 smithi152 ceph-mon[34868]: Updating smithi175:/etc/ceph/ceph.conf 2024-05-14T09:09:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: Updating smithi120:/etc/ceph/ceph.conf 2024-05-14T09:09:04.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: Updating smithi152:/etc/ceph/ceph.conf 2024-05-14T09:09:04.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:04 smithi175 ceph-mon[35353]: Updating smithi175:/etc/ceph/ceph.conf 2024-05-14T09:09:05.477 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-14T09:09:05.477 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:09:05.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T09:09:05.545 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:09:05.545 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:09:05.645 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:09:05.645 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T09:09:05.728 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: Updating smithi120:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.728 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/395254919' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.730 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.730 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:05.730 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:05.730 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:05.737 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:09:05.737 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:09:05.868 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:09:05.868 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: Updating smithi120:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/395254919' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:05.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: Updating smithi120:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: Updating smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: Updating smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/395254919' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:05.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:05.959 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:09:05.960 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T09:09:06.085 INFO:tasks.cephadm:Adding mgr.x on smithi120 2024-05-14T09:09:06.086 INFO:tasks.cephadm:Adding mgr.y on smithi152 2024-05-14T09:09:06.086 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-05-14T09:09:06.086 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch apply mgr '3;smithi120=x;smithi152=y;smithi175=z' 2024-05-14T09:09:06.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:06 smithi120 ceph-mon[31085]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T09:09:06.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:06 smithi120 ceph-mon[31085]: Reconfiguring daemon mon.a on smithi120 2024-05-14T09:09:06.563 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:09:06.852 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:06 smithi175 ceph-mon[35353]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T09:09:06.852 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:06 smithi175 ceph-mon[35353]: Reconfiguring daemon mon.a on smithi120 2024-05-14T09:09:06.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:06 smithi152 ceph-mon[34868]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T09:09:06.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:06 smithi152 ceph-mon[34868]: Reconfiguring daemon mon.a on smithi120 2024-05-14T09:09:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:07 smithi120 ceph-mon[31085]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:07.666 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:07 smithi175 ceph-mon[35353]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:07 smithi152 ceph-mon[34868]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:08.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.558+0000 7f084d000700 1 -- 172.21.15.175:0/2901635156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0848077780 msgr2=0x7f0848075bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:08.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.558+0000 7f084d000700 1 --2- 172.21.15.175:0/2901635156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0848077780 0x7f0848075bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0838009910 tx=0x7f0838009c20 comp rx=0 tx=0).stop 2024-05-14T09:09:08.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.558+0000 7f084d000700 1 -- 172.21.15.175:0/2901635156 shutdown_connections 2024-05-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.558+0000 7f084d000700 1 --2- 172.21.15.175:0/2901635156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0848077780 0x7f0848075bb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.558+0000 7f084d000700 1 -- 172.21.15.175:0/2901635156 >> 172.21.15.175:0/2901635156 conn(0x7f08480ff350 msgr2=0x7f08481017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.558+0000 7f084d000700 1 -- 172.21.15.175:0/2901635156 shutdown_connections 2024-05-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.558+0000 7f084d000700 1 -- 172.21.15.175:0/2901635156 wait complete. 2024-05-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.559+0000 7f084d000700 1 Processor -- start 2024-05-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.559+0000 7f084d000700 1 -- start start 2024-05-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f084d000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0848077780 0x7f084819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f084d000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f084819bfb0 0x7f08481a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f084d000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08481a1480 0x7f08481a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f084d000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f084810bd00 con 0x7f084819bfb0 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f084d000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f084810bb80 con 0x7f0848077780 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f084d000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f084810be80 con 0x7f08481a1480 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f0846800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08481a1480 0x7f08481a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f0846800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08481a1480 0x7f08481a38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40958/0 (socket says 172.21.15.175:40958) 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f0846800700 1 -- 172.21.15.175:0/3452586058 learned_addr learned my addr 172.21.15.175:0/3452586058 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.560+0000 7f0845400700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f084819bfb0 0x7f08481a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.561+0000 7f0845e00700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0848077780 0x7f084819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.561+0000 7f0846800700 1 -- 172.21.15.175:0/3452586058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0848077780 msgr2=0x7f084819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.561+0000 7f0846800700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0848077780 0x7f084819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.561+0000 7f0846800700 1 -- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f084819bfb0 msgr2=0x7f08481a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.561+0000 7f0846800700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f084819bfb0 0x7f08481a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.561+0000 7f0846800700 1 -- 172.21.15.175:0/3452586058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08481a3e10 con 0x7f08481a1480 2024-05-14T09:09:08.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:08.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:08.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:08 smithi175 ceph-mon[35353]: Reconfiguring mon.b (monmap changed)... 2024-05-14T09:09:08.563 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:08.563 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:08.563 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:08.563 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:08 smithi175 ceph-mon[35353]: Reconfiguring daemon mon.b on smithi152 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.561+0000 7f0846800700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08481a1480 0x7f08481a38a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f084000ba50 tx=0x7f084000bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.562+0000 7f083ea00700 1 -- 172.21.15.175:0/3452586058 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0840019070 con 0x7f08481a1480 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.562+0000 7f083ea00700 1 -- 172.21.15.175:0/3452586058 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f084000cdc0 con 0x7f08481a1480 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.562+0000 7f083ea00700 1 -- 172.21.15.175:0/3452586058 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0840014e60 con 0x7f08481a1480 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.562+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08481a4100 con 0x7f08481a1480 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.562+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08481a4670 con 0x7f08481a1480 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.563+0000 7f083ea00700 1 -- 172.21.15.175:0/3452586058 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f084001c070 con 0x7f08481a1480 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.563+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0848064e20 con 0x7f08481a1480 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.564+0000 7f083ea00700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f082c03e9a0 0x7f082c040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.564+0000 7f083ea00700 1 -- 172.21.15.175:0/3452586058 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0840051df0 con 0x7f08481a1480 2024-05-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.565+0000 7f0845e00700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f082c03e9a0 0x7f082c040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.566+0000 7f0845e00700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f082c03e9a0 0x7f082c040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0838009750 tx=0x7f083801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.571+0000 7f083ea00700 1 -- 172.21.15.175:0/3452586058 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0840017120 con 0x7f08481a1480 2024-05-14T09:09:08.661 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:08.661 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:08.661 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:08 smithi152 ceph-mon[34868]: Reconfiguring mon.b (monmap changed)... 2024-05-14T09:09:08.661 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:08.661 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:08.661 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:08.661 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:08 smithi152 ceph-mon[34868]: Reconfiguring daemon mon.b on smithi152 2024-05-14T09:09:08.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.815+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi152=y;smithi175=z", "target": ["mon-mgr", ""]}) -- 0x7f0848101260 con 0x7f082c03e9a0 2024-05-14T09:09:08.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.831+0000 7f083ea00700 1 -- 172.21.15.175:0/3452586058 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0848101260 con 0x7f082c03e9a0 2024-05-14T09:09:08.831 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.834+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f082c03e9a0 msgr2=0x7f082c040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.834+0000 7f084d000700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f082c03e9a0 0x7f082c040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0838009750 tx=0x7f083801a040 comp rx=0 tx=0).stop 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.834+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08481a1480 msgr2=0x7f08481a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.834+0000 7f084d000700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08481a1480 0x7f08481a38a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f084000ba50 tx=0x7f084000bd60 comp rx=0 tx=0).stop 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 shutdown_connections 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f082c03e9a0 0x7f082c040eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0848077780 0x7f084819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08481a1480 0x7f08481a38a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 --2- 172.21.15.175:0/3452586058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f084819bfb0 0x7f08481a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 >> 172.21.15.175:0/3452586058 conn(0x7f08480ff350 msgr2=0x7f0848100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:08.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 shutdown_connections 2024-05-14T09:09:08.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:09:08.835+0000 7f084d000700 1 -- 172.21.15.175:0/3452586058 wait complete. 2024-05-14T09:09:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:08 smithi120 ceph-mon[31085]: Reconfiguring mon.b (monmap changed)... 2024-05-14T09:09:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:08.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:08 smithi120 ceph-mon[31085]: Reconfiguring daemon mon.b on smithi152 2024-05-14T09:09:09.533 DEBUG:teuthology.orchestra.run.smithi152:mgr.y> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.y.service 2024-05-14T09:09:09.538 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.z.service 2024-05-14T09:09:09.546 INFO:tasks.cephadm:Deploying OSDs... 2024-05-14T09:09:09.546 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:09:09.547 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T09:09:09.607 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T09:09:09.607 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-05-14T09:09:09.659 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T09:09:09.659 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:09.659 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-14T09:09:09.660 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:09.660 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:09.660 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-05-14 09:07:57.107485231 +0000 2024-05-14T09:09:09.660 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-05-14 09:01:36.826508623 +0000 2024-05-14T09:09:09.660 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-05-14 09:01:36.826508623 +0000 2024-05-14T09:09:09.660 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-05-14 09:01:36.826508623 +0000 2024-05-14T09:09:09.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T09:09:09.738 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-05-14T09:09:09.739 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-05-14T09:09:09.739 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000385185 s, 1.3 MB/s 2024-05-14T09:09:09.742 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T09:09:09.794 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-05-14 09:07:57.178483583 +0000 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-05-14 09:01:37.400495308 +0000 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-05-14 09:01:37.400495308 +0000 2024-05-14T09:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-05-14 09:01:37.400495308 +0000 2024-05-14T09:09:09.842 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T09:09:09.910 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-05-14T09:09:09.910 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-05-14T09:09:09.911 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000360061 s, 1.4 MB/s 2024-05-14T09:09:09.913 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T09:09:09.967 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-05-14T09:09:10.014 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T09:09:10.014 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:10.014 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-14T09:09:10.014 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:10.014 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:10.015 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-05-14 09:07:57.245482027 +0000 2024-05-14T09:09:10.015 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-05-14 09:01:38.021480903 +0000 2024-05-14T09:09:10.015 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-05-14 09:01:38.021480903 +0000 2024-05-14T09:09:10.015 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-05-14 09:01:38.021480903 +0000 2024-05-14T09:09:10.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi152=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: Saving service mgr spec with placement smithi120=x;smithi152=y;smithi175=z;count:3 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:10.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:10.087 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-05-14T09:09:10.087 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-05-14T09:09:10.087 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000331985 s, 1.5 MB/s 2024-05-14T09:09:10.090 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T09:09:10.142 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-05-14 09:07:57.299480773 +0000 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-05-14 09:01:38.626466869 +0000 2024-05-14T09:09:10.192 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-05-14 09:01:38.626466869 +0000 2024-05-14T09:09:10.193 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-05-14 09:01:38.626466869 +0000 2024-05-14T09:09:10.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T09:09:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi152=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: Saving service mgr spec with placement smithi120=x;smithi152=y;smithi175=z;count:3 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi152=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: Saving service mgr spec with placement smithi120=x;smithi152=y;smithi175=z;count:3 2024-05-14T09:09:10.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:10.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T09:09:10.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T09:09:10.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:10.273 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-05-14T09:09:10.273 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-05-14T09:09:10.273 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000375154 s, 1.4 MB/s 2024-05-14T09:09:10.276 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T09:09:10.330 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-05-14T09:09:10.330 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T09:09:10.390 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T09:09:10.390 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-05-14T09:09:10.444 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T09:09:10.444 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:10.444 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-14T09:09:10.444 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:10.444 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:10.444 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-05-14 09:08:55.008449118 +0000 2024-05-14T09:09:10.445 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-05-14 09:01:36.982312300 +0000 2024-05-14T09:09:10.445 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-05-14 09:01:36.982312300 +0000 2024-05-14T09:09:10.445 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-05-14 09:01:36.982312300 +0000 2024-05-14T09:09:10.445 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T09:09:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-05-14T09:09:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-05-14T09:09:10.524 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000380323 s, 1.3 MB/s 2024-05-14T09:09:10.528 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T09:09:10.583 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-05-14 09:08:55.009449106 +0000 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-05-14 09:01:37.612305084 +0000 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-05-14 09:01:37.612305084 +0000 2024-05-14T09:09:10.633 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-05-14 09:01:37.612305084 +0000 2024-05-14T09:09:10.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T09:09:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-05-14T09:09:10.708 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-05-14T09:09:10.708 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000361183 s, 1.4 MB/s 2024-05-14T09:09:10.711 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T09:09:10.765 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-05-14 09:08:55.010449095 +0000 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-05-14 09:01:38.207298269 +0000 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-05-14 09:01:38.207298269 +0000 2024-05-14T09:09:10.813 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-05-14 09:01:38.207298269 +0000 2024-05-14T09:09:10.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T09:09:10.883 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-05-14T09:09:10.883 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-05-14T09:09:10.883 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000356394 s, 1.4 MB/s 2024-05-14T09:09:10.886 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T09:09:10.940 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-05-14 09:08:55.011449083 +0000 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-05-14 09:01:38.825291190 +0000 2024-05-14T09:09:10.991 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-05-14 09:01:38.825291190 +0000 2024-05-14T09:09:10.992 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-05-14 09:01:38.825291190 +0000 2024-05-14T09:09:10.992 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T09:09:11.068 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-05-14T09:09:11.069 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-05-14T09:09:11.069 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000361364 s, 1.4 MB/s 2024-05-14T09:09:11.072 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T09:09:11.128 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-05-14T09:09:11.128 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T09:09:11.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:10 smithi120 ceph-mon[31085]: Reconfiguring mon.c (monmap changed)... 2024-05-14T09:09:11.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:10 smithi120 ceph-mon[31085]: Reconfiguring daemon mon.c on smithi175 2024-05-14T09:09:11.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:10 smithi175 ceph-mon[35353]: Reconfiguring mon.c (monmap changed)... 2024-05-14T09:09:11.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:10 smithi175 ceph-mon[35353]: Reconfiguring daemon mon.c on smithi175 2024-05-14T09:09:11.183 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T09:09:11.183 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-05-14T09:09:11.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:10 smithi152 ceph-mon[34868]: Reconfiguring mon.c (monmap changed)... 2024-05-14T09:09:11.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:10 smithi152 ceph-mon[34868]: Reconfiguring daemon mon.c on smithi175 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-14 09:08:43.399950770 +0000 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-14 09:01:40.259036159 +0000 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-14 09:01:40.259036159 +0000 2024-05-14T09:09:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-14 09:01:40.259036159 +0000 2024-05-14T09:09:11.277 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T09:09:11.356 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-14T09:09:11.356 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-14T09:09:11.356 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000364216 s, 1.4 MB/s 2024-05-14T09:09:11.360 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T09:09:11.414 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-05-14T09:09:11.462 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T09:09:11.462 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:11.462 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-14T09:09:11.462 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:11.462 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:11.462 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-14 09:08:43.399950770 +0000 2024-05-14T09:09:11.462 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-14 09:01:40.878026618 +0000 2024-05-14T09:09:11.463 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-14 09:01:40.878026618 +0000 2024-05-14T09:09:11.463 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-14 09:01:40.878026618 +0000 2024-05-14T09:09:11.463 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T09:09:11.529 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-14T09:09:11.529 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-14T09:09:11.529 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00031467 s, 1.6 MB/s 2024-05-14T09:09:11.532 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T09:09:11.579 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-14 09:08:43.400950755 +0000 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-14 09:01:41.493017139 +0000 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-14 09:01:41.493017139 +0000 2024-05-14T09:09:11.624 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-14 09:01:41.493017139 +0000 2024-05-14T09:09:11.625 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T09:09:11.729 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-14T09:09:11.730 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-14T09:09:11.730 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000272063 s, 1.9 MB/s 2024-05-14T09:09:11.733 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T09:09:11.774 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-05-14T09:09:11.856 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T09:09:11.856 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:09:11.856 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-05-14T09:09:11.856 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:09:11.857 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:09:11.857 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-05-14 09:08:43.401950739 +0000 2024-05-14T09:09:11.857 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-05-14 09:01:42.050008555 +0000 2024-05-14T09:09:11.857 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-05-14 09:01:42.050008555 +0000 2024-05-14T09:09:11.857 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-05-14 09:01:42.050008555 +0000 2024-05-14T09:09:11.857 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T09:09:11.969 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-05-14T09:09:11.969 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-05-14T09:09:11.969 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000360315 s, 1.4 MB/s 2024-05-14T09:09:11.972 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T09:09:12.020 INFO:tasks.cephadm:Deploying osd.0 on smithi120 with /dev/vg_nvme/lv_4... 2024-05-14T09:09:12.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:12.097 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T09:09:12.097 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:12.097 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:12.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:09:12.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:12 smithi175 ceph-mon[35353]: Deploying daemon mgr.z on smithi175 2024-05-14T09:09:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:12 smithi120 ceph-mon[31085]: Deploying daemon mgr.z on smithi175 2024-05-14T09:09:13.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:12 smithi152 ceph-mon[34868]: Deploying daemon mgr.z on smithi175 2024-05-14T09:09:13.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:13 smithi120 ceph-mon[31085]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:13.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:13 smithi175 ceph-mon[35353]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:13 smithi152 ceph-mon[34868]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:14.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:14 smithi175 systemd[1]: Starting Ceph mgr.z for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:09:15.081 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:14 smithi175 ceph-mon[35353]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:15.082 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:14 smithi175 podman[37056]: 2024-05-14 09:09:14.692093846 +0000 UTC m=+0.032148920 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:09:15.082 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:14 smithi175 podman[37056]: 2024-05-14 09:09:14.827642749 +0000 UTC m=+0.167697870 container create 09f3351b5f0c721ca44e4ad5253e1e32dff6fbc23741e868a0498b000ea65b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T09:09:15.082 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 podman[37056]: 2024-05-14 09:09:15.081713487 +0000 UTC m=+0.421768605 container init 09f3351b5f0c721ca44e4ad5253e1e32dff6fbc23741e868a0498b000ea65b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=) 2024-05-14T09:09:15.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:14 smithi120 ceph-mon[31085]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:15.158 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T09:09:15.159 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T09:09:15.159 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-05-14T09:09:15.159 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-05-14T09:09:15.159 INFO:teuthology.orchestra.run.smithi120.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0348892 s, 301 MB/s 2024-05-14T09:09:15.159 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-05-14T09:09:15.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:14 smithi152 ceph-mon[34868]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:15.407 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 podman[37056]: 2024-05-14 09:09:15.091818667 +0000 UTC m=+0.431873815 container start 09f3351b5f0c721ca44e4ad5253e1e32dff6fbc23741e868a0498b000ea65b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-14T09:09:15.407 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 bash[37056]: 09f3351b5f0c721ca44e4ad5253e1e32dff6fbc23741e868a0498b000ea65b0f 2024-05-14T09:09:15.407 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 systemd[1]: Started Ceph mgr.z for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:09:15.407 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 ceph-mgr[37075]: -- 172.21.15.175:0/1958587139 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dccc6705a0 con 0x55dcd13fa000 2024-05-14T09:09:15.668 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:15.406+0000 7f5a8a599200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T09:09:15.668 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:15.666+0000 7f5a8a599200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:09:15.977 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:15.800+0000 7f5a8a599200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T09:09:15.982 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_4 2024-05-14T09:09:16.423 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:09:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:16.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T09:09:16.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:16.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:16.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:16 smithi175 ceph-mon[35353]: Deploying daemon mgr.y on smithi152 2024-05-14T09:09:16.478 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:16.202+0000 7f5a8a599200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T09:09:16.478 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:16.317+0000 7f5a8a599200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T09:09:16.576 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:16.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T09:09:16.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:16.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:16.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:16 smithi152 ceph-mon[34868]: Deploying daemon mgr.y on smithi152 2024-05-14T09:09:16.613 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.614 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.614 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:16.614 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:16.614 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T09:09:16.614 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:16.614 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:16.614 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:16 smithi120 ceph-mon[31085]: Deploying daemon mgr.y on smithi152 2024-05-14T09:09:17.519 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:17 smithi120 ceph-mon[31085]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:17.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:17 smithi152 ceph-mon[34868]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:17.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:17 smithi175 ceph-mon[35353]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:18.227 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:17.909+0000 7f5a8a599200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T09:09:18.227 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:18.139+0000 7f5a8a599200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 -- 172.21.15.120:0/3222909758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 msgr2=0x7f4424103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 --2- 172.21.15.120:0/3222909758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f4424103650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4414009990 tx=0x7f4414009ca0 comp rx=0 tx=0).stop 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 -- 172.21.15.120:0/3222909758 shutdown_connections 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 --2- 172.21.15.120:0/3222909758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4424104d10 0x7f442410b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 --2- 172.21.15.120:0/3222909758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f4424103650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 --2- 172.21.15.120:0/3222909758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4424104370 0x7f4424104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 -- 172.21.15.120:0/3222909758 >> 172.21.15.120:0/3222909758 conn(0x7f44240fe880 msgr2=0x7f4424100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 -- 172.21.15.120:0/3222909758 shutdown_connections 2024-05-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.342+0000 7f442a400700 1 -- 172.21.15.120:0/3222909758 wait complete. 2024-05-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.343+0000 7f442a400700 1 Processor -- start 2024-05-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f442a400700 1 -- start start 2024-05-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f442a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f442419ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f442a400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4424104370 0x7f442419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f442a400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4424104d10 0x7f44241a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f442a400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f442410eb30 con 0x7f4424103240 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f442a400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f442410e9b0 con 0x7f4424104d10 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f442a400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f442410ecb0 con 0x7f4424104370 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f4423400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f442419ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f4423400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f442419ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45940/0 (socket says 172.21.15.120:45940) 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.344+0000 7f4423400700 1 -- 172.21.15.120:0/1739181113 learned_addr learned my addr 172.21.15.120:0/1739181113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f441aa00700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4424104370 0x7f442419cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f4423e00700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4424104d10 0x7f44241a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f4423400700 1 -- 172.21.15.120:0/1739181113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4424104370 msgr2=0x7f442419cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f4423400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4424104370 0x7f442419cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f4423400700 1 -- 172.21.15.120:0/1739181113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4424104d10 msgr2=0x7f44241a3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f4423400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4424104d10 0x7f44241a3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f4423400700 1 -- 172.21.15.120:0/1739181113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44241a45f0 con 0x7f4424103240 2024-05-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.345+0000 7f4423400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f442419ca90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f441400b2e0 tx=0x7f441400ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.346+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414026070 con 0x7f4424103240 2024-05-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.346+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44140058e0 con 0x7f4424103240 2024-05-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.346+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44241a4880 con 0x7f4424103240 2024-05-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.346+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441400fc30 con 0x7f4424103240 2024-05-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.346+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44241a4d60 con 0x7f4424103240 2024-05-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.347+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44240512c0 con 0x7f4424103240 2024-05-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.347+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f4414029070 con 0x7f4424103240 2024-05-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.348+0000 7f4420c00700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f440803e750 0x7f4408040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.348+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f44140536f0 con 0x7f4424103240 2024-05-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.348+0000 7f441aa00700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f440803e750 0x7f4408040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.349+0000 7f441aa00700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f440803e750 0x7f4408040c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f442419db40 tx=0x7f440c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.354+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4414013070 con 0x7f4424103240 2024-05-14T09:09:18.591 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 systemd[1]: Starting Ceph mgr.y for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:18.593+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4424100a10 con 0x7f440803e750 2024-05-14T09:09:18.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:18.360+0000 7f5a8a599200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T09:09:18.844 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 podman[36218]: 2024-05-14 09:09:18.497238808 +0000 UTC m=+0.035579410 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:09:18.844 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 podman[36218]: 2024-05-14 09:09:18.614729941 +0000 UTC m=+0.153070557 container create e61ff104d4bcfb878bb834eb8a2f9700cd67d21b3312a4e4c71605e39f30fc48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:09:18.844 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 podman[36218]: 2024-05-14 09:09:18.843861805 +0000 UTC m=+0.382202404 container init e61ff104d4bcfb878bb834eb8a2f9700cd67d21b3312a4e4c71605e39f30fc48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-05-14T09:09:19.129 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:18.746+0000 7f5a8a599200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T09:09:19.129 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:18.871+0000 7f5a8a599200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T09:09:19.170 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 podman[36218]: 2024-05-14 09:09:18.854095791 +0000 UTC m=+0.392436414 container start e61ff104d4bcfb878bb834eb8a2f9700cd67d21b3312a4e4c71605e39f30fc48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-14T09:09:19.170 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 bash[36218]: e61ff104d4bcfb878bb834eb8a2f9700cd67d21b3312a4e4c71605e39f30fc48 2024-05-14T09:09:19.170 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 systemd[1]: Started Ceph mgr.y for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:09:19.170 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:18 smithi152 ceph-mgr[36237]: -- 172.21.15.152:0/538382236 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630b53665a0 con 0x5630ba0f0480 2024-05-14T09:09:19.386 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:19.128+0000 7f5a8a599200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:19.169+0000 7f2c7557d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:19.430+0000 7f2c7557d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.432 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.682 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:19.682 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:19.682 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:09:19.683 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:09:19.683 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:19.683 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.683 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.683 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.683 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.708 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:19.564+0000 7f2c7557d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:19.385+0000 7f5a8a599200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:20.105 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:19.986+0000 7f2c7557d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T09:09:20.418 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:20.105+0000 7f2c7557d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T09:09:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:20.477 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:20.223+0000 7f5a8a599200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T09:09:20.521 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:20.521 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:20.706 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:20.706 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:20.945 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:20.527+0000 7f5a8a599200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T09:09:21.227 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:21.097+0000 7f5a8a599200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T09:09:21.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:21 smithi152 ceph-mon[34868]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:21.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.720 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:21.241+0000 7f5a8a599200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T09:09:21.720 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:21 smithi175 ceph-mon[35353]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:21.720 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.720 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.720 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.720 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:21 smithi120 ceph-mon[31085]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:21.977 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:21.719+0000 7f5a8a599200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T09:09:22.208 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:21.782+0000 7f2c7557d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T09:09:22.208 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:22.021+0000 7f2c7557d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T09:09:22.477 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:22.175+0000 7f5a8a599200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T09:09:22.477 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:22.302+0000 7f5a8a599200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T09:09:22.640 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:22.246+0000 7f2c7557d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T09:09:22.947 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:22.630+0000 7f5a8a599200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T09:09:22.947 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:22.814+0000 7f5a8a599200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T09:09:22.947 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:22.946+0000 7f5a8a599200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T09:09:22.958 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:22.640+0000 7f2c7557d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T09:09:22.958 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:22.768+0000 7f2c7557d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T09:09:23.284 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:23.024+0000 7f2c7557d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T09:09:23.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:23.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:23.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:23.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:23.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/425709383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb734948-7a05-48ee-b91b-f35370e93d82"}]: dispatch 2024-05-14T09:09:23.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/425709383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb734948-7a05-48ee-b91b-f35370e93d82"}]': finished 2024-05-14T09:09:23.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T09:09:23.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:23.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:23.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:23.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:23.708 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:23.284+0000 7f2c7557d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:09:23.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:23.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:23.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:23.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:23.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/425709383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb734948-7a05-48ee-b91b-f35370e93d82"}]: dispatch 2024-05-14T09:09:23.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/425709383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb734948-7a05-48ee-b91b-f35370e93d82"}]': finished 2024-05-14T09:09:23.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T09:09:23.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:23.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:23.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:23.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:23.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:23.352+0000 7f5a8a599200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T09:09:23.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:23.479+0000 7f5a8a599200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T09:09:23.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:23.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/425709383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb734948-7a05-48ee-b91b-f35370e93d82"}]: dispatch 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/425709383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb734948-7a05-48ee-b91b-f35370e93d82"}]': finished 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T09:09:23.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:24.371 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:24.080+0000 7f2c7557d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T09:09:24.416 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:24.273+0000 7f5a8a599200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T09:09:24.708 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:24.371+0000 7f2c7557d200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T09:09:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:24 smithi152 ceph-mon[34868]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T09:09:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:24 smithi152 ceph-mon[34868]: Reconfiguring daemon mgr.x on smithi120 2024-05-14T09:09:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:24 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2013077981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:09:24.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:09:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z[37071]: 2024-05-14T09:09:24.570+0000 7f5a8a599200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T09:09:24.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:24 smithi175 ceph-mon[35353]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T09:09:24.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:24 smithi175 ceph-mon[35353]: Reconfiguring daemon mgr.x on smithi120 2024-05-14T09:09:24.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:24 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2013077981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:09:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:24 smithi120 ceph-mon[31085]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T09:09:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:24 smithi120 ceph-mon[31085]: Reconfiguring daemon mgr.x on smithi120 2024-05-14T09:09:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:24 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2013077981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:09:25.208 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:24.942+0000 7f2c7557d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T09:09:25.209 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:25 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:25.082+0000 7f2c7557d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T09:09:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:25.458+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 14) ==== 99938+0+0 (secure 0 0 0) 0x7f4414009d10 con 0x7f4424103240 2024-05-14T09:09:25.708 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:25 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:25.554+0000 7f2c7557d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T09:09:25.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:25 smithi152 ceph-mon[34868]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:25.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:25 smithi152 ceph-mon[34868]: Standby manager daemon z started 2024-05-14T09:09:25.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:25 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T09:09:25.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:25 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T09:09:25.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:25 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T09:09:25.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:25 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T09:09:25.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:25 smithi175 ceph-mon[35353]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:25.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:25 smithi175 ceph-mon[35353]: Standby manager daemon z started 2024-05-14T09:09:25.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:25 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T09:09:25.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:25 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T09:09:25.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:25 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T09:09:25.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:25 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T09:09:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:25 smithi120 ceph-mon[31085]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:25 smithi120 ceph-mon[31085]: Standby manager daemon z started 2024-05-14T09:09:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:25 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T09:09:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:25 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T09:09:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:25 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T09:09:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:25 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.175:0/4127261879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T09:09:26.458 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:26.008+0000 7f2c7557d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T09:09:26.458 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:26.133+0000 7f2c7557d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T09:09:26.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:26 smithi175 ceph-mon[35353]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-14T09:09:26.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:26 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T09:09:26.774 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:26 smithi152 ceph-mon[34868]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-14T09:09:26.774 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:26 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T09:09:26.774 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:26.459+0000 7f2c7557d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T09:09:26.774 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:26.644+0000 7f2c7557d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T09:09:26.775 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:26.774+0000 7f2c7557d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T09:09:26.883 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:26 smithi120 ceph-mon[31085]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-14T09:09:26.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:26 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T09:09:27.458 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:27.179+0000 7f2c7557d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T09:09:27.458 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:27.307+0000 7f2c7557d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T09:09:27.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:27 smithi175 ceph-mon[35353]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:27.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:27 smithi120 ceph-mon[31085]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:27 smithi152 ceph-mon[34868]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:28.354 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:28.070+0000 7f2c7557d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T09:09:28.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:28.500+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mgrmap(e 15) ==== 149597+0+0 (secure 0 0 0) 0x7f4414003890 con 0x7f4424103240 2024-05-14T09:09:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:28 smithi120 ceph-mon[31085]: Standby manager daemon y started 2024-05-14T09:09:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:28 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T09:09:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:28 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T09:09:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:28 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T09:09:28.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:28 smithi120 ceph-mon[31085]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T09:09:28.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:28 smithi152 ceph-mon[34868]: Standby manager daemon y started 2024-05-14T09:09:28.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:28 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T09:09:28.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:28 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T09:09:28.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:28 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T09:09:28.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:28 smithi152 ceph-mon[34868]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T09:09:28.709 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:09:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y[36233]: 2024-05-14T09:09:28.353+0000 7f2c7557d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T09:09:28.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:28 smithi175 ceph-mon[35353]: Standby manager daemon y started 2024-05-14T09:09:28.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:28 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T09:09:28.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:28 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T09:09:28.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:28 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T09:09:28.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:28 smithi175 ceph-mon[35353]: from='mgr.? 172.21.15.152:0/2927515183' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T09:09:29.617 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:29 smithi120 ceph-mon[31085]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:29.617 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:29 smithi120 ceph-mon[31085]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-14T09:09:29.617 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T09:09:29.617 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:29.618 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:29.618 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:29 smithi152 ceph-mon[34868]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:29 smithi152 ceph-mon[34868]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-14T09:09:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T09:09:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:29.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:29.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:29.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:29 smithi175 ceph-mon[35353]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:29.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:29 smithi175 ceph-mon[35353]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-14T09:09:29.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T09:09:29.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:29.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:29.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:31.761 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:31 smithi152 ceph-mon[34868]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:31.761 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:31.761 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:31.774 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:31 smithi120 ceph-mon[31085]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:31.774 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:31.774 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:31.774 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:31 smithi175 ceph-mon[35353]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:33.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:33 smithi152 ceph-mon[34868]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:33.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:33 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T09:09:33.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:33 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:33.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:33 smithi152 ceph-mon[34868]: Deploying daemon osd.0 on smithi120 2024-05-14T09:09:33.821 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:33 smithi120 ceph-mon[31085]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:33.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:33 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T09:09:33.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:33 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:33.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:33 smithi120 ceph-mon[31085]: Deploying daemon osd.0 on smithi120 2024-05-14T09:09:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:33 smithi175 ceph-mon[35353]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:33 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T09:09:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:33 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:33 smithi175 ceph-mon[35353]: Deploying daemon osd.0 on smithi120 2024-05-14T09:09:35.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:35 smithi175 ceph-mon[35353]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:35.775 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:35 smithi120 ceph-mon[31085]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:35 smithi152 ceph-mon[34868]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:37 smithi120 ceph-mon[31085]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:37 smithi152 ceph-mon[34868]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:37 smithi175 ceph-mon[35353]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:39.855 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:39 smithi120 ceph-mon[31085]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:39.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:39 smithi175 ceph-mon[35353]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:39 smithi152 ceph-mon[34868]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:41.853 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:41 smithi120 ceph-mon[31085]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:41.853 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:41.853 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:41.853 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:41 smithi152 ceph-mon[34868]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:41 smithi175 ceph-mon[35353]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:43.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:43 smithi120 ceph-mon[31085]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:43.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:43 smithi152 ceph-mon[34868]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:43.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:43 smithi175 ceph-mon[35353]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:45.883 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:45 smithi120 ceph-mon[31085]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:45.883 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.883 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:45.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:45.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:45 smithi120 ceph-mon[31085]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T09:09:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:45 smithi152 ceph-mon[34868]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:45.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:45.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:45 smithi152 ceph-mon[34868]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T09:09:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:45 smithi175 ceph-mon[35353]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:45.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:45.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:45.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:45 smithi175 ceph-mon[35353]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T09:09:46.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.739+0000 7f4420c00700 1 -- 172.21.15.120:0/1739181113 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4424100a10 con 0x7f440803e750 2024-05-14T09:09:46.741 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 0 on host 'smithi120' 2024-05-14T09:09:46.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f440803e750 msgr2=0x7f4408040c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f440803e750 0x7f4408040c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f442419db40 tx=0x7f440c009260 comp rx=0 tx=0).stop 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 msgr2=0x7f442419ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f442419ca90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f441400b2e0 tx=0x7f441400ba60 comp rx=0 tx=0).stop 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 shutdown_connections 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f440803e750 0x7f4408040c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4424104d10 0x7f44241a3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4424103240 0x7f442419ca90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 --2- 172.21.15.120:0/1739181113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4424104370 0x7f442419cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 >> 172.21.15.120:0/1739181113 conn(0x7f44240fe880 msgr2=0x7f4424100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 shutdown_connections 2024-05-14T09:09:46.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:09:46.743+0000 7f442a400700 1 -- 172.21.15.120:0/1739181113 wait complete. 2024-05-14T09:09:46.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:46 smithi120 ceph-mon[31085]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T09:09:46.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:46 smithi120 ceph-mon[31085]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T09:09:46.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:46 smithi120 ceph-mon[31085]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:09:46.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:46 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:46 smithi152 ceph-mon[34868]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T09:09:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:46 smithi152 ceph-mon[34868]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T09:09:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:46 smithi152 ceph-mon[34868]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:09:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:46 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:46 smithi175 ceph-mon[35353]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T09:09:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:46 smithi175 ceph-mon[35353]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T09:09:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:46 smithi175 ceph-mon[35353]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:09:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:46 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:47.529 DEBUG:teuthology.orchestra.run.smithi120:osd.0> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.0.service 2024-05-14T09:09:47.534 INFO:tasks.cephadm:Deploying osd.1 on smithi152 with /dev/vg_nvme/lv_4... 2024-05-14T09:09:47.534 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:47.772 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:47.959 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: from='osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:09:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:48 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:09:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:48 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:09:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:48 smithi152 ceph-mon[34868]: osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] boot 2024-05-14T09:09:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:48 smithi152 ceph-mon[34868]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T09:09:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:48 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:48.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:48 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:09:48.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:48 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:09:48.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:48 smithi120 ceph-mon[31085]: osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] boot 2024-05-14T09:09:48.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:48 smithi120 ceph-mon[31085]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T09:09:48.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:48 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:48.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:48 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:09:48.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:48 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:09:48.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:48 smithi175 ceph-mon[35353]: osd.0 [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] boot 2024-05-14T09:09:48.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:48 smithi175 ceph-mon[35353]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T09:09:48.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:48 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T09:09:49.912 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:49 smithi152 ceph-mon[34868]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:49.912 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:49 smithi152 ceph-mon[34868]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T09:09:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:49 smithi175 ceph-mon[35353]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:49 smithi175 ceph-mon[35353]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T09:09:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:49 smithi120 ceph-mon[31085]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:49 smithi120 ceph-mon[31085]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T09:09:50.824 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T09:09:50.825 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T09:09:50.825 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2024-05-14T09:09:50.825 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2024-05-14T09:09:50.825 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0367934 s, 285 MB/s 2024-05-14T09:09:50.825 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2024-05-14T09:09:51.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2024-05-14T09:09:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:51 smithi152 ceph-mon[34868]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:51 smithi175 ceph-mon[35353]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:52.015 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:09:52.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:51 smithi120 ceph-mon[31085]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:53.430 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:53.430 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi120 2024-05-14T09:09:53.430 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.430 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:09:53.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi120 to 17089M 2024-05-14T09:09:53.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:53.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:53.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi120 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi120 to 17089M 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:53.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:53.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi120 2024-05-14T09:09:53.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:09:53.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi120 to 17089M 2024-05-14T09:09:53.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:53.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:53.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:09:53.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.253+0000 7fd46ce00700 1 -- 172.21.15.152:0/2274017382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd46810c1f0 msgr2=0x7fd46810e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.253+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2274017382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd46810c1f0 0x7fd46810e700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd460009990 tx=0x7fd460009ca0 comp rx=0 tx=0).stop 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.254+0000 7fd46ce00700 1 -- 172.21.15.152:0/2274017382 shutdown_connections 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.254+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2274017382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd46810c1f0 0x7fd46810e700 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.254+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2274017382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680776e0 0x7fd468075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.254+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2274017382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4680760f0 0x7fd468076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.254+0000 7fd46ce00700 1 -- 172.21.15.152:0/2274017382 >> 172.21.15.152:0/2274017382 conn(0x7fd4680ff9c0 msgr2=0x7fd468101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.254+0000 7fd46ce00700 1 -- 172.21.15.152:0/2274017382 shutdown_connections 2024-05-14T09:09:54.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.254+0000 7fd46ce00700 1 -- 172.21.15.152:0/2274017382 wait complete. 2024-05-14T09:09:54.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 Processor -- start 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 -- start start 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680760f0 0x7fd46819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4680776e0 0x7fd46819cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46810c1f0 0x7fd4681a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd468111ea0 con 0x7fd46810c1f0 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd468111d20 con 0x7fd4680776e0 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.255+0000 7fd46ce00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd468112020 con 0x7fd4680760f0 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.256+0000 7fd465e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680760f0 0x7fd46819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.256+0000 7fd465e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680760f0 0x7fd46819ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.152:35036/0 (socket says 172.21.15.152:35036) 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.256+0000 7fd465e00700 1 -- 172.21.15.152:0/2773598429 learned_addr learned my addr 172.21.15.152:0/2773598429 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.256+0000 7fd466800700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46810c1f0 0x7fd4681a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:54.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.256+0000 7fd45fe00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4680776e0 0x7fd46819cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:54.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd465e00700 1 -- 172.21.15.152:0/2773598429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4680776e0 msgr2=0x7fd46819cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:54.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd465e00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4680776e0 0x7fd46819cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:54.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd465e00700 1 -- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46810c1f0 msgr2=0x7fd4681a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd465e00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46810c1f0 0x7fd4681a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd465e00700 1 -- 172.21.15.152:0/2773598429 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4681a4570 con 0x7fd4680760f0 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd465e00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680760f0 0x7fd46819ca10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd458007f10 tx=0x7fd45800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd45ea00700 1 -- 172.21.15.152:0/2773598429 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45800dd20 con 0x7fd4680760f0 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.257+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4681a4860 con 0x7fd4680760f0 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.258+0000 7fd45ea00700 1 -- 172.21.15.152:0/2773598429 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd458018070 con 0x7fd4680760f0 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.258+0000 7fd45ea00700 1 -- 172.21.15.152:0/2773598429 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580125b0 con 0x7fd4680760f0 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.258+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4681a4df0 con 0x7fd4680760f0 2024-05-14T09:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.259+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4680512c0 con 0x7fd4680760f0 2024-05-14T09:09:54.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.263+0000 7fd45ea00700 1 -- 172.21.15.152:0/2773598429 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) ==== 149597+0+0 (secure 0 0 0) 0x7fd4580133f0 con 0x7fd4680760f0 2024-05-14T09:09:54.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.265+0000 7fd45ea00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd44c0b2870 0x7fd44c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:09:54.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.265+0000 7fd45ea00700 1 -- 172.21.15.152:0/2773598429 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fd4580e07f0 con 0x7fd4680760f0 2024-05-14T09:09:54.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.265+0000 7fd45fe00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd44c0b2870 0x7fd44c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:09:54.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.266+0000 7fd45fe00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd44c0b2870 0x7fd44c0b4d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd46819dac0 tx=0x7fd45000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:09:54.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.274+0000 7fd45ea00700 1 -- 172.21.15.152:0/2773598429 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd458010070 con 0x7fd4680760f0 2024-05-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:09:54.518+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd468063c00 con 0x7fd44c0b2870 2024-05-14T09:09:55.476 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:55 smithi152 ceph-mon[34868]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:55.476 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:55 smithi152 ceph-mon[34868]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:55.476 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:09:55.476 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:09:55.476 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:55.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:55 smithi175 ceph-mon[35353]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:55.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:55 smithi175 ceph-mon[35353]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:55.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:09:55.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:09:55.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:55.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:55 smithi120 ceph-mon[31085]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:55.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:55 smithi120 ceph-mon[31085]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:09:55.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:09:55.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:09:55.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:09:57.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:57 smithi175 ceph-mon[35353]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:57 smithi120 ceph-mon[31085]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:57 smithi152 ceph-mon[34868]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:59 smithi120 ceph-mon[31085]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:59 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/3979553084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]: dispatch 2024-05-14T09:09:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:59 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]: dispatch 2024-05-14T09:09:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:59 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]': finished 2024-05-14T09:09:59.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:59 smithi120 ceph-mon[31085]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T09:09:59.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:09:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:09:59.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:59 smithi152 ceph-mon[34868]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:59.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:59 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/3979553084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]: dispatch 2024-05-14T09:09:59.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:59 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]: dispatch 2024-05-14T09:09:59.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:59 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]': finished 2024-05-14T09:09:59.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:59 smithi152 ceph-mon[34868]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T09:09:59.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:09:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:09:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:59 smithi175 ceph-mon[35353]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:09:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:59 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/3979553084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]: dispatch 2024-05-14T09:09:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:59 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]: dispatch 2024-05-14T09:09:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:59 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a48da4c-1105-46af-9372-8403c631030d"}]': finished 2024-05-14T09:09:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:59 smithi175 ceph-mon[35353]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T09:09:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:09:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:00 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/1152764999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:10:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:00 smithi120 ceph-mon[31085]: overall HEALTH_OK 2024-05-14T09:10:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:00 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/1152764999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:10:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:00 smithi152 ceph-mon[34868]: overall HEALTH_OK 2024-05-14T09:10:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:00 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/1152764999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:10:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:00 smithi175 ceph-mon[35353]: overall HEALTH_OK 2024-05-14T09:10:01.609 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:01 smithi152 ceph-mon[34868]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:01 smithi120 ceph-mon[31085]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:01.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:01 smithi175 ceph-mon[35353]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:03.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:03 smithi152 ceph-mon[34868]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:03.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:03 smithi120 ceph-mon[31085]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:03 smithi175 ceph-mon[35353]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:05.368 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:05 smithi152 ceph-mon[34868]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:05 smithi120 ceph-mon[31085]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:05.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:05 smithi175 ceph-mon[35353]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:07 smithi120 ceph-mon[31085]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:07.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:07 smithi152 ceph-mon[34868]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:07.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:07 smithi175 ceph-mon[35353]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:08.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T09:10:08.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:08.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T09:10:08.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T09:10:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:09.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:09 smithi120 ceph-mon[31085]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:09.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:09 smithi120 ceph-mon[31085]: Deploying daemon osd.1 on smithi152 2024-05-14T09:10:09.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:09 smithi152 ceph-mon[34868]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:09.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:09 smithi152 ceph-mon[34868]: Deploying daemon osd.1 on smithi152 2024-05-14T09:10:09.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:09 smithi175 ceph-mon[35353]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:09.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:09 smithi175 ceph-mon[35353]: Deploying daemon osd.1 on smithi152 2024-05-14T09:10:11.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:11 smithi152 ceph-mon[34868]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:11 smithi120 ceph-mon[31085]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:11.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:11 smithi175 ceph-mon[35353]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:13.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:13 smithi120 ceph-mon[31085]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:13.694 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:13 smithi152 ceph-mon[34868]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:13.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:13 smithi175 ceph-mon[35353]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:15.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:15 smithi120 ceph-mon[31085]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:15.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:15 smithi152 ceph-mon[34868]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:15.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:15 smithi175 ceph-mon[35353]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:17.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:17 smithi120 ceph-mon[31085]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:17.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:17 smithi152 ceph-mon[34868]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:17.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:17 smithi175 ceph-mon[35353]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:18.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:18.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:18.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:18.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:18.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:18.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:19.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:19 smithi152 ceph-mon[34868]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:19 smithi120 ceph-mon[31085]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:19 smithi175 ceph-mon[35353]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:21 smithi120 ceph-mon[31085]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:21.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:21.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:21 smithi152 ceph-mon[34868]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:21 smithi175 ceph-mon[35353]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:22 smithi120 ceph-mon[31085]: from='osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T09:10:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:22 smithi120 ceph-mon[31085]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T09:10:22.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:22 smithi152 ceph-mon[34868]: from='osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T09:10:22.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:22 smithi152 ceph-mon[34868]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T09:10:22.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:22 smithi175 ceph-mon[35353]: from='osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T09:10:22.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:22 smithi175 ceph-mon[35353]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T09:10:23.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.130+0000 7fd45ea00700 1 -- 172.21.15.152:0/2773598429 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd468063c00 con 0x7fd44c0b2870 2024-05-14T09:10:23.130 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 1 on host 'smithi152' 2024-05-14T09:10:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.133+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd44c0b2870 msgr2=0x7fd44c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:10:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.133+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd44c0b2870 0x7fd44c0b4d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd46819dac0 tx=0x7fd45000b410 comp rx=0 tx=0).stop 2024-05-14T09:10:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.133+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680760f0 msgr2=0x7fd46819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:10:23.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.133+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680760f0 0x7fd46819ca10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd458007f10 tx=0x7fd45800d3b0 comp rx=0 tx=0).stop 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.133+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 shutdown_connections 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.133+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd44c0b2870 0x7fd44c0b4d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.133+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46810c1f0 0x7fd4681a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.134+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4680760f0 0x7fd46819ca10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.134+0000 7fd46ce00700 1 --2- 172.21.15.152:0/2773598429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4680776e0 0x7fd46819cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.134+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 >> 172.21.15.152:0/2773598429 conn(0x7fd4680ff9c0 msgr2=0x7fd468108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.134+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 shutdown_connections 2024-05-14T09:10:23.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:10:23.134+0000 7fd46ce00700 1 -- 172.21.15.152:0/2773598429 wait complete. 2024-05-14T09:10:23.879 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: from='osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:23.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T09:10:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T09:10:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: from='osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:10:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:10:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:23.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:23.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: from='osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:24.026 DEBUG:teuthology.orchestra.run.smithi152:osd.1> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.1.service 2024-05-14T09:10:24.031 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-05-14T09:10:24.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T09:10:24.454 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:10:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:24 smithi152 ceph-mon[34868]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:10:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:24 smithi152 ceph-mon[34868]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T09:10:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:24 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:24 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:24 smithi152 ceph-mon[34868]: from='osd.1 ' entity='osd.1' 2024-05-14T09:10:24.709 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:10:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1[39442]: 2024-05-14T09:10:24.401+0000 7f80ad000700 -1 osd.1 0 waiting for initial osdmap 2024-05-14T09:10:24.709 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:10:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1[39442]: 2024-05-14T09:10:24.422+0000 7f80a2e00700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:10:24.799 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:24 smithi175 ceph-mon[35353]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:10:24.801 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:24 smithi175 ceph-mon[35353]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T09:10:24.801 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:24 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:24.802 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:24 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:24.802 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:24 smithi175 ceph-mon[35353]: from='osd.1 ' entity='osd.1' 2024-05-14T09:10:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:24 smithi120 ceph-mon[31085]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:10:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:24 smithi120 ceph-mon[31085]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T09:10:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:24 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:24 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:24 smithi120 ceph-mon[31085]: from='osd.1 ' entity='osd.1' 2024-05-14T09:10:25.647 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:25 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:10:25.647 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:25 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:10:25.647 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:25 smithi175 ceph-mon[35353]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:25.647 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:25.647 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:25 smithi175 ceph-mon[35353]: osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] boot 2024-05-14T09:10:25.647 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:25 smithi175 ceph-mon[35353]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T09:10:25.647 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:25.790 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:25 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:10:25.791 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:25 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:10:25.791 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:25 smithi152 ceph-mon[34868]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:25.791 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:25.791 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:25 smithi152 ceph-mon[34868]: osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] boot 2024-05-14T09:10:25.791 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:25 smithi152 ceph-mon[34868]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T09:10:25.791 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:25 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:10:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:25 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:10:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:25 smithi120 ceph-mon[31085]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T09:10:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:25 smithi120 ceph-mon[31085]: osd.1 [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] boot 2024-05-14T09:10:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:25 smithi120 ceph-mon[31085]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T09:10:25.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T09:10:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T09:10:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T09:10:27.113 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-05-14T09:10:27.113 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-05-14T09:10:27.113 INFO:teuthology.orchestra.run.smithi175.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0349213 s, 300 MB/s 2024-05-14T09:10:27.113 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-05-14T09:10:27.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:27 smithi152 ceph-mon[34868]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:27.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:27 smithi152 ceph-mon[34868]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T09:10:27.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:27 smithi175 ceph-mon[35353]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:27.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:27 smithi175 ceph-mon[35353]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T09:10:27.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-05-14T09:10:27.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:27 smithi120 ceph-mon[31085]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:27.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:27 smithi120 ceph-mon[31085]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T09:10:28.255 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:10:29.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:29 smithi175 ceph-mon[35353]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:29.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:29 smithi120 ceph-mon[31085]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:29 smithi152 ceph-mon[34868]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:30.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.245+0000 7f7b72200700 1 -- 172.21.15.175:0/3888138857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ab10 msgr2=0x7f7b6c10af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:10:30.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.245+0000 7f7b72200700 1 --2- 172.21.15.175:0/3888138857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ab10 0x7f7b6c10af20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009990 tx=0x7f7b5c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:10:30.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.246+0000 7f7b72200700 1 -- 172.21.15.175:0/3888138857 shutdown_connections 2024-05-14T09:10:30.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.246+0000 7f7b72200700 1 --2- 172.21.15.175:0/3888138857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b6c10c420 0x7f7b6c112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:30.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.246+0000 7f7b72200700 1 --2- 172.21.15.175:0/3888138857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ab10 0x7f7b6c10af20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:30.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.246+0000 7f7b72200700 1 --2- 172.21.15.175:0/3888138857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b6c10ba80 0x7f7b6c10be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:30.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.246+0000 7f7b72200700 1 -- 172.21.15.175:0/3888138857 >> 172.21.15.175:0/3888138857 conn(0x7f7b6c0799c0 msgr2=0x7f7b6c07be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:10:30.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.246+0000 7f7b72200700 1 -- 172.21.15.175:0/3888138857 shutdown_connections 2024-05-14T09:10:30.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.246+0000 7f7b72200700 1 -- 172.21.15.175:0/3888138857 wait complete. 2024-05-14T09:10:30.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 Processor -- start 2024-05-14T09:10:30.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 -- start start 2024-05-14T09:10:30.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b6c10ab10 0x7f7b6c1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ba80 0x7f7b6c1a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b6c10c420 0x7f7b6c1a8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c1162b0 con 0x7f7b6c10ab10 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c116130 con 0x7f7b6c10c420 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.247+0000 7f7b72200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c116430 con 0x7f7b6c10ba80 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ba80 0x7f7b6c1a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ba80 0x7f7b6c1a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:57932/0 (socket says 172.21.15.175:57932) 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 -- 172.21.15.175:0/1632285005 learned_addr learned my addr 172.21.15.175:0/1632285005 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6b400700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b6c10ab10 0x7f7b6c1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6be00700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b6c10c420 0x7f7b6c1a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 -- 172.21.15.175:0/1632285005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b6c10c420 msgr2=0x7f7b6c1a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:10:30.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b6c10c420 0x7f7b6c1a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:30.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 -- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b6c10ab10 msgr2=0x7f7b6c1a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:10:30.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b6c10ab10 0x7f7b6c1a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:30.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6aa00700 1 -- 172.21.15.175:0/1632285005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c1a89e0 con 0x7f7b6c10ba80 2024-05-14T09:10:30.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.248+0000 7f7b6be00700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b6c10c420 0x7f7b6c1a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:10:30.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.249+0000 7f7b6aa00700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ba80 0x7f7b6c1a13c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800d980 tx=0x7f7b5800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:10:30.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.249+0000 7f7b63e00700 1 -- 172.21.15.175:0/1632285005 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b58017070 con 0x7f7b6c10ba80 2024-05-14T09:10:30.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.249+0000 7f7b63e00700 1 -- 172.21.15.175:0/1632285005 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b58005020 con 0x7f7b6c10ba80 2024-05-14T09:10:30.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.249+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6c1a8cd0 con 0x7f7b6c10ba80 2024-05-14T09:10:30.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.249+0000 7f7b63e00700 1 -- 172.21.15.175:0/1632285005 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b58009ab0 con 0x7f7b6c10ba80 2024-05-14T09:10:30.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.249+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6c1a91c0 con 0x7f7b6c10ba80 2024-05-14T09:10:30.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.251+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6c0512c0 con 0x7f7b6c10ba80 2024-05-14T09:10:30.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.255+0000 7f7b63e00700 1 -- 172.21.15.175:0/1632285005 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) ==== 149597+0+0 (secure 0 0 0) 0x7f7b580051d0 con 0x7f7b6c10ba80 2024-05-14T09:10:30.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.257+0000 7f7b63e00700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b500b2870 0x7f7b500b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:10:30.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.258+0000 7f7b63e00700 1 -- 172.21.15.175:0/1632285005 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f7b580e0cf0 con 0x7f7b6c10ba80 2024-05-14T09:10:30.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.258+0000 7f7b6b400700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b500b2870 0x7f7b500b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:10:30.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.259+0000 7f7b6b400700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b500b2870 0x7f7b500b4d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00b2e0 tx=0x7f7b5c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:10:30.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.259+0000 7f7b63e00700 1 -- 172.21.15.175:0/1632285005 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7b58020020 con 0x7f7b6c10ba80 2024-05-14T09:10:30.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:30.501+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7b6c063c00 con 0x7f7b500b2870 2024-05-14T09:10:31.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi152 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi152 to 17089M 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:10:31.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:10:31.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:31.437 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi152 2024-05-14T09:10:31.437 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:31.437 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.437 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi152 to 17089M 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:10:31.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:31.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi152 2024-05-14T09:10:31.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:31.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi152 to 17089M 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:10:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:10:31.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:10:31.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:33.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:33 smithi152 ceph-mon[34868]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:33.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:33 smithi175 ceph-mon[35353]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:33 smithi120 ceph-mon[31085]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:35.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:35 smithi152 ceph-mon[34868]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:35.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:35 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/2364992331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]: dispatch 2024-05-14T09:10:35.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:35 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]: dispatch 2024-05-14T09:10:35.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:35 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]': finished 2024-05-14T09:10:35.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:35 smithi152 ceph-mon[34868]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T09:10:35.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:35 smithi175 ceph-mon[35353]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:35 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/2364992331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]: dispatch 2024-05-14T09:10:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:35 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]: dispatch 2024-05-14T09:10:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:35 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]': finished 2024-05-14T09:10:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:35 smithi175 ceph-mon[35353]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T09:10:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:35 smithi120 ceph-mon[31085]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:35 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/2364992331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]: dispatch 2024-05-14T09:10:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:35 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]: dispatch 2024-05-14T09:10:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:35 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "faf13568-1e16-4349-b77f-ad12a08ef3ec"}]': finished 2024-05-14T09:10:35.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:35 smithi120 ceph-mon[31085]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T09:10:35.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:36 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/1120629769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:10:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:36 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/1120629769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:10:36.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:36 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/1120629769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:10:37.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:37 smithi152 ceph-mon[34868]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:37.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:37 smithi175 ceph-mon[35353]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:37.535 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:37 smithi120 ceph-mon[31085]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:39.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:39 smithi152 ceph-mon[34868]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:39.474 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:39 smithi175 ceph-mon[35353]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:39.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:39 smithi120 ceph-mon[31085]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:41.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:41 smithi152 ceph-mon[34868]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:41.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:41 smithi175 ceph-mon[35353]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:41.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:41 smithi120 ceph-mon[31085]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:43.443 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:43 smithi175 ceph-mon[35353]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:43.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:43 smithi152 ceph-mon[34868]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:43.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:43 smithi120 ceph-mon[31085]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T09:10:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:44 smithi152 ceph-mon[34868]: Deploying daemon osd.2 on smithi175 2024-05-14T09:10:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T09:10:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:44 smithi175 ceph-mon[35353]: Deploying daemon osd.2 on smithi175 2024-05-14T09:10:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T09:10:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:44 smithi120 ceph-mon[31085]: Deploying daemon osd.2 on smithi175 2024-05-14T09:10:45.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:45 smithi152 ceph-mon[34868]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:45.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:45 smithi175 ceph-mon[35353]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:45.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:45 smithi120 ceph-mon[31085]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:47.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:47 smithi152 ceph-mon[34868]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:47.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:47 smithi175 ceph-mon[35353]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:47.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:47 smithi120 ceph-mon[31085]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:49.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:49 smithi175 ceph-mon[35353]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:49.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:49 smithi120 ceph-mon[31085]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:49.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:49 smithi152 ceph-mon[34868]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:51.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:51 smithi175 ceph-mon[35353]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:51.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:51 smithi120 ceph-mon[31085]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:51.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:51 smithi152 ceph-mon[34868]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:53.778 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:53 smithi175 ceph-mon[35353]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:53.779 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:53.779 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:53.779 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:53.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:53 smithi120 ceph-mon[31085]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:53.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:53.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:53.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:53.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:53 smithi152 ceph-mon[34868]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:53.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:53.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:53.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:55 smithi120 ceph-mon[31085]: pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:55.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:55 smithi152 ceph-mon[34868]: pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:55.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:55 smithi175 ceph-mon[35353]: pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:56.940 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:56.940 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:56.940 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:56 smithi175 ceph-mon[35353]: from='osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T09:10:56.940 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:56 smithi175 ceph-mon[35353]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T09:10:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:56 smithi120 ceph-mon[31085]: from='osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T09:10:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:56 smithi120 ceph-mon[31085]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T09:10:57.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:57.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:57.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:56 smithi152 ceph-mon[34868]: from='osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T09:10:57.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:56 smithi152 ceph-mon[34868]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T09:10:57.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.764+0000 7f7b63e00700 1 -- 172.21.15.175:0/1632285005 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7b6c063c00 con 0x7f7b500b2870 2024-05-14T09:10:57.767 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-05-14T09:10:57.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b500b2870 msgr2=0x7f7b500b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:10:57.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b500b2870 0x7f7b500b4d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00b2e0 tx=0x7f7b5c01a040 comp rx=0 tx=0).stop 2024-05-14T09:10:57.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ba80 msgr2=0x7f7b6c1a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:10:57.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ba80 0x7f7b6c1a13c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800d980 tx=0x7f7b5800dc90 comp rx=0 tx=0).stop 2024-05-14T09:10:57.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 shutdown_connections 2024-05-14T09:10:57.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b500b2870 0x7f7b500b4d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:57.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b6c10c420 0x7f7b6c1a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:57.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b6c10ab10 0x7f7b6c1a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:57.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 --2- 172.21.15.175:0/1632285005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b6c10ba80 0x7f7b6c1a13c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:10:57.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 >> 172.21.15.175:0/1632285005 conn(0x7f7b6c0799c0 msgr2=0x7f7b6c10ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:10:57.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 shutdown_connections 2024-05-14T09:10:57.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:10:57.768+0000 7f7b72200700 1 -- 172.21.15.175:0/1632285005 wait complete. 2024-05-14T09:10:57.895 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:57.895 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T09:10:57.895 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T09:10:57.895 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:57.895 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:10:57.896 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:10:57.896 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:57.896 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:57.896 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:57.896 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:57.896 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:57.896 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T09:10:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:58.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:10:58.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:10:58.508 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.2.service 2024-05-14T09:10:58.514 INFO:tasks.cephadm:Deploying osd.3 on smithi120 with /dev/vg_nvme/lv_3... 2024-05-14T09:10:58.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T09:10:58.972 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:10:59.078 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:58 smithi175 ceph-mon[35353]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:10:59.078 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:58 smithi175 ceph-mon[35353]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T09:10:59.078 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:59.078 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:59.078 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:58 smithi175 ceph-mon[35353]: pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:59.202 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:58 smithi120 ceph-mon[31085]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:10:59.203 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:58 smithi120 ceph-mon[31085]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T09:10:59.203 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:59.203 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:59.203 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:58 smithi120 ceph-mon[31085]: pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:10:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:58 smithi152 ceph-mon[34868]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:10:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:58 smithi152 ceph-mon[34868]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T09:10:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:10:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:58 smithi152 ceph-mon[34868]: pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-14T09:11:00.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:59 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:11:00.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:59 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:11:00.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:11:00.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:59 smithi175 ceph-mon[35353]: osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] boot 2024-05-14T09:11:00.092 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:59 smithi175 ceph-mon[35353]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T09:11:00.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:10:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:11:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:59 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:11:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:59 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:11:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:11:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:59 smithi152 ceph-mon[34868]: osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] boot 2024-05-14T09:11:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:59 smithi152 ceph-mon[34868]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T09:11:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:10:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:11:00.213 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:59 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:11:00.213 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:59 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:11:00.213 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:11:00.213 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:59 smithi120 ceph-mon[31085]: osd.2 [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] boot 2024-05-14T09:11:00.213 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:59 smithi120 ceph-mon[31085]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T09:11:00.213 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:10:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T09:11:01.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:00 smithi120 ceph-mon[31085]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T09:11:01.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:00 smithi120 ceph-mon[31085]: pgmap v109: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:01.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:00 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T09:11:01.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:00 smithi152 ceph-mon[34868]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T09:11:01.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:00 smithi152 ceph-mon[34868]: pgmap v109: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:01.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:00 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T09:11:01.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:00 smithi175 ceph-mon[35353]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T09:11:01.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:00 smithi175 ceph-mon[35353]: pgmap v109: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:01.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:00 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T09:11:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T09:11:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T09:11:01.783 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-05-14T09:11:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-05-14T09:11:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0353445 s, 297 MB/s 2024-05-14T09:11:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-05-14T09:11:02.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T09:11:02.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:01 smithi120 ceph-mon[31085]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T09:11:02.096 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T09:11:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T09:11:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:01 smithi152 ceph-mon[34868]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T09:11:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T09:11:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T09:11:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:01 smithi175 ceph-mon[35353]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T09:11:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T09:11:02.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49398]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T09:11:02.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49398]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49398]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49398]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:02.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49401]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T09:11:02.386 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49401]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.386 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49401]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.386 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49401]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:02.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_3 2024-05-14T09:11:02.708 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43176]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T09:11:02.708 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43176]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.708 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43176]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.708 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43176]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:02.709 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43179]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T09:11:02.709 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43179]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.709 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43179]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.709 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43179]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44440]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44440]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44440]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44440]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44443]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44443]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44443]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.773 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44443]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:02.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49412]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T09:11:02.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49412]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49412]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49412]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:02.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49431]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T09:11:02.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49431]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:02.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49431]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:02.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 sudo[49431]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:03.081 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:11:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43182]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T09:11:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43182]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43182]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43182]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43185]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T09:11:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43185]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43185]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 sudo[43185]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: pgmap v112: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44446]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T09:11:03.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44446]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:03.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44446]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:03.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44446]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:03.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44449]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44449]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44449]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 sudo[44449]: pam_unix(sudo:session): session closed for user root 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: pgmap v112: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:03.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.243 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T09:11:03.243 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T09:11:03.243 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: pgmap v112: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:03.243 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T09:11:03.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T09:11:03.245 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: osdmap e22: 3 total, 3 up, 3 in 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi175 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:04.285 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi175 to 17089M 2024-05-14T09:11:04.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:04.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:04.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: osdmap e22: 3 total, 3 up, 3 in 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi175 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi175 to 17089M 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: osdmap e22: 3 total, 3 up, 3 in 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi175 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi175 to 17089M 2024-05-14T09:11:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:04.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:04.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:04.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:05.214 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:04 smithi120 ceph-mon[31085]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:05.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:04 smithi152 ceph-mon[34868]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:05.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 -- 172.21.15.120:0/4017682640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4104340 msgr2=0x7ff0f4104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 --2- 172.21.15.120:0/4017682640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4104340 0x7ff0f4104750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400b0a0 tx=0x7ff0e400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 -- 172.21.15.120:0/4017682640 shutdown_connections 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 --2- 172.21.15.120:0/4017682640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4105e10 0x7ff0f410c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 --2- 172.21.15.120:0/4017682640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4104340 0x7ff0f4104750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 --2- 172.21.15.120:0/4017682640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4105470 0x7ff0f4105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 -- 172.21.15.120:0/4017682640 >> 172.21.15.120:0/4017682640 conn(0x7ff0f40ff9c0 msgr2=0x7ff0f4101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 -- 172.21.15.120:0/4017682640 shutdown_connections 2024-05-14T09:11:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.461+0000 7ff0f9000700 1 -- 172.21.15.120:0/4017682640 wait complete. 2024-05-14T09:11:05.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.462+0000 7ff0f9000700 1 Processor -- start 2024-05-14T09:11:05.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.462+0000 7ff0f9000700 1 -- start start 2024-05-14T09:11:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f9000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4104340 0x7ff0f40773f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f9000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4105470 0x7ff0f4075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f9000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4105e10 0x7ff0f4076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f9000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410fc30 con 0x7ff0f4105470 2024-05-14T09:11:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f9000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410fab0 con 0x7ff0f4105e10 2024-05-14T09:11:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f9000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410fdb0 con 0x7ff0f4104340 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4105470 0x7ff0f4075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4105470 0x7ff0f4075b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40268/0 (socket says 172.21.15.120:40268) 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.463+0000 7ff0f1400700 1 -- 172.21.15.120:0/779393012 learned_addr learned my addr 172.21.15.120:0/779393012 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f1e00700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4104340 0x7ff0f40773f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f2800700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4105e10 0x7ff0f4076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f1400700 1 -- 172.21.15.120:0/779393012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4104340 msgr2=0x7ff0f40773f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f1400700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4104340 0x7ff0f40773f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f1400700 1 -- 172.21.15.120:0/779393012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4105e10 msgr2=0x7ff0f4076050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f1400700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4105e10 0x7ff0f4076050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f1400700 1 -- 172.21.15.120:0/779393012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f4076750 con 0x7ff0f4105470 2024-05-14T09:11:05.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0f1400700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4105470 0x7ff0f4075b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c920 tx=0x7ff0e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:11:05.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.464+0000 7ff0eaa00700 1 -- 172.21.15.120:0/779393012 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0007b00 con 0x7ff0f4105470 2024-05-14T09:11:05.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.465+0000 7ff0eaa00700 1 -- 172.21.15.120:0/779393012 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0e0004cc0 con 0x7ff0f4105470 2024-05-14T09:11:05.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.465+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f41a4990 con 0x7ff0f4105470 2024-05-14T09:11:05.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.465+0000 7ff0eaa00700 1 -- 172.21.15.120:0/779393012 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00054f0 con 0x7ff0f4105470 2024-05-14T09:11:05.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.465+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f41a4e40 con 0x7ff0f4105470 2024-05-14T09:11:05.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.466+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f40512c0 con 0x7ff0f4105470 2024-05-14T09:11:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.468+0000 7ff0eaa00700 1 -- 172.21.15.120:0/779393012 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7ff0e0007ca0 con 0x7ff0f4105470 2024-05-14T09:11:05.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.470+0000 7ff0eaa00700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0d80b2900 0x7ff0d80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:05.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.470+0000 7ff0eaa00700 1 -- 172.21.15.120:0/779393012 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3237+0+0 (secure 0 0 0) 0x7ff0e00e0a90 con 0x7ff0f4105470 2024-05-14T09:11:05.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.470+0000 7ff0f1e00700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0d80b2900 0x7ff0d80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:05.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.471+0000 7ff0f1e00700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0d80b2900 0x7ff0d80b4e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009fd0 tx=0x7ff0e400b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:11:05.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.475+0000 7ff0eaa00700 1 -- 172.21.15.120:0/779393012 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff0e0014030 con 0x7ff0f4105470 2024-05-14T09:11:05.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:04 smithi175 ceph-mon[35353]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:05.717+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff0f4063c00 con 0x7ff0d80b2900 2024-05-14T09:11:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:06 smithi120 ceph-mon[31085]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:11:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:11:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:11:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:06 smithi152 ceph-mon[34868]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:11:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:11:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:11:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:06 smithi175 ceph-mon[35353]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:11:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:11:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:11:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:07.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:07 smithi120 ceph-mon[31085]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:07.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:07 smithi152 ceph-mon[34868]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:07 smithi175 ceph-mon[35353]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:09.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:09 smithi152 ceph-mon[34868]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:09.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:09 smithi175 ceph-mon[35353]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:09.485 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:09 smithi120 ceph-mon[31085]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:10 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4248832782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc6567b9-b095-481f-b68a-95e8119e71a1"}]: dispatch 2024-05-14T09:11:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:10 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4248832782' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc6567b9-b095-481f-b68a-95e8119e71a1"}]': finished 2024-05-14T09:11:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:10 smithi152 ceph-mon[34868]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T09:11:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:10 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4248832782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc6567b9-b095-481f-b68a-95e8119e71a1"}]: dispatch 2024-05-14T09:11:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:10 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4248832782' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc6567b9-b095-481f-b68a-95e8119e71a1"}]': finished 2024-05-14T09:11:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:10 smithi175 ceph-mon[35353]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T09:11:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:10.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:10 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4248832782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc6567b9-b095-481f-b68a-95e8119e71a1"}]: dispatch 2024-05-14T09:11:10.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:10 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4248832782' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc6567b9-b095-481f-b68a-95e8119e71a1"}]': finished 2024-05-14T09:11:10.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:10 smithi120 ceph-mon[31085]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T09:11:10.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:11.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:11 smithi152 ceph-mon[34868]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:11.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:11 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/262512504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:11:11.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:11 smithi175 ceph-mon[35353]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:11.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:11 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/262512504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:11:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:11 smithi120 ceph-mon[31085]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:11 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/262512504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:11:13.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:13 smithi152 ceph-mon[34868]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:13.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:13 smithi175 ceph-mon[35353]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:13.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:13 smithi120 ceph-mon[31085]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:15.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:15 smithi120 ceph-mon[31085]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:15.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:15 smithi152 ceph-mon[34868]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:15.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:15 smithi175 ceph-mon[35353]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:17.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:17 smithi175 ceph-mon[35353]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:17.499 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:17 smithi120 ceph-mon[31085]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:17.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:17 smithi152 ceph-mon[34868]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:19.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:19 smithi175 ceph-mon[35353]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:19.545 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:19 smithi120 ceph-mon[31085]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:19.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:19 smithi152 ceph-mon[34868]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:20.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T09:11:20.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:20.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:20 smithi120 ceph-mon[31085]: Deploying daemon osd.3 on smithi120 2024-05-14T09:11:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T09:11:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:20 smithi152 ceph-mon[34868]: Deploying daemon osd.3 on smithi120 2024-05-14T09:11:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T09:11:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:20 smithi175 ceph-mon[35353]: Deploying daemon osd.3 on smithi120 2024-05-14T09:11:21.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:21 smithi120 ceph-mon[31085]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:21.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:21 smithi152 ceph-mon[34868]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:21.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:21 smithi175 ceph-mon[35353]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:23.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:23 smithi120 ceph-mon[31085]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:23.530 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:23 smithi175 ceph-mon[35353]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:23.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:23 smithi152 ceph-mon[34868]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:25.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:25 smithi175 ceph-mon[35353]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:25.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:25 smithi120 ceph-mon[31085]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:25.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:25 smithi152 ceph-mon[34868]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:27.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:27 smithi120 ceph-mon[31085]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:27.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:27 smithi152 ceph-mon[34868]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:27.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:27 smithi175 ceph-mon[35353]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:29 smithi120 ceph-mon[31085]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:29.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:29 smithi152 ceph-mon[34868]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:29.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:29.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:29 smithi175 ceph-mon[35353]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:29.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:30.524 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:30.524 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:11:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:11:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:11:31.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:31 smithi120 ceph-mon[31085]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:31.609 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:31 smithi152 ceph-mon[34868]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:31.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:31 smithi175 ceph-mon[35353]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:33 smithi120 ceph-mon[31085]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:33 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:33 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:33.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:33 smithi152 ceph-mon[34868]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:33.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:33 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:33.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:33 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:33.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:33 smithi175 ceph-mon[35353]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:33.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:33 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:33.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:33 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:34 smithi120 ceph-mon[31085]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T09:11:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:34.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:34.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:34 smithi152 ceph-mon[34868]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T09:11:34.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:34.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:34.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:34 smithi175 ceph-mon[35353]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T09:11:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:34.972 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 3 on host 'smithi120' 2024-05-14T09:11:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.971+0000 7ff0eaa00700 1 -- 172.21.15.120:0/779393012 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff0f4063c00 con 0x7ff0d80b2900 2024-05-14T09:11:34.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0d80b2900 msgr2=0x7ff0d80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:34.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0d80b2900 0x7ff0d80b4e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009fd0 tx=0x7ff0e400b7b0 comp rx=0 tx=0).stop 2024-05-14T09:11:34.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4105470 msgr2=0x7ff0f4075b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:34.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4105470 0x7ff0f4075b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c920 tx=0x7ff0e000cce0 comp rx=0 tx=0).stop 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 shutdown_connections 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0d80b2900 0x7ff0d80b4e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4105e10 0x7ff0f4076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4104340 0x7ff0f40773f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 --2- 172.21.15.120:0/779393012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f4105470 0x7ff0f4075b10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 >> 172.21.15.120:0/779393012 conn(0x7ff0f40ff9c0 msgr2=0x7ff0f41086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 shutdown_connections 2024-05-14T09:11:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:11:34.975+0000 7ff0f9000700 1 -- 172.21.15.120:0/779393012 wait complete. 2024-05-14T09:11:35.592 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:35.593 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T09:11:35.593 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T09:11:35.593 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:11:35.593 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:35.593 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:35.593 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:11:35.593 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:11:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:35.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:35.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T09:11:35.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T09:11:35.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:11:35.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:35.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:35.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:11:35.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:35.870 DEBUG:teuthology.orchestra.run.smithi120:osd.3> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.3.service 2024-05-14T09:11:35.874 INFO:tasks.cephadm:Deploying osd.4 on smithi152 with /dev/vg_nvme/lv_3... 2024-05-14T09:11:35.874 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T09:11:36.314 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:11:36.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:36 smithi120 ceph-mon[31085]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:11:36.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:36 smithi120 ceph-mon[31085]: osdmap e25: 4 total, 3 up, 4 in 2024-05-14T09:11:36.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:36.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:36.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:36 smithi120 ceph-mon[31085]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' 2024-05-14T09:11:36.480 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:11:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:11:36.183+0000 7f7386800700 -1 osd.3 0 waiting for initial osdmap 2024-05-14T09:11:36.480 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:11:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:11:36.208+0000 7f737c600700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:11:36.653 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:36 smithi152 ceph-mon[34868]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:11:36.653 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:36 smithi152 ceph-mon[34868]: osdmap e25: 4 total, 3 up, 4 in 2024-05-14T09:11:36.653 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:36.653 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:36.654 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:36 smithi152 ceph-mon[34868]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' 2024-05-14T09:11:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:36 smithi175 ceph-mon[35353]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:11:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:36 smithi175 ceph-mon[35353]: osdmap e25: 4 total, 3 up, 4 in 2024-05-14T09:11:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:36.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:36 smithi175 ceph-mon[35353]: from='osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533]' entity='osd.3' 2024-05-14T09:11:37.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:37 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:11:37.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:37 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:11:37.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:37 smithi120 ceph-mon[31085]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:37.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:37.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:37 smithi120 ceph-mon[31085]: osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] boot 2024-05-14T09:11:37.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:37 smithi120 ceph-mon[31085]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T09:11:37.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:37.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:37 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:11:37.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:37 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:11:37.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:37 smithi152 ceph-mon[34868]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:37.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:37.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:37 smithi152 ceph-mon[34868]: osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] boot 2024-05-14T09:11:37.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:37 smithi152 ceph-mon[34868]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T09:11:37.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:37.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:37 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:11:37.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:37 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:11:37.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:37 smithi175 ceph-mon[35353]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-14T09:11:37.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:37.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:37 smithi175 ceph-mon[35353]: osd.3 [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] boot 2024-05-14T09:11:37.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:37 smithi175 ceph-mon[35353]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T09:11:37.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T09:11:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:38 smithi120 ceph-mon[31085]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T09:11:38.649 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:38 smithi152 ceph-mon[34868]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T09:11:38.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:38 smithi175 ceph-mon[35353]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T09:11:39.281 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T09:11:39.282 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T09:11:39.282 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2024-05-14T09:11:39.282 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2024-05-14T09:11:39.282 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0310107 s, 338 MB/s 2024-05-14T09:11:39.282 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2024-05-14T09:11:39.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:39 smithi120 ceph-mon[31085]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:39.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:39 smithi120 ceph-mon[31085]: osdmap e28: 4 total, 4 up, 4 in 2024-05-14T09:11:39.653 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:39 smithi152 ceph-mon[34868]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:39.653 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:39 smithi152 ceph-mon[34868]: osdmap e28: 4 total, 4 up, 4 in 2024-05-14T09:11:39.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:39 smithi175 ceph-mon[35353]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:39.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:39 smithi175 ceph-mon[35353]: osdmap e28: 4 total, 4 up, 4 in 2024-05-14T09:11:40.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2024-05-14T09:11:40.567 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:11:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi120 2024-05-14T09:11:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:41.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi120 to 8544M 2024-05-14T09:11:41.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:41.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:41.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:41.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi120 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi120 to 8544M 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi120 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi120 to 8544M 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:11:42.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 -- 172.21.15.152:0/2168662303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0105e10 msgr2=0x7f3fb010c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 --2- 172.21.15.152:0/2168662303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0105e10 0x7f3fb010c6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800b0a0 tx=0x7f3fa800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 -- 172.21.15.152:0/2168662303 shutdown_connections 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 --2- 172.21.15.152:0/2168662303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0105e10 0x7f3fb010c6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 --2- 172.21.15.152:0/2168662303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fb0104340 0x7f3fb0104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 --2- 172.21.15.152:0/2168662303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb0105470 0x7f3fb0105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 -- 172.21.15.152:0/2168662303 >> 172.21.15.152:0/2168662303 conn(0x7f3fb00ff9c0 msgr2=0x7f3fb0101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 -- 172.21.15.152:0/2168662303 shutdown_connections 2024-05-14T09:11:42.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.867+0000 7f3fb5600700 1 -- 172.21.15.152:0/2168662303 wait complete. 2024-05-14T09:11:42.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.868+0000 7f3fb5600700 1 Processor -- start 2024-05-14T09:11:42.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.868+0000 7f3fb5600700 1 -- start start 2024-05-14T09:11:42.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3fb5600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0104340 0x7f3fb019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:42.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3fb5600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fb0105470 0x7f3fb019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:42.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3fb5600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb0105e10 0x7f3fb01a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:42.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3fb5600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb010fca0 con 0x7f3fb0105e10 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3fb5600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb010fb20 con 0x7f3fb0104340 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3fb5600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb010fe20 con 0x7f3fb0105470 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faea00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0104340 0x7f3fb019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faea00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0104340 0x7f3fb019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42296/0 (socket says 172.21.15.152:42296) 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faea00700 1 -- 172.21.15.152:0/1935528130 learned_addr learned my addr 172.21.15.152:0/1935528130 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faf400700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb0105e10 0x7f3fb01a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3fae000700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fb0105470 0x7f3fb019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faea00700 1 -- 172.21.15.152:0/1935528130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fb0105470 msgr2=0x7f3fb019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faea00700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fb0105470 0x7f3fb019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faea00700 1 -- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb0105e10 msgr2=0x7f3fb01a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.869+0000 7f3faea00700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb0105e10 0x7f3fb01a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3faea00700 1 -- 172.21.15.152:0/1935528130 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb01a2200 con 0x7f3fb0104340 2024-05-14T09:11:42.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3faf400700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb0105e10 0x7f3fb01a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:11:42.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3fae000700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fb0105470 0x7f3fb019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:11:42.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3faea00700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0104340 0x7f3fb019a730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c970 tx=0x7f3fa000cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:11:42.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3fa7400700 1 -- 172.21.15.152:0/1935528130 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0007b00 con 0x7f3fb0104340 2024-05-14T09:11:42.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3fa7400700 1 -- 172.21.15.152:0/1935528130 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fa0007ca0 con 0x7f3fb0104340 2024-05-14T09:11:42.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3fa7400700 1 -- 172.21.15.152:0/1935528130 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0018660 con 0x7f3fb0104340 2024-05-14T09:11:42.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb01a24f0 con 0x7f3fb0104340 2024-05-14T09:11:42.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.870+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb01a29e0 con 0x7f3fb0104340 2024-05-14T09:11:42.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.871+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb00512c0 con 0x7f3fb0104340 2024-05-14T09:11:42.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.874+0000 7f3fa7400700 1 -- 172.21.15.152:0/1935528130 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f3fa0004030 con 0x7f3fb0104340 2024-05-14T09:11:42.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.876+0000 7f3fa7400700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3f940b2880 0x7f3f940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:11:42.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.876+0000 7f3fa7400700 1 -- 172.21.15.152:0/1935528130 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f3fa00e1140 con 0x7f3fb0104340 2024-05-14T09:11:42.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.876+0000 7f3fae000700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3f940b2880 0x7f3f940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:11:42.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.878+0000 7f3fae000700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3f940b2880 0x7f3f940b4d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c005fd0 tx=0x7f3f9c005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:11:42.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:42.879+0000 7f3fa7400700 1 -- 172.21.15.152:0/1935528130 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3fa0014030 con 0x7f3fb0104340 2024-05-14T09:11:43.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:11:43.121+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3fb0063c00 con 0x7f3f940b2880 2024-05-14T09:11:44.090 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:43 smithi152 ceph-mon[34868]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:11:44.091 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:11:44.091 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:11:44.091 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:43 smithi120 ceph-mon[31085]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:11:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:11:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:11:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:43 smithi175 ceph-mon[35353]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:11:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:11:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:11:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:45.114 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:44 smithi152 ceph-mon[34868]: from='client.34193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:11:45.133 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:44 smithi120 ceph-mon[31085]: from='client.34193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:11:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:44 smithi175 ceph-mon[35353]: from='client.34193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:11:46.102 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:45 smithi152 ceph-mon[34868]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-14T09:11:46.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:45 smithi120 ceph-mon[31085]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-14T09:11:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:45 smithi175 ceph-mon[35353]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-14T09:11:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:47 smithi120 ceph-mon[31085]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T09:11:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:47 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/2262308213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]: dispatch 2024-05-14T09:11:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:47 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]: dispatch 2024-05-14T09:11:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:47 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]': finished 2024-05-14T09:11:48.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:47 smithi120 ceph-mon[31085]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T09:11:48.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:11:48.174 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:47 smithi152 ceph-mon[34868]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T09:11:48.175 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:47 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/2262308213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]: dispatch 2024-05-14T09:11:48.175 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:47 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]: dispatch 2024-05-14T09:11:48.175 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:47 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]': finished 2024-05-14T09:11:48.175 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:47 smithi152 ceph-mon[34868]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T09:11:48.175 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:11:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:47 smithi175 ceph-mon[35353]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T09:11:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:47 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/2262308213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]: dispatch 2024-05-14T09:11:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:47 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]: dispatch 2024-05-14T09:11:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:47 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d112625-503e-4906-8165-24025f4bd184"}]': finished 2024-05-14T09:11:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:47 smithi175 ceph-mon[35353]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T09:11:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:11:49.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:48 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/877010099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:11:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:48 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/877010099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:11:49.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:48 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/877010099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:11:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:49 smithi120 ceph-mon[31085]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:11:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:49 smithi152 ceph-mon[34868]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:11:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:49 smithi175 ceph-mon[35353]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:11:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:51 smithi120 ceph-mon[31085]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:11:52.135 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:51 smithi152 ceph-mon[34868]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:11:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:51 smithi175 ceph-mon[35353]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:11:54.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:53 smithi152 ceph-mon[34868]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:53 smithi175 ceph-mon[35353]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:53 smithi120 ceph-mon[31085]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:55.109 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:54 smithi152 ceph-mon[34868]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:55.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:54 smithi175 ceph-mon[35353]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:55.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:54 smithi120 ceph-mon[31085]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:57.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:57 smithi152 ceph-mon[34868]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:57.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T09:11:57.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:57.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:57 smithi175 ceph-mon[35353]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:57.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T09:11:57.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:57 smithi120 ceph-mon[31085]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T09:11:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:11:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:58 smithi152 ceph-mon[34868]: Deploying daemon osd.4 on smithi152 2024-05-14T09:11:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:58 smithi175 ceph-mon[35353]: Deploying daemon osd.4 on smithi152 2024-05-14T09:11:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:58 smithi120 ceph-mon[31085]: Deploying daemon osd.4 on smithi152 2024-05-14T09:11:59.357 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:11:59 smithi152 ceph-mon[34868]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:59.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:11:59 smithi175 ceph-mon[35353]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:11:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:11:59 smithi120 ceph-mon[31085]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:01.415 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:01 smithi152 ceph-mon[34868]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:01.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:01 smithi175 ceph-mon[35353]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:01 smithi120 ceph-mon[31085]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:03.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:03 smithi152 ceph-mon[34868]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:03.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:03 smithi120 ceph-mon[31085]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:03 smithi175 ceph-mon[35353]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:05 smithi120 ceph-mon[31085]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:05.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:05 smithi152 ceph-mon[34868]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:05.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:05 smithi175 ceph-mon[35353]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:07.852 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:07 smithi152 ceph-mon[34868]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:07.852 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:07.852 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:07.852 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:07 smithi120 ceph-mon[31085]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:07 smithi175 ceph-mon[35353]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:09 smithi120 ceph-mon[31085]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:09 smithi152 ceph-mon[34868]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:09.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:09 smithi175 ceph-mon[35353]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:11.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:11.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: from='osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T09:12:11.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:11 smithi120 ceph-mon[31085]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T09:12:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:11.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:11.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: from='osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T09:12:11.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:11 smithi152 ceph-mon[34868]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T09:12:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:11.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:11.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:11.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: from='osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T09:12:11.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:11 smithi175 ceph-mon[35353]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T09:12:12.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.744+0000 7f3fa7400700 1 -- 172.21.15.152:0/1935528130 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3fb0063c00 con 0x7f3f940b2880 2024-05-14T09:12:12.744 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 4 on host 'smithi152' 2024-05-14T09:12:12.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3f940b2880 msgr2=0x7f3f940b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:12.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3f940b2880 0x7f3f940b4d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c005fd0 tx=0x7f3f9c005e40 comp rx=0 tx=0).stop 2024-05-14T09:12:12.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0104340 msgr2=0x7f3fb019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:12.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0104340 0x7f3fb019a730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c970 tx=0x7f3fa000cd30 comp rx=0 tx=0).stop 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 shutdown_connections 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3f940b2880 0x7f3f940b4d90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fb0104340 0x7f3fb019a730 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb0105e10 0x7f3fb01a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 --2- 172.21.15.152:0/1935528130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fb0105470 0x7f3fb019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.748+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 >> 172.21.15.152:0/1935528130 conn(0x7f3fb00ff9c0 msgr2=0x7f3fb01086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.749+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 shutdown_connections 2024-05-14T09:12:12.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:12:12.749+0000 7f3fb5600700 1 -- 172.21.15.152:0/1935528130 wait complete. 2024-05-14T09:12:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:12 smithi152 ceph-mon[34868]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T09:12:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:12 smithi152 ceph-mon[34868]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T09:12:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:12 smithi152 ceph-mon[34868]: from='osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:12:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:12 smithi152 ceph-mon[34868]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:12:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:12 smithi175 ceph-mon[35353]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T09:12:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:12 smithi175 ceph-mon[35353]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T09:12:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:12 smithi175 ceph-mon[35353]: from='osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:12:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:12 smithi175 ceph-mon[35353]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:12:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:12 smithi120 ceph-mon[31085]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T09:12:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:12 smithi120 ceph-mon[31085]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T09:12:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:12 smithi120 ceph-mon[31085]: from='osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:12:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:12 smithi120 ceph-mon[31085]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:12:13.595 DEBUG:teuthology.orchestra.run.smithi152:osd.4> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.4.service 2024-05-14T09:12:13.599 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-05-14T09:12:13.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T09:12:13.827 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:13.827 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:12:13.827 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: osdmap e31: 5 total, 4 up, 5 in 2024-05-14T09:12:13.827 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:13.827 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:13.827 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:13.827 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:13.828 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:13.828 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:13 smithi152 ceph-mon[34868]: from='osd.4 ' entity='osd.4' 2024-05-14T09:12:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:12:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: osdmap e31: 5 total, 4 up, 5 in 2024-05-14T09:12:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:13.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:13.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:13.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:13.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:13 smithi175 ceph-mon[35353]: from='osd.4 ' entity='osd.4' 2024-05-14T09:12:14.046 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:12:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:12:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: osdmap e31: 5 total, 4 up, 5 in 2024-05-14T09:12:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:13 smithi120 ceph-mon[31085]: from='osd.4 ' entity='osd.4' 2024-05-14T09:12:14.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:14 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:12:14.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:14 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:12:14.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:14.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:14 smithi175 ceph-mon[35353]: osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] boot 2024-05-14T09:12:14.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:14 smithi175 ceph-mon[35353]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T09:12:14.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:14.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:14 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:12:14.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:14 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:12:14.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:14.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:14 smithi152 ceph-mon[34868]: osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] boot 2024-05-14T09:12:14.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:14 smithi152 ceph-mon[34868]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T09:12:14.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:14 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:12:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:14 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:12:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:14 smithi120 ceph-mon[31085]: osd.4 [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] boot 2024-05-14T09:12:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:14 smithi120 ceph-mon[31085]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T09:12:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T09:12:15.756 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:15 smithi152 ceph-mon[34868]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:15.812 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:15 smithi175 ceph-mon[35353]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:15 smithi120 ceph-mon[31085]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-14T09:12:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T09:12:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T09:12:16.797 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-05-14T09:12:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-05-14T09:12:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0337015 s, 311 MB/s 2024-05-14T09:12:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-05-14T09:12:16.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:16 smithi152 ceph-mon[34868]: osdmap e33: 5 total, 5 up, 5 in 2024-05-14T09:12:16.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:16 smithi175 ceph-mon[35353]: osdmap e33: 5 total, 5 up, 5 in 2024-05-14T09:12:17.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:16 smithi120 ceph-mon[31085]: osdmap e33: 5 total, 5 up, 5 in 2024-05-14T09:12:17.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-05-14T09:12:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:17 smithi152 ceph-mon[34868]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:17.976 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:17 smithi175 ceph-mon[35353]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:18.104 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:12:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:17 smithi120 ceph-mon[31085]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:19.854 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:19.854 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi152 2024-05-14T09:12:19.854 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.854 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:19.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:19.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi152 to 8544M 2024-05-14T09:12:19.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:19.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:19.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi152 2024-05-14T09:12:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi152 to 8544M 2024-05-14T09:12:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi152 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi152 to 8544M 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 -- 172.21.15.175:0/2376852509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 msgr2=0x7fbf3010c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 --2- 172.21.15.175:0/2376852509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf3010c4f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800b0a0 tx=0x7fbf2800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 -- 172.21.15.175:0/2376852509 shutdown_connections 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 --2- 172.21.15.175:0/2376852509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf30104170 0x7fbf30104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 --2- 172.21.15.175:0/2376852509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf3010c4f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 --2- 172.21.15.175:0/2376852509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf301052a0 0x7fbf301056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 -- 172.21.15.175:0/2376852509 >> 172.21.15.175:0/2376852509 conn(0x7fbf300ff7b0 msgr2=0x7fbf30101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 -- 172.21.15.175:0/2376852509 shutdown_connections 2024-05-14T09:12:20.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.249+0000 7fbf35a00700 1 -- 172.21.15.175:0/2376852509 wait complete. 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.250+0000 7fbf35a00700 1 Processor -- start 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35a00700 1 -- start start 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf30104170 0x7fbf3019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf301052a0 0x7fbf3019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf301a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3010faf0 con 0x7fbf30104170 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3010f970 con 0x7fbf301052a0 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3010fc70 con 0x7fbf30105c40 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf301a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:12:20.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf301a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40286/0 (socket says 172.21.15.175:40286) 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.251+0000 7fbf35000700 1 -- 172.21.15.175:0/1205510510 learned_addr learned my addr 172.21.15.175:0/1205510510 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf2fe00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf30104170 0x7fbf3019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf2f400700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf301052a0 0x7fbf3019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf35000700 1 -- 172.21.15.175:0/1205510510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf301052a0 msgr2=0x7fbf3019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf35000700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf301052a0 0x7fbf3019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf35000700 1 -- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf30104170 msgr2=0x7fbf3019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf35000700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf30104170 0x7fbf3019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf35000700 1 -- 172.21.15.175:0/1205510510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf301a21f0 con 0x7fbf30105c40 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.252+0000 7fbf35000700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf301a1b70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800b070 tx=0x7fbf2800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.253+0000 7fbf2cc00700 1 -- 172.21.15.175:0/1205510510 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28021070 con 0x7fbf30105c40 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.253+0000 7fbf2cc00700 1 -- 172.21.15.175:0/1205510510 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf28007c80 con 0x7fbf30105c40 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.253+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf301a2480 con 0x7fbf30105c40 2024-05-14T09:12:20.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.253+0000 7fbf2cc00700 1 -- 172.21.15.175:0/1205510510 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2801b690 con 0x7fbf30105c40 2024-05-14T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.253+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf301a2930 con 0x7fbf30105c40 2024-05-14T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.254+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf300512c0 con 0x7fbf30105c40 2024-05-14T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.256+0000 7fbf2cc00700 1 -- 172.21.15.175:0/1205510510 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fbf28024070 con 0x7fbf30105c40 2024-05-14T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.258+0000 7fbf2cc00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf140b2900 0x7fbf140b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.258+0000 7fbf2cc00700 1 -- 172.21.15.175:0/1205510510 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7fbf2800f020 con 0x7fbf30105c40 2024-05-14T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.259+0000 7fbf2fe00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf140b2900 0x7fbf140b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:12:20.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.260+0000 7fbf2fe00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf140b2900 0x7fbf140b4e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005950 tx=0x7fbf200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:12:20.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.262+0000 7fbf2cc00700 1 -- 172.21.15.175:0/1205510510 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbf2802b020 con 0x7fbf30105c40 2024-05-14T09:12:20.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:20.495+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbf30063c00 con 0x7fbf140b2900 2024-05-14T09:12:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:12:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:12:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:20.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:12:20.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:12:20.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:20.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:12:20.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:12:20.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:21.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:21 smithi175 ceph-mon[35353]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:21.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:21 smithi175 ceph-mon[35353]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:12:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:21 smithi120 ceph-mon[31085]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:21 smithi120 ceph-mon[31085]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:12:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:21 smithi152 ceph-mon[34868]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:21 smithi152 ceph-mon[34868]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:12:23.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:23 smithi175 ceph-mon[35353]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:23 smithi120 ceph-mon[31085]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:23.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:23 smithi152 ceph-mon[34868]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:25 smithi120 ceph-mon[31085]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:25 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/2524669752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]: dispatch 2024-05-14T09:12:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:25 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]: dispatch 2024-05-14T09:12:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:25 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]': finished 2024-05-14T09:12:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:25 smithi120 ceph-mon[31085]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T09:12:25.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:25 smithi152 ceph-mon[34868]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:25 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/2524669752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]: dispatch 2024-05-14T09:12:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:25 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]: dispatch 2024-05-14T09:12:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:25 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]': finished 2024-05-14T09:12:25.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:25 smithi152 ceph-mon[34868]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T09:12:25.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:25 smithi175 ceph-mon[35353]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:25.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:25 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/2524669752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]: dispatch 2024-05-14T09:12:25.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:25 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]: dispatch 2024-05-14T09:12:25.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:25 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e68188d-0af5-4edf-a9e8-17a5ef0cd98f"}]': finished 2024-05-14T09:12:25.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:25 smithi175 ceph-mon[35353]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T09:12:25.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:26.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:26 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/1356632903' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:12:26.921 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:26 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/1356632903' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:12:26.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:26 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/1356632903' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:12:27.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:27 smithi120 ceph-mon[31085]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:27 smithi152 ceph-mon[34868]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:27 smithi175 ceph-mon[35353]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:29.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:29 smithi175 ceph-mon[35353]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:29.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:29 smithi120 ceph-mon[31085]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:29 smithi152 ceph-mon[34868]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:31.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:31 smithi120 ceph-mon[31085]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:31 smithi152 ceph-mon[34868]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:31 smithi175 ceph-mon[35353]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:33.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:33 smithi152 ceph-mon[34868]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:33 smithi175 ceph-mon[35353]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:34.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:33 smithi120 ceph-mon[31085]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:34.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T09:12:34.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:34.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T09:12:34.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:35.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T09:12:35.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:35 smithi152 ceph-mon[34868]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:35 smithi152 ceph-mon[34868]: Deploying daemon osd.5 on smithi175 2024-05-14T09:12:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:35 smithi175 ceph-mon[35353]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:35 smithi175 ceph-mon[35353]: Deploying daemon osd.5 on smithi175 2024-05-14T09:12:36.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:35 smithi120 ceph-mon[31085]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:36.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:35 smithi120 ceph-mon[31085]: Deploying daemon osd.5 on smithi175 2024-05-14T09:12:37.937 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:37 smithi120 ceph-mon[31085]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:37 smithi152 ceph-mon[34868]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:37 smithi175 ceph-mon[35353]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:39.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:39 smithi175 ceph-mon[35353]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:39 smithi152 ceph-mon[34868]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:40.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:39 smithi120 ceph-mon[31085]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:41 smithi152 ceph-mon[34868]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:41 smithi175 ceph-mon[35353]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:42.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:41 smithi120 ceph-mon[31085]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:43.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:43 smithi152 ceph-mon[34868]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:43.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:43 smithi175 ceph-mon[35353]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:43 smithi120 ceph-mon[31085]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:44.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:44.920 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:45.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:45.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:45.723 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:45 smithi175 ceph-mon[35353]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:45 smithi152 ceph-mon[34868]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:46.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:45 smithi120 ceph-mon[31085]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:47 smithi152 ceph-mon[34868]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:47.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:47 smithi175 ceph-mon[35353]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:47.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:47.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:47 smithi120 ceph-mon[31085]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:48.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:48.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:48.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:48 smithi175 ceph-mon[35353]: from='osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T09:12:48.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:48 smithi175 ceph-mon[35353]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T09:12:49.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:48 smithi120 ceph-mon[31085]: from='osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T09:12:49.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:48 smithi120 ceph-mon[31085]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T09:12:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:48 smithi152 ceph-mon[34868]: from='osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T09:12:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:48 smithi152 ceph-mon[34868]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T09:12:49.266 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-05-14T09:12:49.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.265+0000 7fbf2cc00700 1 -- 172.21.15.175:0/1205510510 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf30063c00 con 0x7fbf140b2900 2024-05-14T09:12:49.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf140b2900 msgr2=0x7fbf140b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:49.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf140b2900 0x7fbf140b4e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005950 tx=0x7fbf200058e0 comp rx=0 tx=0).stop 2024-05-14T09:12:49.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 msgr2=0x7fbf301a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf301a1b70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800b070 tx=0x7fbf2800bd70 comp rx=0 tx=0).stop 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 shutdown_connections 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf140b2900 0x7fbf140b4e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf30105c40 0x7fbf301a1b70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf30104170 0x7fbf3019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 --2- 172.21.15.175:0/1205510510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf301052a0 0x7fbf3019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.269+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 >> 172.21.15.175:0/1205510510 conn(0x7fbf300ff7b0 msgr2=0x7fbf301084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.270+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 shutdown_connections 2024-05-14T09:12:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:12:49.270+0000 7fbf35a00700 1 -- 172.21.15.175:0/1205510510 wait complete. 2024-05-14T09:12:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T09:12:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T09:12:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: from='osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:12:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:12:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T09:12:50.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T09:12:50.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: from='osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:12:50.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:50.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:12:50.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:50.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:50.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:50.145 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.5.service 2024-05-14T09:12:50.151 INFO:tasks.cephadm:Deploying osd.6 on smithi120 with /dev/vg_nvme/lv_2... 2024-05-14T09:12:50.151 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T09:12:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T09:12:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T09:12:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: from='osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:12:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:50.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:12:50.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:50.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:50.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:12:50.603 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:12:50.727 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:12:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:12:50.567+0000 7fd252e00700 -1 osd.5 0 waiting for initial osdmap 2024-05-14T09:12:50.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:12:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:12:50.589+0000 7fd248c00700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:12:51.086 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:50 smithi120 ceph-mon[31085]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:12:51.086 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:50 smithi120 ceph-mon[31085]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T09:12:51.086 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:51.086 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:51.086 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:50 smithi120 ceph-mon[31085]: from='osd.5 ' entity='osd.5' 2024-05-14T09:12:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:50 smithi152 ceph-mon[34868]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:12:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:50 smithi152 ceph-mon[34868]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T09:12:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:50 smithi152 ceph-mon[34868]: from='osd.5 ' entity='osd.5' 2024-05-14T09:12:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:50 smithi175 ceph-mon[35353]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:12:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:50 smithi175 ceph-mon[35353]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T09:12:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:50 smithi175 ceph-mon[35353]: from='osd.5 ' entity='osd.5' 2024-05-14T09:12:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:51 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:12:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:51 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:12:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:51 smithi175 ceph-mon[35353]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:51.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:51.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:51 smithi175 ceph-mon[35353]: osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] boot 2024-05-14T09:12:51.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:51 smithi175 ceph-mon[35353]: osdmap e37: 6 total, 6 up, 6 in 2024-05-14T09:12:51.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:52.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:51 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:12:52.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:51 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:12:52.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:51 smithi120 ceph-mon[31085]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:52.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:52.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:51 smithi120 ceph-mon[31085]: osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] boot 2024-05-14T09:12:52.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:51 smithi120 ceph-mon[31085]: osdmap e37: 6 total, 6 up, 6 in 2024-05-14T09:12:52.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:51 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:12:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:51 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:12:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:51 smithi152 ceph-mon[34868]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-14T09:12:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:51 smithi152 ceph-mon[34868]: osd.5 [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] boot 2024-05-14T09:12:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:51 smithi152 ceph-mon[34868]: osdmap e37: 6 total, 6 up, 6 in 2024-05-14T09:12:52.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T09:12:53.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:52 smithi120 ceph-mon[31085]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T09:12:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:52 smithi152 ceph-mon[34868]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T09:12:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:52 smithi175 ceph-mon[35353]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T09:12:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T09:12:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T09:12:53.642 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-05-14T09:12:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-05-14T09:12:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0352529 s, 297 MB/s 2024-05-14T09:12:53.642 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 2024-05-14T09:12:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-05-14T09:12:54.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:53 smithi120 ceph-mon[31085]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:12:54.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:53 smithi120 ceph-mon[31085]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T09:12:54.176 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:53 smithi175 ceph-mon[35353]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:12:54.176 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:53 smithi175 ceph-mon[35353]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T09:12:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:53 smithi152 ceph-mon[34868]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:12:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:53 smithi152 ceph-mon[34868]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T09:12:54.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_2 2024-05-14T09:12:55.049 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:12:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:55.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:12:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:56.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:56.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:12:56.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:12:57.030 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:56 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi175 2024-05-14T09:12:57.031 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:56 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi175 to 8544M 2024-05-14T09:12:57.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:56 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi175 2024-05-14T09:12:57.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:56 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi175 to 8544M 2024-05-14T09:12:57.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:56 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi175 2024-05-14T09:12:57.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:56 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi175 to 8544M 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 -- 172.21.15.120:0/2478894822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 msgr2=0x7fd594104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 --2- 172.21.15.120:0/2478894822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd594104750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd588009990 tx=0x7fd588009ca0 comp rx=0 tx=0).stop 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 -- 172.21.15.120:0/2478894822 shutdown_connections 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 --2- 172.21.15.120:0/2478894822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd594105e10 0x7fd59410c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 --2- 172.21.15.120:0/2478894822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd594104750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 --2- 172.21.15.120:0/2478894822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd594105470 0x7fd594105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 -- 172.21.15.120:0/2478894822 >> 172.21.15.120:0/2478894822 conn(0x7fd5940ff9c0 msgr2=0x7fd594101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 -- 172.21.15.120:0/2478894822 shutdown_connections 2024-05-14T09:12:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.634+0000 7fd59bc00700 1 -- 172.21.15.120:0/2478894822 wait complete. 2024-05-14T09:12:57.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 Processor -- start 2024-05-14T09:12:57.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 -- start start 2024-05-14T09:12:57.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd59419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:57.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd594105470 0x7fd59419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:57.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd594105e10 0x7fd5941a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:57.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd59410fc40 con 0x7fd594104340 2024-05-14T09:12:57.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd59410fac0 con 0x7fd594105470 2024-05-14T09:12:57.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.636+0000 7fd59bc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd59410fdc0 con 0x7fd594105e10 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd59419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd59419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36072/0 (socket says 172.21.15.120:36072) 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 -- 172.21.15.120:0/185617823 learned_addr learned my addr 172.21.15.120:0/185617823 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd593e00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd594105470 0x7fd59419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 -- 172.21.15.120:0/185617823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd594105e10 msgr2=0x7fd5941a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd594105e10 0x7fd5941a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 -- 172.21.15.120:0/185617823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd594105470 msgr2=0x7fd59419ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd594105470 0x7fd59419ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 -- 172.21.15.120:0/185617823 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5941a2380 con 0x7fd594104340 2024-05-14T09:12:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.637+0000 7fd599200700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd59419a820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5880098e0 tx=0x7fd58800ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:12:57.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.638+0000 7fd591600700 1 -- 172.21.15.120:0/185617823 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588026070 con 0x7fd594104340 2024-05-14T09:12:57.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.638+0000 7fd591600700 1 -- 172.21.15.120:0/185617823 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd588003d20 con 0x7fd594104340 2024-05-14T09:12:57.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.638+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5941a2610 con 0x7fd594104340 2024-05-14T09:12:57.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.638+0000 7fd591600700 1 -- 172.21.15.120:0/185617823 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58800fd20 con 0x7fd594104340 2024-05-14T09:12:57.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.638+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5941a2b40 con 0x7fd594104340 2024-05-14T09:12:57.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.639+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5940512c0 con 0x7fd594104340 2024-05-14T09:12:57.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.642+0000 7fd591600700 1 -- 172.21.15.120:0/185617823 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fd588029070 con 0x7fd594104340 2024-05-14T09:12:57.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.644+0000 7fd591600700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd57c0b2900 0x7fd57c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:12:57.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.644+0000 7fd591600700 1 -- 172.21.15.120:0/185617823 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7fd5880e2250 con 0x7fd594104340 2024-05-14T09:12:57.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.644+0000 7fd593e00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd57c0b2900 0x7fd57c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:12:57.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.645+0000 7fd593e00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd57c0b2900 0x7fd57c0b4e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd59419b8d0 tx=0x7fd580009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:12:57.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.649+0000 7fd591600700 1 -- 172.21.15.120:0/185617823 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd588013070 con 0x7fd594104340 2024-05-14T09:12:57.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:12:57.891+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd594063c00 con 0x7fd57c0b2900 2024-05-14T09:12:57.892 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:57 smithi120 ceph-mon[31085]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:12:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:57 smithi152 ceph-mon[34868]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:12:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:57 smithi175 ceph-mon[35353]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:12:59.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:58 smithi120 ceph-mon[31085]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:12:59.137 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:12:59.137 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:12:59.137 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:58 smithi152 ceph-mon[34868]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:12:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:12:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:12:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:12:59.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:58 smithi175 ceph-mon[35353]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:12:59.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:12:59.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:12:59.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:12:59 smithi120 ceph-mon[31085]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-14T09:13:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:12:59 smithi152 ceph-mon[34868]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-14T09:13:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:12:59 smithi175 ceph-mon[35353]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-14T09:13:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:01 smithi120 ceph-mon[31085]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-14T09:13:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:01 smithi152 ceph-mon[34868]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-14T09:13:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:01 smithi175 ceph-mon[35353]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-14T09:13:03.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:02 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2962208974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2d6f698-0513-4b46-a575-24ec7b0bb63b"}]: dispatch 2024-05-14T09:13:03.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:02 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2962208974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2d6f698-0513-4b46-a575-24ec7b0bb63b"}]': finished 2024-05-14T09:13:03.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:02 smithi120 ceph-mon[31085]: osdmap e40: 7 total, 6 up, 7 in 2024-05-14T09:13:03.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:03.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:02 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2962208974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2d6f698-0513-4b46-a575-24ec7b0bb63b"}]: dispatch 2024-05-14T09:13:03.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:02 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2962208974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2d6f698-0513-4b46-a575-24ec7b0bb63b"}]': finished 2024-05-14T09:13:03.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:02 smithi152 ceph-mon[34868]: osdmap e40: 7 total, 6 up, 7 in 2024-05-14T09:13:03.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:02 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2962208974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2d6f698-0513-4b46-a575-24ec7b0bb63b"}]: dispatch 2024-05-14T09:13:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:02 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2962208974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2d6f698-0513-4b46-a575-24ec7b0bb63b"}]': finished 2024-05-14T09:13:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:02 smithi175 ceph-mon[35353]: osdmap e40: 7 total, 6 up, 7 in 2024-05-14T09:13:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:03 smithi120 ceph-mon[31085]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:13:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:03 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4150963471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:13:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:03 smithi152 ceph-mon[34868]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:13:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:03 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4150963471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:13:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:03 smithi175 ceph-mon[35353]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:13:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:03 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4150963471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:13:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:05 smithi120 ceph-mon[31085]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:13:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:05 smithi152 ceph-mon[34868]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:13:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:05 smithi175 ceph-mon[35353]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T09:13:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:07 smithi120 ceph-mon[31085]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:07 smithi152 ceph-mon[34868]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:07 smithi175 ceph-mon[35353]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:09 smithi120 ceph-mon[31085]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:10.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:09 smithi152 ceph-mon[34868]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:09 smithi175 ceph-mon[35353]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:12.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:11 smithi120 ceph-mon[31085]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:11 smithi152 ceph-mon[34868]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:11 smithi175 ceph-mon[35353]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T09:13:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:13.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T09:13:13.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:13.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T09:13:13.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:13 smithi120 ceph-mon[31085]: Deploying daemon osd.6 on smithi120 2024-05-14T09:13:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:13 smithi120 ceph-mon[31085]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:13 smithi152 ceph-mon[34868]: Deploying daemon osd.6 on smithi120 2024-05-14T09:13:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:13 smithi152 ceph-mon[34868]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:13 smithi175 ceph-mon[35353]: Deploying daemon osd.6 on smithi120 2024-05-14T09:13:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:13 smithi175 ceph-mon[35353]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:15 smithi120 ceph-mon[31085]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:15 smithi152 ceph-mon[34868]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:15 smithi175 ceph-mon[35353]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:17 smithi152 ceph-mon[34868]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:17 smithi175 ceph-mon[35353]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:17 smithi120 ceph-mon[31085]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:20.026 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:19 smithi120 ceph-mon[31085]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:19 smithi152 ceph-mon[34868]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:19 smithi175 ceph-mon[35353]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:21 smithi120 ceph-mon[31085]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:13:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:21 smithi152 ceph-mon[34868]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:13:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:21 smithi175 ceph-mon[35353]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:13:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:23 smithi152 ceph-mon[34868]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:24.214 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:23 smithi120 ceph-mon[31085]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:23 smithi175 ceph-mon[35353]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:25.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:24 smithi175 ceph-mon[35353]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:25.345 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:24 smithi120 ceph-mon[31085]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:25.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:24 smithi152 ceph-mon[34868]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:25 smithi175 ceph-mon[35353]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T09:13:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:26.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:13:26.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.303 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:25 smithi120 ceph-mon[31085]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T09:13:26.304 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.304 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.304 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:26.304 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:13:26.304 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:25 smithi152 ceph-mon[34868]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T09:13:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:13:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:27.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:26 smithi120 ceph-mon[31085]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T09:13:27.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:26 smithi120 ceph-mon[31085]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T09:13:27.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:26 smithi120 ceph-mon[31085]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:13:27.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:26 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:27.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:26 smithi120 ceph-mon[31085]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.444+0000 7fd591600700 1 -- 172.21.15.120:0/185617823 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd594063c00 con 0x7fd57c0b2900 2024-05-14T09:13:27.446 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 6 on host 'smithi120' 2024-05-14T09:13:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd57c0b2900 msgr2=0x7fd57c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:13:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd57c0b2900 0x7fd57c0b4e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd59419b8d0 tx=0x7fd580009260 comp rx=0 tx=0).stop 2024-05-14T09:13:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 msgr2=0x7fd59419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:13:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd59419a820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5880098e0 tx=0x7fd58800ba90 comp rx=0 tx=0).stop 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 shutdown_connections 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd57c0b2900 0x7fd57c0b4e10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd594105e10 0x7fd5941a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd594104340 0x7fd59419a820 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 --2- 172.21.15.120:0/185617823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd594105470 0x7fd59419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.448+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 >> 172.21.15.120:0/185617823 conn(0x7fd5940ff9c0 msgr2=0x7fd5941086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.449+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 shutdown_connections 2024-05-14T09:13:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:13:27.449+0000 7fd59bc00700 1 -- 172.21.15.120:0/185617823 wait complete. 2024-05-14T09:13:27.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:26 smithi152 ceph-mon[34868]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T09:13:27.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:26 smithi152 ceph-mon[34868]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T09:13:27.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:26 smithi152 ceph-mon[34868]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:13:27.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:26 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:27.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:26 smithi152 ceph-mon[34868]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:27.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:26 smithi175 ceph-mon[35353]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T09:13:27.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:26 smithi175 ceph-mon[35353]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T09:13:27.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:26 smithi175 ceph-mon[35353]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:13:27.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:26 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:27.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:26 smithi175 ceph-mon[35353]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-14T09:13:28.379 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:28 smithi120 ceph-mon[31085]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:13:28.379 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:28 smithi120 ceph-mon[31085]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T09:13:28.379 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:28.379 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:28.379 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:13:28.379 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:28.379 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:28.436 DEBUG:teuthology.orchestra.run.smithi120:osd.6> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.6.service 2024-05-14T09:13:28.441 INFO:tasks.cephadm:Deploying osd.7 on smithi152 with /dev/vg_nvme/lv_2... 2024-05-14T09:13:28.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T09:13:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:28 smithi152 ceph-mon[34868]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:13:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:28 smithi152 ceph-mon[34868]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T09:13:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:13:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:28 smithi175 ceph-mon[35353]: from='osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:13:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:28 smithi175 ceph-mon[35353]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T09:13:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:13:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:28.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:28.891 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:13:29.278 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:29 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:13:29.278 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:29 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:13:29.279 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:29 smithi152 ceph-mon[34868]: osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] boot 2024-05-14T09:13:29.279 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:29 smithi152 ceph-mon[34868]: osdmap e43: 7 total, 7 up, 7 in 2024-05-14T09:13:29.279 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:29.279 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:29 smithi152 ceph-mon[34868]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:29 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:13:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:29 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:13:29.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:29 smithi120 ceph-mon[31085]: osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] boot 2024-05-14T09:13:29.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:29 smithi120 ceph-mon[31085]: osdmap e43: 7 total, 7 up, 7 in 2024-05-14T09:13:29.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:29.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:29 smithi120 ceph-mon[31085]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:29.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:29 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:13:29.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:29 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:13:29.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:29 smithi175 ceph-mon[35353]: osd.6 [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] boot 2024-05-14T09:13:29.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:29 smithi175 ceph-mon[35353]: osdmap e43: 7 total, 7 up, 7 in 2024-05-14T09:13:29.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T09:13:29.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:29 smithi175 ceph-mon[35353]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:30.250 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:30 smithi120 ceph-mon[31085]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T09:13:30.441 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:30 smithi152 ceph-mon[34868]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T09:13:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:30 smithi175 ceph-mon[35353]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T09:13:31.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:31 smithi120 ceph-mon[31085]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:31.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:31 smithi152 ceph-mon[34868]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:31.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:31 smithi175 ceph-mon[35353]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:32.005 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T09:13:32.006 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T09:13:32.006 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2024-05-14T09:13:32.006 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2024-05-14T09:13:32.006 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0344773 s, 304 MB/s 2024-05-14T09:13:32.006 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2024-05-14T09:13:32.889 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2024-05-14T09:13:33.342 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:13:33.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:33 smithi152 ceph-mon[34868]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:33 smithi120 ceph-mon[31085]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:33.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:33 smithi175 ceph-mon[35353]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi120 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi120 to 5696M 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:13:34.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi120 2024-05-14T09:13:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi120 to 5696M 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:13:34.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi120 2024-05-14T09:13:34.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi120 to 5696M 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:13:34.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:13:35.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 -- 172.21.15.152:0/2306360933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410c260 msgr2=0x7faf44112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 --2- 172.21.15.152:0/2306360933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410c260 0x7faf44112b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b0a0 tx=0x7faf3c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 -- 172.21.15.152:0/2306360933 shutdown_connections 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 --2- 172.21.15.152:0/2306360933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410c260 0x7faf44112b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 --2- 172.21.15.152:0/2306360933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4410a790 0x7faf4410aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 --2- 172.21.15.152:0/2306360933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4410b8c0 0x7faf4410bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 -- 172.21.15.152:0/2306360933 >> 172.21.15.152:0/2306360933 conn(0x7faf44079840 msgr2=0x7faf441085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 -- 172.21.15.152:0/2306360933 shutdown_connections 2024-05-14T09:13:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.694+0000 7faf43200700 1 -- 172.21.15.152:0/2306360933 wait complete. 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.695+0000 7faf43200700 1 Processor -- start 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.695+0000 7faf43200700 1 -- start start 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf43200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410a790 0x7faf441a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf43200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4410b8c0 0x7faf441a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf43200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4410c260 0x7faf441a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf43200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faf441160d0 con 0x7faf4410c260 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf43200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf44115f50 con 0x7faf4410a790 2024-05-14T09:13:35.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf43200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf44116250 con 0x7faf4410b8c0 2024-05-14T09:13:35.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410a790 0x7faf441a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:13:35.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410a790 0x7faf441a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40784/0 (socket says 172.21.15.152:40784) 2024-05-14T09:13:35.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 -- 172.21.15.152:0/3362624175 learned_addr learned my addr 172.21.15.152:0/3362624175 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-05-14T09:13:35.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf42800700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4410c260 0x7faf441a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:13:35.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41400700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4410b8c0 0x7faf441a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:13:35.697 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:35 smithi152 ceph-mon[34868]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:35.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 -- 172.21.15.152:0/3362624175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4410b8c0 msgr2=0x7faf441a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:13:35.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4410b8c0 0x7faf441a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:35.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 -- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4410c260 msgr2=0x7faf441a80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:13:35.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4410c260 0x7faf441a80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.696+0000 7faf41e00700 1 -- 172.21.15.152:0/3362624175 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf441a8750 con 0x7faf4410a790 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.697+0000 7faf41400700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4410b8c0 0x7faf441a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.697+0000 7faf41e00700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410a790 0x7faf441a0bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf3400d950 tx=0x7faf3400dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.697+0000 7faf3aa00700 1 -- 172.21.15.152:0/3362624175 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34017070 con 0x7faf4410a790 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.697+0000 7faf3aa00700 1 -- 172.21.15.152:0/3362624175 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf3400de30 con 0x7faf4410a790 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.697+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf441a8a40 con 0x7faf4410a790 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.697+0000 7faf3aa00700 1 -- 172.21.15.152:0/3362624175 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34003aa0 con 0x7faf4410a790 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.697+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf441a8fd0 con 0x7faf4410a790 2024-05-14T09:13:35.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.699+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf440512c0 con 0x7faf4410a790 2024-05-14T09:13:35.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.702+0000 7faf3aa00700 1 -- 172.21.15.152:0/3362624175 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7faf34003c40 con 0x7faf4410a790 2024-05-14T09:13:35.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.703+0000 7faf3aa00700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf280b2900 0x7faf280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:13:35.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.703+0000 7faf3aa00700 1 -- 172.21.15.152:0/3362624175 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7faf340e17d0 con 0x7faf4410a790 2024-05-14T09:13:35.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.704+0000 7faf41400700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf280b2900 0x7faf280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:13:35.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.705+0000 7faf41400700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf280b2900 0x7faf280b4e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005fd0 tx=0x7faf2c005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:13:35.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.707+0000 7faf3aa00700 1 -- 172.21.15.152:0/3362624175 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faf34020030 con 0x7faf4410a790 2024-05-14T09:13:35.751 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:35 smithi120 ceph-mon[31085]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:35.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:13:35.947+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7faf44063c00 con 0x7faf280b2900 2024-05-14T09:13:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:35 smithi175 ceph-mon[35353]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:36.879 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:13:36.879 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:13:36.879 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:13:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:13:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:36.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:13:36.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:13:36.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:37.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:37 smithi152 ceph-mon[34868]: from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:13:37.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:37 smithi152 ceph-mon[34868]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:37.786 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:37 smithi120 ceph-mon[31085]: from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:13:37.786 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:37 smithi120 ceph-mon[31085]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:37 smithi175 ceph-mon[35353]: from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:13:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:37 smithi175 ceph-mon[35353]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:39 smithi120 ceph-mon[31085]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:39 smithi152 ceph-mon[34868]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:39 smithi175 ceph-mon[35353]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:40 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/3748005979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]: dispatch 2024-05-14T09:13:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:40 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]: dispatch 2024-05-14T09:13:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:40 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]': finished 2024-05-14T09:13:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:40 smithi120 ceph-mon[31085]: osdmap e45: 8 total, 7 up, 8 in 2024-05-14T09:13:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:13:40.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:40 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/3748005979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]: dispatch 2024-05-14T09:13:40.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:40 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]: dispatch 2024-05-14T09:13:40.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:40 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]': finished 2024-05-14T09:13:40.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:40 smithi152 ceph-mon[34868]: osdmap e45: 8 total, 7 up, 8 in 2024-05-14T09:13:40.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:13:40.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:40 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/3748005979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]: dispatch 2024-05-14T09:13:40.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:40 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]: dispatch 2024-05-14T09:13:40.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:40 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42fe6ed9-d065-45d6-938c-66322c1ec1c0"}]': finished 2024-05-14T09:13:40.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:40 smithi175 ceph-mon[35353]: osdmap e45: 8 total, 7 up, 8 in 2024-05-14T09:13:40.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:13:41.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:41 smithi120 ceph-mon[31085]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:41.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:41 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/4090310491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:13:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:41 smithi152 ceph-mon[34868]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:41 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/4090310491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:13:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:41 smithi175 ceph-mon[35353]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:41 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/4090310491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:13:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:43 smithi120 ceph-mon[31085]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:43 smithi152 ceph-mon[34868]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:43.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:43 smithi175 ceph-mon[35353]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:45.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:45 smithi152 ceph-mon[34868]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:45.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:45 smithi120 ceph-mon[31085]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:45 smithi175 ceph-mon[35353]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:47.837 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:47 smithi152 ceph-mon[34868]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:47.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:47 smithi120 ceph-mon[31085]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:47 smithi175 ceph-mon[35353]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:49.837 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:49 smithi120 ceph-mon[31085]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:49.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:49 smithi152 ceph-mon[34868]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:49 smithi175 ceph-mon[35353]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:50.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T09:13:50.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:50.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T09:13:50.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:50.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T09:13:50.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:13:51.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:51 smithi120 ceph-mon[31085]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:51.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:51 smithi120 ceph-mon[31085]: Deploying daemon osd.7 on smithi152 2024-05-14T09:13:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:51 smithi152 ceph-mon[34868]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:51 smithi152 ceph-mon[34868]: Deploying daemon osd.7 on smithi152 2024-05-14T09:13:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:51 smithi175 ceph-mon[35353]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:51 smithi175 ceph-mon[35353]: Deploying daemon osd.7 on smithi152 2024-05-14T09:13:53.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:53 smithi120 ceph-mon[31085]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:53.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:53 smithi152 ceph-mon[34868]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:53.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:53 smithi175 ceph-mon[35353]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:55.672 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:55 smithi152 ceph-mon[34868]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:55 smithi120 ceph-mon[31085]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:55.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:55 smithi175 ceph-mon[35353]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:57.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:57 smithi120 ceph-mon[31085]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:57 smithi152 ceph-mon[34868]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:57 smithi175 ceph-mon[35353]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:59.805 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:13:59 smithi152 ceph-mon[34868]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:59.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:13:59 smithi120 ceph-mon[31085]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:13:59.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:13:59 smithi175 ceph-mon[35353]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:01.349 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:01.349 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:01.349 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:01 smithi152 ceph-mon[34868]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:01.349 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:01.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:01.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:01.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:01 smithi175 ceph-mon[35353]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:01.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:01 smithi120 ceph-mon[31085]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:03 smithi152 ceph-mon[34868]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:03.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:03 smithi120 ceph-mon[31085]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:03 smithi175 ceph-mon[35353]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:05.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:05.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:05.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:05 smithi152 ceph-mon[34868]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:05.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:05 smithi152 ceph-mon[34868]: from='osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T09:14:05.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:05 smithi152 ceph-mon[34868]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T09:14:05.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:05.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:05.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:05 smithi175 ceph-mon[35353]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:05.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:05 smithi175 ceph-mon[35353]: from='osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T09:14:05.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:05 smithi175 ceph-mon[35353]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T09:14:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:05 smithi120 ceph-mon[31085]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:05 smithi120 ceph-mon[31085]: from='osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T09:14:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:05 smithi120 ceph-mon[31085]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T09:14:06.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.029+0000 7faf3aa00700 1 -- 172.21.15.152:0/3362624175 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faf44063c00 con 0x7faf280b2900 2024-05-14T09:14:06.031 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 7 on host 'smithi152' 2024-05-14T09:14:06.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf280b2900 msgr2=0x7faf280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf280b2900 0x7faf280b4e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005fd0 tx=0x7faf2c005f00 comp rx=0 tx=0).stop 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410a790 msgr2=0x7faf441a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410a790 0x7faf441a0bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf3400d950 tx=0x7faf3400dd10 comp rx=0 tx=0).stop 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 shutdown_connections 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf280b2900 0x7faf280b4e10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf4410a790 0x7faf441a0bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4410c260 0x7faf441a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 --2- 172.21.15.152:0/3362624175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4410b8c0 0x7faf441a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 >> 172.21.15.152:0/3362624175 conn(0x7faf44079840 msgr2=0x7faf4410eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 shutdown_connections 2024-05-14T09:14:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:14:06.033+0000 7faf43200700 1 -- 172.21.15.152:0/3362624175 wait complete. 2024-05-14T09:14:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T09:14:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T09:14:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:06.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:06.943 DEBUG:teuthology.orchestra.run.smithi152:osd.7> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.7.service 2024-05-14T09:14:06.949 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-05-14T09:14:06.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T09:14:07.395 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:14:07.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:14:07.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T09:14:07.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:07.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] boot 2024-05-14T09:14:07.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: osdmap e48: 8 total, 8 up, 8 in 2024-05-14T09:14:07.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] boot 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: osdmap e48: 8 total, 8 up, 8 in 2024-05-14T09:14:07.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: osd.7 [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] boot 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: osdmap e48: 8 total, 8 up, 8 in 2024-05-14T09:14:07.536 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T09:14:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:08 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:14:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:08 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:14:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:08 smithi152 ceph-mon[34868]: osdmap e49: 8 total, 8 up, 8 in 2024-05-14T09:14:08.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:08 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:14:08.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:08 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:14:08.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:08 smithi175 ceph-mon[35353]: osdmap e49: 8 total, 8 up, 8 in 2024-05-14T09:14:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:08 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:14:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:08 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:14:08.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:08 smithi120 ceph-mon[31085]: osdmap e49: 8 total, 8 up, 8 in 2024-05-14T09:14:09.486 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:09 smithi175 ceph-mon[35353]: pgmap v233: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:09.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:09 smithi175 ceph-mon[35353]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-14T09:14:09.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:09 smithi175 ceph-mon[35353]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T09:14:09.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:09 smithi152 ceph-mon[34868]: pgmap v233: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:09.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:09 smithi152 ceph-mon[34868]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-14T09:14:09.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:09 smithi152 ceph-mon[34868]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T09:14:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:09 smithi120 ceph-mon[31085]: pgmap v233: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:09 smithi120 ceph-mon[31085]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-14T09:14:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:09 smithi120 ceph-mon[31085]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T09:14:10.450 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T09:14:10.450 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T09:14:10.450 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-05-14T09:14:10.450 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-05-14T09:14:10.450 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0331657 s, 316 MB/s 2024-05-14T09:14:10.450 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-05-14T09:14:11.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-05-14T09:14:11.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:11 smithi152 ceph-mon[34868]: pgmap v235: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:11.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:11 smithi175 ceph-mon[35353]: pgmap v235: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:11.806 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:14:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:11 smithi120 ceph-mon[31085]: pgmap v235: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi152 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi152 to 5696M 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi152 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi152 to 5696M 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi152 2024-05-14T09:14:13.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi152 to 5696M 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:13.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:13.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 -- 172.21.15.175:0/1372293722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810b8c0 msgr2=0x7f9b0810bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/1372293722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810b8c0 0x7f9b0810bcd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009990 tx=0x7f9af4009ca0 comp rx=0 tx=0).stop 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 -- 172.21.15.175:0/1372293722 shutdown_connections 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/1372293722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b0810a790 0x7f9b0810aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/1372293722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b0810c260 0x7f9b08112b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/1372293722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810b8c0 0x7f9b0810bcd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 -- 172.21.15.175:0/1372293722 >> 172.21.15.175:0/1372293722 conn(0x7f9b08079840 msgr2=0x7f9b081085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 -- 172.21.15.175:0/1372293722 shutdown_connections 2024-05-14T09:14:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.978+0000 7f9b0ca00700 1 -- 172.21.15.175:0/1372293722 wait complete. 2024-05-14T09:14:13.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.979+0000 7f9b0ca00700 1 Processor -- start 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b0ca00700 1 -- start start 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b0ca00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810a790 0x7f9b081a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b0ca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b0810b8c0 0x7f9b081a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b0ca00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b0810c260 0x7f9b081a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b0ca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9b081160b0 con 0x7f9b0810b8c0 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b0ca00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08115f30 con 0x7f9b0810c260 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b0ca00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08116230 con 0x7f9b0810a790 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b07400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810a790 0x7f9b081a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b07400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810a790 0x7f9b081a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48232/0 (socket says 172.21.15.175:48232) 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.980+0000 7f9b07400700 1 -- 172.21.15.175:0/911390829 learned_addr learned my addr 172.21.15.175:0/911390829 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b07e00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b0810c260 0x7f9b081a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b06a00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b0810b8c0 0x7f9b081a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b07400700 1 -- 172.21.15.175:0/911390829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b0810c260 msgr2=0x7f9b081a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b07400700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b0810c260 0x7f9b081a8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b07400700 1 -- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b0810b8c0 msgr2=0x7f9b081a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b07400700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b0810b8c0 0x7f9b081a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b07400700 1 -- 172.21.15.175:0/911390829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b081a8810 con 0x7f9b0810a790 2024-05-14T09:14:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9b07400700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810a790 0x7f9b081a0ca0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c970 tx=0x7f9af800cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:14:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.981+0000 7f9affe00700 1 -- 172.21.15.175:0/911390829 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8004220 con 0x7f9b0810a790 2024-05-14T09:14:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.982+0000 7f9affe00700 1 -- 172.21.15.175:0/911390829 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9af8007d90 con 0x7f9b0810a790 2024-05-14T09:14:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.982+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b081a8b00 con 0x7f9b0810a790 2024-05-14T09:14:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.982+0000 7f9affe00700 1 -- 172.21.15.175:0/911390829 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8003c80 con 0x7f9b0810a790 2024-05-14T09:14:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.982+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b081a9090 con 0x7f9b0810a790 2024-05-14T09:14:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.983+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b080512c0 con 0x7f9b0810a790 2024-05-14T09:14:13.983 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:13 smithi175 ceph-mon[35353]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:14:13.984 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:13 smithi175 ceph-mon[35353]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-14T09:14:13.984 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:13 smithi175 ceph-mon[35353]: Cluster is now healthy 2024-05-14T09:14:13.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.987+0000 7f9affe00700 1 -- 172.21.15.175:0/911390829 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f9af80043c0 con 0x7f9b0810a790 2024-05-14T09:14:13.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.988+0000 7f9affe00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9aec0b2900 0x7f9aec0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:13.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.989+0000 7f9affe00700 1 -- 172.21.15.175:0/911390829 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5397+0+0 (secure 0 0 0) 0x7f9af80e15c0 con 0x7f9b0810a790 2024-05-14T09:14:13.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.989+0000 7f9b06a00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9aec0b2900 0x7f9aec0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:13.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.991+0000 7f9b06a00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9aec0b2900 0x7f9aec0b4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9af400b5c0 tx=0x7f9af401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:14:13.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:13.991+0000 7f9affe00700 1 -- 172.21.15.175:0/911390829 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9af8014030 con 0x7f9b0810a790 2024-05-14T09:14:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:13 smithi120 ceph-mon[31085]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:14:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:13 smithi120 ceph-mon[31085]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-14T09:14:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:13 smithi120 ceph-mon[31085]: Cluster is now healthy 2024-05-14T09:14:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:13 smithi152 ceph-mon[34868]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:14:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:13 smithi152 ceph-mon[34868]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-14T09:14:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:13 smithi152 ceph-mon[34868]: Cluster is now healthy 2024-05-14T09:14:14.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:14.230+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9b08063c00 con 0x7f9aec0b2900 2024-05-14T09:14:15.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:14:15.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:14:15.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:15.195 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:14:15.195 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:14:15.195 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:15.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:14:15.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:14:15.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:15 smithi120 ceph-mon[31085]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 164 KiB/s, 0 objects/s recovering 2024-05-14T09:14:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:15 smithi120 ceph-mon[31085]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:14:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:15 smithi152 ceph-mon[34868]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 164 KiB/s, 0 objects/s recovering 2024-05-14T09:14:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:15 smithi152 ceph-mon[34868]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:14:16.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:15 smithi175 ceph-mon[35353]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 164 KiB/s, 0 objects/s recovering 2024-05-14T09:14:16.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:15 smithi175 ceph-mon[35353]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:14:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:17 smithi120 ceph-mon[31085]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-05-14T09:14:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:17 smithi152 ceph-mon[34868]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-05-14T09:14:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:17 smithi175 ceph-mon[35353]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-05-14T09:14:19.198 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:18 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/1384340877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]: dispatch 2024-05-14T09:14:19.199 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:18 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]: dispatch 2024-05-14T09:14:19.199 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:18 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]': finished 2024-05-14T09:14:19.199 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:18 smithi175 ceph-mon[35353]: osdmap e51: 9 total, 8 up, 9 in 2024-05-14T09:14:19.199 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:18 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/1384340877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]: dispatch 2024-05-14T09:14:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:18 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]: dispatch 2024-05-14T09:14:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:18 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]': finished 2024-05-14T09:14:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:18 smithi152 ceph-mon[34868]: osdmap e51: 9 total, 8 up, 9 in 2024-05-14T09:14:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:19.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:18 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/1384340877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]: dispatch 2024-05-14T09:14:19.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:18 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]: dispatch 2024-05-14T09:14:19.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:18 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6917512f-8d13-47e1-8150-fdc1c89a20f9"}]': finished 2024-05-14T09:14:19.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:18 smithi120 ceph-mon[31085]: osdmap e51: 9 total, 8 up, 9 in 2024-05-14T09:14:19.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:19 smithi152 ceph-mon[34868]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T09:14:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:19 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/1479564228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:14:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:19 smithi175 ceph-mon[35353]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T09:14:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:19 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/1479564228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:14:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:19 smithi120 ceph-mon[31085]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T09:14:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:19 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/1479564228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:14:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:21 smithi152 ceph-mon[34868]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T09:14:22.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:21 smithi175 ceph-mon[35353]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T09:14:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:21 smithi120 ceph-mon[31085]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T09:14:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:23 smithi152 ceph-mon[34868]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:23 smithi175 ceph-mon[35353]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:23 smithi120 ceph-mon[31085]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:26.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:25 smithi175 ceph-mon[35353]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:25 smithi152 ceph-mon[34868]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:26.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:25 smithi120 ceph-mon[31085]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:27 smithi152 ceph-mon[34868]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:27 smithi175 ceph-mon[35353]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:27 smithi120 ceph-mon[31085]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T09:14:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:28 smithi152 ceph-mon[34868]: Deploying daemon osd.8 on smithi175 2024-05-14T09:14:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:28 smithi152 ceph-mon[34868]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:29.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T09:14:29.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:29.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:28 smithi175 ceph-mon[35353]: Deploying daemon osd.8 on smithi175 2024-05-14T09:14:29.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:28 smithi175 ceph-mon[35353]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T09:14:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:28 smithi120 ceph-mon[31085]: Deploying daemon osd.8 on smithi175 2024-05-14T09:14:29.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:28 smithi120 ceph-mon[31085]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:31.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:31 smithi175 ceph-mon[35353]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:31.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:31 smithi120 ceph-mon[31085]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:31.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:31 smithi152 ceph-mon[34868]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:33.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:33 smithi175 ceph-mon[35353]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:33.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:33 smithi152 ceph-mon[34868]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:33 smithi120 ceph-mon[31085]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:35.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:35 smithi152 ceph-mon[34868]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:35 smithi120 ceph-mon[31085]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:35.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:35 smithi175 ceph-mon[35353]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:37.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:37 smithi175 ceph-mon[35353]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:37.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:37 smithi120 ceph-mon[31085]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:37.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:37 smithi152 ceph-mon[34868]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:38.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:38 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:38.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:38 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:38.692 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:38 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:38 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:38 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:38 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:38.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:38 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:38.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:38 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:38.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:38 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:39.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:39 smithi175 ceph-mon[35353]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:39.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:39 smithi152 ceph-mon[34868]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:39 smithi120 ceph-mon[31085]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:41.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:41 smithi152 ceph-mon[34868]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:41.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:41 smithi175 ceph-mon[35353]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:41.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:41 smithi120 ceph-mon[31085]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:42 smithi152 ceph-mon[34868]: from='osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T09:14:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:42 smithi152 ceph-mon[34868]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T09:14:42.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:42.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:42.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:42 smithi175 ceph-mon[35353]: from='osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T09:14:42.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:42 smithi175 ceph-mon[35353]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T09:14:42.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:42.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:42.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:42 smithi120 ceph-mon[31085]: from='osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T09:14:42.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:42 smithi120 ceph-mon[31085]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T09:14:43.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:42.999+0000 7f9affe00700 1 -- 172.21.15.175:0/911390829 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9b08063c00 con 0x7f9aec0b2900 2024-05-14T09:14:43.000 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9aec0b2900 msgr2=0x7f9aec0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9aec0b2900 0x7f9aec0b4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9af400b5c0 tx=0x7f9af401a040 comp rx=0 tx=0).stop 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810a790 msgr2=0x7f9b081a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810a790 0x7f9b081a0ca0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c970 tx=0x7f9af800cd30 comp rx=0 tx=0).stop 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 shutdown_connections 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9aec0b2900 0x7f9aec0b4e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b0810c260 0x7f9b081a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0810a790 0x7f9b081a0ca0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:43.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 --2- 172.21.15.175:0/911390829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b0810b8c0 0x7f9b081a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:43.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 >> 172.21.15.175:0/911390829 conn(0x7f9b08079840 msgr2=0x7f9b0810eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:14:43.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 shutdown_connections 2024-05-14T09:14:43.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:14:43.003+0000 7f9b0ca00700 1 -- 172.21.15.175:0/911390829 wait complete. 2024-05-14T09:14:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T09:14:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: osdmap e52: 9 total, 8 up, 9 in 2024-05-14T09:14:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:14:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:14:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:43.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:43.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:43.860 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.8.service 2024-05-14T09:14:43.866 INFO:tasks.cephadm:Deploying osd.9 on smithi120 with /dev/vg_nvme/lv_1... 2024-05-14T09:14:43.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T09:14:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T09:14:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: osdmap e52: 9 total, 8 up, 9 in 2024-05-14T09:14:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:14:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:14:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T09:14:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: osdmap e52: 9 total, 8 up, 9 in 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:14:44.302 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:14:44.477 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:14:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:14:44.313+0000 7fbdbe800700 -1 osd.8 0 waiting for initial osdmap 2024-05-14T09:14:44.478 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:14:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:14:44.356+0000 7fbdb4600700 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:14:44.804 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:44 smithi120 ceph-mon[31085]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:14:44.804 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:44 smithi120 ceph-mon[31085]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T09:14:44.804 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:44.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:44.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:44 smithi120 ceph-mon[31085]: from='osd.8 ' entity='osd.8' 2024-05-14T09:14:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:44 smithi152 ceph-mon[34868]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:14:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:44 smithi152 ceph-mon[34868]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T09:14:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:44 smithi152 ceph-mon[34868]: from='osd.8 ' entity='osd.8' 2024-05-14T09:14:44.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:44 smithi175 ceph-mon[35353]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:14:44.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:44 smithi175 ceph-mon[35353]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T09:14:44.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:44.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:44.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:44 smithi175 ceph-mon[35353]: from='osd.8 ' entity='osd.8' 2024-05-14T09:14:45.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:45 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:14:45.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:45 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:14:45.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:45 smithi120 ceph-mon[31085]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:45.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:45 smithi120 ceph-mon[31085]: osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] boot 2024-05-14T09:14:45.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:45 smithi120 ceph-mon[31085]: osdmap e54: 9 total, 9 up, 9 in 2024-05-14T09:14:45.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:45.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:45 smithi120 ceph-mon[31085]: osdmap e55: 9 total, 9 up, 9 in 2024-05-14T09:14:45.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:45 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:14:45.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:45 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:14:45.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:45 smithi175 ceph-mon[35353]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:45.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:45 smithi175 ceph-mon[35353]: osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] boot 2024-05-14T09:14:45.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:45 smithi175 ceph-mon[35353]: osdmap e54: 9 total, 9 up, 9 in 2024-05-14T09:14:45.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:45.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:45 smithi175 ceph-mon[35353]: osdmap e55: 9 total, 9 up, 9 in 2024-05-14T09:14:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:45 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:14:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:45 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:14:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:45 smithi152 ceph-mon[34868]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-14T09:14:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:45 smithi152 ceph-mon[34868]: osd.8 [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] boot 2024-05-14T09:14:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:45 smithi152 ceph-mon[34868]: osdmap e54: 9 total, 9 up, 9 in 2024-05-14T09:14:45.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T09:14:45.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:45 smithi152 ceph-mon[34868]: osdmap e55: 9 total, 9 up, 9 in 2024-05-14T09:14:47.347 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T09:14:47.347 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T09:14:47.347 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-05-14T09:14:47.347 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-05-14T09:14:47.347 INFO:teuthology.orchestra.run.smithi120.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0339834 s, 309 MB/s 2024-05-14T09:14:47.347 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 2024-05-14T09:14:47.347 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-05-14T09:14:47.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:47 smithi120 ceph-mon[31085]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:14:47.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:47 smithi120 ceph-mon[31085]: osdmap e56: 9 total, 9 up, 9 in 2024-05-14T09:14:47.779 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:47 smithi175 ceph-mon[35353]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:14:47.779 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:47 smithi175 ceph-mon[35353]: osdmap e56: 9 total, 9 up, 9 in 2024-05-14T09:14:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:47 smithi152 ceph-mon[34868]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:14:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:47 smithi152 ceph-mon[34868]: osdmap e56: 9 total, 9 up, 9 in 2024-05-14T09:14:48.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_1 2024-05-14T09:14:48.812 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi175 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi175 to 5696M 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:49.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:49 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-05-14T09:14:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi175 2024-05-14T09:14:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi175 to 5696M 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:49.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:49 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.999 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-05-14T09:14:49.999 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi175 2024-05-14T09:14:49.999 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.999 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:49.999 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:50.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:50.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:14:50.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi175 to 5696M 2024-05-14T09:14:50.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:50.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:50.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:14:50.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:49 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.208+0000 7fca1ca00700 1 -- 172.21.15.120:0/1734865331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 msgr2=0x7fca18106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.208+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1734865331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106cc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca08009990 tx=0x7fca08009ca0 comp rx=0 tx=0).stop 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.209+0000 7fca1ca00700 1 -- 172.21.15.120:0/1734865331 shutdown_connections 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.209+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1734865331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18109e00 0x7fca1810c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.209+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1734865331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106cc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.209+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1734865331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18107290 0x7fca18109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.209+0000 7fca1ca00700 1 -- 172.21.15.120:0/1734865331 >> 172.21.15.120:0/1734865331 conn(0x7fca180fe690 msgr2=0x7fca18100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.209+0000 7fca1ca00700 1 -- 172.21.15.120:0/1734865331 shutdown_connections 2024-05-14T09:14:51.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.209+0000 7fca1ca00700 1 -- 172.21.15.120:0/1734865331 wait complete. 2024-05-14T09:14:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.210+0000 7fca1ca00700 1 Processor -- start 2024-05-14T09:14:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.210+0000 7fca1ca00700 1 -- start start 2024-05-14T09:14:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca1ca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca1ca00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18107290 0x7fca18106690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca1ca00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18109e00 0x7fca181a8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca1ca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fca1810faa0 con 0x7fca1806cd00 2024-05-14T09:14:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca1ca00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca1810f920 con 0x7fca18107290 2024-05-14T09:14:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca1ca00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca1810fc20 con 0x7fca18109e00 2024-05-14T09:14:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca16800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca16800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50538/0 (socket says 172.21.15.120:50538) 2024-05-14T09:14:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca16800700 1 -- 172.21.15.120:0/1850306355 learned_addr learned my addr 172.21.15.120:0/1850306355 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:14:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca17200700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18109e00 0x7fca181a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.211+0000 7fca15e00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18107290 0x7fca18106690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca16800700 1 -- 172.21.15.120:0/1850306355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18109e00 msgr2=0x7fca181a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca16800700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18109e00 0x7fca181a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca16800700 1 -- 172.21.15.120:0/1850306355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18107290 msgr2=0x7fca18106690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca16800700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18107290 0x7fca18106690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca16800700 1 -- 172.21.15.120:0/1850306355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca181a8840 con 0x7fca1806cd00 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca15e00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18107290 0x7fca18106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca17200700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18109e00 0x7fca181a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.212+0000 7fca16800700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca08000c00 tx=0x7fca080047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.213+0000 7fca0f400700 1 -- 172.21.15.120:0/1850306355 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08003c10 con 0x7fca1806cd00 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.213+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca181a8ad0 con 0x7fca1806cd00 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.213+0000 7fca0f400700 1 -- 172.21.15.120:0/1850306355 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca08004830 con 0x7fca1806cd00 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.213+0000 7fca0f400700 1 -- 172.21.15.120:0/1850306355 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08005350 con 0x7fca1806cd00 2024-05-14T09:14:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.213+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca181a8f20 con 0x7fca1806cd00 2024-05-14T09:14:51.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.214+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca180512c0 con 0x7fca1806cd00 2024-05-14T09:14:51.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.217+0000 7fca0f400700 1 -- 172.21.15.120:0/1850306355 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fca080054f0 con 0x7fca1806cd00 2024-05-14T09:14:51.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.218+0000 7fca0f400700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9fc0b2900 0x7fc9fc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:14:51.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.218+0000 7fca0f400700 1 -- 172.21.15.120:0/1850306355 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5829+0+0 (secure 0 0 0) 0x7fca080e2ff0 con 0x7fca1806cd00 2024-05-14T09:14:51.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.218+0000 7fca15e00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9fc0b2900 0x7fc9fc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:14:51.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.219+0000 7fca15e00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9fc0b2900 0x7fc9fc0b4e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca04005950 tx=0x7fca040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:14:51.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.221+0000 7fca0f400700 1 -- 172.21.15.120:0/1850306355 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fca0802f070 con 0x7fca1806cd00 2024-05-14T09:14:51.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:14:51.463+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fca1810aae0 con 0x7fc9fc0b2900 2024-05-14T09:14:51.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:51 smithi120 ceph-mon[31085]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:14:51.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:14:51.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:14:51.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:51 smithi152 ceph-mon[34868]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:14:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:14:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:14:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:51 smithi175 ceph-mon[35353]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T09:14:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:14:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:14:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:14:52.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:52 smithi152 ceph-mon[34868]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:14:52.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:52 smithi175 ceph-mon[35353]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:14:53.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:52 smithi120 ceph-mon[31085]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:14:53.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:53 smithi120 ceph-mon[31085]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-14T09:14:53.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:53 smithi152 ceph-mon[34868]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-14T09:14:53.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:53 smithi175 ceph-mon[35353]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-14T09:14:55.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:55 smithi152 ceph-mon[34868]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T09:14:55.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:55 smithi175 ceph-mon[35353]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T09:14:56.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:55 smithi120 ceph-mon[31085]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T09:14:56.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:56 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1038121565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9c8846f-4e89-4037-be61-133dcc3f14b6"}]: dispatch 2024-05-14T09:14:56.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:56 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1038121565' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9c8846f-4e89-4037-be61-133dcc3f14b6"}]': finished 2024-05-14T09:14:56.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:56 smithi152 ceph-mon[34868]: osdmap e57: 10 total, 9 up, 10 in 2024-05-14T09:14:56.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:14:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:56 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1038121565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9c8846f-4e89-4037-be61-133dcc3f14b6"}]: dispatch 2024-05-14T09:14:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:56 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1038121565' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9c8846f-4e89-4037-be61-133dcc3f14b6"}]': finished 2024-05-14T09:14:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:56 smithi175 ceph-mon[35353]: osdmap e57: 10 total, 9 up, 10 in 2024-05-14T09:14:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:14:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:56 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1038121565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9c8846f-4e89-4037-be61-133dcc3f14b6"}]: dispatch 2024-05-14T09:14:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:56 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1038121565' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9c8846f-4e89-4037-be61-133dcc3f14b6"}]': finished 2024-05-14T09:14:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:56 smithi120 ceph-mon[31085]: osdmap e57: 10 total, 9 up, 10 in 2024-05-14T09:14:57.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:14:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:57 smithi152 ceph-mon[34868]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:14:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:57 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3468234374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:14:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:57 smithi175 ceph-mon[35353]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:14:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:57 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3468234374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:14:58.081 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:57 smithi120 ceph-mon[31085]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:14:58.081 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:57 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3468234374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:14:59.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:14:59 smithi152 ceph-mon[34868]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:14:59.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:14:59 smithi175 ceph-mon[35353]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:14:59 smithi120 ceph-mon[31085]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:01.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:01 smithi152 ceph-mon[34868]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:01 smithi175 ceph-mon[35353]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:01 smithi120 ceph-mon[31085]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:03.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:03 smithi175 ceph-mon[35353]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:03.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:03 smithi120 ceph-mon[31085]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:04.144 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:03 smithi152 ceph-mon[34868]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:05.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:05 smithi120 ceph-mon[31085]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:05.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T09:15:05.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:05 smithi175 ceph-mon[35353]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T09:15:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:05 smithi152 ceph-mon[34868]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T09:15:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:06.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:06 smithi120 ceph-mon[31085]: Deploying daemon osd.9 on smithi120 2024-05-14T09:15:07.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:06 smithi152 ceph-mon[34868]: Deploying daemon osd.9 on smithi120 2024-05-14T09:15:07.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:06 smithi175 ceph-mon[35353]: Deploying daemon osd.9 on smithi120 2024-05-14T09:15:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:07 smithi175 ceph-mon[35353]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:07 smithi120 ceph-mon[31085]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:07 smithi152 ceph-mon[34868]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:10.025 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:09 smithi120 ceph-mon[31085]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:09 smithi152 ceph-mon[34868]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:09 smithi175 ceph-mon[35353]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:12.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:11 smithi120 ceph-mon[31085]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:11 smithi152 ceph-mon[34868]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:11 smithi175 ceph-mon[35353]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:14.039 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:13 smithi120 ceph-mon[31085]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:13 smithi152 ceph-mon[34868]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:13 smithi175 ceph-mon[35353]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:16.118 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:15 smithi120 ceph-mon[31085]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:16.118 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:16.118 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:16.118 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:15 smithi152 ceph-mon[34868]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:15 smithi175 ceph-mon[35353]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:18.010 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:17 smithi120 ceph-mon[31085]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:17 smithi152 ceph-mon[34868]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:17 smithi175 ceph-mon[35353]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:19 smithi175 ceph-mon[35353]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:19 smithi175 ceph-mon[35353]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T09:15:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:19 smithi120 ceph-mon[31085]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:19 smithi120 ceph-mon[31085]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T09:15:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:19 smithi152 ceph-mon[34868]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:19 smithi152 ceph-mon[34868]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T09:15:20.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.664+0000 7fca0f400700 1 -- 172.21.15.120:0/1850306355 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fca1810aae0 con 0x7fc9fc0b2900 2024-05-14T09:15:20.664 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 9 on host 'smithi120' 2024-05-14T09:15:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9fc0b2900 msgr2=0x7fc9fc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:15:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9fc0b2900 0x7fc9fc0b4e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca04005950 tx=0x7fca040058e0 comp rx=0 tx=0).stop 2024-05-14T09:15:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 msgr2=0x7fca18106150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:15:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca08000c00 tx=0x7fca080047b0 comp rx=0 tx=0).stop 2024-05-14T09:15:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 shutdown_connections 2024-05-14T09:15:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9fc0b2900 0x7fc9fc0b4e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18109e00 0x7fca181a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca1806cd00 0x7fca18106150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 --2- 172.21.15.120:0/1850306355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18107290 0x7fca18106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 >> 172.21.15.120:0/1850306355 conn(0x7fca180fe690 msgr2=0x7fca18100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:15:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 shutdown_connections 2024-05-14T09:15:20.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:15:20.668+0000 7fca1ca00700 1 -- 172.21.15.120:0/1850306355 wait complete. 2024-05-14T09:15:21.089 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T09:15:21.089 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: osdmap e58: 10 total, 9 up, 10 in 2024-05-14T09:15:21.089 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:15:21.089 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:21.089 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:21.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:21.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:21.090 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T09:15:21.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: osdmap e58: 10 total, 9 up, 10 in 2024-05-14T09:15:21.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:15:21.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T09:15:21.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: osdmap e58: 10 total, 9 up, 10 in 2024-05-14T09:15:21.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-05-14T09:15:21.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:21.541 DEBUG:teuthology.orchestra.run.smithi120:osd.9> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.9.service 2024-05-14T09:15:21.547 INFO:tasks.cephadm:Deploying osd.10 on smithi152 with /dev/vg_nvme/lv_1... 2024-05-14T09:15:21.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T09:15:21.957 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:21 smithi152 ceph-mon[34868]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:21 smithi152 ceph-mon[34868]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:15:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:21 smithi152 ceph-mon[34868]: osdmap e59: 10 total, 9 up, 10 in 2024-05-14T09:15:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:21.998 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:15:22.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:21 smithi120 ceph-mon[31085]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:22.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:21 smithi120 ceph-mon[31085]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:15:22.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:21 smithi120 ceph-mon[31085]: osdmap e59: 10 total, 9 up, 10 in 2024-05-14T09:15:22.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:22.000 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:21 smithi175 ceph-mon[35353]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:21 smithi175 ceph-mon[35353]: from='osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-05-14T09:15:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:21 smithi175 ceph-mon[35353]: osdmap e59: 10 total, 9 up, 10 in 2024-05-14T09:15:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:23.009 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:22 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:15:23.009 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:22 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:15:23.009 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:23.009 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:22 smithi120 ceph-mon[31085]: osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] boot 2024-05-14T09:15:23.009 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:22 smithi120 ceph-mon[31085]: osdmap e60: 10 total, 10 up, 10 in 2024-05-14T09:15:23.009 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:23.071 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:22 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:15:23.071 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:22 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:15:23.071 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:23.071 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:22 smithi152 ceph-mon[34868]: osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] boot 2024-05-14T09:15:23.071 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:22 smithi152 ceph-mon[34868]: osdmap e60: 10 total, 10 up, 10 in 2024-05-14T09:15:23.071 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:22 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:15:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:22 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:15:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:22 smithi175 ceph-mon[35353]: osd.9 [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] boot 2024-05-14T09:15:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:22 smithi175 ceph-mon[35353]: osdmap e60: 10 total, 10 up, 10 in 2024-05-14T09:15:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T09:15:23.846 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:23 smithi120 ceph-mon[31085]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:23.846 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:23 smithi120 ceph-mon[31085]: osdmap e61: 10 total, 10 up, 10 in 2024-05-14T09:15:24.109 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:23 smithi152 ceph-mon[34868]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:24.109 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:23 smithi152 ceph-mon[34868]: osdmap e61: 10 total, 10 up, 10 in 2024-05-14T09:15:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:23 smithi175 ceph-mon[35353]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-14T09:15:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:23 smithi175 ceph-mon[35353]: osdmap e61: 10 total, 10 up, 10 in 2024-05-14T09:15:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T09:15:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T09:15:25.221 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2024-05-14T09:15:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2024-05-14T09:15:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0365021 s, 287 MB/s 2024-05-14T09:15:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2024-05-14T09:15:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:25 smithi152 ceph-mon[34868]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:26.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:25 smithi120 ceph-mon[31085]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:26.197 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_1 2024-05-14T09:15:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:25 smithi175 ceph-mon[35353]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:26.631 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi120 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi120 to 4272M 2024-05-14T09:15:27.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:27.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:27.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi120 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi120 to 4272M 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:27.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:27.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:27.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi120 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi120 to 4272M 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:29.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.229+0000 7f56e6800700 1 -- 172.21.15.152:0/3060049150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e010c1f0 msgr2=0x7f56e010e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:15:29.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.229+0000 7f56e6800700 1 --2- 172.21.15.152:0/3060049150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e010c1f0 0x7f56e010e700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b0a0 tx=0x7f56d800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:15:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.229+0000 7f56e6800700 1 -- 172.21.15.152:0/3060049150 shutdown_connections 2024-05-14T09:15:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.229+0000 7f56e6800700 1 --2- 172.21.15.152:0/3060049150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e010c1f0 0x7f56e010e700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.229+0000 7f56e6800700 1 --2- 172.21.15.152:0/3060049150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e00776e0 0x7f56e0075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.229+0000 7f56e6800700 1 --2- 172.21.15.152:0/3060049150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e00760f0 0x7f56e0076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.229+0000 7f56e6800700 1 -- 172.21.15.152:0/3060049150 >> 172.21.15.152:0/3060049150 conn(0x7f56e00ff9c0 msgr2=0x7f56e0101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:15:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.230+0000 7f56e6800700 1 -- 172.21.15.152:0/3060049150 shutdown_connections 2024-05-14T09:15:29.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.230+0000 7f56e6800700 1 -- 172.21.15.152:0/3060049150 wait complete. 2024-05-14T09:15:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 Processor -- start 2024-05-14T09:15:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 -- start start 2024-05-14T09:15:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e00760f0 0x7f56e019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:15:29.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e00776e0 0x7f56e019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e010c1f0 0x7f56e01a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0111ea0 con 0x7f56e010c1f0 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0111d20 con 0x7f56e00776e0 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56e6800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0112020 con 0x7f56e00760f0 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.231+0000 7f56dea00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e00776e0 0x7f56e019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dea00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e00776e0 0x7f56e019cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39414/0 (socket says 172.21.15.152:39414) 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dea00700 1 -- 172.21.15.152:0/3450424293 learned_addr learned my addr 172.21.15.152:0/3450424293 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56df400700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e00760f0 0x7f56e019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dfe00700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e010c1f0 0x7f56e01a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dea00700 1 -- 172.21.15.152:0/3450424293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e00760f0 msgr2=0x7f56e019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:15:29.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dea00700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e00760f0 0x7f56e019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dea00700 1 -- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e010c1f0 msgr2=0x7f56e01a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dea00700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e010c1f0 0x7f56e01a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.232+0000 7f56dea00700 1 -- 172.21.15.152:0/3450424293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e01a44e0 con 0x7f56e00776e0 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.233+0000 7f56dea00700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e00776e0 0x7f56e019cf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00c920 tx=0x7f56cc00cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.233+0000 7f56d7e00700 1 -- 172.21.15.152:0/3450424293 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc007b00 con 0x7f56e00776e0 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.233+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e01a47d0 con 0x7f56e00776e0 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.233+0000 7f56d7e00700 1 -- 172.21.15.152:0/3450424293 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56cc004cc0 con 0x7f56e00776e0 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.233+0000 7f56d7e00700 1 -- 172.21.15.152:0/3450424293 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0053f0 con 0x7f56e00776e0 2024-05-14T09:15:29.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.233+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01a4d60 con 0x7f56e00776e0 2024-05-14T09:15:29.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.234+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e00512c0 con 0x7f56e00776e0 2024-05-14T09:15:29.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.238+0000 7f56d7e00700 1 -- 172.21.15.152:0/3450424293 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f56cc004750 con 0x7f56e00776e0 2024-05-14T09:15:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.241+0000 7f56d7e00700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f56c40b2880 0x7f56c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:15:29.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.241+0000 7f56d7e00700 1 -- 172.21.15.152:0/3450424293 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6261+0+0 (secure 0 0 0) 0x7f56cc0e1a50 con 0x7f56e00776e0 2024-05-14T09:15:29.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.242+0000 7f56df400700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f56c40b2880 0x7f56c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:15:29.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.242+0000 7f56d7e00700 1 -- 172.21.15.152:0/3450424293 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f56cc014030 con 0x7f56e00776e0 2024-05-14T09:15:29.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.243+0000 7f56df400700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f56c40b2880 0x7f56c40b4d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56e00773e0 tx=0x7f56d000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:15:29.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:29.483+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f56e0063c00 con 0x7f56c40b2880 2024-05-14T09:15:29.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:29 smithi120 ceph-mon[31085]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:29.707 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:29 smithi152 ceph-mon[34868]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:29.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:29 smithi175 ceph-mon[35353]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:30.589 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:30 smithi152 ceph-mon[34868]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:15:30.589 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:15:30.589 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:15:30.589 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:30 smithi120 ceph-mon[31085]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:15:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:15:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:15:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:30 smithi175 ceph-mon[35353]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:15:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:15:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:15:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:31.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:31 smithi120 ceph-mon[31085]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:31.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:31 smithi152 ceph-mon[34868]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:31.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:31 smithi175 ceph-mon[35353]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:33 smithi120 ceph-mon[31085]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:33.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:33 smithi152 ceph-mon[34868]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:33.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:33 smithi175 ceph-mon[35353]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:34.409 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:34 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/792420039' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]: dispatch 2024-05-14T09:15:34.409 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:34 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]: dispatch 2024-05-14T09:15:34.409 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:34 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]': finished 2024-05-14T09:15:34.409 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:34 smithi152 ceph-mon[34868]: osdmap e62: 11 total, 10 up, 11 in 2024-05-14T09:15:34.409 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:34.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:34 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/792420039' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]: dispatch 2024-05-14T09:15:34.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:34 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]: dispatch 2024-05-14T09:15:34.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:34 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]': finished 2024-05-14T09:15:34.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:34 smithi120 ceph-mon[31085]: osdmap e62: 11 total, 10 up, 11 in 2024-05-14T09:15:34.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:34 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/792420039' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]: dispatch 2024-05-14T09:15:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:34 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]: dispatch 2024-05-14T09:15:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:34 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "345256b7-22fe-434c-b01b-9fd4b7863770"}]': finished 2024-05-14T09:15:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:34 smithi175 ceph-mon[35353]: osdmap e62: 11 total, 10 up, 11 in 2024-05-14T09:15:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:35 smithi120 ceph-mon[31085]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:35.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:35 smithi120 ceph-mon[31085]: from='client.? 172.21.15.152:0/1546730071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:15:35.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:35 smithi152 ceph-mon[34868]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:35.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:35 smithi152 ceph-mon[34868]: from='client.? 172.21.15.152:0/1546730071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:15:35.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:35 smithi175 ceph-mon[35353]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:35.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:35 smithi175 ceph-mon[35353]: from='client.? 172.21.15.152:0/1546730071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:15:37.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:37 smithi120 ceph-mon[31085]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:37.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:37 smithi152 ceph-mon[34868]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:37.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:37 smithi175 ceph-mon[35353]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:39.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:39 smithi120 ceph-mon[31085]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:39.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:39 smithi152 ceph-mon[34868]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:39.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:39 smithi175 ceph-mon[35353]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:41.601 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:41 smithi152 ceph-mon[34868]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:41.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:41 smithi120 ceph-mon[31085]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:41.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:41 smithi175 ceph-mon[35353]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:43.602 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:43 smithi152 ceph-mon[34868]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:43.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:43 smithi120 ceph-mon[31085]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:43 smithi175 ceph-mon[35353]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T09:15:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:44 smithi120 ceph-mon[31085]: Deploying daemon osd.10 on smithi152 2024-05-14T09:15:44.689 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T09:15:44.689 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:44.690 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:44 smithi152 ceph-mon[34868]: Deploying daemon osd.10 on smithi152 2024-05-14T09:15:44.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T09:15:44.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:44.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:44 smithi175 ceph-mon[35353]: Deploying daemon osd.10 on smithi152 2024-05-14T09:15:45.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:45 smithi120 ceph-mon[31085]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:45.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:45 smithi152 ceph-mon[34868]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:45.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:45 smithi175 ceph-mon[35353]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:47.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:47 smithi152 ceph-mon[34868]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:47.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:47 smithi120 ceph-mon[31085]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:47.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:47 smithi175 ceph-mon[35353]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:49.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:49 smithi120 ceph-mon[31085]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:49.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:49 smithi152 ceph-mon[34868]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:49.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:49 smithi175 ceph-mon[35353]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:51.595 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:51 smithi152 ceph-mon[34868]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:51.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:51 smithi120 ceph-mon[31085]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:51.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:51 smithi175 ceph-mon[35353]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:53 smithi152 ceph-mon[34868]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:53.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:53 smithi120 ceph-mon[31085]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:53.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:53 smithi175 ceph-mon[35353]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:54.651 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:54 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:54.651 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:54 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:54.651 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:54 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:54.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:54 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:54.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:54 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:54.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:54 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:54.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:54 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:54.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:54 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:54.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:54 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:55.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:55 smithi152 ceph-mon[34868]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:55.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:55 smithi175 ceph-mon[35353]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:55 smithi120 ceph-mon[31085]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:57 smithi152 ceph-mon[34868]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:57 smithi152 ceph-mon[34868]: from='osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T09:15:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:57 smithi152 ceph-mon[34868]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T09:15:57.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:57 smithi175 ceph-mon[35353]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:57.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:57 smithi175 ceph-mon[35353]: from='osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T09:15:57.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:57 smithi175 ceph-mon[35353]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T09:15:57.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:57 smithi120 ceph-mon[31085]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:57.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:57 smithi120 ceph-mon[31085]: from='osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T09:15:57.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:57 smithi120 ceph-mon[31085]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T09:15:58.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T09:15:58.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:15:58.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: osdmap e63: 11 total, 10 up, 11 in 2024-05-14T09:15:58.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:58.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:15:58.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:58.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:58.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T09:15:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:15:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: osdmap e63: 11 total, 10 up, 11 in 2024-05-14T09:15:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:15:58.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:58.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:58.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: osdmap e63: 11 total, 10 up, 11 in 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:15:58.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.109+0000 7f56d7e00700 1 -- 172.21.15.152:0/3450424293 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f56e0063c00 con 0x7f56c40b2880 2024-05-14T09:15:59.111 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 10 on host 'smithi152' 2024-05-14T09:15:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f56c40b2880 msgr2=0x7f56c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:15:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f56c40b2880 0x7f56c40b4d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56e00773e0 tx=0x7f56d000a380 comp rx=0 tx=0).stop 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e00776e0 msgr2=0x7f56e019cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e00776e0 0x7f56e019cf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00c920 tx=0x7f56cc00cc30 comp rx=0 tx=0).stop 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 shutdown_connections 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f56c40b2880 0x7f56c40b4d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e010c1f0 0x7f56e01a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e00760f0 0x7f56e019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 --2- 172.21.15.152:0/3450424293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e00776e0 0x7f56e019cf50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 >> 172.21.15.152:0/3450424293 conn(0x7f56e00ff9c0 msgr2=0x7f56e0108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 shutdown_connections 2024-05-14T09:15:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-05-14T09:15:59.113+0000 7f56e6800700 1 -- 172.21.15.152:0/3450424293 wait complete. 2024-05-14T09:15:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:15:59.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: osdmap e64: 11 total, 10 up, 11 in 2024-05-14T09:15:59.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:59.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:59.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:59.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:59.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:15:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:59.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:59.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:15:59.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: osdmap e64: 11 total, 10 up, 11 in 2024-05-14T09:15:59.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:59.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:59.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:59.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:59.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:15:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:15:59.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:15:59.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-05-14T09:15:59.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: osdmap e64: 11 total, 10 up, 11 in 2024-05-14T09:15:59.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:59.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:15:59.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:59.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:15:59.960 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:15:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:00.033 DEBUG:teuthology.orchestra.run.smithi152:osd.10> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.10.service 2024-05-14T09:16:00.038 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-05-14T09:16:00.038 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T09:16:00.484 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:16:00.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:00 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:16:00.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:00 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:16:00.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:00 smithi175 ceph-mon[35353]: osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] boot 2024-05-14T09:16:00.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:00 smithi175 ceph-mon[35353]: osdmap e65: 11 total, 11 up, 11 in 2024-05-14T09:16:00.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:00 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:16:00.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:00 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:16:00.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:00 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:16:00.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:00 smithi120 ceph-mon[31085]: osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] boot 2024-05-14T09:16:00.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:00 smithi120 ceph-mon[31085]: osdmap e65: 11 total, 11 up, 11 in 2024-05-14T09:16:00.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:00 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:16:00.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:00 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:16:00.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:00 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:16:00.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:00 smithi152 ceph-mon[34868]: osd.10 [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] boot 2024-05-14T09:16:00.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:00 smithi152 ceph-mon[34868]: osdmap e65: 11 total, 11 up, 11 in 2024-05-14T09:16:00.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:00 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T09:16:01.841 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:01 smithi152 ceph-mon[34868]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:16:01.841 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:01 smithi152 ceph-mon[34868]: osdmap e66: 11 total, 11 up, 11 in 2024-05-14T09:16:01.841 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:01 smithi152 ceph-mon[34868]: osdmap e67: 11 total, 11 up, 11 in 2024-05-14T09:16:01.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:01 smithi120 ceph-mon[31085]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:16:01.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:01 smithi120 ceph-mon[31085]: osdmap e66: 11 total, 11 up, 11 in 2024-05-14T09:16:01.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:01 smithi120 ceph-mon[31085]: osdmap e67: 11 total, 11 up, 11 in 2024-05-14T09:16:01.975 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:01 smithi175 ceph-mon[35353]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-05-14T09:16:01.975 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:01 smithi175 ceph-mon[35353]: osdmap e66: 11 total, 11 up, 11 in 2024-05-14T09:16:01.975 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:01 smithi175 ceph-mon[35353]: osdmap e67: 11 total, 11 up, 11 in 2024-05-14T09:16:03.565 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T09:16:03.566 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T09:16:03.566 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-05-14T09:16:03.566 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-05-14T09:16:03.566 INFO:teuthology.orchestra.run.smithi175.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0411031 s, 255 MB/s 2024-05-14T09:16:03.566 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-05-14T09:16:03.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:03 smithi120 ceph-mon[31085]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-14T09:16:03.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:03 smithi175 ceph-mon[35353]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-14T09:16:03.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:03 smithi152 ceph-mon[34868]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-14T09:16:04.519 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-05-14T09:16:04.922 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:05.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:05.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-14T09:16:05.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:05.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:06.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:06 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi152 2024-05-14T09:16:06.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:06 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi152 to 4272M 2024-05-14T09:16:06.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:06 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi152 2024-05-14T09:16:06.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:06 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi152 to 4272M 2024-05-14T09:16:06.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:06 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi152 2024-05-14T09:16:06.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:06 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi152 to 4272M 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.204+0000 7fe9a1e00700 1 -- 172.21.15.175:0/763458180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c106390 msgr2=0x7fe99c1067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.204+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/763458180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c106390 0x7fe99c1067a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe990009990 tx=0x7fe990009ca0 comp rx=0 tx=0).stop 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.204+0000 7fe9a1e00700 1 -- 172.21.15.175:0/763458180 shutdown_connections 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.204+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/763458180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe99c107e60 0x7fe99c10e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.204+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/763458180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c106390 0x7fe99c1067a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.204+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/763458180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1074c0 0x7fe99c1078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.204+0000 7fe9a1e00700 1 -- 172.21.15.175:0/763458180 >> 172.21.15.175:0/763458180 conn(0x7fe99c101a10 msgr2=0x7fe99c103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:07.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.205+0000 7fe9a1e00700 1 -- 172.21.15.175:0/763458180 shutdown_connections 2024-05-14T09:16:07.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.205+0000 7fe9a1e00700 1 -- 172.21.15.175:0/763458180 wait complete. 2024-05-14T09:16:07.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 Processor -- start 2024-05-14T09:16:07.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 -- start start 2024-05-14T09:16:07.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c106390 0x7fe99c19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:07.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c1074c0 0x7fe99c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:07.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe99c107e60 0x7fe99c1a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c111c80 con 0x7fe99c106390 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c111b00 con 0x7fe99c107e60 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.206+0000 7fe9a1e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c111e00 con 0x7fe99c1074c0 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c1074c0 0x7fe99c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c1074c0 0x7fe99c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39628/0 (socket says 172.21.15.175:39628) 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 -- 172.21.15.175:0/1944665387 learned_addr learned my addr 172.21.15.175:0/1944665387 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe9a0a00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c106390 0x7fe99c19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe9a1400700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe99c107e60 0x7fe99c1a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 -- 172.21.15.175:0/1944665387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe99c107e60 msgr2=0x7fe99c1a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe99c107e60 0x7fe99c1a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 -- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c106390 msgr2=0x7fe99c19c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c106390 0x7fe99c19c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 -- 172.21.15.175:0/1944665387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c1a42c0 con 0x7fe99c1074c0 2024-05-14T09:16:07.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.207+0000 7fe99be00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c1074c0 0x7fe99c19cd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe98800c9b0 tx=0x7fe98800cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:07.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.208+0000 7fe999600700 1 -- 172.21.15.175:0/1944665387 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988007b00 con 0x7fe99c1074c0 2024-05-14T09:16:07.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.208+0000 7fe999600700 1 -- 172.21.15.175:0/1944665387 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe988007ca0 con 0x7fe99c1074c0 2024-05-14T09:16:07.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.208+0000 7fe999600700 1 -- 172.21.15.175:0/1944665387 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988018660 con 0x7fe99c1074c0 2024-05-14T09:16:07.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.208+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c1a45b0 con 0x7fe99c1074c0 2024-05-14T09:16:07.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.208+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c1a4b40 con 0x7fe99c1074c0 2024-05-14T09:16:07.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.209+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c0512c0 con 0x7fe99c1074c0 2024-05-14T09:16:07.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.212+0000 7fe999600700 1 -- 172.21.15.175:0/1944665387 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fe98800f450 con 0x7fe99c1074c0 2024-05-14T09:16:07.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.213+0000 7fe999600700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9840b2900 0x7fe9840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:07.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.214+0000 7fe999600700 1 -- 172.21.15.175:0/1944665387 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6694+0+0 (secure 0 0 0) 0x7fe9880e1f30 con 0x7fe99c1074c0 2024-05-14T09:16:07.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.214+0000 7fe9a0a00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9840b2900 0x7fe9840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:07.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.215+0000 7fe9a0a00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9840b2900 0x7fe9840b4e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe990003820 tx=0x7fe99001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:07.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.218+0000 7fe999600700 1 -- 172.21.15.175:0/1944665387 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe988014030 con 0x7fe99c1074c0 2024-05-14T09:16:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:07.454+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe99c063c00 con 0x7fe9840b2900 2024-05-14T09:16:07.786 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:07 smithi120 ceph-mon[31085]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T09:16:07.786 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:16:07.786 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:16:07.786 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:07 smithi152 ceph-mon[34868]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T09:16:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:16:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:16:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:07 smithi175 ceph-mon[35353]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T09:16:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T09:16:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T09:16:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:08 smithi175 ceph-mon[35353]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:16:08.818 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:08 smithi120 ceph-mon[31085]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:16:08.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:08 smithi152 ceph-mon[34868]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:16:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:09 smithi120 ceph-mon[31085]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T09:16:09.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:09 smithi175 ceph-mon[35353]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T09:16:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:09 smithi152 ceph-mon[34868]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T09:16:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:11 smithi120 ceph-mon[31085]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:16:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:11 smithi152 ceph-mon[34868]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:16:11.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:11 smithi175 ceph-mon[35353]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T09:16:12.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:12 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/1902160660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]: dispatch 2024-05-14T09:16:12.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:12 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]: dispatch 2024-05-14T09:16:12.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:12 smithi175 ceph-mon[35353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]': finished 2024-05-14T09:16:12.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:12 smithi175 ceph-mon[35353]: osdmap e68: 12 total, 11 up, 12 in 2024-05-14T09:16:12.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:12.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:12 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/1902160660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]: dispatch 2024-05-14T09:16:12.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:12 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]: dispatch 2024-05-14T09:16:12.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:12 smithi120 ceph-mon[31085]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]': finished 2024-05-14T09:16:12.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:12 smithi120 ceph-mon[31085]: osdmap e68: 12 total, 11 up, 12 in 2024-05-14T09:16:12.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:12 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/1902160660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]: dispatch 2024-05-14T09:16:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:12 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]: dispatch 2024-05-14T09:16:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:12 smithi152 ceph-mon[34868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98aafbef-b766-49dc-b707-68043cf59c21"}]': finished 2024-05-14T09:16:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:12 smithi152 ceph-mon[34868]: osdmap e68: 12 total, 11 up, 12 in 2024-05-14T09:16:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:13.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:13 smithi120 ceph-mon[31085]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:13.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:13 smithi120 ceph-mon[31085]: from='client.? 172.21.15.175:0/1012736905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:16:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:13 smithi152 ceph-mon[34868]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:13 smithi152 ceph-mon[34868]: from='client.? 172.21.15.175:0/1012736905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:16:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:13 smithi175 ceph-mon[35353]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:13 smithi175 ceph-mon[35353]: from='client.? 172.21.15.175:0/1012736905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T09:16:15.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:15 smithi120 ceph-mon[31085]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:15 smithi152 ceph-mon[34868]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:15 smithi175 ceph-mon[35353]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:17.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:17 smithi120 ceph-mon[31085]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:17 smithi152 ceph-mon[34868]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:17.976 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:17 smithi175 ceph-mon[35353]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:19.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:19 smithi120 ceph-mon[31085]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:19.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:19 smithi175 ceph-mon[35353]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:19 smithi152 ceph-mon[34868]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:21 smithi120 ceph-mon[31085]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T09:16:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:21 smithi152 ceph-mon[34868]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T09:16:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:21 smithi175 ceph-mon[35353]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T09:16:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:22 smithi120 ceph-mon[31085]: Deploying daemon osd.11 on smithi175 2024-05-14T09:16:22.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:22 smithi152 ceph-mon[34868]: Deploying daemon osd.11 on smithi175 2024-05-14T09:16:22.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:22 smithi175 ceph-mon[35353]: Deploying daemon osd.11 on smithi175 2024-05-14T09:16:23.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:23 smithi175 ceph-mon[35353]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:23 smithi120 ceph-mon[31085]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:23.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:23 smithi152 ceph-mon[34868]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:25 smithi120 ceph-mon[31085]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:25 smithi152 ceph-mon[34868]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:25 smithi175 ceph-mon[35353]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:27.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:27 smithi120 ceph-mon[31085]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:27 smithi152 ceph-mon[34868]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:27 smithi175 ceph-mon[35353]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:29.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:29 smithi120 ceph-mon[31085]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:29 smithi152 ceph-mon[34868]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:29 smithi175 ceph-mon[35353]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:31.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:31 smithi120 ceph-mon[31085]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:31.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:31.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:31.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:31.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:31 smithi175 ceph-mon[35353]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:31.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:31.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:31.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:31 smithi152 ceph-mon[34868]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:33.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:33 smithi175 ceph-mon[35353]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:33.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:33 smithi120 ceph-mon[31085]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:33.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:33 smithi152 ceph-mon[34868]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: from='osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T09:16:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T09:16:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:35 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: from='osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T09:16:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T09:16:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:35.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:35.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:35 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: from='osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T09:16:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T09:16:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:35.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:35.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:35.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:35 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:36.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.574+0000 7fe999600700 1 -- 172.21.15.175:0/1944665387 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe99c063c00 con 0x7fe9840b2900 2024-05-14T09:16:36.575 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-05-14T09:16:36.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9840b2900 msgr2=0x7fe9840b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:36.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9840b2900 0x7fe9840b4e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe990003820 tx=0x7fe99001a040 comp rx=0 tx=0).stop 2024-05-14T09:16:36.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c1074c0 msgr2=0x7fe99c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:36.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c1074c0 0x7fe99c19cd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe98800c9b0 tx=0x7fe98800cd70 comp rx=0 tx=0).stop 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 shutdown_connections 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9840b2900 0x7fe9840b4e10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe99c107e60 0x7fe99c1a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c106390 0x7fe99c19c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 --2- 172.21.15.175:0/1944665387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99c1074c0 0x7fe99c19cd30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.578+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 >> 172.21.15.175:0/1944665387 conn(0x7fe99c101a10 msgr2=0x7fe99c10a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.579+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 shutdown_connections 2024-05-14T09:16:36.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:36.579+0000 7fe9a1e00700 1 -- 172.21.15.175:0/1944665387 wait complete. 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: osdmap e69: 12 total, 11 up, 12 in 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: from='osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:36 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T09:16:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: osdmap e69: 12 total, 11 up, 12 in 2024-05-14T09:16:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:36.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: from='osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:16:36.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:16:36.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:36.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:36.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:36 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:36.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T09:16:36.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: osdmap e69: 12 total, 11 up, 12 in 2024-05-14T09:16:36.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:36.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: from='osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:16:36.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-05-14T09:16:36.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:36.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:36.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:36 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:37.424 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.11.service 2024-05-14T09:16:37.429 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-14T09:16:37.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-14T09:16:37.784 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:37 smithi120 ceph-mon[31085]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:37.785 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:37 smithi120 ceph-mon[31085]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:16:37.785 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:37 smithi120 ceph-mon[31085]: osdmap e70: 12 total, 11 up, 12 in 2024-05-14T09:16:37.785 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:37.785 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:37.885 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:16:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:37 smithi152 ceph-mon[34868]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:37 smithi152 ceph-mon[34868]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:16:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:37 smithi152 ceph-mon[34868]: osdmap e70: 12 total, 11 up, 12 in 2024-05-14T09:16:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:37 smithi175 ceph-mon[35353]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:37 smithi175 ceph-mon[35353]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-05-14T09:16:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:37 smithi175 ceph-mon[35353]: osdmap e70: 12 total, 11 up, 12 in 2024-05-14T09:16:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:38.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:38 smithi120 ceph-mon[31085]: purged_snaps scrub starts 2024-05-14T09:16:38.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:38 smithi120 ceph-mon[31085]: purged_snaps scrub ok 2024-05-14T09:16:38.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:38 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:38.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:38 smithi120 ceph-mon[31085]: osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] boot 2024-05-14T09:16:38.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:38 smithi120 ceph-mon[31085]: osdmap e71: 12 total, 12 up, 12 in 2024-05-14T09:16:38.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:38 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:38 smithi152 ceph-mon[34868]: purged_snaps scrub starts 2024-05-14T09:16:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:38 smithi152 ceph-mon[34868]: purged_snaps scrub ok 2024-05-14T09:16:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:38 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:38 smithi152 ceph-mon[34868]: osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] boot 2024-05-14T09:16:38.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:38 smithi152 ceph-mon[34868]: osdmap e71: 12 total, 12 up, 12 in 2024-05-14T09:16:38.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:38 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:38.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:38 smithi175 ceph-mon[35353]: purged_snaps scrub starts 2024-05-14T09:16:38.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:38 smithi175 ceph-mon[35353]: purged_snaps scrub ok 2024-05-14T09:16:38.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:38 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:38.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:38 smithi175 ceph-mon[35353]: osd.11 [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] boot 2024-05-14T09:16:38.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:38 smithi175 ceph-mon[35353]: osdmap e71: 12 total, 12 up, 12 in 2024-05-14T09:16:38.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:38 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T09:16:39.943 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:39 smithi120 ceph-mon[31085]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:39.944 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:39 smithi120 ceph-mon[31085]: osdmap e72: 12 total, 12 up, 12 in 2024-05-14T09:16:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:39 smithi152 ceph-mon[34868]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:39 smithi152 ceph-mon[34868]: osdmap e72: 12 total, 12 up, 12 in 2024-05-14T09:16:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:39 smithi175 ceph-mon[35353]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-14T09:16:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:39 smithi175 ceph-mon[35353]: osdmap e72: 12 total, 12 up, 12 in 2024-05-14T09:16:40.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 -- 172.21.15.120:0/1550654238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 msgr2=0x7f806410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:40.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 --2- 172.21.15.120:0/1550654238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f806410c510 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f805c00b0a0 tx=0x7f805c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 -- 172.21.15.120:0/1550654238 shutdown_connections 2024-05-14T09:16:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 --2- 172.21.15.120:0/1550654238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f806410c510 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 --2- 172.21.15.120:0/1550654238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8064104e30 0x7f8064107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 --2- 172.21.15.120:0/1550654238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064107790 0x7f8064109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 -- 172.21.15.120:0/1550654238 >> 172.21.15.120:0/1550654238 conn(0x7f80640fe870 msgr2=0x7f8064100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 -- 172.21.15.120:0/1550654238 shutdown_connections 2024-05-14T09:16:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.352+0000 7f806a600700 1 -- 172.21.15.120:0/1550654238 wait complete. 2024-05-14T09:16:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.353+0000 7f806a600700 1 Processor -- start 2024-05-14T09:16:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.353+0000 7f806a600700 1 -- start start 2024-05-14T09:16:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.353+0000 7f806a600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064104e30 0x7f806419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.353+0000 7f806a600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8064107790 0x7f806419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f806a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f80641a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f806a600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f806410fc90 con 0x7f806410a0f0 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f806a600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f806410fb10 con 0x7f8064104e30 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f806a600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f806410fe10 con 0x7f8064107790 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f80641a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f80641a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40452/0 (socket says 172.21.15.120:40452) 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 -- 172.21.15.120:0/3877121084 learned_addr learned my addr 172.21.15.120:0/3877121084 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f805aa00700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8064107790 0x7f806419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063400700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064104e30 0x7f806419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 -- 172.21.15.120:0/3877121084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8064107790 msgr2=0x7f806419ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8064107790 0x7f806419ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 -- 172.21.15.120:0/3877121084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064104e30 msgr2=0x7f806419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064104e30 0x7f806419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063e00700 1 -- 172.21.15.120:0/3877121084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8064102c20 con 0x7f806410a0f0 2024-05-14T09:16:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.354+0000 7f8063400700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064104e30 0x7f806419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:16:40.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.355+0000 7f8063e00700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f80641a1cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f805c00b830 tx=0x7f805c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:40.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.355+0000 7f8060c00700 1 -- 172.21.15.120:0/3877121084 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c021070 con 0x7f806410a0f0 2024-05-14T09:16:40.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.355+0000 7f8060c00700 1 -- 172.21.15.120:0/3877121084 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f805c007c80 con 0x7f806410a0f0 2024-05-14T09:16:40.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.355+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8064102eb0 con 0x7f806410a0f0 2024-05-14T09:16:40.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.355+0000 7f8060c00700 1 -- 172.21.15.120:0/3877121084 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c01b7b0 con 0x7f806410a0f0 2024-05-14T09:16:40.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.355+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80641033e0 con 0x7f806410a0f0 2024-05-14T09:16:40.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.356+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80640512c0 con 0x7f806410a0f0 2024-05-14T09:16:40.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.359+0000 7f8060c00700 1 -- 172.21.15.120:0/3877121084 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f805c024070 con 0x7f806410a0f0 2024-05-14T09:16:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.360+0000 7f8060c00700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f80480b2900 0x7f80480b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.361+0000 7f8060c00700 1 -- 172.21.15.120:0/3877121084 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f805c00f020 con 0x7f806410a0f0 2024-05-14T09:16:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.361+0000 7f8063400700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f80480b2900 0x7f80480b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:40.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.361+0000 7f8063400700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f80480b2900 0x7f80480b4e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8054005950 tx=0x7f80540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:40.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.363+0000 7f8060c00700 1 -- 172.21.15.120:0/3877121084 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f805c02b020 con 0x7f806410a0f0 2024-05-14T09:16:40.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.594+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8064104a50 con 0x7f806410a0f0 2024-05-14T09:16:40.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.595+0000 7f8060c00700 1 -- 172.21.15.120:0/3877121084 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f805c0ab7c0 con 0x7f806410a0f0 2024-05-14T09:16:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:16:40.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f80480b2900 msgr2=0x7f80480b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:40.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f80480b2900 0x7f80480b4e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8054005950 tx=0x7f80540058e0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 msgr2=0x7f80641a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:40.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f80641a1cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f805c00b830 tx=0x7f805c00bd70 comp rx=0 tx=0).stop 2024-05-14T09:16:40.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 shutdown_connections 2024-05-14T09:16:40.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f80480b2900 0x7f80480b4e10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8064104e30 0x7f806419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806410a0f0 0x7f80641a1cf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 --2- 172.21.15.120:0/3877121084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8064107790 0x7f806419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:40.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.598+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 >> 172.21.15.120:0/3877121084 conn(0x7f80640fe870 msgr2=0x7f8064105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:40.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.599+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 shutdown_connections 2024-05-14T09:16:40.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:40.599+0000 7f806a600700 1 -- 172.21.15.120:0/3877121084 wait complete. 2024-05-14T09:16:40.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:40 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3877121084' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T09:16:40.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:40 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3877121084' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T09:16:40.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:40 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3877121084' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T09:16:41.477 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1715678197,"num_in_osds":12,"osd_in_since":1715678171,"num_remapped_pgs":0} 2024-05-14T09:16:41.478 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:16:41.930 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:16:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:41 smithi152 ceph-mon[34868]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:41 smithi175 ceph-mon[35353]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:42.083 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:41 smithi120 ceph-mon[31085]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: Detected new or changed devices on smithi175 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi175 to 4272M 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:43 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: Detected new or changed devices on smithi175 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.869 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi175 to 4272M 2024-05-14T09:16:43.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:43.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:43.870 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:43 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: Detected new or changed devices on smithi175 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi175 to 4272M 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:43.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:43 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 -- 172.21.15.120:0/3712195816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010b110 msgr2=0x7fbd40117620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 --2- 172.21.15.120:0/3712195816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010b110 0x7fbd40117620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800b0a0 tx=0x7fbd3800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 -- 172.21.15.120:0/3712195816 shutdown_connections 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 --2- 172.21.15.120:0/3712195816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010b110 0x7fbd40117620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 --2- 172.21.15.120:0/3712195816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd4010f6c0 0x7fbd4010fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 --2- 172.21.15.120:0/3712195816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd4010a7c0 0x7fbd4010abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 -- 172.21.15.120:0/3712195816 >> 172.21.15.120:0/3712195816 conn(0x7fbd40076b00 msgr2=0x7fbd40076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 -- 172.21.15.120:0/3712195816 shutdown_connections 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.112+0000 7fbd3f200700 1 -- 172.21.15.120:0/3712195816 wait complete. 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.113+0000 7fbd3f200700 1 Processor -- start 2024-05-14T09:16:44.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.113+0000 7fbd3f200700 1 -- start start 2024-05-14T09:16:44.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3f200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010a7c0 0x7fbd401a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:44.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3f200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd4010b110 0x7fbd401a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:44.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3f200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd4010f6c0 0x7fbd401a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:44.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3f200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4011a7a0 con 0x7fbd4010a7c0 2024-05-14T09:16:44.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3f200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4011a620 con 0x7fbd4010f6c0 2024-05-14T09:16:44.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3f200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4011a920 con 0x7fbd4010b110 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010a7c0 0x7fbd401a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010a7c0 0x7fbd401a10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40466/0 (socket says 172.21.15.120:40466) 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.114+0000 7fbd3de00700 1 -- 172.21.15.120:0/2814270938 learned_addr learned my addr 172.21.15.120:0/2814270938 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3d400700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd4010b110 0x7fbd401a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3e800700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd4010f6c0 0x7fbd401a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3de00700 1 -- 172.21.15.120:0/2814270938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd4010b110 msgr2=0x7fbd401a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3de00700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd4010b110 0x7fbd401a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3de00700 1 -- 172.21.15.120:0/2814270938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd4010f6c0 msgr2=0x7fbd401a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3de00700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd4010f6c0 0x7fbd401a5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3de00700 1 -- 172.21.15.120:0/2814270938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd401a5f10 con 0x7fbd4010a7c0 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3e800700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd4010f6c0 0x7fbd401a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3de00700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010a7c0 0x7fbd401a10f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c9b0 tx=0x7fbd3000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd36a00700 1 -- 172.21.15.120:0/2814270938 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30007b00 con 0x7fbd4010a7c0 2024-05-14T09:16:44.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd401a61a0 con 0x7fbd4010a7c0 2024-05-14T09:16:44.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd36a00700 1 -- 172.21.15.120:0/2814270938 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd30007ca0 con 0x7fbd4010a7c0 2024-05-14T09:16:44.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.115+0000 7fbd36a00700 1 -- 172.21.15.120:0/2814270938 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30018660 con 0x7fbd4010a7c0 2024-05-14T09:16:44.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.116+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd401a66e0 con 0x7fbd4010a7c0 2024-05-14T09:16:44.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.117+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd400512c0 con 0x7fbd4010a7c0 2024-05-14T09:16:44.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.119+0000 7fbd36a00700 1 -- 172.21.15.120:0/2814270938 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fbd3000f450 con 0x7fbd4010a7c0 2024-05-14T09:16:44.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.121+0000 7fbd36a00700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd240b2880 0x7fbd240b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:44.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.121+0000 7fbd36a00700 1 -- 172.21.15.120:0/2814270938 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fbd300e2110 con 0x7fbd4010a7c0 2024-05-14T09:16:44.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.121+0000 7fbd3d400700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd240b2880 0x7fbd240b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:44.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.122+0000 7fbd3d400700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd240b2880 0x7fbd240b4d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c005950 tx=0x7fbd2c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:44.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.125+0000 7fbd36a00700 1 -- 172.21.15.120:0/2814270938 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbd30014030 con 0x7fbd4010a7c0 2024-05-14T09:16:44.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.357+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd4002e5f0 con 0x7fbd4010a7c0 2024-05-14T09:16:44.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.359+0000 7fbd36a00700 1 -- 172.21.15.120:0/2814270938 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18465 (secure 0 0 0) 0x7fbd300aa2c0 con 0x7fbd4010a7c0 2024-05-14T09:16:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:16:44.360 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":72,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:16:38.641682+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:16:44.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd240b2880 msgr2=0x7fbd240b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:44.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd240b2880 0x7fbd240b4d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c005950 tx=0x7fbd2c0058e0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010a7c0 msgr2=0x7fbd401a10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:44.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010a7c0 0x7fbd401a10f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c9b0 tx=0x7fbd3000cd70 comp rx=0 tx=0).stop 2024-05-14T09:16:44.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 shutdown_connections 2024-05-14T09:16:44.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd240b2880 0x7fbd240b4d90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd4010f6c0 0x7fbd401a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd4010a7c0 0x7fbd401a10f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 --2- 172.21.15.120:0/2814270938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd4010b110 0x7fbd401a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:44.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.362+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 >> 172.21.15.120:0/2814270938 conn(0x7fbd40076b00 msgr2=0x7fbd40108860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:44.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.363+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 shutdown_connections 2024-05-14T09:16:44.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:44.363+0000 7fbd3f200700 1 -- 172.21.15.120:0/2814270938 wait complete. 2024-05-14T09:16:44.784 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:44 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2814270938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:16:44.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:44 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2814270938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:16:44.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:44 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2814270938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:16:45.243 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T09:11:00.255347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T09:16:45.243 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-14T09:16:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:16:45.855 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:45 smithi120 ceph-mon[31085]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:45 smithi152 ceph-mon[34868]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:45 smithi175 ceph-mon[35353]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:47.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:47 smithi120 ceph-mon[31085]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:47.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.901+0000 7f6f22800700 1 -- 172.21.15.120:0/1193265403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c10c5c0 msgr2=0x7f6f1c10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:47.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.901+0000 7f6f22800700 1 --2- 172.21.15.120:0/1193265403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c10c5c0 0x7f6f1c10c9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009990 tx=0x7f6f0c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:16:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.901+0000 7f6f22800700 1 -- 172.21.15.120:0/1193265403 shutdown_connections 2024-05-14T09:16:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.901+0000 7f6f22800700 1 --2- 172.21.15.120:0/1193265403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f1c106ed0 0x7f6f1c113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.901+0000 7f6f22800700 1 --2- 172.21.15.120:0/1193265403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c10c5c0 0x7f6f1c10c9d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.902+0000 7f6f22800700 1 --2- 172.21.15.120:0/1193265403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1c106580 0x7f6f1c106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.902+0000 7f6f22800700 1 -- 172.21.15.120:0/1193265403 >> 172.21.15.120:0/1193265403 conn(0x7f6f1c102080 msgr2=0x7f6f1c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.902+0000 7f6f22800700 1 -- 172.21.15.120:0/1193265403 shutdown_connections 2024-05-14T09:16:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.902+0000 7f6f22800700 1 -- 172.21.15.120:0/1193265403 wait complete. 2024-05-14T09:16:47.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 Processor -- start 2024-05-14T09:16:47.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 -- start start 2024-05-14T09:16:47.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c106580 0x7f6f1c19cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:47.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f1c106ed0 0x7f6f1c19d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:47.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1c10c5c0 0x7f6f1c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:47.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1165d0 con 0x7f6f1c106580 2024-05-14T09:16:47.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c116450 con 0x7f6f1c106ed0 2024-05-14T09:16:47.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.903+0000 7f6f22800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c116750 con 0x7f6f1c10c5c0 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c106580 0x7f6f1c19cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c106580 0x7f6f1c19cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40482/0 (socket says 172.21.15.120:40482) 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 -- 172.21.15.120:0/1545171732 learned_addr learned my addr 172.21.15.120:0/1545171732 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1aa00700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f1c106ed0 0x7f6f1c19d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1be00700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1c10c5c0 0x7f6f1c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 -- 172.21.15.120:0/1545171732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1c10c5c0 msgr2=0x7f6f1c1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1c10c5c0 0x7f6f1c1a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 -- 172.21.15.120:0/1545171732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f1c106ed0 msgr2=0x7f6f1c19d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f1c106ed0 0x7f6f1c19d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1b400700 1 -- 172.21.15.120:0/1545171732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c1a1e50 con 0x7f6f1c106580 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1be00700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1c10c5c0 0x7f6f1c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.904+0000 7f6f1aa00700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f1c106ed0 0x7f6f1c19d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:16:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.905+0000 7f6f1b400700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c106580 0x7f6f1c19cf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00b5c0 tx=0x7f6f0c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.905+0000 7f6f13e00700 1 -- 172.21.15.120:0/1545171732 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c004830 con 0x7f6f1c106580 2024-05-14T09:16:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.905+0000 7f6f13e00700 1 -- 172.21.15.120:0/1545171732 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f0c005020 con 0x7f6f1c106580 2024-05-14T09:16:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.905+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c1a20e0 con 0x7f6f1c106580 2024-05-14T09:16:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.905+0000 7f6f13e00700 1 -- 172.21.15.120:0/1545171732 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00f950 con 0x7f6f1c106580 2024-05-14T09:16:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.905+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c1a2560 con 0x7f6f1c106580 2024-05-14T09:16:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.907+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1c0512c0 con 0x7f6f1c106580 2024-05-14T09:16:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.909+0000 7f6f13e00700 1 -- 172.21.15.120:0/1545171732 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f6f0c0049d0 con 0x7f6f1c106580 2024-05-14T09:16:47.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.911+0000 7f6f13e00700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f000b2880 0x7f6f000b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.912+0000 7f6f13e00700 1 -- 172.21.15.120:0/1545171732 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f6f0c0e2a00 con 0x7f6f1c106580 2024-05-14T09:16:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.912+0000 7f6f1aa00700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f000b2880 0x7f6f000b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:47.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.912+0000 7f6f1aa00700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f000b2880 0x7f6f000b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005950 tx=0x7f6f080058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:47.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:47.917+0000 7f6f13e00700 1 -- 172.21.15.120:0/1545171732 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6f0c013070 con 0x7f6f1c106580 2024-05-14T09:16:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:47 smithi152 ceph-mon[34868]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:47 smithi175 ceph-mon[35353]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:48.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.147+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f1c02e5f0 con 0x7f6f1c106580 2024-05-14T09:16:48.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.148+0000 7f6f13e00700 1 -- 172.21.15.120:0/1545171732 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f6f0c0aabb0 con 0x7f6f1c106580 2024-05-14T09:16:48.150 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-05-14T09:16:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f000b2880 msgr2=0x7f6f000b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f000b2880 0x7f6f000b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005950 tx=0x7f6f080058e0 comp rx=0 tx=0).stop 2024-05-14T09:16:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c106580 msgr2=0x7f6f1c19cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c106580 0x7f6f1c19cf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00b5c0 tx=0x7f6f0c0047b0 comp rx=0 tx=0).stop 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 shutdown_connections 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6f000b2880 0x7f6f000b4d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1c10c5c0 0x7f6f1c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f1c106580 0x7f6f1c19cf80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 --2- 172.21.15.120:0/1545171732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f1c106ed0 0x7f6f1c19d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.151+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 >> 172.21.15.120:0/1545171732 conn(0x7f6f1c102080 msgr2=0x7f6f1c1048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.152+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 shutdown_connections 2024-05-14T09:16:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:48.152+0000 7f6f22800700 1 -- 172.21.15.120:0/1545171732 wait complete. 2024-05-14T09:16:48.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:48 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1545171732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.a on smithi120 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.d on smithi120 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.g on smithi120 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.j on smithi120 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.b on smithi152 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.e on smithi152 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.h on smithi152 2024-05-14T09:16:48.954 INFO:tasks.cephadm:Adding mds.k on smithi152 2024-05-14T09:16:48.955 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-05-14T09:16:48.955 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-05-14T09:16:48.955 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-05-14T09:16:48.955 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-05-14T09:16:48.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph orch apply mds all '12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-05-14T09:16:48.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:48 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1545171732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:16:48.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:48 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1545171732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:16:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:16:49.884 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:49 smithi175 ceph-mon[35353]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:49.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:49 smithi120 ceph-mon[31085]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:49.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:49 smithi152 ceph-mon[34868]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.760+0000 7f68c5200700 1 -- 172.21.15.175:0/1684177726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 msgr2=0x7f68c0075b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.760+0000 7f68c5200700 1 --2- 172.21.15.175:0/1684177726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c0075b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009990 tx=0x7f68b0009ca0 comp rx=0 tx=0).stop 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.760+0000 7f68c5200700 1 -- 172.21.15.175:0/1684177726 shutdown_connections 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.761+0000 7f68c5200700 1 --2- 172.21.15.175:0/1684177726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c010c030 0x7f68c010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.761+0000 7f68c5200700 1 --2- 172.21.15.175:0/1684177726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c0075b50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.761+0000 7f68c5200700 1 --2- 172.21.15.175:0/1684177726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68c0076090 0x7f68c00764c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.761+0000 7f68c5200700 1 -- 172.21.15.175:0/1684177726 >> 172.21.15.175:0/1684177726 conn(0x7f68c00ff7b0 msgr2=0x7f68c0101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.761+0000 7f68c5200700 1 -- 172.21.15.175:0/1684177726 shutdown_connections 2024-05-14T09:16:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.761+0000 7f68c5200700 1 -- 172.21.15.175:0/1684177726 wait complete. 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.762+0000 7f68c5200700 1 Processor -- start 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.762+0000 7f68c5200700 1 -- start start 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.762+0000 7f68c5200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c0076090 0x7f68c019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.762+0000 7f68c5200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.762+0000 7f68c5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68c010c030 0x7f68c01a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68c5200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0111c70 con 0x7f68c010c030 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68c5200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0111af0 con 0x7f68c0076090 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68c5200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0111df0 con 0x7f68c0077680 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50858/0 (socket says 172.21.15.175:50858) 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 -- 172.21.15.175:0/2144672885 learned_addr learned my addr 172.21.15.175:0/2144672885 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-05-14T09:16:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bf400700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c0076090 0x7f68c019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bfe00700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68c010c030 0x7f68c01a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 -- 172.21.15.175:0/2144672885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c0076090 msgr2=0x7f68c019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c0076090 0x7f68c019c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 -- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68c010c030 msgr2=0x7f68c01a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68c010c030 0x7f68c01a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.763+0000 7f68bea00700 1 -- 172.21.15.175:0/2144672885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c01a43d0 con 0x7f68c0077680 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.764+0000 7f68bea00700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c019cdb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00d950 tx=0x7f68ac00dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.764+0000 7f68b7e00700 1 -- 172.21.15.175:0/2144672885 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac016070 con 0x7f68c0077680 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.764+0000 7f68b7e00700 1 -- 172.21.15.175:0/2144672885 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68ac010460 con 0x7f68c0077680 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.764+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c01a46c0 con 0x7f68c0077680 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.764+0000 7f68b7e00700 1 -- 172.21.15.175:0/2144672885 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00f620 con 0x7f68c0077680 2024-05-14T09:16:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.764+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c01a4c50 con 0x7f68c0077680 2024-05-14T09:16:51.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.765+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c00512c0 con 0x7f68c0077680 2024-05-14T09:16:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.768+0000 7f68b7e00700 1 -- 172.21.15.175:0/2144672885 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f68ac019070 con 0x7f68c0077680 2024-05-14T09:16:51.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:51 smithi175 ceph-mon[35353]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.771+0000 7f68b7e00700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68a40b2900 0x7f68a40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:51.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.771+0000 7f68b7e00700 1 -- 172.21.15.175:0/2144672885 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f68ac0e1d50 con 0x7f68c0077680 2024-05-14T09:16:51.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.772+0000 7f68bf400700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68a40b2900 0x7f68a40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.772+0000 7f68b7e00700 1 -- 172.21.15.175:0/2144672885 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f68ac0a9e70 con 0x7f68c0077680 2024-05-14T09:16:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:51.773+0000 7f68bf400700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68a40b2900 0x7f68a40b4e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68b000b5c0 tx=0x7f68b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:51.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:51 smithi120 ceph-mon[31085]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:51 smithi152 ceph-mon[34868]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:52.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.019+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7f68c0063d00 con 0x7f68a40b2900 2024-05-14T09:16:52.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.039+0000 7f68b7e00700 1 -- 172.21.15.175:0/2144672885 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f68c0063d00 con 0x7f68a40b2900 2024-05-14T09:16:52.039 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-05-14T09:16:52.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68a40b2900 msgr2=0x7f68a40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68a40b2900 0x7f68a40b4e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68b000b5c0 tx=0x7f68b001a040 comp rx=0 tx=0).stop 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 msgr2=0x7f68c019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c019cdb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00d950 tx=0x7f68ac00dd10 comp rx=0 tx=0).stop 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 shutdown_connections 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68a40b2900 0x7f68a40b4e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c0076090 0x7f68c019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68c010c030 0x7f68c01a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 --2- 172.21.15.175:0/2144672885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68c0077680 0x7f68c019cdb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.042+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 >> 172.21.15.175:0/2144672885 conn(0x7f68c00ff7b0 msgr2=0x7f68c0108010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.043+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 shutdown_connections 2024-05-14T09:16:52.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-05-14T09:16:52.043+0000 7f68c5200700 1 -- 172.21.15.175:0/2144672885 wait complete. 2024-05-14T09:16:52.916 DEBUG:teuthology.orchestra.run.smithi120:mds.a> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.a.service 2024-05-14T09:16:52.924 DEBUG:teuthology.orchestra.run.smithi120:mds.d> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.d.service 2024-05-14T09:16:52.971 DEBUG:teuthology.orchestra.run.smithi120:mds.g> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.g.service 2024-05-14T09:16:53.017 DEBUG:teuthology.orchestra.run.smithi120:mds.j> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.j.service 2024-05-14T09:16:53.064 DEBUG:teuthology.orchestra.run.smithi152:mds.b> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.b.service 2024-05-14T09:16:53.072 DEBUG:teuthology.orchestra.run.smithi152:mds.e> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.e.service 2024-05-14T09:16:53.119 DEBUG:teuthology.orchestra.run.smithi152:mds.h> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.h.service 2024-05-14T09:16:53.165 DEBUG:teuthology.orchestra.run.smithi152:mds.k> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.k.service 2024-05-14T09:16:53.177 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:16:53.177 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: Saving service mds.all spec with placement smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: Deploying daemon mds.l on smithi175 2024-05-14T09:16:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:53 smithi175 ceph-mon[35353]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:53.211 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.c.service 2024-05-14T09:16:53.217 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.f.service 2024-05-14T09:16:53.266 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.i.service 2024-05-14T09:16:53.313 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.l.service 2024-05-14T09:16:53.360 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-14T09:16:53.360 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:16:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:16:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: Saving service mds.all spec with placement smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-05-14T09:16:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:16:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:16:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: Deploying daemon mds.l on smithi175 2024-05-14T09:16:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:53 smithi120 ceph-mon[31085]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:16:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: Saving service mds.all spec with placement smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: Deploying daemon mds.l on smithi175 2024-05-14T09:16:53.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:53 smithi152 ceph-mon[34868]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:53.799 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:16:55.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:55 smithi175 ceph-mon[35353]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:55.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:55 smithi120 ceph-mon[31085]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:55.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:55 smithi152 ceph-mon[34868]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:55.946 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:55 smithi175 podman[65884]: 2024-05-14 09:16:55.624098496 +0000 UTC m=+0.160517450 container create 530e1f3503501dc4f81b0b81e0f855acb618da8892ccaa84100382c39b1bfa13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-05-14T09:16:55.946 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:55 smithi175 podman[65884]: 2024-05-14 09:16:55.94504815 +0000 UTC m=+0.481467087 container init 530e1f3503501dc4f81b0b81e0f855acb618da8892ccaa84100382c39b1bfa13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 -- 172.21.15.120:0/2193954747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8109680 msgr2=0x7f31e8110fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 --2- 172.21.15.120:0/2193954747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8109680 0x7f31e8110fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31e000b0d0 tx=0x7f31e000b3e0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 -- 172.21.15.120:0/2193954747 shutdown_connections 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 --2- 172.21.15.120:0/2193954747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e8104400 0x7f31e8104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 --2- 172.21.15.120:0/2193954747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8109680 0x7f31e8110fe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 --2- 172.21.15.120:0/2193954747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 0x7f31e8109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 -- 172.21.15.120:0/2193954747 >> 172.21.15.120:0/2193954747 conn(0x7f31e8079d10 msgr2=0x7f31e807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 -- 172.21.15.120:0/2193954747 shutdown_connections 2024-05-14T09:16:56.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.082+0000 7f31eea00700 1 -- 172.21.15.120:0/2193954747 wait complete. 2024-05-14T09:16:56.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.083+0000 7f31eea00700 1 Processor -- start 2024-05-14T09:16:56.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.083+0000 7f31eea00700 1 -- start start 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31eea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8104400 0x7f31e81a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31eea00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 0x7f31e81a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31eea00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e8109680 0x7f31e819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31eea00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f31e8114160 con 0x7f31e8104400 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31eea00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f31e8113fe0 con 0x7f31e8109680 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31eea00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81142e0 con 0x7f31e8108d30 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31ed600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8104400 0x7f31e81a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31ecc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 0x7f31e81a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:56.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31ed600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8104400 0x7f31e81a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51286/0 (socket says 172.21.15.120:51286) 2024-05-14T09:16:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31ecc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 0x7f31e81a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:46086/0 (socket says 172.21.15.120:46086) 2024-05-14T09:16:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.084+0000 7f31ed600700 1 -- 172.21.15.120:0/2001893691 learned_addr learned my addr 172.21.15.120:0/2001893691 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:16:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ee000700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e8109680 0x7f31e819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ed600700 1 -- 172.21.15.120:0/2001893691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 msgr2=0x7f31e81a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ed600700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 0x7f31e81a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ed600700 1 -- 172.21.15.120:0/2001893691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e8109680 msgr2=0x7f31e819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ed600700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e8109680 0x7f31e819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ed600700 1 -- 172.21.15.120:0/2001893691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e819afb0 con 0x7f31e8104400 2024-05-14T09:16:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ecc00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 0x7f31e81a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:16:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.085+0000 7f31ed600700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8104400 0x7f31e81a06e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00d950 tx=0x7f31dc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.089+0000 7f31e6000700 1 -- 172.21.15.120:0/2001893691 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc016070 con 0x7f31e8104400 2024-05-14T09:16:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.089+0000 7f31e6000700 1 -- 172.21.15.120:0/2001893691 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31dc009dd0 con 0x7f31e8104400 2024-05-14T09:16:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.089+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e819b2a0 con 0x7f31e8104400 2024-05-14T09:16:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.089+0000 7f31e6000700 1 -- 172.21.15.120:0/2001893691 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00f3c0 con 0x7f31e8104400 2024-05-14T09:16:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.089+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e81a7570 con 0x7f31e8104400 2024-05-14T09:16:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.090+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e80512c0 con 0x7f31e8104400 2024-05-14T09:16:56.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.093+0000 7f31e6000700 1 -- 172.21.15.120:0/2001893691 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f31dc019070 con 0x7f31e8104400 2024-05-14T09:16:56.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.099+0000 7f31e6000700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f31d00b2900 0x7f31d00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:16:56.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.100+0000 7f31ecc00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f31d00b2900 0x7f31d00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:16:56.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.100+0000 7f31e6000700 1 -- 172.21.15.120:0/2001893691 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f31dc0e1940 con 0x7f31e8104400 2024-05-14T09:16:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.101+0000 7f31ecc00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f31d00b2900 0x7f31d00b4e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31e806b690 tx=0x7f31d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:16:56.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.106+0000 7f31e6000700 1 -- 172.21.15.120:0/2001893691 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f31dc0a9a60 con 0x7f31e8104400 2024-05-14T09:16:56.228 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:55 smithi175 podman[65884]: 2024-05-14 09:16:55.95495146 +0000 UTC m=+0.491370407 container start 530e1f3503501dc4f81b0b81e0f855acb618da8892ccaa84100382c39b1bfa13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-14T09:16:56.228 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:56 smithi175 ceph-mds[65903]: -- 172.21.15.175:0/3068103338 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e3607084e0 con 0x55e360753600 2024-05-14T09:16:56.228 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:56 smithi175 ceph-mds[65903]: -- 172.21.15.175:0/3068103338 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e36070ba40 con 0x55e360753600 2024-05-14T09:16:56.228 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l[65899]: starting mds.l at 2024-05-14T09:16:56.228 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:56 smithi175 bash[65884]: 530e1f3503501dc4f81b0b81e0f855acb618da8892ccaa84100382c39b1bfa13 2024-05-14T09:16:56.228 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:16:56 smithi175 systemd[1]: Started Ceph mds.l for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:16:56.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.392+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31e819be30 con 0x7f31e8104400 2024-05-14T09:16:56.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.393+0000 7f31e6000700 1 -- 172.21.15.120:0/2001893691 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f31dc0a9360 con 0x7f31e8104400 2024-05-14T09:16:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:16:56.394 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T09:16:56.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f31d00b2900 msgr2=0x7f31d00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:56.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f31d00b2900 0x7f31d00b4e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31e806b690 tx=0x7f31d4009260 comp rx=0 tx=0).stop 2024-05-14T09:16:56.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8104400 msgr2=0x7f31e81a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:16:56.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8104400 0x7f31e81a06e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00d950 tx=0x7f31dc00dc60 comp rx=0 tx=0).stop 2024-05-14T09:16:56.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 shutdown_connections 2024-05-14T09:16:56.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f31d00b2900 0x7f31d00b4e10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e8109680 0x7f31e819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e8104400 0x7f31e81a06e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 --2- 172.21.15.120:0/2001893691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8108d30 0x7f31e81a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:16:56.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.396+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 >> 172.21.15.120:0/2001893691 conn(0x7f31e8079d10 msgr2=0x7f31e8101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:16:56.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.397+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 shutdown_connections 2024-05-14T09:16:56.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:16:56.397+0000 7f31eea00700 1 -- 172.21.15.120:0/2001893691 wait complete. 2024-05-14T09:16:56.399 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 2 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.175:6832/3706419963,v1:172.21.15.175:6833/3706419963] up:boot 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: fsmap 1 up:standby 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:16:57.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:16:57.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:57.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: Deploying daemon mds.k on smithi152 2024-05-14T09:16:57.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:57.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:57 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2001893691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:16:57.417 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.175:6832/3706419963,v1:172.21.15.175:6833/3706419963] up:boot 2024-05-14T09:16:57.417 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: fsmap 1 up:standby 2024-05-14T09:16:57.417 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T09:16:57.417 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: Deploying daemon mds.k on smithi152 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:57.418 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:57 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2001893691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:16:57.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.175:6832/3706419963,v1:172.21.15.175:6833/3706419963] up:boot 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: fsmap 1 up:standby 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: Deploying daemon mds.k on smithi152 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:57.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:57 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2001893691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:16:59.241 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:16:59.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:16:59 smithi152 ceph-mon[34868]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:16:59 smithi120 ceph-mon[31085]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:16:59.700 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:16:59.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:16:59 smithi175 ceph-mon[35353]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:00.114 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:16:59 smithi152 podman[63938]: 2024-05-14 09:16:59.941552006 +0000 UTC m=+0.190590441 container create 3ec99715c27d16d58e527a72527102c3b8032148b8c2469af6a44c81fac184ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:17:00.708 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:17:00 smithi152 podman[63938]: 2024-05-14 09:17:00.247519572 +0000 UTC m=+0.496558062 container init 3ec99715c27d16d58e527a72527102c3b8032148b8c2469af6a44c81fac184ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-14T09:17:00.708 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:17:00 smithi152 podman[63938]: 2024-05-14 09:17:00.258057726 +0000 UTC m=+0.507096196 container start 3ec99715c27d16d58e527a72527102c3b8032148b8c2469af6a44c81fac184ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-05-14T09:17:00.708 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:17:00 smithi152 bash[63938]: 3ec99715c27d16d58e527a72527102c3b8032148b8c2469af6a44c81fac184ff 2024-05-14T09:17:00.709 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:17:00 smithi152 systemd[1]: Started Ceph mds.k for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:00.709 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:17:00 smithi152 ceph-mds[63964]: -- 172.21.15.152:0/2466083839 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56300604fa40 con 0x563006097600 2024-05-14T09:17:00.709 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:17:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k[63958]: starting mds.k at 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: Deploying daemon mds.j on smithi120 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] up:boot 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: fsmap 2 up:standby 2024-05-14T09:17:01.702 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: Deploying daemon mds.j on smithi120 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] up:boot 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: fsmap 2 up:standby 2024-05-14T09:17:01.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: Deploying daemon mds.j on smithi120 2024-05-14T09:17:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] up:boot 2024-05-14T09:17:01.960 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: fsmap 2 up:standby 2024-05-14T09:17:01.960 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T09:17:02.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 -- 172.21.15.120:0/2130475436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 msgr2=0x7f162410ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:02.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 --2- 172.21.15.120:0/2130475436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f162410ada0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f160c009990 tx=0x7f160c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 -- 172.21.15.120:0/2130475436 shutdown_connections 2024-05-14T09:17:02.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 --2- 172.21.15.120:0/2130475436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f162410b2e0 0x7f1624117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 --2- 172.21.15.120:0/2130475436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1624110970 0x7f1624110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 --2- 172.21.15.120:0/2130475436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f162410ada0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 -- 172.21.15.120:0/2130475436 >> 172.21.15.120:0/2130475436 conn(0x7f1624077c80 msgr2=0x7f16240780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 -- 172.21.15.120:0/2130475436 shutdown_connections 2024-05-14T09:17:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.114+0000 7f162b200700 1 -- 172.21.15.120:0/2130475436 wait complete. 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.115+0000 7f162b200700 1 Processor -- start 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.115+0000 7f162b200700 1 -- start start 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f162b200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f16241a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f162b200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162410b2e0 0x7f16241a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f162b200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624110970 0x7f16241a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f162b200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f162411a9a0 con 0x7f162410a990 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f162b200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f162411a820 con 0x7f1624110970 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f162b200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f162411ab20 con 0x7f162410b2e0 2024-05-14T09:17:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f1623e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f16241a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f1623e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f16241a1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58772/0 (socket says 172.21.15.120:58772) 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f1623e00700 1 -- 172.21.15.120:0/3632104962 learned_addr learned my addr 172.21.15.120:0/3632104962 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f161be00700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162410b2e0 0x7f16241a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.116+0000 7f1629200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624110970 0x7f16241a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1623e00700 1 -- 172.21.15.120:0/3632104962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162410b2e0 msgr2=0x7f16241a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1623e00700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162410b2e0 0x7f16241a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1623e00700 1 -- 172.21.15.120:0/3632104962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624110970 msgr2=0x7f16241a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1623e00700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624110970 0x7f16241a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1623e00700 1 -- 172.21.15.120:0/3632104962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16241a6340 con 0x7f162410a990 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1629200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624110970 0x7f16241a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1623e00700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f16241a1470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f161400b500 tx=0x7f161400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1621600700 1 -- 172.21.15.120:0/3632104962 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614015020 con 0x7f162410a990 2024-05-14T09:17:02.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1621600700 1 -- 172.21.15.120:0/3632104962 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1614011cc0 con 0x7f162410a990 2024-05-14T09:17:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f1621600700 1 -- 172.21.15.120:0/3632104962 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614010c80 con 0x7f162410a990 2024-05-14T09:17:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.117+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16241a6630 con 0x7f162410a990 2024-05-14T09:17:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.118+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16241adf50 con 0x7f162410a990 2024-05-14T09:17:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.119+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f162410c080 con 0x7f162410a990 2024-05-14T09:17:02.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.121+0000 7f1621600700 1 -- 172.21.15.120:0/3632104962 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f1614018020 con 0x7f162410a990 2024-05-14T09:17:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.124+0000 7f1621600700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16080b2900 0x7f16080b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.124+0000 7f1621600700 1 -- 172.21.15.120:0/3632104962 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f16140e1b80 con 0x7f162410a990 2024-05-14T09:17:02.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.124+0000 7f161be00700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16080b2900 0x7f16080b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:02.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.125+0000 7f161be00700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16080b2900 0x7f16080b4e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f160c006010 tx=0x7f160c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:02.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.127+0000 7f1621600700 1 -- 172.21.15.120:0/3632104962 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f161401f020 con 0x7f162410a990 2024-05-14T09:17:02.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.412+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16241a27d0 con 0x7f162410a990 2024-05-14T09:17:02.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.413+0000 7f1621600700 1 -- 172.21.15.120:0/3632104962 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7f16140a9ca0 con 0x7f162410a990 2024-05-14T09:17:02.414 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:02.414 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T09:17:02.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.416+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16080b2900 msgr2=0x7f16080b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:02.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.416+0000 7f162b200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16080b2900 0x7f16080b4e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f160c006010 tx=0x7f160c00b540 comp rx=0 tx=0).stop 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.416+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 msgr2=0x7f16241a1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.416+0000 7f162b200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f16241a1470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f161400b500 tx=0x7f161400b8c0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 shutdown_connections 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16080b2900 0x7f16080b4e10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624110970 0x7f16241a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f162410a990 0x7f16241a1470 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 --2- 172.21.15.120:0/3632104962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162410b2e0 0x7f16241a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 >> 172.21.15.120:0/3632104962 conn(0x7f1624077c80 msgr2=0x7f162407b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 shutdown_connections 2024-05-14T09:17:02.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:02.417+0000 7f162b200700 1 -- 172.21.15.120:0/3632104962 wait complete. 2024-05-14T09:17:02.419 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 3 2024-05-14T09:17:02.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:02 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3632104962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:02 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3632104962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:02.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:02 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3632104962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:03.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:03 smithi120 ceph-mon[31085]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:03 smithi175 ceph-mon[35353]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:03.860 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:03 smithi152 ceph-mon[34868]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:04.582 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:04 smithi120 systemd[1]: Starting Ceph mds.j for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:04.885 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:04 smithi120 podman[70833]: 2024-05-14 09:17:04.485593087 +0000 UTC m=+0.032718046 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:04.885 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:04 smithi120 podman[70833]: 2024-05-14 09:17:04.599554395 +0000 UTC m=+0.146679392 container create 89f1d5c8991d4e000b802491a7f253a6b75a334a01f7bf11939fbc030d331577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-14T09:17:05.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:04 smithi120 podman[70833]: 2024-05-14 09:17:04.914118593 +0000 UTC m=+0.461243616 container init 89f1d5c8991d4e000b802491a7f253a6b75a334a01f7bf11939fbc030d331577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-14T09:17:05.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:04 smithi120 podman[70833]: 2024-05-14 09:17:04.925129648 +0000 UTC m=+0.472254652 container start 89f1d5c8991d4e000b802491a7f253a6b75a334a01f7bf11939fbc030d331577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:17:05.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:05 smithi120 bash[70833]: 89f1d5c8991d4e000b802491a7f253a6b75a334a01f7bf11939fbc030d331577 2024-05-14T09:17:05.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:05 smithi120 systemd[1]: Started Ceph mds.j for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:05.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mds[70852]: -- 172.21.15.120:0/2447593451 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d526e07a40 con 0x55d526e4f600 2024-05-14T09:17:05.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:17:05 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j[70848]: starting mds.j at 2024-05-14T09:17:05.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:17:05.882 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mon[31085]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:05.882 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.882 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.882 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.882 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:05.882 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:05.882 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:05.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:05 smithi152 ceph-mon[34868]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:05.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:05 smithi175 ceph-mon[35353]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:05.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:06.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:06 smithi120 ceph-mon[31085]: Deploying daemon mds.d on smithi120 2024-05-14T09:17:06.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:06 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.120:6834/1838398514,v1:172.21.15.120:6835/1838398514] up:boot 2024-05-14T09:17:06.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:06 smithi120 ceph-mon[31085]: fsmap 3 up:standby 2024-05-14T09:17:06.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T09:17:06.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:06 smithi152 ceph-mon[34868]: Deploying daemon mds.d on smithi120 2024-05-14T09:17:06.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:06 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.120:6834/1838398514,v1:172.21.15.120:6835/1838398514] up:boot 2024-05-14T09:17:06.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:06 smithi152 ceph-mon[34868]: fsmap 3 up:standby 2024-05-14T09:17:06.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T09:17:06.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:06 smithi175 ceph-mon[35353]: Deploying daemon mds.d on smithi120 2024-05-14T09:17:06.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:06 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.120:6834/1838398514,v1:172.21.15.120:6835/1838398514] up:boot 2024-05-14T09:17:06.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:06 smithi175 ceph-mon[35353]: fsmap 3 up:standby 2024-05-14T09:17:06.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T09:17:07.413 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:07.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:07 smithi120 ceph-mon[31085]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:07 smithi152 ceph-mon[34868]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:07 smithi175 ceph-mon[35353]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:08.385 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:08 smithi120 systemd[1]: Starting Ceph mds.d for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:09.129 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 podman[71234]: 2024-05-14 09:17:08.989665372 +0000 UTC m=+0.051789416 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:09.384 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 podman[71234]: 2024-05-14 09:17:09.129116273 +0000 UTC m=+0.191240349 container create a63a79f73d8b650ce37d283cfc8e6ed8584c897516cb08817193c94ee300e225 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T09:17:09.744 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:09 smithi120 ceph-mon[31085]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:09.815 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:09 smithi175 ceph-mon[35353]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:09 smithi152 ceph-mon[34868]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:10.087 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 podman[71234]: 2024-05-14 09:17:09.744295421 +0000 UTC m=+0.806419527 container init a63a79f73d8b650ce37d283cfc8e6ed8584c897516cb08817193c94ee300e225 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-14T09:17:10.087 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 podman[71234]: 2024-05-14 09:17:09.754067922 +0000 UTC m=+0.816191973 container start a63a79f73d8b650ce37d283cfc8e6ed8584c897516cb08817193c94ee300e225 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-05-14T09:17:10.087 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 bash[71234]: a63a79f73d8b650ce37d283cfc8e6ed8584c897516cb08817193c94ee300e225 2024-05-14T09:17:10.087 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 systemd[1]: Started Ceph mds.d for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:10.087 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 ceph-mds[71277]: -- 172.21.15.120:0/653680859 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fc917ba40 con 0x563fc91c3180 2024-05-14T09:17:10.087 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:17:09 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d[71266]: starting mds.d at 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 -- 172.21.15.120:0/4087515596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd94115180 msgr2=0x7fdd941175a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 --2- 172.21.15.120:0/4087515596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd94115180 0x7fdd941175a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000b0a0 tx=0x7fdd9000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 -- 172.21.15.120:0/4087515596 shutdown_connections 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 --2- 172.21.15.120:0/4087515596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd94115180 0x7fdd941175a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 --2- 172.21.15.120:0/4087515596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd94075b60 0x7fdd94075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 --2- 172.21.15.120:0/4087515596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd940764b0 0x7fdd94114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 -- 172.21.15.120:0/4087515596 >> 172.21.15.120:0/4087515596 conn(0x7fdd94079d10 msgr2=0x7fdd9407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:10.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 -- 172.21.15.120:0/4087515596 shutdown_connections 2024-05-14T09:17:10.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.202+0000 7fdd9b200700 1 -- 172.21.15.120:0/4087515596 wait complete. 2024-05-14T09:17:10.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.203+0000 7fdd9b200700 1 Processor -- start 2024-05-14T09:17:10.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.203+0000 7fdd9b200700 1 -- start start 2024-05-14T09:17:10.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd9b200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd94075b60 0x7fdd941a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:10.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd9b200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940764b0 0x7fdd941a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:10.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd9b200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd94115180 0x7fdd941a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:10.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd9b200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9411a790 con 0x7fdd940764b0 2024-05-14T09:17:10.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd9b200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9411a610 con 0x7fdd94075b60 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd9b200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9411a910 con 0x7fdd94115180 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940764b0 0x7fdd941a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940764b0 0x7fdd941a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44606/0 (socket says 172.21.15.120:44606) 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 -- 172.21.15.120:0/1724683020 learned_addr learned my addr 172.21.15.120:0/1724683020 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99e00700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd94075b60 0x7fdd941a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd9a800700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd94115180 0x7fdd941a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 -- 172.21.15.120:0/1724683020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd94115180 msgr2=0x7fdd941a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd94115180 0x7fdd941a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 -- 172.21.15.120:0/1724683020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd94075b60 msgr2=0x7fdd941a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd94075b60 0x7fdd941a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.204+0000 7fdd99400700 1 -- 172.21.15.120:0/1724683020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd941a6030 con 0x7fdd940764b0 2024-05-14T09:17:10.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.205+0000 7fdd99400700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940764b0 0x7fdd941a1700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400d950 tx=0x7fdd8400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:10.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.205+0000 7fdd8ea00700 1 -- 172.21.15.120:0/1724683020 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84016070 con 0x7fdd940764b0 2024-05-14T09:17:10.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.205+0000 7fdd8ea00700 1 -- 172.21.15.120:0/1724683020 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd84009dd0 con 0x7fdd940764b0 2024-05-14T09:17:10.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.205+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd941a6320 con 0x7fdd940764b0 2024-05-14T09:17:10.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.205+0000 7fdd8ea00700 1 -- 172.21.15.120:0/1724683020 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400f3c0 con 0x7fdd940764b0 2024-05-14T09:17:10.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.205+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd941adc40 con 0x7fdd940764b0 2024-05-14T09:17:10.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.207+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd940772a0 con 0x7fdd940764b0 2024-05-14T09:17:10.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.209+0000 7fdd8ea00700 1 -- 172.21.15.120:0/1724683020 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fdd84019070 con 0x7fdd940764b0 2024-05-14T09:17:10.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.211+0000 7fdd8ea00700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdd7c0b2880 0x7fdd7c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:10.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.211+0000 7fdd8ea00700 1 -- 172.21.15.120:0/1724683020 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fdd840e1a00 con 0x7fdd940764b0 2024-05-14T09:17:10.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.211+0000 7fdd99e00700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdd7c0b2880 0x7fdd7c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:10.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.212+0000 7fdd99e00700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdd7c0b2880 0x7fdd7c0b4d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdd88005950 tx=0x7fdd8800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:10.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.216+0000 7fdd8ea00700 1 -- 172.21.15.120:0/1724683020 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdd840a9b20 con 0x7fdd940764b0 2024-05-14T09:17:10.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.502+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd941a24c0 con 0x7fdd940764b0 2024-05-14T09:17:10.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.503+0000 7fdd8ea00700 1 -- 172.21.15.120:0/1724683020 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3052 (secure 0 0 0) 0x7fdd840a9420 con 0x7fdd940764b0 2024-05-14T09:17:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:10.504 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T09:17:10.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.506+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdd7c0b2880 msgr2=0x7fdd7c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:10.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.506+0000 7fdd9b200700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdd7c0b2880 0x7fdd7c0b4d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdd88005950 tx=0x7fdd8800a300 comp rx=0 tx=0).stop 2024-05-14T09:17:10.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.506+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940764b0 msgr2=0x7fdd941a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:10.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.506+0000 7fdd9b200700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940764b0 0x7fdd941a1700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400d950 tx=0x7fdd8400dc60 comp rx=0 tx=0).stop 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.506+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 shutdown_connections 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.507+0000 7fdd9b200700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdd7c0b2880 0x7fdd7c0b4d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.507+0000 7fdd9b200700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd94075b60 0x7fdd941a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.507+0000 7fdd9b200700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd94115180 0x7fdd941a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.507+0000 7fdd9b200700 1 --2- 172.21.15.120:0/1724683020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940764b0 0x7fdd941a1700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.507+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 >> 172.21.15.120:0/1724683020 conn(0x7fdd94079d10 msgr2=0x7fdd94100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.507+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 shutdown_connections 2024-05-14T09:17:10.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:10.507+0000 7fdd9b200700 1 -- 172.21.15.120:0/1724683020 wait complete. 2024-05-14T09:17:10.509 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 4 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1724683020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:11.205 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.120:6836/1071479620,v1:172.21.15.120:6837/1071479620] up:boot 2024-05-14T09:17:11.206 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: fsmap 4 up:standby 2024-05-14T09:17:11.206 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T09:17:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:11.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:11.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:11.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1724683020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:11.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.120:6836/1071479620,v1:172.21.15.120:6837/1071479620] up:boot 2024-05-14T09:17:11.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: fsmap 4 up:standby 2024-05-14T09:17:11.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1724683020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.120:6836/1071479620,v1:172.21.15.120:6837/1071479620] up:boot 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: fsmap 4 up:standby 2024-05-14T09:17:11.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T09:17:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:11 smithi152 ceph-mon[34868]: Deploying daemon mds.e on smithi152 2024-05-14T09:17:12.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:11 smithi152 ceph-mon[34868]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:11 smithi175 ceph-mon[35353]: Deploying daemon mds.e on smithi152 2024-05-14T09:17:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:11 smithi175 ceph-mon[35353]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:11 smithi120 ceph-mon[31085]: Deploying daemon mds.e on smithi152 2024-05-14T09:17:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:11 smithi120 ceph-mon[31085]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:13.315 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:13 smithi152 ceph-mon[34868]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:13.376 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:17:13.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:13 smithi120 ceph-mon[31085]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:13.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:13 smithi175 ceph-mon[35353]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:13.681 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:13 smithi152 systemd[1]: Starting Ceph mds.e for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:13.814 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:13.959 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:13 smithi152 podman[64250]: 2024-05-14 09:17:13.584990047 +0000 UTC m=+0.032239195 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:13.959 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:13 smithi152 podman[64250]: 2024-05-14 09:17:13.732086833 +0000 UTC m=+0.179336021 container create a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-14T09:17:14.459 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:14 smithi152 podman[64250]: 2024-05-14 09:17:14.027723077 +0000 UTC m=+0.474972285 container init a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:17:14.459 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:14 smithi152 podman[64250]: 2024-05-14 09:17:14.037291933 +0000 UTC m=+0.484541090 container start a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:17:14.459 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:14 smithi152 bash[64250]: a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 2024-05-14T09:17:14.459 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:14 smithi152 ceph-mds[64269]: -- 172.21.15.152:0/4260100260 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56396285fa40 con 0x5639628a7600 2024-05-14T09:17:14.459 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:14 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e[64265]: starting mds.e at 2024-05-14T09:17:14.460 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:17:14 smithi152 systemd[1]: Started Ceph mds.e for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:15.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] up:boot 2024-05-14T09:17:15.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: fsmap 5 up:standby 2024-05-14T09:17:15.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T09:17:15.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:15.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:15.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:15.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:15.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:15 smithi120 ceph-mon[31085]: Deploying daemon mds.f on smithi175 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] up:boot 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: fsmap 5 up:standby 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:15.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:15 smithi175 ceph-mon[35353]: Deploying daemon mds.f on smithi175 2024-05-14T09:17:15.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] up:boot 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: fsmap 5 up:standby 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:15.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:15 smithi152 ceph-mon[34868]: Deploying daemon mds.f on smithi175 2024-05-14T09:17:16.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 -- 172.21.15.120:0/1432623575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010b110 msgr2=0x7f6b00117620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:16.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 --2- 172.21.15.120:0/1432623575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010b110 0x7f6b00117620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6af800b0a0 tx=0x7f6af800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 -- 172.21.15.120:0/1432623575 shutdown_connections 2024-05-14T09:17:16.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 --2- 172.21.15.120:0/1432623575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b0010f6c0 0x7f6b0010fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 --2- 172.21.15.120:0/1432623575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010b110 0x7f6b00117620 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 --2- 172.21.15.120:0/1432623575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0010a7c0 0x7f6b0010abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 -- 172.21.15.120:0/1432623575 >> 172.21.15.120:0/1432623575 conn(0x7f6b00076b00 msgr2=0x7f6b00076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:16.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 -- 172.21.15.120:0/1432623575 shutdown_connections 2024-05-14T09:17:16.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.085+0000 7f6aff200700 1 -- 172.21.15.120:0/1432623575 wait complete. 2024-05-14T09:17:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.086+0000 7f6aff200700 1 Processor -- start 2024-05-14T09:17:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6aff200700 1 -- start start 2024-05-14T09:17:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6aff200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b0010a7c0 0x7f6b001a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6aff200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0010b110 0x7f6b001a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6aff200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010f6c0 0x7f6b001a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6aff200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0011a770 con 0x7f6b0010f6c0 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6aff200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0011a5f0 con 0x7f6b0010a7c0 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6aff200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0011a8f0 con 0x7f6b0010b110 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.087+0000 7f6afe800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010f6c0 0x7f6b001a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010f6c0 0x7f6b001a58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44620/0 (socket says 172.21.15.120:44620) 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 -- 172.21.15.120:0/3662016650 learned_addr learned my addr 172.21.15.120:0/3662016650 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afd400700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0010b110 0x7f6b001a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afde00700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b0010a7c0 0x7f6b001a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 -- 172.21.15.120:0/3662016650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0010b110 msgr2=0x7f6b001a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0010b110 0x7f6b001a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 -- 172.21.15.120:0/3662016650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b0010a7c0 msgr2=0x7f6b001a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b0010a7c0 0x7f6b001a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 -- 172.21.15.120:0/3662016650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b001a5f70 con 0x7f6b0010f6c0 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afde00700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b0010a7c0 0x7f6b001a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afd400700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0010b110 0x7f6b001a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.088+0000 7f6afe800700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010f6c0 0x7f6b001a58d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6af800b830 tx=0x7f6af8004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.089+0000 7f6af6a00700 1 -- 172.21.15.120:0/3662016650 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8021070 con 0x7f6b0010f6c0 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.089+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b001a6200 con 0x7f6b0010f6c0 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.089+0000 7f6af6a00700 1 -- 172.21.15.120:0/3662016650 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6af8007c80 con 0x7f6b0010f6c0 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.089+0000 7f6af6a00700 1 -- 172.21.15.120:0/3662016650 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8005260 con 0x7f6b0010f6c0 2024-05-14T09:17:16.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.089+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b001adb80 con 0x7f6b0010f6c0 2024-05-14T09:17:16.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.090+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b000512c0 con 0x7f6b0010f6c0 2024-05-14T09:17:16.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.093+0000 7f6af6a00700 1 -- 172.21.15.120:0/3662016650 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f6af8024070 con 0x7f6b0010f6c0 2024-05-14T09:17:16.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.094+0000 7f6af6a00700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ae40b2880 0x7f6ae40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:16.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.095+0000 7f6af6a00700 1 -- 172.21.15.120:0/3662016650 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f6af800f020 con 0x7f6b0010f6c0 2024-05-14T09:17:16.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.095+0000 7f6afde00700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ae40b2880 0x7f6ae40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:16.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.095+0000 7f6afde00700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ae40b2880 0x7f6ae40b4d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6af0005e10 tx=0x7f6af0005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:16.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.097+0000 7f6af6a00700 1 -- 172.21.15.120:0/3662016650 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6af802b020 con 0x7f6b0010f6c0 2024-05-14T09:17:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.381+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b001a2400 con 0x7f6b0010f6c0 2024-05-14T09:17:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:16.384 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-14T09:17:16.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.383+0000 7f6af6a00700 1 -- 172.21.15.120:0/3662016650 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4708 (secure 0 0 0) 0x7f6af80aba90 con 0x7f6b0010f6c0 2024-05-14T09:17:16.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.385+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ae40b2880 msgr2=0x7f6ae40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ae40b2880 0x7f6ae40b4d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6af0005e10 tx=0x7f6af0005d60 comp rx=0 tx=0).stop 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010f6c0 msgr2=0x7f6b001a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010f6c0 0x7f6b001a58d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6af800b830 tx=0x7f6af8004db0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 shutdown_connections 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ae40b2880 0x7f6ae40b4d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b0010a7c0 0x7f6b001a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0010f6c0 0x7f6b001a58d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 --2- 172.21.15.120:0/3662016650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0010b110 0x7f6b001a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 >> 172.21.15.120:0/3662016650 conn(0x7f6b00076b00 msgr2=0x7f6b00108880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:16.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 shutdown_connections 2024-05-14T09:17:16.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:16.386+0000 7f6aff200700 1 -- 172.21.15.120:0/3662016650 wait complete. 2024-05-14T09:17:16.388 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 6 2024-05-14T09:17:17.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:17 smithi120 ceph-mon[31085]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:17.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:17 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3662016650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:17.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:17 smithi175 ceph-mon[35353]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:17.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:17 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3662016650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:17.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:17 smithi152 ceph-mon[34868]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:17.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:17 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3662016650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:17.977 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:17 smithi175 systemd[1]: Starting Ceph mds.f for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:18.375 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 podman[66196]: 2024-05-14 09:17:17.917111923 +0000 UTC m=+0.035511326 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:18.375 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 podman[66196]: 2024-05-14 09:17:18.086907315 +0000 UTC m=+0.205306740 container create 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-14T09:17:18.375 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 podman[66196]: 2024-05-14 09:17:18.374486179 +0000 UTC m=+0.492885611 container init 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-14T09:17:18.727 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 podman[66196]: 2024-05-14 09:17:18.385190852 +0000 UTC m=+0.503590264 container start 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-14T09:17:18.727 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 bash[66196]: 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 2024-05-14T09:17:18.727 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 systemd[1]: Started Ceph mds.f for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:18.727 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 ceph-mds[66215]: -- 172.21.15.175:0/1670128154 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588ce033a40 con 0x5588ce07b600 2024-05-14T09:17:18.727 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:17:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f[66211]: starting mds.f at 2024-05-14T09:17:19.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:17:19.790 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:19.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:19.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: Deploying daemon mds.c on smithi175 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.175:6834/1285285129,v1:172.21.15.175:6835/1285285129] up:boot 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: fsmap 6 up:standby 2024-05-14T09:17:19.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T09:17:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: Deploying daemon mds.c on smithi175 2024-05-14T09:17:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.175:6834/1285285129,v1:172.21.15.175:6835/1285285129] up:boot 2024-05-14T09:17:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: fsmap 6 up:standby 2024-05-14T09:17:19.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T09:17:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: Deploying daemon mds.c on smithi175 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.175:6834/1285285129,v1:172.21.15.175:6835/1285285129] up:boot 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: fsmap 6 up:standby 2024-05-14T09:17:19.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T09:17:21.769 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:21 smithi120 ceph-mon[31085]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:21.900 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:21 smithi175 ceph-mon[35353]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:21 smithi152 ceph-mon[34868]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:22.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 -- 172.21.15.120:0/1863748544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b41034c0 msgr2=0x7fa2b41038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:22.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 --2- 172.21.15.120:0/1863748544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b41034c0 0x7fa2b41038d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40099c0 tx=0x7fa2a4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 -- 172.21.15.120:0/1863748544 shutdown_connections 2024-05-14T09:17:22.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 --2- 172.21.15.120:0/1863748544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4108740 0x7fa2b41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 --2- 172.21.15.120:0/1863748544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b41034c0 0x7fa2b41038d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 --2- 172.21.15.120:0/1863748544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b4107df0 0x7fa2b4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 -- 172.21.15.120:0/1863748544 >> 172.21.15.120:0/1863748544 conn(0x7fa2b40fedc0 msgr2=0x7fa2b41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 -- 172.21.15.120:0/1863748544 shutdown_connections 2024-05-14T09:17:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.006+0000 7fa2ba000700 1 -- 172.21.15.120:0/1863748544 wait complete. 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.007+0000 7fa2ba000700 1 Processor -- start 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2ba000700 1 -- start start 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2ba000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b41034c0 0x7fa2b419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2ba000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b4107df0 0x7fa2b419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2ba000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4108740 0x7fa2b419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2ba000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b4113240 con 0x7fa2b4107df0 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2ba000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41130c0 con 0x7fa2b4108740 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2ba000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41133c0 con 0x7fa2b41034c0 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2b3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b41034c0 0x7fa2b419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2aaa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b4107df0 0x7fa2b419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2b3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b41034c0 0x7fa2b419ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:42240/0 (socket says 172.21.15.120:42240) 2024-05-14T09:17:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.008+0000 7fa2b3400700 1 -- 172.21.15.120:0/3223737077 learned_addr learned my addr 172.21.15.120:0/3223737077 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:22.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3e00700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4108740 0x7fa2b419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:22.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3400700 1 -- 172.21.15.120:0/3223737077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4108740 msgr2=0x7fa2b419f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:22.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3400700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4108740 0x7fa2b419f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3400700 1 -- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b4107df0 msgr2=0x7fa2b419b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3400700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b4107df0 0x7fa2b419b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3400700 1 -- 172.21.15.120:0/3223737077 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b419fb60 con 0x7fa2b41034c0 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3e00700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4108740 0x7fa2b419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.009+0000 7fa2b3400700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b41034c0 0x7fa2b419ad40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4006010 tx=0x7fa2a40055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.010+0000 7fa2b0c00700 1 -- 172.21.15.120:0/3223737077 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4026070 con 0x7fa2b41034c0 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.010+0000 7fa2b0c00700 1 -- 172.21.15.120:0/3223737077 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2a400f460 con 0x7fa2b41034c0 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.010+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b419fdf0 con 0x7fa2b41034c0 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.010+0000 7fa2b0c00700 1 -- 172.21.15.120:0/3223737077 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4009e60 con 0x7fa2b41034c0 2024-05-14T09:17:22.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.010+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b41a0320 con 0x7fa2b41034c0 2024-05-14T09:17:22.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.011+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b40512c0 con 0x7fa2b41034c0 2024-05-14T09:17:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.015+0000 7fa2b0c00700 1 -- 172.21.15.120:0/3223737077 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fa2a4029070 con 0x7fa2b41034c0 2024-05-14T09:17:22.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.016+0000 7fa2b0c00700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa2980b2900 0x7fa2980b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:22.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.016+0000 7fa2b0c00700 1 -- 172.21.15.120:0/3223737077 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fa2a40e2b60 con 0x7fa2b41034c0 2024-05-14T09:17:22.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.016+0000 7fa2aaa00700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa2980b2900 0x7fa2980b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:22.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.017+0000 7fa2aaa00700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa2980b2900 0x7fa2980b4e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4109a50 tx=0x7fa29c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.033+0000 7fa2b0c00700 1 -- 172.21.15.120:0/3223737077 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa2a4030080 con 0x7fa2b41034c0 2024-05-14T09:17:22.228 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:21 smithi175 systemd[1]: Starting Ceph mds.c for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.313+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2b419c0a0 con 0x7fa2b41034c0 2024-05-14T09:17:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.315+0000 7fa2b0c00700 1 -- 172.21.15.120:0/3223737077 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5536 (secure 0 0 0) 0x7fa2a4013070 con 0x7fa2b41034c0 2024-05-14T09:17:22.315 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:22.315 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-14T09:17:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa2980b2900 msgr2=0x7fa2980b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa2980b2900 0x7fa2980b4e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4109a50 tx=0x7fa29c009260 comp rx=0 tx=0).stop 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b41034c0 msgr2=0x7fa2b419ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b41034c0 0x7fa2b419ad40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4006010 tx=0x7fa2a40055f0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 shutdown_connections 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa2980b2900 0x7fa2980b4e10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4108740 0x7fa2b419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b41034c0 0x7fa2b419ad40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 --2- 172.21.15.120:0/3223737077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2b4107df0 0x7fa2b419b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 >> 172.21.15.120:0/3223737077 conn(0x7fa2b40fedc0 msgr2=0x7fa2b406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 shutdown_connections 2024-05-14T09:17:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:22.318+0000 7fa2ba000700 1 -- 172.21.15.120:0/3223737077 wait complete. 2024-05-14T09:17:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-05-14T09:17:22.604 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 podman[66495]: 2024-05-14 09:17:22.175816603 +0000 UTC m=+0.031754273 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:22.605 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 podman[66495]: 2024-05-14 09:17:22.303095427 +0000 UTC m=+0.159033120 container create ef5aee604f06b7e89bcd93629591616554eaac74a0fe1ca568f8f3ed6fd17fe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:17:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:22 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3223737077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:22.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:22 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3223737077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:22.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:22 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3223737077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:22.977 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 podman[66495]: 2024-05-14 09:17:22.60777047 +0000 UTC m=+0.463708206 container init ef5aee604f06b7e89bcd93629591616554eaac74a0fe1ca568f8f3ed6fd17fe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-14T09:17:22.978 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 podman[66495]: 2024-05-14 09:17:22.617844562 +0000 UTC m=+0.473782238 container start ef5aee604f06b7e89bcd93629591616554eaac74a0fe1ca568f8f3ed6fd17fe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:17:22.978 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 ceph-mds[66514]: -- 172.21.15.175:0/4163517966 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ad5c3fa40 con 0x563ad5c87600 2024-05-14T09:17:22.978 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c[66510]: starting mds.c at 2024-05-14T09:17:22.978 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 bash[66495]: ef5aee604f06b7e89bcd93629591616554eaac74a0fe1ca568f8f3ed6fd17fe3 2024-05-14T09:17:22.978 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:17:22 smithi175 systemd[1]: Started Ceph mds.c for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: Deploying daemon mds.h on smithi152 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:boot 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: fsmap 7 up:standby 2024-05-14T09:17:24.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: Deploying daemon mds.h on smithi152 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:boot 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: fsmap 7 up:standby 2024-05-14T09:17:24.179 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T09:17:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: Deploying daemon mds.h on smithi152 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:boot 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: fsmap 7 up:standby 2024-05-14T09:17:24.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T09:17:25.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:17:25.590 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:26.081 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:25 smithi120 ceph-mon[31085]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:25 smithi152 ceph-mon[34868]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:25 smithi175 ceph-mon[35353]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:26.583 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:26 smithi152 systemd[1]: Starting Ceph mds.h for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:26.936 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:26 smithi152 podman[64547]: 2024-05-14 09:17:26.490389534 +0000 UTC m=+0.038526348 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:26.936 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:26 smithi152 podman[64547]: 2024-05-14 09:17:26.646520121 +0000 UTC m=+0.194656962 container create 4ba25ddb775a48c14447467aa9d5b731045c9f582d00a5b13e7e71bf21273dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:17:26.936 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:26 smithi152 podman[64547]: 2024-05-14 09:17:26.935962016 +0000 UTC m=+0.484098863 container init 4ba25ddb775a48c14447467aa9d5b731045c9f582d00a5b13e7e71bf21273dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-14T09:17:27.208 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:26 smithi152 podman[64547]: 2024-05-14 09:17:26.946071121 +0000 UTC m=+0.494207930 container start 4ba25ddb775a48c14447467aa9d5b731045c9f582d00a5b13e7e71bf21273dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:17:27.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mds[64565]: -- 172.21.15.152:0/1642372707 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4ecd09a40 con 0x55e4ecd51a80 2024-05-14T09:17:27.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: starting mds.h at 2024-05-14T09:17:27.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:27 smithi152 bash[64547]: 4ba25ddb775a48c14447467aa9d5b731045c9f582d00a5b13e7e71bf21273dd9 2024-05-14T09:17:27.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:17:27 smithi152 systemd[1]: Started Ceph mds.h for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:27.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 -- 172.21.15.120:0/4022240236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410b2e0 msgr2=0x7f4484117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:27.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 --2- 172.21.15.120:0/4022240236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410b2e0 0x7f4484117810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f447c00b0a0 tx=0x7f447c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:17:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 -- 172.21.15.120:0/4022240236 shutdown_connections 2024-05-14T09:17:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 --2- 172.21.15.120:0/4022240236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4484110970 0x7f4484110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 --2- 172.21.15.120:0/4022240236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410b2e0 0x7f4484117810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 --2- 172.21.15.120:0/4022240236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448410a990 0x7f448410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 -- 172.21.15.120:0/4022240236 >> 172.21.15.120:0/4022240236 conn(0x7f4484077c80 msgr2=0x7f44840780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 -- 172.21.15.120:0/4022240236 shutdown_connections 2024-05-14T09:17:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.876+0000 7f448ae00700 1 -- 172.21.15.120:0/4022240236 wait complete. 2024-05-14T09:17:27.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.877+0000 7f448ae00700 1 Processor -- start 2024-05-14T09:17:27.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f448ae00700 1 -- start start 2024-05-14T09:17:27.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f448ae00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410a990 0x7f44841a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:27.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f448ae00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448410b2e0 0x7f44841a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:27.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f448ae00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4484110970 0x7f44841a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f448ae00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f448411a990 con 0x7f448410a990 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f448ae00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f448411a810 con 0x7f4484110970 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f448ae00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f448411ab10 con 0x7f448410b2e0 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.878+0000 7f4483e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410a990 0x7f44841a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410a990 0x7f44841a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54550/0 (socket says 172.21.15.120:54550) 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 -- 172.21.15.120:0/2580825494 learned_addr learned my addr 172.21.15.120:0/2580825494 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483400700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448410b2e0 0x7f44841a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4488e00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4484110970 0x7f44841a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 -- 172.21.15.120:0/2580825494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448410b2e0 msgr2=0x7f44841a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448410b2e0 0x7f44841a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 -- 172.21.15.120:0/2580825494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4484110970 msgr2=0x7f44841a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4484110970 0x7f44841a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:27.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 -- 172.21.15.120:0/2580825494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44841a6210 con 0x7f448410a990 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483400700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448410b2e0 0x7f44841a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.879+0000 7f4483e00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410a990 0x7f44841a1340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f447400c8f0 tx=0x7f447400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.880+0000 7f4480c00700 1 -- 172.21.15.120:0/2580825494 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474007b00 con 0x7f448410a990 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.880+0000 7f4480c00700 1 -- 172.21.15.120:0/2580825494 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4474007ca0 con 0x7f448410a990 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.880+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44841a6500 con 0x7f448410a990 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.880+0000 7f4480c00700 1 -- 172.21.15.120:0/2580825494 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474018660 con 0x7f448410a990 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.880+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44841ade20 con 0x7f448410a990 2024-05-14T09:17:27.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.881+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44840512c0 con 0x7f448410a990 2024-05-14T09:17:27.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.884+0000 7f4480c00700 1 -- 172.21.15.120:0/2580825494 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f447400f450 con 0x7f448410a990 2024-05-14T09:17:27.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.885+0000 7f4480c00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f44680b2900 0x7f44680b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:27.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.885+0000 7f4480c00700 1 -- 172.21.15.120:0/2580825494 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f44740e1d50 con 0x7f448410a990 2024-05-14T09:17:27.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.885+0000 7f4483400700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f44680b2900 0x7f44680b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:27.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.886+0000 7f4483400700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f44680b2900 0x7f44680b4e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4470005950 tx=0x7f44700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:27.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:27.890+0000 7f4480c00700 1 -- 172.21.15.120:0/2580825494 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4474014030 con 0x7f448410a990 2024-05-14T09:17:28.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:27 smithi120 ceph-mon[31085]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:28.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:28.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.181+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44841a26d0 con 0x7f448410a990 2024-05-14T09:17:28.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.183+0000 7f4480c00700 1 -- 172.21.15.120:0/2580825494 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7192 (secure 0 0 0) 0x7f44841a26d0 con 0x7f448410a990 2024-05-14T09:17:28.182 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:28.183 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-14T09:17:28.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f44680b2900 msgr2=0x7f44680b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f44680b2900 0x7f44680b4e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4470005950 tx=0x7f44700058e0 comp rx=0 tx=0).stop 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410a990 msgr2=0x7f44841a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410a990 0x7f44841a1340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f447400c8f0 tx=0x7f447400ccb0 comp rx=0 tx=0).stop 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 shutdown_connections 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f44680b2900 0x7f44680b4e10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4484110970 0x7f44841a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f448410a990 0x7f44841a1340 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 --2- 172.21.15.120:0/2580825494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448410b2e0 0x7f44841a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 >> 172.21.15.120:0/2580825494 conn(0x7f4484077c80 msgr2=0x7f448407b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 shutdown_connections 2024-05-14T09:17:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:28.186+0000 7f448ae00700 1 -- 172.21.15.120:0/2580825494 wait complete. 2024-05-14T09:17:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 9 2024-05-14T09:17:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mon[34868]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:27 smithi175 ceph-mon[35353]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:28 smithi175 ceph-mon[35353]: Deploying daemon mds.i on smithi175 2024-05-14T09:17:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:28 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] up:boot 2024-05-14T09:17:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:28 smithi175 ceph-mon[35353]: fsmap 8 up:standby 2024-05-14T09:17:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:28 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T09:17:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:28 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2580825494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:29.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:28 smithi120 ceph-mon[31085]: Deploying daemon mds.i on smithi175 2024-05-14T09:17:29.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:28 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] up:boot 2024-05-14T09:17:29.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:28 smithi120 ceph-mon[31085]: fsmap 8 up:standby 2024-05-14T09:17:29.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T09:17:29.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:28 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2580825494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:28 smithi152 ceph-mon[34868]: Deploying daemon mds.i on smithi175 2024-05-14T09:17:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:28 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] up:boot 2024-05-14T09:17:29.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:28 smithi152 ceph-mon[34868]: fsmap 8 up:standby 2024-05-14T09:17:29.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:28 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T09:17:29.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:28 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2580825494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:29 smithi175 ceph-mon[35353]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:30.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:29 smithi120 ceph-mon[31085]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:30.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:29 smithi152 ceph-mon[34868]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:30.829 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:30 smithi175 systemd[1]: Starting Ceph mds.i for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:30.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:17:31.149 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:30 smithi175 podman[66807]: 2024-05-14 09:17:30.737640969 +0000 UTC m=+0.035912807 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:31.149 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:30 smithi175 podman[66807]: 2024-05-14 09:17:30.868578546 +0000 UTC m=+0.166850402 container create caf092ae6b786aba992c748afa961452399c9c665430d524dd91892e29b8ef66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, ceph=True) 2024-05-14T09:17:31.150 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:31 smithi175 podman[66807]: 2024-05-14 09:17:31.148655127 +0000 UTC m=+0.446926989 container init caf092ae6b786aba992c748afa961452399c9c665430d524dd91892e29b8ef66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-14T09:17:31.421 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:31.478 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:31 smithi175 podman[66807]: 2024-05-14 09:17:31.161110472 +0000 UTC m=+0.459382301 container start caf092ae6b786aba992c748afa961452399c9c665430d524dd91892e29b8ef66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-14T09:17:31.478 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:31 smithi175 bash[66807]: caf092ae6b786aba992c748afa961452399c9c665430d524dd91892e29b8ef66 2024-05-14T09:17:31.478 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:31 smithi175 systemd[1]: Started Ceph mds.i for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:31.478 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mds[66827]: -- 172.21.15.175:0/2260389319 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad1969ba40 con 0x55ad196e3600 2024-05-14T09:17:31.478 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:17:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i[66823]: starting mds.i at 2024-05-14T09:17:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:31 smithi152 ceph-mon[34868]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:32.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:32.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:31 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mon[35353]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:32.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:31 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:32.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:31 smithi120 ceph-mon[31085]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:32.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:32.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:32.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:32.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:31 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:32.941 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:32 smithi120 ceph-mon[31085]: Deploying daemon mds.g on smithi120 2024-05-14T09:17:32.942 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:32 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] up:boot 2024-05-14T09:17:32.942 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:32 smithi120 ceph-mon[31085]: fsmap 9 up:standby 2024-05-14T09:17:32.942 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:32 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T09:17:33.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:32 smithi152 ceph-mon[34868]: Deploying daemon mds.g on smithi120 2024-05-14T09:17:33.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:32 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] up:boot 2024-05-14T09:17:33.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:32 smithi152 ceph-mon[34868]: fsmap 9 up:standby 2024-05-14T09:17:33.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:32 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T09:17:33.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:32 smithi175 ceph-mon[35353]: Deploying daemon mds.g on smithi120 2024-05-14T09:17:33.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:32 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] up:boot 2024-05-14T09:17:33.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:32 smithi175 ceph-mon[35353]: fsmap 9 up:standby 2024-05-14T09:17:33.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:32 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 -- 172.21.15.120:0/1905498878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c410c5c0 msgr2=0x7f36c410c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 --2- 172.21.15.120:0/1905498878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c410c5c0 0x7f36c410c9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009990 tx=0x7f36b4009ca0 comp rx=0 tx=0).stop 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 -- 172.21.15.120:0/1905498878 shutdown_connections 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 --2- 172.21.15.120:0/1905498878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c4106ed0 0x7f36c4113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 --2- 172.21.15.120:0/1905498878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c410c5c0 0x7f36c410c9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 --2- 172.21.15.120:0/1905498878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c4106580 0x7f36c4106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 -- 172.21.15.120:0/1905498878 >> 172.21.15.120:0/1905498878 conn(0x7f36c4102080 msgr2=0x7f36c41044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 -- 172.21.15.120:0/1905498878 shutdown_connections 2024-05-14T09:17:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.793+0000 7f36c8a00700 1 -- 172.21.15.120:0/1905498878 wait complete. 2024-05-14T09:17:33.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 Processor -- start 2024-05-14T09:17:33.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 -- start start 2024-05-14T09:17:33.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c4106580 0x7f36c419cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:33.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c4106ed0 0x7f36c419d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c410c5c0 0x7f36c41a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f36c41165d0 con 0x7f36c4106580 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4116450 con 0x7f36c410c5c0 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.795+0000 7f36c8a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4116750 con 0x7f36c4106ed0 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c4106580 0x7f36c419cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c4106580 0x7f36c419cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36114/0 (socket says 172.21.15.120:36114) 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 -- 172.21.15.120:0/685872956 learned_addr learned my addr 172.21.15.120:0/685872956 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1400700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c4106ed0 0x7f36c419d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c2800700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c410c5c0 0x7f36c41a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 -- 172.21.15.120:0/685872956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c4106ed0 msgr2=0x7f36c419d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c4106ed0 0x7f36c419d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 -- 172.21.15.120:0/685872956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c410c5c0 msgr2=0x7f36c41a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c410c5c0 0x7f36c41a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 -- 172.21.15.120:0/685872956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c41a1e60 con 0x7f36c4106580 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1400700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c4106ed0 0x7f36c419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.796+0000 7f36c1e00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c4106580 0x7f36c419cfe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.797+0000 7f36baa00700 1 -- 172.21.15.120:0/685872956 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4027070 con 0x7f36c4106580 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.797+0000 7f36baa00700 1 -- 172.21.15.120:0/685872956 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b400fb80 con 0x7f36c4106580 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.797+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c41a20f0 con 0x7f36c4106580 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.797+0000 7f36baa00700 1 -- 172.21.15.120:0/685872956 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4022c00 con 0x7f36c4106580 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.797+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c41a9a70 con 0x7f36c4106580 2024-05-14T09:17:33.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.798+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c40512c0 con 0x7f36c4106580 2024-05-14T09:17:33.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.802+0000 7f36baa00700 1 -- 172.21.15.120:0/685872956 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f36b402a070 con 0x7f36c4106580 2024-05-14T09:17:33.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.803+0000 7f36baa00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f36a80b2900 0x7f36a80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:33.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.804+0000 7f36baa00700 1 -- 172.21.15.120:0/685872956 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f36b40e3060 con 0x7f36c4106580 2024-05-14T09:17:33.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.804+0000 7f36c1400700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f36a80b2900 0x7f36a80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:33.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.804+0000 7f36c1400700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f36a80b2900 0x7f36a80b4e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f36b0005fd0 tx=0x7f36b0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:33.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:33.806+0000 7f36baa00700 1 -- 172.21.15.120:0/685872956 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f36b4013070 con 0x7f36c4106580 2024-05-14T09:17:34.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.090+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36c419e2f0 con 0x7f36c4106580 2024-05-14T09:17:34.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.091+0000 7f36baa00700 1 -- 172.21.15.120:0/685872956 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8019 (secure 0 0 0) 0x7f36b40b3030 con 0x7f36c4106580 2024-05-14T09:17:34.091 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:34.091 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-14T09:17:34.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f36a80b2900 msgr2=0x7f36a80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:34.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f36a80b2900 0x7f36a80b4e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f36b0005fd0 tx=0x7f36b0005ee0 comp rx=0 tx=0).stop 2024-05-14T09:17:34.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c4106580 msgr2=0x7f36c419cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:34.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c4106580 0x7f36c419cfe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4005ef0 comp rx=0 tx=0).stop 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 shutdown_connections 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f36a80b2900 0x7f36a80b4e10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c410c5c0 0x7f36c41a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36c4106580 0x7f36c419cfe0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 --2- 172.21.15.120:0/685872956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c4106ed0 0x7f36c419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.094+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 >> 172.21.15.120:0/685872956 conn(0x7f36c4102080 msgr2=0x7f36c4104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.095+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 shutdown_connections 2024-05-14T09:17:34.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:34.095+0000 7f36c8a00700 1 -- 172.21.15.120:0/685872956 wait complete. 2024-05-14T09:17:34.096 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 10 2024-05-14T09:17:34.163 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:33 smithi120 ceph-mon[31085]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:34.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:33 smithi152 ceph-mon[34868]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:34.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:33 smithi175 ceph-mon[35353]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:35.174 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:34 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/685872956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:35.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:34 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/685872956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:35.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:34 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/685872956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:35.884 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:35 smithi120 systemd[1]: Starting Ceph mds.g for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:35 smithi152 ceph-mon[34868]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:35 smithi175 ceph-mon[35353]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:36.316 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:35 smithi120 ceph-mon[31085]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:36.316 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:35 smithi120 podman[72227]: 2024-05-14 09:17:35.885989724 +0000 UTC m=+0.032506472 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:36.316 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:36 smithi120 podman[72227]: 2024-05-14 09:17:36.002851025 +0000 UTC m=+0.149367801 container create add6a555e5582969150ac5210db8903a4a4b2484b0fe5de3e5ac6f9681d0f5fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True) 2024-05-14T09:17:36.316 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:36 smithi120 podman[72227]: 2024-05-14 09:17:36.315605361 +0000 UTC m=+0.462122117 container init add6a555e5582969150ac5210db8903a4a4b2484b0fe5de3e5ac6f9681d0f5fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-14T09:17:36.634 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:36 smithi120 podman[72227]: 2024-05-14 09:17:36.32660926 +0000 UTC m=+0.473126001 container start add6a555e5582969150ac5210db8903a4a4b2484b0fe5de3e5ac6f9681d0f5fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-14T09:17:36.634 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:36 smithi120 bash[72227]: add6a555e5582969150ac5210db8903a4a4b2484b0fe5de3e5ac6f9681d0f5fd 2024-05-14T09:17:36.634 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:36 smithi120 ceph-mds[72246]: -- 172.21.15.120:0/3183845283 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e15ce7a40 con 0x557e15d2fa80 2024-05-14T09:17:36.634 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:36 smithi120 systemd[1]: Started Ceph mds.g for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:36.634 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:17:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g[72242]: starting mds.g at 2024-05-14T09:17:37.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:17:37.808 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:37.808 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: Deploying daemon mds.a on smithi120 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.120:6838/3368743010,v1:172.21.15.120:6839/3368743010] up:boot 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: fsmap 10 up:standby 2024-05-14T09:17:37.809 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:37 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: Deploying daemon mds.a on smithi120 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.120:6838/3368743010,v1:172.21.15.120:6839/3368743010] up:boot 2024-05-14T09:17:37.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: fsmap 10 up:standby 2024-05-14T09:17:37.960 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:37 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T09:17:37.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:37.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: Deploying daemon mds.a on smithi120 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.120:6838/3368743010,v1:172.21.15.120:6839/3368743010] up:boot 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: fsmap 10 up:standby 2024-05-14T09:17:37.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:37 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T09:17:38.336 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:39.736 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:39 smithi120 ceph-mon[31085]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:39 smithi152 ceph-mon[34868]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:39 smithi175 ceph-mon[35353]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:40.128 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:39 smithi120 systemd[1]: Starting Ceph mds.a for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:40.750 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:40 smithi120 podman[72638]: 2024-05-14 09:17:40.624058507 +0000 UTC m=+0.042278756 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:40.750 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:40 smithi120 podman[72638]: 2024-05-14 09:17:40.749864843 +0000 UTC m=+0.168085101 container create 9297adf698af34bca5c181419b2e7f01169b597e7ffc96a3cc67b373a8ef199e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-14T09:17:41.385 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:41 smithi120 podman[72638]: 2024-05-14 09:17:41.045980204 +0000 UTC m=+0.464200459 container init 9297adf698af34bca5c181419b2e7f01169b597e7ffc96a3cc67b373a8ef199e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-14T09:17:41.385 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:41 smithi120 podman[72638]: 2024-05-14 09:17:41.056278709 +0000 UTC m=+0.474498988 container start 9297adf698af34bca5c181419b2e7f01169b597e7ffc96a3cc67b373a8ef199e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-14T09:17:41.385 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:41 smithi120 bash[72638]: 9297adf698af34bca5c181419b2e7f01169b597e7ffc96a3cc67b373a8ef199e 2024-05-14T09:17:41.385 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:41 smithi120 systemd[1]: Started Ceph mds.a for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:41.385 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mds[72676]: -- 172.21.15.120:0/428007010 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca05d4fa40 con 0x55ca05d97a80 2024-05-14T09:17:41.385 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a[72672]: starting mds.a at 2024-05-14T09:17:41.706 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mon[31085]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:41.707 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.707 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.707 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.707 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:41.707 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:41.707 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:41.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.831+0000 7f2b39800700 1 -- 172.21.15.120:0/2434034841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b34106580 msgr2=0x7f2b34106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.831+0000 7f2b39800700 1 --2- 172.21.15.120:0/2434034841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b34106580 0x7f2b34106990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009990 tx=0x7f2b20009ca0 comp rx=0 tx=0).stop 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.831+0000 7f2b39800700 1 -- 172.21.15.120:0/2434034841 shutdown_connections 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.831+0000 7f2b39800700 1 --2- 172.21.15.120:0/2434034841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b34106ed0 0x7f2b34113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.831+0000 7f2b39800700 1 --2- 172.21.15.120:0/2434034841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b3410c5c0 0x7f2b3410c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.831+0000 7f2b39800700 1 --2- 172.21.15.120:0/2434034841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b34106580 0x7f2b34106990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.831+0000 7f2b39800700 1 -- 172.21.15.120:0/2434034841 >> 172.21.15.120:0/2434034841 conn(0x7f2b34102080 msgr2=0x7f2b341044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.832+0000 7f2b39800700 1 -- 172.21.15.120:0/2434034841 shutdown_connections 2024-05-14T09:17:41.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.832+0000 7f2b39800700 1 -- 172.21.15.120:0/2434034841 wait complete. 2024-05-14T09:17:41.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.833+0000 7f2b39800700 1 Processor -- start 2024-05-14T09:17:41.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.833+0000 7f2b39800700 1 -- start start 2024-05-14T09:17:41.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b39800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b34106580 0x7f2b3419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:41.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b39800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b34106ed0 0x7f2b3419d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:41.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b39800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3410c5c0 0x7f2b341a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b39800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2b34116570 con 0x7f2b3410c5c0 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b39800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2b341163f0 con 0x7f2b34106ed0 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b39800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b341166f0 con 0x7f2b34106580 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b33400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3410c5c0 0x7f2b341a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b33400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3410c5c0 0x7f2b341a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41050/0 (socket says 172.21.15.120:41050) 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b33400700 1 -- 172.21.15.120:0/923508131 learned_addr learned my addr 172.21.15.120:0/923508131 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b32a00700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b34106580 0x7f2b3419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.834+0000 7f2b32000700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b34106ed0 0x7f2b3419d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b33400700 1 -- 172.21.15.120:0/923508131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b34106580 msgr2=0x7f2b3419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b33400700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b34106580 0x7f2b3419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b33400700 1 -- 172.21.15.120:0/923508131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b34106ed0 msgr2=0x7f2b3419d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b33400700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b34106ed0 0x7f2b3419d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:41.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b33400700 1 -- 172.21.15.120:0/923508131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b341a1e10 con 0x7f2b3410c5c0 2024-05-14T09:17:41.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b32a00700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b34106580 0x7f2b3419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:17:41.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b32000700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b34106ed0 0x7f2b3419d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:17:41.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b33400700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3410c5c0 0x7f2b341a1770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c007ee0 tx=0x7f2b2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:41.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b2b400700 1 -- 172.21.15.120:0/923508131 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00dbd0 con 0x7f2b3410c5c0 2024-05-14T09:17:41.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b2b400700 1 -- 172.21.15.120:0/923508131 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b2c00dd70 con 0x7f2b3410c5c0 2024-05-14T09:17:41.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b341a2100 con 0x7f2b3410c5c0 2024-05-14T09:17:41.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b2b400700 1 -- 172.21.15.120:0/923508131 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0058d0 con 0x7f2b3410c5c0 2024-05-14T09:17:41.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.835+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b341a9a20 con 0x7f2b3410c5c0 2024-05-14T09:17:41.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.837+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b340512c0 con 0x7f2b3410c5c0 2024-05-14T09:17:41.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.839+0000 7f2b2b400700 1 -- 172.21.15.120:0/923508131 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f2b2c01a020 con 0x7f2b3410c5c0 2024-05-14T09:17:41.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.841+0000 7f2b2b400700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2b180b2880 0x7f2b180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:41.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.841+0000 7f2b2b400700 1 -- 172.21.15.120:0/923508131 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f2b2c0e1d10 con 0x7f2b3410c5c0 2024-05-14T09:17:41.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.841+0000 7f2b32a00700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2b180b2880 0x7f2b180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:41.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.842+0000 7f2b32a00700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2b180b2880 0x7f2b180b4d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b341079f0 tx=0x7f2b2400b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:41.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:41.843+0000 7f2b2b400700 1 -- 172.21.15.120:0/923508131 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2b2c010070 con 0x7f2b3410c5c0 2024-05-14T09:17:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:41 smithi152 ceph-mon[34868]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:41.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:41 smithi175 ceph-mon[35353]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T09:17:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T09:17:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:42.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.120+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b3402e5f0 con 0x7f2b3410c5c0 2024-05-14T09:17:42.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.122+0000 7f2b2b400700 1 -- 172.21.15.120:0/923508131 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9677 (secure 0 0 0) 0x7f2b2c0a9e30 con 0x7f2b3410c5c0 2024-05-14T09:17:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:42.123 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-14T09:17:42.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2b180b2880 msgr2=0x7f2b180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:42.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2b180b2880 0x7f2b180b4d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b341079f0 tx=0x7f2b2400b2c0 comp rx=0 tx=0).stop 2024-05-14T09:17:42.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3410c5c0 msgr2=0x7f2b341a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:42.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3410c5c0 0x7f2b341a1770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c007ee0 tx=0x7f2b2c00d3b0 comp rx=0 tx=0).stop 2024-05-14T09:17:42.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 shutdown_connections 2024-05-14T09:17:42.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2b180b2880 0x7f2b180b4d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:42.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3410c5c0 0x7f2b341a1770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:42.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b34106580 0x7f2b3419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:42.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 --2- 172.21.15.120:0/923508131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b34106ed0 0x7f2b3419d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:42.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.125+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 >> 172.21.15.120:0/923508131 conn(0x7f2b34102080 msgr2=0x7f2b34104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:42.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.126+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 shutdown_connections 2024-05-14T09:17:42.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:42.126+0000 7f2b39800700 1 -- 172.21.15.120:0/923508131 wait complete. 2024-05-14T09:17:42.128 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2024-05-14T09:17:42.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:42 smithi120 ceph-mon[31085]: Deploying daemon mds.b on smithi152 2024-05-14T09:17:42.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:42 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.120:6840/1248486929,v1:172.21.15.120:6841/1248486929] up:boot 2024-05-14T09:17:42.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:42 smithi120 ceph-mon[31085]: fsmap 11 up:standby 2024-05-14T09:17:42.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T09:17:42.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:42 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/923508131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:42.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:42 smithi152 ceph-mon[34868]: Deploying daemon mds.b on smithi152 2024-05-14T09:17:42.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:42 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.120:6840/1248486929,v1:172.21.15.120:6841/1248486929] up:boot 2024-05-14T09:17:42.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:42 smithi152 ceph-mon[34868]: fsmap 11 up:standby 2024-05-14T09:17:42.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T09:17:42.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:42 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/923508131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:42.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:42 smithi175 ceph-mon[35353]: Deploying daemon mds.b on smithi152 2024-05-14T09:17:42.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:42 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.120:6840/1248486929,v1:172.21.15.120:6841/1248486929] up:boot 2024-05-14T09:17:42.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:42 smithi175 ceph-mon[35353]: fsmap 11 up:standby 2024-05-14T09:17:42.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T09:17:42.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:42 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/923508131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:43 smithi120 ceph-mon[31085]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:43 smithi152 ceph-mon[34868]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:43.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:43 smithi175 ceph-mon[35353]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:44.708 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:44 smithi152 systemd[1]: Starting Ceph mds.b for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:17:44.945 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:17:45.147 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:44 smithi152 podman[64856]: 2024-05-14 09:17:44.706563757 +0000 UTC m=+0.034784373 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:17:45.147 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:44 smithi152 podman[64856]: 2024-05-14 09:17:44.85940947 +0000 UTC m=+0.187630114 container create b1c50458a17207e578e25a084b8d95816ea45e03925a40abbdfa3ffe1eb914a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-14T09:17:45.147 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:45 smithi152 podman[64856]: 2024-05-14 09:17:45.146741141 +0000 UTC m=+0.474961829 container init b1c50458a17207e578e25a084b8d95816ea45e03925a40abbdfa3ffe1eb914a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:17:45.396 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:45.458 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:45 smithi152 podman[64856]: 2024-05-14 09:17:45.156773588 +0000 UTC m=+0.484994203 container start b1c50458a17207e578e25a084b8d95816ea45e03925a40abbdfa3ffe1eb914a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-14T09:17:45.459 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-mds[64875]: -- 172.21.15.152:0/241576547 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ecdf41a40 con 0x556ecdf89a80 2024-05-14T09:17:45.459 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b[64871]: starting mds.b at 2024-05-14T09:17:45.459 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:45 smithi152 bash[64856]: b1c50458a17207e578e25a084b8d95816ea45e03925a40abbdfa3ffe1eb914a8 2024-05-14T09:17:45.459 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:17:45 smithi152 systemd[1]: Started Ceph mds.b for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:17:45.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:45 smithi120 ceph-mon[31085]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:45.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:45 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-mon[34868]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:45 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:45 smithi175 ceph-mon[35353]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:45.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:45 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:46.778 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:46 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.152:6838/256598418,v1:172.21.15.152:6839/256598418] up:boot 2024-05-14T09:17:46.778 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:46 smithi120 ceph-mon[31085]: fsmap 12 up:standby 2024-05-14T09:17:46.779 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:46 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T09:17:46.779 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:46 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:17:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:46 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.152:6838/256598418,v1:172.21.15.152:6839/256598418] up:boot 2024-05-14T09:17:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:46 smithi152 ceph-mon[34868]: fsmap 12 up:standby 2024-05-14T09:17:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:46 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T09:17:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:46 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:17:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:46 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.152:6838/256598418,v1:172.21.15.152:6839/256598418] up:boot 2024-05-14T09:17:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:46 smithi175 ceph-mon[35353]: fsmap 12 up:standby 2024-05-14T09:17:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:46 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T09:17:46.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:46 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:17:47.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 -- 172.21.15.120:0/3831296543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb8108f20 msgr2=0x7fedb8109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:47.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 --2- 172.21.15.120:0/3831296543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb8108f20 0x7fedb8109330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feda40099c0 tx=0x7feda4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 -- 172.21.15.120:0/3831296543 shutdown_connections 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 --2- 172.21.15.120:0/3831296543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedb81045f0 0x7fedb8104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 --2- 172.21.15.120:0/3831296543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb8109870 0x7fedb81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 --2- 172.21.15.120:0/3831296543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb8108f20 0x7fedb8109330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 -- 172.21.15.120:0/3831296543 >> 172.21.15.120:0/3831296543 conn(0x7fedb8100040 msgr2=0x7fedb8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 -- 172.21.15.120:0/3831296543 shutdown_connections 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.676+0000 7fedbf400700 1 -- 172.21.15.120:0/3831296543 wait complete. 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 Processor -- start 2024-05-14T09:17:47.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 -- start start 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb81045f0 0x7fedb819d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb8108f20 0x7fedb819d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedb8109870 0x7fedb81a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8114330 con 0x7fedb81045f0 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fedb81141b0 con 0x7fedb8109870 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.678+0000 7fedbf400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fedb81144b0 con 0x7fedb8108f20 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb81045f0 0x7fedb819d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb81045f0 0x7fedb819d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41076/0 (socket says 172.21.15.120:41076) 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 -- 172.21.15.120:0/1093057846 learned_addr learned my addr 172.21.15.120:0/1093057846 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:47.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedb7e00700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb8108f20 0x7fedb819d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbd400700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedb8109870 0x7fedb81a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 -- 172.21.15.120:0/1093057846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb8108f20 msgr2=0x7fedb819d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb8108f20 0x7fedb819d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 -- 172.21.15.120:0/1093057846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedb8109870 msgr2=0x7fedb81a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedb8109870 0x7fedb81a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.679+0000 7fedbca00700 1 -- 172.21.15.120:0/1093057846 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb81a1e60 con 0x7fedb81045f0 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.680+0000 7fedbca00700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb81045f0 0x7fedb819d040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c920 tx=0x7fedac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.680+0000 7fedb5600700 1 -- 172.21.15.120:0/1093057846 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac007b00 con 0x7fedb81045f0 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.680+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb81a2150 con 0x7fedb81045f0 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.680+0000 7fedb5600700 1 -- 172.21.15.120:0/1093057846 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fedac004cc0 con 0x7fedb81045f0 2024-05-14T09:17:47.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.680+0000 7fedb5600700 1 -- 172.21.15.120:0/1093057846 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac0053f0 con 0x7fedb81045f0 2024-05-14T09:17:47.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.680+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb81a26b0 con 0x7fedb81045f0 2024-05-14T09:17:47.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.681+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb80512c0 con 0x7fedb81045f0 2024-05-14T09:17:47.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.684+0000 7fedb5600700 1 -- 172.21.15.120:0/1093057846 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fedac004750 con 0x7fedb81045f0 2024-05-14T09:17:47.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.686+0000 7fedb5600700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feda00b2900 0x7feda00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:47.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.686+0000 7fedb5600700 1 -- 172.21.15.120:0/1093057846 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fedac0e1850 con 0x7fedb81045f0 2024-05-14T09:17:47.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.686+0000 7fedb7e00700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feda00b2900 0x7feda00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:47.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.687+0000 7fedb7e00700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feda00b2900 0x7feda00b4e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feda4009990 tx=0x7feda4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:47.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.691+0000 7fedb5600700 1 -- 172.21.15.120:0/1093057846 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fedac014030 con 0x7fedb81045f0 2024-05-14T09:17:47.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.990+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedb819e3a0 con 0x7fedb81045f0 2024-05-14T09:17:47.992 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:47 smithi120 ceph-mon[31085]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:47.992 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:47.992 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:47.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.992+0000 7fedb5600700 1 -- 172.21.15.120:0/1093057846 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10503 (secure 0 0 0) 0x7fedac0a9a10 con 0x7fedb81045f0 2024-05-14T09:17:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:47.994 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":14601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-14T09:17:47.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feda00b2900 msgr2=0x7feda00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:47.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feda00b2900 0x7feda00b4e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feda4009990 tx=0x7feda4005fb0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb81045f0 msgr2=0x7fedb819d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:47.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb81045f0 0x7fedb819d040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c920 tx=0x7fedac00cc30 comp rx=0 tx=0).stop 2024-05-14T09:17:47.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 shutdown_connections 2024-05-14T09:17:47.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7feda00b2900 0x7feda00b4e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedb8109870 0x7fedb81a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedb81045f0 0x7fedb819d040 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 --2- 172.21.15.120:0/1093057846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb8108f20 0x7fedb819d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:47.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 >> 172.21.15.120:0/1093057846 conn(0x7fedb8100040 msgr2=0x7fedb810a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:47.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 shutdown_connections 2024-05-14T09:17:47.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:47.995+0000 7fedbf400700 1 -- 172.21.15.120:0/1093057846 wait complete. 2024-05-14T09:17:47.997 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 13 2024-05-14T09:17:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:47 smithi152 ceph-mon[34868]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:47 smithi175 ceph-mon[35353]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.133 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:48 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1093057846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:49.133 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:48 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:48 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:48 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:48 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.202 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-14T09:17:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:48 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1093057846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:48 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:48 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:48 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:48 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:48 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1093057846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:17:49.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:48 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:48 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:48 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:48 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:49.625 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:50.079 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:49 smithi120 ceph-mon[31085]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:49 smithi152 ceph-mon[34868]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:49 smithi175 ceph-mon[35353]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:51 smithi175 ceph-mon[35353]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:51.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:51 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.486 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.486 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:51 smithi120 ceph-mon[31085]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:51.486 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.486 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:51 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:51 smithi152 ceph-mon[34868]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:51.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:51 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 -- 172.21.15.120:0/3124650761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc108d30 msgr2=0x7ff9bc109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/3124650761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc108d30 0x7ff9bc109140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80099c0 tx=0x7ff9a8009cd0 comp rx=0 tx=0).stop 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 -- 172.21.15.120:0/3124650761 shutdown_connections 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/3124650761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9bc109680 0x7ff9bc110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/3124650761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9bc104400 0x7ff9bc104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/3124650761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc108d30 0x7ff9bc109140 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 -- 172.21.15.120:0/3124650761 >> 172.21.15.120:0/3124650761 conn(0x7ff9bc079d10 msgr2=0x7ff9bc07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 -- 172.21.15.120:0/3124650761 shutdown_connections 2024-05-14T09:17:51.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.833+0000 7ff9bbe00700 1 -- 172.21.15.120:0/3124650761 wait complete. 2024-05-14T09:17:51.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.834+0000 7ff9bbe00700 1 Processor -- start 2024-05-14T09:17:51.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bbe00700 1 -- start start 2024-05-14T09:17:51.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bbe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9bc104400 0x7ff9bc19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:51.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bbe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9bc108d30 0x7ff9bc19d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:51.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc109680 0x7ff9bc1a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:51.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bbe00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc114190 con 0x7ff9bc109680 2024-05-14T09:17:51.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bbe00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc114010 con 0x7ff9bc104400 2024-05-14T09:17:51.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bbe00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc114310 con 0x7ff9bc108d30 2024-05-14T09:17:51.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bb400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc109680 0x7ff9bc1a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:51.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bb400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc109680 0x7ff9bc1a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41608/0 (socket says 172.21.15.120:41608) 2024-05-14T09:17:51.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.835+0000 7ff9bb400700 1 -- 172.21.15.120:0/2051625602 learned_addr learned my addr 172.21.15.120:0/2051625602 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:51.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9baa00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9bc104400 0x7ff9bc19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:51.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9ba000700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9bc108d30 0x7ff9bc19d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:51.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9bb400700 1 -- 172.21.15.120:0/2051625602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9bc108d30 msgr2=0x7ff9bc19d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9bb400700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9bc108d30 0x7ff9bc19d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9bb400700 1 -- 172.21.15.120:0/2051625602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9bc104400 msgr2=0x7ff9bc19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9bb400700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9bc104400 0x7ff9bc19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9bb400700 1 -- 172.21.15.120:0/2051625602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc1a1d90 con 0x7ff9bc109680 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9bb400700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc109680 0x7ff9bc1a16f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4007ee0 tx=0x7ff9b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.836+0000 7ff9c0a00700 1 -- 172.21.15.120:0/2051625602 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400dbd0 con 0x7ff9bc109680 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.837+0000 7ff9c0a00700 1 -- 172.21.15.120:0/2051625602 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9b400dd70 con 0x7ff9bc109680 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.837+0000 7ff9c0a00700 1 -- 172.21.15.120:0/2051625602 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40058d0 con 0x7ff9bc109680 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.837+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9bc1a2080 con 0x7ff9bc109680 2024-05-14T09:17:51.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.837+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9bc1a99a0 con 0x7ff9bc109680 2024-05-14T09:17:51.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.838+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9bc1058b0 con 0x7ff9bc109680 2024-05-14T09:17:51.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.841+0000 7ff9c0a00700 1 -- 172.21.15.120:0/2051625602 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7ff9b401a020 con 0x7ff9bc109680 2024-05-14T09:17:51.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.842+0000 7ff9c0a00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9a00b2880 0x7ff9a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:51.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.842+0000 7ff9c0a00700 1 -- 172.21.15.120:0/2051625602 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7ff9b40e1c80 con 0x7ff9bc109680 2024-05-14T09:17:51.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.842+0000 7ff9baa00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9a00b2880 0x7ff9a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:51.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.843+0000 7ff9baa00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9a00b2880 0x7ff9a00b4d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009bf0 tx=0x7ff9ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:51.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:51.845+0000 7ff9c0a00700 1 -- 172.21.15.120:0/2051625602 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff9b4010070 con 0x7ff9bc109680 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.078+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff9bc1a9b70 con 0x7ff9bc109680 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.079+0000 7ff9c0a00700 1 -- 172.21.15.120:0/2051625602 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7ff9b40a9da0 con 0x7ff9bc109680 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:17:52.080 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-05-14T09:17:52.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.082+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9a00b2880 msgr2=0x7ff9a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:52.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.082+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9a00b2880 0x7ff9a00b4d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009bf0 tx=0x7ff9ac009260 comp rx=0 tx=0).stop 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.082+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc109680 msgr2=0x7ff9bc1a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.082+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc109680 0x7ff9bc1a16f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4007ee0 tx=0x7ff9b400d3b0 comp rx=0 tx=0).stop 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 shutdown_connections 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9a00b2880 0x7ff9a00b4d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9bc104400 0x7ff9bc19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9bc109680 0x7ff9bc1a16f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 --2- 172.21.15.120:0/2051625602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9bc108d30 0x7ff9bc19d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 >> 172.21.15.120:0/2051625602 conn(0x7ff9bc079d10 msgr2=0x7ff9bc10f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 shutdown_connections 2024-05-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:52.083+0000 7ff9bbe00700 1 -- 172.21.15.120:0/2051625602 wait complete. 2024-05-14T09:17:52.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:52 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2051625602' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T09:17:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:52 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2051625602' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T09:17:52.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:52 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2051625602' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T09:17:53.054 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T09:17:53.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T09:17:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:17:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:53 smithi120 ceph-mon[31085]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:53 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:17:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:17:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:53 smithi175 ceph-mon[35353]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:53 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:17:53.481 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:53.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:53.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:17:53.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:53.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:53 smithi152 ceph-mon[34868]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:53.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:53 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:17:55.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:55 smithi120 ceph-mon[31085]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:55.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:55 smithi152 ceph-mon[34868]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:55.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:55 smithi175 ceph-mon[35353]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:56.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 -- 172.21.15.120:0/2532471971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 msgr2=0x7f42c0110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:56.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 --2- 172.21.15.120:0/2532471971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c0110df0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42b800b0a0 tx=0x7f42b800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 -- 172.21.15.120:0/2532471971 shutdown_connections 2024-05-14T09:17:56.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 --2- 172.21.15.120:0/2532471971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c0110df0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 --2- 172.21.15.120:0/2532471971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42c01054e0 0x7f42c01058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 --2- 172.21.15.120:0/2532471971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c0105e30 0x7f42c010e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 -- 172.21.15.120:0/2532471971 >> 172.21.15.120:0/2532471971 conn(0x7f42c00fef30 msgr2=0x7f42c0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:56.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 -- 172.21.15.120:0/2532471971 shutdown_connections 2024-05-14T09:17:56.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.211+0000 7f42c5e00700 1 -- 172.21.15.120:0/2532471971 wait complete. 2024-05-14T09:17:56.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 Processor -- start 2024-05-14T09:17:56.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 -- start start 2024-05-14T09:17:56.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c01054e0 0x7f42c01a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:56.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42c0105e30 0x7f42c01a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:56.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:56.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f42c0114370 con 0x7f42c010e910 2024-05-14T09:17:56.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01141f0 con 0x7f42c01054e0 2024-05-14T09:17:56.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.213+0000 7f42c5e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01144f0 con 0x7f42c0105e30 2024-05-14T09:17:56.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:56.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41626/0 (socket says 172.21.15.120:41626) 2024-05-14T09:17:56.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 -- 172.21.15.120:0/1324605927 learned_addr learned my addr 172.21.15.120:0/1324605927 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:17:56.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bea00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c01054e0 0x7f42c01a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42be000700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42c0105e30 0x7f42c01a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 -- 172.21.15.120:0/1324605927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42c0105e30 msgr2=0x7f42c01a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42c0105e30 0x7f42c01a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 -- 172.21.15.120:0/1324605927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c01054e0 msgr2=0x7f42c01a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c01054e0 0x7f42c01a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42bf400700 1 -- 172.21.15.120:0/1324605927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c019b0d0 con 0x7f42c010e910 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.214+0000 7f42be000700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42c0105e30 0x7f42c01a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:17:56.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.215+0000 7f42bf400700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c019aa90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42b8004dc0 tx=0x7f42b8004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:56.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.216+0000 7f42c4a00700 1 -- 172.21.15.120:0/1324605927 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8021070 con 0x7f42c010e910 2024-05-14T09:17:56.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.216+0000 7f42c4a00700 1 -- 172.21.15.120:0/1324605927 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b8007c00 con 0x7f42c010e910 2024-05-14T09:17:56.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.216+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c019b360 con 0x7f42c010e910 2024-05-14T09:17:56.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.216+0000 7f42c4a00700 1 -- 172.21.15.120:0/1324605927 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b80052a0 con 0x7f42c010e910 2024-05-14T09:17:56.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.216+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c019b890 con 0x7f42c010e910 2024-05-14T09:17:56.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.217+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c00512c0 con 0x7f42c010e910 2024-05-14T09:17:56.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.220+0000 7f42c4a00700 1 -- 172.21.15.120:0/1324605927 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f42b8024070 con 0x7f42c010e910 2024-05-14T09:17:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.223+0000 7f42c4a00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42a40b2900 0x7f42a40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:17:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.223+0000 7f42c4a00700 1 -- 172.21.15.120:0/1324605927 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f42b800f020 con 0x7f42c010e910 2024-05-14T09:17:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.223+0000 7f42bea00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42a40b2900 0x7f42a40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:17:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.224+0000 7f42bea00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42a40b2900 0x7f42a40b4e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42c019bbd0 tx=0x7f42b000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:17:56.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.226+0000 7f42c4a00700 1 -- 172.21.15.120:0/1324605927 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f42b802b020 con 0x7f42c010e910 2024-05-14T09:17:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.501+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f42c002e5f0 con 0x7f42c010e910 2024-05-14T09:17:56.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.673+0000 7f42c4a00700 1 -- 172.21.15.120:0/1324605927 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7f42b80aba90 con 0x7f42c010e910 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42a40b2900 msgr2=0x7f42a40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42a40b2900 0x7f42a40b4e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42c019bbd0 tx=0x7f42b000a380 comp rx=0 tx=0).stop 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 msgr2=0x7f42c019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c019aa90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42b8004dc0 tx=0x7f42b8004df0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 shutdown_connections 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42a40b2900 0x7f42a40b4e10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c01054e0 0x7f42c01a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42c010e910 0x7f42c019aa90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 --2- 172.21.15.120:0/1324605927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42c0105e30 0x7f42c01a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:17:56.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 >> 172.21.15.120:0/1324605927 conn(0x7f42c00fef30 msgr2=0x7f42c00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:17:56.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 shutdown_connections 2024-05-14T09:17:56.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:17:56.677+0000 7f42c5e00700 1 -- 172.21.15.120:0/1324605927 wait complete. 2024-05-14T09:17:56.679 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-05-14T09:17:56.759 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.759 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.759 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.759 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.760 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:56 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1324605927' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T09:17:56.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:56 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1324605927' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T09:17:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:56.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:56 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1324605927' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T09:17:57.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1324605927' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: osdmap e73: 12 total, 12 up, 12 in 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:17:57.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:57.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1324605927' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T09:17:57.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: osdmap e73: 12 total, 12 up, 12 in 2024-05-14T09:17:57.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:57.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:17:57.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1324605927' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T09:17:57.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: osdmap e73: 12 total, 12 up, 12 in 2024-05-14T09:17:57.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:57.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:17:57.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:17:57.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:17:58.066 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:17:58.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:58 smithi120 ceph-mon[31085]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T09:17:58.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:58 smithi120 ceph-mon[31085]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T09:17:58.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:58 smithi152 ceph-mon[34868]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T09:17:58.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:58 smithi152 ceph-mon[34868]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T09:17:58.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:58 smithi175 ceph-mon[35353]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T09:17:58.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:58 smithi175 ceph-mon[35353]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T09:17:59.878 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:59 smithi120 ceph-mon[31085]: pgmap v373: 33 pgs: 10 creating+peering, 16 unknown, 7 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:59.878 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:17:59 smithi120 ceph-mon[31085]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T09:17:59.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:59 smithi152 ceph-mon[34868]: pgmap v373: 33 pgs: 10 creating+peering, 16 unknown, 7 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:59.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:17:59 smithi152 ceph-mon[34868]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T09:17:59.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:59 smithi175 ceph-mon[35353]: pgmap v373: 33 pgs: 10 creating+peering, 16 unknown, 7 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:17:59.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:17:59 smithi175 ceph-mon[35353]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T09:18:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 -- 172.21.15.120:0/835243033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70104410 msgr2=0x7fbd70104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 --2- 172.21.15.120:0/835243033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70104410 0x7fbd70104820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbd640099c0 tx=0x7fbd64009cd0 comp rx=0 tx=0).stop 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 -- 172.21.15.120:0/835243033 shutdown_connections 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 --2- 172.21.15.120:0/835243033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd70109690 0x7fbd70110ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 --2- 172.21.15.120:0/835243033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70104410 0x7fbd70104820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 --2- 172.21.15.120:0/835243033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd70108d40 0x7fbd70109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 -- 172.21.15.120:0/835243033 >> 172.21.15.120:0/835243033 conn(0x7fbd70079d50 msgr2=0x7fbd7007a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 -- 172.21.15.120:0/835243033 shutdown_connections 2024-05-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.519+0000 7fbd76400700 1 -- 172.21.15.120:0/835243033 wait complete. 2024-05-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 Processor -- start 2024-05-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 -- start start 2024-05-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd70104410 0x7fbd70075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70108d40 0x7fbd70076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd70109690 0x7fbd70076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70114190 con 0x7fbd70108d40 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70114010 con 0x7fbd70104410 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.521+0000 7fbd76400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70114310 con 0x7fbd70109690 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70108d40 0x7fbd70076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70108d40 0x7fbd70076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45260/0 (socket says 172.21.15.120:45260) 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 -- 172.21.15.120:0/2803575233 learned_addr learned my addr 172.21.15.120:0/2803575233 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd75a00700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd70109690 0x7fbd70076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd75000700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd70104410 0x7fbd70075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 -- 172.21.15.120:0/2803575233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd70109690 msgr2=0x7fbd70076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd70109690 0x7fbd70076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 -- 172.21.15.120:0/2803575233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd70104410 msgr2=0x7fbd70075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd70104410 0x7fbd70075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.522+0000 7fbd6fe00700 1 -- 172.21.15.120:0/2803575233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd701a8f00 con 0x7fbd70108d40 2024-05-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.523+0000 7fbd6fe00700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70108d40 0x7fbd70076000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d950 tx=0x7fbd6000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.523+0000 7fbd6d600700 1 -- 172.21.15.120:0/2803575233 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60017070 con 0x7fbd70108d40 2024-05-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.523+0000 7fbd6d600700 1 -- 172.21.15.120:0/2803575233 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd60005020 con 0x7fbd70108d40 2024-05-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.523+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd701a91f0 con 0x7fbd70108d40 2024-05-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.523+0000 7fbd6d600700 1 -- 172.21.15.120:0/2803575233 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000f980 con 0x7fbd70108d40 2024-05-14T09:18:00.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.523+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd701a96e0 con 0x7fbd70108d40 2024-05-14T09:18:00.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.524+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7006a620 con 0x7fbd70108d40 2024-05-14T09:18:00.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.527+0000 7fbd6d600700 1 -- 172.21.15.120:0/2803575233 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fbd60004a30 con 0x7fbd70108d40 2024-05-14T09:18:00.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.529+0000 7fbd6d600700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd580b2880 0x7fbd580b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:00.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.529+0000 7fbd6d600700 1 -- 172.21.15.120:0/2803575233 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7fbd600e1b30 con 0x7fbd70108d40 2024-05-14T09:18:00.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.529+0000 7fbd75000700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd580b2880 0x7fbd580b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:00.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.530+0000 7fbd75000700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd580b2880 0x7fbd580b4d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd640058e0 tx=0x7fbd64005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:00.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.532+0000 7fbd6d600700 1 -- 172.21.15.120:0/2803575233 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbd600a9ae0 con 0x7fbd70108d40 2024-05-14T09:18:00.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:00.767+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fbd7002e710 con 0x7fbd70108d40 2024-05-14T09:18:01.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.724+0000 7fbd6d600700 1 -- 172.21.15.120:0/2803575233 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v76) ==== 171+0+0 (secure 0 0 0) 0x7fbd600a93e0 con 0x7fbd70108d40 2024-05-14T09:18:01.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd580b2880 msgr2=0x7fbd580b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:01.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd580b2880 0x7fbd580b4d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd640058e0 tx=0x7fbd64005fb0 comp rx=0 tx=0).stop 2024-05-14T09:18:01.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70108d40 msgr2=0x7fbd70076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:01.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70108d40 0x7fbd70076000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d950 tx=0x7fbd6000dc60 comp rx=0 tx=0).stop 2024-05-14T09:18:01.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 shutdown_connections 2024-05-14T09:18:01.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbd580b2880 0x7fbd580b4d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:01.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd70104410 0x7fbd70075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:01.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd70109690 0x7fbd70076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:01.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 --2- 172.21.15.120:0/2803575233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd70108d40 0x7fbd70076000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:01.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.729+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 >> 172.21.15.120:0/2803575233 conn(0x7fbd70079d50 msgr2=0x7fbd70102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:01.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.730+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 shutdown_connections 2024-05-14T09:18:01.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:01.730+0000 7fbd76400700 1 -- 172.21.15.120:0/2803575233 wait complete. 2024-05-14T09:18:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-05-14T09:18:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:01 smithi175 ceph-mon[35353]: pgmap v375: 33 pgs: 10 creating+peering, 4 unknown, 19 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:01 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2803575233' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-14T09:18:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:01 smithi120 ceph-mon[31085]: pgmap v375: 33 pgs: 10 creating+peering, 4 unknown, 19 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:01 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2803575233' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-14T09:18:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:01 smithi152 ceph-mon[34868]: pgmap v375: 33 pgs: 10 creating+peering, 4 unknown, 19 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:01 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2803575233' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-14T09:18:02.634 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T09:18:02.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:02 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2803575233' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-14T09:18:02.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:02 smithi120 ceph-mon[31085]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T09:18:03.102 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:03.110 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:02 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2803575233' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-14T09:18:03.110 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:02 smithi152 ceph-mon[34868]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T09:18:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:02 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2803575233' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-14T09:18:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:02 smithi175 ceph-mon[35353]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T09:18:03.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:03 smithi120 ceph-mon[31085]: pgmap v377: 97 pgs: 51 unknown, 15 creating+peering, 31 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:03.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:03 smithi120 ceph-mon[31085]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T09:18:04.144 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:03 smithi152 ceph-mon[34868]: pgmap v377: 97 pgs: 51 unknown, 15 creating+peering, 31 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:04.144 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:03 smithi152 ceph-mon[34868]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T09:18:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:03 smithi175 ceph-mon[35353]: pgmap v377: 97 pgs: 51 unknown, 15 creating+peering, 31 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:03 smithi175 ceph-mon[35353]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T09:18:04.872 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:04 smithi120 ceph-mon[31085]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T09:18:05.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:04 smithi152 ceph-mon[34868]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T09:18:05.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 -- 172.21.15.120:0/3052164191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10a990 msgr2=0x7fcb5c10ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 --2- 172.21.15.120:0/3052164191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10a990 0x7fcb5c10ada0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009990 tx=0x7fcb48009ca0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 -- 172.21.15.120:0/3052164191 shutdown_connections 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 --2- 172.21.15.120:0/3052164191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb5c10b2e0 0x7fcb5c117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 --2- 172.21.15.120:0/3052164191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c110970 0x7fcb5c110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 --2- 172.21.15.120:0/3052164191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10a990 0x7fcb5c10ada0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 -- 172.21.15.120:0/3052164191 >> 172.21.15.120:0/3052164191 conn(0x7fcb5c077c80 msgr2=0x7fcb5c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 -- 172.21.15.120:0/3052164191 shutdown_connections 2024-05-14T09:18:05.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.223+0000 7fcb62e00700 1 -- 172.21.15.120:0/3052164191 wait complete. 2024-05-14T09:18:05.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.224+0000 7fcb62e00700 1 Processor -- start 2024-05-14T09:18:05.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.224+0000 7fcb62e00700 1 -- start start 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb62e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb5c10a990 0x7fcb5c1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb62e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10b2e0 0x7fcb5c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb62e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c110970 0x7fcb5c1a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb62e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c11a940 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb62e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c11a7c0 con 0x7fcb5c10a990 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb62e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c11aac0 con 0x7fcb5c110970 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb5b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10b2e0 0x7fcb5c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb5b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10b2e0 0x7fcb5c1a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45280/0 (socket says 172.21.15.120:45280) 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb5b400700 1 -- 172.21.15.120:0/2806715584 learned_addr learned my addr 172.21.15.120:0/2806715584 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb5be00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb5c10a990 0x7fcb5c1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:05.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.225+0000 7fcb60e00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c110970 0x7fcb5c1a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:05.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.226+0000 7fcb5b400700 1 -- 172.21.15.120:0/2806715584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c110970 msgr2=0x7fcb5c1a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.226+0000 7fcb5b400700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c110970 0x7fcb5c1a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.226+0000 7fcb5b400700 1 -- 172.21.15.120:0/2806715584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb5c10a990 msgr2=0x7fcb5c1a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.226+0000 7fcb5b400700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb5c10a990 0x7fcb5c1a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.226+0000 7fcb5b400700 1 -- 172.21.15.120:0/2806715584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c1a6190 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.226+0000 7fcb5b400700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10b2e0 0x7fcb5c1a1910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb48006010 tx=0x7fcb480057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.227+0000 7fcb58c00700 1 -- 172.21.15.120:0/2806715584 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48027070 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.227+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c1a6420 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.227+0000 7fcb58c00700 1 -- 172.21.15.120:0/2806715584 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb4800fb00 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.227+0000 7fcb58c00700 1 -- 172.21.15.120:0/2806715584 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48022b50 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.227+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c1a6900 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:04 smithi175 ceph-mon[35353]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T09:18:05.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.228+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c0512c0 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.231+0000 7fcb58c00700 1 -- 172.21.15.120:0/2806715584 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fcb4802a070 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.233+0000 7fcb58c00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcb400b2880 0x7fcb400b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:05.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.234+0000 7fcb58c00700 1 -- 172.21.15.120:0/2806715584 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7fcb480e3480 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.234+0000 7fcb5be00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcb400b2880 0x7fcb400b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:05.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.234+0000 7fcb5be00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcb400b2880 0x7fcb400b4d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c07d0f0 tx=0x7fcb4c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:05.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.237+0000 7fcb58c00700 1 -- 172.21.15.120:0/2806715584 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcb48013070 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.514+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcb5c02e5f0 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.774+0000 7fcb58c00700 1 -- 172.21.15.120:0/2806715584 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fcb480ab340 con 0x7fcb5c10b2e0 2024-05-14T09:18:05.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.781+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcb400b2880 msgr2=0x7fcb400b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:05.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.781+0000 7fcb62e00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcb400b2880 0x7fcb400b4d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c07d0f0 tx=0x7fcb4c00a380 comp rx=0 tx=0).stop 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.781+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10b2e0 msgr2=0x7fcb5c1a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.781+0000 7fcb62e00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10b2e0 0x7fcb5c1a1910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb48006010 tx=0x7fcb480057c0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.781+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 shutdown_connections 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.782+0000 7fcb62e00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcb400b2880 0x7fcb400b4d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.782+0000 7fcb62e00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb5c10a990 0x7fcb5c1a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.782+0000 7fcb62e00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c110970 0x7fcb5c1a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.782+0000 7fcb62e00700 1 --2- 172.21.15.120:0/2806715584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb5c10b2e0 0x7fcb5c1a1910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.782+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 >> 172.21.15.120:0/2806715584 conn(0x7fcb5c077c80 msgr2=0x7fcb5c07b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.783+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 shutdown_connections 2024-05-14T09:18:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:05.783+0000 7fcb62e00700 1 -- 172.21.15.120:0/2806715584 wait complete. 2024-05-14T09:18:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 2 and data pool 3 2024-05-14T09:18:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:05 smithi120 ceph-mon[31085]: pgmap v380: 97 pgs: 20 unknown, 29 creating+peering, 48 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:06.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:05 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2806715584' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T09:18:06.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:05 smithi120 ceph-mon[31085]: daemon mds.h assigned to filesystem cephfs as rank 0 2024-05-14T09:18:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:05 smithi152 ceph-mon[34868]: pgmap v380: 97 pgs: 20 unknown, 29 creating+peering, 48 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:05 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2806715584' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T09:18:06.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:05 smithi152 ceph-mon[34868]: daemon mds.h assigned to filesystem cephfs as rank 0 2024-05-14T09:18:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:05 smithi175 ceph-mon[35353]: pgmap v380: 97 pgs: 20 unknown, 29 creating+peering, 48 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:05 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2806715584' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T09:18:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:05 smithi175 ceph-mon[35353]: daemon mds.h assigned to filesystem cephfs as rank 0 2024-05-14T09:18:06.725 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-14T09:18:06.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-14T09:18:07.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:06 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2806715584' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T09:18:07.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:06 smithi120 ceph-mon[31085]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T09:18:07.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:06 smithi120 ceph-mon[31085]: fsmap cephfs:1 {0=h=up:creating} 11 up:standby 2024-05-14T09:18:07.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:06 smithi120 ceph-mon[31085]: daemon mds.h is now active in filesystem cephfs as rank 0 2024-05-14T09:18:07.187 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:07.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:06 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2806715584' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T09:18:07.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:06 smithi152 ceph-mon[34868]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T09:18:07.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:06 smithi152 ceph-mon[34868]: fsmap cephfs:1 {0=h=up:creating} 11 up:standby 2024-05-14T09:18:07.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:06 smithi152 ceph-mon[34868]: daemon mds.h is now active in filesystem cephfs as rank 0 2024-05-14T09:18:07.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:06 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2806715584' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T09:18:07.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:06 smithi175 ceph-mon[35353]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T09:18:07.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:06 smithi175 ceph-mon[35353]: fsmap cephfs:1 {0=h=up:creating} 11 up:standby 2024-05-14T09:18:07.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:06 smithi175 ceph-mon[35353]: daemon mds.h is now active in filesystem cephfs as rank 0 2024-05-14T09:18:08.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:07 smithi120 ceph-mon[31085]: pgmap v382: 97 pgs: 29 creating+peering, 68 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:08.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:07 smithi120 ceph-mon[31085]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T09:18:08.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:07 smithi120 ceph-mon[31085]: Cluster is now healthy 2024-05-14T09:18:08.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:07 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] up:active 2024-05-14T09:18:08.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:07 smithi120 ceph-mon[31085]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:08.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:07 smithi120 ceph-mon[31085]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:08.208 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:18:07 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:18:07.875+0000 7f6fc5800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T09:18:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:07 smithi152 ceph-mon[34868]: pgmap v382: 97 pgs: 29 creating+peering, 68 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:07 smithi152 ceph-mon[34868]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T09:18:08.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:07 smithi152 ceph-mon[34868]: Cluster is now healthy 2024-05-14T09:18:08.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:07 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] up:active 2024-05-14T09:18:08.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:07 smithi152 ceph-mon[34868]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:08.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:07 smithi152 ceph-mon[34868]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:07 smithi175 ceph-mon[35353]: pgmap v382: 97 pgs: 29 creating+peering, 68 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:07 smithi175 ceph-mon[35353]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T09:18:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:07 smithi175 ceph-mon[35353]: Cluster is now healthy 2024-05-14T09:18:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:07 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] up:active 2024-05-14T09:18:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:07 smithi175 ceph-mon[35353]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:07 smithi175 ceph-mon[35353]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:09.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.451+0000 7f7046600700 1 -- 172.21.15.120:0/848841458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7040105290 msgr2=0x7f70401056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.451+0000 7f7046600700 1 --2- 172.21.15.120:0/848841458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7040105290 0x7f70401056a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7034009990 tx=0x7f7034009ca0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.452+0000 7f7046600700 1 -- 172.21.15.120:0/848841458 shutdown_connections 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.452+0000 7f7046600700 1 --2- 172.21.15.120:0/848841458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f704010e700 0x7f7040110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.452+0000 7f7046600700 1 --2- 172.21.15.120:0/848841458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7040105290 0x7f70401056a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.452+0000 7f7046600700 1 --2- 172.21.15.120:0/848841458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7040105be0 0x7f704010e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.452+0000 7f7046600700 1 -- 172.21.15.120:0/848841458 >> 172.21.15.120:0/848841458 conn(0x7f7040078ac0 msgr2=0x7f7040078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.452+0000 7f7046600700 1 -- 172.21.15.120:0/848841458 shutdown_connections 2024-05-14T09:18:09.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.452+0000 7f7046600700 1 -- 172.21.15.120:0/848841458 wait complete. 2024-05-14T09:18:09.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 Processor -- start 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 -- start start 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7040105290 0x7f7040102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7040105be0 0x7f70401034c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f704010e700 0x7f7040103a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7040114100 con 0x7f704010e700 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7040113f80 con 0x7f7040105290 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.453+0000 7f7046600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7040114280 con 0x7f7040105be0 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f704010e700 0x7f7040103a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f704010e700 0x7f7040103a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52822/0 (socket says 172.21.15.120:52822) 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 -- 172.21.15.120:0/1688173954 learned_addr learned my addr 172.21.15.120:0/1688173954 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045200700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7040105290 0x7f7040102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f703fe00700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7040105be0 0x7f70401034c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 -- 172.21.15.120:0/1688173954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7040105be0 msgr2=0x7f70401034c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7040105be0 0x7f70401034c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 -- 172.21.15.120:0/1688173954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7040105290 msgr2=0x7f7040102f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7040105290 0x7f7040102f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045c00700 1 -- 172.21.15.120:0/1688173954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70401a8ef0 con 0x7f704010e700 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f703fe00700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7040105be0 0x7f70401034c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:18:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.454+0000 7f7045200700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7040105290 0x7f7040102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:18:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.455+0000 7f7045c00700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f704010e700 0x7f7040103a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7038007ee0 tx=0x7f703800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.455+0000 7f703d600700 1 -- 172.21.15.120:0/1688173954 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703800dbd0 con 0x7f704010e700 2024-05-14T09:18:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.455+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70401a91e0 con 0x7f704010e700 2024-05-14T09:18:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.455+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401a9720 con 0x7f704010e700 2024-05-14T09:18:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.455+0000 7f703d600700 1 -- 172.21.15.120:0/1688173954 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f703800dd70 con 0x7f704010e700 2024-05-14T09:18:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.455+0000 7f703d600700 1 -- 172.21.15.120:0/1688173954 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380058d0 con 0x7f704010e700 2024-05-14T09:18:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.456+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7020005330 con 0x7f704010e700 2024-05-14T09:18:09.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.459+0000 7f703d600700 1 -- 172.21.15.120:0/1688173954 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f703801a020 con 0x7f704010e700 2024-05-14T09:18:09.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.462+0000 7f703d600700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70280b2900 0x7f70280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:09.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.462+0000 7f7045200700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70280b2900 0x7f70280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:09.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.462+0000 7f703d600700 1 -- 172.21.15.120:0/1688173954 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f70380e1e40 con 0x7f704010e700 2024-05-14T09:18:09.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.463+0000 7f7045200700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70280b2900 0x7f70280b4e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f70340098e0 tx=0x7f703400b580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:09.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.464+0000 7f703d600700 1 -- 172.21.15.120:0/1688173954 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7038010070 con 0x7f704010e700 2024-05-14T09:18:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.703+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7020005620 con 0x7f704010e700 2024-05-14T09:18:09.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.801+0000 7f703d600700 1 -- 172.21.15.120:0/1688173954 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) ==== 157+0+0 (secure 0 0 0) 0x7f70380a9c10 con 0x7f704010e700 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.805+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70280b2900 msgr2=0x7f70280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.805+0000 7f7046600700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70280b2900 0x7f70280b4e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f70340098e0 tx=0x7f703400b580 comp rx=0 tx=0).stop 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.805+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f704010e700 msgr2=0x7f7040103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.805+0000 7f7046600700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f704010e700 0x7f7040103a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7038007ee0 tx=0x7f703800d3b0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 shutdown_connections 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70280b2900 0x7f70280b4e10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7040105290 0x7f7040102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f704010e700 0x7f7040103a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 --2- 172.21.15.120:0/1688173954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7040105be0 0x7f70401034c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:09.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 >> 172.21.15.120:0/1688173954 conn(0x7f7040078ac0 msgr2=0x7f7040100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:09.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 shutdown_connections 2024-05-14T09:18:09.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:09.806+0000 7f7046600700 1 -- 172.21.15.120:0/1688173954 wait complete. 2024-05-14T09:18:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:09 smithi120 ceph-mon[31085]: pgmap v383: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-05-14T09:18:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:09 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1688173954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-14T09:18:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:09 smithi152 ceph-mon[34868]: pgmap v383: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-05-14T09:18:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:09 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1688173954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-14T09:18:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:09 smithi175 ceph-mon[35353]: pgmap v383: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-05-14T09:18:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:09 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1688173954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-14T09:18:10.700 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T09:18:11.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:10 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1688173954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-14T09:18:11.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:10 smithi120 ceph-mon[31085]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T09:18:11.153 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:11.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:10 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1688173954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-14T09:18:11.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:10 smithi152 ceph-mon[34868]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T09:18:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:10 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1688173954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-14T09:18:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:10 smithi175 ceph-mon[35353]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T09:18:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:11 smithi120 ceph-mon[31085]: pgmap v385: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:11 smithi152 ceph-mon[34868]: pgmap v385: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:11 smithi175 ceph-mon[35353]: pgmap v385: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:13.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 -- 172.21.15.120:0/1046988473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc0109870 msgr2=0x7efcc01111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:13.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 --2- 172.21.15.120:0/1046988473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc0109870 0x7efcc01111d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efcb800b0d0 tx=0x7efcb800b3e0 comp rx=0 tx=0).stop 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 -- 172.21.15.120:0/1046988473 shutdown_connections 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 --2- 172.21.15.120:0/1046988473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcc01045f0 0x7efcc0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 --2- 172.21.15.120:0/1046988473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc0109870 0x7efcc01111d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 --2- 172.21.15.120:0/1046988473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc0108f20 0x7efcc0109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 -- 172.21.15.120:0/1046988473 >> 172.21.15.120:0/1046988473 conn(0x7efcc0100040 msgr2=0x7efcc0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 -- 172.21.15.120:0/1046988473 shutdown_connections 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.554+0000 7efcc6e00700 1 -- 172.21.15.120:0/1046988473 wait complete. 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.556+0000 7efcc6e00700 1 Processor -- start 2024-05-14T09:18:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.556+0000 7efcc6e00700 1 -- start start 2024-05-14T09:18:13.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcc6e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc01045f0 0x7efcc019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:13.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcc6e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc0108f20 0x7efcc019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:13.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcc6e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcc0109870 0x7efcc019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:13.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcc6e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efcc01143a0 con 0x7efcc01045f0 2024-05-14T09:18:13.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcc6e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0114220 con 0x7efcc0109870 2024-05-14T09:18:13.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcc6e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0114520 con 0x7efcc0108f20 2024-05-14T09:18:13.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcbfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc01045f0 0x7efcc019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:13.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcbfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc01045f0 0x7efcc019ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52842/0 (socket says 172.21.15.120:52842) 2024-05-14T09:18:13.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcbfe00700 1 -- 172.21.15.120:0/4074155173 learned_addr learned my addr 172.21.15.120:0/4074155173 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:13.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcbf400700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc0108f20 0x7efcc019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:13.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.557+0000 7efcc4e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcc0109870 0x7efcc019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:13.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbfe00700 1 -- 172.21.15.120:0/4074155173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc0108f20 msgr2=0x7efcc019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:13.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbfe00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc0108f20 0x7efcc019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:13.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbfe00700 1 -- 172.21.15.120:0/4074155173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcc0109870 msgr2=0x7efcc019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:13.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbfe00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcc0109870 0x7efcc019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:13.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbfe00700 1 -- 172.21.15.120:0/4074155173 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc019fc40 con 0x7efcc01045f0 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcc4e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcc0109870 0x7efcc019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbfe00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc01045f0 0x7efcc019ad70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d980 tx=0x7efcb000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbcc00700 1 -- 172.21.15.120:0/4074155173 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0016070 con 0x7efcc01045f0 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbcc00700 1 -- 172.21.15.120:0/4074155173 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcb0004020 con 0x7efcc01045f0 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc019ff30 con 0x7efcc01045f0 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcbcc00700 1 -- 172.21.15.120:0/4074155173 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0004bb0 con 0x7efcc01045f0 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.558+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc01a7850 con 0x7efcc01045f0 2024-05-14T09:18:13.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.560+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc00512c0 con 0x7efcc01045f0 2024-05-14T09:18:13.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.564+0000 7efcbcc00700 1 -- 172.21.15.120:0/4074155173 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7efcb000bb60 con 0x7efcc01045f0 2024-05-14T09:18:13.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.565+0000 7efcbcc00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efca40b2880 0x7efca40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:13.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.566+0000 7efcbcc00700 1 -- 172.21.15.120:0/4074155173 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8277+0+0 (secure 0 0 0) 0x7efcb00e2640 con 0x7efcc01045f0 2024-05-14T09:18:13.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.566+0000 7efcbf400700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efca40b2880 0x7efca40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:13.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.566+0000 7efcbf400700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efca40b2880 0x7efca40b4d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efcac005950 tx=0x7efcac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:13.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.568+0000 7efcbcc00700 1 -- 172.21.15.120:0/4074155173 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efcb001f020 con 0x7efcc01045f0 2024-05-14T09:18:13.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:13.802+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efcc002e5f0 con 0x7efcc01045f0 2024-05-14T09:18:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:13 smithi120 ceph-mon[31085]: pgmap v386: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:13 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4074155173' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T09:18:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:13 smithi152 ceph-mon[34868]: pgmap v386: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:13 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4074155173' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T09:18:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:13 smithi175 ceph-mon[35353]: pgmap v386: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:13 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4074155173' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T09:18:14.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.845+0000 7efcbcc00700 1 -- 172.21.15.120:0/4074155173 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) ==== 228+0+0 (secure 0 0 0) 0x7efcb00aa2d0 con 0x7efcc01045f0 2024-05-14T09:18:14.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efca40b2880 msgr2=0x7efca40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:14.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efca40b2880 0x7efca40b4d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efcac005950 tx=0x7efcac0058e0 comp rx=0 tx=0).stop 2024-05-14T09:18:14.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc01045f0 msgr2=0x7efcc019ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:14.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc01045f0 0x7efcc019ad70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d980 tx=0x7efcb000dd40 comp rx=0 tx=0).stop 2024-05-14T09:18:14.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 shutdown_connections 2024-05-14T09:18:14.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efca40b2880 0x7efca40b4d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:14.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcc0109870 0x7efcc019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:14.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcc01045f0 0x7efcc019ad70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:14.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 --2- 172.21.15.120:0/4074155173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc0108f20 0x7efcc019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:14.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.851+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 >> 172.21.15.120:0/4074155173 conn(0x7efcc0100040 msgr2=0x7efcc0108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:14.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.852+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 shutdown_connections 2024-05-14T09:18:14.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:14.852+0000 7efcc6e00700 1 -- 172.21.15.120:0/4074155173 wait complete. 2024-05-14T09:18:14.854 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data_ec' created 2024-05-14T09:18:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:14 smithi120 ceph-mon[31085]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T09:18:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:14 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4074155173' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T09:18:15.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:14 smithi120 ceph-mon[31085]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T09:18:15.192 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:14 smithi152 ceph-mon[34868]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T09:18:15.192 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:14 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4074155173' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T09:18:15.192 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:14 smithi152 ceph-mon[34868]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T09:18:15.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:14 smithi175 ceph-mon[35353]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T09:18:15.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:14 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4074155173' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T09:18:15.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:14 smithi175 ceph-mon[35353]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T09:18:15.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-14T09:18:16.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:15 smithi120 ceph-mon[31085]: pgmap v388: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:16.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:15 smithi120 ceph-mon[31085]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T09:18:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:15 smithi152 ceph-mon[34868]: pgmap v388: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:15 smithi152 ceph-mon[34868]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T09:18:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:15 smithi175 ceph-mon[35353]: pgmap v388: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T09:18:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:15 smithi175 ceph-mon[35353]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T09:18:16.254 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:18.111 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:17 smithi120 ceph-mon[31085]: pgmap v391: 129 pgs: 5 creating+peering, 27 unknown, 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-14T09:18:18.112 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:17 smithi120 ceph-mon[31085]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T09:18:18.112 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:17 smithi120 ceph-mon[31085]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T09:18:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:17 smithi152 ceph-mon[34868]: pgmap v391: 129 pgs: 5 creating+peering, 27 unknown, 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-14T09:18:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:17 smithi152 ceph-mon[34868]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T09:18:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:17 smithi152 ceph-mon[34868]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T09:18:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:17 smithi175 ceph-mon[35353]: pgmap v391: 129 pgs: 5 creating+peering, 27 unknown, 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-14T09:18:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:17 smithi175 ceph-mon[35353]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T09:18:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:17 smithi175 ceph-mon[35353]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T09:18:18.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 -- 172.21.15.120:0/1455271286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410b2e0 msgr2=0x7f9764117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 --2- 172.21.15.120:0/1455271286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410b2e0 0x7f9764117810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f975c00b0a0 tx=0x7f975c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 -- 172.21.15.120:0/1455271286 shutdown_connections 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 --2- 172.21.15.120:0/1455271286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410b2e0 0x7f9764117810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 --2- 172.21.15.120:0/1455271286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9764110970 0x7f9764110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 --2- 172.21.15.120:0/1455271286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f976410a990 0x7f976410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 -- 172.21.15.120:0/1455271286 >> 172.21.15.120:0/1455271286 conn(0x7f9764077c80 msgr2=0x7f97640780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 -- 172.21.15.120:0/1455271286 shutdown_connections 2024-05-14T09:18:18.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.459+0000 7f9769a00700 1 -- 172.21.15.120:0/1455271286 wait complete. 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 Processor -- start 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 -- start start 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410a990 0x7f97641a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f976410b2e0 0x7f97641a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9764110970 0x7f97641a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f976411a960 con 0x7f976410a990 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f976411a7e0 con 0x7f9764110970 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9769a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f976411aae0 con 0x7f976410b2e0 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.461+0000 7f9762a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410a990 0x7f97641a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:18.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410a990 0x7f97641a1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54544/0 (socket says 172.21.15.120:54544) 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 -- 172.21.15.120:0/346139447 learned_addr learned my addr 172.21.15.120:0/346139447 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762000700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f976410b2e0 0x7f97641a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9763400700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9764110970 0x7f97641a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 -- 172.21.15.120:0/346139447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f976410b2e0 msgr2=0x7f97641a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f976410b2e0 0x7f97641a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 -- 172.21.15.120:0/346139447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9764110970 msgr2=0x7f97641a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9764110970 0x7f97641a5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 -- 172.21.15.120:0/346139447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97641a6220 con 0x7f976410a990 2024-05-14T09:18:18.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.462+0000 7f9762a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410a990 0x7f97641a1350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f975400d950 tx=0x7f975400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:18.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.463+0000 7f975b400700 1 -- 172.21.15.120:0/346139447 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754017070 con 0x7f976410a990 2024-05-14T09:18:18.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.463+0000 7f975b400700 1 -- 172.21.15.120:0/346139447 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f975400de30 con 0x7f976410a990 2024-05-14T09:18:18.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.463+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97641a6510 con 0x7f976410a990 2024-05-14T09:18:18.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.463+0000 7f975b400700 1 -- 172.21.15.120:0/346139447 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754005310 con 0x7f976410a990 2024-05-14T09:18:18.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.463+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97641ade30 con 0x7f976410a990 2024-05-14T09:18:18.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.464+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976410c080 con 0x7f976410a990 2024-05-14T09:18:18.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.468+0000 7f975b400700 1 -- 172.21.15.120:0/346139447 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f9754004750 con 0x7f976410a990 2024-05-14T09:18:18.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.470+0000 7f975b400700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97480b2880 0x7f97480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:18.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.470+0000 7f975b400700 1 -- 172.21.15.120:0/346139447 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7f97540e2100 con 0x7f976410a990 2024-05-14T09:18:18.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.470+0000 7f9762000700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97480b2880 0x7f97480b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:18.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.471+0000 7f9762000700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97480b2880 0x7f97480b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9750005950 tx=0x7f97500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:18.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.474+0000 7f975b400700 1 -- 172.21.15.120:0/346139447 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f97540a9ba0 con 0x7f976410a990 2024-05-14T09:18:18.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.706+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f97641a26b0 con 0x7f976410a990 2024-05-14T09:18:18.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.870+0000 7f975b400700 1 -- 172.21.15.120:0/346139447 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7f97540a94a0 con 0x7f976410a990 2024-05-14T09:18:18.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97480b2880 msgr2=0x7f97480b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:18.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97480b2880 0x7f97480b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9750005950 tx=0x7f97500058e0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410a990 msgr2=0x7f97641a1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:18.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410a990 0x7f97641a1350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f975400d950 tx=0x7f975400dd10 comp rx=0 tx=0).stop 2024-05-14T09:18:18.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 shutdown_connections 2024-05-14T09:18:18.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97480b2880 0x7f97480b4d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9764110970 0x7f97641a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f976410a990 0x7f97641a1350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 --2- 172.21.15.120:0/346139447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f976410b2e0 0x7f97641a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:18.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.876+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 >> 172.21.15.120:0/346139447 conn(0x7f9764077c80 msgr2=0x7f976407b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:18.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.877+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 shutdown_connections 2024-05-14T09:18:18.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:18.877+0000 7f9769a00700 1 -- 172.21.15.120:0/346139447 wait complete. 2024-05-14T09:18:18.878 INFO:teuthology.orchestra.run.smithi120.stderr:set pool 4 allow_ec_overwrites to true 2024-05-14T09:18:19.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:18 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/346139447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-14T09:18:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:18 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/346139447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-14T09:18:19.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:18 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/346139447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-14T09:18:19.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-14T09:18:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:19 smithi120 ceph-mon[31085]: pgmap v393: 129 pgs: 5 creating+peering, 11 unknown, 113 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:19 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/346139447' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-14T09:18:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:19 smithi120 ceph-mon[31085]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T09:18:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:19 smithi152 ceph-mon[34868]: pgmap v393: 129 pgs: 5 creating+peering, 11 unknown, 113 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:19 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/346139447' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-14T09:18:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:19 smithi152 ceph-mon[34868]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T09:18:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:19 smithi175 ceph-mon[35353]: pgmap v393: 129 pgs: 5 creating+peering, 11 unknown, 113 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:19 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/346139447' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-14T09:18:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:19 smithi175 ceph-mon[35353]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T09:18:22.052 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:21 smithi120 ceph-mon[31085]: pgmap v395: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:21 smithi152 ceph-mon[34868]: pgmap v395: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:21 smithi175 ceph-mon[35353]: pgmap v395: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:22.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 -- 172.21.15.120:0/2249888952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c10c5c0 msgr2=0x7fea6c10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 --2- 172.21.15.120:0/2249888952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c10c5c0 0x7fea6c10c9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009990 tx=0x7fea5c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 -- 172.21.15.120:0/2249888952 shutdown_connections 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 --2- 172.21.15.120:0/2249888952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea6c106ed0 0x7fea6c113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 --2- 172.21.15.120:0/2249888952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c10c5c0 0x7fea6c10c9d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 --2- 172.21.15.120:0/2249888952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6c106580 0x7fea6c106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 -- 172.21.15.120:0/2249888952 >> 172.21.15.120:0/2249888952 conn(0x7fea6c102080 msgr2=0x7fea6c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 -- 172.21.15.120:0/2249888952 shutdown_connections 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.422+0000 7fea72600700 1 -- 172.21.15.120:0/2249888952 wait complete. 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.423+0000 7fea72600700 1 Processor -- start 2024-05-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.423+0000 7fea72600700 1 -- start start 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.423+0000 7fea72600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea6c106580 0x7fea6c19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea72600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c106ed0 0x7fea6c19d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea72600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6c10c5c0 0x7fea6c1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea72600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c116590 con 0x7fea6c106ed0 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea72600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c116410 con 0x7fea6c10c5c0 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea72600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c116710 con 0x7fea6c106580 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c106ed0 0x7fea6c19d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c106ed0 0x7fea6c19d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54558/0 (socket says 172.21.15.120:54558) 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 -- 172.21.15.120:0/4177658254 learned_addr learned my addr 172.21.15.120:0/4177658254 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6be00700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6c10c5c0 0x7fea6c1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6b400700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea6c106580 0x7fea6c19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 -- 172.21.15.120:0/4177658254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea6c106580 msgr2=0x7fea6c19cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea6c106580 0x7fea6c19cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 -- 172.21.15.120:0/4177658254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6c10c5c0 msgr2=0x7fea6c1a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6c10c5c0 0x7fea6c1a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.424+0000 7fea6aa00700 1 -- 172.21.15.120:0/4177658254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c1a1e20 con 0x7fea6c106ed0 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.425+0000 7fea6aa00700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c106ed0 0x7fea6c19d540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea5800d950 tx=0x7fea5800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.425+0000 7fea63e00700 1 -- 172.21.15.120:0/4177658254 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58016070 con 0x7fea6c106ed0 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.425+0000 7fea63e00700 1 -- 172.21.15.120:0/4177658254 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea5800de30 con 0x7fea6c106ed0 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.425+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c1a2110 con 0x7fea6c106ed0 2024-05-14T09:18:22.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.425+0000 7fea63e00700 1 -- 172.21.15.120:0/4177658254 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58005280 con 0x7fea6c106ed0 2024-05-14T09:18:22.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.425+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6c1a9a30 con 0x7fea6c106ed0 2024-05-14T09:18:22.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.426+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea6c0512c0 con 0x7fea6c106ed0 2024-05-14T09:18:22.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.430+0000 7fea63e00700 1 -- 172.21.15.120:0/4177658254 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fea58005420 con 0x7fea6c106ed0 2024-05-14T09:18:22.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.431+0000 7fea63e00700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea500b2900 0x7fea500b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:22.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.431+0000 7fea63e00700 1 -- 172.21.15.120:0/4177658254 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7fea580e2120 con 0x7fea6c106ed0 2024-05-14T09:18:22.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.432+0000 7fea6b400700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea500b2900 0x7fea500b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:22.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.432+0000 7fea6b400700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea500b2900 0x7fea500b4e10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea5c006010 tx=0x7fea5c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:22.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.434+0000 7fea63e00700 1 -- 172.21.15.120:0/4177658254 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fea5801f070 con 0x7fea6c106ed0 2024-05-14T09:18:22.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:22.720+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fea6c02e5f0 con 0x7fea6c106ed0 2024-05-14T09:18:23.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.551+0000 7fea63e00700 1 -- 172.21.15.120:0/4177658254 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fea580a9bc0 con 0x7fea6c106ed0 2024-05-14T09:18:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea500b2900 msgr2=0x7fea500b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea500b2900 0x7fea500b4e10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea5c006010 tx=0x7fea5c00b540 comp rx=0 tx=0).stop 2024-05-14T09:18:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c106ed0 msgr2=0x7fea6c19d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c106ed0 0x7fea6c19d540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea5800d950 tx=0x7fea5800dd10 comp rx=0 tx=0).stop 2024-05-14T09:18:23.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 shutdown_connections 2024-05-14T09:18:23.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea500b2900 0x7fea500b4e10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6c10c5c0 0x7fea6c1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea6c106580 0x7fea6c19cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 --2- 172.21.15.120:0/4177658254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea6c106ed0 0x7fea6c19d540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.555+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 >> 172.21.15.120:0/4177658254 conn(0x7fea6c102080 msgr2=0x7fea6c104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.556+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 shutdown_connections 2024-05-14T09:18:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:23.556+0000 7fea72600700 1 -- 172.21.15.120:0/4177658254 wait complete. 2024-05-14T09:18:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:added data pool 4 to fsmap 2024-05-14T09:18:23.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:23 smithi120 ceph-mon[31085]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:23.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:23 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4177658254' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-14T09:18:23.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:23 smithi120 ceph-mon[31085]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T09:18:23.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:23 smithi152 ceph-mon[34868]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:23 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4177658254' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-14T09:18:23.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:23 smithi152 ceph-mon[34868]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T09:18:23.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:23 smithi175 ceph-mon[35353]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:23.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:23 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4177658254' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-14T09:18:23.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:23 smithi175 ceph-mon[35353]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T09:18:24.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:18:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:24 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4177658254' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-14T09:18:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:24 smithi120 ceph-mon[31085]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:24.945 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:24.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:24 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4177658254' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-14T09:18:24.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:24 smithi152 ceph-mon[34868]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:24.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:24 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4177658254' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-14T09:18:24.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:24 smithi175 ceph-mon[35353]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:18:25.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:25 smithi120 ceph-mon[31085]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:25.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:25 smithi120 ceph-mon[31085]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-14T09:18:25.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:25 smithi120 ceph-mon[31085]: Cluster is now healthy 2024-05-14T09:18:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:25 smithi152 ceph-mon[34868]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:25 smithi152 ceph-mon[34868]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-14T09:18:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:25 smithi152 ceph-mon[34868]: Cluster is now healthy 2024-05-14T09:18:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:25 smithi175 ceph-mon[35353]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:25 smithi175 ceph-mon[35353]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-14T09:18:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:25 smithi175 ceph-mon[35353]: Cluster is now healthy 2024-05-14T09:18:27.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.334+0000 7fc402e00700 1 -- 172.21.15.120:0/2614795293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc10e900 msgr2=0x7fc3fc110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:27.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.334+0000 7fc402e00700 1 --2- 172.21.15.120:0/2614795293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc10e900 0x7fc3fc110dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400b0a0 tx=0x7fc3f400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.334+0000 7fc402e00700 1 -- 172.21.15.120:0/2614795293 shutdown_connections 2024-05-14T09:18:27.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.334+0000 7fc402e00700 1 --2- 172.21.15.120:0/2614795293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc105520 0x7fc3fc105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.334+0000 7fc402e00700 1 --2- 172.21.15.120:0/2614795293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc10e900 0x7fc3fc110dc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.334+0000 7fc402e00700 1 --2- 172.21.15.120:0/2614795293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3fc105e70 0x7fc3fc10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.334+0000 7fc402e00700 1 -- 172.21.15.120:0/2614795293 >> 172.21.15.120:0/2614795293 conn(0x7fc3fc0fedc0 msgr2=0x7fc3fc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:27.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.335+0000 7fc402e00700 1 -- 172.21.15.120:0/2614795293 shutdown_connections 2024-05-14T09:18:27.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.335+0000 7fc402e00700 1 -- 172.21.15.120:0/2614795293 wait complete. 2024-05-14T09:18:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 Processor -- start 2024-05-14T09:18:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 -- start start 2024-05-14T09:18:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc105520 0x7fc3fc1a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc105e70 0x7fc3fc1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3fc10e900 0x7fc3fc19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc114340 con 0x7fc3fc105520 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1141c0 con 0x7fc3fc105e70 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.336+0000 7fc402e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1144c0 con 0x7fc3fc10e900 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc105520 0x7fc3fc1a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc105520 0x7fc3fc1a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54572/0 (socket says 172.21.15.120:54572) 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 -- 172.21.15.120:0/1137442142 learned_addr learned my addr 172.21.15.120:0/1137442142 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3f3e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc105e70 0x7fc3fc1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc400e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3fc10e900 0x7fc3fc19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 -- 172.21.15.120:0/1137442142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3fc10e900 msgr2=0x7fc3fc19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3fc10e900 0x7fc3fc19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 -- 172.21.15.120:0/1137442142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc105e70 msgr2=0x7fc3fc1a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc105e70 0x7fc3fc1a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.337+0000 7fc3fbe00700 1 -- 172.21.15.120:0/1137442142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc19b1c0 con 0x7fc3fc105520 2024-05-14T09:18:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.338+0000 7fc3fbe00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc105520 0x7fc3fc1a08a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00d950 tx=0x7fc3ec00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.338+0000 7fc3f9600700 1 -- 172.21.15.120:0/1137442142 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec016070 con 0x7fc3fc105520 2024-05-14T09:18:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.338+0000 7fc3f9600700 1 -- 172.21.15.120:0/1137442142 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ec010460 con 0x7fc3fc105520 2024-05-14T09:18:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.338+0000 7fc3f9600700 1 -- 172.21.15.120:0/1137442142 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00f620 con 0x7fc3fc105520 2024-05-14T09:18:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.338+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc19b450 con 0x7fc3fc105520 2024-05-14T09:18:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.338+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1a7750 con 0x7fc3fc105520 2024-05-14T09:18:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.339+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc06be30 con 0x7fc3fc105520 2024-05-14T09:18:27.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.342+0000 7fc3f9600700 1 -- 172.21.15.120:0/1137442142 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fc3ec019070 con 0x7fc3fc105520 2024-05-14T09:18:27.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.343+0000 7fc3f9600700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3e00b2900 0x7fc3e00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:27.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.344+0000 7fc3f9600700 1 -- 172.21.15.120:0/1137442142 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fc3ec0e2070 con 0x7fc3fc105520 2024-05-14T09:18:27.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.344+0000 7fc3f3e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3e00b2900 0x7fc3e00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:27.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.344+0000 7fc3f3e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3e00b2900 0x7fc3e00b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005950 tx=0x7fc3e40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:27.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.347+0000 7fc3f9600700 1 -- 172.21.15.120:0/1137442142 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3ec0a9af0 con 0x7fc3fc105520 2024-05-14T09:18:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.622+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3fc02e5f0 con 0x7fc3fc105520 2024-05-14T09:18:27.623 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:27 smithi120 ceph-mon[31085]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.624+0000 7fc3f9600700 1 -- 172.21.15.120:0/1137442142 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11823 (secure 0 0 0) 0x7fc3ec0a93f0 con 0x7fc3fc105520 2024-05-14T09:18:27.625 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:18:27.625 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":14601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:18:22.723115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34427,"qdb_cluster":[34427]},"id":1}]} 2024-05-14T09:18:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3e00b2900 msgr2=0x7fc3e00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3e00b2900 0x7fc3e00b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005950 tx=0x7fc3e40058e0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc105520 msgr2=0x7fc3fc1a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc105520 0x7fc3fc1a08a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00d950 tx=0x7fc3ec00dd10 comp rx=0 tx=0).stop 2024-05-14T09:18:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 shutdown_connections 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3e00b2900 0x7fc3e00b4e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3fc10e900 0x7fc3fc19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3fc105520 0x7fc3fc1a08a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 --2- 172.21.15.120:0/1137442142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc105e70 0x7fc3fc1a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.627+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 >> 172.21.15.120:0/1137442142 conn(0x7fc3fc0fedc0 msgr2=0x7fc3fc0ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.628+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 shutdown_connections 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:27.628+0000 7fc402e00700 1 -- 172.21.15.120:0/1137442142 wait complete. 2024-05-14T09:18:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2024-05-14T09:18:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:27 smithi152 ceph-mon[34868]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:27 smithi175 ceph-mon[35353]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:28.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:18:28.879 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:28 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1137442142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:18:28.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:28 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1137442142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:18:28.898 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:28.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:28 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1137442142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:18:29.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:29 smithi120 ceph-mon[31085]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:29 smithi152 ceph-mon[34868]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:29 smithi175 ceph-mon[35353]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 -- 172.21.15.120:0/1863378234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 msgr2=0x7f0ec4106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/1863378234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec4106a30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40099c0 tx=0x7f0eb4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 -- 172.21.15.120:0/1863378234 shutdown_connections 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/1863378234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec410b8a0 0x7f0ec4113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/1863378234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec4106a30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/1863378234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec410af50 0x7f0ec410b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 -- 172.21.15.120:0/1863378234 >> 172.21.15.120:0/1863378234 conn(0x7f0ec4102030 msgr2=0x7f0ec4104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 -- 172.21.15.120:0/1863378234 shutdown_connections 2024-05-14T09:18:31.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.295+0000 7f0ec3e00700 1 -- 172.21.15.120:0/1863378234 wait complete. 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.296+0000 7f0ec3e00700 1 Processor -- start 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.296+0000 7f0ec3e00700 1 -- start start 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec3e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec410af50 0x7f0ec419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec3e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec410b8a0 0x7f0ec41a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec3e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4116380 con 0x7f0ec4106620 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec3e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4116200 con 0x7f0ec410af50 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec3e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4116500 con 0x7f0ec410b8a0 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec2a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec2a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57158/0 (socket says 172.21.15.120:57158) 2024-05-14T09:18:31.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.297+0000 7f0ec2a00700 1 -- 172.21.15.120:0/2923952270 learned_addr learned my addr 172.21.15.120:0/2923952270 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:31.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2000700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec410af50 0x7f0ec419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec3400700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec410b8a0 0x7f0ec41a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2a00700 1 -- 172.21.15.120:0/2923952270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec410b8a0 msgr2=0x7f0ec41a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2a00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec410b8a0 0x7f0ec41a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2a00700 1 -- 172.21.15.120:0/2923952270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec410af50 msgr2=0x7f0ec419d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2a00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec410af50 0x7f0ec419d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2a00700 1 -- 172.21.15.120:0/2923952270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec41a1ce0 con 0x7f0ec4106620 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2000700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec410af50 0x7f0ec419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:18:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec2a00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec419ce10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400f690 tx=0x7f0eb400f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec8a00700 1 -- 172.21.15.120:0/2923952270 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4027070 con 0x7f0ec4106620 2024-05-14T09:18:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec8a00700 1 -- 172.21.15.120:0/2923952270 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0eb40056d0 con 0x7f0ec4106620 2024-05-14T09:18:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.298+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec41a1f70 con 0x7f0ec4106620 2024-05-14T09:18:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.299+0000 7f0ec8a00700 1 -- 172.21.15.120:0/2923952270 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40173f0 con 0x7f0ec4106620 2024-05-14T09:18:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.299+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec41a2450 con 0x7f0ec4106620 2024-05-14T09:18:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.300+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec40512c0 con 0x7f0ec4106620 2024-05-14T09:18:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.303+0000 7f0ec8a00700 1 -- 172.21.15.120:0/2923952270 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f0eb402a070 con 0x7f0ec4106620 2024-05-14T09:18:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.304+0000 7f0ec8a00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0ea80b2880 0x7f0ea80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.305+0000 7f0ec8a00700 1 -- 172.21.15.120:0/2923952270 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f0eb40e3540 con 0x7f0ec4106620 2024-05-14T09:18:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.305+0000 7f0ec2000700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0ea80b2880 0x7f0ea80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.306+0000 7f0ec2000700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0ea80b2880 0x7f0ea80b4d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:31.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.308+0000 7f0ec8a00700 1 -- 172.21.15.120:0/2923952270 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0eb4013070 con 0x7f0ec4106620 2024-05-14T09:18:31.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.540+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ec402e5f0 con 0x7f0ec4106620 2024-05-14T09:18:31.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.543+0000 7f0ec8a00700 1 -- 172.21.15.120:0/2923952270 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24137 (secure 0 0 0) 0x7f0eb40ab0e0 con 0x7f0ec4106620 2024-05-14T09:18:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:18:31.544 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":86,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:18:22.722785+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:18:31.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0ea80b2880 msgr2=0x7f0ea80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0ea80b2880 0x7f0ea80b4d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb0005dc0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 msgr2=0x7f0ec419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec419ce10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400f690 tx=0x7f0eb400f770 comp rx=0 tx=0).stop 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 shutdown_connections 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0ea80b2880 0x7f0ea80b4d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec410b8a0 0x7f0ec41a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec4106620 0x7f0ec419ce10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 --2- 172.21.15.120:0/2923952270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec410af50 0x7f0ec419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 >> 172.21.15.120:0/2923952270 conn(0x7f0ec4102030 msgr2=0x7f0ec410a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 shutdown_connections 2024-05-14T09:18:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:31.546+0000 7f0ec3e00700 1 -- 172.21.15.120:0/2923952270 wait complete. 2024-05-14T09:18:31.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:31 smithi120 ceph-mon[31085]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:31.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:31 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2923952270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:31 smithi152 ceph-mon[34868]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:31 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2923952270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:31 smithi175 ceph-mon[35353]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:31 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2923952270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:32.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:18:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:33.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:33 smithi120 ceph-mon[31085]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:33.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:33 smithi152 ceph-mon[34868]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:33 smithi175 ceph-mon[35353]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 -- 172.21.15.120:0/3251866838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 msgr2=0x7f4cc4109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/3251866838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc4109330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00099c0 tx=0x7f4cb0009cd0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 -- 172.21.15.120:0/3251866838 shutdown_connections 2024-05-14T09:18:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/3251866838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc4109870 0x7f4cc41111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/3251866838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc41045f0 0x7f4cc4104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/3251866838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc4109330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 -- 172.21.15.120:0/3251866838 >> 172.21.15.120:0/3251866838 conn(0x7f4cc4100040 msgr2=0x7f4cc4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 -- 172.21.15.120:0/3251866838 shutdown_connections 2024-05-14T09:18:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.161+0000 7f4cc8c00700 1 -- 172.21.15.120:0/3251866838 wait complete. 2024-05-14T09:18:35.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.162+0000 7f4cc8c00700 1 Processor -- start 2024-05-14T09:18:35.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.162+0000 7f4cc8c00700 1 -- start start 2024-05-14T09:18:35.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc8c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc41045f0 0x7f4cc419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:35.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:35.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc8c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc4109870 0x7f4cc419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:35.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc8c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4114380 con 0x7f4cc4108f20 2024-05-14T09:18:35.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc8c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4114200 con 0x7f4cc4109870 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc8c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4114500 con 0x7f4cc41045f0 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57176/0 (socket says 172.21.15.120:57176) 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.163+0000 7f4cc1400700 1 -- 172.21.15.120:0/1803698651 learned_addr learned my addr 172.21.15.120:0/1803698651 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc1e00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc41045f0 0x7f4cc419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc2800700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc4109870 0x7f4cc419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc1400700 1 -- 172.21.15.120:0/1803698651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc41045f0 msgr2=0x7f4cc419adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc1400700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc41045f0 0x7f4cc419adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc1400700 1 -- 172.21.15.120:0/1803698651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc4109870 msgr2=0x7f4cc419f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc1400700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc4109870 0x7f4cc419f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc1400700 1 -- 172.21.15.120:0/1803698651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc419fcc0 con 0x7f4cc4108f20 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc2800700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc4109870 0x7f4cc419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cc1400700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc419b390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000b580 tx=0x7f4cb000f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.164+0000 7f4cbaa00700 1 -- 172.21.15.120:0/1803698651 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0027070 con 0x7f4cc4108f20 2024-05-14T09:18:35.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.165+0000 7f4cbaa00700 1 -- 172.21.15.120:0/1803698651 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cb000fda0 con 0x7f4cc4108f20 2024-05-14T09:18:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.165+0000 7f4cbaa00700 1 -- 172.21.15.120:0/1803698651 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00173f0 con 0x7f4cc4108f20 2024-05-14T09:18:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.165+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc419ff50 con 0x7f4cc4108f20 2024-05-14T09:18:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.165+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41a0430 con 0x7f4cc4108f20 2024-05-14T09:18:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.166+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc40512c0 con 0x7f4cc4108f20 2024-05-14T09:18:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.171+0000 7f4cbaa00700 1 -- 172.21.15.120:0/1803698651 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f4cb002a070 con 0x7f4cc4108f20 2024-05-14T09:18:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.173+0000 7f4cbaa00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ca80b2880 0x7f4ca80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.173+0000 7f4cbaa00700 1 -- 172.21.15.120:0/1803698651 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f4cb00e3710 con 0x7f4cc4108f20 2024-05-14T09:18:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.173+0000 7f4cc1e00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ca80b2880 0x7f4ca80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.174+0000 7f4cc1e00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ca80b2880 0x7f4ca80b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4005950 tx=0x7f4cb40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.177+0000 7f4cbaa00700 1 -- 172.21.15.120:0/1803698651 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4cb0013070 con 0x7f4cc4108f20 2024-05-14T09:18:35.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.407+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc402e5f0 con 0x7f4cc4108f20 2024-05-14T09:18:35.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.409+0000 7f4cbaa00700 1 -- 172.21.15.120:0/1803698651 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24137 (secure 0 0 0) 0x7f4cb00ab2b0 con 0x7f4cc4108f20 2024-05-14T09:18:35.410 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:18:35.411 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":86,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:18:22.722785+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:18:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.412+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ca80b2880 msgr2=0x7f4ca80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.412+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ca80b2880 0x7f4ca80b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4005950 tx=0x7f4cb40058e0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.412+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 msgr2=0x7f4cc419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc419b390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000b580 tx=0x7f4cb000f460 comp rx=0 tx=0).stop 2024-05-14T09:18:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 shutdown_connections 2024-05-14T09:18:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4ca80b2880 0x7f4ca80b4d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc4109870 0x7f4cc419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc41045f0 0x7f4cc419adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 --2- 172.21.15.120:0/1803698651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4cc4108f20 0x7f4cc419b390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 >> 172.21.15.120:0/1803698651 conn(0x7f4cc4100040 msgr2=0x7f4cc410a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 shutdown_connections 2024-05-14T09:18:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:35.413+0000 7f4cc8c00700 1 -- 172.21.15.120:0/1803698651 wait complete. 2024-05-14T09:18:35.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:35 smithi120 ceph-mon[31085]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:35.805 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:35 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1803698651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:35 smithi152 ceph-mon[34868]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:35 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1803698651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:35 smithi175 ceph-mon[35353]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:35 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1803698651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:36.244 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:18:36.699 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:37.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:37 smithi120 ceph-mon[31085]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:37 smithi152 ceph-mon[34868]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:37 smithi175 ceph-mon[35353]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 -- 172.21.15.120:0/3213797615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08110ba0 msgr2=0x7f5e08113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 --2- 172.21.15.120:0/3213797615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08110ba0 0x7f5e08113000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000b0a0 tx=0x7f5e0000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:18:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 -- 172.21.15.120:0/3213797615 shutdown_connections 2024-05-14T09:18:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 --2- 172.21.15.120:0/3213797615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08110ba0 0x7f5e08113000 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 --2- 172.21.15.120:0/3213797615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e08075d30 0x7f5e08076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 --2- 172.21.15.120:0/3213797615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e08076680 0x7f5e08110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:38.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 -- 172.21.15.120:0/3213797615 >> 172.21.15.120:0/3213797615 conn(0x7f5e08100040 msgr2=0x7f5e08102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:38.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 -- 172.21.15.120:0/3213797615 shutdown_connections 2024-05-14T09:18:38.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.970+0000 7f5e10000700 1 -- 172.21.15.120:0/3213797615 wait complete. 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.971+0000 7f5e10000700 1 Processor -- start 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.971+0000 7f5e10000700 1 -- start start 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e10000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e08075d30 0x7f5e0819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e10000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08076680 0x7f5e0819d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e10000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e08110ba0 0x7f5e081a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e10000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08116530 con 0x7f5e08076680 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e10000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e081163b0 con 0x7f5e08110ba0 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e10000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e081166b0 con 0x7f5e08075d30 2024-05-14T09:18:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e0cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08076680 0x7f5e0819d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e0cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08076680 0x7f5e0819d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51338/0 (socket says 172.21.15.120:51338) 2024-05-14T09:18:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.972+0000 7f5e0cc00700 1 -- 172.21.15.120:0/3755443789 learned_addr learned my addr 172.21.15.120:0/3755443789 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0d600700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e08075d30 0x7f5e0819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0e000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e08110ba0 0x7f5e081a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0cc00700 1 -- 172.21.15.120:0/3755443789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e08075d30 msgr2=0x7f5e0819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0cc00700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e08075d30 0x7f5e0819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0cc00700 1 -- 172.21.15.120:0/3755443789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e08110ba0 msgr2=0x7f5e081a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0cc00700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e08110ba0 0x7f5e081a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0cc00700 1 -- 172.21.15.120:0/3755443789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e081a1d00 con 0x7f5e08076680 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e0cc00700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08076680 0x7f5e0819d480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5df400d950 tx=0x7f5df400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.973+0000 7f5e06000700 1 -- 172.21.15.120:0/3755443789 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4016070 con 0x7f5e08076680 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.974+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e081a1ff0 con 0x7f5e08076680 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.974+0000 7f5e06000700 1 -- 172.21.15.120:0/3755443789 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5df4010460 con 0x7f5e08076680 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.974+0000 7f5e06000700 1 -- 172.21.15.120:0/3755443789 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df400f620 con 0x7f5e08076680 2024-05-14T09:18:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.974+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e081a99c0 con 0x7f5e08076680 2024-05-14T09:18:38.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.975+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e080512c0 con 0x7f5e08076680 2024-05-14T09:18:38.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.979+0000 7f5e06000700 1 -- 172.21.15.120:0/3755443789 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f5df4019070 con 0x7f5e08076680 2024-05-14T09:18:38.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.980+0000 7f5e06000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5df00b2880 0x7f5df00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:38.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.981+0000 7f5e06000700 1 -- 172.21.15.120:0/3755443789 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f5df40e1fe0 con 0x7f5e08076680 2024-05-14T09:18:38.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.981+0000 7f5e0d600700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5df00b2880 0x7f5df00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.981+0000 7f5e0d600700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5df00b2880 0x7f5df00b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc005ea0 tx=0x7f5dfc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:38.983+0000 7f5e06000700 1 -- 172.21.15.120:0/3755443789 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5df40a9ac0 con 0x7f5e08076680 2024-05-14T09:18:39.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.261+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e0819e240 con 0x7f5e08076680 2024-05-14T09:18:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.264+0000 7f5e06000700 1 -- 172.21.15.120:0/3755443789 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11823 (secure 0 0 0) 0x7f5df40a93c0 con 0x7f5e08076680 2024-05-14T09:18:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:18:39.265 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":14601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34388,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:18:22.723115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34427,"qdb_cluster":[34427]},"id":1}]} 2024-05-14T09:18:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.266+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5df00b2880 msgr2=0x7f5df00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.266+0000 7f5e10000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5df00b2880 0x7f5df00b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc005ea0 tx=0x7f5dfc005e30 comp rx=0 tx=0).stop 2024-05-14T09:18:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08076680 msgr2=0x7f5e0819d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08076680 0x7f5e0819d480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5df400d950 tx=0x7f5df400dd10 comp rx=0 tx=0).stop 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 shutdown_connections 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5df00b2880 0x7f5df00b4d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e08110ba0 0x7f5e081a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e08075d30 0x7f5e0819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 --2- 172.21.15.120:0/3755443789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e08076680 0x7f5e0819d480 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 >> 172.21.15.120:0/3755443789 conn(0x7f5e08100040 msgr2=0x7f5e081006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 shutdown_connections 2024-05-14T09:18:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:39.267+0000 7f5e10000700 1 -- 172.21.15.120:0/3755443789 wait complete. 2024-05-14T09:18:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2024-05-14T09:18:39.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:39 smithi120 ceph-mon[31085]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:39.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:39 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3755443789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:18:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:39 smithi152 ceph-mon[34868]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:39 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3755443789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:18:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:39 smithi175 ceph-mon[35353]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:39 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3755443789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:18:40.069 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:18:40.513 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:40.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6, 5, 7]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-14T09:18:40.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-05-14T09:18:40.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6, 5, 7]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-14T09:18:40.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6, 5, 7]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-14T09:18:40.994 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6, 5, 7]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-05-14T09:18:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:41 smithi120 ceph-mon[31085]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T09:18:41.962 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:41.962 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-14T09:18:41.962 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-14T09:18:41.962 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-14T09:18:41.963 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-05-14T09:18:41.963 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6, 5, 7]}]': finished 2024-05-14T09:18:41.963 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-14T09:18:41.963 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-05-14T09:18:41.963 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-14T09:18:41.963 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-05-14T09:18:41.963 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:41 smithi152 ceph-mon[34868]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6, 5, 7]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-05-14T09:18:41.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:41 smithi175 ceph-mon[35353]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T09:18:42.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.812+0000 7f07a7200700 1 -- 172.21.15.120:0/2201528066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8106620 msgr2=0x7f07a8106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.812+0000 7f07a7200700 1 --2- 172.21.15.120:0/2201528066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8106620 0x7f07a8106a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f07980099c0 tx=0x7f0798009cd0 comp rx=0 tx=0).stop 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.813+0000 7f07a7200700 1 -- 172.21.15.120:0/2201528066 shutdown_connections 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.813+0000 7f07a7200700 1 --2- 172.21.15.120:0/2201528066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07a810b8a0 0x7f07a8113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.813+0000 7f07a7200700 1 --2- 172.21.15.120:0/2201528066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8106620 0x7f07a8106a30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.813+0000 7f07a7200700 1 --2- 172.21.15.120:0/2201528066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a810af50 0x7f07a810b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.813+0000 7f07a7200700 1 -- 172.21.15.120:0/2201528066 >> 172.21.15.120:0/2201528066 conn(0x7f07a8102030 msgr2=0x7f07a8104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.813+0000 7f07a7200700 1 -- 172.21.15.120:0/2201528066 shutdown_connections 2024-05-14T09:18:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.813+0000 7f07a7200700 1 -- 172.21.15.120:0/2201528066 wait complete. 2024-05-14T09:18:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.814+0000 7f07a7200700 1 Processor -- start 2024-05-14T09:18:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.814+0000 7f07a7200700 1 -- start start 2024-05-14T09:18:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.814+0000 7f07a7200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a8106620 0x7f07a81a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.814+0000 7f07a7200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07a810af50 0x7f07a81a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.814+0000 7f07a7200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a810b8a0 0x7f07a819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.814+0000 7f07a7200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8116380 con 0x7f07a810b8a0 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a7200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8116200 con 0x7f07a810af50 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a7200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8116500 con 0x7f07a8106620 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a810b8a0 0x7f07a819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a810b8a0 0x7f07a819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51350/0 (socket says 172.21.15.120:51350) 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 -- 172.21.15.120:0/2598184723 learned_addr learned my addr 172.21.15.120:0/2598184723 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a5400700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07a810af50 0x7f07a81a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a5e00700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a8106620 0x7f07a81a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 -- 172.21.15.120:0/2598184723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a8106620 msgr2=0x7f07a81a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:42.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a8106620 0x7f07a81a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:42.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 -- 172.21.15.120:0/2598184723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07a810af50 msgr2=0x7f07a81a2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:42.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07a810af50 0x7f07a81a2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:42.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.815+0000 7f07a6800700 1 -- 172.21.15.120:0/2598184723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a819d270 con 0x7f07a810b8a0 2024-05-14T09:18:42.817 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:42 smithi120 ceph-mon[31085]: osdmap e88: 12 total, 12 up, 12 in 2024-05-14T09:18:42.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.816+0000 7f07a6800700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a810b8a0 0x7f07a819cb40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f07a0007ee0 tx=0x7f07a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:42.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.816+0000 7f079ea00700 1 -- 172.21.15.120:0/2598184723 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a000dbd0 con 0x7f07a810b8a0 2024-05-14T09:18:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.816+0000 7f079ea00700 1 -- 172.21.15.120:0/2598184723 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a000dd70 con 0x7f07a810b8a0 2024-05-14T09:18:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.816+0000 7f079ea00700 1 -- 172.21.15.120:0/2598184723 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00058d0 con 0x7f07a810b8a0 2024-05-14T09:18:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.816+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a819d560 con 0x7f07a810b8a0 2024-05-14T09:18:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.816+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a81a9760 con 0x7f07a810b8a0 2024-05-14T09:18:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.818+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a8107ad0 con 0x7f07a810b8a0 2024-05-14T09:18:42.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.821+0000 7f079ea00700 1 -- 172.21.15.120:0/2598184723 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f07a001a020 con 0x7f07a810b8a0 2024-05-14T09:18:42.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.823+0000 7f079ea00700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f078c0b2900 0x7f078c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:42.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.823+0000 7f079ea00700 1 -- 172.21.15.120:0/2598184723 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f07a00e2380 con 0x7f07a810b8a0 2024-05-14T09:18:42.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.823+0000 7f07a5e00700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f078c0b2900 0x7f078c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:42.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.824+0000 7f07a5e00700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f078c0b2900 0x7f078c0b4e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c00 tx=0x7f0798005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:42.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:42.826+0000 7f079ea00700 1 -- 172.21.15.120:0/2598184723 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f07a0010070 con 0x7f07a810b8a0 2024-05-14T09:18:42.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:42 smithi152 ceph-mon[34868]: osdmap e88: 12 total, 12 up, 12 in 2024-05-14T09:18:42.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:42 smithi175 ceph-mon[35353]: osdmap e88: 12 total, 12 up, 12 in 2024-05-14T09:18:43.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.059+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07a802e5f0 con 0x7f07a810b8a0 2024-05-14T09:18:43.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.063+0000 7f079ea00700 1 -- 172.21.15.120:0/2598184723 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24638 (secure 0 0 0) 0x7f07a00a9d00 con 0x7f07a810b8a0 2024-05-14T09:18:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:18:43.065 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":88,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:18:41.632841+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:18:43.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f078c0b2900 msgr2=0x7f078c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f078c0b2900 0x7f078c0b4e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c00 tx=0x7f0798005940 comp rx=0 tx=0).stop 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a810b8a0 msgr2=0x7f07a819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a810b8a0 0x7f07a819cb40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f07a0007ee0 tx=0x7f07a000d3b0 comp rx=0 tx=0).stop 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 shutdown_connections 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f078c0b2900 0x7f078c0b4e10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a810b8a0 0x7f07a819cb40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a8106620 0x7f07a81a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:43.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 --2- 172.21.15.120:0/2598184723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07a810af50 0x7f07a81a2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:43.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.067+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 >> 172.21.15.120:0/2598184723 conn(0x7f07a8102030 msgr2=0x7f07a810a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:43.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.068+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 shutdown_connections 2024-05-14T09:18:43.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:43.068+0000 7f07a7200700 1 -- 172.21.15.120:0/2598184723 wait complete. 2024-05-14T09:18:43.853 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:43 smithi120 ceph-mon[31085]: pgmap v409: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:43.853 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:43 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2598184723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:43.928 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T09:18:05.515901+0000', 'modified': '2024-05-14T09:18:22.723115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34427': {'gid': 34427, 'name': 'h', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.152:6837/1812479560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 1812479560}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 1812479560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34427, 'qdb_cluster': [34427]} 2024-05-14T09:18:43.928 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T09:18:43.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-14T09:18:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:43 smithi152 ceph-mon[34868]: pgmap v409: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:43 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2598184723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:43.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:43 smithi175 ceph-mon[35353]: pgmap v409: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:18:43.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:43 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2598184723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:18:44.359 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:45 smithi152 ceph-mon[34868]: pgmap v410: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:45 smithi175 ceph-mon[35353]: pgmap v410: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:46.002 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:45 smithi120 ceph-mon[31085]: pgmap v410: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.588+0000 7f2ef8600700 1 -- 172.21.15.120:0/3358707920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010a990 msgr2=0x7f2ef010ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.588+0000 7f2ef8600700 1 --2- 172.21.15.120:0/3358707920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010a990 0x7f2ef010ada0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009990 tx=0x7f2edc009ca0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.588+0000 7f2ef8600700 1 -- 172.21.15.120:0/3358707920 shutdown_connections 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.588+0000 7f2ef8600700 1 --2- 172.21.15.120:0/3358707920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef010b2e0 0x7f2ef0117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.588+0000 7f2ef8600700 1 --2- 172.21.15.120:0/3358707920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef0110970 0x7f2ef0110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.588+0000 7f2ef8600700 1 --2- 172.21.15.120:0/3358707920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010a990 0x7f2ef010ada0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.589+0000 7f2ef8600700 1 -- 172.21.15.120:0/3358707920 >> 172.21.15.120:0/3358707920 conn(0x7f2ef0077c80 msgr2=0x7f2ef00780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.589+0000 7f2ef8600700 1 -- 172.21.15.120:0/3358707920 shutdown_connections 2024-05-14T09:18:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.589+0000 7f2ef8600700 1 -- 172.21.15.120:0/3358707920 wait complete. 2024-05-14T09:18:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 Processor -- start 2024-05-14T09:18:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 -- start start 2024-05-14T09:18:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef010a990 0x7f2ef01a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010b2e0 0x7f2ef01a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef0110970 0x7f2ef01a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef011a940 con 0x7f2ef010b2e0 2024-05-14T09:18:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef011a7c0 con 0x7f2ef010a990 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.590+0000 7f2ef8600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef011aac0 con 0x7f2ef0110970 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010b2e0 0x7f2ef01a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010b2e0 0x7f2ef01a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51372/0 (socket says 172.21.15.120:51372) 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 -- 172.21.15.120:0/1635035282 learned_addr learned my addr 172.21.15.120:0/1635035282 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef010a990 0x7f2ef01a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef6600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef0110970 0x7f2ef01a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 -- 172.21.15.120:0/1635035282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef0110970 msgr2=0x7f2ef01a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef0110970 0x7f2ef01a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 -- 172.21.15.120:0/1635035282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef010a990 msgr2=0x7f2ef01a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef010a990 0x7f2ef01a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5200700 1 -- 172.21.15.120:0/1635035282 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef01a6190 con 0x7f2ef010b2e0 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.591+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef010a990 0x7f2ef01a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:18:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.592+0000 7f2ef5200700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010b2e0 0x7f2ef01a1910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000c00 tx=0x7f2edc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.592+0000 7f2eee000700 1 -- 172.21.15.120:0/1635035282 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc027070 con 0x7f2ef010b2e0 2024-05-14T09:18:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.592+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef01a6420 con 0x7f2ef010b2e0 2024-05-14T09:18:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.592+0000 7f2eee000700 1 -- 172.21.15.120:0/1635035282 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2edc00fc70 con 0x7f2ef010b2e0 2024-05-14T09:18:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.592+0000 7f2eee000700 1 -- 172.21.15.120:0/1635035282 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc022d30 con 0x7f2ef010b2e0 2024-05-14T09:18:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.592+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef01a6950 con 0x7f2ef010b2e0 2024-05-14T09:18:46.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.596+0000 7f2eee000700 1 -- 172.21.15.120:0/1635035282 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f2edc02a070 con 0x7f2ef010b2e0 2024-05-14T09:18:46.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.597+0000 7f2f071a7b80 1 Processor -- start 2024-05-14T09:18:46.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.597+0000 7f2f071a7b80 1 -- start start 2024-05-14T09:18:46.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddbc5df0 0x55edddd49660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd44010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55edddc659d0 con 0x55edddbc5df0 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55edddc03710 con 0x55edddd43c00 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55edddc61990 con 0x55edddd49ba0 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2eee000700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ed80b2900 0x7f2ed80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2ef6600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddbc5df0 0x55edddd49660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.598+0000 7f2ef6600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddbc5df0 0x55edddd49660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51376/0 (socket says 172.21.15.120:51376) 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef6600700 1 -- 172.21.15.120:0/3607074019 learned_addr learned my addr 172.21.15.120:0/3607074019 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2eee000700 1 -- 172.21.15.120:0/1635035282 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2edc0e3390 con 0x7f2ef010b2e0 2024-05-14T09:18:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd44010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef5200700 1 -- 172.21.15.120:0/3607074019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 msgr2=0x55edddd436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef5200700 1 -- 172.21.15.120:0/3607074019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddbc5df0 msgr2=0x55edddd49660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddbc5df0 0x55edddd49660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef5200700 1 -- 172.21.15.120:0/3607074019 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edddbb2880 con 0x55edddd43c00 2024-05-14T09:18:46.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.599+0000 7f2ef6600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ed80b2900 0x7f2ed80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.600+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd44010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0e0ba0 tx=0x7f2edc009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9068a6094b393aeb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:46.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.600+0000 7f2ef6600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ed80b2900 0x7f2ed80b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55edddd449e0 tx=0x7f2ee8004b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:46.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.600+0000 7f2ee2a00700 1 -- 172.21.15.120:0/3607074019 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0aae00 con 0x55edddd43c00 2024-05-14T09:18:46.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.600+0000 7f2ee2a00700 1 -- 172.21.15.120:0/3607074019 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2edc0aa700 con 0x55edddd43c00 2024-05-14T09:18:46.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.601+0000 7f2ee2a00700 1 -- 172.21.15.120:0/3607074019 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0aa960 con 0x55edddd43c00 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3607074019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 msgr2=0x55edddd44010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd44010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0e0ba0 tx=0x7f2edc009310 comp rx=0 tx=0).stop 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3607074019 shutdown_connections 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd44010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddbc5df0 0x55edddd49660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3607074019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3607074019 >> 172.21.15.120:0/3607074019 conn(0x55edddc04a30 msgr2=0x55edddd3e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3607074019 shutdown_connections 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.602+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3607074019 wait complete. 2024-05-14T09:18:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.603+0000 7f2f071a7b80 1 -- start start 2024-05-14T09:18:46.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.603+0000 7f2f071a7b80 1 Processor -- start 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd4d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd4d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd49ba0 0x55edddd4ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55edddd50430 con 0x55edddd49ba0 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55edddbcbad0 con 0x55edddd43c00 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55edddd505b0 con 0x55edddbc5df0 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2f071a7b80 10 client.0 _ll_register_callbacks cb 0x55edddbf9330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2ef6600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd49ba0 0x55edddd4ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2ef6600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd49ba0 0x55edddd4ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51384/0 (socket says 172.21.15.120:51384) 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2ef6600700 1 -- 172.21.15.120:0/2139258499 learned_addr learned my addr 172.21.15.120:0/2139258499 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd4d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.604+0000 7f2ef5200700 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd4d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ef6600700 1 -- 172.21.15.120:0/2139258499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 msgr2=0x55edddd4d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ef6600700 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd4d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ef6600700 1 -- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 msgr2=0x55edddd4d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ef6600700 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd4d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ef6600700 1 -- 172.21.15.120:0/2139258499 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edddc2b3d0 con 0x55edddd49ba0 2024-05-14T09:18:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ef6600700 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd49ba0 0x55edddd4ddb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801af00 tx=0x7f2ee8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db59253a05db8d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ed7400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.605+0000 7f2ed7400700 1 -- 172.21.15.120:0/2139258499 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee801a320 con 0x55edddd49ba0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.606+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2edc0aa700 con 0x55edddd49ba0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.606+0000 7f2ed7400700 1 -- 172.21.15.120:0/2139258499 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2ee8017ac0 con 0x55edddd49ba0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.606+0000 7f2ed7400700 1 -- 172.21.15.120:0/2139258499 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2ee8017cc0 con 0x55edddd49ba0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.606+0000 7f2f071a7b80 10 client.14697 fetch_fsmap learned FSMap version 17 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.606+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55edddd5afe0 con 0x55edddd49ba0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.606+0000 7f2ed7400700 1 -- 172.21.15.120:0/2139258499 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2edc0aa700 con 0x55edddd49ba0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.606+0000 7f2ed7400700 1 -- 172.21.15.120:0/2139258499 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f2ee8004510 con 0x55edddd49ba0 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.607+0000 7f2f071a7b80 10 client.14697 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.607+0000 7f2f071a7b80 10 client.14697 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.607+0000 7f2f071a7b80 20 client.14697 populate_metadata read hostname 'smithi120' 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.607+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55edddd5d6c0 0x55edddd5eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.607+0000 7f2f071a7b80 4 client.14697 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:18:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.607+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edddd10020 con 0x55edddd5d6c0 2024-05-14T09:18:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.608+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55edddd5d6c0 0x55edddd5eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.609+0000 7f2ed7400700 10 client.14697 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:18:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.609+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55edddd5d6c0 0x55edddd5eb30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4662c4cae341d0d4 server_cookie=8ea8921bff80edf8 in_seq=0 out_seq=0 2024-05-14T09:18:46.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.611+0000 7f2ed7400700 1 -- 172.21.15.120:0/2139258499 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55edddd10020 con 0x55edddd5d6c0 2024-05-14T09:18:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.611+0000 7f2ed7400700 10 client.14697 handle_command_reply: tid=0 2024-05-14T09:18:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.611+0000 7f2f071a7b80 1 client.14697 shutdown 2024-05-14T09:18:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd49ba0 msgr2=0x55edddd4ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd49ba0 0x55edddd4ddb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801af00 tx=0x7f2ee8004ad0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 shutdown_connections 2024-05-14T09:18:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55edddd5d6c0 0x55edddd5eb30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd49ba0 0x55edddd4ddb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd4d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/2139258499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd43c00 0x55edddd4d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 >> 172.21.15.120:0/2139258499 conn(0x55edddc04a30 msgr2=0x55edddd426b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2ed7400700 0 client.14697 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:18:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 shutdown_connections 2024-05-14T09:18:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 1 -- 172.21.15.120:0/2139258499 wait complete. 2024-05-14T09:18:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.612+0000 7f2f071a7b80 20 client.14697 trim_cache size 0 max 16384 2024-05-14T09:18:46.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.634+0000 7f2f071a7b80 1 Processor -- start 2024-05-14T09:18:46.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.634+0000 7f2f071a7b80 1 -- start start 2024-05-14T09:18:46.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddbc5df0 0x55edddd436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd38a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd5cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55edddd5ce70 con 0x55edddd43c00 2024-05-14T09:18:46.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55edddd5d540 con 0x55edddbc5df0 2024-05-14T09:18:46.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55edddd5dc10 con 0x55edddd49ba0 2024-05-14T09:18:46.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd38a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd38a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51388/0 (socket says 172.21.15.120:51388) 2024-05-14T09:18:46.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2ef5200700 1 -- 172.21.15.120:0/3901727951 learned_addr learned my addr 172.21.15.120:0/3901727951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:46.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.635+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddbc5df0 0x55edddd436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef6600700 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd5cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef5200700 1 -- 172.21.15.120:0/3901727951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 msgr2=0x55edddd5cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd5cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef5200700 1 -- 172.21.15.120:0/3901727951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddbc5df0 msgr2=0x55edddd436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddbc5df0 0x55edddd436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef5200700 1 -- 172.21.15.120:0/3901727951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edddd4b8c0 con 0x55edddd43c00 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddbc5df0 0x55edddd436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef6600700 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd5cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd38a50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0a7970 tx=0x7f2edc01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a39dd6cb1092510 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ee2000700 1 -- 172.21.15.120:0/3901727951 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0b34d0 con 0x55edddd43c00 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ee2000700 1 -- 172.21.15.120:0/3901727951 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2edc0aae00 con 0x55edddd43c00 2024-05-14T09:18:46.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.636+0000 7f2ee2000700 1 -- 172.21.15.120:0/3901727951 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0aabc0 con 0x55edddd43c00 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3901727951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 msgr2=0x55edddd38a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd38a50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0a7970 tx=0x7f2edc01a040 comp rx=0 tx=0).stop 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3901727951 shutdown_connections 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddbc5df0 0x55edddd436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddd49ba0 0x55edddd5cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3901727951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd38a50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3901727951 >> 172.21.15.120:0/3901727951 conn(0x55edddc04a30 msgr2=0x55edddd4e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3901727951 shutdown_connections 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.637+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3901727951 wait complete. 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.638+0000 7f2f071a7b80 1 -- start start 2024-05-14T09:18:46.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.638+0000 7f2f071a7b80 1 Processor -- start 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd68150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd68690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2f071a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd49ba0 0x55edddd636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55edddd5e9b0 con 0x55edddd43c00 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55edddd5e2e0 con 0x55edddd49ba0 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2f071a7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55edddd5f080 con 0x55edddbc5df0 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2f071a7b80 10 client.0 _ll_register_callbacks cb 0x55edddbf9330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd68690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd68690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51400/0 (socket says 172.21.15.120:51400) 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5200700 1 -- 172.21.15.120:0/3710151549 learned_addr learned my addr 172.21.15.120:0/3710151549 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd68150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef6600700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd49ba0 0x55edddd636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5200700 1 -- 172.21.15.120:0/3710151549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 msgr2=0x55edddd68150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd68150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5200700 1 -- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd49ba0 msgr2=0x55edddd636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.639+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd49ba0 0x55edddd636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2ef5200700 1 -- 172.21.15.120:0/3710151549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edddd63e60 con 0x55edddd43c00 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2ef6600700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd49ba0 0x55edddd636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2ef5200700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd68690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0a6780 tx=0x7f2edc00ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf3da771d4b1b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2ed7400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2ed7400700 1 -- 172.21.15.120:0/3710151549 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0ca050 con 0x55edddd43c00 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2ed7400700 1 -- 172.21.15.120:0/3710151549 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2edc0aab70 con 0x55edddd43c00 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2edc0aae00 con 0x55edddd43c00 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2ed7400700 1 -- 172.21.15.120:0/3710151549 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2edc0b3040 con 0x55edddd43c00 2024-05-14T09:18:46.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2f071a7b80 10 client.14703 fetch_fsmap learned FSMap version 17 2024-05-14T09:18:46.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.640+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55eddddc8590 con 0x55edddd43c00 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2ed7400700 1 -- 172.21.15.120:0/3710151549 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2edc0aae00 con 0x55edddd43c00 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2ed7400700 1 -- 172.21.15.120:0/3710151549 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f2edc0a6190 con 0x55edddd43c00 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2f071a7b80 10 client.14703 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2f071a7b80 10 client.14703 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2f071a7b80 20 client.14703 populate_metadata read hostname 'smithi120' 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55eddddca4f0 0x55eddddcb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2f071a7b80 4 client.14703 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.641+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "status"}) -- 0x55edddc733b0 con 0x55eddddca4f0 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.642+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55eddddca4f0 0x55eddddcb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.643+0000 7f2ef5c00700 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55eddddca4f0 0x55eddddcb960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b7a6e9c57fecf0c server_cookie=df60a9ea08e792e8 in_seq=0 out_seq=0 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.643+0000 7f2ed7400700 10 client.14703 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:18:46.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.643+0000 7f2ed7400700 1 -- 172.21.15.120:0/3710151549 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55edddc733b0 con 0x55eddddca4f0 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.643+0000 7f2ed7400700 10 client.14703 handle_command_reply: tid=0 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.643+0000 7f2f071a7b80 1 client.14703 shutdown 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 msgr2=0x55edddd68690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd68690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0a6780 tx=0x7f2edc00ff60 comp rx=0 tx=0).stop 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 shutdown_connections 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55eddddca4f0 0x55eddddcb960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55edddd49ba0 0x55edddd636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55edddbc5df0 0x55edddd68150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 --2- 172.21.15.120:0/3710151549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55edddd43c00 0x55edddd68690 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 >> 172.21.15.120:0/3710151549 conn(0x55edddc04a30 msgr2=0x55edddd47050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2ed7400700 0 client.14703 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:18:46.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 shutdown_connections 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 1 -- 172.21.15.120:0/3710151549 wait complete. 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.644+0000 7f2f071a7b80 20 client.14703 trim_cache size 0 max 16384 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 34427, 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 40.865712037999998, 2024-05-14T09:18:46.647 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 17, 2024-05-14T09:18:46.648 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 88, 2024-05-14T09:18:46.648 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 86, 2024-05-14T09:18:46.648 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 79.572915002000002 2024-05-14T09:18:46.648 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:18:46.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ed80b2900 msgr2=0x7f2ed80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ed80b2900 0x7f2ed80b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55edddd449e0 tx=0x7f2ee8004b40 comp rx=0 tx=0).stop 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010b2e0 msgr2=0x7f2ef01a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010b2e0 0x7f2ef01a1910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000c00 tx=0x7f2edc009f90 comp rx=0 tx=0).stop 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 shutdown_connections 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ed80b2900 0x7f2ed80b4e10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef010a990 0x7f2ef01a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef0110970 0x7f2ef01a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 --2- 172.21.15.120:0/1635035282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ef010b2e0 0x7f2ef01a1910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 >> 172.21.15.120:0/1635035282 conn(0x7f2ef0077c80 msgr2=0x7f2ef007b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 shutdown_connections 2024-05-14T09:18:46.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:46.645+0000 7f2ef8600700 1 -- 172.21.15.120:0/1635035282 wait complete. 2024-05-14T09:18:47.479 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T09:18:47.479 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:47.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-14T09:18:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:47 smithi152 ceph-mon[34868]: pgmap v411: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:47 smithi175 ceph-mon[35353]: pgmap v411: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:48.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:47 smithi120 ceph-mon[31085]: pgmap v411: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:49.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:49 smithi152 ceph-mon[34868]: pgmap v412: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:49 smithi175 ceph-mon[35353]: pgmap v412: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:50.037 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:49 smithi120 ceph-mon[31085]: pgmap v412: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:50.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.279+0000 7fdcf8a00700 1 -- 172.21.15.120:0/3781059793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 msgr2=0x7fdcf41111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:50.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.279+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/3781059793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf41111d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0099c0 tx=0x7fdcec009cd0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.280+0000 7fdcf8a00700 1 -- 172.21.15.120:0/3781059793 shutdown_connections 2024-05-14T09:18:50.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.280+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/3781059793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf41111d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.280+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/3781059793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf41045f0 0x7fdcf4104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.280+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/3781059793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf4108f20 0x7fdcf4109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.280+0000 7fdcf8a00700 1 -- 172.21.15.120:0/3781059793 >> 172.21.15.120:0/3781059793 conn(0x7fdcf4100040 msgr2=0x7fdcf4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:50.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.280+0000 7fdcf8a00700 1 -- 172.21.15.120:0/3781059793 shutdown_connections 2024-05-14T09:18:50.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.280+0000 7fdcf8a00700 1 -- 172.21.15.120:0/3781059793 wait complete. 2024-05-14T09:18:50.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.281+0000 7fdcf8a00700 1 Processor -- start 2024-05-14T09:18:50.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.281+0000 7fdcf8a00700 1 -- start start 2024-05-14T09:18:50.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.281+0000 7fdcf8a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf41045f0 0x7fdcf4075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:50.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.281+0000 7fdcf8a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4108f20 0x7fdcf4076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:50.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf8a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:50.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf8a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4114350 con 0x7fdcf4109870 2024-05-14T09:18:50.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf8a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41141d0 con 0x7fdcf41045f0 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf8a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41144d0 con 0x7fdcf4108f20 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf4076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47622/0 (socket says 172.21.15.120:47622) 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 -- 172.21.15.120:0/227696302 learned_addr learned my addr 172.21.15.120:0/227696302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf1e00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf41045f0 0x7fdcf4075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf1400700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4108f20 0x7fdcf4076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 -- 172.21.15.120:0/227696302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4108f20 msgr2=0x7fdcf4076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4108f20 0x7fdcf4076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 -- 172.21.15.120:0/227696302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf41045f0 msgr2=0x7fdcf4075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf41045f0 0x7fdcf4075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.282+0000 7fdcf2800700 1 -- 172.21.15.120:0/227696302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf41a9100 con 0x7fdcf4109870 2024-05-14T09:18:50.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.283+0000 7fdcf2800700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf4076540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0059d0 tx=0x7fdcec00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:50.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.283+0000 7fdceaa00700 1 -- 172.21.15.120:0/227696302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec027070 con 0x7fdcf4109870 2024-05-14T09:18:50.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.283+0000 7fdceaa00700 1 -- 172.21.15.120:0/227696302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcec0056d0 con 0x7fdcf4109870 2024-05-14T09:18:50.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.283+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf41a9390 con 0x7fdcf4109870 2024-05-14T09:18:50.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.283+0000 7fdceaa00700 1 -- 172.21.15.120:0/227696302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0173f0 con 0x7fdcf4109870 2024-05-14T09:18:50.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.283+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf41a9840 con 0x7fdcf4109870 2024-05-14T09:18:50.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.285+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf40512c0 con 0x7fdcf4109870 2024-05-14T09:18:50.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.287+0000 7fdceaa00700 1 -- 172.21.15.120:0/227696302 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fdcec02a070 con 0x7fdcf4109870 2024-05-14T09:18:50.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.289+0000 7fdceaa00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdcd80b2900 0x7fdcd80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:50.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.290+0000 7fdceaa00700 1 -- 172.21.15.120:0/227696302 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fdcec0e3500 con 0x7fdcf4109870 2024-05-14T09:18:50.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.290+0000 7fdcf1e00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdcd80b2900 0x7fdcd80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:50.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.290+0000 7fdcf1e00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdcd80b2900 0x7fdcd80b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdce40060b0 tx=0x7fdce4007b80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:50.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.295+0000 7fdceaa00700 1 -- 172.21.15.120:0/227696302 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdcec013070 con 0x7fdcf4109870 2024-05-14T09:18:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.577+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdcf402e7b0 con 0x7fdcf4109870 2024-05-14T09:18:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.577+0000 7fdceaa00700 1 -- 172.21.15.120:0/227696302 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fdcec0aaf10 con 0x7fdcf4109870 2024-05-14T09:18:50.577 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdcd80b2900 msgr2=0x7fdcd80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdcd80b2900 0x7fdcd80b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdce40060b0 tx=0x7fdce4007b80 comp rx=0 tx=0).stop 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 msgr2=0x7fdcf4076540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf4076540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0059d0 tx=0x7fdcec00f740 comp rx=0 tx=0).stop 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 shutdown_connections 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdcd80b2900 0x7fdcd80b4e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf41045f0 0x7fdcf4075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcf4109870 0x7fdcf4076540 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 --2- 172.21.15.120:0/227696302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4108f20 0x7fdcf4076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 >> 172.21.15.120:0/227696302 conn(0x7fdcf4100040 msgr2=0x7fdcf41086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:50.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 shutdown_connections 2024-05-14T09:18:50.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:50.581+0000 7fdcf8a00700 1 -- 172.21.15.120:0/227696302 wait complete. 2024-05-14T09:18:50.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:50 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/227696302' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T09:18:50.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:50 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/227696302' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T09:18:50.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:50 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/227696302' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T09:18:51.447 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T09:18:51.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:51.448 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:18:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 41787sec preferred_lft 41787sec 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-05-14T09:18:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:18:51.505 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-05-14T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-05-14T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-05-14T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:18:51.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:18:51.898 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:51 smithi120 ceph-mon[31085]: pgmap v413: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:51 smithi152 ceph-mon[34868]: pgmap v413: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:51 smithi175 ceph-mon[35353]: pgmap v413: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-05-14T09:18:52.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:18:52.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:52.014 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T09:18:52.082 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-05-14T09:18:52.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:52.086 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-05-14T09:18:52.138 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-05-14T09:18:52.138 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T09:18:52.138 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T09:18:52.138 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T09:18:52.138 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T09:18:52.139 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:18:52.139 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:18:52.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T09:18:52.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T09:18:52.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T09:18:52.139 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:18:52.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:18:52.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:18:52.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:52.869 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-05-14T09:18:52.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:52.926 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-05-14T09:18:52.979 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:18:52.979 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:18:52.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:18:52.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-14T09:18:52.979 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:18:53.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:18:53.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:18:53.167 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-14T09:18:53.167 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:18:53.167 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:18:53.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-14T09:18:53.168 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T09:18:53.168 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-14T09:18:53.168 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-14T09:18:53.168 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-14T09:18:53.168 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:18:53.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:18:53.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:18:53.458 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:18:53.458 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:18:53.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-05-14T09:18:53.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T09:18:53.459 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:18:53.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:18:53.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:18:53.660 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-14T09:18:53.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:18:53.660 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:53.704 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T09:18:53.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:18:53.705 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:53.801 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-05-14T09:18:53.875 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:18:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-05-14T09:18:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-05-14T09:18:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-05-14T09:18:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-05-14T09:18:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-05-14T09:18:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:18:53.925 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/95821b8f087c29f15bcddbe75cf573d1567ec30783cafc93ff7b8ef07034a33f/merged 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/24af7e0023a416eadaec87e907f606f46d6a4e07fa8895b37a9a495e471b4625/merged 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b2c5c4124798129e1b2ac12f0627fde7145959ba5ba910edb302acb9daf1b919/merged 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e88bdde8ae9d123541bcdc6aef4f54ad5949284308fbb740a13b4b29ff7f8145/merged 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/06075a78475efd3f13f9430d18d2f4010b8152de1d2f98e4d8d7c21186a890fb/merged 2024-05-14T09:18:53.926 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/a52ee462ee026e4bfcd8e9ccd42a2c344cad40db964e3e504756827eb3006372/merged 2024-05-14T09:18:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/5abb428e6cd506421d57fb2bb1186e2e35c4bc6c867004fe179076cd70ba8a97/merged 2024-05-14T09:18:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e2dd0be5dbefb7c322f191f4f3fd976988048cf4458e8a9b058ff8ca4bb6d960/merged 2024-05-14T09:18:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/9536011080a88def88751493bf6e7f420fc5c41b3e1e978a8cc96d28dac1d8cd/merged 2024-05-14T09:18:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b70a621bfd2a14d71f4f9a1f974dae3ca943b8c7e3f4cdb34f00e0d2ba7f5442/merged 2024-05-14T09:18:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-05-14T09:18:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:18:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:18:53.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:53.928 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-05-14T09:18:53.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:53 smithi175 ceph-mon[35353]: pgmap v414: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-05-14T09:18:54.020 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T09:18:54.020 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-14T09:18:54.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-05-14T09:18:54.078 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:53 smithi120 ceph-mon[31085]: pgmap v414: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-05-14T09:18:54.092 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:18:54.136 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-05-14T09:18:54.137 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/95821b8f087c29f15bcddbe75cf573d1567ec30783cafc93ff7b8ef07034a33f/merged 2024-05-14T09:18:54.138 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/24af7e0023a416eadaec87e907f606f46d6a4e07fa8895b37a9a495e471b4625/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b2c5c4124798129e1b2ac12f0627fde7145959ba5ba910edb302acb9daf1b919/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e88bdde8ae9d123541bcdc6aef4f54ad5949284308fbb740a13b4b29ff7f8145/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/06075a78475efd3f13f9430d18d2f4010b8152de1d2f98e4d8d7c21186a890fb/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/a52ee462ee026e4bfcd8e9ccd42a2c344cad40db964e3e504756827eb3006372/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/5abb428e6cd506421d57fb2bb1186e2e35c4bc6c867004fe179076cd70ba8a97/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e2dd0be5dbefb7c322f191f4f3fd976988048cf4458e8a9b058ff8ca4bb6d960/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/9536011080a88def88751493bf6e7f420fc5c41b3e1e978a8cc96d28dac1d8cd/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b70a621bfd2a14d71f4f9a1f974dae3ca943b8c7e3f4cdb34f00e0d2ba7f5442/merged 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:18:54.139 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:18:54.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:54.140 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-05-14T09:18:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:53 smithi152 ceph-mon[34868]: pgmap v414: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-05-14T09:18:54.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:2024-05-14T09:18:54.310+0000 7f7353f87480 -1 init, newargv = 0x7f733c0046a0 newargc=15 2024-05-14T09:18:54.310 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:ceph-fuse[76641]: starting ceph client 2024-05-14T09:18:54.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:ceph-fuse[76641]: starting fuse 2024-05-14T09:18:55.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-05-14T09:18:55.420 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:18:55.472 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:18:55.473 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-05-14T09:18:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/95821b8f087c29f15bcddbe75cf573d1567ec30783cafc93ff7b8ef07034a33f/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/24af7e0023a416eadaec87e907f606f46d6a4e07fa8895b37a9a495e471b4625/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b2c5c4124798129e1b2ac12f0627fde7145959ba5ba910edb302acb9daf1b919/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e88bdde8ae9d123541bcdc6aef4f54ad5949284308fbb740a13b4b29ff7f8145/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/06075a78475efd3f13f9430d18d2f4010b8152de1d2f98e4d8d7c21186a890fb/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/a52ee462ee026e4bfcd8e9ccd42a2c344cad40db964e3e504756827eb3006372/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/5abb428e6cd506421d57fb2bb1186e2e35c4bc6c867004fe179076cd70ba8a97/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e2dd0be5dbefb7c322f191f4f3fd976988048cf4458e8a9b058ff8ca4bb6d960/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/9536011080a88def88751493bf6e7f420fc5c41b3e1e978a8cc96d28dac1d8cd/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b70a621bfd2a14d71f4f9a1f974dae3ca943b8c7e3f4cdb34f00e0d2ba7f5442/merged 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:18:55.475 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:18:55.476 INFO:teuthology.orchestra.run.smithi120.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:55.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:55.477 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-05-14T09:18:55.524 INFO:teuthology.orchestra.run.smithi120.stdout:119 2024-05-14T09:18:55.524 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-05-14T09:18:55.524 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2024-05-14T09:18:55.524 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2024-05-14T09:18:55.524 DEBUG:teuthology.orchestra.run.smithi120:> import re 2024-05-14T09:18:55.524 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-05-14T09:18:55.524 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2024-05-14T09:18:55.524 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T09:18:55.525 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2024-05-14T09:18:55.526 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2024-05-14T09:18:55.526 DEBUG:teuthology.orchestra.run.smithi120:> return f 2024-05-14T09:18:55.526 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T09:18:55.526 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:18:55.526 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.admin")) 2024-05-14T09:18:55.526 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-05-14T09:18:55.679 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.admin.76641.asok 2024-05-14T09:18:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:18:55.695 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76641.asok 2024-05-14T09:18:55.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:55.695 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76641.asok status 2024-05-14T09:18:55.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:55 smithi175 ceph-mon[35353]: pgmap v415: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-05-14T09:18:55.981 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:55 smithi120 ceph-mon[31085]: pgmap v415: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-05-14T09:18:55.997 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:18:55.997 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2024-05-14T09:18:55.997 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T09:18:55.997 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T09:18:55.997 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "admin", 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "76641", 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 14715, 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2024-05-14T09:18:55.998 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 14715 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3832496755 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3832496755 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:18:55.999 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.14715 192.168.0.1:0/3832496755", 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/3832496755", 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 17, 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 88, 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2024-05-14T09:18:56.000 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:18:56.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:56.018 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2024-05-14T09:18:56.018 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:56.064 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2024-05-14T09:18:56.065 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:56.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:18:56.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:18:56.196 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-14T09:18:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:55 smithi152 ceph-mon[34868]: pgmap v415: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-05-14T09:18:56.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T09:18:56.355 INFO:teuthology.orchestra.run.smithi120.stdout:# file: . 2024-05-14T09:18:56.355 INFO:teuthology.orchestra.run.smithi120.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-14T09:18:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:18:56.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:18:56.366 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:18:56.366 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T09:18:56.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T09:18:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:18:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:57 smithi175 ceph-mon[35353]: pgmap v416: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:18:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:18:58.038 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:57 smithi120 ceph-mon[31085]: pgmap v416: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:18:58.038 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:18:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:57 smithi152 ceph-mon[34868]: pgmap v416: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:18:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:18:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 -- 172.21.15.120:0/4126004931 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104108740 msgr2=0x7f41041100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 --2- 172.21.15.120:0/4126004931 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104108740 0x7f41041100a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00b0d0 tx=0x7f40fc00b3e0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 -- 172.21.15.120:0/4126004931 shutdown_connections 2024-05-14T09:18:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 --2- 172.21.15.120:0/4126004931 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104108740 0x7f41041100a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 --2- 172.21.15.120:0/4126004931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41041034c0 0x7f41041038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 --2- 172.21.15.120:0/4126004931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104107df0 0x7f4104108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 -- 172.21.15.120:0/4126004931 >> 172.21.15.120:0/4126004931 conn(0x7f41040fedc0 msgr2=0x7f41041011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 -- 172.21.15.120:0/4126004931 shutdown_connections 2024-05-14T09:18:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.047+0000 7f410bc00700 1 -- 172.21.15.120:0/4126004931 wait complete. 2024-05-14T09:18:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 Processor -- start 2024-05-14T09:18:59.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 -- start start 2024-05-14T09:18:59.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41041034c0 0x7f41040ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:59.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104107df0 0x7f41040ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:59.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104108740 0x7f41040ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:59.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4104113270 con 0x7f4104107df0 2024-05-14T09:18:59.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41041130f0 con 0x7f4104108740 2024-05-14T09:18:59.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.049+0000 7f410bc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f41041133f0 con 0x7f41041034c0 2024-05-14T09:18:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104107df0 0x7f41040ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104107df0 0x7f41040ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53144/0 (socket says 172.21.15.120:53144) 2024-05-14T09:18:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 -- 172.21.15.120:0/476114871 learned_addr learned my addr 172.21.15.120:0/476114871 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:18:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4109200700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41041034c0 0x7f41040ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4109c00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104108740 0x7f41040ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 -- 172.21.15.120:0/476114871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41041034c0 msgr2=0x7f41040ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41041034c0 0x7f41040ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 -- 172.21.15.120:0/476114871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104108740 msgr2=0x7f41040ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104108740 0x7f41040ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4103e00700 1 -- 172.21.15.120:0/476114871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41041a9110 con 0x7f4104107df0 2024-05-14T09:18:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.050+0000 7f4109c00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104108740 0x7f41040ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:18:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.051+0000 7f4103e00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104107df0 0x7f41040ff7e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d980 tx=0x7f40f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.051+0000 7f4101600700 1 -- 172.21.15.120:0/476114871 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0017070 con 0x7f4104107df0 2024-05-14T09:18:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.051+0000 7f4101600700 1 -- 172.21.15.120:0/476114871 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40f0009dc0 con 0x7f4104107df0 2024-05-14T09:18:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.051+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41041a9400 con 0x7f4104107df0 2024-05-14T09:18:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.051+0000 7f4101600700 1 -- 172.21.15.120:0/476114871 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f000f3c0 con 0x7f4104107df0 2024-05-14T09:18:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.052+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a9990 con 0x7f4104107df0 2024-05-14T09:18:59.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.053+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41040512c0 con 0x7f4104107df0 2024-05-14T09:18:59.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.055+0000 7f4101600700 1 -- 172.21.15.120:0/476114871 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f40f0009930 con 0x7f4104107df0 2024-05-14T09:18:59.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.057+0000 7f4101600700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40ec0b2900 0x7f40ec0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:18:59.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.057+0000 7f4101600700 1 -- 172.21.15.120:0/476114871 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f40f00e1ff0 con 0x7f4104107df0 2024-05-14T09:18:59.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.057+0000 7f4109200700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40ec0b2900 0x7f40ec0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:18:59.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.058+0000 7f4109200700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40ec0b2900 0x7f40ec0b4e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009c60 tx=0x7f40f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:18:59.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.062+0000 7f4101600700 1 -- 172.21.15.120:0/476114871 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f40f00a9970 con 0x7f4104107df0 2024-05-14T09:18:59.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.314+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f410402e5f0 con 0x7f4104107df0 2024-05-14T09:18:59.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.315+0000 7f4101600700 1 -- 172.21.15.120:0/476114871 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+599 (secure 0 0 0) 0x7f40f00a9270 con 0x7f4104107df0 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1968421814 2024-05-15T09:07:40.065639+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2919660982 2024-05-15T09:07:04.655251+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2419562786 2024-05-15T09:07:04.655251+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1457013957 2024-05-15T09:07:40.065639+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3562327753 2024-05-15T09:07:04.655251+0000 2024-05-14T09:18:59.315 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/119127043 2024-05-15T09:07:40.065639+0000 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40ec0b2900 msgr2=0x7f40ec0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40ec0b2900 0x7f40ec0b4e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009c60 tx=0x7f40f8009260 comp rx=0 tx=0).stop 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104107df0 msgr2=0x7f41040ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104107df0 0x7f41040ff7e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d980 tx=0x7f40f000dc90 comp rx=0 tx=0).stop 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 shutdown_connections 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40ec0b2900 0x7f40ec0b4e10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4104108740 0x7f41040ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41041034c0 0x7f41040ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 --2- 172.21.15.120:0/476114871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4104107df0 0x7f41040ff7e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:18:59.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 >> 172.21.15.120:0/476114871 conn(0x7f41040fedc0 msgr2=0x7f410406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:18:59.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.318+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 shutdown_connections 2024-05-14T09:18:59.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:18:59.319+0000 7f410bc00700 1 -- 172.21.15.120:0/476114871 wait complete. 2024-05-14T09:18:59.319 INFO:teuthology.orchestra.run.smithi120.stderr:listed 10 entries 2024-05-14T09:18:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:59 smithi120 ceph-mon[31085]: pgmap v417: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:18:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:59 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:18:59 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/476114871' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:18:59.781 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:59 smithi175 ceph-mon[35353]: pgmap v417: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:18:59.781 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.781 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:59 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:18:59 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/476114871' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:18:59.864 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:59 smithi152 ceph-mon[34868]: pgmap v417: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:18:59.864 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.864 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.864 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.864 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:59 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:18:59.864 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:18:59 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/476114871' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:19:00.759 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:19:00.759 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T09:19:00.810 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T09:19:01.314 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:01.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:01 smithi120 ceph-mon[31085]: pgmap v418: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:19:01.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.822 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:01 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:01 smithi152 ceph-mon[34868]: pgmap v418: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:19:01.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:01 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:01 smithi175 ceph-mon[35353]: pgmap v418: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T09:19:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:01.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:01 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:02.986 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:02.986 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:02 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:03.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:03.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:02 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:02 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 -- 172.21.15.120:0/2418361539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 msgr2=0x7f087810b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 --2- 172.21.15.120:0/2418361539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087810b330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f08640099c0 tx=0x7f0864009cd0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 -- 172.21.15.120:0/2418361539 shutdown_connections 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 --2- 172.21.15.120:0/2418361539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0878106640 0x7f0878106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 --2- 172.21.15.120:0/2418361539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f087810b870 0x7f08781131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 --2- 172.21.15.120:0/2418361539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087810b330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 -- 172.21.15.120:0/2418361539 >> 172.21.15.120:0/2418361539 conn(0x7f0878102030 msgr2=0x7f0878104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 -- 172.21.15.120:0/2418361539 shutdown_connections 2024-05-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.594+0000 7f087ec00700 1 -- 172.21.15.120:0/2418361539 wait complete. 2024-05-14T09:19:03.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.595+0000 7f087ec00700 1 Processor -- start 2024-05-14T09:19:03.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.596+0000 7f087ec00700 1 -- start start 2024-05-14T09:19:03.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.596+0000 7f087ec00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0878106640 0x7f087819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.596+0000 7f087ec00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087819d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.596+0000 7f087ec00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f087810b870 0x7f08781a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.596+0000 7f087ec00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0878116380 con 0x7f087810af20 2024-05-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.596+0000 7f087ec00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0878116200 con 0x7f0878106640 2024-05-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.596+0000 7f087ec00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0878116500 con 0x7f087810b870 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087819d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087819d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53166/0 (socket says 172.21.15.120:53166) 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 -- 172.21.15.120:0/1226071779 learned_addr learned my addr 172.21.15.120:0/1226071779 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087d800700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0878106640 0x7f087819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087e200700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f087810b870 0x7f08781a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 -- 172.21.15.120:0/1226071779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f087810b870 msgr2=0x7f08781a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f087810b870 0x7f08781a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 -- 172.21.15.120:0/1226071779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0878106640 msgr2=0x7f087819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0878106640 0x7f087819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087ce00700 1 -- 172.21.15.120:0/1226071779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08781a1c20 con 0x7f087810af20 2024-05-14T09:19:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.597+0000 7f087e200700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f087810b870 0x7f08781a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:19:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.598+0000 7f087ce00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087819d2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f086400b580 tx=0x7f08640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.598+0000 7f0876000700 1 -- 172.21.15.120:0/1226071779 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864009e60 con 0x7f087810af20 2024-05-14T09:19:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.598+0000 7f0876000700 1 -- 172.21.15.120:0/1226071779 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08640047f0 con 0x7f087810af20 2024-05-14T09:19:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.598+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08781a1eb0 con 0x7f087810af20 2024-05-14T09:19:03.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.598+0000 7f0876000700 1 -- 172.21.15.120:0/1226071779 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864003e60 con 0x7f087810af20 2024-05-14T09:19:03.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.598+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08781a2380 con 0x7f087810af20 2024-05-14T09:19:03.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.599+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08780512c0 con 0x7f087810af20 2024-05-14T09:19:03.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.602+0000 7f0876000700 1 -- 172.21.15.120:0/1226071779 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f08640039d0 con 0x7f087810af20 2024-05-14T09:19:03.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.603+0000 7f0876000700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08600b2900 0x7f08600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:03.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.604+0000 7f0876000700 1 -- 172.21.15.120:0/1226071779 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f08640e33a0 con 0x7f087810af20 2024-05-14T09:19:03.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.604+0000 7f087d800700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08600b2900 0x7f08600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:03.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.605+0000 7f087d800700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08600b2900 0x7f08600b4e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f086c009c60 tx=0x7f086c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:03.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.606+0000 7f0876000700 1 -- 172.21.15.120:0/1226071779 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0864013070 con 0x7f087810af20 2024-05-14T09:19:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.851+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f087802e5f0 con 0x7f087810af20 2024-05-14T09:19:03.852 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:03 smithi120 ceph-mon[31085]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T09:19:03.852 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:19:03.852 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:19:03.852 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.852+0000 7f0876000700 1 -- 172.21.15.120:0/1226071779 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+599 (secure 0 0 0) 0x7f08640aadb0 con 0x7f087810af20 2024-05-14T09:19:03.852 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:19:03.852 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1968421814 2024-05-15T09:07:40.065639+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2919660982 2024-05-15T09:07:04.655251+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2419562786 2024-05-15T09:07:04.655251+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1457013957 2024-05-15T09:07:40.065639+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3562327753 2024-05-15T09:07:04.655251+0000 2024-05-14T09:19:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/119127043 2024-05-15T09:07:40.065639+0000 2024-05-14T09:19:03.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08600b2900 msgr2=0x7f08600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:03.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08600b2900 0x7f08600b4e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f086c009c60 tx=0x7f086c009260 comp rx=0 tx=0).stop 2024-05-14T09:19:03.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 msgr2=0x7f087819d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:03.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087819d2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f086400b580 tx=0x7f08640045e0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 shutdown_connections 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08600b2900 0x7f08600b4e10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0878106640 0x7f087819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f087810b870 0x7f08781a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 --2- 172.21.15.120:0/1226071779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f087810af20 0x7f087819d2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 >> 172.21.15.120:0/1226071779 conn(0x7f0878102030 msgr2=0x7f087810a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 shutdown_connections 2024-05-14T09:19:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:03.856+0000 7f087ec00700 1 -- 172.21.15.120:0/1226071779 wait complete. 2024-05-14T09:19:03.858 INFO:teuthology.orchestra.run.smithi120.stderr:listed 10 entries 2024-05-14T09:19:04.109 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:03 smithi152 ceph-mon[34868]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T09:19:04.110 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:19:04.110 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:19:04.110 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:03 smithi175 ceph-mon[35353]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T09:19:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:19:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:19:04.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:19:04.726 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2024-05-14T09:19:04.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:19:04.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:19:04.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:ceph-fuse[76641]: fuse finished with error 0 and tester_r 0 2024-05-14T09:19:04.812 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T09:19:05.025 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:04 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1226071779' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:19:05.146 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:04 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1226071779' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:19:05.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:04 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1226071779' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:19:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:05 smithi120 ceph-mon[31085]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T09:19:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:05 smithi152 ceph-mon[34868]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T09:19:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:05 smithi175 ceph-mon[35353]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T09:19:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:07 smithi120 ceph-mon[31085]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-14T09:19:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:07 smithi152 ceph-mon[34868]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-14T09:19:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:07 smithi175 ceph-mon[35353]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-14T09:19:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:09 smithi120 ceph-mon[31085]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:09 smithi152 ceph-mon[34868]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:09 smithi175 ceph-mon[35353]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:10.914 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:19:10.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:19:10.914 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-14T09:19:10.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:19:11.435 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:11.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:11 smithi120 ceph-mon[31085]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:11 smithi152 ceph-mon[34868]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:11 smithi175 ceph-mon[35353]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 -- 172.21.15.120:0/407920648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 msgr2=0x7f9d6c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 --2- 172.21.15.120:0/407920648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c104a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d600099c0 tx=0x7f9d60009cd0 comp rx=0 tx=0).stop 2024-05-14T09:19:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 -- 172.21.15.120:0/407920648 shutdown_connections 2024-05-14T09:19:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 --2- 172.21.15.120:0/407920648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d6c109870 0x7f9d6c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 --2- 172.21.15.120:0/407920648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c104a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:13.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 --2- 172.21.15.120:0/407920648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d6c108f20 0x7f9d6c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:13.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 -- 172.21.15.120:0/407920648 >> 172.21.15.120:0/407920648 conn(0x7f9d6c100040 msgr2=0x7f9d6c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:13.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 -- 172.21.15.120:0/407920648 shutdown_connections 2024-05-14T09:19:13.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.761+0000 7f9d73600700 1 -- 172.21.15.120:0/407920648 wait complete. 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.762+0000 7f9d73600700 1 Processor -- start 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d73600700 1 -- start start 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d73600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c19cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d73600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d6c108f20 0x7f9d6c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d73600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d6c109870 0x7f9d6c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d73600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c114350 con 0x7f9d6c1045f0 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d73600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c1141d0 con 0x7f9d6c109870 2024-05-14T09:19:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d73600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c1144d0 con 0x7f9d6c108f20 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d70c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c19cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d70c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c19cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49260/0 (socket says 172.21.15.120:49260) 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.763+0000 7f9d70c00700 1 -- 172.21.15.120:0/2471401691 learned_addr learned my addr 172.21.15.120:0/2471401691 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d6be00700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d6c108f20 0x7f9d6c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d70c00700 1 -- 172.21.15.120:0/2471401691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d6c108f20 msgr2=0x7f9d6c19d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d70c00700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d6c108f20 0x7f9d6c19d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d71600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d6c109870 0x7f9d6c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d70c00700 1 -- 172.21.15.120:0/2471401691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d6c109870 msgr2=0x7f9d6c1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d70c00700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d6c109870 0x7f9d6c1a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d70c00700 1 -- 172.21.15.120:0/2471401691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c1a1eb0 con 0x7f9d6c1045f0 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d6be00700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d6c108f20 0x7f9d6c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d70c00700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c19cfe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d60000c00 tx=0x7f9d6000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:13.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.764+0000 7f9d69600700 1 -- 172.21.15.120:0/2471401691 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000f940 con 0x7f9d6c1045f0 2024-05-14T09:19:13.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.765+0000 7f9d69600700 1 -- 172.21.15.120:0/2471401691 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d60004830 con 0x7f9d6c1045f0 2024-05-14T09:19:13.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.765+0000 7f9d69600700 1 -- 172.21.15.120:0/2471401691 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600054b0 con 0x7f9d6c1045f0 2024-05-14T09:19:13.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.765+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6c1a2140 con 0x7f9d6c1045f0 2024-05-14T09:19:13.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.765+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6c1a25c0 con 0x7f9d6c1045f0 2024-05-14T09:19:13.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.766+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d6c0512c0 con 0x7f9d6c1045f0 2024-05-14T09:19:13.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.768+0000 7f9d69600700 1 -- 172.21.15.120:0/2471401691 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f9d60029060 con 0x7f9d6c1045f0 2024-05-14T09:19:13.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.771+0000 7f9d69600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d540b2880 0x7f9d540b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:13.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.771+0000 7f9d69600700 1 -- 172.21.15.120:0/2471401691 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f9d600e3460 con 0x7f9d6c1045f0 2024-05-14T09:19:13.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.771+0000 7f9d6be00700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d540b2880 0x7f9d540b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:13.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.772+0000 7f9d6be00700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d540b2880 0x7f9d540b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9d58005fd0 tx=0x7f9d58005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:13.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:13.774+0000 7f9d69600700 1 -- 172.21.15.120:0/2471401691 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9d60013070 con 0x7f9d6c1045f0 2024-05-14T09:19:13.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:13 smithi120 ceph-mon[31085]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:14.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.010+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d6c1a9b20 con 0x7f9d6c1045f0 2024-05-14T09:19:14.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.012+0000 7f9d69600700 1 -- 172.21.15.120:0/2471401691 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24638 (secure 0 0 0) 0x7f9d600aae70 con 0x7f9d6c1045f0 2024-05-14T09:19:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:19:14.014 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":88,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:18:41.632841+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:19:14.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.015+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d540b2880 msgr2=0x7f9d540b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:14.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.015+0000 7f9d73600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d540b2880 0x7f9d540b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9d58005fd0 tx=0x7f9d58005ee0 comp rx=0 tx=0).stop 2024-05-14T09:19:14.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.015+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 msgr2=0x7f9d6c19cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:14.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.015+0000 7f9d73600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c19cfe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d60000c00 tx=0x7f9d6000f510 comp rx=0 tx=0).stop 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 shutdown_connections 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d540b2880 0x7f9d540b4d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d6c109870 0x7f9d6c1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d6c1045f0 0x7f9d6c19cfe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 --2- 172.21.15.120:0/2471401691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d6c108f20 0x7f9d6c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 >> 172.21.15.120:0/2471401691 conn(0x7f9d6c100040 msgr2=0x7f9d6c10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 shutdown_connections 2024-05-14T09:19:14.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:14.016+0000 7f9d73600700 1 -- 172.21.15.120:0/2471401691 wait complete. 2024-05-14T09:19:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:13 smithi152 ceph-mon[34868]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:13 smithi175 ceph-mon[35353]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-14T09:19:14.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:19:15.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:14 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2471401691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:19:15.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:14 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2471401691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:19:15.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:14 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2471401691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:19:15.332 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:15 smithi120 ceph-mon[31085]: pgmap v425: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T09:19:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:15 smithi152 ceph-mon[34868]: pgmap v425: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T09:19:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:15 smithi175 ceph-mon[35353]: pgmap v425: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 -- 172.21.15.120:0/4211645611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390115180 msgr2=0x7ff3901175a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 --2- 172.21.15.120:0/4211645611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390115180 0x7ff3901175a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff38800b0a0 tx=0x7ff38800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 -- 172.21.15.120:0/4211645611 shutdown_connections 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 --2- 172.21.15.120:0/4211645611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390075b60 0x7ff390075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 --2- 172.21.15.120:0/4211645611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390115180 0x7ff3901175a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 --2- 172.21.15.120:0/4211645611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3900764b0 0x7ff390114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 -- 172.21.15.120:0/4211645611 >> 172.21.15.120:0/4211645611 conn(0x7ff390079d10 msgr2=0x7ff39007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 -- 172.21.15.120:0/4211645611 shutdown_connections 2024-05-14T09:19:17.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.500+0000 7ff38fe00700 1 -- 172.21.15.120:0/4211645611 wait complete. 2024-05-14T09:19:17.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.501+0000 7ff38fe00700 1 Processor -- start 2024-05-14T09:19:17.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38fe00700 1 -- start start 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390075b60 0x7ff3901a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3900764b0 0x7ff3901a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38fe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390115180 0x7ff3901a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38fe00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff39011a790 con 0x7ff390075b60 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38fe00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff39011a610 con 0x7ff390115180 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38fe00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff39011a910 con 0x7ff3900764b0 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.502+0000 7ff38ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390075b60 0x7ff3901a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390075b60 0x7ff3901a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49274/0 (socket says 172.21.15.120:49274) 2024-05-14T09:19:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 -- 172.21.15.120:0/3733079603 learned_addr learned my addr 172.21.15.120:0/3733079603 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:17.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff386000700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3900764b0 0x7ff3901a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38f400700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390115180 0x7ff3901a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 -- 172.21.15.120:0/3733079603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3900764b0 msgr2=0x7ff3901a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3900764b0 0x7ff3901a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 -- 172.21.15.120:0/3733079603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390115180 msgr2=0x7ff3901a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390115180 0x7ff3901a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 -- 172.21.15.120:0/3733079603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3901a5ff0 con 0x7ff390075b60 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38f400700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390115180 0x7ff3901a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.503+0000 7ff38ea00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390075b60 0x7ff3901a1120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff38000d950 tx=0x7ff38000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.504+0000 7ff394a00700 1 -- 172.21.15.120:0/3733079603 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380016070 con 0x7ff390075b60 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.504+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3901a6280 con 0x7ff390075b60 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.504+0000 7ff394a00700 1 -- 172.21.15.120:0/3733079603 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff380010460 con 0x7ff390075b60 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.504+0000 7ff394a00700 1 -- 172.21.15.120:0/3733079603 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38000f620 con 0x7ff390075b60 2024-05-14T09:19:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.504+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3901adc00 con 0x7ff390075b60 2024-05-14T09:19:17.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.505+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3900772a0 con 0x7ff390075b60 2024-05-14T09:19:17.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.509+0000 7ff394a00700 1 -- 172.21.15.120:0/3733079603 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7ff380019070 con 0x7ff390075b60 2024-05-14T09:19:17.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.511+0000 7ff394a00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3740b2900 0x7ff3740b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:17.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.511+0000 7ff394a00700 1 -- 172.21.15.120:0/3733079603 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7ff3800e2110 con 0x7ff390075b60 2024-05-14T09:19:17.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.511+0000 7ff386000700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3740b2900 0x7ff3740b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:17.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.512+0000 7ff386000700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3740b2900 0x7ff3740b4e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff378005950 tx=0x7ff3780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.514+0000 7ff394a00700 1 -- 172.21.15.120:0/3733079603 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff3800a9af0 con 0x7ff390075b60 2024-05-14T09:19:17.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.745+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff39002e5f0 con 0x7ff390075b60 2024-05-14T09:19:17.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.749+0000 7ff394a00700 1 -- 172.21.15.120:0/3733079603 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24638 (secure 0 0 0) 0x7ff3800a93f0 con 0x7ff390075b60 2024-05-14T09:19:17.750 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:19:17.751 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":88,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:18:41.632841+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:19:17.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.753+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3740b2900 msgr2=0x7ff3740b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:17.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.753+0000 7ff38fe00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3740b2900 0x7ff3740b4e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff378005950 tx=0x7ff3780058e0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.753+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390075b60 msgr2=0x7ff3901a1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:17.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.753+0000 7ff38fe00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390075b60 0x7ff3901a1120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff38000d950 tx=0x7ff38000dd10 comp rx=0 tx=0).stop 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 shutdown_connections 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3740b2900 0x7ff3740b4e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff390115180 0x7ff3901a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff390075b60 0x7ff3901a1120 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 --2- 172.21.15.120:0/3733079603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3900764b0 0x7ff3901a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 >> 172.21.15.120:0/3733079603 conn(0x7ff390079d10 msgr2=0x7ff390100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 shutdown_connections 2024-05-14T09:19:17.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:17.754+0000 7ff38fe00700 1 -- 172.21.15.120:0/3733079603 wait complete. 2024-05-14T09:19:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:17 smithi120 ceph-mon[31085]: pgmap v426: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T09:19:18.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:17 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3733079603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:19:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:17 smithi152 ceph-mon[34868]: pgmap v426: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T09:19:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:17 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3733079603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:19:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:17 smithi175 ceph-mon[35353]: pgmap v426: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T09:19:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:17 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3733079603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:19:18.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-14T09:19:19.034 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:19 smithi120 ceph-mon[31085]: pgmap v427: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:19 smithi152 ceph-mon[34868]: pgmap v427: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:19 smithi175 ceph-mon[35353]: pgmap v427: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:21.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.349+0000 7f716ac00700 1 -- 172.21.15.120:0/2285834511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 msgr2=0x7f716410ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.349+0000 7f716ac00700 1 --2- 172.21.15.120:0/2285834511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f716410ada0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7150009990 tx=0x7f7150009ca0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.349+0000 7f716ac00700 1 -- 172.21.15.120:0/2285834511 shutdown_connections 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.349+0000 7f716ac00700 1 --2- 172.21.15.120:0/2285834511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7164110970 0x7f7164110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.349+0000 7f716ac00700 1 --2- 172.21.15.120:0/2285834511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f716410b2e0 0x7f7164117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.349+0000 7f716ac00700 1 --2- 172.21.15.120:0/2285834511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f716410ada0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.349+0000 7f716ac00700 1 -- 172.21.15.120:0/2285834511 >> 172.21.15.120:0/2285834511 conn(0x7f7164077c80 msgr2=0x7f71640780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.350+0000 7f716ac00700 1 -- 172.21.15.120:0/2285834511 shutdown_connections 2024-05-14T09:19:21.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.350+0000 7f716ac00700 1 -- 172.21.15.120:0/2285834511 wait complete. 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.351+0000 7f716ac00700 1 Processor -- start 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.351+0000 7f716ac00700 1 -- start start 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.351+0000 7f716ac00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f71641a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.351+0000 7f716ac00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716410b2e0 0x7f71641a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.351+0000 7f716ac00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7164110970 0x7f71641a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f716ac00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f716411a9f0 con 0x7f716410a990 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f716ac00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f716411a870 con 0x7f716410b2e0 2024-05-14T09:19:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f716ac00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f716411ab70 con 0x7f7164110970 2024-05-14T09:19:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f71641a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f71641a1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37634/0 (socket says 172.21.15.120:37634) 2024-05-14T09:19:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 -- 172.21.15.120:0/1321471631 learned_addr learned my addr 172.21.15.120:0/1321471631 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163400700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716410b2e0 0x7f71641a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7168c00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7164110970 0x7f71641a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 -- 172.21.15.120:0/1321471631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7164110970 msgr2=0x7f71641a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7164110970 0x7f71641a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 -- 172.21.15.120:0/1321471631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716410b2e0 msgr2=0x7f71641a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716410b2e0 0x7f71641a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.352+0000 7f7163e00700 1 -- 172.21.15.120:0/1321471631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71641a6240 con 0x7f716410a990 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.353+0000 7f7163400700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716410b2e0 0x7f71641a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.353+0000 7f7163e00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f71641a1420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f715400c9e0 tx=0x7f715400cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.353+0000 7f7160c00700 1 -- 172.21.15.120:0/1321471631 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154007aa0 con 0x7f716410a990 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.353+0000 7f7160c00700 1 -- 172.21.15.120:0/1321471631 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7154007c40 con 0x7f716410a990 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.353+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71641a6530 con 0x7f716410a990 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.353+0000 7f7160c00700 1 -- 172.21.15.120:0/1321471631 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154018660 con 0x7f716410a990 2024-05-14T09:19:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.353+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71641adf00 con 0x7f716410a990 2024-05-14T09:19:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.355+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716410c080 con 0x7f716410a990 2024-05-14T09:19:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.357+0000 7f7160c00700 1 -- 172.21.15.120:0/1321471631 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f7154018800 con 0x7f716410a990 2024-05-14T09:19:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.358+0000 7f7160c00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71480b2900 0x7f71480b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.359+0000 7f7160c00700 1 -- 172.21.15.120:0/1321471631 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f71540e24c0 con 0x7f716410a990 2024-05-14T09:19:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.359+0000 7f7163400700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71480b2900 0x7f71480b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.360+0000 7f7163400700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71480b2900 0x7f71480b4e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f715000b5c0 tx=0x7f7150005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.368+0000 7f7160c00700 1 -- 172.21.15.120:0/1321471631 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7154014030 con 0x7f716410a990 2024-05-14T09:19:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.645+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f716402e5f0 con 0x7f716410a990 2024-05-14T09:19:21.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.857+0000 7f7160c00700 1 -- 172.21.15.120:0/1321471631 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f71540a9e40 con 0x7f716410a990 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71480b2900 msgr2=0x7f71480b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71480b2900 0x7f71480b4e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f715000b5c0 tx=0x7f7150005fd0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 msgr2=0x7f71641a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f71641a1420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f715400c9e0 tx=0x7f715400cda0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 shutdown_connections 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71480b2900 0x7f71480b4e10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7164110970 0x7f71641a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f716410a990 0x7f71641a1420 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 --2- 172.21.15.120:0/1321471631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716410b2e0 0x7f71641a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:21.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 >> 172.21.15.120:0/1321471631 conn(0x7f7164077c80 msgr2=0x7f716407b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:21.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 shutdown_connections 2024-05-14T09:19:21.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:21.861+0000 7f716ac00700 1 -- 172.21.15.120:0/1321471631 wait complete. 2024-05-14T09:19:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:21 smithi120 ceph-mon[31085]: pgmap v428: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:21 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1321471631' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T09:19:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:21 smithi152 ceph-mon[34868]: pgmap v428: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:21 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1321471631' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T09:19:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:21 smithi175 ceph-mon[35353]: pgmap v428: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:21 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1321471631' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T09:19:22.678 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-14T09:19:22.678 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-14T09:19:23.129 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:23.133 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:22 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1321471631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T09:19:23.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:22 smithi120 ceph-mon[31085]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:19:23.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:22 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1321471631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T09:19:23.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:22 smithi152 ceph-mon[34868]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:19:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:22 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1321471631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T09:19:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:22 smithi175 ceph-mon[35353]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:19:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:23 smithi152 ceph-mon[34868]: pgmap v429: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:23 smithi175 ceph-mon[35353]: pgmap v429: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:23 smithi120 ceph-mon[31085]: pgmap v429: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 -- 172.21.15.120:0/2692149455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314076c10 msgr2=0x7f2314077020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 --2- 172.21.15.120:0/2692149455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314076c10 0x7f2314077020 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f230400b0a0 tx=0x7f230400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 -- 172.21.15.120:0/2692149455 shutdown_connections 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 --2- 172.21.15.120:0/2692149455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2314110be0 0x7f2314113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 --2- 172.21.15.120:0/2692149455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314076c10 0x7f2314077020 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 --2- 172.21.15.120:0/2692149455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2314077560 0x7f23141106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 -- 172.21.15.120:0/2692149455 >> 172.21.15.120:0/2692149455 conn(0x7f23140ffea0 msgr2=0x7f23141022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 -- 172.21.15.120:0/2692149455 shutdown_connections 2024-05-14T09:19:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.273+0000 7f231a600700 1 -- 172.21.15.120:0/2692149455 wait complete. 2024-05-14T09:19:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.274+0000 7f231a600700 1 Processor -- start 2024-05-14T09:19:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f231a600700 1 -- start start 2024-05-14T09:19:25.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f231a600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2314076c10 0x7f231419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:25.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f231a600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2314077560 0x7f231419d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:25.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f231a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314110be0 0x7f23141a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:25.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f231a600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f23141165c0 con 0x7f2314110be0 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f231a600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2314116440 con 0x7f2314077560 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f231a600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2314116740 con 0x7f2314076c10 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f2313e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314110be0 0x7f23141a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f2313e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314110be0 0x7f23141a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37652/0 (socket says 172.21.15.120:37652) 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.275+0000 7f2313e00700 1 -- 172.21.15.120:0/2738458779 learned_addr learned my addr 172.21.15.120:0/2738458779 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f2313400700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2314076c10 0x7f231419cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f230aa00700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2314077560 0x7f231419d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f2313e00700 1 -- 172.21.15.120:0/2738458779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2314076c10 msgr2=0x7f231419cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f2313e00700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2314076c10 0x7f231419cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f2313e00700 1 -- 172.21.15.120:0/2738458779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2314077560 msgr2=0x7f231419d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f2313e00700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2314077560 0x7f231419d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f2313e00700 1 -- 172.21.15.120:0/2738458779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23141a1ea0 con 0x7f2314110be0 2024-05-14T09:19:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.276+0000 7f230aa00700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2314077560 0x7f231419d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:19:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.277+0000 7f2313e00700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314110be0 0x7f23141a1800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f230c00d950 tx=0x7f230c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.277+0000 7f2310c00700 1 -- 172.21.15.120:0/2738458779 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c017070 con 0x7f2314110be0 2024-05-14T09:19:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.277+0000 7f2310c00700 1 -- 172.21.15.120:0/2738458779 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f230c005020 con 0x7f2314110be0 2024-05-14T09:19:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.277+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23141a2130 con 0x7f2314110be0 2024-05-14T09:19:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.277+0000 7f2310c00700 1 -- 172.21.15.120:0/2738458779 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c009990 con 0x7f2314110be0 2024-05-14T09:19:25.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.277+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23141a9ab0 con 0x7f2314110be0 2024-05-14T09:19:25.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.278+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23140512c0 con 0x7f2314110be0 2024-05-14T09:19:25.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.282+0000 7f2310c00700 1 -- 172.21.15.120:0/2738458779 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f230c004a30 con 0x7f2314110be0 2024-05-14T09:19:25.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.284+0000 7f2310c00700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f22f80b2900 0x7f22f80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:25.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.284+0000 7f2310c00700 1 -- 172.21.15.120:0/2738458779 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f230c0e20c0 con 0x7f2314110be0 2024-05-14T09:19:25.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.284+0000 7f2313400700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f22f80b2900 0x7f22f80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:25.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.285+0000 7f2313400700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f22f80b2900 0x7f22f80b4e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2304009fd0 tx=0x7f2304006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:25.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.287+0000 7f2310c00700 1 -- 172.21.15.120:0/2738458779 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f230c0051d0 con 0x7f2314110be0 2024-05-14T09:19:25.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.567+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f231402e5f0 con 0x7f2314110be0 2024-05-14T09:19:25.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.892+0000 7f2310c00700 1 -- 172.21.15.120:0/2738458779 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f230c0a9ac0 con 0x7f2314110be0 2024-05-14T09:19:25.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f22f80b2900 msgr2=0x7f22f80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:25.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f22f80b2900 0x7f22f80b4e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2304009fd0 tx=0x7f2304006210 comp rx=0 tx=0).stop 2024-05-14T09:19:25.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314110be0 msgr2=0x7f23141a1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:25.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314110be0 0x7f23141a1800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f230c00d950 tx=0x7f230c00dc60 comp rx=0 tx=0).stop 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 shutdown_connections 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f22f80b2900 0x7f22f80b4e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2314110be0 0x7f23141a1800 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2314076c10 0x7f231419cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 --2- 172.21.15.120:0/2738458779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2314077560 0x7f231419d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.898+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 >> 172.21.15.120:0/2738458779 conn(0x7f23140ffea0 msgr2=0x7f2314100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.899+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 shutdown_connections 2024-05-14T09:19:25.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:25.899+0000 7f231a600700 1 -- 172.21.15.120:0/2738458779 wait complete. 2024-05-14T09:19:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:25 smithi152 ceph-mon[34868]: pgmap v430: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:25 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2738458779' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T09:19:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:25 smithi175 ceph-mon[35353]: pgmap v430: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:25 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2738458779' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T09:19:26.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:25 smithi120 ceph-mon[31085]: pgmap v430: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:26.300 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:25 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2738458779' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T09:19:26.730 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-14T09:19:26.918 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:26 smithi120 ceph-mon[31085]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T09:19:26.918 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:26 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2738458779' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T09:19:26.918 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:26 smithi120 ceph-mon[31085]: daemon mds.e assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T09:19:26.918 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:26 smithi120 ceph-mon[31085]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:19:26.919 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:26 smithi120 ceph-mon[31085]: fsmap cephfs:2 {0=h=up:active,1=e=up:creating} 10 up:standby 2024-05-14T09:19:26.919 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:26 smithi120 ceph-mon[31085]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-05-14T09:19:27.178 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:27.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:26 smithi152 ceph-mon[34868]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T09:19:27.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:26 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2738458779' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T09:19:27.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:26 smithi152 ceph-mon[34868]: daemon mds.e assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T09:19:27.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:26 smithi152 ceph-mon[34868]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:19:27.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:26 smithi152 ceph-mon[34868]: fsmap cephfs:2 {0=h=up:active,1=e=up:creating} 10 up:standby 2024-05-14T09:19:27.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:26 smithi152 ceph-mon[34868]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-05-14T09:19:27.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:26 smithi175 ceph-mon[35353]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T09:19:27.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:26 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2738458779' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T09:19:27.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:26 smithi175 ceph-mon[35353]: daemon mds.e assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T09:19:27.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:26 smithi175 ceph-mon[35353]: fsmap cephfs:1 {0=h=up:active} 11 up:standby 2024-05-14T09:19:27.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:26 smithi175 ceph-mon[35353]: fsmap cephfs:2 {0=h=up:active,1=e=up:creating} 10 up:standby 2024-05-14T09:19:27.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:26 smithi175 ceph-mon[35353]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-05-14T09:19:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:27 smithi120 ceph-mon[31085]: pgmap v431: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:27 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] up:active 2024-05-14T09:19:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:27 smithi120 ceph-mon[31085]: daemon mds.k assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T09:19:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:27 smithi120 ceph-mon[31085]: fsmap cephfs:2 {0=h=up:active,1=e=up:active} 10 up:standby 2024-05-14T09:19:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:27 smithi120 ceph-mon[31085]: fsmap cephfs:3 {0=h=up:active,1=e=up:active,2=k=up:creating} 9 up:standby 2024-05-14T09:19:28.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:27 smithi120 ceph-mon[31085]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-05-14T09:19:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:27 smithi152 ceph-mon[34868]: pgmap v431: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:27 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] up:active 2024-05-14T09:19:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:27 smithi152 ceph-mon[34868]: daemon mds.k assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T09:19:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:27 smithi152 ceph-mon[34868]: fsmap cephfs:2 {0=h=up:active,1=e=up:active} 10 up:standby 2024-05-14T09:19:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:27 smithi152 ceph-mon[34868]: fsmap cephfs:3 {0=h=up:active,1=e=up:active,2=k=up:creating} 9 up:standby 2024-05-14T09:19:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:27 smithi152 ceph-mon[34868]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-05-14T09:19:28.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:19:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:19:27.885+0000 7f6fc5800700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-14T09:19:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:27 smithi175 ceph-mon[35353]: pgmap v431: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T09:19:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:27 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] up:active 2024-05-14T09:19:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:27 smithi175 ceph-mon[35353]: daemon mds.k assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T09:19:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:27 smithi175 ceph-mon[35353]: fsmap cephfs:2 {0=h=up:active,1=e=up:active} 10 up:standby 2024-05-14T09:19:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:27 smithi175 ceph-mon[35353]: fsmap cephfs:3 {0=h=up:active,1=e=up:active,2=k=up:creating} 9 up:standby 2024-05-14T09:19:28.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:27 smithi175 ceph-mon[35353]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-05-14T09:19:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:28 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] up:active 2024-05-14T09:19:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:28 smithi152 ceph-mon[34868]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T09:19:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:28 smithi152 ceph-mon[34868]: fsmap cephfs:3 {0=h=up:active,1=e=up:active,2=k=up:active} 9 up:standby 2024-05-14T09:19:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:28 smithi152 ceph-mon[34868]: fsmap cephfs:4 {0=h=up:active,1=e=up:active,2=k=up:active,3=i=up:creating} 8 up:standby 2024-05-14T09:19:29.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:28 smithi152 ceph-mon[34868]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-05-14T09:19:29.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:28 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] up:active 2024-05-14T09:19:29.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:28 smithi175 ceph-mon[35353]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T09:19:29.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:28 smithi175 ceph-mon[35353]: fsmap cephfs:3 {0=h=up:active,1=e=up:active,2=k=up:active} 9 up:standby 2024-05-14T09:19:29.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:28 smithi175 ceph-mon[35353]: fsmap cephfs:4 {0=h=up:active,1=e=up:active,2=k=up:active,3=i=up:creating} 8 up:standby 2024-05-14T09:19:29.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:28 smithi175 ceph-mon[35353]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-05-14T09:19:29.275 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:28 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] up:active 2024-05-14T09:19:29.275 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:28 smithi120 ceph-mon[31085]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T09:19:29.275 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:28 smithi120 ceph-mon[31085]: fsmap cephfs:3 {0=h=up:active,1=e=up:active,2=k=up:active} 9 up:standby 2024-05-14T09:19:29.275 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:28 smithi120 ceph-mon[31085]: fsmap cephfs:4 {0=h=up:active,1=e=up:active,2=k=up:active,3=i=up:creating} 8 up:standby 2024-05-14T09:19:29.275 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:28 smithi120 ceph-mon[31085]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-05-14T09:19:29.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 -- 172.21.15.120:0/2610286672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410af50 msgr2=0x7f5f0410b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:29.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 --2- 172.21.15.120:0/2610286672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410af50 0x7f5f0410b360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00099c0 tx=0x7f5ef0009cd0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 -- 172.21.15.120:0/2610286672 shutdown_connections 2024-05-14T09:19:29.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 --2- 172.21.15.120:0/2610286672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f04106620 0x7f5f04106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 --2- 172.21.15.120:0/2610286672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f0410b8a0 0x7f5f04113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 --2- 172.21.15.120:0/2610286672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410af50 0x7f5f0410b360 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 -- 172.21.15.120:0/2610286672 >> 172.21.15.120:0/2610286672 conn(0x7f5f04102030 msgr2=0x7f5f04104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:29.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 -- 172.21.15.120:0/2610286672 shutdown_connections 2024-05-14T09:19:29.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.521+0000 7f5f09800700 1 -- 172.21.15.120:0/2610286672 wait complete. 2024-05-14T09:19:29.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.522+0000 7f5f09800700 1 Processor -- start 2024-05-14T09:19:29.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f09800700 1 -- start start 2024-05-14T09:19:29.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f09800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f04106620 0x7f5f0419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:29.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f09800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f0410af50 0x7f5f0419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:29.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f09800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410b8a0 0x7f5f041a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f09800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5f04116360 con 0x7f5f0410b8a0 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f09800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f041161e0 con 0x7f5f04106620 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f09800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5f041164e0 con 0x7f5f0410af50 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.523+0000 7f5f08e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410b8a0 0x7f5f041a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f03e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f04106620 0x7f5f0419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f08e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410b8a0 0x7f5f041a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33566/0 (socket says 172.21.15.120:33566) 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f08e00700 1 -- 172.21.15.120:0/1183574987 learned_addr learned my addr 172.21.15.120:0/1183574987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:29.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f03400700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f0410af50 0x7f5f0419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f08e00700 1 -- 172.21.15.120:0/1183574987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f0410af50 msgr2=0x7f5f0419d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f08e00700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f0410af50 0x7f5f0419d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f08e00700 1 -- 172.21.15.120:0/1183574987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f04106620 msgr2=0x7f5f0419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f08e00700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f04106620 0x7f5f0419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f08e00700 1 -- 172.21.15.120:0/1183574987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f041a1ce0 con 0x7f5f0410b8a0 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.524+0000 7f5f03400700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f0410af50 0x7f5f0419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.525+0000 7f5f08e00700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410b8a0 0x7f5f041a1640 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00ada0 tx=0x7f5efc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:29.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.525+0000 7f5f00c00700 1 -- 172.21.15.120:0/1183574987 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc017020 con 0x7f5f0410b8a0 2024-05-14T09:19:29.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.525+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f041a1fd0 con 0x7f5f0410b8a0 2024-05-14T09:19:29.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.525+0000 7f5f00c00700 1 -- 172.21.15.120:0/1183574987 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5efc00ce10 con 0x7f5f0410b8a0 2024-05-14T09:19:29.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.525+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f041a98f0 con 0x7f5f0410b8a0 2024-05-14T09:19:29.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.525+0000 7f5f00c00700 1 -- 172.21.15.120:0/1183574987 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc005260 con 0x7f5f0410b8a0 2024-05-14T09:19:29.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.526+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f040512c0 con 0x7f5f0410b8a0 2024-05-14T09:19:29.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.531+0000 7f5f00c00700 1 -- 172.21.15.120:0/1183574987 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f5efc00c980 con 0x7f5f0410b8a0 2024-05-14T09:19:29.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.532+0000 7f5f00c00700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5ee80b2880 0x7f5ee80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:29.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.532+0000 7f5f00c00700 1 -- 172.21.15.120:0/1183574987 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f5efc0e2170 con 0x7f5f0410b8a0 2024-05-14T09:19:29.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.532+0000 7f5f03e00700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5ee80b2880 0x7f5ee80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:29.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.533+0000 7f5f03e00700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5ee80b2880 0x7f5ee80b4d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4005950 tx=0x7f5ef400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:29.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.535+0000 7f5f00c00700 1 -- 172.21.15.120:0/1183574987 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5efc021020 con 0x7f5f0410b8a0 2024-05-14T09:19:29.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.819+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f5f0402e5f0 con 0x7f5f0410b8a0 2024-05-14T09:19:29.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.973+0000 7f5f00c00700 1 -- 172.21.15.120:0/1183574987 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f5efc0a9b80 con 0x7f5f0410b8a0 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5ee80b2880 msgr2=0x7f5ee80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5ee80b2880 0x7f5ee80b4d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4005950 tx=0x7f5ef400b410 comp rx=0 tx=0).stop 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410b8a0 msgr2=0x7f5f041a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410b8a0 0x7f5f041a1640 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00ada0 tx=0x7f5efc00c330 comp rx=0 tx=0).stop 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 shutdown_connections 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5ee80b2880 0x7f5ee80b4d90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f04106620 0x7f5f0419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f0410b8a0 0x7f5f041a1640 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 --2- 172.21.15.120:0/1183574987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f0410af50 0x7f5f0419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 >> 172.21.15.120:0/1183574987 conn(0x7f5f04102030 msgr2=0x7f5f0410a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 shutdown_connections 2024-05-14T09:19:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:29.978+0000 7f5f09800700 1 -- 172.21.15.120:0/1183574987 wait complete. 2024-05-14T09:19:30.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: pgmap v432: 129 pgs: 129 active+clean; 582 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 2 op/s 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] up:active 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: Cluster is now healthy 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: fsmap cephfs:4 {0=h=up:active,1=e=up:active,2=k=up:active,3=i=up:active} 8 up:standby 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-14T09:19:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:29 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1183574987' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T09:19:30.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: pgmap v432: 129 pgs: 129 active+clean; 582 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 2 op/s 2024-05-14T09:19:30.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] up:active 2024-05-14T09:19:30.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T09:19:30.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T09:19:30.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: Cluster is now healthy 2024-05-14T09:19:30.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: fsmap cephfs:4 {0=h=up:active,1=e=up:active,2=k=up:active,3=i=up:active} 8 up:standby 2024-05-14T09:19:30.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T09:19:30.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-14T09:19:30.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:29 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1183574987' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T09:19:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: pgmap v432: 129 pgs: 129 active+clean; 582 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 2 op/s 2024-05-14T09:19:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] up:active 2024-05-14T09:19:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T09:19:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T09:19:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: Cluster is now healthy 2024-05-14T09:19:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: fsmap cephfs:4 {0=h=up:active,1=e=up:active,2=k=up:active,3=i=up:active} 8 up:standby 2024-05-14T09:19:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T09:19:30.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-14T09:19:30.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:29 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1183574987' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T09:19:30.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-14T09:19:31.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:30 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1183574987' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T09:19:31.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:30 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:active 2024-05-14T09:19:31.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:30 smithi120 ceph-mon[31085]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T09:19:31.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:30 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:19:31.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:30 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1183574987' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T09:19:31.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:30 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:active 2024-05-14T09:19:31.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:30 smithi175 ceph-mon[35353]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T09:19:31.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:30 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:19:31.335 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:31.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:30 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1183574987' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T09:19:31.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:30 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:active 2024-05-14T09:19:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:30 smithi152 ceph-mon[34868]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T09:19:31.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:30 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:19:32.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:31 smithi120 ceph-mon[31085]: pgmap v433: 129 pgs: 129 active+clean; 585 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-05-14T09:19:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:31 smithi175 ceph-mon[35353]: pgmap v433: 129 pgs: 129 active+clean; 585 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-05-14T09:19:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:31 smithi152 ceph-mon[34868]: pgmap v433: 129 pgs: 129 active+clean; 585 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 -- 172.21.15.120:0/2692652222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 msgr2=0x7fd334113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 --2- 172.21.15.120:0/2692652222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd334113000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00b0a0 tx=0x7fd32c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 -- 172.21.15.120:0/2692652222 shutdown_connections 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 --2- 172.21.15.120:0/2692652222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd334075d30 0x7fd334076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 --2- 172.21.15.120:0/2692652222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd334113000 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 --2- 172.21.15.120:0/2692652222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd334076680 0x7fd334110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 -- 172.21.15.120:0/2692652222 >> 172.21.15.120:0/2692652222 conn(0x7fd334100040 msgr2=0x7fd334102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 -- 172.21.15.120:0/2692652222 shutdown_connections 2024-05-14T09:19:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.642+0000 7fd339800700 1 -- 172.21.15.120:0/2692652222 wait complete. 2024-05-14T09:19:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.643+0000 7fd339800700 1 Processor -- start 2024-05-14T09:19:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.643+0000 7fd339800700 1 -- start start 2024-05-14T09:19:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd339800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd334075d30 0x7fd33419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd339800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd334076680 0x7fd33419d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd339800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd3341a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd339800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd334116530 con 0x7fd334110ba0 2024-05-14T09:19:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd339800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341163b0 con 0x7fd334076680 2024-05-14T09:19:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd339800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341166b0 con 0x7fd334075d30 2024-05-14T09:19:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd333400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd3341a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd333400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd3341a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33590/0 (socket says 172.21.15.120:33590) 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.644+0000 7fd333400700 1 -- 172.21.15.120:0/3594451662 learned_addr learned my addr 172.21.15.120:0/3594451662 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd332a00700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd334075d30 0x7fd33419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd332000700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd334076680 0x7fd33419d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd333400700 1 -- 172.21.15.120:0/3594451662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd334075d30 msgr2=0x7fd33419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd333400700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd334075d30 0x7fd33419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd333400700 1 -- 172.21.15.120:0/3594451662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd334076680 msgr2=0x7fd33419d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd333400700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd334076680 0x7fd33419d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd333400700 1 -- 172.21.15.120:0/3594451662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3341a1d90 con 0x7fd334110ba0 2024-05-14T09:19:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.645+0000 7fd333400700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd3341a16f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00b830 tx=0x7fd32c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.646+0000 7fd32b400700 1 -- 172.21.15.120:0/3594451662 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c021070 con 0x7fd334110ba0 2024-05-14T09:19:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.646+0000 7fd32b400700 1 -- 172.21.15.120:0/3594451662 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd32c007b80 con 0x7fd334110ba0 2024-05-14T09:19:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.646+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3341a2020 con 0x7fd334110ba0 2024-05-14T09:19:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.646+0000 7fd32b400700 1 -- 172.21.15.120:0/3594451662 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0052a0 con 0x7fd334110ba0 2024-05-14T09:19:33.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.646+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3341a2500 con 0x7fd334110ba0 2024-05-14T09:19:33.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.647+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3340512c0 con 0x7fd334110ba0 2024-05-14T09:19:33.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.651+0000 7fd32b400700 1 -- 172.21.15.120:0/3594451662 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fd32c024070 con 0x7fd334110ba0 2024-05-14T09:19:33.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.653+0000 7fd32b400700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd3180b2880 0x7fd3180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:33.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.653+0000 7fd32b400700 1 -- 172.21.15.120:0/3594451662 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fd32c00f020 con 0x7fd334110ba0 2024-05-14T09:19:33.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.653+0000 7fd332a00700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd3180b2880 0x7fd3180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:33.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.654+0000 7fd332a00700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd3180b2880 0x7fd3180b4d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd324005950 tx=0x7fd32400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:33.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.656+0000 7fd32b400700 1 -- 172.21.15.120:0/3594451662 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd32c02b020 con 0x7fd334110ba0 2024-05-14T09:19:33.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.939+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd33402e5f0 con 0x7fd334110ba0 2024-05-14T09:19:33.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.986+0000 7fd32b400700 1 -- 172.21.15.120:0/3594451662 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7fd32c0abac0 con 0x7fd334110ba0 2024-05-14T09:19:33.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.989+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd3180b2880 msgr2=0x7fd3180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:33.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.989+0000 7fd339800700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd3180b2880 0x7fd3180b4d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd324005950 tx=0x7fd32400a300 comp rx=0 tx=0).stop 2024-05-14T09:19:33.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.989+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 msgr2=0x7fd3341a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:33.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.989+0000 7fd339800700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd3341a16f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00b830 tx=0x7fd32c004d00 comp rx=0 tx=0).stop 2024-05-14T09:19:33.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 shutdown_connections 2024-05-14T09:19:33.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd3180b2880 0x7fd3180b4d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd334110ba0 0x7fd3341a16f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd334075d30 0x7fd33419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 --2- 172.21.15.120:0/3594451662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd334076680 0x7fd33419d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:33.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 >> 172.21.15.120:0/3594451662 conn(0x7fd334100040 msgr2=0x7fd334101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:33.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 shutdown_connections 2024-05-14T09:19:33.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:33.990+0000 7fd339800700 1 -- 172.21.15.120:0/3594451662 wait complete. 2024-05-14T09:19:34.260 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:33 smithi152 ceph-mon[34868]: pgmap v434: 129 pgs: 129 active+clean; 586 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-14T09:19:34.260 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:33 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3594451662' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T09:19:34.377 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:33 smithi120 ceph-mon[31085]: pgmap v434: 129 pgs: 129 active+clean; 586 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-14T09:19:34.377 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:33 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3594451662' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T09:19:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:33 smithi175 ceph-mon[35353]: pgmap v434: 129 pgs: 129 active+clean; 586 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-14T09:19:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:33 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3594451662' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T09:19:34.764 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-14T09:19:34.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-14T09:19:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:35.362 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:35 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3594451662' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T09:19:35.362 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:35 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:19:35.363 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:35 smithi120 ceph-mon[31085]: pgmap v435: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-05-14T09:19:35.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:35 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3594451662' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T09:19:35.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:35 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:19:35.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:35 smithi152 ceph-mon[34868]: pgmap v435: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-05-14T09:19:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:35 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3594451662' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T09:19:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:35 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:19:35.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:35 smithi175 ceph-mon[35353]: pgmap v435: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-05-14T09:19:37.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 -- 172.21.15.120:0/3775080990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc108740 msgr2=0x7f04dc1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:37.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 --2- 172.21.15.120:0/3775080990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc108740 0x7f04dc1100a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04d400b0d0 tx=0x7f04d400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 -- 172.21.15.120:0/3775080990 shutdown_connections 2024-05-14T09:19:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 --2- 172.21.15.120:0/3775080990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc108740 0x7f04dc1100a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 --2- 172.21.15.120:0/3775080990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04dc1034c0 0x7f04dc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 --2- 172.21.15.120:0/3775080990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04dc107df0 0x7f04dc108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 -- 172.21.15.120:0/3775080990 >> 172.21.15.120:0/3775080990 conn(0x7f04dc0fedc0 msgr2=0x7f04dc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 -- 172.21.15.120:0/3775080990 shutdown_connections 2024-05-14T09:19:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.365+0000 7f04e0c00700 1 -- 172.21.15.120:0/3775080990 wait complete. 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.366+0000 7f04e0c00700 1 Processor -- start 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04e0c00700 1 -- start start 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04e0c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc1034c0 0x7f04dc19ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04e0c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04dc107df0 0x7f04dc19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04e0c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04dc108740 0x7f04dc19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04e0c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc113240 con 0x7f04dc1034c0 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04e0c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1130c0 con 0x7f04dc108740 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04e0c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc1133c0 con 0x7f04dc107df0 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04d9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc1034c0 0x7f04dc19ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04d9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc1034c0 0x7f04dc19ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33600/0 (socket says 172.21.15.120:33600) 2024-05-14T09:19:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.367+0000 7f04d9e00700 1 -- 172.21.15.120:0/2272012490 learned_addr learned my addr 172.21.15.120:0/2272012490 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9400700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04dc107df0 0x7f04dc19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04da800700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04dc108740 0x7f04dc19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9e00700 1 -- 172.21.15.120:0/2272012490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04dc107df0 msgr2=0x7f04dc19b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9e00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04dc107df0 0x7f04dc19b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9e00700 1 -- 172.21.15.120:0/2272012490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04dc108740 msgr2=0x7f04dc19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9e00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04dc108740 0x7f04dc19f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9e00700 1 -- 172.21.15.120:0/2272012490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc19fba0 con 0x7f04dc1034c0 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9400700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04dc107df0 0x7f04dc19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:19:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.368+0000 7f04d9e00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc1034c0 0x7f04dc19ad80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00c970 tx=0x7f04cc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.369+0000 7f04d2a00700 1 -- 172.21.15.120:0/2272012490 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc007aa0 con 0x7f04dc1034c0 2024-05-14T09:19:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.369+0000 7f04d2a00700 1 -- 172.21.15.120:0/2272012490 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04cc004cc0 con 0x7f04dc1034c0 2024-05-14T09:19:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.369+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04dc19fe90 con 0x7f04dc1034c0 2024-05-14T09:19:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.369+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04dc1a0380 con 0x7f04dc1034c0 2024-05-14T09:19:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.369+0000 7f04d2a00700 1 -- 172.21.15.120:0/2272012490 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc005500 con 0x7f04dc1034c0 2024-05-14T09:19:37.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.370+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04dc0512c0 con 0x7f04dc1034c0 2024-05-14T09:19:37.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.375+0000 7f04d2a00700 1 -- 172.21.15.120:0/2272012490 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f04cc007c40 con 0x7f04dc1034c0 2024-05-14T09:19:37.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.377+0000 7f04d2a00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04c00b2880 0x7f04c00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:37.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.377+0000 7f04d2a00700 1 -- 172.21.15.120:0/2272012490 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f04cc0e26c0 con 0x7f04dc1034c0 2024-05-14T09:19:37.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.377+0000 7f04d9400700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04c00b2880 0x7f04c00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:37.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.378+0000 7f04d9400700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04c00b2880 0x7f04c00b4d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04c8005fd0 tx=0x7f04c800a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:37.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.378+0000 7f04d2a00700 1 -- 172.21.15.120:0/2272012490 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f04cc0aa160 con 0x7f04dc1034c0 2024-05-14T09:19:37.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:37 smithi120 ceph-mon[31085]: pgmap v436: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T09:19:37.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.645+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f04dc19c0e0 con 0x7f04c00b2880 2024-05-14T09:19:37.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:37 smithi152 ceph-mon[34868]: pgmap v436: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T09:19:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.727+0000 7f04d2a00700 1 -- 172.21.15.120:0/2272012490 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f04dc19c0e0 con 0x7f04c00b2880 2024-05-14T09:19:37.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:37 smithi175 ceph-mon[35353]: pgmap v436: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T09:19:37.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04c00b2880 msgr2=0x7f04c00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:37.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04c00b2880 0x7f04c00b4d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04c8005fd0 tx=0x7f04c800a5e0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc1034c0 msgr2=0x7f04dc19ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:37.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc1034c0 0x7f04dc19ad80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00c970 tx=0x7f04cc00cd30 comp rx=0 tx=0).stop 2024-05-14T09:19:37.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 shutdown_connections 2024-05-14T09:19:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04c00b2880 0x7f04c00b4d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04dc108740 0x7f04dc19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc1034c0 0x7f04dc19ad80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 --2- 172.21.15.120:0/2272012490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04dc107df0 0x7f04dc19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.730+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 >> 172.21.15.120:0/2272012490 conn(0x7f04dc0fedc0 msgr2=0x7f04dc06b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.731+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 shutdown_connections 2024-05-14T09:19:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:37.731+0000 7f04e0c00700 1 -- 172.21.15.120:0/2272012490 wait complete. 2024-05-14T09:19:38.113 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:19:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:19:37.655+0000 7f7520c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T09:19:38.113 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:19:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:19:37.656+0000 7f7520c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T09:19:38.113 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:19:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:19:37.656+0000 7f7520c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T09:19:38.113 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:19:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:19:37.656+0000 7f7520c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T09:19:38.113 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:19:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:19:37.656+0000 7f7520c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T09:19:38.575 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-14T09:19:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:38 smithi152 ceph-mon[34868]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:38.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:38 smithi175 ceph-mon[35353]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:38.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:38 smithi120 ceph-mon[31085]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:39.502 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:39 smithi120 ceph-mon[31085]: pgmap v437: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.1 KiB/s wr, 21 op/s 2024-05-14T09:19:39.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:39 smithi152 ceph-mon[34868]: pgmap v437: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.1 KiB/s wr, 21 op/s 2024-05-14T09:19:39.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:39 smithi175 ceph-mon[35353]: pgmap v437: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.1 KiB/s wr, 21 op/s 2024-05-14T09:19:40.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:40 smithi120 ceph-mon[31085]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-14T09:19:40.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:40 smithi152 ceph-mon[34868]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-14T09:19:40.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:40 smithi175 ceph-mon[35353]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-14T09:19:41.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 -- 172.21.15.120:0/958230590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 msgr2=0x7f7f8c106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:41.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 --2- 172.21.15.120:0/958230590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c106990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009990 tx=0x7f7f74009ca0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 -- 172.21.15.120:0/958230590 shutdown_connections 2024-05-14T09:19:41.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 --2- 172.21.15.120:0/958230590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c106ed0 0x7f7f8c113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 --2- 172.21.15.120:0/958230590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c10c5c0 0x7f7f8c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 --2- 172.21.15.120:0/958230590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c106990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 -- 172.21.15.120:0/958230590 >> 172.21.15.120:0/958230590 conn(0x7f7f8c102080 msgr2=0x7f7f8c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:41.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 -- 172.21.15.120:0/958230590 shutdown_connections 2024-05-14T09:19:41.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.202+0000 7f7f92200700 1 -- 172.21.15.120:0/958230590 wait complete. 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 Processor -- start 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 -- start start 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c19d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c106ed0 0x7f7f8c19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c10c5c0 0x7f7f8c1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1165a0 con 0x7f7f8c106580 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c116420 con 0x7f7f8c10c5c0 2024-05-14T09:19:41.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.204+0000 7f7f92200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c116720 con 0x7f7f8c106ed0 2024-05-14T09:19:41.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c19d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c19d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47498/0 (socket says 172.21.15.120:47498) 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 -- 172.21.15.120:0/2540207169 learned_addr learned my addr 172.21.15.120:0/2540207169 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f83e00700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c106ed0 0x7f7f8c19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8be00700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c10c5c0 0x7f7f8c1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 -- 172.21.15.120:0/2540207169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c106ed0 msgr2=0x7f7f8c19d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c106ed0 0x7f7f8c19d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 -- 172.21.15.120:0/2540207169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c10c5c0 msgr2=0x7f7f8c1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c10c5c0 0x7f7f8c1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.205+0000 7f7f8b400700 1 -- 172.21.15.120:0/2540207169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c1a1e90 con 0x7f7f8c106580 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.206+0000 7f7f8b400700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c19d070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00d980 tx=0x7f7f7c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.206+0000 7f7f88c00700 1 -- 172.21.15.120:0/2540207169 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c017070 con 0x7f7f8c106580 2024-05-14T09:19:41.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.206+0000 7f7f88c00700 1 -- 172.21.15.120:0/2540207169 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f7c009dc0 con 0x7f7f8c106580 2024-05-14T09:19:41.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.206+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c1a2180 con 0x7f7f8c106580 2024-05-14T09:19:41.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.206+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c1a2690 con 0x7f7f8c106580 2024-05-14T09:19:41.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.206+0000 7f7f88c00700 1 -- 172.21.15.120:0/2540207169 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00f3c0 con 0x7f7f8c106580 2024-05-14T09:19:41.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.208+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f68005330 con 0x7f7f8c106580 2024-05-14T09:19:41.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.210+0000 7f7f88c00700 1 -- 172.21.15.120:0/2540207169 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f7f7c009930 con 0x7f7f8c106580 2024-05-14T09:19:41.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.213+0000 7f7f88c00700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7f700b2910 0x7f7f700b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:41.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.213+0000 7f7f88c00700 1 -- 172.21.15.120:0/2540207169 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f7f7c0e20a0 con 0x7f7f8c106580 2024-05-14T09:19:41.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.213+0000 7f7f83e00700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7f700b2910 0x7f7f700b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:41.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.214+0000 7f7f83e00700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7f700b2910 0x7f7f700b4e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7f74006010 tx=0x7f7f7400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:41.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.218+0000 7f7f88c00700 1 -- 172.21.15.120:0/2540207169 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7f7c0a98c0 con 0x7f7f8c106580 2024-05-14T09:19:41.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:41 smithi175 ceph-mon[35353]: pgmap v438: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-14T09:19:41.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-05-14T09:19:41.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-05-14T09:19:41.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:41 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]: dispatch 2024-05-14T09:19:41.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.498+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7f68000bc0 con 0x7f7f700b2910 2024-05-14T09:19:41.498 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:41 smithi120 ceph-mon[31085]: pgmap v438: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-14T09:19:41.498 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-05-14T09:19:41.499 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-05-14T09:19:41.499 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:41 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]: dispatch 2024-05-14T09:19:41.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.577+0000 7f7f88c00700 1 -- 172.21.15.120:0/2540207169 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7f68000bc0 con 0x7f7f700b2910 2024-05-14T09:19:41.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.580+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7f700b2910 msgr2=0x7f7f700b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:41.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.580+0000 7f7f92200700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7f700b2910 0x7f7f700b4e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7f74006010 tx=0x7f7f7400b540 comp rx=0 tx=0).stop 2024-05-14T09:19:41.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.580+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 msgr2=0x7f7f8c19d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:41.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.580+0000 7f7f92200700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c19d070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00d980 tx=0x7f7f7c00dc90 comp rx=0 tx=0).stop 2024-05-14T09:19:41.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 shutdown_connections 2024-05-14T09:19:41.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7f700b2910 0x7f7f700b4e20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c10c5c0 0x7f7f8c1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f8c106580 0x7f7f8c19d070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 --2- 172.21.15.120:0/2540207169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c106ed0 0x7f7f8c19d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:41.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 >> 172.21.15.120:0/2540207169 conn(0x7f7f8c102080 msgr2=0x7f7f8c1049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:41.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 shutdown_connections 2024-05-14T09:19:41.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:41.581+0000 7f7f92200700 1 -- 172.21.15.120:0/2540207169 wait complete. 2024-05-14T09:19:41.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:41 smithi152 ceph-mon[34868]: pgmap v438: 129 pgs: 129 active+clean; 587 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-14T09:19:41.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-05-14T09:19:41.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-05-14T09:19:41.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:41 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]: dispatch 2024-05-14T09:19:42.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-14T09:19:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-05-14T09:19:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-05-14T09:19:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]': finished 2024-05-14T09:19:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:42 smithi120 ceph-mon[31085]: osdmap e89: 12 total, 12 up, 12 in 2024-05-14T09:19:42.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:42 smithi120 ceph-mon[31085]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-05-14T09:19:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-05-14T09:19:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]': finished 2024-05-14T09:19:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:42 smithi152 ceph-mon[34868]: osdmap e89: 12 total, 12 up, 12 in 2024-05-14T09:19:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:42 smithi152 ceph-mon[34868]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:42.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-05-14T09:19:42.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-05-14T09:19:42.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]': finished 2024-05-14T09:19:42.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:42 smithi175 ceph-mon[35353]: osdmap e89: 12 total, 12 up, 12 in 2024-05-14T09:19:42.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:42 smithi175 ceph-mon[35353]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:42.808 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:43.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:43 smithi120 ceph-mon[31085]: pgmap v440: 129 pgs: 129 active+clean; 594 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-05-14T09:19:43.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:43 smithi120 ceph-mon[31085]: osdmap e90: 12 total, 12 up, 12 in 2024-05-14T09:19:43.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:43 smithi152 ceph-mon[34868]: pgmap v440: 129 pgs: 129 active+clean; 594 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-05-14T09:19:43.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:43 smithi152 ceph-mon[34868]: osdmap e90: 12 total, 12 up, 12 in 2024-05-14T09:19:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:43 smithi175 ceph-mon[35353]: pgmap v440: 129 pgs: 129 active+clean; 594 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-05-14T09:19:43.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:43 smithi175 ceph-mon[35353]: osdmap e90: 12 total, 12 up, 12 in 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.061+0000 7f7177600700 1 -- 172.21.15.120:0/3974389754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010b2e0 msgr2=0x7f7170117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.061+0000 7f7177600700 1 --2- 172.21.15.120:0/3974389754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010b2e0 0x7f7170117810 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f716800b0a0 tx=0x7f716800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.061+0000 7f7177600700 1 -- 172.21.15.120:0/3974389754 shutdown_connections 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.061+0000 7f7177600700 1 --2- 172.21.15.120:0/3974389754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7170110970 0x7f7170110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.061+0000 7f7177600700 1 --2- 172.21.15.120:0/3974389754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010b2e0 0x7f7170117810 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.061+0000 7f7177600700 1 --2- 172.21.15.120:0/3974389754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717010a990 0x7f717010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.061+0000 7f7177600700 1 -- 172.21.15.120:0/3974389754 >> 172.21.15.120:0/3974389754 conn(0x7f7170077c80 msgr2=0x7f71700780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.062+0000 7f7177600700 1 -- 172.21.15.120:0/3974389754 shutdown_connections 2024-05-14T09:19:45.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.062+0000 7f7177600700 1 -- 172.21.15.120:0/3974389754 wait complete. 2024-05-14T09:19:45.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.063+0000 7f7177600700 1 Processor -- start 2024-05-14T09:19:45.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.063+0000 7f7177600700 1 -- start start 2024-05-14T09:19:45.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7177600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010a990 0x7f71701a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:45.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7177600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717010b2e0 0x7f71701a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:45.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7177600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7170110970 0x7f71701a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:45.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7177600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f717011a990 con 0x7f717010a990 2024-05-14T09:19:45.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7177600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f717011a810 con 0x7f7170110970 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7177600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f717011ab10 con 0x7f717010b2e0 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010a990 0x7f71701a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010a990 0x7f71701a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47514/0 (socket says 172.21.15.120:47514) 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 -- 172.21.15.120:0/1950860401 learned_addr learned my addr 172.21.15.120:0/1950860401 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f716fe00700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717010b2e0 0x7f71701a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7175600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7170110970 0x7f71701a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 -- 172.21.15.120:0/1950860401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717010b2e0 msgr2=0x7f71701a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717010b2e0 0x7f71701a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 -- 172.21.15.120:0/1950860401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7170110970 msgr2=0x7f71701a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7170110970 0x7f71701a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.064+0000 7f7174c00700 1 -- 172.21.15.120:0/1950860401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71701a6160 con 0x7f717010a990 2024-05-14T09:19:45.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.065+0000 7f7174c00700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010a990 0x7f71701a1340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f716400c9e0 tx=0x7f716400cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:45.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.065+0000 7f716d600700 1 -- 172.21.15.120:0/1950860401 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164007aa0 con 0x7f717010a990 2024-05-14T09:19:45.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.065+0000 7f716d600700 1 -- 172.21.15.120:0/1950860401 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7164007c40 con 0x7f717010a990 2024-05-14T09:19:45.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.065+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71701a6450 con 0x7f717010a990 2024-05-14T09:19:45.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.065+0000 7f716d600700 1 -- 172.21.15.120:0/1950860401 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164018660 con 0x7f717010a990 2024-05-14T09:19:45.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.065+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71701ade20 con 0x7f717010a990 2024-05-14T09:19:45.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.066+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71700512c0 con 0x7f717010a990 2024-05-14T09:19:45.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.069+0000 7f716d600700 1 -- 172.21.15.120:0/1950860401 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f7164018800 con 0x7f717010a990 2024-05-14T09:19:45.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.070+0000 7f716d600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71580b2990 0x7f71580b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:45.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.071+0000 7f716d600700 1 -- 172.21.15.120:0/1950860401 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f71640e2810 con 0x7f717010a990 2024-05-14T09:19:45.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.071+0000 7f716fe00700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71580b2990 0x7f71580b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:45.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.072+0000 7f716fe00700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71580b2990 0x7f71580b4ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f715c005950 tx=0x7f715c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:45.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.073+0000 7f716d600700 1 -- 172.21.15.120:0/1950860401 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7164054df0 con 0x7f717010a990 2024-05-14T09:19:45.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.339+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f71701a26a0 con 0x7f71580b2990 2024-05-14T09:19:45.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.352+0000 7f716d600700 1 -- 172.21.15.120:0/1950860401 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f71701a26a0 con 0x7f71580b2990 2024-05-14T09:19:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e 2024-05-14T09:19:45.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.354+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71580b2990 msgr2=0x7f71580b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.354+0000 7f7177600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71580b2990 0x7f71580b4ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f715c005950 tx=0x7f715c0058e0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.354+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010a990 msgr2=0x7f71701a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.354+0000 7f7177600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010a990 0x7f71701a1340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f716400c9e0 tx=0x7f716400cda0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 shutdown_connections 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71580b2990 0x7f71580b4ea0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7170110970 0x7f71701a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f717010a990 0x7f71701a1340 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 --2- 172.21.15.120:0/1950860401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717010b2e0 0x7f71701a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 >> 172.21.15.120:0/1950860401 conn(0x7f7170077c80 msgr2=0x7f717007b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 shutdown_connections 2024-05-14T09:19:45.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:45.355+0000 7f7177600700 1 -- 172.21.15.120:0/1950860401 wait complete. 2024-05-14T09:19:45.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:45 smithi120 ceph-mon[31085]: pgmap v442: 129 pgs: 129 active+clean; 594 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-14T09:19:45.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:45 smithi175 ceph-mon[35353]: pgmap v442: 129 pgs: 129 active+clean; 594 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-14T09:19:45.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:45 smithi152 ceph-mon[34868]: pgmap v442: 129 pgs: 129 active+clean; 594 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-14T09:19:46.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-14T09:19:46.707 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:46.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:46 smithi175 ceph-mon[35353]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:46.855 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:46 smithi120 ceph-mon[31085]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:46.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:46 smithi152 ceph-mon[34868]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:47.740 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:47 smithi120 ceph-mon[31085]: pgmap v443: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-05-14T09:19:47.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:47 smithi152 ceph-mon[34868]: pgmap v443: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-05-14T09:19:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:47 smithi175 ceph-mon[35353]: pgmap v443: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-05-14T09:19:49.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.139+0000 7f0c4f200700 1 -- 172.21.15.120:0/1814018054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c4810e910 msgr2=0x7f0c48110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.139+0000 7f0c4f200700 1 --2- 172.21.15.120:0/1814018054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c4810e910 0x7f0c48110df0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000b0a0 tx=0x7f0c4000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.139+0000 7f0c4f200700 1 -- 172.21.15.120:0/1814018054 shutdown_connections 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.139+0000 7f0c4f200700 1 --2- 172.21.15.120:0/1814018054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c4810e910 0x7f0c48110df0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.139+0000 7f0c4f200700 1 --2- 172.21.15.120:0/1814018054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c481054e0 0x7f0c481058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.139+0000 7f0c4f200700 1 --2- 172.21.15.120:0/1814018054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c48105e30 0x7f0c4810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.140+0000 7f0c4f200700 1 -- 172.21.15.120:0/1814018054 >> 172.21.15.120:0/1814018054 conn(0x7f0c480fef30 msgr2=0x7f0c48101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.140+0000 7f0c4f200700 1 -- 172.21.15.120:0/1814018054 shutdown_connections 2024-05-14T09:19:49.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.140+0000 7f0c4f200700 1 -- 172.21.15.120:0/1814018054 wait complete. 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.141+0000 7f0c4f200700 1 Processor -- start 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.141+0000 7f0c4f200700 1 -- start start 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.141+0000 7f0c4f200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c481054e0 0x7f0c481a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.141+0000 7f0c4f200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c48105e30 0x7f0c481a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c4f200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c4810e910 0x7f0c4819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c4f200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0c48114320 con 0x7f0c481054e0 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c4f200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0c481141a0 con 0x7f0c48105e30 2024-05-14T09:19:49.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c4f200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0c481144a0 con 0x7f0c4810e910 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c481054e0 0x7f0c481a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c481054e0 0x7f0c481a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48724/0 (socket says 172.21.15.120:48724) 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 -- 172.21.15.120:0/4066177002 learned_addr learned my addr 172.21.15.120:0/4066177002 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47400700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c48105e30 0x7f0c481a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c4d200700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c4810e910 0x7f0c4819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 -- 172.21.15.120:0/4066177002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c4810e910 msgr2=0x7f0c4819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c4810e910 0x7f0c4819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 -- 172.21.15.120:0/4066177002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c48105e30 msgr2=0x7f0c481a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c48105e30 0x7f0c481a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.142+0000 7f0c47e00700 1 -- 172.21.15.120:0/4066177002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4819b150 con 0x7f0c481054e0 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.143+0000 7f0c47e00700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c481054e0 0x7f0c481a08a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800d950 tx=0x7f0c3800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:49.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.143+0000 7f0c44c00700 1 -- 172.21.15.120:0/4066177002 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38016070 con 0x7f0c481054e0 2024-05-14T09:19:49.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.143+0000 7f0c44c00700 1 -- 172.21.15.120:0/4066177002 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c38010460 con 0x7f0c481054e0 2024-05-14T09:19:49.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.143+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4819b3e0 con 0x7f0c481054e0 2024-05-14T09:19:49.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.143+0000 7f0c44c00700 1 -- 172.21.15.120:0/4066177002 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800f620 con 0x7f0c481054e0 2024-05-14T09:19:49.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.143+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4819b920 con 0x7f0c481054e0 2024-05-14T09:19:49.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.144+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c480512c0 con 0x7f0c481054e0 2024-05-14T09:19:49.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.147+0000 7f0c44c00700 1 -- 172.21.15.120:0/4066177002 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f0c38019070 con 0x7f0c481054e0 2024-05-14T09:19:49.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.148+0000 7f0c44c00700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0c2c0b2910 0x7f0c2c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:49.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.149+0000 7f0c44c00700 1 -- 172.21.15.120:0/4066177002 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0c380e23b0 con 0x7f0c481054e0 2024-05-14T09:19:49.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.149+0000 7f0c47400700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0c2c0b2910 0x7f0c2c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:49.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.150+0000 7f0c47400700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0c2c0b2910 0x7f0c2c0b4e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c34005fd0 tx=0x7f0c3400af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:49.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.151+0000 7f0c44c00700 1 -- 172.21.15.120:0/4066177002 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0c380a9b70 con 0x7f0c481054e0 2024-05-14T09:19:49.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.419+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0c48063c00 con 0x7f0c2c0b2910 2024-05-14T09:19:49.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.493+0000 7f0c44c00700 1 -- 172.21.15.120:0/4066177002 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0c48063c00 con 0x7f0c2c0b2910 2024-05-14T09:19:49.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0c2c0b2910 msgr2=0x7f0c2c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:49.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0c2c0b2910 0x7f0c2c0b4e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c34005fd0 tx=0x7f0c3400af20 comp rx=0 tx=0).stop 2024-05-14T09:19:49.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c481054e0 msgr2=0x7f0c481a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:49.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c481054e0 0x7f0c481a08a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800d950 tx=0x7f0c3800dd10 comp rx=0 tx=0).stop 2024-05-14T09:19:49.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 shutdown_connections 2024-05-14T09:19:49.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0c2c0b2910 0x7f0c2c0b4e20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c4810e910 0x7f0c4819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c481054e0 0x7f0c481a08a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 --2- 172.21.15.120:0/4066177002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c48105e30 0x7f0c481a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:49.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.496+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 >> 172.21.15.120:0/4066177002 conn(0x7f0c480fef30 msgr2=0x7f0c480ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:49.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.497+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 shutdown_connections 2024-05-14T09:19:49.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:49.497+0000 7f0c4f200700 1 -- 172.21.15.120:0/4066177002 wait complete. 2024-05-14T09:19:49.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:49 smithi120 ceph-mon[31085]: pgmap v444: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-14T09:19:49.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:49 smithi152 ceph-mon[34868]: pgmap v444: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-14T09:19:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:49 smithi175 ceph-mon[35353]: pgmap v444: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-14T09:19:50.420 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-14T09:19:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:50 smithi120 ceph-mon[31085]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:50.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:50 smithi152 ceph-mon[34868]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:50.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:50 smithi175 ceph-mon[35353]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:51.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:51 smithi120 ceph-mon[31085]: pgmap v445: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-14T09:19:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:51 smithi152 ceph-mon[34868]: pgmap v445: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-14T09:19:51.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:51 smithi175 ceph-mon[35353]: pgmap v445: 129 pgs: 129 active+clean; 613 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-14T09:19:53.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 -- 172.21.15.120:0/1608743073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167810e910 msgr2=0x7f1678110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:53.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 --2- 172.21.15.120:0/1608743073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167810e910 0x7f1678110de0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f167000b0a0 tx=0x7f167000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 -- 172.21.15.120:0/1608743073 shutdown_connections 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 --2- 172.21.15.120:0/1608743073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16781054e0 0x7f16781058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 --2- 172.21.15.120:0/1608743073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167810e910 0x7f1678110de0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 --2- 172.21.15.120:0/1608743073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1678105e30 0x7f167810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 -- 172.21.15.120:0/1608743073 >> 172.21.15.120:0/1608743073 conn(0x7f16780fedf0 msgr2=0x7f1678101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 -- 172.21.15.120:0/1608743073 shutdown_connections 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.346+0000 7f167fc00700 1 -- 172.21.15.120:0/1608743073 wait complete. 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.347+0000 7f167fc00700 1 Processor -- start 2024-05-14T09:19:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.347+0000 7f167fc00700 1 -- start start 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167fc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16781054e0 0x7f16781031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167fc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1678105e30 0x7f1678103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167fc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f167810e910 0x7f1678103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167fc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1678114380 con 0x7f16781054e0 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167fc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1678114200 con 0x7f167810e910 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167fc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1678114500 con 0x7f1678105e30 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16781054e0 0x7f16781031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:53.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16781054e0 0x7f16781031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48744/0 (socket says 172.21.15.120:48744) 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167d200700 1 -- 172.21.15.120:0/1056523776 learned_addr learned my addr 172.21.15.120:0/1056523776 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f1677e00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1678105e30 0x7f1678103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.348+0000 7f167dc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f167810e910 0x7f1678103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167d200700 1 -- 172.21.15.120:0/1056523776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1678105e30 msgr2=0x7f1678103710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167d200700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1678105e30 0x7f1678103710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167d200700 1 -- 172.21.15.120:0/1056523776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f167810e910 msgr2=0x7f1678103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167d200700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f167810e910 0x7f1678103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167d200700 1 -- 172.21.15.120:0/1056523776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16781a9110 con 0x7f16781054e0 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167dc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f167810e910 0x7f1678103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167d200700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16781054e0 0x7f16781031d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c970 tx=0x7f166c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f1675600700 1 -- 172.21.15.120:0/1056523776 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c004220 con 0x7f16781054e0 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f1675600700 1 -- 172.21.15.120:0/1056523776 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f166c007d30 con 0x7f16781054e0 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16781a93a0 con 0x7f16781054e0 2024-05-14T09:19:53.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.349+0000 7f1675600700 1 -- 172.21.15.120:0/1056523776 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c003c90 con 0x7f16781054e0 2024-05-14T09:19:53.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.350+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16781a98e0 con 0x7f16781054e0 2024-05-14T09:19:53.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.351+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16780512c0 con 0x7f16781054e0 2024-05-14T09:19:53.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.353+0000 7f1675600700 1 -- 172.21.15.120:0/1056523776 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f166c0078a0 con 0x7f16781054e0 2024-05-14T09:19:53.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.355+0000 7f1675600700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16600b2910 0x7f16600b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:53.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.355+0000 7f1675600700 1 -- 172.21.15.120:0/1056523776 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f166c0e2790 con 0x7f16781054e0 2024-05-14T09:19:53.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.355+0000 7f1677e00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16600b2910 0x7f16600b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:53.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.356+0000 7f1677e00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16600b2910 0x7f16600b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16781024d0 tx=0x7f166400b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:53.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.358+0000 7f1675600700 1 -- 172.21.15.120:0/1056523776 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f166c014030 con 0x7f16781054e0 2024-05-14T09:19:53.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.626+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1678063c00 con 0x7f16600b2910 2024-05-14T09:19:53.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:53 smithi120 ceph-mon[31085]: pgmap v446: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-05-14T09:19:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.639+0000 7f1675600700 1 -- 172.21.15.120:0/1056523776 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1678063c00 con 0x7f16600b2910 2024-05-14T09:19:53.639 INFO:teuthology.orchestra.run.smithi120.stdout:/volumes/qa/sv_1/7546b93d-58ec-44d3-8224-f49823f8fed1 2024-05-14T09:19:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.641+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16600b2910 msgr2=0x7f16600b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16600b2910 0x7f16600b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16781024d0 tx=0x7f166400b590 comp rx=0 tx=0).stop 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16781054e0 msgr2=0x7f16781031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16781054e0 0x7f16781031d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c970 tx=0x7f166c00cd30 comp rx=0 tx=0).stop 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 shutdown_connections 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16600b2910 0x7f16600b4e20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f167810e910 0x7f1678103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16781054e0 0x7f16781031d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 --2- 172.21.15.120:0/1056523776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1678105e30 0x7f1678103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 >> 172.21.15.120:0/1056523776 conn(0x7f16780fedf0 msgr2=0x7f16780ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 shutdown_connections 2024-05-14T09:19:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:53.642+0000 7f167fc00700 1 -- 172.21.15.120:0/1056523776 wait complete. 2024-05-14T09:19:53.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:53 smithi152 ceph-mon[34868]: pgmap v446: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-05-14T09:19:53.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:53 smithi175 ceph-mon[35353]: pgmap v446: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-05-14T09:19:54.450 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:19:54.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:54 smithi120 ceph-mon[31085]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:54.904 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:54.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:54 smithi152 ceph-mon[34868]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:54.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:54 smithi175 ceph-mon[35353]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:19:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:55 smithi120 ceph-mon[31085]: pgmap v447: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-05-14T09:19:55.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:55 smithi152 ceph-mon[34868]: pgmap v447: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-05-14T09:19:55.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:55 smithi175 ceph-mon[35353]: pgmap v447: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 -- 172.21.15.120:0/2811555292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3941045f0 msgr2=0x7fc394104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 --2- 172.21.15.120:0/2811555292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3941045f0 0x7fc394104a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc3840099c0 tx=0x7fc384009cd0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 -- 172.21.15.120:0/2811555292 shutdown_connections 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 --2- 172.21.15.120:0/2811555292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc394109870 0x7fc3941111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 --2- 172.21.15.120:0/2811555292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3941045f0 0x7fc394104a00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 --2- 172.21.15.120:0/2811555292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc394108f20 0x7fc394109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 -- 172.21.15.120:0/2811555292 >> 172.21.15.120:0/2811555292 conn(0x7fc394100040 msgr2=0x7fc394102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:57.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 -- 172.21.15.120:0/2811555292 shutdown_connections 2024-05-14T09:19:57.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.205+0000 7fc39a600700 1 -- 172.21.15.120:0/2811555292 wait complete. 2024-05-14T09:19:57.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.206+0000 7fc39a600700 1 Processor -- start 2024-05-14T09:19:57.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.207+0000 7fc39a600700 1 -- start start 2024-05-14T09:19:57.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.207+0000 7fc39a600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3941045f0 0x7fc39419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:57.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.207+0000 7fc39a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394108f20 0x7fc39419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:57.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.207+0000 7fc39a600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc394109870 0x7fc39419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:57.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.207+0000 7fc39a600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc3941143a0 con 0x7fc394108f20 2024-05-14T09:19:57.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.207+0000 7fc39a600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc394114220 con 0x7fc3941045f0 2024-05-14T09:19:57.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.207+0000 7fc39a600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc394114520 con 0x7fc394109870 2024-05-14T09:19:57.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394108f20 0x7fc39419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:57.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394108f20 0x7fc39419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48758/0 (socket says 172.21.15.120:48758) 2024-05-14T09:19:57.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 -- 172.21.15.120:0/1048545095 learned_addr learned my addr 172.21.15.120:0/1048545095 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:19:57.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc393400700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3941045f0 0x7fc39419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:57.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc393e00700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc394109870 0x7fc39419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 -- 172.21.15.120:0/1048545095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc394109870 msgr2=0x7fc39419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc394109870 0x7fc39419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 -- 172.21.15.120:0/1048545095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3941045f0 msgr2=0x7fc39419adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3941045f0 0x7fc39419adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.208+0000 7fc392a00700 1 -- 172.21.15.120:0/1048545095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39419fc80 con 0x7fc394108f20 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.209+0000 7fc392a00700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394108f20 0x7fc39419b350 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc38000d980 tx=0x7fc38000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.209+0000 7fc38be00700 1 -- 172.21.15.120:0/1048545095 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380017070 con 0x7fc394108f20 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.209+0000 7fc38be00700 1 -- 172.21.15.120:0/1048545095 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc380009dc0 con 0x7fc394108f20 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.209+0000 7fc38be00700 1 -- 172.21.15.120:0/1048545095 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38000f3c0 con 0x7fc394108f20 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.209+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39419ff70 con 0x7fc394108f20 2024-05-14T09:19:57.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.209+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3940759f0 con 0x7fc394108f20 2024-05-14T09:19:57.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.211+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc394105aa0 con 0x7fc394108f20 2024-05-14T09:19:57.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.216+0000 7fc38be00700 1 -- 172.21.15.120:0/1048545095 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fc380009930 con 0x7fc394108f20 2024-05-14T09:19:57.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.219+0000 7fc38be00700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3780b2910 0x7fc3780b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:19:57.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.219+0000 7fc38be00700 1 -- 172.21.15.120:0/1048545095 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc3800e2280 con 0x7fc394108f20 2024-05-14T09:19:57.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.219+0000 7fc393400700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3780b2910 0x7fc3780b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:19:57.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.219+0000 7fc38be00700 1 -- 172.21.15.120:0/1048545095 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3800a9a40 con 0x7fc394108f20 2024-05-14T09:19:57.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.220+0000 7fc393400700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3780b2910 0x7fc3780b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc384000c00 tx=0x7fc384005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:19:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.493+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc39419c110 con 0x7fc394108f20 2024-05-14T09:19:57.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.495+0000 7fc38be00700 1 -- 172.21.15.120:0/1048545095 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11957 (secure 0 0 0) 0x7fc3800a9340 con 0x7fc394108f20 2024-05-14T09:19:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:19:57.496 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:19:33.941015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:19:57.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3780b2910 msgr2=0x7fc3780b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:57.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3780b2910 0x7fc3780b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc384000c00 tx=0x7fc384005fb0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394108f20 msgr2=0x7fc39419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:19:57.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394108f20 0x7fc39419b350 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc38000d980 tx=0x7fc38000dc90 comp rx=0 tx=0).stop 2024-05-14T09:19:57.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 shutdown_connections 2024-05-14T09:19:57.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc3780b2910 0x7fc3780b4e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3941045f0 0x7fc39419adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc394109870 0x7fc39419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 --2- 172.21.15.120:0/1048545095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394108f20 0x7fc39419b350 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:19:57.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.498+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 >> 172.21.15.120:0/1048545095 conn(0x7fc394100040 msgr2=0x7fc394102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:19:57.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.499+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 shutdown_connections 2024-05-14T09:19:57.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:19:57.499+0000 7fc39a600700 1 -- 172.21.15.120:0/1048545095 wait complete. 2024-05-14T09:19:57.503 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-05-14T09:19:57.877 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:57 smithi120 ceph-mon[31085]: pgmap v448: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-14T09:19:57.877 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:57 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1048545095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:19:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:57 smithi152 ceph-mon[34868]: pgmap v448: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-14T09:19:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:57 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1048545095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:19:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:57 smithi175 ceph-mon[35353]: pgmap v448: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-14T09:19:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:57 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1048545095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:19:58.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:19:58.761 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:19:59.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:19:59 smithi120 ceph-mon[31085]: pgmap v449: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-14T09:19:59.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:19:59 smithi152 ceph-mon[34868]: pgmap v449: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-14T09:19:59.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:19:59 smithi175 ceph-mon[35353]: pgmap v449: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-14T09:20:00.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:00 smithi120 ceph-mon[31085]: overall HEALTH_OK 2024-05-14T09:20:00.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:00 smithi152 ceph-mon[34868]: overall HEALTH_OK 2024-05-14T09:20:00.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:00 smithi175 ceph-mon[35353]: overall HEALTH_OK 2024-05-14T09:20:01.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 -- 172.21.15.120:0/3101224277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5438106570 msgr2=0x7f5438106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:01.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 --2- 172.21.15.120:0/3101224277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5438106570 0x7f5438106980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5424009990 tx=0x7f5424009ca0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 -- 172.21.15.120:0/3101224277 shutdown_connections 2024-05-14T09:20:01.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 --2- 172.21.15.120:0/3101224277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f543810c5b0 0x7f543810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 --2- 172.21.15.120:0/3101224277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5438106ec0 0x7f5438113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 --2- 172.21.15.120:0/3101224277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5438106570 0x7f5438106980 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 -- 172.21.15.120:0/3101224277 >> 172.21.15.120:0/3101224277 conn(0x7f5438102050 msgr2=0x7f54381044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:01.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 -- 172.21.15.120:0/3101224277 shutdown_connections 2024-05-14T09:20:01.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.011+0000 7f543f200700 1 -- 172.21.15.120:0/3101224277 wait complete. 2024-05-14T09:20:01.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.013+0000 7f543f200700 1 Processor -- start 2024-05-14T09:20:01.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.013+0000 7f543f200700 1 -- start start 2024-05-14T09:20:01.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.013+0000 7f543f200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5438106570 0x7f543819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:01.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.013+0000 7f543f200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5438106ec0 0x7f543819d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:01.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f543f200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f543810c5b0 0x7f54381a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:01.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f543f200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5438116590 con 0x7f543810c5b0 2024-05-14T09:20:01.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f543f200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5438116410 con 0x7f5438106ec0 2024-05-14T09:20:01.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f543f200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5438116710 con 0x7f5438106570 2024-05-14T09:20:01.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f543d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f543810c5b0 0x7f54381a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:01.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f543d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f543810c5b0 0x7f54381a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48124/0 (socket says 172.21.15.120:48124) 2024-05-14T09:20:01.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f543d200700 1 -- 172.21.15.120:0/1047997881 learned_addr learned my addr 172.21.15.120:0/1047997881 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:01.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f5437400700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5438106ec0 0x7f543819d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:01.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.014+0000 7f5437e00700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5438106570 0x7f543819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:01.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f543d200700 1 -- 172.21.15.120:0/1047997881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5438106570 msgr2=0x7f543819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:01.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f543d200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5438106570 0x7f543819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f543d200700 1 -- 172.21.15.120:0/1047997881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5438106ec0 msgr2=0x7f543819d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:01.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f543d200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5438106ec0 0x7f543819d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f543d200700 1 -- 172.21.15.120:0/1047997881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54381a1d80 con 0x7f543810c5b0 2024-05-14T09:20:01.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f543d200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f543810c5b0 0x7f54381a1790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f543000ada0 tx=0x7f543000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:01.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f5434c00700 1 -- 172.21.15.120:0/1047997881 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430017020 con 0x7f543810c5b0 2024-05-14T09:20:01.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f5434c00700 1 -- 172.21.15.120:0/1047997881 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f543000ce10 con 0x7f543810c5b0 2024-05-14T09:20:01.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f5434c00700 1 -- 172.21.15.120:0/1047997881 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430005280 con 0x7f543810c5b0 2024-05-14T09:20:01.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.015+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54381a2070 con 0x7f543810c5b0 2024-05-14T09:20:01.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.016+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54381a2530 con 0x7f543810c5b0 2024-05-14T09:20:01.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.017+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543810e970 con 0x7f543810c5b0 2024-05-14T09:20:01.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.021+0000 7f5434c00700 1 -- 172.21.15.120:0/1047997881 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f543000c980 con 0x7f543810c5b0 2024-05-14T09:20:01.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.022+0000 7f5434c00700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f541c0b2990 0x7f541c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:01.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.022+0000 7f5434c00700 1 -- 172.21.15.120:0/1047997881 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f54300e2430 con 0x7f543810c5b0 2024-05-14T09:20:01.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.023+0000 7f5437e00700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f541c0b2990 0x7f541c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:01.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.023+0000 7f5437e00700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f541c0b2990 0x7f541c0b4ea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5428005ea0 tx=0x7f5428005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:01.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.025+0000 7f5434c00700 1 -- 172.21.15.120:0/1047997881 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5430021020 con 0x7f543810c5b0 2024-05-14T09:20:01.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.259+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f543810e350 con 0x7f543810c5b0 2024-05-14T09:20:01.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.262+0000 7f5434c00700 1 -- 172.21.15.120:0/1047997881 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7f54300a9c80 con 0x7f543810c5b0 2024-05-14T09:20:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:20:01.263 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:20:01.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.266+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f541c0b2990 msgr2=0x7f541c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:01.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.266+0000 7f543f200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f541c0b2990 0x7f541c0b4ea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5428005ea0 tx=0x7f5428005e30 comp rx=0 tx=0).stop 2024-05-14T09:20:01.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f543810c5b0 msgr2=0x7f54381a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:01.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f543810c5b0 0x7f54381a1790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f543000ada0 tx=0x7f543000c330 comp rx=0 tx=0).stop 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 shutdown_connections 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f541c0b2990 0x7f541c0b4ea0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f543810c5b0 0x7f54381a1790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5438106570 0x7f543819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 --2- 172.21.15.120:0/1047997881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5438106ec0 0x7f543819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 >> 172.21.15.120:0/1047997881 conn(0x7f5438102050 msgr2=0x7f5438103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 shutdown_connections 2024-05-14T09:20:01.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:01.267+0000 7f543f200700 1 -- 172.21.15.120:0/1047997881 wait complete. 2024-05-14T09:20:01.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:01 smithi120 ceph-mon[31085]: pgmap v450: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-14T09:20:01.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:01 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1047997881' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:01.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:01 smithi152 ceph-mon[34868]: pgmap v450: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-14T09:20:01.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:01 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1047997881' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:01 smithi175 ceph-mon[35353]: pgmap v450: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-14T09:20:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:01 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1047997881' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:02.338 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-14T09:20:02.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T09:20:02.801 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:03.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:03 smithi120 ceph-mon[31085]: pgmap v451: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-05-14T09:20:03.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:03 smithi152 ceph-mon[34868]: pgmap v451: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-05-14T09:20:03.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:03 smithi175 ceph-mon[35353]: pgmap v451: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-05-14T09:20:04.746 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:04 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:20:04.859 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:04 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:20:04.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:04 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:20:04.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.982+0000 7f2542200700 1 -- 172.21.15.120:0/3913152766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 msgr2=0x7f253c1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:04.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.982+0000 7f2542200700 1 --2- 172.21.15.120:0/3913152766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c1049f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f252c0099c0 tx=0x7f252c009cd0 comp rx=0 tx=0).stop 2024-05-14T09:20:04.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.982+0000 7f2542200700 1 -- 172.21.15.120:0/3913152766 shutdown_connections 2024-05-14T09:20:04.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.982+0000 7f2542200700 1 --2- 172.21.15.120:0/3913152766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c109860 0x7f253c1111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:04.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.982+0000 7f2542200700 1 --2- 172.21.15.120:0/3913152766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c1049f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:04.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.982+0000 7f2542200700 1 --2- 172.21.15.120:0/3913152766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f253c108f10 0x7f253c109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:04.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.982+0000 7f2542200700 1 -- 172.21.15.120:0/3913152766 >> 172.21.15.120:0/3913152766 conn(0x7f253c0ffed0 msgr2=0x7f253c102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:04.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.983+0000 7f2542200700 1 -- 172.21.15.120:0/3913152766 shutdown_connections 2024-05-14T09:20:04.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.983+0000 7f2542200700 1 -- 172.21.15.120:0/3913152766 wait complete. 2024-05-14T09:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 Processor -- start 2024-05-14T09:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 -- start start 2024-05-14T09:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c19ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f253c108f10 0x7f253c19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c109860 0x7f253c19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f253c114390 con 0x7f253c1045e0 2024-05-14T09:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f253c114210 con 0x7f253c108f10 2024-05-14T09:20:04.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.984+0000 7f2542200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f253c114510 con 0x7f253c109860 2024-05-14T09:20:04.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c19ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:04.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c19ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48148/0 (socket says 172.21.15.120:48148) 2024-05-14T09:20:04.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 -- 172.21.15.120:0/3139900945 learned_addr learned my addr 172.21.15.120:0/3139900945 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:04.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f2533e00700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f253c108f10 0x7f253c19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:04.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253be00700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c109860 0x7f253c19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 -- 172.21.15.120:0/3139900945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c109860 msgr2=0x7f253c19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c109860 0x7f253c19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 -- 172.21.15.120:0/3139900945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f253c108f10 msgr2=0x7f253c19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f253c108f10 0x7f253c19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.985+0000 7f253b400700 1 -- 172.21.15.120:0/3139900945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c19fc30 con 0x7f253c1045e0 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.986+0000 7f253b400700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c19ad60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f252c000c00 tx=0x7f252c00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.986+0000 7f2538c00700 1 -- 172.21.15.120:0/3139900945 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c027070 con 0x7f253c1045e0 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.986+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c19fec0 con 0x7f253c1045e0 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.986+0000 7f2538c00700 1 -- 172.21.15.120:0/3139900945 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f252c00fe50 con 0x7f253c1045e0 2024-05-14T09:20:04.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.986+0000 7f2538c00700 1 -- 172.21.15.120:0/3139900945 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c0173f0 con 0x7f253c1045e0 2024-05-14T09:20:04.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.986+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c076b00 con 0x7f253c1045e0 2024-05-14T09:20:04.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.988+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c105a90 con 0x7f253c1045e0 2024-05-14T09:20:04.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.990+0000 7f2538c00700 1 -- 172.21.15.120:0/3139900945 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f252c02a070 con 0x7f253c1045e0 2024-05-14T09:20:04.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.993+0000 7f2538c00700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f25200b2910 0x7f25200b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:04.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.993+0000 7f2538c00700 1 -- 172.21.15.120:0/3139900945 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f252c0e3970 con 0x7f253c1045e0 2024-05-14T09:20:04.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.993+0000 7f2533e00700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f25200b2910 0x7f25200b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:04.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.994+0000 7f2533e00700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f25200b2910 0x7f25200b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2524005950 tx=0x7f25240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:04.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:04.996+0000 7f2538c00700 1 -- 172.21.15.120:0/3139900945 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f252c05fdf0 con 0x7f253c1045e0 2024-05-14T09:20:05.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.227+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f253c0512c0 con 0x7f25200b2910 2024-05-14T09:20:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.263+0000 7f2538c00700 1 -- 172.21.15.120:0/3139900945 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340465 (secure 0 0 0) 0x7f253c0512c0 con 0x7f25200b2910 2024-05-14T09:20:05.270 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:20:05.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f25200b2910 msgr2=0x7f25200b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:05.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f25200b2910 0x7f25200b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2524005950 tx=0x7f25240058e0 comp rx=0 tx=0).stop 2024-05-14T09:20:05.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 msgr2=0x7f253c19ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c19ad60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f252c000c00 tx=0x7f252c00f510 comp rx=0 tx=0).stop 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 shutdown_connections 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f25200b2910 0x7f25200b4e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c109860 0x7f253c19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f253c1045e0 0x7f253c19ad60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 --2- 172.21.15.120:0/3139900945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f253c108f10 0x7f253c19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 >> 172.21.15.120:0/3139900945 conn(0x7f253c0ffed0 msgr2=0x7f253c10a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 shutdown_connections 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:05.270+0000 7f2542200700 1 -- 172.21.15.120:0/3139900945 wait complete. 2024-05-14T09:20:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-05-14T09:20:05.860 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:05 smithi120 ceph-mon[31085]: pgmap v452: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-14T09:20:05.886 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:05 smithi152 ceph-mon[34868]: pgmap v452: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-14T09:20:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:05 smithi175 ceph-mon[35353]: pgmap v452: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-14T09:20:06.655 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-05-14T09:20:04.329060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661024,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":433,"num_read_kb":322,"num_write":376,"num_write_kb":2295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363512,"kb_used_data":14336,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578312,"statfs":{"total":1151940427776,"available":1151568191488,"internally_reserved":0,"allocated":14680064,"data_stored":8175758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14183,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":74,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006532"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891770+0000","last_change":"2024-05-14T09:18:02.795124+0000","last_active":"2024-05-14T09:19:42.891770+0000","last_peered":"2024-05-14T09:19:42.891770+0000","last_clean":"2024-05-14T09:19:42.891770+0000","last_became_active":"2024-05-14T09:18:02.794129+0000","last_became_peered":"2024-05-14T09:18:02.794129+0000","last_unstale":"2024-05-14T09:19:42.891770+0000","last_undegraded":"2024-05-14T09:19:42.891770+0000","last_fullsized":"2024-05-14T09:19:42.891770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:54.875120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886281+0000","last_change":"2024-05-14T09:18:02.775506+0000","last_active":"2024-05-14T09:19:42.886281+0000","last_peered":"2024-05-14T09:19:42.886281+0000","last_clean":"2024-05-14T09:19:42.886281+0000","last_became_active":"2024-05-14T09:18:02.774491+0000","last_became_peered":"2024-05-14T09:18:02.774491+0000","last_unstale":"2024-05-14T09:19:42.886281+0000","last_undegraded":"2024-05-14T09:19:42.886281+0000","last_fullsized":"2024-05-14T09:19:42.886281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:36:40.414254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886454+0000","last_change":"2024-05-14T09:18:02.792681+0000","last_active":"2024-05-14T09:19:42.886454+0000","last_peered":"2024-05-14T09:19:42.886454+0000","last_clean":"2024-05-14T09:19:42.886454+0000","last_became_active":"2024-05-14T09:18:02.791903+0000","last_became_peered":"2024-05-14T09:18:02.791903+0000","last_unstale":"2024-05-14T09:19:42.886454+0000","last_undegraded":"2024-05-14T09:19:42.886454+0000","last_fullsized":"2024-05-14T09:19:42.886454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:09:31.027641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807617+0000","last_change":"2024-05-14T09:18:41.667606+0000","last_active":"2024-05-14T09:19:42.807617+0000","last_peered":"2024-05-14T09:19:42.807617+0000","last_clean":"2024-05-14T09:19:42.807617+0000","last_became_active":"2024-05-14T09:18:41.666853+0000","last_became_peered":"2024-05-14T09:18:41.666853+0000","last_unstale":"2024-05-14T09:19:42.807617+0000","last_undegraded":"2024-05-14T09:19:42.807617+0000","last_fullsized":"2024-05-14T09:19:42.807617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:13:40.719553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813544+0000","last_change":"2024-05-14T09:18:02.775383+0000","last_active":"2024-05-14T09:19:42.813544+0000","last_peered":"2024-05-14T09:19:42.813544+0000","last_clean":"2024-05-14T09:19:42.813544+0000","last_became_active":"2024-05-14T09:18:02.774694+0000","last_became_peered":"2024-05-14T09:18:02.774694+0000","last_unstale":"2024-05-14T09:19:42.813544+0000","last_undegraded":"2024-05-14T09:19:42.813544+0000","last_fullsized":"2024-05-14T09:19:42.813544+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:47.289929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894249+0000","last_change":"2024-05-14T09:18:02.782178+0000","last_active":"2024-05-14T09:19:42.894249+0000","last_peered":"2024-05-14T09:19:42.894249+0000","last_clean":"2024-05-14T09:19:42.894249+0000","last_became_active":"2024-05-14T09:18:02.781714+0000","last_became_peered":"2024-05-14T09:18:02.781714+0000","last_unstale":"2024-05-14T09:19:42.894249+0000","last_undegraded":"2024-05-14T09:19:42.894249+0000","last_fullsized":"2024-05-14T09:19:42.894249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:43:02.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460310+0000","last_change":"2024-05-14T09:18:02.774434+0000","last_active":"2024-05-14T09:19:42.460310+0000","last_peered":"2024-05-14T09:19:42.460310+0000","last_clean":"2024-05-14T09:19:42.460310+0000","last_became_active":"2024-05-14T09:18:02.774054+0000","last_became_peered":"2024-05-14T09:18:02.774054+0000","last_unstale":"2024-05-14T09:19:42.460310+0000","last_undegraded":"2024-05-14T09:19:42.460310+0000","last_fullsized":"2024-05-14T09:19:42.460310+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:10.640939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810203+0000","last_change":"2024-05-14T09:18:02.780444+0000","last_active":"2024-05-14T09:19:42.810203+0000","last_peered":"2024-05-14T09:19:42.810203+0000","last_clean":"2024-05-14T09:19:42.810203+0000","last_became_active":"2024-05-14T09:18:02.779992+0000","last_became_peered":"2024-05-14T09:18:02.779992+0000","last_unstale":"2024-05-14T09:19:42.810203+0000","last_undegraded":"2024-05-14T09:19:42.810203+0000","last_fullsized":"2024-05-14T09:19:42.810203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:32:14.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.893291+0000","last_change":"2024-05-14T09:18:02.790247+0000","last_active":"2024-05-14T09:19:42.893291+0000","last_peered":"2024-05-14T09:19:42.893291+0000","last_clean":"2024-05-14T09:19:42.893291+0000","last_became_active":"2024-05-14T09:18:02.789293+0000","last_became_peered":"2024-05-14T09:18:02.789293+0000","last_unstale":"2024-05-14T09:19:42.893291+0000","last_undegraded":"2024-05-14T09:19:42.893291+0000","last_fullsized":"2024-05-14T09:19:42.893291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:01.939326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.896371+0000","last_change":"2024-05-14T09:18:02.785167+0000","last_active":"2024-05-14T09:19:42.896371+0000","last_peered":"2024-05-14T09:19:42.896371+0000","last_clean":"2024-05-14T09:19:42.896371+0000","last_became_active":"2024-05-14T09:18:02.784772+0000","last_became_peered":"2024-05-14T09:18:02.784772+0000","last_unstale":"2024-05-14T09:19:42.896371+0000","last_undegraded":"2024-05-14T09:19:42.896371+0000","last_fullsized":"2024-05-14T09:19:42.896371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:06.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461597+0000","last_change":"2024-05-14T09:18:02.793000+0000","last_active":"2024-05-14T09:19:42.461597+0000","last_peered":"2024-05-14T09:19:42.461597+0000","last_clean":"2024-05-14T09:19:42.461597+0000","last_became_active":"2024-05-14T09:18:02.791895+0000","last_became_peered":"2024-05-14T09:18:02.791895+0000","last_unstale":"2024-05-14T09:19:42.461597+0000","last_undegraded":"2024-05-14T09:19:42.461597+0000","last_fullsized":"2024-05-14T09:19:42.461597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:17.313383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.468102+0000","last_change":"2024-05-14T09:18:02.776309+0000","last_active":"2024-05-14T09:19:42.468102+0000","last_peered":"2024-05-14T09:19:42.468102+0000","last_clean":"2024-05-14T09:19:42.468102+0000","last_became_active":"2024-05-14T09:18:02.769218+0000","last_became_peered":"2024-05-14T09:18:02.769218+0000","last_unstale":"2024-05-14T09:19:42.468102+0000","last_undegraded":"2024-05-14T09:19:42.468102+0000","last_fullsized":"2024-05-14T09:19:42.468102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:54.793852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459166+0000","last_change":"2024-05-14T09:18:41.667109+0000","last_active":"2024-05-14T09:19:42.459166+0000","last_peered":"2024-05-14T09:19:42.459166+0000","last_clean":"2024-05-14T09:19:42.459166+0000","last_became_active":"2024-05-14T09:18:41.666437+0000","last_became_peered":"2024-05-14T09:18:41.666437+0000","last_unstale":"2024-05-14T09:19:42.459166+0000","last_undegraded":"2024-05-14T09:19:42.459166+0000","last_fullsized":"2024-05-14T09:19:42.459166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:14.806924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885246+0000","last_change":"2024-05-14T09:18:02.777380+0000","last_active":"2024-05-14T09:19:42.885246+0000","last_peered":"2024-05-14T09:19:42.885246+0000","last_clean":"2024-05-14T09:19:42.885246+0000","last_became_active":"2024-05-14T09:18:02.777035+0000","last_became_peered":"2024-05-14T09:18:02.777035+0000","last_unstale":"2024-05-14T09:19:42.885246+0000","last_undegraded":"2024-05-14T09:19:42.885246+0000","last_fullsized":"2024-05-14T09:19:42.885246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:56.906077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886307+0000","last_change":"2024-05-14T09:18:02.784577+0000","last_active":"2024-05-14T09:19:42.886307+0000","last_peered":"2024-05-14T09:19:42.886307+0000","last_clean":"2024-05-14T09:19:42.886307+0000","last_became_active":"2024-05-14T09:18:02.784185+0000","last_became_peered":"2024-05-14T09:18:02.784185+0000","last_unstale":"2024-05-14T09:19:42.886307+0000","last_undegraded":"2024-05-14T09:19:42.886307+0000","last_fullsized":"2024-05-14T09:19:42.886307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:44:38.518861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890331+0000","last_change":"2024-05-14T09:18:02.783262+0000","last_active":"2024-05-14T09:19:42.890331+0000","last_peered":"2024-05-14T09:19:42.890331+0000","last_clean":"2024-05-14T09:19:42.890331+0000","last_became_active":"2024-05-14T09:18:02.780405+0000","last_became_peered":"2024-05-14T09:18:02.780405+0000","last_unstale":"2024-05-14T09:19:42.890331+0000","last_undegraded":"2024-05-14T09:19:42.890331+0000","last_fullsized":"2024-05-14T09:19:42.890331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:01:50.437966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891244+0000","last_change":"2024-05-14T09:18:02.789155+0000","last_active":"2024-05-14T09:19:42.891244+0000","last_peered":"2024-05-14T09:19:42.891244+0000","last_clean":"2024-05-14T09:19:42.891244+0000","last_became_active":"2024-05-14T09:18:02.788703+0000","last_became_peered":"2024-05-14T09:18:02.788703+0000","last_unstale":"2024-05-14T09:19:42.891244+0000","last_undegraded":"2024-05-14T09:19:42.891244+0000","last_fullsized":"2024-05-14T09:19:42.891244+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:27:18.593797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807960+0000","last_change":"2024-05-14T09:18:02.788856+0000","last_active":"2024-05-14T09:19:42.807960+0000","last_peered":"2024-05-14T09:19:42.807960+0000","last_clean":"2024-05-14T09:19:42.807960+0000","last_became_active":"2024-05-14T09:18:02.788477+0000","last_became_peered":"2024-05-14T09:18:02.788477+0000","last_unstale":"2024-05-14T09:19:42.807960+0000","last_undegraded":"2024-05-14T09:19:42.807960+0000","last_fullsized":"2024-05-14T09:19:42.807960+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:14:09.943568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465747+0000","last_change":"2024-05-14T09:18:02.781087+0000","last_active":"2024-05-14T09:19:42.465747+0000","last_peered":"2024-05-14T09:19:42.465747+0000","last_clean":"2024-05-14T09:19:42.465747+0000","last_became_active":"2024-05-14T09:18:02.780584+0000","last_became_peered":"2024-05-14T09:18:02.780584+0000","last_unstale":"2024-05-14T09:19:42.465747+0000","last_undegraded":"2024-05-14T09:19:42.465747+0000","last_fullsized":"2024-05-14T09:19:42.465747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:02:23.587235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.889482+0000","last_change":"2024-05-14T09:19:42.889482+0000","last_active":"2024-05-14T09:19:42.889482+0000","last_peered":"2024-05-14T09:19:42.889482+0000","last_clean":"2024-05-14T09:19:42.889482+0000","last_became_active":"2024-05-14T09:19:42.887316+0000","last_became_peered":"2024-05-14T09:19:42.887316+0000","last_unstale":"2024-05-14T09:19:42.889482+0000","last_undegraded":"2024-05-14T09:19:42.889482+0000","last_fullsized":"2024-05-14T09:19:42.889482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:13:44.778215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":91,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:02.101478+0000","last_change":"2024-05-14T09:17:57.708207+0000","last_active":"2024-05-14T09:20:02.101478+0000","last_peered":"2024-05-14T09:20:02.101478+0000","last_clean":"2024-05-14T09:20:02.101478+0000","last_became_active":"2024-05-14T09:17:57.707547+0000","last_became_peered":"2024-05-14T09:17:57.707547+0000","last_unstale":"2024-05-14T09:20:02.101478+0000","last_undegraded":"2024-05-14T09:20:02.101478+0000","last_fullsized":"2024-05-14T09:20:02.101478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.378254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811026+0000","last_change":"2024-05-14T09:18:02.782461+0000","last_active":"2024-05-14T09:19:42.811026+0000","last_peered":"2024-05-14T09:19:42.811026+0000","last_clean":"2024-05-14T09:19:42.811026+0000","last_became_active":"2024-05-14T09:18:02.781014+0000","last_became_peered":"2024-05-14T09:18:02.781014+0000","last_unstale":"2024-05-14T09:19:42.811026+0000","last_undegraded":"2024-05-14T09:19:42.811026+0000","last_fullsized":"2024-05-14T09:19:42.811026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:21:13.024727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466004+0000","last_change":"2024-05-14T09:18:15.878163+0000","last_active":"2024-05-14T09:19:42.466004+0000","last_peered":"2024-05-14T09:19:42.466004+0000","last_clean":"2024-05-14T09:19:42.466004+0000","last_became_active":"2024-05-14T09:18:15.877097+0000","last_became_peered":"2024-05-14T09:18:15.877097+0000","last_unstale":"2024-05-14T09:19:42.466004+0000","last_undegraded":"2024-05-14T09:19:42.466004+0000","last_fullsized":"2024-05-14T09:19:42.466004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:59.570534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811245+0000","last_change":"2024-05-14T09:17:57.773712+0000","last_active":"2024-05-14T09:19:42.811245+0000","last_peered":"2024-05-14T09:19:42.811245+0000","last_clean":"2024-05-14T09:19:42.811245+0000","last_became_active":"2024-05-14T09:17:57.772849+0000","last_became_peered":"2024-05-14T09:17:57.772849+0000","last_unstale":"2024-05-14T09:19:42.811245+0000","last_undegraded":"2024-05-14T09:19:42.811245+0000","last_fullsized":"2024-05-14T09:19:42.811245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:20.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885570+0000","last_change":"2024-05-14T09:18:02.790490+0000","last_active":"2024-05-14T09:19:42.885570+0000","last_peered":"2024-05-14T09:19:42.885570+0000","last_clean":"2024-05-14T09:19:42.885570+0000","last_became_active":"2024-05-14T09:18:02.790112+0000","last_became_peered":"2024-05-14T09:18:02.790112+0000","last_unstale":"2024-05-14T09:19:42.885570+0000","last_undegraded":"2024-05-14T09:19:42.885570+0000","last_fullsized":"2024-05-14T09:19:42.885570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:15.851585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466806+0000","last_change":"2024-05-14T09:18:15.888894+0000","last_active":"2024-05-14T09:19:42.466806+0000","last_peered":"2024-05-14T09:19:42.466806+0000","last_clean":"2024-05-14T09:19:42.466806+0000","last_became_active":"2024-05-14T09:18:15.888327+0000","last_became_peered":"2024-05-14T09:18:15.888327+0000","last_unstale":"2024-05-14T09:19:42.466806+0000","last_undegraded":"2024-05-14T09:19:42.466806+0000","last_fullsized":"2024-05-14T09:19:42.466806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:13:19.871380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814675+0000","last_change":"2024-05-14T09:17:57.717745+0000","last_active":"2024-05-14T09:19:42.814675+0000","last_peered":"2024-05-14T09:19:42.814675+0000","last_clean":"2024-05-14T09:19:42.814675+0000","last_became_active":"2024-05-14T09:17:57.716822+0000","last_became_peered":"2024-05-14T09:17:57.716822+0000","last_unstale":"2024-05-14T09:19:42.814675+0000","last_undegraded":"2024-05-14T09:19:42.814675+0000","last_fullsized":"2024-05-14T09:19:42.814675+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:47:40.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891071+0000","last_change":"2024-05-14T09:18:02.788276+0000","last_active":"2024-05-14T09:19:42.891071+0000","last_peered":"2024-05-14T09:19:42.891071+0000","last_clean":"2024-05-14T09:19:42.891071+0000","last_became_active":"2024-05-14T09:18:02.787446+0000","last_became_peered":"2024-05-14T09:18:02.787446+0000","last_unstale":"2024-05-14T09:19:42.891071+0000","last_undegraded":"2024-05-14T09:19:42.891071+0000","last_fullsized":"2024-05-14T09:19:42.891071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:07:36.574378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466347+0000","last_change":"2024-05-14T09:18:15.887824+0000","last_active":"2024-05-14T09:19:42.466347+0000","last_peered":"2024-05-14T09:19:42.466347+0000","last_clean":"2024-05-14T09:19:42.466347+0000","last_became_active":"2024-05-14T09:18:15.887152+0000","last_became_peered":"2024-05-14T09:18:15.887152+0000","last_unstale":"2024-05-14T09:19:42.466347+0000","last_undegraded":"2024-05-14T09:19:42.466347+0000","last_fullsized":"2024-05-14T09:19:42.466347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:54.778329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814724+0000","last_change":"2024-05-14T09:17:57.717528+0000","last_active":"2024-05-14T09:19:42.814724+0000","last_peered":"2024-05-14T09:19:42.814724+0000","last_clean":"2024-05-14T09:19:42.814724+0000","last_became_active":"2024-05-14T09:17:57.716251+0000","last_became_peered":"2024-05-14T09:17:57.716251+0000","last_unstale":"2024-05-14T09:19:42.814724+0000","last_undegraded":"2024-05-14T09:19:42.814724+0000","last_fullsized":"2024-05-14T09:19:42.814724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:29:08.080292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461675+0000","last_change":"2024-05-14T09:18:02.790132+0000","last_active":"2024-05-14T09:19:42.461675+0000","last_peered":"2024-05-14T09:19:42.461675+0000","last_clean":"2024-05-14T09:19:42.461675+0000","last_became_active":"2024-05-14T09:18:02.789461+0000","last_became_peered":"2024-05-14T09:18:02.789461+0000","last_unstale":"2024-05-14T09:19:42.461675+0000","last_undegraded":"2024-05-14T09:19:42.461675+0000","last_fullsized":"2024-05-14T09:19:42.461675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:36:55.261959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465830+0000","last_change":"2024-05-14T09:18:15.893674+0000","last_active":"2024-05-14T09:19:42.465830+0000","last_peered":"2024-05-14T09:19:42.465830+0000","last_clean":"2024-05-14T09:19:42.465830+0000","last_became_active":"2024-05-14T09:18:15.891857+0000","last_became_peered":"2024-05-14T09:18:15.891857+0000","last_unstale":"2024-05-14T09:19:42.465830+0000","last_undegraded":"2024-05-14T09:19:42.465830+0000","last_fullsized":"2024-05-14T09:19:42.465830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:14:55.020773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:00.095235+0000","last_change":"2024-05-14T09:18:41.982086+0000","last_active":"2024-05-14T09:20:00.095235+0000","last_peered":"2024-05-14T09:20:00.095235+0000","last_clean":"2024-05-14T09:20:00.095235+0000","last_became_active":"2024-05-14T09:18:41.981103+0000","last_became_peered":"2024-05-14T09:18:41.981103+0000","last_unstale":"2024-05-14T09:20:00.095235+0000","last_undegraded":"2024-05-14T09:20:00.095235+0000","last_fullsized":"2024-05-14T09:20:00.095235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:25:26.896681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813717+0000","last_change":"2024-05-14T09:18:02.775834+0000","last_active":"2024-05-14T09:19:42.813717+0000","last_peered":"2024-05-14T09:19:42.813717+0000","last_clean":"2024-05-14T09:19:42.813717+0000","last_became_active":"2024-05-14T09:18:02.773708+0000","last_became_peered":"2024-05-14T09:18:02.773708+0000","last_unstale":"2024-05-14T09:19:42.813717+0000","last_undegraded":"2024-05-14T09:19:42.813717+0000","last_fullsized":"2024-05-14T09:19:42.813717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:00.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.899138+0000","last_change":"2024-05-14T09:19:42.899138+0000","last_active":"2024-05-14T09:19:42.899138+0000","last_peered":"2024-05-14T09:19:42.899138+0000","last_clean":"2024-05-14T09:19:42.899138+0000","last_became_active":"2024-05-14T09:19:42.897588+0000","last_became_peered":"2024-05-14T09:19:42.897588+0000","last_unstale":"2024-05-14T09:19:42.899138+0000","last_undegraded":"2024-05-14T09:19:42.899138+0000","last_fullsized":"2024-05-14T09:19:42.899138+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:13:05.760525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894250+0000","last_change":"2024-05-14T09:18:42.326203+0000","last_active":"2024-05-14T09:19:42.894250+0000","last_peered":"2024-05-14T09:19:42.894250+0000","last_clean":"2024-05-14T09:19:42.894250+0000","last_became_active":"2024-05-14T09:18:42.324907+0000","last_became_peered":"2024-05-14T09:18:42.324907+0000","last_unstale":"2024-05-14T09:19:42.894250+0000","last_undegraded":"2024-05-14T09:19:42.894250+0000","last_fullsized":"2024-05-14T09:19:42.894250+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:50.408706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460788+0000","last_change":"2024-05-14T09:18:41.669731+0000","last_active":"2024-05-14T09:19:42.460788+0000","last_peered":"2024-05-14T09:19:42.460788+0000","last_clean":"2024-05-14T09:19:42.460788+0000","last_became_active":"2024-05-14T09:18:41.667039+0000","last_became_peered":"2024-05-14T09:18:41.667039+0000","last_unstale":"2024-05-14T09:19:42.460788+0000","last_undegraded":"2024-05-14T09:19:42.460788+0000","last_fullsized":"2024-05-14T09:19:42.460788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:33:30.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890846+0000","last_change":"2024-05-14T09:18:15.894314+0000","last_active":"2024-05-14T09:19:42.890846+0000","last_peered":"2024-05-14T09:19:42.890846+0000","last_clean":"2024-05-14T09:19:42.890846+0000","last_became_active":"2024-05-14T09:18:15.893173+0000","last_became_peered":"2024-05-14T09:18:15.893173+0000","last_unstale":"2024-05-14T09:19:42.890846+0000","last_undegraded":"2024-05-14T09:19:42.890846+0000","last_fullsized":"2024-05-14T09:19:42.890846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:19:25.467141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458514+0000","last_change":"2024-05-14T09:17:57.704612+0000","last_active":"2024-05-14T09:19:42.458514+0000","last_peered":"2024-05-14T09:19:42.458514+0000","last_clean":"2024-05-14T09:19:42.458514+0000","last_became_active":"2024-05-14T09:17:57.703979+0000","last_became_peered":"2024-05-14T09:17:57.703979+0000","last_unstale":"2024-05-14T09:19:42.458514+0000","last_undegraded":"2024-05-14T09:19:42.458514+0000","last_fullsized":"2024-05-14T09:19:42.458514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:08.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810103+0000","last_change":"2024-05-14T09:18:02.774778+0000","last_active":"2024-05-14T09:19:42.810103+0000","last_peered":"2024-05-14T09:19:42.810103+0000","last_clean":"2024-05-14T09:19:42.810103+0000","last_became_active":"2024-05-14T09:18:02.774406+0000","last_became_peered":"2024-05-14T09:18:02.774406+0000","last_unstale":"2024-05-14T09:19:42.810103+0000","last_undegraded":"2024-05-14T09:19:42.810103+0000","last_fullsized":"2024-05-14T09:19:42.810103+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.135221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886244+0000","last_change":"2024-05-14T09:18:15.885921+0000","last_active":"2024-05-14T09:19:42.886244+0000","last_peered":"2024-05-14T09:19:42.886244+0000","last_clean":"2024-05-14T09:19:42.886244+0000","last_became_active":"2024-05-14T09:18:15.885261+0000","last_became_peered":"2024-05-14T09:18:15.885261+0000","last_unstale":"2024-05-14T09:19:42.886244+0000","last_undegraded":"2024-05-14T09:19:42.886244+0000","last_fullsized":"2024-05-14T09:19:42.886244+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:57.438626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459603+0000","last_change":"2024-05-14T09:17:57.714662+0000","last_active":"2024-05-14T09:19:42.459603+0000","last_peered":"2024-05-14T09:19:42.459603+0000","last_clean":"2024-05-14T09:19:42.459603+0000","last_became_active":"2024-05-14T09:17:57.714086+0000","last_became_peered":"2024-05-14T09:17:57.714086+0000","last_unstale":"2024-05-14T09:19:42.459603+0000","last_undegraded":"2024-05-14T09:19:42.459603+0000","last_fullsized":"2024-05-14T09:19:42.459603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:20.609634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807255+0000","last_change":"2024-05-14T09:18:02.767521+0000","last_active":"2024-05-14T09:19:42.807255+0000","last_peered":"2024-05-14T09:19:42.807255+0000","last_clean":"2024-05-14T09:19:42.807255+0000","last_became_active":"2024-05-14T09:18:02.767035+0000","last_became_peered":"2024-05-14T09:18:02.767035+0000","last_unstale":"2024-05-14T09:19:42.807255+0000","last_undegraded":"2024-05-14T09:19:42.807255+0000","last_fullsized":"2024-05-14T09:19:42.807255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:00:30.251960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810556+0000","last_change":"2024-05-14T09:18:15.890254+0000","last_active":"2024-05-14T09:19:42.810556+0000","last_peered":"2024-05-14T09:19:42.810556+0000","last_clean":"2024-05-14T09:19:42.810556+0000","last_became_active":"2024-05-14T09:18:15.887699+0000","last_became_peered":"2024-05-14T09:18:15.887699+0000","last_unstale":"2024-05-14T09:19:42.810556+0000","last_undegraded":"2024-05-14T09:19:42.810556+0000","last_fullsized":"2024-05-14T09:19:42.810556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:30:39.578671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:00.093835+0000","last_change":"2024-05-14T09:17:57.712559+0000","last_active":"2024-05-14T09:20:00.093835+0000","last_peered":"2024-05-14T09:20:00.093835+0000","last_clean":"2024-05-14T09:20:00.093835+0000","last_became_active":"2024-05-14T09:17:57.711265+0000","last_became_peered":"2024-05-14T09:17:57.711265+0000","last_unstale":"2024-05-14T09:20:00.093835+0000","last_undegraded":"2024-05-14T09:20:00.093835+0000","last_fullsized":"2024-05-14T09:20:00.093835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:37:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.892687+0000","last_change":"2024-05-14T09:18:02.793657+0000","last_active":"2024-05-14T09:19:42.892687+0000","last_peered":"2024-05-14T09:19:42.892687+0000","last_clean":"2024-05-14T09:19:42.892687+0000","last_became_active":"2024-05-14T09:18:02.789550+0000","last_became_peered":"2024-05-14T09:18:02.789550+0000","last_unstale":"2024-05-14T09:19:42.892687+0000","last_undegraded":"2024-05-14T09:19:42.892687+0000","last_fullsized":"2024-05-14T09:19:42.892687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:31.933523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807018+0000","last_change":"2024-05-14T09:18:15.877290+0000","last_active":"2024-05-14T09:19:42.807018+0000","last_peered":"2024-05-14T09:19:42.807018+0000","last_clean":"2024-05-14T09:19:42.807018+0000","last_became_active":"2024-05-14T09:18:15.874522+0000","last_became_peered":"2024-05-14T09:18:15.874522+0000","last_unstale":"2024-05-14T09:19:42.807018+0000","last_undegraded":"2024-05-14T09:19:42.807018+0000","last_fullsized":"2024-05-14T09:19:42.807018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:16.774709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461614+0000","last_change":"2024-05-14T09:17:57.710407+0000","last_active":"2024-05-14T09:19:42.461614+0000","last_peered":"2024-05-14T09:19:42.461614+0000","last_clean":"2024-05-14T09:19:42.461614+0000","last_became_active":"2024-05-14T09:17:57.709776+0000","last_became_peered":"2024-05-14T09:17:57.709776+0000","last_unstale":"2024-05-14T09:19:42.461614+0000","last_undegraded":"2024-05-14T09:19:42.461614+0000","last_fullsized":"2024-05-14T09:19:42.461614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:28:04.838236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885738+0000","last_change":"2024-05-14T09:18:41.664954+0000","last_active":"2024-05-14T09:19:42.885738+0000","last_peered":"2024-05-14T09:19:42.885738+0000","last_clean":"2024-05-14T09:19:42.885738+0000","last_became_active":"2024-05-14T09:18:41.663825+0000","last_became_peered":"2024-05-14T09:18:41.663825+0000","last_unstale":"2024-05-14T09:19:42.885738+0000","last_undegraded":"2024-05-14T09:19:42.885738+0000","last_fullsized":"2024-05-14T09:19:42.885738+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:50.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467173+0000","last_change":"2024-05-14T09:18:15.882918+0000","last_active":"2024-05-14T09:19:42.467173+0000","last_peered":"2024-05-14T09:19:42.467173+0000","last_clean":"2024-05-14T09:19:42.467173+0000","last_became_active":"2024-05-14T09:18:15.880220+0000","last_became_peered":"2024-05-14T09:18:15.880220+0000","last_unstale":"2024-05-14T09:19:42.467173+0000","last_undegraded":"2024-05-14T09:19:42.467173+0000","last_fullsized":"2024-05-14T09:19:42.467173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:49.777319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461522+0000","last_change":"2024-05-14T09:17:57.775417+0000","last_active":"2024-05-14T09:19:42.461522+0000","last_peered":"2024-05-14T09:19:42.461522+0000","last_clean":"2024-05-14T09:19:42.461522+0000","last_became_active":"2024-05-14T09:17:57.774362+0000","last_became_peered":"2024-05-14T09:17:57.774362+0000","last_unstale":"2024-05-14T09:19:42.461522+0000","last_undegraded":"2024-05-14T09:19:42.461522+0000","last_fullsized":"2024-05-14T09:19:42.461522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:27.320060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891815+0000","last_change":"2024-05-14T09:18:02.794096+0000","last_active":"2024-05-14T09:19:42.891815+0000","last_peered":"2024-05-14T09:19:42.891815+0000","last_clean":"2024-05-14T09:19:42.891815+0000","last_became_active":"2024-05-14T09:18:02.788361+0000","last_became_peered":"2024-05-14T09:18:02.788361+0000","last_unstale":"2024-05-14T09:19:42.891815+0000","last_undegraded":"2024-05-14T09:19:42.891815+0000","last_fullsized":"2024-05-14T09:19:42.891815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:41.485460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807126+0000","last_change":"2024-05-14T09:18:15.886317+0000","last_active":"2024-05-14T09:19:42.807126+0000","last_peered":"2024-05-14T09:19:42.807126+0000","last_clean":"2024-05-14T09:19:42.807126+0000","last_became_active":"2024-05-14T09:18:15.885903+0000","last_became_peered":"2024-05-14T09:18:15.885903+0000","last_unstale":"2024-05-14T09:19:42.807126+0000","last_undegraded":"2024-05-14T09:19:42.807126+0000","last_fullsized":"2024-05-14T09:19:42.807126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:26:59.892672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'35","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:00.112352+0000","last_change":"2024-05-14T09:17:57.717013+0000","last_active":"2024-05-14T09:20:00.112352+0000","last_peered":"2024-05-14T09:20:00.112352+0000","last_clean":"2024-05-14T09:20:00.112352+0000","last_became_active":"2024-05-14T09:17:57.714552+0000","last_became_peered":"2024-05-14T09:17:57.714552+0000","last_unstale":"2024-05-14T09:20:00.112352+0000","last_undegraded":"2024-05-14T09:20:00.112352+0000","last_fullsized":"2024-05-14T09:20:00.112352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:16.042573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62827,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":71,"num_read_kb":97,"num_write":37,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814169+0000","last_change":"2024-05-14T09:18:02.782446+0000","last_active":"2024-05-14T09:19:42.814169+0000","last_peered":"2024-05-14T09:19:42.814169+0000","last_clean":"2024-05-14T09:19:42.814169+0000","last_became_active":"2024-05-14T09:18:02.779998+0000","last_became_peered":"2024-05-14T09:18:02.779998+0000","last_unstale":"2024-05-14T09:19:42.814169+0000","last_undegraded":"2024-05-14T09:19:42.814169+0000","last_fullsized":"2024-05-14T09:19:42.814169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:50.734227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462426+0000","last_change":"2024-05-14T09:18:15.894372+0000","last_active":"2024-05-14T09:19:42.462426+0000","last_peered":"2024-05-14T09:19:42.462426+0000","last_clean":"2024-05-14T09:19:42.462426+0000","last_became_active":"2024-05-14T09:18:15.893842+0000","last_became_peered":"2024-05-14T09:18:15.893842+0000","last_unstale":"2024-05-14T09:19:42.462426+0000","last_undegraded":"2024-05-14T09:19:42.462426+0000","last_fullsized":"2024-05-14T09:19:42.462426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:57.675242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890505+0000","last_change":"2024-05-14T09:18:41.675372+0000","last_active":"2024-05-14T09:19:42.890505+0000","last_peered":"2024-05-14T09:19:42.890505+0000","last_clean":"2024-05-14T09:19:42.890505+0000","last_became_active":"2024-05-14T09:18:41.659107+0000","last_became_peered":"2024-05-14T09:18:41.659107+0000","last_unstale":"2024-05-14T09:19:42.890505+0000","last_undegraded":"2024-05-14T09:19:42.890505+0000","last_fullsized":"2024-05-14T09:19:42.890505+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:55:43.567929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458772+0000","last_change":"2024-05-14T09:18:02.780558+0000","last_active":"2024-05-14T09:19:42.458772+0000","last_peered":"2024-05-14T09:19:42.458772+0000","last_clean":"2024-05-14T09:19:42.458772+0000","last_became_active":"2024-05-14T09:18:02.779955+0000","last_became_peered":"2024-05-14T09:18:02.779955+0000","last_unstale":"2024-05-14T09:19:42.458772+0000","last_undegraded":"2024-05-14T09:19:42.458772+0000","last_fullsized":"2024-05-14T09:19:42.458772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:28:59.821879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890970+0000","last_change":"2024-05-14T09:18:15.892207+0000","last_active":"2024-05-14T09:19:42.890970+0000","last_peered":"2024-05-14T09:19:42.890970+0000","last_clean":"2024-05-14T09:19:42.890970+0000","last_became_active":"2024-05-14T09:18:15.891646+0000","last_became_peered":"2024-05-14T09:18:15.891646+0000","last_unstale":"2024-05-14T09:19:42.890970+0000","last_undegraded":"2024-05-14T09:19:42.890970+0000","last_fullsized":"2024-05-14T09:19:42.890970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:06:48.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461084+0000","last_change":"2024-05-14T09:17:57.717130+0000","last_active":"2024-05-14T09:19:42.461084+0000","last_peered":"2024-05-14T09:19:42.461084+0000","last_clean":"2024-05-14T09:19:42.461084+0000","last_became_active":"2024-05-14T09:17:57.716738+0000","last_became_peered":"2024-05-14T09:17:57.716738+0000","last_unstale":"2024-05-14T09:19:42.461084+0000","last_undegraded":"2024-05-14T09:19:42.461084+0000","last_fullsized":"2024-05-14T09:19:42.461084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:20:16.246789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461122+0000","last_change":"2024-05-14T09:18:02.783073+0000","last_active":"2024-05-14T09:19:42.461122+0000","last_peered":"2024-05-14T09:19:42.461122+0000","last_clean":"2024-05-14T09:19:42.461122+0000","last_became_active":"2024-05-14T09:18:02.782657+0000","last_became_peered":"2024-05-14T09:18:02.782657+0000","last_unstale":"2024-05-14T09:19:42.461122+0000","last_undegraded":"2024-05-14T09:19:42.461122+0000","last_fullsized":"2024-05-14T09:19:42.461122+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:39:46.649875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807966+0000","last_change":"2024-05-14T09:18:15.885231+0000","last_active":"2024-05-14T09:19:42.807966+0000","last_peered":"2024-05-14T09:19:42.807966+0000","last_clean":"2024-05-14T09:19:42.807966+0000","last_became_active":"2024-05-14T09:18:15.880199+0000","last_became_peered":"2024-05-14T09:18:15.880199+0000","last_unstale":"2024-05-14T09:19:42.807966+0000","last_undegraded":"2024-05-14T09:19:42.807966+0000","last_fullsized":"2024-05-14T09:19:42.807966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:10:22.707034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":80,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:58.092524+0000","last_change":"2024-05-14T09:17:57.718596+0000","last_active":"2024-05-14T09:19:58.092524+0000","last_peered":"2024-05-14T09:19:58.092524+0000","last_clean":"2024-05-14T09:19:58.092524+0000","last_became_active":"2024-05-14T09:17:57.717735+0000","last_became_peered":"2024-05-14T09:17:57.717735+0000","last_unstale":"2024-05-14T09:19:58.092524+0000","last_undegraded":"2024-05-14T09:19:58.092524+0000","last_fullsized":"2024-05-14T09:19:58.092524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:45.110512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460333+0000","last_change":"2024-05-14T09:18:02.780222+0000","last_active":"2024-05-14T09:19:42.460333+0000","last_peered":"2024-05-14T09:19:42.460333+0000","last_clean":"2024-05-14T09:19:42.460333+0000","last_became_active":"2024-05-14T09:18:02.779842+0000","last_became_peered":"2024-05-14T09:18:02.779842+0000","last_unstale":"2024-05-14T09:19:42.460333+0000","last_undegraded":"2024-05-14T09:19:42.460333+0000","last_fullsized":"2024-05-14T09:19:42.460333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:46.726665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459242+0000","last_change":"2024-05-14T09:18:15.885248+0000","last_active":"2024-05-14T09:19:42.459242+0000","last_peered":"2024-05-14T09:19:42.459242+0000","last_clean":"2024-05-14T09:19:42.459242+0000","last_became_active":"2024-05-14T09:18:15.884675+0000","last_became_peered":"2024-05-14T09:18:15.884675+0000","last_unstale":"2024-05-14T09:19:42.459242+0000","last_undegraded":"2024-05-14T09:19:42.459242+0000","last_fullsized":"2024-05-14T09:19:42.459242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:28:14.278141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890196+0000","last_change":"2024-05-14T09:18:41.687983+0000","last_active":"2024-05-14T09:19:42.890196+0000","last_peered":"2024-05-14T09:19:42.890196+0000","last_clean":"2024-05-14T09:19:42.890196+0000","last_became_active":"2024-05-14T09:18:41.666942+0000","last_became_peered":"2024-05-14T09:18:41.666942+0000","last_unstale":"2024-05-14T09:19:42.890196+0000","last_undegraded":"2024-05-14T09:19:42.890196+0000","last_fullsized":"2024-05-14T09:19:42.890196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:38:24.183297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460053+0000","last_change":"2024-05-14T09:18:02.788509+0000","last_active":"2024-05-14T09:19:42.460053+0000","last_peered":"2024-05-14T09:19:42.460053+0000","last_clean":"2024-05-14T09:19:42.460053+0000","last_became_active":"2024-05-14T09:18:02.786886+0000","last_became_peered":"2024-05-14T09:18:02.786886+0000","last_unstale":"2024-05-14T09:19:42.460053+0000","last_undegraded":"2024-05-14T09:19:42.460053+0000","last_fullsized":"2024-05-14T09:19:42.460053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:29:38.765565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459813+0000","last_change":"2024-05-14T09:18:15.895299+0000","last_active":"2024-05-14T09:19:42.459813+0000","last_peered":"2024-05-14T09:19:42.459813+0000","last_clean":"2024-05-14T09:19:42.459813+0000","last_became_active":"2024-05-14T09:18:15.893663+0000","last_became_peered":"2024-05-14T09:18:15.893663+0000","last_unstale":"2024-05-14T09:19:42.459813+0000","last_undegraded":"2024-05-14T09:19:42.459813+0000","last_fullsized":"2024-05-14T09:19:42.459813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:58:24.950436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814266+0000","last_change":"2024-05-14T09:17:57.710933+0000","last_active":"2024-05-14T09:19:42.814266+0000","last_peered":"2024-05-14T09:19:42.814266+0000","last_clean":"2024-05-14T09:19:42.814266+0000","last_became_active":"2024-05-14T09:17:57.710255+0000","last_became_peered":"2024-05-14T09:17:57.710255+0000","last_unstale":"2024-05-14T09:19:42.814266+0000","last_undegraded":"2024-05-14T09:19:42.814266+0000","last_fullsized":"2024-05-14T09:19:42.814266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:30.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891143+0000","last_change":"2024-05-14T09:18:02.781494+0000","last_active":"2024-05-14T09:19:42.891143+0000","last_peered":"2024-05-14T09:19:42.891143+0000","last_clean":"2024-05-14T09:19:42.891143+0000","last_became_active":"2024-05-14T09:18:02.781112+0000","last_became_peered":"2024-05-14T09:18:02.781112+0000","last_unstale":"2024-05-14T09:19:42.891143+0000","last_undegraded":"2024-05-14T09:19:42.891143+0000","last_fullsized":"2024-05-14T09:19:42.891143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:27.109538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813351+0000","last_change":"2024-05-14T09:18:16.135447+0000","last_active":"2024-05-14T09:19:42.813351+0000","last_peered":"2024-05-14T09:19:42.813351+0000","last_clean":"2024-05-14T09:19:42.813351+0000","last_became_active":"2024-05-14T09:18:16.133770+0000","last_became_peered":"2024-05-14T09:18:16.133770+0000","last_unstale":"2024-05-14T09:19:42.813351+0000","last_undegraded":"2024-05-14T09:19:42.813351+0000","last_fullsized":"2024-05-14T09:19:42.813351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:29.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807668+0000","last_change":"2024-05-14T09:17:57.776542+0000","last_active":"2024-05-14T09:19:42.807668+0000","last_peered":"2024-05-14T09:19:42.807668+0000","last_clean":"2024-05-14T09:19:42.807668+0000","last_became_active":"2024-05-14T09:17:57.775370+0000","last_became_peered":"2024-05-14T09:17:57.775370+0000","last_unstale":"2024-05-14T09:19:42.807668+0000","last_undegraded":"2024-05-14T09:19:42.807668+0000","last_fullsized":"2024-05-14T09:19:42.807668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:24.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.895442+0000","last_change":"2024-05-14T09:18:02.776673+0000","last_active":"2024-05-14T09:19:42.895442+0000","last_peered":"2024-05-14T09:19:42.895442+0000","last_clean":"2024-05-14T09:19:42.895442+0000","last_became_active":"2024-05-14T09:18:02.776243+0000","last_became_peered":"2024-05-14T09:18:02.776243+0000","last_unstale":"2024-05-14T09:19:42.895442+0000","last_undegraded":"2024-05-14T09:19:42.895442+0000","last_fullsized":"2024-05-14T09:19:42.895442+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:21.226977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459325+0000","last_change":"2024-05-14T09:18:15.885039+0000","last_active":"2024-05-14T09:19:42.459325+0000","last_peered":"2024-05-14T09:19:42.459325+0000","last_clean":"2024-05-14T09:19:42.459325+0000","last_became_active":"2024-05-14T09:18:15.884466+0000","last_became_peered":"2024-05-14T09:18:15.884466+0000","last_unstale":"2024-05-14T09:19:42.459325+0000","last_undegraded":"2024-05-14T09:19:42.459325+0000","last_fullsized":"2024-05-14T09:19:42.459325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:12.000203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:02.102784+0000","last_change":"2024-05-14T09:17:57.712259+0000","last_active":"2024-05-14T09:20:02.102784+0000","last_peered":"2024-05-14T09:20:02.102784+0000","last_clean":"2024-05-14T09:20:02.102784+0000","last_became_active":"2024-05-14T09:17:57.711663+0000","last_became_peered":"2024-05-14T09:17:57.711663+0000","last_unstale":"2024-05-14T09:20:02.102784+0000","last_undegraded":"2024-05-14T09:20:02.102784+0000","last_fullsized":"2024-05-14T09:20:02.102784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:40:31.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894379+0000","last_change":"2024-05-14T09:18:02.783586+0000","last_active":"2024-05-14T09:19:42.894379+0000","last_peered":"2024-05-14T09:19:42.894379+0000","last_clean":"2024-05-14T09:19:42.894379+0000","last_became_active":"2024-05-14T09:18:02.783122+0000","last_became_peered":"2024-05-14T09:18:02.783122+0000","last_unstale":"2024-05-14T09:19:42.894379+0000","last_undegraded":"2024-05-14T09:19:42.894379+0000","last_fullsized":"2024-05-14T09:19:42.894379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:32:24.966064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459651+0000","last_change":"2024-05-14T09:18:16.132825+0000","last_active":"2024-05-14T09:19:42.459651+0000","last_peered":"2024-05-14T09:19:42.459651+0000","last_clean":"2024-05-14T09:19:42.459651+0000","last_became_active":"2024-05-14T09:18:16.132155+0000","last_became_peered":"2024-05-14T09:18:16.132155+0000","last_unstale":"2024-05-14T09:19:42.459651+0000","last_undegraded":"2024-05-14T09:19:42.459651+0000","last_fullsized":"2024-05-14T09:19:42.459651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:43.579951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460417+0000","last_change":"2024-05-14T09:18:02.788407+0000","last_active":"2024-05-14T09:19:42.460417+0000","last_peered":"2024-05-14T09:19:42.460417+0000","last_clean":"2024-05-14T09:19:42.460417+0000","last_became_active":"2024-05-14T09:18:02.785934+0000","last_became_peered":"2024-05-14T09:18:02.785934+0000","last_unstale":"2024-05-14T09:19:42.460417+0000","last_undegraded":"2024-05-14T09:19:42.460417+0000","last_fullsized":"2024-05-14T09:19:42.460417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:02.103122+0000","last_change":"2024-05-14T09:17:57.781016+0000","last_active":"2024-05-14T09:20:02.103122+0000","last_peered":"2024-05-14T09:20:02.103122+0000","last_clean":"2024-05-14T09:20:02.103122+0000","last_became_active":"2024-05-14T09:17:57.777442+0000","last_became_peered":"2024-05-14T09:17:57.777442+0000","last_unstale":"2024-05-14T09:20:02.103122+0000","last_undegraded":"2024-05-14T09:20:02.103122+0000","last_fullsized":"2024-05-14T09:20:02.103122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:17:06.992053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460997+0000","last_change":"2024-05-14T09:18:15.891299+0000","last_active":"2024-05-14T09:19:42.460997+0000","last_peered":"2024-05-14T09:19:42.460997+0000","last_clean":"2024-05-14T09:19:42.460997+0000","last_became_active":"2024-05-14T09:18:15.890552+0000","last_became_peered":"2024-05-14T09:18:15.890552+0000","last_unstale":"2024-05-14T09:19:42.460997+0000","last_undegraded":"2024-05-14T09:19:42.460997+0000","last_fullsized":"2024-05-14T09:19:42.460997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:03:44.936117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810268+0000","last_change":"2024-05-14T09:18:02.793484+0000","last_active":"2024-05-14T09:19:42.810268+0000","last_peered":"2024-05-14T09:19:42.810268+0000","last_clean":"2024-05-14T09:19:42.810268+0000","last_became_active":"2024-05-14T09:18:02.792888+0000","last_became_peered":"2024-05-14T09:18:02.792888+0000","last_unstale":"2024-05-14T09:19:42.810268+0000","last_undegraded":"2024-05-14T09:19:42.810268+0000","last_fullsized":"2024-05-14T09:19:42.810268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:19.212025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466940+0000","last_change":"2024-05-14T09:17:57.715271+0000","last_active":"2024-05-14T09:19:42.466940+0000","last_peered":"2024-05-14T09:19:42.466940+0000","last_clean":"2024-05-14T09:19:42.466940+0000","last_became_active":"2024-05-14T09:17:57.712524+0000","last_became_peered":"2024-05-14T09:17:57.712524+0000","last_unstale":"2024-05-14T09:19:42.466940+0000","last_undegraded":"2024-05-14T09:19:42.466940+0000","last_fullsized":"2024-05-14T09:19:42.466940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:39:46.868509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460004+0000","last_change":"2024-05-14T09:16:01.832034+0000","last_active":"2024-05-14T09:19:42.460004+0000","last_peered":"2024-05-14T09:19:42.460004+0000","last_clean":"2024-05-14T09:19:42.460004+0000","last_became_active":"2024-05-14T09:16:01.815331+0000","last_became_peered":"2024-05-14T09:16:01.815331+0000","last_unstale":"2024-05-14T09:19:42.460004+0000","last_undegraded":"2024-05-14T09:19:42.460004+0000","last_fullsized":"2024-05-14T09:19:42.460004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_clean_scrub_stamp":"2024-05-14T09:11:00.916612+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:04:45.123827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461481+0000","last_change":"2024-05-14T09:18:16.136149+0000","last_active":"2024-05-14T09:19:42.461481+0000","last_peered":"2024-05-14T09:19:42.461481+0000","last_clean":"2024-05-14T09:19:42.461481+0000","last_became_active":"2024-05-14T09:18:16.134655+0000","last_became_peered":"2024-05-14T09:18:16.134655+0000","last_unstale":"2024-05-14T09:19:42.461481+0000","last_undegraded":"2024-05-14T09:19:42.461481+0000","last_fullsized":"2024-05-14T09:19:42.461481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:51.879763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458220+0000","last_change":"2024-05-14T09:18:02.791068+0000","last_active":"2024-05-14T09:19:42.458220+0000","last_peered":"2024-05-14T09:19:42.458220+0000","last_clean":"2024-05-14T09:19:42.458220+0000","last_became_active":"2024-05-14T09:18:02.785294+0000","last_became_peered":"2024-05-14T09:18:02.785294+0000","last_unstale":"2024-05-14T09:19:42.458220+0000","last_undegraded":"2024-05-14T09:19:42.458220+0000","last_fullsized":"2024-05-14T09:19:42.458220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:06:25.554475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460448+0000","last_change":"2024-05-14T09:17:57.715272+0000","last_active":"2024-05-14T09:19:42.460448+0000","last_peered":"2024-05-14T09:19:42.460448+0000","last_clean":"2024-05-14T09:19:42.460448+0000","last_became_active":"2024-05-14T09:17:57.713504+0000","last_became_peered":"2024-05-14T09:17:57.713504+0000","last_unstale":"2024-05-14T09:19:42.460448+0000","last_undegraded":"2024-05-14T09:19:42.460448+0000","last_fullsized":"2024-05-14T09:19:42.460448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:27:26.071204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890697+0000","last_change":"2024-05-14T09:18:15.893437+0000","last_active":"2024-05-14T09:19:42.890697+0000","last_peered":"2024-05-14T09:19:42.890697+0000","last_clean":"2024-05-14T09:19:42.890697+0000","last_became_active":"2024-05-14T09:18:15.890908+0000","last_became_peered":"2024-05-14T09:18:15.890908+0000","last_unstale":"2024-05-14T09:19:42.890697+0000","last_undegraded":"2024-05-14T09:19:42.890697+0000","last_fullsized":"2024-05-14T09:19:42.890697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:15.339562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814084+0000","last_change":"2024-05-14T09:17:57.779601+0000","last_active":"2024-05-14T09:19:42.814084+0000","last_peered":"2024-05-14T09:19:42.814084+0000","last_clean":"2024-05-14T09:19:42.814084+0000","last_became_active":"2024-05-14T09:17:57.778730+0000","last_became_peered":"2024-05-14T09:17:57.778730+0000","last_unstale":"2024-05-14T09:19:42.814084+0000","last_undegraded":"2024-05-14T09:19:42.814084+0000","last_fullsized":"2024-05-14T09:19:42.814084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:01:07.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459475+0000","last_change":"2024-05-14T09:18:02.786283+0000","last_active":"2024-05-14T09:19:42.459475+0000","last_peered":"2024-05-14T09:19:42.459475+0000","last_clean":"2024-05-14T09:19:42.459475+0000","last_became_active":"2024-05-14T09:18:02.785158+0000","last_became_peered":"2024-05-14T09:18:02.785158+0000","last_unstale":"2024-05-14T09:19:42.459475+0000","last_undegraded":"2024-05-14T09:19:42.459475+0000","last_fullsized":"2024-05-14T09:19:42.459475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:28.804419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810065+0000","last_change":"2024-05-14T09:18:16.133898+0000","last_active":"2024-05-14T09:19:42.810065+0000","last_peered":"2024-05-14T09:19:42.810065+0000","last_clean":"2024-05-14T09:19:42.810065+0000","last_became_active":"2024-05-14T09:18:16.132493+0000","last_became_peered":"2024-05-14T09:18:16.132493+0000","last_unstale":"2024-05-14T09:19:42.810065+0000","last_undegraded":"2024-05-14T09:19:42.810065+0000","last_fullsized":"2024-05-14T09:19:42.810065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:38:15.126883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'16","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:54.810385+0000","last_change":"2024-05-14T09:17:57.710000+0000","last_active":"2024-05-14T09:19:54.810385+0000","last_peered":"2024-05-14T09:19:54.810385+0000","last_clean":"2024-05-14T09:19:54.810385+0000","last_became_active":"2024-05-14T09:17:57.709546+0000","last_became_peered":"2024-05-14T09:17:57.709546+0000","last_unstale":"2024-05-14T09:19:54.810385+0000","last_undegraded":"2024-05-14T09:19:54.810385+0000","last_fullsized":"2024-05-14T09:19:54.810385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:09.681936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811135+0000","last_change":"2024-05-14T09:18:02.786342+0000","last_active":"2024-05-14T09:19:42.811135+0000","last_peered":"2024-05-14T09:19:42.811135+0000","last_clean":"2024-05-14T09:19:42.811135+0000","last_became_active":"2024-05-14T09:18:02.785981+0000","last_became_peered":"2024-05-14T09:18:02.785981+0000","last_unstale":"2024-05-14T09:19:42.811135+0000","last_undegraded":"2024-05-14T09:19:42.811135+0000","last_fullsized":"2024-05-14T09:19:42.811135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:59:43.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.463961+0000","last_change":"2024-05-14T09:18:15.882171+0000","last_active":"2024-05-14T09:19:42.463961+0000","last_peered":"2024-05-14T09:19:42.463961+0000","last_clean":"2024-05-14T09:19:42.463961+0000","last_became_active":"2024-05-14T09:18:15.881015+0000","last_became_peered":"2024-05-14T09:18:15.881015+0000","last_unstale":"2024-05-14T09:19:42.463961+0000","last_undegraded":"2024-05-14T09:19:42.463961+0000","last_fullsized":"2024-05-14T09:19:42.463961+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:18.832868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.468720+0000","last_change":"2024-05-14T09:17:58.254067+0000","last_active":"2024-05-14T09:19:42.468720+0000","last_peered":"2024-05-14T09:19:42.468720+0000","last_clean":"2024-05-14T09:19:42.468720+0000","last_became_active":"2024-05-14T09:17:58.253140+0000","last_became_peered":"2024-05-14T09:17:58.253140+0000","last_unstale":"2024-05-14T09:19:42.468720+0000","last_undegraded":"2024-05-14T09:19:42.468720+0000","last_fullsized":"2024-05-14T09:19:42.468720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:20.263028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886335+0000","last_change":"2024-05-14T09:18:02.775968+0000","last_active":"2024-05-14T09:19:42.886335+0000","last_peered":"2024-05-14T09:19:42.886335+0000","last_clean":"2024-05-14T09:19:42.886335+0000","last_became_active":"2024-05-14T09:18:02.775639+0000","last_became_peered":"2024-05-14T09:18:02.775639+0000","last_unstale":"2024-05-14T09:19:42.886335+0000","last_undegraded":"2024-05-14T09:19:42.886335+0000","last_fullsized":"2024-05-14T09:19:42.886335+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:27:52.179647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467811+0000","last_change":"2024-05-14T09:18:16.139823+0000","last_active":"2024-05-14T09:19:42.467811+0000","last_peered":"2024-05-14T09:19:42.467811+0000","last_clean":"2024-05-14T09:19:42.467811+0000","last_became_active":"2024-05-14T09:18:16.138075+0000","last_became_peered":"2024-05-14T09:18:16.138075+0000","last_unstale":"2024-05-14T09:19:42.467811+0000","last_undegraded":"2024-05-14T09:19:42.467811+0000","last_fullsized":"2024-05-14T09:19:42.467811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:41.186678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890342+0000","last_change":"2024-05-14T09:17:57.773751+0000","last_active":"2024-05-14T09:19:42.890342+0000","last_peered":"2024-05-14T09:19:42.890342+0000","last_clean":"2024-05-14T09:19:42.890342+0000","last_became_active":"2024-05-14T09:17:57.772964+0000","last_became_peered":"2024-05-14T09:17:57.772964+0000","last_unstale":"2024-05-14T09:19:42.890342+0000","last_undegraded":"2024-05-14T09:19:42.890342+0000","last_fullsized":"2024-05-14T09:19:42.890342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:08:01.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813590+0000","last_change":"2024-05-14T09:18:02.774847+0000","last_active":"2024-05-14T09:19:42.813590+0000","last_peered":"2024-05-14T09:19:42.813590+0000","last_clean":"2024-05-14T09:19:42.813590+0000","last_became_active":"2024-05-14T09:18:02.774384+0000","last_became_peered":"2024-05-14T09:18:02.774384+0000","last_unstale":"2024-05-14T09:19:42.813590+0000","last_undegraded":"2024-05-14T09:19:42.813590+0000","last_fullsized":"2024-05-14T09:19:42.813590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:54:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.808049+0000","last_change":"2024-05-14T09:18:15.887656+0000","last_active":"2024-05-14T09:19:42.808049+0000","last_peered":"2024-05-14T09:19:42.808049+0000","last_clean":"2024-05-14T09:19:42.808049+0000","last_became_active":"2024-05-14T09:18:15.887203+0000","last_became_peered":"2024-05-14T09:18:15.887203+0000","last_unstale":"2024-05-14T09:19:42.808049+0000","last_undegraded":"2024-05-14T09:19:42.808049+0000","last_fullsized":"2024-05-14T09:19:42.808049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:27.080959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810710+0000","last_change":"2024-05-14T09:17:57.707511+0000","last_active":"2024-05-14T09:19:42.810710+0000","last_peered":"2024-05-14T09:19:42.810710+0000","last_clean":"2024-05-14T09:19:42.810710+0000","last_became_active":"2024-05-14T09:17:57.706706+0000","last_became_peered":"2024-05-14T09:17:57.706706+0000","last_unstale":"2024-05-14T09:19:42.810710+0000","last_undegraded":"2024-05-14T09:19:42.810710+0000","last_fullsized":"2024-05-14T09:19:42.810710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:25.325832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890576+0000","last_change":"2024-05-14T09:18:02.787800+0000","last_active":"2024-05-14T09:19:42.890576+0000","last_peered":"2024-05-14T09:19:42.890576+0000","last_clean":"2024-05-14T09:19:42.890576+0000","last_became_active":"2024-05-14T09:18:02.785115+0000","last_became_peered":"2024-05-14T09:18:02.785115+0000","last_unstale":"2024-05-14T09:19:42.890576+0000","last_undegraded":"2024-05-14T09:19:42.890576+0000","last_fullsized":"2024-05-14T09:19:42.890576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:23.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.900338+0000","last_change":"2024-05-14T09:19:42.898356+0000","last_active":"2024-05-14T09:19:42.900338+0000","last_peered":"2024-05-14T09:19:42.900338+0000","last_clean":"2024-05-14T09:19:42.900338+0000","last_became_active":"2024-05-14T09:19:42.896256+0000","last_became_peered":"2024-05-14T09:19:42.896256+0000","last_unstale":"2024-05-14T09:19:42.900338+0000","last_undegraded":"2024-05-14T09:19:42.900338+0000","last_fullsized":"2024-05-14T09:19:42.900338+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:59:09.389588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.464902+0000","last_change":"2024-05-14T09:17:57.710472+0000","last_active":"2024-05-14T09:19:42.464902+0000","last_peered":"2024-05-14T09:19:42.464902+0000","last_clean":"2024-05-14T09:19:42.464902+0000","last_became_active":"2024-05-14T09:17:57.710056+0000","last_became_peered":"2024-05-14T09:17:57.710056+0000","last_unstale":"2024-05-14T09:19:42.464902+0000","last_undegraded":"2024-05-14T09:19:42.464902+0000","last_fullsized":"2024-05-14T09:19:42.464902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:45.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810546+0000","last_change":"2024-05-14T09:18:02.779982+0000","last_active":"2024-05-14T09:19:42.810546+0000","last_peered":"2024-05-14T09:19:42.810546+0000","last_clean":"2024-05-14T09:19:42.810546+0000","last_became_active":"2024-05-14T09:18:02.779595+0000","last_became_peered":"2024-05-14T09:18:02.779595+0000","last_unstale":"2024-05-14T09:19:42.810546+0000","last_undegraded":"2024-05-14T09:19:42.810546+0000","last_fullsized":"2024-05-14T09:19:42.810546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:06.520980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467407+0000","last_change":"2024-05-14T09:18:16.137850+0000","last_active":"2024-05-14T09:19:42.467407+0000","last_peered":"2024-05-14T09:19:42.467407+0000","last_clean":"2024-05-14T09:19:42.467407+0000","last_became_active":"2024-05-14T09:18:16.135097+0000","last_became_peered":"2024-05-14T09:18:16.135097+0000","last_unstale":"2024-05-14T09:19:42.467407+0000","last_undegraded":"2024-05-14T09:19:42.467407+0000","last_fullsized":"2024-05-14T09:19:42.467407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:29:09.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813419+0000","last_change":"2024-05-14T09:17:57.720232+0000","last_active":"2024-05-14T09:19:42.813419+0000","last_peered":"2024-05-14T09:19:42.813419+0000","last_clean":"2024-05-14T09:19:42.813419+0000","last_became_active":"2024-05-14T09:17:57.719057+0000","last_became_peered":"2024-05-14T09:17:57.719057+0000","last_unstale":"2024-05-14T09:19:42.813419+0000","last_undegraded":"2024-05-14T09:19:42.813419+0000","last_fullsized":"2024-05-14T09:19:42.813419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:34.378868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460625+0000","last_change":"2024-05-14T09:18:02.788106+0000","last_active":"2024-05-14T09:19:42.460625+0000","last_peered":"2024-05-14T09:19:42.460625+0000","last_clean":"2024-05-14T09:19:42.460625+0000","last_became_active":"2024-05-14T09:18:02.787631+0000","last_became_peered":"2024-05-14T09:18:02.787631+0000","last_unstale":"2024-05-14T09:19:42.460625+0000","last_undegraded":"2024-05-14T09:19:42.460625+0000","last_fullsized":"2024-05-14T09:19:42.460625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:59:45.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890890+0000","last_change":"2024-05-14T09:18:15.889654+0000","last_active":"2024-05-14T09:19:42.890890+0000","last_peered":"2024-05-14T09:19:42.890890+0000","last_clean":"2024-05-14T09:19:42.890890+0000","last_became_active":"2024-05-14T09:18:15.888915+0000","last_became_peered":"2024-05-14T09:18:15.888915+0000","last_unstale":"2024-05-14T09:19:42.890890+0000","last_undegraded":"2024-05-14T09:19:42.890890+0000","last_fullsized":"2024-05-14T09:19:42.890890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:52:27.127246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:58.093178+0000","last_change":"2024-05-14T09:17:58.253945+0000","last_active":"2024-05-14T09:19:58.093178+0000","last_peered":"2024-05-14T09:19:58.093178+0000","last_clean":"2024-05-14T09:19:58.093178+0000","last_became_active":"2024-05-14T09:17:58.252807+0000","last_became_peered":"2024-05-14T09:17:58.252807+0000","last_unstale":"2024-05-14T09:19:58.093178+0000","last_undegraded":"2024-05-14T09:19:58.093178+0000","last_fullsized":"2024-05-14T09:19:58.093178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:56:52.853589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461794+0000","last_change":"2024-05-14T09:18:02.792743+0000","last_active":"2024-05-14T09:19:42.461794+0000","last_peered":"2024-05-14T09:19:42.461794+0000","last_clean":"2024-05-14T09:19:42.461794+0000","last_became_active":"2024-05-14T09:18:02.792371+0000","last_became_peered":"2024-05-14T09:18:02.792371+0000","last_unstale":"2024-05-14T09:19:42.461794+0000","last_undegraded":"2024-05-14T09:19:42.461794+0000","last_fullsized":"2024-05-14T09:19:42.461794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:10:00.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885584+0000","last_change":"2024-05-14T09:18:15.884104+0000","last_active":"2024-05-14T09:19:42.885584+0000","last_peered":"2024-05-14T09:19:42.885584+0000","last_clean":"2024-05-14T09:19:42.885584+0000","last_became_active":"2024-05-14T09:18:15.881737+0000","last_became_peered":"2024-05-14T09:18:15.881737+0000","last_unstale":"2024-05-14T09:19:42.885584+0000","last_undegraded":"2024-05-14T09:19:42.885584+0000","last_fullsized":"2024-05-14T09:19:42.885584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:27:57.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461959+0000","last_change":"2024-05-14T09:17:57.717776+0000","last_active":"2024-05-14T09:19:42.461959+0000","last_peered":"2024-05-14T09:19:42.461959+0000","last_clean":"2024-05-14T09:19:42.461959+0000","last_became_active":"2024-05-14T09:17:57.717338+0000","last_became_peered":"2024-05-14T09:17:57.717338+0000","last_unstale":"2024-05-14T09:19:42.461959+0000","last_undegraded":"2024-05-14T09:19:42.461959+0000","last_fullsized":"2024-05-14T09:19:42.461959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:38.441355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461321+0000","last_change":"2024-05-14T09:18:02.786286+0000","last_active":"2024-05-14T09:19:42.461321+0000","last_peered":"2024-05-14T09:19:42.461321+0000","last_clean":"2024-05-14T09:19:42.461321+0000","last_became_active":"2024-05-14T09:18:02.785915+0000","last_became_peered":"2024-05-14T09:18:02.785915+0000","last_unstale":"2024-05-14T09:19:42.461321+0000","last_undegraded":"2024-05-14T09:19:42.461321+0000","last_fullsized":"2024-05-14T09:19:42.461321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:54:08.960145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459339+0000","last_change":"2024-05-14T09:18:15.889692+0000","last_active":"2024-05-14T09:19:42.459339+0000","last_peered":"2024-05-14T09:19:42.459339+0000","last_clean":"2024-05-14T09:19:42.459339+0000","last_became_active":"2024-05-14T09:18:15.888675+0000","last_became_peered":"2024-05-14T09:18:15.888675+0000","last_unstale":"2024-05-14T09:19:42.459339+0000","last_undegraded":"2024-05-14T09:19:42.459339+0000","last_fullsized":"2024-05-14T09:19:42.459339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:11:20.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459050+0000","last_change":"2024-05-14T09:17:57.694782+0000","last_active":"2024-05-14T09:19:42.459050+0000","last_peered":"2024-05-14T09:19:42.459050+0000","last_clean":"2024-05-14T09:19:42.459050+0000","last_became_active":"2024-05-14T09:17:57.693913+0000","last_became_peered":"2024-05-14T09:17:57.693913+0000","last_unstale":"2024-05-14T09:19:42.459050+0000","last_undegraded":"2024-05-14T09:19:42.459050+0000","last_fullsized":"2024-05-14T09:19:42.459050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:36:10.758138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462269+0000","last_change":"2024-05-14T09:18:02.784340+0000","last_active":"2024-05-14T09:19:42.462269+0000","last_peered":"2024-05-14T09:19:42.462269+0000","last_clean":"2024-05-14T09:19:42.462269+0000","last_became_active":"2024-05-14T09:18:02.783905+0000","last_became_peered":"2024-05-14T09:18:02.783905+0000","last_unstale":"2024-05-14T09:19:42.462269+0000","last_undegraded":"2024-05-14T09:19:42.462269+0000","last_fullsized":"2024-05-14T09:19:42.462269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:57:57.219324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890915+0000","last_change":"2024-05-14T09:18:02.789214+0000","last_active":"2024-05-14T09:19:42.890915+0000","last_peered":"2024-05-14T09:19:42.890915+0000","last_clean":"2024-05-14T09:19:42.890915+0000","last_became_active":"2024-05-14T09:18:02.788764+0000","last_became_peered":"2024-05-14T09:18:02.788764+0000","last_unstale":"2024-05-14T09:19:42.890915+0000","last_undegraded":"2024-05-14T09:19:42.890915+0000","last_fullsized":"2024-05-14T09:19:42.890915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:13.665828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466401+0000","last_change":"2024-05-14T09:18:02.782255+0000","last_active":"2024-05-14T09:19:42.466401+0000","last_peered":"2024-05-14T09:19:42.466401+0000","last_clean":"2024-05-14T09:19:42.466401+0000","last_became_active":"2024-05-14T09:18:02.781817+0000","last_became_peered":"2024-05-14T09:18:02.781817+0000","last_unstale":"2024-05-14T09:19:42.466401+0000","last_undegraded":"2024-05-14T09:19:42.466401+0000","last_fullsized":"2024-05-14T09:19:42.466401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:56:31.544934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.464590+0000","last_change":"2024-05-14T09:18:02.781737+0000","last_active":"2024-05-14T09:19:42.464590+0000","last_peered":"2024-05-14T09:19:42.464590+0000","last_clean":"2024-05-14T09:19:42.464590+0000","last_became_active":"2024-05-14T09:18:02.778429+0000","last_became_peered":"2024-05-14T09:18:02.778429+0000","last_unstale":"2024-05-14T09:19:42.464590+0000","last_undegraded":"2024-05-14T09:19:42.464590+0000","last_fullsized":"2024-05-14T09:19:42.464590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:52.699915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886015+0000","last_change":"2024-05-14T09:18:02.787107+0000","last_active":"2024-05-14T09:19:42.886015+0000","last_peered":"2024-05-14T09:19:42.886015+0000","last_clean":"2024-05-14T09:19:42.886015+0000","last_became_active":"2024-05-14T09:18:02.786259+0000","last_became_peered":"2024-05-14T09:18:02.786259+0000","last_unstale":"2024-05-14T09:19:42.886015+0000","last_undegraded":"2024-05-14T09:19:42.886015+0000","last_fullsized":"2024-05-14T09:19:42.886015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:50.103862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459488+0000","last_change":"2024-05-14T09:18:02.792086+0000","last_active":"2024-05-14T09:19:42.459488+0000","last_peered":"2024-05-14T09:19:42.459488+0000","last_clean":"2024-05-14T09:19:42.459488+0000","last_became_active":"2024-05-14T09:18:02.785795+0000","last_became_peered":"2024-05-14T09:18:02.785795+0000","last_unstale":"2024-05-14T09:19:42.459488+0000","last_undegraded":"2024-05-14T09:19:42.459488+0000","last_fullsized":"2024-05-14T09:19:42.459488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:58.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891603+0000","last_change":"2024-05-14T09:18:02.787934+0000","last_active":"2024-05-14T09:19:42.891603+0000","last_peered":"2024-05-14T09:19:42.891603+0000","last_clean":"2024-05-14T09:19:42.891603+0000","last_became_active":"2024-05-14T09:18:02.787030+0000","last_became_peered":"2024-05-14T09:18:02.787030+0000","last_unstale":"2024-05-14T09:19:42.891603+0000","last_undegraded":"2024-05-14T09:19:42.891603+0000","last_fullsized":"2024-05-14T09:19:42.891603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:02:57.521485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465624+0000","last_change":"2024-05-14T09:18:02.791714+0000","last_active":"2024-05-14T09:19:42.465624+0000","last_peered":"2024-05-14T09:19:42.465624+0000","last_clean":"2024-05-14T09:19:42.465624+0000","last_became_active":"2024-05-14T09:18:02.791184+0000","last_became_peered":"2024-05-14T09:18:02.791184+0000","last_unstale":"2024-05-14T09:19:42.465624+0000","last_undegraded":"2024-05-14T09:19:42.465624+0000","last_fullsized":"2024-05-14T09:19:42.465624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:55:03.943446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811249+0000","last_change":"2024-05-14T09:18:02.790270+0000","last_active":"2024-05-14T09:19:42.811249+0000","last_peered":"2024-05-14T09:19:42.811249+0000","last_clean":"2024-05-14T09:19:42.811249+0000","last_became_active":"2024-05-14T09:18:02.789845+0000","last_became_peered":"2024-05-14T09:18:02.789845+0000","last_unstale":"2024-05-14T09:19:42.811249+0000","last_undegraded":"2024-05-14T09:19:42.811249+0000","last_fullsized":"2024-05-14T09:19:42.811249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:10:43.469279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459685+0000","last_change":"2024-05-14T09:18:02.778122+0000","last_active":"2024-05-14T09:19:42.459685+0000","last_peered":"2024-05-14T09:19:42.459685+0000","last_clean":"2024-05-14T09:19:42.459685+0000","last_became_active":"2024-05-14T09:18:02.775013+0000","last_became_peered":"2024-05-14T09:18:02.775013+0000","last_unstale":"2024-05-14T09:19:42.459685+0000","last_undegraded":"2024-05-14T09:19:42.459685+0000","last_fullsized":"2024-05-14T09:19:42.459685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:49:35.138229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807022+0000","last_change":"2024-05-14T09:18:41.667927+0000","last_active":"2024-05-14T09:19:42.807022+0000","last_peered":"2024-05-14T09:19:42.807022+0000","last_clean":"2024-05-14T09:19:42.807022+0000","last_became_active":"2024-05-14T09:18:41.667390+0000","last_became_peered":"2024-05-14T09:18:41.667390+0000","last_unstale":"2024-05-14T09:19:42.807022+0000","last_undegraded":"2024-05-14T09:19:42.807022+0000","last_fullsized":"2024-05-14T09:19:42.807022+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:47.648872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891568+0000","last_change":"2024-05-14T09:18:02.794924+0000","last_active":"2024-05-14T09:19:42.891568+0000","last_peered":"2024-05-14T09:19:42.891568+0000","last_clean":"2024-05-14T09:19:42.891568+0000","last_became_active":"2024-05-14T09:18:02.794505+0000","last_became_peered":"2024-05-14T09:18:02.794505+0000","last_unstale":"2024-05-14T09:19:42.891568+0000","last_undegraded":"2024-05-14T09:19:42.891568+0000","last_fullsized":"2024-05-14T09:19:42.891568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:39.150209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458949+0000","last_change":"2024-05-14T09:18:02.781514+0000","last_active":"2024-05-14T09:19:42.458949+0000","last_peered":"2024-05-14T09:19:42.458949+0000","last_clean":"2024-05-14T09:19:42.458949+0000","last_became_active":"2024-05-14T09:18:02.779948+0000","last_became_peered":"2024-05-14T09:18:02.779948+0000","last_unstale":"2024-05-14T09:19:42.458949+0000","last_undegraded":"2024-05-14T09:19:42.458949+0000","last_fullsized":"2024-05-14T09:19:42.458949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:25.125018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891164+0000","last_change":"2024-05-14T09:18:02.785558+0000","last_active":"2024-05-14T09:19:42.891164+0000","last_peered":"2024-05-14T09:19:42.891164+0000","last_clean":"2024-05-14T09:19:42.891164+0000","last_became_active":"2024-05-14T09:18:02.785086+0000","last_became_peered":"2024-05-14T09:18:02.785086+0000","last_unstale":"2024-05-14T09:19:42.891164+0000","last_undegraded":"2024-05-14T09:19:42.891164+0000","last_fullsized":"2024-05-14T09:19:42.891164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:39:13.087341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70422,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":357,"num_read_kb":258,"num_write":251,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":211266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678060,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":519244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874290,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1172412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037818,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":518603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234049,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":518869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430280,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1115869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593808,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":514498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1110016,"data_stored":578355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738493,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":515954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411439,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":577885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149799,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":513815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953567,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":519194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790041,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32812,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712340,"statfs":{"total":95995035648,"available":95961436160,"internally_reserved":0,"allocated":1667072,"data_stored":1111060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:20:06.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T09:20:06.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:06 smithi120 ceph-mon[31085]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:20:06.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:06 smithi152 ceph-mon[34868]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:20:06.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:06 smithi175 ceph-mon[35353]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:20:07.118 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:07 smithi152 ceph-mon[34868]: pgmap v453: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-14T09:20:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:07.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:07.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:07.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:07 smithi120 ceph-mon[31085]: pgmap v453: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-14T09:20:08.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.076 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.077 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:07 smithi175 ceph-mon[35353]: pgmap v453: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-14T09:20:08.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:08.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:09.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.462+0000 7f6d66a00700 1 -- 172.21.15.120:0/2160224396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 msgr2=0x7f6d60110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:09.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.462+0000 7f6d66a00700 1 --2- 172.21.15.120:0/2160224396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d60110dd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800b0a0 tx=0x7f6d5800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.463+0000 7f6d66a00700 1 -- 172.21.15.120:0/2160224396 shutdown_connections 2024-05-14T09:20:09.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.463+0000 7f6d66a00700 1 --2- 172.21.15.120:0/2160224396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d60110dd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.463+0000 7f6d66a00700 1 --2- 172.21.15.120:0/2160224396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d601054a0 0x7f6d601058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.463+0000 7f6d66a00700 1 --2- 172.21.15.120:0/2160224396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d60105df0 0x7f6d6010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.463+0000 7f6d66a00700 1 -- 172.21.15.120:0/2160224396 >> 172.21.15.120:0/2160224396 conn(0x7f6d600fedc0 msgr2=0x7f6d601011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:09.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.463+0000 7f6d66a00700 1 -- 172.21.15.120:0/2160224396 shutdown_connections 2024-05-14T09:20:09.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.463+0000 7f6d66a00700 1 -- 172.21.15.120:0/2160224396 wait complete. 2024-05-14T09:20:09.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 Processor -- start 2024-05-14T09:20:09.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 -- start start 2024-05-14T09:20:09.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d601054a0 0x7f6d6019cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:09.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d60105df0 0x7f6d6019d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:09.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d601a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60114370 con 0x7f6d6010e910 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601141f0 con 0x7f6d60105df0 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.464+0000 7f6d66a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601144f0 con 0x7f6d601054a0 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d601a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d601a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45346/0 (socket says 172.21.15.120:45346) 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 -- 172.21.15.120:0/996247283 learned_addr learned my addr 172.21.15.120:0/996247283 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d5fe00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d601054a0 0x7f6d6019cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d5f400700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d60105df0 0x7f6d6019d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 -- 172.21.15.120:0/996247283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d601054a0 msgr2=0x7f6d6019cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d601054a0 0x7f6d6019cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 -- 172.21.15.120:0/996247283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d60105df0 msgr2=0x7f6d6019d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d60105df0 0x7f6d6019d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.465+0000 7f6d64a00700 1 -- 172.21.15.120:0/996247283 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601a1dc0 con 0x7f6d6010e910 2024-05-14T09:20:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.466+0000 7f6d64a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d601a17d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d58004dc0 tx=0x7f6d58004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:09.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.466+0000 7f6d5cc00700 1 -- 172.21.15.120:0/996247283 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58021020 con 0x7f6d6010e910 2024-05-14T09:20:09.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.466+0000 7f6d5cc00700 1 -- 172.21.15.120:0/996247283 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d58007cf0 con 0x7f6d6010e910 2024-05-14T09:20:09.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.466+0000 7f6d5cc00700 1 -- 172.21.15.120:0/996247283 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58005370 con 0x7f6d6010e910 2024-05-14T09:20:09.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.466+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d601a2050 con 0x7f6d6010e910 2024-05-14T09:20:09.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.466+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601a24e0 con 0x7f6d6010e910 2024-05-14T09:20:09.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.468+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d600512c0 con 0x7f6d6010e910 2024-05-14T09:20:09.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.470+0000 7f6d5cc00700 1 -- 172.21.15.120:0/996247283 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f6d58024020 con 0x7f6d6010e910 2024-05-14T09:20:09.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.471+0000 7f6d5cc00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d440b2990 0x7f6d440b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:09.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.472+0000 7f6d5cc00700 1 -- 172.21.15.120:0/996247283 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6d5800f020 con 0x7f6d6010e910 2024-05-14T09:20:09.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.472+0000 7f6d5fe00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d440b2990 0x7f6d440b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:09.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.473+0000 7f6d5fe00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d440b2990 0x7f6d440b4ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d50005ea0 tx=0x7f6d50005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:09.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.477+0000 7f6d5cc00700 1 -- 172.21.15.120:0/996247283 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6d580ab380 con 0x7f6d6010e910 2024-05-14T09:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.700+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d60063c00 con 0x7f6d440b2990 2024-05-14T09:20:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.728+0000 7f6d5cc00700 1 -- 172.21.15.120:0/996247283 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340464 (secure 0 0 0) 0x7f6d60063c00 con 0x7f6d440b2990 2024-05-14T09:20:09.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:20:09.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.735+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d440b2990 msgr2=0x7f6d440b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:09.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.735+0000 7f6d66a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d440b2990 0x7f6d440b4ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d50005ea0 tx=0x7f6d50005e30 comp rx=0 tx=0).stop 2024-05-14T09:20:09.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.735+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 msgr2=0x7f6d601a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:09.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.735+0000 7f6d66a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d601a17d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d58004dc0 tx=0x7f6d58004ea0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 shutdown_connections 2024-05-14T09:20:09.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d440b2990 0x7f6d440b4ea0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6010e910 0x7f6d601a17d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d601054a0 0x7f6d6019cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 --2- 172.21.15.120:0/996247283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d60105df0 0x7f6d6019d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:09.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 >> 172.21.15.120:0/996247283 conn(0x7f6d600fedc0 msgr2=0x7f6d601032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:09.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 shutdown_connections 2024-05-14T09:20:09.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:09.736+0000 7f6d66a00700 1 -- 172.21.15.120:0/996247283 wait complete. 2024-05-14T09:20:09.739 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-05-14T09:20:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:09 smithi152 ceph-mon[34868]: pgmap v454: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T09:20:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:09.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:09 smithi175 ceph-mon[35353]: pgmap v454: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T09:20:09.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:09.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:10.107 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:09 smithi120 ceph-mon[31085]: pgmap v454: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T09:20:10.108 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:10.108 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:10.507 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-05-14T09:20:08.330999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665289,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":484,"num_read_kb":352,"num_write":377,"num_write_kb":2300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363524,"kb_used_data":14348,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578300,"statfs":{"total":1151940427776,"available":1151568179200,"internally_reserved":0,"allocated":14692352,"data_stored":8188553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9568,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006191"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891770+0000","last_change":"2024-05-14T09:18:02.795124+0000","last_active":"2024-05-14T09:19:42.891770+0000","last_peered":"2024-05-14T09:19:42.891770+0000","last_clean":"2024-05-14T09:19:42.891770+0000","last_became_active":"2024-05-14T09:18:02.794129+0000","last_became_peered":"2024-05-14T09:18:02.794129+0000","last_unstale":"2024-05-14T09:19:42.891770+0000","last_undegraded":"2024-05-14T09:19:42.891770+0000","last_fullsized":"2024-05-14T09:19:42.891770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:54.875120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886337+0000","last_change":"2024-05-14T09:18:02.775506+0000","last_active":"2024-05-14T09:19:42.886337+0000","last_peered":"2024-05-14T09:19:42.886337+0000","last_clean":"2024-05-14T09:19:42.886337+0000","last_became_active":"2024-05-14T09:18:02.774491+0000","last_became_peered":"2024-05-14T09:18:02.774491+0000","last_unstale":"2024-05-14T09:19:42.886337+0000","last_undegraded":"2024-05-14T09:19:42.886337+0000","last_fullsized":"2024-05-14T09:19:42.886337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:36:40.414254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886517+0000","last_change":"2024-05-14T09:18:02.792681+0000","last_active":"2024-05-14T09:19:42.886517+0000","last_peered":"2024-05-14T09:19:42.886517+0000","last_clean":"2024-05-14T09:19:42.886517+0000","last_became_active":"2024-05-14T09:18:02.791903+0000","last_became_peered":"2024-05-14T09:18:02.791903+0000","last_unstale":"2024-05-14T09:19:42.886517+0000","last_undegraded":"2024-05-14T09:19:42.886517+0000","last_fullsized":"2024-05-14T09:19:42.886517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:09:31.027641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807617+0000","last_change":"2024-05-14T09:18:41.667606+0000","last_active":"2024-05-14T09:19:42.807617+0000","last_peered":"2024-05-14T09:19:42.807617+0000","last_clean":"2024-05-14T09:19:42.807617+0000","last_became_active":"2024-05-14T09:18:41.666853+0000","last_became_peered":"2024-05-14T09:18:41.666853+0000","last_unstale":"2024-05-14T09:19:42.807617+0000","last_undegraded":"2024-05-14T09:19:42.807617+0000","last_fullsized":"2024-05-14T09:19:42.807617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:13:40.719553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813544+0000","last_change":"2024-05-14T09:18:02.775383+0000","last_active":"2024-05-14T09:19:42.813544+0000","last_peered":"2024-05-14T09:19:42.813544+0000","last_clean":"2024-05-14T09:19:42.813544+0000","last_became_active":"2024-05-14T09:18:02.774694+0000","last_became_peered":"2024-05-14T09:18:02.774694+0000","last_unstale":"2024-05-14T09:19:42.813544+0000","last_undegraded":"2024-05-14T09:19:42.813544+0000","last_fullsized":"2024-05-14T09:19:42.813544+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:47.289929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894249+0000","last_change":"2024-05-14T09:18:02.782178+0000","last_active":"2024-05-14T09:19:42.894249+0000","last_peered":"2024-05-14T09:19:42.894249+0000","last_clean":"2024-05-14T09:19:42.894249+0000","last_became_active":"2024-05-14T09:18:02.781714+0000","last_became_peered":"2024-05-14T09:18:02.781714+0000","last_unstale":"2024-05-14T09:19:42.894249+0000","last_undegraded":"2024-05-14T09:19:42.894249+0000","last_fullsized":"2024-05-14T09:19:42.894249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:43:02.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460310+0000","last_change":"2024-05-14T09:18:02.774434+0000","last_active":"2024-05-14T09:19:42.460310+0000","last_peered":"2024-05-14T09:19:42.460310+0000","last_clean":"2024-05-14T09:19:42.460310+0000","last_became_active":"2024-05-14T09:18:02.774054+0000","last_became_peered":"2024-05-14T09:18:02.774054+0000","last_unstale":"2024-05-14T09:19:42.460310+0000","last_undegraded":"2024-05-14T09:19:42.460310+0000","last_fullsized":"2024-05-14T09:19:42.460310+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:10.640939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810203+0000","last_change":"2024-05-14T09:18:02.780444+0000","last_active":"2024-05-14T09:19:42.810203+0000","last_peered":"2024-05-14T09:19:42.810203+0000","last_clean":"2024-05-14T09:19:42.810203+0000","last_became_active":"2024-05-14T09:18:02.779992+0000","last_became_peered":"2024-05-14T09:18:02.779992+0000","last_unstale":"2024-05-14T09:19:42.810203+0000","last_undegraded":"2024-05-14T09:19:42.810203+0000","last_fullsized":"2024-05-14T09:19:42.810203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:32:14.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.893291+0000","last_change":"2024-05-14T09:18:02.790247+0000","last_active":"2024-05-14T09:19:42.893291+0000","last_peered":"2024-05-14T09:19:42.893291+0000","last_clean":"2024-05-14T09:19:42.893291+0000","last_became_active":"2024-05-14T09:18:02.789293+0000","last_became_peered":"2024-05-14T09:18:02.789293+0000","last_unstale":"2024-05-14T09:19:42.893291+0000","last_undegraded":"2024-05-14T09:19:42.893291+0000","last_fullsized":"2024-05-14T09:19:42.893291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:01.939326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.896371+0000","last_change":"2024-05-14T09:18:02.785167+0000","last_active":"2024-05-14T09:19:42.896371+0000","last_peered":"2024-05-14T09:19:42.896371+0000","last_clean":"2024-05-14T09:19:42.896371+0000","last_became_active":"2024-05-14T09:18:02.784772+0000","last_became_peered":"2024-05-14T09:18:02.784772+0000","last_unstale":"2024-05-14T09:19:42.896371+0000","last_undegraded":"2024-05-14T09:19:42.896371+0000","last_fullsized":"2024-05-14T09:19:42.896371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:06.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461597+0000","last_change":"2024-05-14T09:18:02.793000+0000","last_active":"2024-05-14T09:19:42.461597+0000","last_peered":"2024-05-14T09:19:42.461597+0000","last_clean":"2024-05-14T09:19:42.461597+0000","last_became_active":"2024-05-14T09:18:02.791895+0000","last_became_peered":"2024-05-14T09:18:02.791895+0000","last_unstale":"2024-05-14T09:19:42.461597+0000","last_undegraded":"2024-05-14T09:19:42.461597+0000","last_fullsized":"2024-05-14T09:19:42.461597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:17.313383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.468102+0000","last_change":"2024-05-14T09:18:02.776309+0000","last_active":"2024-05-14T09:19:42.468102+0000","last_peered":"2024-05-14T09:19:42.468102+0000","last_clean":"2024-05-14T09:19:42.468102+0000","last_became_active":"2024-05-14T09:18:02.769218+0000","last_became_peered":"2024-05-14T09:18:02.769218+0000","last_unstale":"2024-05-14T09:19:42.468102+0000","last_undegraded":"2024-05-14T09:19:42.468102+0000","last_fullsized":"2024-05-14T09:19:42.468102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:54.793852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459166+0000","last_change":"2024-05-14T09:18:41.667109+0000","last_active":"2024-05-14T09:19:42.459166+0000","last_peered":"2024-05-14T09:19:42.459166+0000","last_clean":"2024-05-14T09:19:42.459166+0000","last_became_active":"2024-05-14T09:18:41.666437+0000","last_became_peered":"2024-05-14T09:18:41.666437+0000","last_unstale":"2024-05-14T09:19:42.459166+0000","last_undegraded":"2024-05-14T09:19:42.459166+0000","last_fullsized":"2024-05-14T09:19:42.459166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:14.806924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885246+0000","last_change":"2024-05-14T09:18:02.777380+0000","last_active":"2024-05-14T09:19:42.885246+0000","last_peered":"2024-05-14T09:19:42.885246+0000","last_clean":"2024-05-14T09:19:42.885246+0000","last_became_active":"2024-05-14T09:18:02.777035+0000","last_became_peered":"2024-05-14T09:18:02.777035+0000","last_unstale":"2024-05-14T09:19:42.885246+0000","last_undegraded":"2024-05-14T09:19:42.885246+0000","last_fullsized":"2024-05-14T09:19:42.885246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:56.906077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886307+0000","last_change":"2024-05-14T09:18:02.784577+0000","last_active":"2024-05-14T09:19:42.886307+0000","last_peered":"2024-05-14T09:19:42.886307+0000","last_clean":"2024-05-14T09:19:42.886307+0000","last_became_active":"2024-05-14T09:18:02.784185+0000","last_became_peered":"2024-05-14T09:18:02.784185+0000","last_unstale":"2024-05-14T09:19:42.886307+0000","last_undegraded":"2024-05-14T09:19:42.886307+0000","last_fullsized":"2024-05-14T09:19:42.886307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:44:38.518861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890331+0000","last_change":"2024-05-14T09:18:02.783262+0000","last_active":"2024-05-14T09:19:42.890331+0000","last_peered":"2024-05-14T09:19:42.890331+0000","last_clean":"2024-05-14T09:19:42.890331+0000","last_became_active":"2024-05-14T09:18:02.780405+0000","last_became_peered":"2024-05-14T09:18:02.780405+0000","last_unstale":"2024-05-14T09:19:42.890331+0000","last_undegraded":"2024-05-14T09:19:42.890331+0000","last_fullsized":"2024-05-14T09:19:42.890331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:01:50.437966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891244+0000","last_change":"2024-05-14T09:18:02.789155+0000","last_active":"2024-05-14T09:19:42.891244+0000","last_peered":"2024-05-14T09:19:42.891244+0000","last_clean":"2024-05-14T09:19:42.891244+0000","last_became_active":"2024-05-14T09:18:02.788703+0000","last_became_peered":"2024-05-14T09:18:02.788703+0000","last_unstale":"2024-05-14T09:19:42.891244+0000","last_undegraded":"2024-05-14T09:19:42.891244+0000","last_fullsized":"2024-05-14T09:19:42.891244+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:27:18.593797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807960+0000","last_change":"2024-05-14T09:18:02.788856+0000","last_active":"2024-05-14T09:19:42.807960+0000","last_peered":"2024-05-14T09:19:42.807960+0000","last_clean":"2024-05-14T09:19:42.807960+0000","last_became_active":"2024-05-14T09:18:02.788477+0000","last_became_peered":"2024-05-14T09:18:02.788477+0000","last_unstale":"2024-05-14T09:19:42.807960+0000","last_undegraded":"2024-05-14T09:19:42.807960+0000","last_fullsized":"2024-05-14T09:19:42.807960+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:14:09.943568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465747+0000","last_change":"2024-05-14T09:18:02.781087+0000","last_active":"2024-05-14T09:19:42.465747+0000","last_peered":"2024-05-14T09:19:42.465747+0000","last_clean":"2024-05-14T09:19:42.465747+0000","last_became_active":"2024-05-14T09:18:02.780584+0000","last_became_peered":"2024-05-14T09:18:02.780584+0000","last_unstale":"2024-05-14T09:19:42.465747+0000","last_undegraded":"2024-05-14T09:19:42.465747+0000","last_fullsized":"2024-05-14T09:19:42.465747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:02:23.587235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.889482+0000","last_change":"2024-05-14T09:19:42.889482+0000","last_active":"2024-05-14T09:19:42.889482+0000","last_peered":"2024-05-14T09:19:42.889482+0000","last_clean":"2024-05-14T09:19:42.889482+0000","last_became_active":"2024-05-14T09:19:42.887316+0000","last_became_peered":"2024-05-14T09:19:42.887316+0000","last_unstale":"2024-05-14T09:19:42.889482+0000","last_undegraded":"2024-05-14T09:19:42.889482+0000","last_fullsized":"2024-05-14T09:19:42.889482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:13:44.778215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:06.112521+0000","last_change":"2024-05-14T09:17:57.708207+0000","last_active":"2024-05-14T09:20:06.112521+0000","last_peered":"2024-05-14T09:20:06.112521+0000","last_clean":"2024-05-14T09:20:06.112521+0000","last_became_active":"2024-05-14T09:17:57.707547+0000","last_became_peered":"2024-05-14T09:17:57.707547+0000","last_unstale":"2024-05-14T09:20:06.112521+0000","last_undegraded":"2024-05-14T09:20:06.112521+0000","last_fullsized":"2024-05-14T09:20:06.112521+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.378254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811026+0000","last_change":"2024-05-14T09:18:02.782461+0000","last_active":"2024-05-14T09:19:42.811026+0000","last_peered":"2024-05-14T09:19:42.811026+0000","last_clean":"2024-05-14T09:19:42.811026+0000","last_became_active":"2024-05-14T09:18:02.781014+0000","last_became_peered":"2024-05-14T09:18:02.781014+0000","last_unstale":"2024-05-14T09:19:42.811026+0000","last_undegraded":"2024-05-14T09:19:42.811026+0000","last_fullsized":"2024-05-14T09:19:42.811026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:21:13.024727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466004+0000","last_change":"2024-05-14T09:18:15.878163+0000","last_active":"2024-05-14T09:19:42.466004+0000","last_peered":"2024-05-14T09:19:42.466004+0000","last_clean":"2024-05-14T09:19:42.466004+0000","last_became_active":"2024-05-14T09:18:15.877097+0000","last_became_peered":"2024-05-14T09:18:15.877097+0000","last_unstale":"2024-05-14T09:19:42.466004+0000","last_undegraded":"2024-05-14T09:19:42.466004+0000","last_fullsized":"2024-05-14T09:19:42.466004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:59.570534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811245+0000","last_change":"2024-05-14T09:17:57.773712+0000","last_active":"2024-05-14T09:19:42.811245+0000","last_peered":"2024-05-14T09:19:42.811245+0000","last_clean":"2024-05-14T09:19:42.811245+0000","last_became_active":"2024-05-14T09:17:57.772849+0000","last_became_peered":"2024-05-14T09:17:57.772849+0000","last_unstale":"2024-05-14T09:19:42.811245+0000","last_undegraded":"2024-05-14T09:19:42.811245+0000","last_fullsized":"2024-05-14T09:19:42.811245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:20.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885639+0000","last_change":"2024-05-14T09:18:02.790490+0000","last_active":"2024-05-14T09:19:42.885639+0000","last_peered":"2024-05-14T09:19:42.885639+0000","last_clean":"2024-05-14T09:19:42.885639+0000","last_became_active":"2024-05-14T09:18:02.790112+0000","last_became_peered":"2024-05-14T09:18:02.790112+0000","last_unstale":"2024-05-14T09:19:42.885639+0000","last_undegraded":"2024-05-14T09:19:42.885639+0000","last_fullsized":"2024-05-14T09:19:42.885639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:15.851585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466806+0000","last_change":"2024-05-14T09:18:15.888894+0000","last_active":"2024-05-14T09:19:42.466806+0000","last_peered":"2024-05-14T09:19:42.466806+0000","last_clean":"2024-05-14T09:19:42.466806+0000","last_became_active":"2024-05-14T09:18:15.888327+0000","last_became_peered":"2024-05-14T09:18:15.888327+0000","last_unstale":"2024-05-14T09:19:42.466806+0000","last_undegraded":"2024-05-14T09:19:42.466806+0000","last_fullsized":"2024-05-14T09:19:42.466806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:13:19.871380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814675+0000","last_change":"2024-05-14T09:17:57.717745+0000","last_active":"2024-05-14T09:19:42.814675+0000","last_peered":"2024-05-14T09:19:42.814675+0000","last_clean":"2024-05-14T09:19:42.814675+0000","last_became_active":"2024-05-14T09:17:57.716822+0000","last_became_peered":"2024-05-14T09:17:57.716822+0000","last_unstale":"2024-05-14T09:19:42.814675+0000","last_undegraded":"2024-05-14T09:19:42.814675+0000","last_fullsized":"2024-05-14T09:19:42.814675+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:47:40.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891071+0000","last_change":"2024-05-14T09:18:02.788276+0000","last_active":"2024-05-14T09:19:42.891071+0000","last_peered":"2024-05-14T09:19:42.891071+0000","last_clean":"2024-05-14T09:19:42.891071+0000","last_became_active":"2024-05-14T09:18:02.787446+0000","last_became_peered":"2024-05-14T09:18:02.787446+0000","last_unstale":"2024-05-14T09:19:42.891071+0000","last_undegraded":"2024-05-14T09:19:42.891071+0000","last_fullsized":"2024-05-14T09:19:42.891071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:07:36.574378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466347+0000","last_change":"2024-05-14T09:18:15.887824+0000","last_active":"2024-05-14T09:19:42.466347+0000","last_peered":"2024-05-14T09:19:42.466347+0000","last_clean":"2024-05-14T09:19:42.466347+0000","last_became_active":"2024-05-14T09:18:15.887152+0000","last_became_peered":"2024-05-14T09:18:15.887152+0000","last_unstale":"2024-05-14T09:19:42.466347+0000","last_undegraded":"2024-05-14T09:19:42.466347+0000","last_fullsized":"2024-05-14T09:19:42.466347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:54.778329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814724+0000","last_change":"2024-05-14T09:17:57.717528+0000","last_active":"2024-05-14T09:19:42.814724+0000","last_peered":"2024-05-14T09:19:42.814724+0000","last_clean":"2024-05-14T09:19:42.814724+0000","last_became_active":"2024-05-14T09:17:57.716251+0000","last_became_peered":"2024-05-14T09:17:57.716251+0000","last_unstale":"2024-05-14T09:19:42.814724+0000","last_undegraded":"2024-05-14T09:19:42.814724+0000","last_fullsized":"2024-05-14T09:19:42.814724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:29:08.080292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461675+0000","last_change":"2024-05-14T09:18:02.790132+0000","last_active":"2024-05-14T09:19:42.461675+0000","last_peered":"2024-05-14T09:19:42.461675+0000","last_clean":"2024-05-14T09:19:42.461675+0000","last_became_active":"2024-05-14T09:18:02.789461+0000","last_became_peered":"2024-05-14T09:18:02.789461+0000","last_unstale":"2024-05-14T09:19:42.461675+0000","last_undegraded":"2024-05-14T09:19:42.461675+0000","last_fullsized":"2024-05-14T09:19:42.461675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:36:55.261959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465830+0000","last_change":"2024-05-14T09:18:15.893674+0000","last_active":"2024-05-14T09:19:42.465830+0000","last_peered":"2024-05-14T09:19:42.465830+0000","last_clean":"2024-05-14T09:19:42.465830+0000","last_became_active":"2024-05-14T09:18:15.891857+0000","last_became_peered":"2024-05-14T09:18:15.891857+0000","last_unstale":"2024-05-14T09:19:42.465830+0000","last_undegraded":"2024-05-14T09:19:42.465830+0000","last_fullsized":"2024-05-14T09:19:42.465830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:14:55.020773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:05.109748+0000","last_change":"2024-05-14T09:18:41.982086+0000","last_active":"2024-05-14T09:20:05.109748+0000","last_peered":"2024-05-14T09:20:05.109748+0000","last_clean":"2024-05-14T09:20:05.109748+0000","last_became_active":"2024-05-14T09:18:41.981103+0000","last_became_peered":"2024-05-14T09:18:41.981103+0000","last_unstale":"2024-05-14T09:20:05.109748+0000","last_undegraded":"2024-05-14T09:20:05.109748+0000","last_fullsized":"2024-05-14T09:20:05.109748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:25:26.896681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813717+0000","last_change":"2024-05-14T09:18:02.775834+0000","last_active":"2024-05-14T09:19:42.813717+0000","last_peered":"2024-05-14T09:19:42.813717+0000","last_clean":"2024-05-14T09:19:42.813717+0000","last_became_active":"2024-05-14T09:18:02.773708+0000","last_became_peered":"2024-05-14T09:18:02.773708+0000","last_unstale":"2024-05-14T09:19:42.813717+0000","last_undegraded":"2024-05-14T09:19:42.813717+0000","last_fullsized":"2024-05-14T09:19:42.813717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:00.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.899138+0000","last_change":"2024-05-14T09:19:42.899138+0000","last_active":"2024-05-14T09:19:42.899138+0000","last_peered":"2024-05-14T09:19:42.899138+0000","last_clean":"2024-05-14T09:19:42.899138+0000","last_became_active":"2024-05-14T09:19:42.897588+0000","last_became_peered":"2024-05-14T09:19:42.897588+0000","last_unstale":"2024-05-14T09:19:42.899138+0000","last_undegraded":"2024-05-14T09:19:42.899138+0000","last_fullsized":"2024-05-14T09:19:42.899138+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:13:05.760525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894250+0000","last_change":"2024-05-14T09:18:42.326203+0000","last_active":"2024-05-14T09:19:42.894250+0000","last_peered":"2024-05-14T09:19:42.894250+0000","last_clean":"2024-05-14T09:19:42.894250+0000","last_became_active":"2024-05-14T09:18:42.324907+0000","last_became_peered":"2024-05-14T09:18:42.324907+0000","last_unstale":"2024-05-14T09:19:42.894250+0000","last_undegraded":"2024-05-14T09:19:42.894250+0000","last_fullsized":"2024-05-14T09:19:42.894250+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:50.408706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460788+0000","last_change":"2024-05-14T09:18:41.669731+0000","last_active":"2024-05-14T09:19:42.460788+0000","last_peered":"2024-05-14T09:19:42.460788+0000","last_clean":"2024-05-14T09:19:42.460788+0000","last_became_active":"2024-05-14T09:18:41.667039+0000","last_became_peered":"2024-05-14T09:18:41.667039+0000","last_unstale":"2024-05-14T09:19:42.460788+0000","last_undegraded":"2024-05-14T09:19:42.460788+0000","last_fullsized":"2024-05-14T09:19:42.460788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:33:30.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890846+0000","last_change":"2024-05-14T09:18:15.894314+0000","last_active":"2024-05-14T09:19:42.890846+0000","last_peered":"2024-05-14T09:19:42.890846+0000","last_clean":"2024-05-14T09:19:42.890846+0000","last_became_active":"2024-05-14T09:18:15.893173+0000","last_became_peered":"2024-05-14T09:18:15.893173+0000","last_unstale":"2024-05-14T09:19:42.890846+0000","last_undegraded":"2024-05-14T09:19:42.890846+0000","last_fullsized":"2024-05-14T09:19:42.890846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:19:25.467141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458514+0000","last_change":"2024-05-14T09:17:57.704612+0000","last_active":"2024-05-14T09:19:42.458514+0000","last_peered":"2024-05-14T09:19:42.458514+0000","last_clean":"2024-05-14T09:19:42.458514+0000","last_became_active":"2024-05-14T09:17:57.703979+0000","last_became_peered":"2024-05-14T09:17:57.703979+0000","last_unstale":"2024-05-14T09:19:42.458514+0000","last_undegraded":"2024-05-14T09:19:42.458514+0000","last_fullsized":"2024-05-14T09:19:42.458514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:08.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810103+0000","last_change":"2024-05-14T09:18:02.774778+0000","last_active":"2024-05-14T09:19:42.810103+0000","last_peered":"2024-05-14T09:19:42.810103+0000","last_clean":"2024-05-14T09:19:42.810103+0000","last_became_active":"2024-05-14T09:18:02.774406+0000","last_became_peered":"2024-05-14T09:18:02.774406+0000","last_unstale":"2024-05-14T09:19:42.810103+0000","last_undegraded":"2024-05-14T09:19:42.810103+0000","last_fullsized":"2024-05-14T09:19:42.810103+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.135221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886244+0000","last_change":"2024-05-14T09:18:15.885921+0000","last_active":"2024-05-14T09:19:42.886244+0000","last_peered":"2024-05-14T09:19:42.886244+0000","last_clean":"2024-05-14T09:19:42.886244+0000","last_became_active":"2024-05-14T09:18:15.885261+0000","last_became_peered":"2024-05-14T09:18:15.885261+0000","last_unstale":"2024-05-14T09:19:42.886244+0000","last_undegraded":"2024-05-14T09:19:42.886244+0000","last_fullsized":"2024-05-14T09:19:42.886244+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:57.438626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459603+0000","last_change":"2024-05-14T09:17:57.714662+0000","last_active":"2024-05-14T09:19:42.459603+0000","last_peered":"2024-05-14T09:19:42.459603+0000","last_clean":"2024-05-14T09:19:42.459603+0000","last_became_active":"2024-05-14T09:17:57.714086+0000","last_became_peered":"2024-05-14T09:17:57.714086+0000","last_unstale":"2024-05-14T09:19:42.459603+0000","last_undegraded":"2024-05-14T09:19:42.459603+0000","last_fullsized":"2024-05-14T09:19:42.459603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:20.609634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807255+0000","last_change":"2024-05-14T09:18:02.767521+0000","last_active":"2024-05-14T09:19:42.807255+0000","last_peered":"2024-05-14T09:19:42.807255+0000","last_clean":"2024-05-14T09:19:42.807255+0000","last_became_active":"2024-05-14T09:18:02.767035+0000","last_became_peered":"2024-05-14T09:18:02.767035+0000","last_unstale":"2024-05-14T09:19:42.807255+0000","last_undegraded":"2024-05-14T09:19:42.807255+0000","last_fullsized":"2024-05-14T09:19:42.807255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:00:30.251960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810556+0000","last_change":"2024-05-14T09:18:15.890254+0000","last_active":"2024-05-14T09:19:42.810556+0000","last_peered":"2024-05-14T09:19:42.810556+0000","last_clean":"2024-05-14T09:19:42.810556+0000","last_became_active":"2024-05-14T09:18:15.887699+0000","last_became_peered":"2024-05-14T09:18:15.887699+0000","last_unstale":"2024-05-14T09:19:42.810556+0000","last_undegraded":"2024-05-14T09:19:42.810556+0000","last_fullsized":"2024-05-14T09:19:42.810556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:30:39.578671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:05.108384+0000","last_change":"2024-05-14T09:17:57.712559+0000","last_active":"2024-05-14T09:20:05.108384+0000","last_peered":"2024-05-14T09:20:05.108384+0000","last_clean":"2024-05-14T09:20:05.108384+0000","last_became_active":"2024-05-14T09:17:57.711265+0000","last_became_peered":"2024-05-14T09:17:57.711265+0000","last_unstale":"2024-05-14T09:20:05.108384+0000","last_undegraded":"2024-05-14T09:20:05.108384+0000","last_fullsized":"2024-05-14T09:20:05.108384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:37:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.892687+0000","last_change":"2024-05-14T09:18:02.793657+0000","last_active":"2024-05-14T09:19:42.892687+0000","last_peered":"2024-05-14T09:19:42.892687+0000","last_clean":"2024-05-14T09:19:42.892687+0000","last_became_active":"2024-05-14T09:18:02.789550+0000","last_became_peered":"2024-05-14T09:18:02.789550+0000","last_unstale":"2024-05-14T09:19:42.892687+0000","last_undegraded":"2024-05-14T09:19:42.892687+0000","last_fullsized":"2024-05-14T09:19:42.892687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:31.933523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807018+0000","last_change":"2024-05-14T09:18:15.877290+0000","last_active":"2024-05-14T09:19:42.807018+0000","last_peered":"2024-05-14T09:19:42.807018+0000","last_clean":"2024-05-14T09:19:42.807018+0000","last_became_active":"2024-05-14T09:18:15.874522+0000","last_became_peered":"2024-05-14T09:18:15.874522+0000","last_unstale":"2024-05-14T09:19:42.807018+0000","last_undegraded":"2024-05-14T09:19:42.807018+0000","last_fullsized":"2024-05-14T09:19:42.807018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:16.774709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461614+0000","last_change":"2024-05-14T09:17:57.710407+0000","last_active":"2024-05-14T09:19:42.461614+0000","last_peered":"2024-05-14T09:19:42.461614+0000","last_clean":"2024-05-14T09:19:42.461614+0000","last_became_active":"2024-05-14T09:17:57.709776+0000","last_became_peered":"2024-05-14T09:17:57.709776+0000","last_unstale":"2024-05-14T09:19:42.461614+0000","last_undegraded":"2024-05-14T09:19:42.461614+0000","last_fullsized":"2024-05-14T09:19:42.461614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:28:04.838236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885738+0000","last_change":"2024-05-14T09:18:41.664954+0000","last_active":"2024-05-14T09:19:42.885738+0000","last_peered":"2024-05-14T09:19:42.885738+0000","last_clean":"2024-05-14T09:19:42.885738+0000","last_became_active":"2024-05-14T09:18:41.663825+0000","last_became_peered":"2024-05-14T09:18:41.663825+0000","last_unstale":"2024-05-14T09:19:42.885738+0000","last_undegraded":"2024-05-14T09:19:42.885738+0000","last_fullsized":"2024-05-14T09:19:42.885738+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:50.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467173+0000","last_change":"2024-05-14T09:18:15.882918+0000","last_active":"2024-05-14T09:19:42.467173+0000","last_peered":"2024-05-14T09:19:42.467173+0000","last_clean":"2024-05-14T09:19:42.467173+0000","last_became_active":"2024-05-14T09:18:15.880220+0000","last_became_peered":"2024-05-14T09:18:15.880220+0000","last_unstale":"2024-05-14T09:19:42.467173+0000","last_undegraded":"2024-05-14T09:19:42.467173+0000","last_fullsized":"2024-05-14T09:19:42.467173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:49.777319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461522+0000","last_change":"2024-05-14T09:17:57.775417+0000","last_active":"2024-05-14T09:19:42.461522+0000","last_peered":"2024-05-14T09:19:42.461522+0000","last_clean":"2024-05-14T09:19:42.461522+0000","last_became_active":"2024-05-14T09:17:57.774362+0000","last_became_peered":"2024-05-14T09:17:57.774362+0000","last_unstale":"2024-05-14T09:19:42.461522+0000","last_undegraded":"2024-05-14T09:19:42.461522+0000","last_fullsized":"2024-05-14T09:19:42.461522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:27.320060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891815+0000","last_change":"2024-05-14T09:18:02.794096+0000","last_active":"2024-05-14T09:19:42.891815+0000","last_peered":"2024-05-14T09:19:42.891815+0000","last_clean":"2024-05-14T09:19:42.891815+0000","last_became_active":"2024-05-14T09:18:02.788361+0000","last_became_peered":"2024-05-14T09:18:02.788361+0000","last_unstale":"2024-05-14T09:19:42.891815+0000","last_undegraded":"2024-05-14T09:19:42.891815+0000","last_fullsized":"2024-05-14T09:19:42.891815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:41.485460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807126+0000","last_change":"2024-05-14T09:18:15.886317+0000","last_active":"2024-05-14T09:19:42.807126+0000","last_peered":"2024-05-14T09:19:42.807126+0000","last_clean":"2024-05-14T09:19:42.807126+0000","last_became_active":"2024-05-14T09:18:15.885903+0000","last_became_peered":"2024-05-14T09:18:15.885903+0000","last_unstale":"2024-05-14T09:19:42.807126+0000","last_undegraded":"2024-05-14T09:19:42.807126+0000","last_fullsized":"2024-05-14T09:19:42.807126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:26:59.892672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:05.129039+0000","last_change":"2024-05-14T09:17:57.717013+0000","last_active":"2024-05-14T09:20:05.129039+0000","last_peered":"2024-05-14T09:20:05.129039+0000","last_clean":"2024-05-14T09:20:05.129039+0000","last_became_active":"2024-05-14T09:17:57.714552+0000","last_became_peered":"2024-05-14T09:17:57.714552+0000","last_unstale":"2024-05-14T09:20:05.129039+0000","last_undegraded":"2024-05-14T09:20:05.129039+0000","last_fullsized":"2024-05-14T09:20:05.129039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:16.042573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67092,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":82,"num_read_kb":107,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814169+0000","last_change":"2024-05-14T09:18:02.782446+0000","last_active":"2024-05-14T09:19:42.814169+0000","last_peered":"2024-05-14T09:19:42.814169+0000","last_clean":"2024-05-14T09:19:42.814169+0000","last_became_active":"2024-05-14T09:18:02.779998+0000","last_became_peered":"2024-05-14T09:18:02.779998+0000","last_unstale":"2024-05-14T09:19:42.814169+0000","last_undegraded":"2024-05-14T09:19:42.814169+0000","last_fullsized":"2024-05-14T09:19:42.814169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:50.734227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462426+0000","last_change":"2024-05-14T09:18:15.894372+0000","last_active":"2024-05-14T09:19:42.462426+0000","last_peered":"2024-05-14T09:19:42.462426+0000","last_clean":"2024-05-14T09:19:42.462426+0000","last_became_active":"2024-05-14T09:18:15.893842+0000","last_became_peered":"2024-05-14T09:18:15.893842+0000","last_unstale":"2024-05-14T09:19:42.462426+0000","last_undegraded":"2024-05-14T09:19:42.462426+0000","last_fullsized":"2024-05-14T09:19:42.462426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:57.675242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890505+0000","last_change":"2024-05-14T09:18:41.675372+0000","last_active":"2024-05-14T09:19:42.890505+0000","last_peered":"2024-05-14T09:19:42.890505+0000","last_clean":"2024-05-14T09:19:42.890505+0000","last_became_active":"2024-05-14T09:18:41.659107+0000","last_became_peered":"2024-05-14T09:18:41.659107+0000","last_unstale":"2024-05-14T09:19:42.890505+0000","last_undegraded":"2024-05-14T09:19:42.890505+0000","last_fullsized":"2024-05-14T09:19:42.890505+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:55:43.567929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458772+0000","last_change":"2024-05-14T09:18:02.780558+0000","last_active":"2024-05-14T09:19:42.458772+0000","last_peered":"2024-05-14T09:19:42.458772+0000","last_clean":"2024-05-14T09:19:42.458772+0000","last_became_active":"2024-05-14T09:18:02.779955+0000","last_became_peered":"2024-05-14T09:18:02.779955+0000","last_unstale":"2024-05-14T09:19:42.458772+0000","last_undegraded":"2024-05-14T09:19:42.458772+0000","last_fullsized":"2024-05-14T09:19:42.458772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:28:59.821879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890970+0000","last_change":"2024-05-14T09:18:15.892207+0000","last_active":"2024-05-14T09:19:42.890970+0000","last_peered":"2024-05-14T09:19:42.890970+0000","last_clean":"2024-05-14T09:19:42.890970+0000","last_became_active":"2024-05-14T09:18:15.891646+0000","last_became_peered":"2024-05-14T09:18:15.891646+0000","last_unstale":"2024-05-14T09:19:42.890970+0000","last_undegraded":"2024-05-14T09:19:42.890970+0000","last_fullsized":"2024-05-14T09:19:42.890970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:06:48.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461084+0000","last_change":"2024-05-14T09:17:57.717130+0000","last_active":"2024-05-14T09:19:42.461084+0000","last_peered":"2024-05-14T09:19:42.461084+0000","last_clean":"2024-05-14T09:19:42.461084+0000","last_became_active":"2024-05-14T09:17:57.716738+0000","last_became_peered":"2024-05-14T09:17:57.716738+0000","last_unstale":"2024-05-14T09:19:42.461084+0000","last_undegraded":"2024-05-14T09:19:42.461084+0000","last_fullsized":"2024-05-14T09:19:42.461084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:20:16.246789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461122+0000","last_change":"2024-05-14T09:18:02.783073+0000","last_active":"2024-05-14T09:19:42.461122+0000","last_peered":"2024-05-14T09:19:42.461122+0000","last_clean":"2024-05-14T09:19:42.461122+0000","last_became_active":"2024-05-14T09:18:02.782657+0000","last_became_peered":"2024-05-14T09:18:02.782657+0000","last_unstale":"2024-05-14T09:19:42.461122+0000","last_undegraded":"2024-05-14T09:19:42.461122+0000","last_fullsized":"2024-05-14T09:19:42.461122+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:39:46.649875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807966+0000","last_change":"2024-05-14T09:18:15.885231+0000","last_active":"2024-05-14T09:19:42.807966+0000","last_peered":"2024-05-14T09:19:42.807966+0000","last_clean":"2024-05-14T09:19:42.807966+0000","last_became_active":"2024-05-14T09:18:15.880199+0000","last_became_peered":"2024-05-14T09:18:15.880199+0000","last_unstale":"2024-05-14T09:19:42.807966+0000","last_undegraded":"2024-05-14T09:19:42.807966+0000","last_fullsized":"2024-05-14T09:19:42.807966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:10:22.707034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:03.107897+0000","last_change":"2024-05-14T09:17:57.718596+0000","last_active":"2024-05-14T09:20:03.107897+0000","last_peered":"2024-05-14T09:20:03.107897+0000","last_clean":"2024-05-14T09:20:03.107897+0000","last_became_active":"2024-05-14T09:17:57.717735+0000","last_became_peered":"2024-05-14T09:17:57.717735+0000","last_unstale":"2024-05-14T09:20:03.107897+0000","last_undegraded":"2024-05-14T09:20:03.107897+0000","last_fullsized":"2024-05-14T09:20:03.107897+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:45.110512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460333+0000","last_change":"2024-05-14T09:18:02.780222+0000","last_active":"2024-05-14T09:19:42.460333+0000","last_peered":"2024-05-14T09:19:42.460333+0000","last_clean":"2024-05-14T09:19:42.460333+0000","last_became_active":"2024-05-14T09:18:02.779842+0000","last_became_peered":"2024-05-14T09:18:02.779842+0000","last_unstale":"2024-05-14T09:19:42.460333+0000","last_undegraded":"2024-05-14T09:19:42.460333+0000","last_fullsized":"2024-05-14T09:19:42.460333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:46.726665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459242+0000","last_change":"2024-05-14T09:18:15.885248+0000","last_active":"2024-05-14T09:19:42.459242+0000","last_peered":"2024-05-14T09:19:42.459242+0000","last_clean":"2024-05-14T09:19:42.459242+0000","last_became_active":"2024-05-14T09:18:15.884675+0000","last_became_peered":"2024-05-14T09:18:15.884675+0000","last_unstale":"2024-05-14T09:19:42.459242+0000","last_undegraded":"2024-05-14T09:19:42.459242+0000","last_fullsized":"2024-05-14T09:19:42.459242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:28:14.278141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890196+0000","last_change":"2024-05-14T09:18:41.687983+0000","last_active":"2024-05-14T09:19:42.890196+0000","last_peered":"2024-05-14T09:19:42.890196+0000","last_clean":"2024-05-14T09:19:42.890196+0000","last_became_active":"2024-05-14T09:18:41.666942+0000","last_became_peered":"2024-05-14T09:18:41.666942+0000","last_unstale":"2024-05-14T09:19:42.890196+0000","last_undegraded":"2024-05-14T09:19:42.890196+0000","last_fullsized":"2024-05-14T09:19:42.890196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:38:24.183297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460053+0000","last_change":"2024-05-14T09:18:02.788509+0000","last_active":"2024-05-14T09:19:42.460053+0000","last_peered":"2024-05-14T09:19:42.460053+0000","last_clean":"2024-05-14T09:19:42.460053+0000","last_became_active":"2024-05-14T09:18:02.786886+0000","last_became_peered":"2024-05-14T09:18:02.786886+0000","last_unstale":"2024-05-14T09:19:42.460053+0000","last_undegraded":"2024-05-14T09:19:42.460053+0000","last_fullsized":"2024-05-14T09:19:42.460053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:29:38.765565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459813+0000","last_change":"2024-05-14T09:18:15.895299+0000","last_active":"2024-05-14T09:19:42.459813+0000","last_peered":"2024-05-14T09:19:42.459813+0000","last_clean":"2024-05-14T09:19:42.459813+0000","last_became_active":"2024-05-14T09:18:15.893663+0000","last_became_peered":"2024-05-14T09:18:15.893663+0000","last_unstale":"2024-05-14T09:19:42.459813+0000","last_undegraded":"2024-05-14T09:19:42.459813+0000","last_fullsized":"2024-05-14T09:19:42.459813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:58:24.950436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814266+0000","last_change":"2024-05-14T09:17:57.710933+0000","last_active":"2024-05-14T09:19:42.814266+0000","last_peered":"2024-05-14T09:19:42.814266+0000","last_clean":"2024-05-14T09:19:42.814266+0000","last_became_active":"2024-05-14T09:17:57.710255+0000","last_became_peered":"2024-05-14T09:17:57.710255+0000","last_unstale":"2024-05-14T09:19:42.814266+0000","last_undegraded":"2024-05-14T09:19:42.814266+0000","last_fullsized":"2024-05-14T09:19:42.814266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:30.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891143+0000","last_change":"2024-05-14T09:18:02.781494+0000","last_active":"2024-05-14T09:19:42.891143+0000","last_peered":"2024-05-14T09:19:42.891143+0000","last_clean":"2024-05-14T09:19:42.891143+0000","last_became_active":"2024-05-14T09:18:02.781112+0000","last_became_peered":"2024-05-14T09:18:02.781112+0000","last_unstale":"2024-05-14T09:19:42.891143+0000","last_undegraded":"2024-05-14T09:19:42.891143+0000","last_fullsized":"2024-05-14T09:19:42.891143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:27.109538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813351+0000","last_change":"2024-05-14T09:18:16.135447+0000","last_active":"2024-05-14T09:19:42.813351+0000","last_peered":"2024-05-14T09:19:42.813351+0000","last_clean":"2024-05-14T09:19:42.813351+0000","last_became_active":"2024-05-14T09:18:16.133770+0000","last_became_peered":"2024-05-14T09:18:16.133770+0000","last_unstale":"2024-05-14T09:19:42.813351+0000","last_undegraded":"2024-05-14T09:19:42.813351+0000","last_fullsized":"2024-05-14T09:19:42.813351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:29.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807668+0000","last_change":"2024-05-14T09:17:57.776542+0000","last_active":"2024-05-14T09:19:42.807668+0000","last_peered":"2024-05-14T09:19:42.807668+0000","last_clean":"2024-05-14T09:19:42.807668+0000","last_became_active":"2024-05-14T09:17:57.775370+0000","last_became_peered":"2024-05-14T09:17:57.775370+0000","last_unstale":"2024-05-14T09:19:42.807668+0000","last_undegraded":"2024-05-14T09:19:42.807668+0000","last_fullsized":"2024-05-14T09:19:42.807668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:24.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.895442+0000","last_change":"2024-05-14T09:18:02.776673+0000","last_active":"2024-05-14T09:19:42.895442+0000","last_peered":"2024-05-14T09:19:42.895442+0000","last_clean":"2024-05-14T09:19:42.895442+0000","last_became_active":"2024-05-14T09:18:02.776243+0000","last_became_peered":"2024-05-14T09:18:02.776243+0000","last_unstale":"2024-05-14T09:19:42.895442+0000","last_undegraded":"2024-05-14T09:19:42.895442+0000","last_fullsized":"2024-05-14T09:19:42.895442+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:21.226977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459325+0000","last_change":"2024-05-14T09:18:15.885039+0000","last_active":"2024-05-14T09:19:42.459325+0000","last_peered":"2024-05-14T09:19:42.459325+0000","last_clean":"2024-05-14T09:19:42.459325+0000","last_became_active":"2024-05-14T09:18:15.884466+0000","last_became_peered":"2024-05-14T09:18:15.884466+0000","last_unstale":"2024-05-14T09:19:42.459325+0000","last_undegraded":"2024-05-14T09:19:42.459325+0000","last_fullsized":"2024-05-14T09:19:42.459325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:12.000203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:06.113799+0000","last_change":"2024-05-14T09:17:57.712259+0000","last_active":"2024-05-14T09:20:06.113799+0000","last_peered":"2024-05-14T09:20:06.113799+0000","last_clean":"2024-05-14T09:20:06.113799+0000","last_became_active":"2024-05-14T09:17:57.711663+0000","last_became_peered":"2024-05-14T09:17:57.711663+0000","last_unstale":"2024-05-14T09:20:06.113799+0000","last_undegraded":"2024-05-14T09:20:06.113799+0000","last_fullsized":"2024-05-14T09:20:06.113799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:40:31.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894379+0000","last_change":"2024-05-14T09:18:02.783586+0000","last_active":"2024-05-14T09:19:42.894379+0000","last_peered":"2024-05-14T09:19:42.894379+0000","last_clean":"2024-05-14T09:19:42.894379+0000","last_became_active":"2024-05-14T09:18:02.783122+0000","last_became_peered":"2024-05-14T09:18:02.783122+0000","last_unstale":"2024-05-14T09:19:42.894379+0000","last_undegraded":"2024-05-14T09:19:42.894379+0000","last_fullsized":"2024-05-14T09:19:42.894379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:32:24.966064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459651+0000","last_change":"2024-05-14T09:18:16.132825+0000","last_active":"2024-05-14T09:19:42.459651+0000","last_peered":"2024-05-14T09:19:42.459651+0000","last_clean":"2024-05-14T09:19:42.459651+0000","last_became_active":"2024-05-14T09:18:16.132155+0000","last_became_peered":"2024-05-14T09:18:16.132155+0000","last_unstale":"2024-05-14T09:19:42.459651+0000","last_undegraded":"2024-05-14T09:19:42.459651+0000","last_fullsized":"2024-05-14T09:19:42.459651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:43.579951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460417+0000","last_change":"2024-05-14T09:18:02.788407+0000","last_active":"2024-05-14T09:19:42.460417+0000","last_peered":"2024-05-14T09:19:42.460417+0000","last_clean":"2024-05-14T09:19:42.460417+0000","last_became_active":"2024-05-14T09:18:02.785934+0000","last_became_peered":"2024-05-14T09:18:02.785934+0000","last_unstale":"2024-05-14T09:19:42.460417+0000","last_undegraded":"2024-05-14T09:19:42.460417+0000","last_fullsized":"2024-05-14T09:19:42.460417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:06.114536+0000","last_change":"2024-05-14T09:17:57.781016+0000","last_active":"2024-05-14T09:20:06.114536+0000","last_peered":"2024-05-14T09:20:06.114536+0000","last_clean":"2024-05-14T09:20:06.114536+0000","last_became_active":"2024-05-14T09:17:57.777442+0000","last_became_peered":"2024-05-14T09:17:57.777442+0000","last_unstale":"2024-05-14T09:20:06.114536+0000","last_undegraded":"2024-05-14T09:20:06.114536+0000","last_fullsized":"2024-05-14T09:20:06.114536+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:17:06.992053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460997+0000","last_change":"2024-05-14T09:18:15.891299+0000","last_active":"2024-05-14T09:19:42.460997+0000","last_peered":"2024-05-14T09:19:42.460997+0000","last_clean":"2024-05-14T09:19:42.460997+0000","last_became_active":"2024-05-14T09:18:15.890552+0000","last_became_peered":"2024-05-14T09:18:15.890552+0000","last_unstale":"2024-05-14T09:19:42.460997+0000","last_undegraded":"2024-05-14T09:19:42.460997+0000","last_fullsized":"2024-05-14T09:19:42.460997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:03:44.936117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810316+0000","last_change":"2024-05-14T09:18:02.793484+0000","last_active":"2024-05-14T09:19:42.810316+0000","last_peered":"2024-05-14T09:19:42.810316+0000","last_clean":"2024-05-14T09:19:42.810316+0000","last_became_active":"2024-05-14T09:18:02.792888+0000","last_became_peered":"2024-05-14T09:18:02.792888+0000","last_unstale":"2024-05-14T09:19:42.810316+0000","last_undegraded":"2024-05-14T09:19:42.810316+0000","last_fullsized":"2024-05-14T09:19:42.810316+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:19.212025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467101+0000","last_change":"2024-05-14T09:17:57.715271+0000","last_active":"2024-05-14T09:19:42.467101+0000","last_peered":"2024-05-14T09:19:42.467101+0000","last_clean":"2024-05-14T09:19:42.467101+0000","last_became_active":"2024-05-14T09:17:57.712524+0000","last_became_peered":"2024-05-14T09:17:57.712524+0000","last_unstale":"2024-05-14T09:19:42.467101+0000","last_undegraded":"2024-05-14T09:19:42.467101+0000","last_fullsized":"2024-05-14T09:19:42.467101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:39:46.868509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460004+0000","last_change":"2024-05-14T09:16:01.832034+0000","last_active":"2024-05-14T09:19:42.460004+0000","last_peered":"2024-05-14T09:19:42.460004+0000","last_clean":"2024-05-14T09:19:42.460004+0000","last_became_active":"2024-05-14T09:16:01.815331+0000","last_became_peered":"2024-05-14T09:16:01.815331+0000","last_unstale":"2024-05-14T09:19:42.460004+0000","last_undegraded":"2024-05-14T09:19:42.460004+0000","last_fullsized":"2024-05-14T09:19:42.460004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_clean_scrub_stamp":"2024-05-14T09:11:00.916612+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:04:45.123827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461481+0000","last_change":"2024-05-14T09:18:16.136149+0000","last_active":"2024-05-14T09:19:42.461481+0000","last_peered":"2024-05-14T09:19:42.461481+0000","last_clean":"2024-05-14T09:19:42.461481+0000","last_became_active":"2024-05-14T09:18:16.134655+0000","last_became_peered":"2024-05-14T09:18:16.134655+0000","last_unstale":"2024-05-14T09:19:42.461481+0000","last_undegraded":"2024-05-14T09:19:42.461481+0000","last_fullsized":"2024-05-14T09:19:42.461481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:51.879763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458307+0000","last_change":"2024-05-14T09:18:02.791068+0000","last_active":"2024-05-14T09:19:42.458307+0000","last_peered":"2024-05-14T09:19:42.458307+0000","last_clean":"2024-05-14T09:19:42.458307+0000","last_became_active":"2024-05-14T09:18:02.785294+0000","last_became_peered":"2024-05-14T09:18:02.785294+0000","last_unstale":"2024-05-14T09:19:42.458307+0000","last_undegraded":"2024-05-14T09:19:42.458307+0000","last_fullsized":"2024-05-14T09:19:42.458307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:06:25.554475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460448+0000","last_change":"2024-05-14T09:17:57.715272+0000","last_active":"2024-05-14T09:19:42.460448+0000","last_peered":"2024-05-14T09:19:42.460448+0000","last_clean":"2024-05-14T09:19:42.460448+0000","last_became_active":"2024-05-14T09:17:57.713504+0000","last_became_peered":"2024-05-14T09:17:57.713504+0000","last_unstale":"2024-05-14T09:19:42.460448+0000","last_undegraded":"2024-05-14T09:19:42.460448+0000","last_fullsized":"2024-05-14T09:19:42.460448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:27:26.071204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890697+0000","last_change":"2024-05-14T09:18:15.893437+0000","last_active":"2024-05-14T09:19:42.890697+0000","last_peered":"2024-05-14T09:19:42.890697+0000","last_clean":"2024-05-14T09:19:42.890697+0000","last_became_active":"2024-05-14T09:18:15.890908+0000","last_became_peered":"2024-05-14T09:18:15.890908+0000","last_unstale":"2024-05-14T09:19:42.890697+0000","last_undegraded":"2024-05-14T09:19:42.890697+0000","last_fullsized":"2024-05-14T09:19:42.890697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:15.339562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814448+0000","last_change":"2024-05-14T09:17:57.779601+0000","last_active":"2024-05-14T09:19:42.814448+0000","last_peered":"2024-05-14T09:19:42.814448+0000","last_clean":"2024-05-14T09:19:42.814448+0000","last_became_active":"2024-05-14T09:17:57.778730+0000","last_became_peered":"2024-05-14T09:17:57.778730+0000","last_unstale":"2024-05-14T09:19:42.814448+0000","last_undegraded":"2024-05-14T09:19:42.814448+0000","last_fullsized":"2024-05-14T09:19:42.814448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:01:07.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459540+0000","last_change":"2024-05-14T09:18:02.786283+0000","last_active":"2024-05-14T09:19:42.459540+0000","last_peered":"2024-05-14T09:19:42.459540+0000","last_clean":"2024-05-14T09:19:42.459540+0000","last_became_active":"2024-05-14T09:18:02.785158+0000","last_became_peered":"2024-05-14T09:18:02.785158+0000","last_unstale":"2024-05-14T09:19:42.459540+0000","last_undegraded":"2024-05-14T09:19:42.459540+0000","last_fullsized":"2024-05-14T09:19:42.459540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:28.804419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810065+0000","last_change":"2024-05-14T09:18:16.133898+0000","last_active":"2024-05-14T09:19:42.810065+0000","last_peered":"2024-05-14T09:19:42.810065+0000","last_clean":"2024-05-14T09:19:42.810065+0000","last_became_active":"2024-05-14T09:18:16.132493+0000","last_became_peered":"2024-05-14T09:18:16.132493+0000","last_unstale":"2024-05-14T09:19:42.810065+0000","last_undegraded":"2024-05-14T09:19:42.810065+0000","last_fullsized":"2024-05-14T09:19:42.810065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:38:15.126883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'16","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:58.811652+0000","last_change":"2024-05-14T09:17:57.710000+0000","last_active":"2024-05-14T09:19:58.811652+0000","last_peered":"2024-05-14T09:19:58.811652+0000","last_clean":"2024-05-14T09:19:58.811652+0000","last_became_active":"2024-05-14T09:17:57.709546+0000","last_became_peered":"2024-05-14T09:17:57.709546+0000","last_unstale":"2024-05-14T09:19:58.811652+0000","last_undegraded":"2024-05-14T09:19:58.811652+0000","last_fullsized":"2024-05-14T09:19:58.811652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:09.681936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811135+0000","last_change":"2024-05-14T09:18:02.786342+0000","last_active":"2024-05-14T09:19:42.811135+0000","last_peered":"2024-05-14T09:19:42.811135+0000","last_clean":"2024-05-14T09:19:42.811135+0000","last_became_active":"2024-05-14T09:18:02.785981+0000","last_became_peered":"2024-05-14T09:18:02.785981+0000","last_unstale":"2024-05-14T09:19:42.811135+0000","last_undegraded":"2024-05-14T09:19:42.811135+0000","last_fullsized":"2024-05-14T09:19:42.811135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:59:43.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.463961+0000","last_change":"2024-05-14T09:18:15.882171+0000","last_active":"2024-05-14T09:19:42.463961+0000","last_peered":"2024-05-14T09:19:42.463961+0000","last_clean":"2024-05-14T09:19:42.463961+0000","last_became_active":"2024-05-14T09:18:15.881015+0000","last_became_peered":"2024-05-14T09:18:15.881015+0000","last_unstale":"2024-05-14T09:19:42.463961+0000","last_undegraded":"2024-05-14T09:19:42.463961+0000","last_fullsized":"2024-05-14T09:19:42.463961+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:18.832868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.468720+0000","last_change":"2024-05-14T09:17:58.254067+0000","last_active":"2024-05-14T09:19:42.468720+0000","last_peered":"2024-05-14T09:19:42.468720+0000","last_clean":"2024-05-14T09:19:42.468720+0000","last_became_active":"2024-05-14T09:17:58.253140+0000","last_became_peered":"2024-05-14T09:17:58.253140+0000","last_unstale":"2024-05-14T09:19:42.468720+0000","last_undegraded":"2024-05-14T09:19:42.468720+0000","last_fullsized":"2024-05-14T09:19:42.468720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:20.263028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886335+0000","last_change":"2024-05-14T09:18:02.775968+0000","last_active":"2024-05-14T09:19:42.886335+0000","last_peered":"2024-05-14T09:19:42.886335+0000","last_clean":"2024-05-14T09:19:42.886335+0000","last_became_active":"2024-05-14T09:18:02.775639+0000","last_became_peered":"2024-05-14T09:18:02.775639+0000","last_unstale":"2024-05-14T09:19:42.886335+0000","last_undegraded":"2024-05-14T09:19:42.886335+0000","last_fullsized":"2024-05-14T09:19:42.886335+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:27:52.179647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467811+0000","last_change":"2024-05-14T09:18:16.139823+0000","last_active":"2024-05-14T09:19:42.467811+0000","last_peered":"2024-05-14T09:19:42.467811+0000","last_clean":"2024-05-14T09:19:42.467811+0000","last_became_active":"2024-05-14T09:18:16.138075+0000","last_became_peered":"2024-05-14T09:18:16.138075+0000","last_unstale":"2024-05-14T09:19:42.467811+0000","last_undegraded":"2024-05-14T09:19:42.467811+0000","last_fullsized":"2024-05-14T09:19:42.467811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:41.186678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890342+0000","last_change":"2024-05-14T09:17:57.773751+0000","last_active":"2024-05-14T09:19:42.890342+0000","last_peered":"2024-05-14T09:19:42.890342+0000","last_clean":"2024-05-14T09:19:42.890342+0000","last_became_active":"2024-05-14T09:17:57.772964+0000","last_became_peered":"2024-05-14T09:17:57.772964+0000","last_unstale":"2024-05-14T09:19:42.890342+0000","last_undegraded":"2024-05-14T09:19:42.890342+0000","last_fullsized":"2024-05-14T09:19:42.890342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:08:01.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813590+0000","last_change":"2024-05-14T09:18:02.774847+0000","last_active":"2024-05-14T09:19:42.813590+0000","last_peered":"2024-05-14T09:19:42.813590+0000","last_clean":"2024-05-14T09:19:42.813590+0000","last_became_active":"2024-05-14T09:18:02.774384+0000","last_became_peered":"2024-05-14T09:18:02.774384+0000","last_unstale":"2024-05-14T09:19:42.813590+0000","last_undegraded":"2024-05-14T09:19:42.813590+0000","last_fullsized":"2024-05-14T09:19:42.813590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:54:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.808049+0000","last_change":"2024-05-14T09:18:15.887656+0000","last_active":"2024-05-14T09:19:42.808049+0000","last_peered":"2024-05-14T09:19:42.808049+0000","last_clean":"2024-05-14T09:19:42.808049+0000","last_became_active":"2024-05-14T09:18:15.887203+0000","last_became_peered":"2024-05-14T09:18:15.887203+0000","last_unstale":"2024-05-14T09:19:42.808049+0000","last_undegraded":"2024-05-14T09:19:42.808049+0000","last_fullsized":"2024-05-14T09:19:42.808049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:27.080959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810765+0000","last_change":"2024-05-14T09:17:57.707511+0000","last_active":"2024-05-14T09:19:42.810765+0000","last_peered":"2024-05-14T09:19:42.810765+0000","last_clean":"2024-05-14T09:19:42.810765+0000","last_became_active":"2024-05-14T09:17:57.706706+0000","last_became_peered":"2024-05-14T09:17:57.706706+0000","last_unstale":"2024-05-14T09:19:42.810765+0000","last_undegraded":"2024-05-14T09:19:42.810765+0000","last_fullsized":"2024-05-14T09:19:42.810765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:25.325832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890576+0000","last_change":"2024-05-14T09:18:02.787800+0000","last_active":"2024-05-14T09:19:42.890576+0000","last_peered":"2024-05-14T09:19:42.890576+0000","last_clean":"2024-05-14T09:19:42.890576+0000","last_became_active":"2024-05-14T09:18:02.785115+0000","last_became_peered":"2024-05-14T09:18:02.785115+0000","last_unstale":"2024-05-14T09:19:42.890576+0000","last_undegraded":"2024-05-14T09:19:42.890576+0000","last_fullsized":"2024-05-14T09:19:42.890576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:23.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.900338+0000","last_change":"2024-05-14T09:19:42.898356+0000","last_active":"2024-05-14T09:19:42.900338+0000","last_peered":"2024-05-14T09:19:42.900338+0000","last_clean":"2024-05-14T09:19:42.900338+0000","last_became_active":"2024-05-14T09:19:42.896256+0000","last_became_peered":"2024-05-14T09:19:42.896256+0000","last_unstale":"2024-05-14T09:19:42.900338+0000","last_undegraded":"2024-05-14T09:19:42.900338+0000","last_fullsized":"2024-05-14T09:19:42.900338+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:59:09.389588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.464902+0000","last_change":"2024-05-14T09:17:57.710472+0000","last_active":"2024-05-14T09:19:42.464902+0000","last_peered":"2024-05-14T09:19:42.464902+0000","last_clean":"2024-05-14T09:19:42.464902+0000","last_became_active":"2024-05-14T09:17:57.710056+0000","last_became_peered":"2024-05-14T09:17:57.710056+0000","last_unstale":"2024-05-14T09:19:42.464902+0000","last_undegraded":"2024-05-14T09:19:42.464902+0000","last_fullsized":"2024-05-14T09:19:42.464902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:45.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810546+0000","last_change":"2024-05-14T09:18:02.779982+0000","last_active":"2024-05-14T09:19:42.810546+0000","last_peered":"2024-05-14T09:19:42.810546+0000","last_clean":"2024-05-14T09:19:42.810546+0000","last_became_active":"2024-05-14T09:18:02.779595+0000","last_became_peered":"2024-05-14T09:18:02.779595+0000","last_unstale":"2024-05-14T09:19:42.810546+0000","last_undegraded":"2024-05-14T09:19:42.810546+0000","last_fullsized":"2024-05-14T09:19:42.810546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:06.520980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467407+0000","last_change":"2024-05-14T09:18:16.137850+0000","last_active":"2024-05-14T09:19:42.467407+0000","last_peered":"2024-05-14T09:19:42.467407+0000","last_clean":"2024-05-14T09:19:42.467407+0000","last_became_active":"2024-05-14T09:18:16.135097+0000","last_became_peered":"2024-05-14T09:18:16.135097+0000","last_unstale":"2024-05-14T09:19:42.467407+0000","last_undegraded":"2024-05-14T09:19:42.467407+0000","last_fullsized":"2024-05-14T09:19:42.467407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:29:09.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813419+0000","last_change":"2024-05-14T09:17:57.720232+0000","last_active":"2024-05-14T09:19:42.813419+0000","last_peered":"2024-05-14T09:19:42.813419+0000","last_clean":"2024-05-14T09:19:42.813419+0000","last_became_active":"2024-05-14T09:17:57.719057+0000","last_became_peered":"2024-05-14T09:17:57.719057+0000","last_unstale":"2024-05-14T09:19:42.813419+0000","last_undegraded":"2024-05-14T09:19:42.813419+0000","last_fullsized":"2024-05-14T09:19:42.813419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:34.378868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460625+0000","last_change":"2024-05-14T09:18:02.788106+0000","last_active":"2024-05-14T09:19:42.460625+0000","last_peered":"2024-05-14T09:19:42.460625+0000","last_clean":"2024-05-14T09:19:42.460625+0000","last_became_active":"2024-05-14T09:18:02.787631+0000","last_became_peered":"2024-05-14T09:18:02.787631+0000","last_unstale":"2024-05-14T09:19:42.460625+0000","last_undegraded":"2024-05-14T09:19:42.460625+0000","last_fullsized":"2024-05-14T09:19:42.460625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:59:45.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890890+0000","last_change":"2024-05-14T09:18:15.889654+0000","last_active":"2024-05-14T09:19:42.890890+0000","last_peered":"2024-05-14T09:19:42.890890+0000","last_clean":"2024-05-14T09:19:42.890890+0000","last_became_active":"2024-05-14T09:18:15.888915+0000","last_became_peered":"2024-05-14T09:18:15.888915+0000","last_unstale":"2024-05-14T09:19:42.890890+0000","last_undegraded":"2024-05-14T09:19:42.890890+0000","last_fullsized":"2024-05-14T09:19:42.890890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:52:27.127246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:03.107930+0000","last_change":"2024-05-14T09:17:58.253945+0000","last_active":"2024-05-14T09:20:03.107930+0000","last_peered":"2024-05-14T09:20:03.107930+0000","last_clean":"2024-05-14T09:20:03.107930+0000","last_became_active":"2024-05-14T09:17:58.252807+0000","last_became_peered":"2024-05-14T09:17:58.252807+0000","last_unstale":"2024-05-14T09:20:03.107930+0000","last_undegraded":"2024-05-14T09:20:03.107930+0000","last_fullsized":"2024-05-14T09:20:03.107930+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:56:52.853589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461794+0000","last_change":"2024-05-14T09:18:02.792743+0000","last_active":"2024-05-14T09:19:42.461794+0000","last_peered":"2024-05-14T09:19:42.461794+0000","last_clean":"2024-05-14T09:19:42.461794+0000","last_became_active":"2024-05-14T09:18:02.792371+0000","last_became_peered":"2024-05-14T09:18:02.792371+0000","last_unstale":"2024-05-14T09:19:42.461794+0000","last_undegraded":"2024-05-14T09:19:42.461794+0000","last_fullsized":"2024-05-14T09:19:42.461794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:10:00.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885584+0000","last_change":"2024-05-14T09:18:15.884104+0000","last_active":"2024-05-14T09:19:42.885584+0000","last_peered":"2024-05-14T09:19:42.885584+0000","last_clean":"2024-05-14T09:19:42.885584+0000","last_became_active":"2024-05-14T09:18:15.881737+0000","last_became_peered":"2024-05-14T09:18:15.881737+0000","last_unstale":"2024-05-14T09:19:42.885584+0000","last_undegraded":"2024-05-14T09:19:42.885584+0000","last_fullsized":"2024-05-14T09:19:42.885584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:27:57.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461959+0000","last_change":"2024-05-14T09:17:57.717776+0000","last_active":"2024-05-14T09:19:42.461959+0000","last_peered":"2024-05-14T09:19:42.461959+0000","last_clean":"2024-05-14T09:19:42.461959+0000","last_became_active":"2024-05-14T09:17:57.717338+0000","last_became_peered":"2024-05-14T09:17:57.717338+0000","last_unstale":"2024-05-14T09:19:42.461959+0000","last_undegraded":"2024-05-14T09:19:42.461959+0000","last_fullsized":"2024-05-14T09:19:42.461959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:38.441355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461321+0000","last_change":"2024-05-14T09:18:02.786286+0000","last_active":"2024-05-14T09:19:42.461321+0000","last_peered":"2024-05-14T09:19:42.461321+0000","last_clean":"2024-05-14T09:19:42.461321+0000","last_became_active":"2024-05-14T09:18:02.785915+0000","last_became_peered":"2024-05-14T09:18:02.785915+0000","last_unstale":"2024-05-14T09:19:42.461321+0000","last_undegraded":"2024-05-14T09:19:42.461321+0000","last_fullsized":"2024-05-14T09:19:42.461321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:54:08.960145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459339+0000","last_change":"2024-05-14T09:18:15.889692+0000","last_active":"2024-05-14T09:19:42.459339+0000","last_peered":"2024-05-14T09:19:42.459339+0000","last_clean":"2024-05-14T09:19:42.459339+0000","last_became_active":"2024-05-14T09:18:15.888675+0000","last_became_peered":"2024-05-14T09:18:15.888675+0000","last_unstale":"2024-05-14T09:19:42.459339+0000","last_undegraded":"2024-05-14T09:19:42.459339+0000","last_fullsized":"2024-05-14T09:19:42.459339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:11:20.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459050+0000","last_change":"2024-05-14T09:17:57.694782+0000","last_active":"2024-05-14T09:19:42.459050+0000","last_peered":"2024-05-14T09:19:42.459050+0000","last_clean":"2024-05-14T09:19:42.459050+0000","last_became_active":"2024-05-14T09:17:57.693913+0000","last_became_peered":"2024-05-14T09:17:57.693913+0000","last_unstale":"2024-05-14T09:19:42.459050+0000","last_undegraded":"2024-05-14T09:19:42.459050+0000","last_fullsized":"2024-05-14T09:19:42.459050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:36:10.758138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462269+0000","last_change":"2024-05-14T09:18:02.784340+0000","last_active":"2024-05-14T09:19:42.462269+0000","last_peered":"2024-05-14T09:19:42.462269+0000","last_clean":"2024-05-14T09:19:42.462269+0000","last_became_active":"2024-05-14T09:18:02.783905+0000","last_became_peered":"2024-05-14T09:18:02.783905+0000","last_unstale":"2024-05-14T09:19:42.462269+0000","last_undegraded":"2024-05-14T09:19:42.462269+0000","last_fullsized":"2024-05-14T09:19:42.462269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:57:57.219324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890915+0000","last_change":"2024-05-14T09:18:02.789214+0000","last_active":"2024-05-14T09:19:42.890915+0000","last_peered":"2024-05-14T09:19:42.890915+0000","last_clean":"2024-05-14T09:19:42.890915+0000","last_became_active":"2024-05-14T09:18:02.788764+0000","last_became_peered":"2024-05-14T09:18:02.788764+0000","last_unstale":"2024-05-14T09:19:42.890915+0000","last_undegraded":"2024-05-14T09:19:42.890915+0000","last_fullsized":"2024-05-14T09:19:42.890915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:13.665828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466401+0000","last_change":"2024-05-14T09:18:02.782255+0000","last_active":"2024-05-14T09:19:42.466401+0000","last_peered":"2024-05-14T09:19:42.466401+0000","last_clean":"2024-05-14T09:19:42.466401+0000","last_became_active":"2024-05-14T09:18:02.781817+0000","last_became_peered":"2024-05-14T09:18:02.781817+0000","last_unstale":"2024-05-14T09:19:42.466401+0000","last_undegraded":"2024-05-14T09:19:42.466401+0000","last_fullsized":"2024-05-14T09:19:42.466401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:56:31.544934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.464590+0000","last_change":"2024-05-14T09:18:02.781737+0000","last_active":"2024-05-14T09:19:42.464590+0000","last_peered":"2024-05-14T09:19:42.464590+0000","last_clean":"2024-05-14T09:19:42.464590+0000","last_became_active":"2024-05-14T09:18:02.778429+0000","last_became_peered":"2024-05-14T09:18:02.778429+0000","last_unstale":"2024-05-14T09:19:42.464590+0000","last_undegraded":"2024-05-14T09:19:42.464590+0000","last_fullsized":"2024-05-14T09:19:42.464590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:52.699915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886071+0000","last_change":"2024-05-14T09:18:02.787107+0000","last_active":"2024-05-14T09:19:42.886071+0000","last_peered":"2024-05-14T09:19:42.886071+0000","last_clean":"2024-05-14T09:19:42.886071+0000","last_became_active":"2024-05-14T09:18:02.786259+0000","last_became_peered":"2024-05-14T09:18:02.786259+0000","last_unstale":"2024-05-14T09:19:42.886071+0000","last_undegraded":"2024-05-14T09:19:42.886071+0000","last_fullsized":"2024-05-14T09:19:42.886071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:50.103862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459488+0000","last_change":"2024-05-14T09:18:02.792086+0000","last_active":"2024-05-14T09:19:42.459488+0000","last_peered":"2024-05-14T09:19:42.459488+0000","last_clean":"2024-05-14T09:19:42.459488+0000","last_became_active":"2024-05-14T09:18:02.785795+0000","last_became_peered":"2024-05-14T09:18:02.785795+0000","last_unstale":"2024-05-14T09:19:42.459488+0000","last_undegraded":"2024-05-14T09:19:42.459488+0000","last_fullsized":"2024-05-14T09:19:42.459488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:58.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891603+0000","last_change":"2024-05-14T09:18:02.787934+0000","last_active":"2024-05-14T09:19:42.891603+0000","last_peered":"2024-05-14T09:19:42.891603+0000","last_clean":"2024-05-14T09:19:42.891603+0000","last_became_active":"2024-05-14T09:18:02.787030+0000","last_became_peered":"2024-05-14T09:18:02.787030+0000","last_unstale":"2024-05-14T09:19:42.891603+0000","last_undegraded":"2024-05-14T09:19:42.891603+0000","last_fullsized":"2024-05-14T09:19:42.891603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:02:57.521485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465624+0000","last_change":"2024-05-14T09:18:02.791714+0000","last_active":"2024-05-14T09:19:42.465624+0000","last_peered":"2024-05-14T09:19:42.465624+0000","last_clean":"2024-05-14T09:19:42.465624+0000","last_became_active":"2024-05-14T09:18:02.791184+0000","last_became_peered":"2024-05-14T09:18:02.791184+0000","last_unstale":"2024-05-14T09:19:42.465624+0000","last_undegraded":"2024-05-14T09:19:42.465624+0000","last_fullsized":"2024-05-14T09:19:42.465624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:55:03.943446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811249+0000","last_change":"2024-05-14T09:18:02.790270+0000","last_active":"2024-05-14T09:19:42.811249+0000","last_peered":"2024-05-14T09:19:42.811249+0000","last_clean":"2024-05-14T09:19:42.811249+0000","last_became_active":"2024-05-14T09:18:02.789845+0000","last_became_peered":"2024-05-14T09:18:02.789845+0000","last_unstale":"2024-05-14T09:19:42.811249+0000","last_undegraded":"2024-05-14T09:19:42.811249+0000","last_fullsized":"2024-05-14T09:19:42.811249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:10:43.469279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459685+0000","last_change":"2024-05-14T09:18:02.778122+0000","last_active":"2024-05-14T09:19:42.459685+0000","last_peered":"2024-05-14T09:19:42.459685+0000","last_clean":"2024-05-14T09:19:42.459685+0000","last_became_active":"2024-05-14T09:18:02.775013+0000","last_became_peered":"2024-05-14T09:18:02.775013+0000","last_unstale":"2024-05-14T09:19:42.459685+0000","last_undegraded":"2024-05-14T09:19:42.459685+0000","last_fullsized":"2024-05-14T09:19:42.459685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:49:35.138229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807022+0000","last_change":"2024-05-14T09:18:41.667927+0000","last_active":"2024-05-14T09:19:42.807022+0000","last_peered":"2024-05-14T09:19:42.807022+0000","last_clean":"2024-05-14T09:19:42.807022+0000","last_became_active":"2024-05-14T09:18:41.667390+0000","last_became_peered":"2024-05-14T09:18:41.667390+0000","last_unstale":"2024-05-14T09:19:42.807022+0000","last_undegraded":"2024-05-14T09:19:42.807022+0000","last_fullsized":"2024-05-14T09:19:42.807022+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:47.648872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891568+0000","last_change":"2024-05-14T09:18:02.794924+0000","last_active":"2024-05-14T09:19:42.891568+0000","last_peered":"2024-05-14T09:19:42.891568+0000","last_clean":"2024-05-14T09:19:42.891568+0000","last_became_active":"2024-05-14T09:18:02.794505+0000","last_became_peered":"2024-05-14T09:18:02.794505+0000","last_unstale":"2024-05-14T09:19:42.891568+0000","last_undegraded":"2024-05-14T09:19:42.891568+0000","last_fullsized":"2024-05-14T09:19:42.891568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:39.150209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458949+0000","last_change":"2024-05-14T09:18:02.781514+0000","last_active":"2024-05-14T09:19:42.458949+0000","last_peered":"2024-05-14T09:19:42.458949+0000","last_clean":"2024-05-14T09:19:42.458949+0000","last_became_active":"2024-05-14T09:18:02.779948+0000","last_became_peered":"2024-05-14T09:18:02.779948+0000","last_unstale":"2024-05-14T09:19:42.458949+0000","last_undegraded":"2024-05-14T09:19:42.458949+0000","last_fullsized":"2024-05-14T09:19:42.458949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:25.125018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891164+0000","last_change":"2024-05-14T09:18:02.785558+0000","last_active":"2024-05-14T09:19:42.891164+0000","last_peered":"2024-05-14T09:19:42.891164+0000","last_clean":"2024-05-14T09:19:42.891164+0000","last_became_active":"2024-05-14T09:18:02.785086+0000","last_became_peered":"2024-05-14T09:18:02.785086+0000","last_unstale":"2024-05-14T09:19:42.891164+0000","last_undegraded":"2024-05-14T09:19:42.891164+0000","last_fullsized":"2024-05-14T09:19:42.891164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:39:13.087341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74687,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":408,"num_read_kb":288,"num_write":252,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":224061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678060,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":519244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874291,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28720,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716432,"statfs":{"total":95995035648,"available":95965626368,"internally_reserved":0,"allocated":1744896,"data_stored":1176677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037819,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":518603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":518869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430281,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1115869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593809,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":514498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":582620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738494,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":515954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":582150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149800,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":513815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953568,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":519194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790042,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32812,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712340,"statfs":{"total":95995035648,"available":95961436160,"internally_reserved":0,"allocated":1667072,"data_stored":1111060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:20:10.513 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-14T09:20:10.514 INFO:tasks.cephadm:Setting up client nodes... 2024-05-14T09:20:10.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-14T09:20:10.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:10 smithi120 ceph-mon[31085]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:20:10.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:20:10.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:20:10.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:10.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:10 smithi152 ceph-mon[34868]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:20:10.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:20:10.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:20:10.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:10.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:10 smithi175 ceph-mon[35353]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:20:10.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:20:10.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:20:10.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:20:11.000 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:12.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:11 smithi120 ceph-mon[31085]: pgmap v455: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-05-14T09:20:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:11 smithi152 ceph-mon[34868]: pgmap v455: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-05-14T09:20:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:11 smithi175 ceph-mon[35353]: pgmap v455: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-05-14T09:20:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 -- 172.21.15.120:0/3382826536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10c420 msgr2=0x7f2ffc112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 --2- 172.21.15.120:0/3382826536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10c420 0x7f2ffc112cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400b0a0 tx=0x7f2ff400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 -- 172.21.15.120:0/3382826536 shutdown_connections 2024-05-14T09:20:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 --2- 172.21.15.120:0/3382826536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10c420 0x7f2ffc112cd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 --2- 172.21.15.120:0/3382826536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ffc10ab10 0x7f2ffc10af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 --2- 172.21.15.120:0/3382826536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ffc10ba80 0x7f2ffc10be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 -- 172.21.15.120:0/3382826536 >> 172.21.15.120:0/3382826536 conn(0x7f2ffc0799c0 msgr2=0x7f2ffc07be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:13.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 -- 172.21.15.120:0/3382826536 shutdown_connections 2024-05-14T09:20:13.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.306+0000 7f3000c00700 1 -- 172.21.15.120:0/3382826536 wait complete. 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.307+0000 7f3000c00700 1 Processor -- start 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f3000c00700 1 -- start start 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f3000c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ffc10ab10 0x7f2ffc1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f3000c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10ba80 0x7f2ffc1a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f3000c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ffc10c420 0x7f2ffc1a8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f3000c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc1162c0 con 0x7f2ffc10ba80 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f3000c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc116140 con 0x7f2ffc10c420 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f3000c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc116440 con 0x7f2ffc10ab10 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f2ff9400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10ba80 0x7f2ffc1a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f2ff9400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10ba80 0x7f2ffc1a12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45358/0 (socket says 172.21.15.120:45358) 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.308+0000 7f2ff9400700 1 -- 172.21.15.120:0/3000833959 learned_addr learned my addr 172.21.15.120:0/3000833959 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:13.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ff9e00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ffc10ab10 0x7f2ffc1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:13.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ffa800700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ffc10c420 0x7f2ffc1a8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:13.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ff9400700 1 -- 172.21.15.120:0/3000833959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ffc10ab10 msgr2=0x7f2ffc1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:13.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ff9400700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ffc10ab10 0x7f2ffc1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ff9400700 1 -- 172.21.15.120:0/3000833959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ffc10c420 msgr2=0x7f2ffc1a8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ff9400700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ffc10c420 0x7f2ffc1a8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ff9400700 1 -- 172.21.15.120:0/3000833959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc1a8850 con 0x7f2ffc10ba80 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ffa800700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ffc10c420 0x7f2ffc1a8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.309+0000 7f2ff9400700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10ba80 0x7f2ffc1a12b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c9b0 tx=0x7f2fe800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.310+0000 7f2ff2a00700 1 -- 172.21.15.120:0/3000833959 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8007b00 con 0x7f2ffc10ba80 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.310+0000 7f2ff2a00700 1 -- 172.21.15.120:0/3000833959 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2fe8007ca0 con 0x7f2ffc10ba80 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.310+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ffc1a8b40 con 0x7f2ffc10ba80 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.310+0000 7f2ff2a00700 1 -- 172.21.15.120:0/3000833959 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8018660 con 0x7f2ffc10ba80 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.310+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ffc1a9080 con 0x7f2ffc10ba80 2024-05-14T09:20:13.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.311+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ffc0512c0 con 0x7f2ffc10ba80 2024-05-14T09:20:13.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.317+0000 7f2ff2a00700 1 -- 172.21.15.120:0/3000833959 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f2fe800f450 con 0x7f2ffc10ba80 2024-05-14T09:20:13.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.318+0000 7f2ff2a00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2fe00b2910 0x7f2fe00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:13.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.319+0000 7f2ff2a00700 1 -- 172.21.15.120:0/3000833959 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2fe80e2b30 con 0x7f2ffc10ba80 2024-05-14T09:20:13.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.319+0000 7f2ff9e00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2fe00b2910 0x7f2fe00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:13.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.320+0000 7f2ff9e00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2fe00b2910 0x7f2fe00b4e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc1a2170 tx=0x7f2fec00a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:13.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.320+0000 7f2ff2a00700 1 -- 172.21.15.120:0/3000833959 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2fe8014030 con 0x7f2ffc10ba80 2024-05-14T09:20:13.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.635+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f2ffc02e5f0 con 0x7f2ffc10ba80 2024-05-14T09:20:13.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.641+0000 7f2ff2a00700 1 -- 172.21.15.120:0/3000833959 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v34) ==== 170+0+59 (secure 0 0 0) 0x7f2fe80aa380 con 0x7f2ffc10ba80 2024-05-14T09:20:13.641 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-05-14T09:20:13.641 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDNLENm0Nr4JRAAiofurF1qVDyqOSFRc5WMuw== 2024-05-14T09:20:13.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2fe00b2910 msgr2=0x7f2fe00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:13.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2fe00b2910 0x7f2fe00b4e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc1a2170 tx=0x7f2fec00a5e0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10ba80 msgr2=0x7f2ffc1a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:13.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10ba80 0x7f2ffc1a12b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c9b0 tx=0x7f2fe800cd70 comp rx=0 tx=0).stop 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 shutdown_connections 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2fe00b2910 0x7f2fe00b4e20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ffc10c420 0x7f2ffc1a8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ffc10ab10 0x7f2ffc1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.644+0000 7f3000c00700 1 --2- 172.21.15.120:0/3000833959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc10ba80 0x7f2ffc1a12b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.645+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 >> 172.21.15.120:0/3000833959 conn(0x7f2ffc0799c0 msgr2=0x7f2ffc10ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.645+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 shutdown_connections 2024-05-14T09:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:13.645+0000 7f3000c00700 1 -- 172.21.15.120:0/3000833959 wait complete. 2024-05-14T09:20:14.022 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:13 smithi120 ceph-mon[31085]: pgmap v456: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:20:14.022 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:13 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3000833959' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T09:20:14.022 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:13 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3000833959' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T09:20:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:13 smithi152 ceph-mon[34868]: pgmap v456: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:20:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:13 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3000833959' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T09:20:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:13 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3000833959' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T09:20:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:13 smithi175 ceph-mon[35353]: pgmap v456: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:20:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:13 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3000833959' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T09:20:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:13 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3000833959' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T09:20:14.529 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:20:14.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-14T09:20:14.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-14T09:20:14.659 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-14T09:20:14.659 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-14T09:20:14.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph mgr dump --format=json 2024-05-14T09:20:15.131 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:15 smithi120 ceph-mon[31085]: pgmap v457: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-14T09:20:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:15 smithi152 ceph-mon[34868]: pgmap v457: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-14T09:20:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:15 smithi175 ceph-mon[35353]: pgmap v457: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-14T09:20:17.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.514+0000 7fcbeac00700 1 -- 172.21.15.120:0/1523594013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4076e40 msgr2=0x7fcbe4077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:17.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.514+0000 7fcbeac00700 1 --2- 172.21.15.120:0/1523594013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4076e40 0x7fcbe4077250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b0a0 tx=0x7fcbd400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.514+0000 7fcbeac00700 1 -- 172.21.15.120:0/1523594013 shutdown_connections 2024-05-14T09:20:17.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.514+0000 7fcbeac00700 1 --2- 172.21.15.120:0/1523594013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbe4110ba0 0x7fcbe4113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.514+0000 7fcbeac00700 1 --2- 172.21.15.120:0/1523594013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4076e40 0x7fcbe4077250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.514+0000 7fcbeac00700 1 --2- 172.21.15.120:0/1523594013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe4077790 0x7fcbe4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.514+0000 7fcbeac00700 1 -- 172.21.15.120:0/1523594013 >> 172.21.15.120:0/1523594013 conn(0x7fcbe40ffec0 msgr2=0x7fcbe4102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:17.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.515+0000 7fcbeac00700 1 -- 172.21.15.120:0/1523594013 shutdown_connections 2024-05-14T09:20:17.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.515+0000 7fcbeac00700 1 -- 172.21.15.120:0/1523594013 wait complete. 2024-05-14T09:20:17.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 Processor -- start 2024-05-14T09:20:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 -- start start 2024-05-14T09:20:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbe4076e40 0x7fcbe419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4077790 0x7fcbe419d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe4110ba0 0x7fcbe41a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4116540 con 0x7fcbe4077790 2024-05-14T09:20:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41163c0 con 0x7fcbe4076e40 2024-05-14T09:20:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.516+0000 7fcbeac00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41166c0 con 0x7fcbe4110ba0 2024-05-14T09:20:17.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4077790 0x7fcbe419d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:17.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4077790 0x7fcbe419d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45372/0 (socket says 172.21.15.120:45372) 2024-05-14T09:20:17.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 -- 172.21.15.120:0/3240153688 learned_addr learned my addr 172.21.15.120:0/3240153688 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:17.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3e00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbe4076e40 0x7fcbe419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:17.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe8c00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe4110ba0 0x7fcbe41a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:17.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 -- 172.21.15.120:0/3240153688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe4110ba0 msgr2=0x7fcbe41a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe4110ba0 0x7fcbe41a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 -- 172.21.15.120:0/3240153688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbe4076e40 msgr2=0x7fcbe419cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbe4076e40 0x7fcbe419cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3400700 1 -- 172.21.15.120:0/3240153688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe41a1e40 con 0x7fcbe4077790 2024-05-14T09:20:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.517+0000 7fcbe3e00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbe4076e40 0x7fcbe419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:20:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.518+0000 7fcbe3400700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4077790 0x7fcbe419d510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00d950 tx=0x7fcbcc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.518+0000 7fcbe0c00700 1 -- 172.21.15.120:0/3240153688 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc016070 con 0x7fcbe4077790 2024-05-14T09:20:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.518+0000 7fcbe0c00700 1 -- 172.21.15.120:0/3240153688 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbcc010460 con 0x7fcbe4077790 2024-05-14T09:20:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.518+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe41a2130 con 0x7fcbe4077790 2024-05-14T09:20:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.518+0000 7fcbe0c00700 1 -- 172.21.15.120:0/3240153688 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00f620 con 0x7fcbe4077790 2024-05-14T09:20:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.518+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe41a9a50 con 0x7fcbe4077790 2024-05-14T09:20:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.519+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe40512c0 con 0x7fcbe4077790 2024-05-14T09:20:17.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.522+0000 7fcbe0c00700 1 -- 172.21.15.120:0/3240153688 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fcbcc019070 con 0x7fcbe4077790 2024-05-14T09:20:17.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.523+0000 7fcbe0c00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbc80b2990 0x7fcbc80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:17.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.524+0000 7fcbe0c00700 1 -- 172.21.15.120:0/3240153688 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fcbcc0e2360 con 0x7fcbe4077790 2024-05-14T09:20:17.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.524+0000 7fcbe3e00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbc80b2990 0x7fcbc80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:17.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.525+0000 7fcbe3e00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbc80b2990 0x7fcbc80b4ea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b830 tx=0x7fcbd4006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:17.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.526+0000 7fcbe0c00700 1 -- 172.21.15.120:0/3240153688 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcbcc0a9b20 con 0x7fcbe4077790 2024-05-14T09:20:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.817+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcbe402e5f0 con 0x7fcbe4077790 2024-05-14T09:20:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.836+0000 7fcbe0c00700 1 -- 172.21.15.120:0/3240153688 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288650 (secure 0 0 0) 0x7fcbcc0a9420 con 0x7fcbe4077790 2024-05-14T09:20:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.841+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbc80b2990 msgr2=0x7fcbc80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.841+0000 7fcbeac00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbc80b2990 0x7fcbc80b4ea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b830 tx=0x7fcbd4006210 comp rx=0 tx=0).stop 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4077790 msgr2=0x7fcbe419d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4077790 0x7fcbe419d510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00d950 tx=0x7fcbcc00dd10 comp rx=0 tx=0).stop 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 shutdown_connections 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbc80b2990 0x7fcbc80b4ea0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbe4076e40 0x7fcbe419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe4110ba0 0x7fcbe41a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 --2- 172.21.15.120:0/3240153688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe4077790 0x7fcbe419d510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 >> 172.21.15.120:0/3240153688 conn(0x7fcbe40ffec0 msgr2=0x7fcbe4100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 shutdown_connections 2024-05-14T09:20:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:17.842+0000 7fcbeac00700 1 -- 172.21.15.120:0/3240153688 wait complete. 2024-05-14T09:20:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:17 smithi120 ceph-mon[31085]: pgmap v458: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T09:20:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:17 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3240153688' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T09:20:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:17 smithi152 ceph-mon[34868]: pgmap v458: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T09:20:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:17 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3240153688' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T09:20:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:17 smithi175 ceph-mon[35353]: pgmap v458: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T09:20:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:17 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3240153688' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T09:20:18.714 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":197404993},{"type":"v1","addr":"172.21.15.120:6801","nonce":197404993}]},"active_addr":"172.21.15.120:6801/197404993","active_change":"2024-05-14T09:07:40.065942+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34112,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.120:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1314222723}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":616357660}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":137027080}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":204536492}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":2345857200}]}]} 2024-05-14T09:20:18.720 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-14T09:20:18.720 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-14T09:20:18.720 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:20:19.164 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:19 smithi120 ceph-mon[31085]: pgmap v459: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T09:20:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:19 smithi152 ceph-mon[34868]: pgmap v459: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T09:20:20.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:19 smithi175 ceph-mon[35353]: pgmap v459: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T09:20:21.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 -- 172.21.15.120:0/2817604792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8115360 msgr2=0x7f2dc8117780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 --2- 172.21.15.120:0/2817604792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8115360 0x7f2dc8117780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000b0a0 tx=0x7f2dc000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 -- 172.21.15.120:0/2817604792 shutdown_connections 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 --2- 172.21.15.120:0/2817604792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2dc8076c70 0x7f2dc8077080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 --2- 172.21.15.120:0/2817604792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8115360 0x7f2dc8117780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 --2- 172.21.15.120:0/2817604792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc80775c0 0x7f2dc8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 -- 172.21.15.120:0/2817604792 >> 172.21.15.120:0/2817604792 conn(0x7f2dc80ffef0 msgr2=0x7f2dc8102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 -- 172.21.15.120:0/2817604792 shutdown_connections 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.538+0000 7f2dce600700 1 -- 172.21.15.120:0/2817604792 wait complete. 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.539+0000 7f2dce600700 1 Processor -- start 2024-05-14T09:20:21.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.539+0000 7f2dce600700 1 -- start start 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dce600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8076c70 0x7f2dc81a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dce600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2dc80775c0 0x7f2dc81a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dce600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc8115360 0x7f2dc81a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dce600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc811a960 con 0x7f2dc8076c70 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dce600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc811a7e0 con 0x7f2dc80775c0 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dce600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc811aae0 con 0x7f2dc8115360 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dc7400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8076c70 0x7f2dc81a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dc7400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8076c70 0x7f2dc81a1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53336/0 (socket says 172.21.15.120:53336) 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dc7400700 1 -- 172.21.15.120:0/3029269673 learned_addr learned my addr 172.21.15.120:0/3029269673 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dc7e00700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc8115360 0x7f2dc81a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.540+0000 7f2dc6a00700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2dc80775c0 0x7f2dc81a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dc7400700 1 -- 172.21.15.120:0/3029269673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc8115360 msgr2=0x7f2dc81a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dc7400700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc8115360 0x7f2dc81a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dc7400700 1 -- 172.21.15.120:0/3029269673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2dc80775c0 msgr2=0x7f2dc81a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dc7400700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2dc80775c0 0x7f2dc81a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dc7400700 1 -- 172.21.15.120:0/3029269673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc81a6200 con 0x7f2dc8076c70 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dc7400700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8076c70 0x7f2dc81a1330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2db800d950 tx=0x7f2db800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dbfe00700 1 -- 172.21.15.120:0/3029269673 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8016070 con 0x7f2dc8076c70 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dbfe00700 1 -- 172.21.15.120:0/3029269673 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2db8010460 con 0x7f2dc8076c70 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc81a64f0 con 0x7f2dc8076c70 2024-05-14T09:20:21.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dbfe00700 1 -- 172.21.15.120:0/3029269673 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db800f620 con 0x7f2dc8076c70 2024-05-14T09:20:21.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.541+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc81ade10 con 0x7f2dc8076c70 2024-05-14T09:20:21.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.543+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da8005330 con 0x7f2dc8076c70 2024-05-14T09:20:21.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.545+0000 7f2dbfe00700 1 -- 172.21.15.120:0/3029269673 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f2db8019070 con 0x7f2dc8076c70 2024-05-14T09:20:21.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.547+0000 7f2dbfe00700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2dac0b2990 0x7f2dac0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:21.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.547+0000 7f2dbfe00700 1 -- 172.21.15.120:0/3029269673 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2db80e2250 con 0x7f2dc8076c70 2024-05-14T09:20:21.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.547+0000 7f2dc6a00700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2dac0b2990 0x7f2dac0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:21.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.548+0000 7f2dc6a00700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2dac0b2990 0x7f2dac0b4ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005950 tx=0x7f2db40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:21.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.549+0000 7f2dbfe00700 1 -- 172.21.15.120:0/3029269673 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2db80a9a10 con 0x7f2dc8076c70 2024-05-14T09:20:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.788+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2da80058f0 con 0x7f2dc8076c70 2024-05-14T09:20:21.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.790+0000 7f2dbfe00700 1 -- 172.21.15.120:0/3029269673 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7f2db80a9310 con 0x7f2dc8076c70 2024-05-14T09:20:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:20:21.791 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:20:21.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.793+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2dac0b2990 msgr2=0x7f2dac0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:21.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.793+0000 7f2dce600700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2dac0b2990 0x7f2dac0b4ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005950 tx=0x7f2db40058e0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.793+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8076c70 msgr2=0x7f2dc81a1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:21.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.793+0000 7f2dce600700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8076c70 0x7f2dc81a1330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2db800d950 tx=0x7f2db800dd10 comp rx=0 tx=0).stop 2024-05-14T09:20:21.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 shutdown_connections 2024-05-14T09:20:21.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2dac0b2990 0x7f2dac0b4ea0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc8115360 0x7f2dc81a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc8076c70 0x7f2dc81a1330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 --2- 172.21.15.120:0/3029269673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2dc80775c0 0x7f2dc81a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:21.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 >> 172.21.15.120:0/3029269673 conn(0x7f2dc80ffef0 msgr2=0x7f2dc8100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:21.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 shutdown_connections 2024-05-14T09:20:21.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:21.794+0000 7f2dce600700 1 -- 172.21.15.120:0/3029269673 wait complete. 2024-05-14T09:20:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:21 smithi120 ceph-mon[31085]: pgmap v460: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T09:20:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:21 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3029269673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:21 smithi152 ceph-mon[34868]: pgmap v460: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T09:20:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:21 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3029269673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:21 smithi175 ceph-mon[35353]: pgmap v460: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T09:20:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:21 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3029269673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:22.705 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-14T09:20:22.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:20:23.151 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:23 smithi120 ceph-mon[31085]: pgmap v461: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T09:20:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:23 smithi152 ceph-mon[34868]: pgmap v461: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T09:20:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:23 smithi175 ceph-mon[35353]: pgmap v461: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 -- 172.21.15.120:0/1925903063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24076680 msgr2=0x7fcd24110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1925903063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24076680 0x7fcd24110660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009990 tx=0x7fcd10009ca0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 -- 172.21.15.120:0/1925903063 shutdown_connections 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1925903063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd24075d30 0x7fcd24076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1925903063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd24110ba0 0x7fcd24113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1925903063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24076680 0x7fcd24110660 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 -- 172.21.15.120:0/1925903063 >> 172.21.15.120:0/1925903063 conn(0x7fcd24100040 msgr2=0x7fcd24102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 -- 172.21.15.120:0/1925903063 shutdown_connections 2024-05-14T09:20:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.483+0000 7fcd2c000700 1 -- 172.21.15.120:0/1925903063 wait complete. 2024-05-14T09:20:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.484+0000 7fcd2c000700 1 Processor -- start 2024-05-14T09:20:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.484+0000 7fcd2c000700 1 -- start start 2024-05-14T09:20:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd2c000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24075d30 0x7fcd2419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd2c000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd24076680 0x7fcd2419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd2c000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd24110ba0 0x7fcd241a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd2c000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24116570 con 0x7fcd24075d30 2024-05-14T09:20:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd2c000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241163f0 con 0x7fcd24110ba0 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd2c000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241166f0 con 0x7fcd24076680 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd29600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24075d30 0x7fcd2419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd29600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24075d30 0x7fcd2419d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53344/0 (socket says 172.21.15.120:53344) 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd29600700 1 -- 172.21.15.120:0/1982783965 learned_addr learned my addr 172.21.15.120:0/1982783965 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd28c00700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd24076680 0x7fcd2419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.485+0000 7fcd2a000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd24110ba0 0x7fcd241a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd29600700 1 -- 172.21.15.120:0/1982783965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd24076680 msgr2=0x7fcd2419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd29600700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd24076680 0x7fcd2419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd29600700 1 -- 172.21.15.120:0/1982783965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd24110ba0 msgr2=0x7fcd241a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd29600700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd24110ba0 0x7fcd241a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd29600700 1 -- 172.21.15.120:0/1982783965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd241a1ec0 con 0x7fcd24075d30 2024-05-14T09:20:25.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd29600700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24075d30 0x7fcd2419d040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcd180060b0 tx=0x7fcd18007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:25.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd22000700 1 -- 172.21.15.120:0/1982783965 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1801a070 con 0x7fcd24075d30 2024-05-14T09:20:25.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd22000700 1 -- 172.21.15.120:0/1982783965 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd1800de20 con 0x7fcd24075d30 2024-05-14T09:20:25.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd241a21b0 con 0x7fcd24075d30 2024-05-14T09:20:25.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd22000700 1 -- 172.21.15.120:0/1982783965 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18014690 con 0x7fcd24075d30 2024-05-14T09:20:25.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.486+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd241a9ad0 con 0x7fcd24075d30 2024-05-14T09:20:25.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.488+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd240512c0 con 0x7fcd24075d30 2024-05-14T09:20:25.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.490+0000 7fcd22000700 1 -- 172.21.15.120:0/1982783965 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fcd1801d070 con 0x7fcd24075d30 2024-05-14T09:20:25.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.492+0000 7fcd22000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcd0c0b2990 0x7fcd0c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:25.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.492+0000 7fcd22000700 1 -- 172.21.15.120:0/1982783965 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fcd180e2440 con 0x7fcd24075d30 2024-05-14T09:20:25.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.492+0000 7fcd28c00700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcd0c0b2990 0x7fcd0c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:25.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.493+0000 7fcd28c00700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcd0c0b2990 0x7fcd0c0b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd10006010 tx=0x7fcd1000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:25.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.495+0000 7fcd22000700 1 -- 172.21.15.120:0/1982783965 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcd18010070 con 0x7fcd24075d30 2024-05-14T09:20:25.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.727+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd2419e350 con 0x7fcd24075d30 2024-05-14T09:20:25.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.730+0000 7fcd22000700 1 -- 172.21.15.120:0/1982783965 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7fcd180a9c60 con 0x7fcd24075d30 2024-05-14T09:20:25.730 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:20:25.731 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:20:25.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcd0c0b2990 msgr2=0x7fcd0c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:25.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcd0c0b2990 0x7fcd0c0b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd10006010 tx=0x7fcd1000b540 comp rx=0 tx=0).stop 2024-05-14T09:20:25.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24075d30 msgr2=0x7fcd2419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:25.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24075d30 0x7fcd2419d040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcd180060b0 tx=0x7fcd18007f90 comp rx=0 tx=0).stop 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 shutdown_connections 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcd0c0b2990 0x7fcd0c0b4ea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd24110ba0 0x7fcd241a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd24075d30 0x7fcd2419d040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 --2- 172.21.15.120:0/1982783965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd24076680 0x7fcd2419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.733+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 >> 172.21.15.120:0/1982783965 conn(0x7fcd24100040 msgr2=0x7fcd24101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.734+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 shutdown_connections 2024-05-14T09:20:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:25.734+0000 7fcd2c000700 1 -- 172.21.15.120:0/1982783965 wait complete. 2024-05-14T09:20:26.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:25 smithi120 ceph-mon[31085]: pgmap v462: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:26.128 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:25 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1982783965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:25 smithi152 ceph-mon[34868]: pgmap v462: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:25 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1982783965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:25 smithi175 ceph-mon[35353]: pgmap v462: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:25 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1982783965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:20:26.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-14T09:20:26.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-14T09:20:26.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-14T09:20:26.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-14T09:20:26.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-14T09:20:26.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-14T09:20:26.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-14T09:20:26.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-14T09:20:26.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-14T09:20:26.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-14T09:20:26.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-14T09:20:26.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-14T09:20:27.719 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:27.727 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:27.735 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:27.737 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:28.184 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:27 smithi120 ceph-mon[31085]: pgmap v463: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:28.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:27 smithi152 ceph-mon[34868]: pgmap v463: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:27 smithi175 ceph-mon[35353]: pgmap v463: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:30.200 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:29 smithi120 ceph-mon[31085]: pgmap v464: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:30.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:29 smithi152 ceph-mon[34868]: pgmap v464: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:30.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:29 smithi175 ceph-mon[35353]: pgmap v464: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:30.240 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:32.027 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:31 smithi120 ceph-mon[31085]: pgmap v465: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:20:32.030 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:32.032 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:32.138 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:32.140 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:32.142 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:31 smithi152 ceph-mon[34868]: pgmap v465: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:20:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:31 smithi175 ceph-mon[35353]: pgmap v465: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:20:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 -- 172.21.15.120:0/514180305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb464105df0 msgr2=0x7fb46410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 --2- 172.21.15.120:0/514180305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb464105df0 0x7fb46410e340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb450009990 tx=0x7fb450009ca0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 -- 172.21.15.120:0/514180305 shutdown_connections 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 --2- 172.21.15.120:0/514180305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4641054a0 0x7fb4641058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 --2- 172.21.15.120:0/514180305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb46410e910 0x7fb464110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 --2- 172.21.15.120:0/514180305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb464105df0 0x7fb46410e340 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 -- 172.21.15.120:0/514180305 >> 172.21.15.120:0/514180305 conn(0x7fb4640fedc0 msgr2=0x7fb4641011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 -- 172.21.15.120:0/514180305 shutdown_connections 2024-05-14T09:20:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.164+0000 7fb46ba00700 1 -- 172.21.15.120:0/514180305 wait complete. 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.166+0000 7fb46ba00700 1 Processor -- start 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.166+0000 7fb46ba00700 1 -- start start 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb46ba00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4641054a0 0x7fb46419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb46ba00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb464105df0 0x7fb46419d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb46ba00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb46410e910 0x7fb4641a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb46ba00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb464114350 con 0x7fb46410e910 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb46ba00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb4641141d0 con 0x7fb464105df0 2024-05-14T09:20:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb46ba00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4641144d0 con 0x7fb4641054a0 2024-05-14T09:20:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb469a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb46410e910 0x7fb4641a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb469a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb46410e910 0x7fb4641a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54558/0 (socket says 172.21.15.120:54558) 2024-05-14T09:20:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb469a00700 1 -- 172.21.15.120:0/3156397739 learned_addr learned my addr 172.21.15.120:0/3156397739 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb469000700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4641054a0 0x7fb46419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.167+0000 7fb463e00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb464105df0 0x7fb46419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.168+0000 7fb469a00700 1 -- 172.21.15.120:0/3156397739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4641054a0 msgr2=0x7fb46419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.168+0000 7fb469a00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4641054a0 0x7fb46419cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.168+0000 7fb469a00700 1 -- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb464105df0 msgr2=0x7fb46419d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.168+0000 7fb469a00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb464105df0 0x7fb46419d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.168+0000 7fb469a00700 1 -- 172.21.15.120:0/3156397739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4641a1da0 con 0x7fb46410e910 2024-05-14T09:20:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.168+0000 7fb469a00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb46410e910 0x7fb4641a17b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb45c007d70 tx=0x7fb45c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:33.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.168+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c016020 con 0x7fb46410e910 2024-05-14T09:20:33.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.169+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb45c00ac90 con 0x7fb46410e910 2024-05-14T09:20:33.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.169+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0115e0 con 0x7fb46410e910 2024-05-14T09:20:33.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.169+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4641a2090 con 0x7fb46410e910 2024-05-14T09:20:33.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.169+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4641a2580 con 0x7fb46410e910 2024-05-14T09:20:33.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.170+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb464063f10 con 0x7fb46410e910 2024-05-14T09:20:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.173+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fb45c019020 con 0x7fb46410e910 2024-05-14T09:20:33.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.174+0000 7fb461600700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb44c0b2910 0x7fb44c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.174+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb45c0e2b40 con 0x7fb46410e910 2024-05-14T09:20:33.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.174+0000 7fb469000700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb44c0b2910 0x7fb44c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.174+0000 7fb461600700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] conn(0x7fb44c0bdbe0 0x7fb44c0c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.175+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 --> [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb44c0c0780 con 0x7fb44c0bdbe0 2024-05-14T09:20:33.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.175+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fb45c0e2ef0 con 0x7fb46410e910 2024-05-14T09:20:33.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.175+0000 7fb469000700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb44c0b2910 0x7fb44c0b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb45800ac50 tx=0x7fb45800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:33.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.175+0000 7fb463e00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] conn(0x7fb44c0bdbe0 0x7fb44c0c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.176+0000 7fb463e00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] conn(0x7fb44c0bdbe0 0x7fb44c0c00b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:33.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.178+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== osd.7 v2:172.21.15.152:6816/2236830001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb44c0c0780 con 0x7fb44c0bdbe0 2024-05-14T09:20:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.198+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 --> [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb464064390 con 0x7fb44c0bdbe0 2024-05-14T09:20:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.199+0000 7fb461600700 1 -- 172.21.15.120:0/3156397739 <== osd.7 v2:172.21.15.152:6816/2236830001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb464064390 con 0x7fb44c0bdbe0 2024-05-14T09:20:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.199+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] conn(0x7fb44c0bdbe0 msgr2=0x7fb44c0c00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.199+0000 7fb46ba00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] conn(0x7fb44c0bdbe0 0x7fb44c0c00b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb44c0b2910 msgr2=0x7fb44c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb44c0b2910 0x7fb44c0b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb45800ac50 tx=0x7fb45800a380 comp rx=0 tx=0).stop 2024-05-14T09:20:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb46410e910 msgr2=0x7fb4641a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 --2- 172.21.15.120:0/3156397739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb46410e910 0x7fb4641a17b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb45c007d70 tx=0x7fb45c00a340 comp rx=0 tx=0).stop 2024-05-14T09:20:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb469a00700 1 -- 172.21.15.120:0/3156397739 reap_dead start 2024-05-14T09:20:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 shutdown_connections 2024-05-14T09:20:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 >> 172.21.15.120:0/3156397739 conn(0x7fb4640fedc0 msgr2=0x7fb464103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 shutdown_connections 2024-05-14T09:20:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.200+0000 7fb46ba00700 1 -- 172.21.15.120:0/3156397739 wait complete. 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.247+0000 7f5b9ae00700 1 -- 172.21.15.120:0/2369064653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 msgr2=0x7f5b94108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.247+0000 7f5b9ae00700 1 --2- 172.21.15.120:0/2369064653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 0x7f5b94108200 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b800099c0 tx=0x7f5b80009cd0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.248+0000 7f5b9ae00700 1 -- 172.21.15.120:0/2369064653 shutdown_connections 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.248+0000 7f5b9ae00700 1 --2- 172.21.15.120:0/2369064653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b941034c0 0x7f5b941038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.248+0000 7f5b9ae00700 1 --2- 172.21.15.120:0/2369064653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b94108740 0x7f5b941100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.248+0000 7f5b9ae00700 1 --2- 172.21.15.120:0/2369064653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 0x7f5b94108200 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.248+0000 7f5b9ae00700 1 -- 172.21.15.120:0/2369064653 >> 172.21.15.120:0/2369064653 conn(0x7f5b940fedc0 msgr2=0x7f5b941011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.248+0000 7f5b9ae00700 1 -- 172.21.15.120:0/2369064653 shutdown_connections 2024-05-14T09:20:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.248+0000 7f5b9ae00700 1 -- 172.21.15.120:0/2369064653 wait complete. 2024-05-14T09:20:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.250+0000 7f5b9ae00700 1 Processor -- start 2024-05-14T09:20:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.250+0000 7f5b9ae00700 1 -- start start 2024-05-14T09:20:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.250+0000 7f5b9ae00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b941034c0 0x7f5b941a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b9ae00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 0x7f5b941a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b9ae00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b94108740 0x7f5b9419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b9ae00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94113200 con 0x7f5b94107df0 2024-05-14T09:20:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b9ae00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94113080 con 0x7f5b941034c0 2024-05-14T09:20:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b9ae00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94113380 con 0x7f5b94108740 2024-05-14T09:20:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b93400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 0x7f5b941a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b93400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 0x7f5b941a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54578/0 (socket says 172.21.15.120:54578) 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b93400700 1 -- 172.21.15.120:0/1975081411 learned_addr learned my addr 172.21.15.120:0/1975081411 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b93e00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b941034c0 0x7f5b941a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.251+0000 7f5b98e00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b94108740 0x7f5b9419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b93400700 1 -- 172.21.15.120:0/1975081411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b94108740 msgr2=0x7f5b9419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b93400700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b94108740 0x7f5b9419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b93400700 1 -- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b941034c0 msgr2=0x7f5b941a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b93400700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b941034c0 0x7f5b941a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b93400700 1 -- 172.21.15.120:0/1975081411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9419b280 con 0x7f5b94107df0 2024-05-14T09:20:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b93400700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 0x7f5b941a0f00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000b580 tx=0x7f5b800057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80027070 con 0x7f5b94107df0 2024-05-14T09:20:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b8000fc80 con 0x7f5b94107df0 2024-05-14T09:20:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9419b510 con 0x7f5b94107df0 2024-05-14T09:20:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.252+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80022da0 con 0x7f5b94107df0 2024-05-14T09:20:33.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.253+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b941a7770 con 0x7f5b94107df0 2024-05-14T09:20:33.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.254+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b94063f10 con 0x7f5b94107df0 2024-05-14T09:20:33.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.257+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f5b8002a070 con 0x7f5b94107df0 2024-05-14T09:20:33.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.259+0000 7f5b90c00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5b780b2910 0x7f5b780b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.259+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5b800e3950 con 0x7f5b94107df0 2024-05-14T09:20:33.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.259+0000 7f5b93e00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5b780b2910 0x7f5b780b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.260+0000 7f5b90c00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] conn(0x7f5b780bdab0 0x7f5b780bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:33.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.260+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 --> [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b780c0650 con 0x7f5b780bdab0 2024-05-14T09:20:33.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.260+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f5b800e3d00 con 0x7f5b94107df0 2024-05-14T09:20:33.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.260+0000 7f5b93e00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5b780b2910 0x7f5b780b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005950 tx=0x7f5b8400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.270+0000 7f5b98e00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] conn(0x7f5b780bdab0 0x7f5b780bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.271+0000 7f5b98e00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] conn(0x7f5b780bdab0 0x7f5b780bff80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.274+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== osd.4 v2:172.21.15.152:6808/3049924657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b780c0650 con 0x7f5b780bdab0 2024-05-14T09:20:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.292+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 --> [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b94064390 con 0x7f5b780bdab0 2024-05-14T09:20:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b90c00700 1 -- 172.21.15.120:0/1975081411 <== osd.4 v2:172.21.15.152:6808/3049924657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5b94064390 con 0x7f5b780bdab0 2024-05-14T09:20:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] conn(0x7f5b780bdab0 msgr2=0x7f5b780bff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b9ae00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] conn(0x7f5b780bdab0 0x7f5b780bff80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5b780b2910 msgr2=0x7f5b780b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b9ae00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5b780b2910 0x7f5b780b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005950 tx=0x7f5b8400a300 comp rx=0 tx=0).stop 2024-05-14T09:20:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 msgr2=0x7f5b941a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b9ae00700 1 --2- 172.21.15.120:0/1975081411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b94107df0 0x7f5b941a0f00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000b580 tx=0x7f5b800057c0 comp rx=0 tx=0).stop 2024-05-14T09:20:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.293+0000 7f5b98e00700 1 -- 172.21.15.120:0/1975081411 reap_dead start 2024-05-14T09:20:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.294+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 shutdown_connections 2024-05-14T09:20:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.294+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 >> 172.21.15.120:0/1975081411 conn(0x7f5b940fedc0 msgr2=0x7f5b9406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.294+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 shutdown_connections 2024-05-14T09:20:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:33.294+0000 7f5b9ae00700 1 -- 172.21.15.120:0/1975081411 wait complete. 2024-05-14T09:20:34.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:33 smithi152 ceph-mon[34868]: pgmap v466: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:34.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:33 smithi175 ceph-mon[35353]: pgmap v466: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:34.239 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:33 smithi120 ceph-mon[31085]: pgmap v466: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:35.674 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:35.675 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:36.009 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:35 smithi120 ceph-mon[31085]: pgmap v467: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 -- 172.21.15.120:0/2652683631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb650109850 msgr2=0x7fb6501111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 --2- 172.21.15.120:0/2652683631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb650109850 0x7fb6501111b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb64800b0d0 tx=0x7fb64800b3e0 comp rx=0 tx=0).stop 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 -- 172.21.15.120:0/2652683631 shutdown_connections 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 --2- 172.21.15.120:0/2652683631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb650109850 0x7fb6501111b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 --2- 172.21.15.120:0/2652683631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6501045d0 0x7fb6501049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 --2- 172.21.15.120:0/2652683631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb650108f00 0x7fb650109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 -- 172.21.15.120:0/2652683631 >> 172.21.15.120:0/2652683631 conn(0x7fb6500ffea0 msgr2=0x7fb6501022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 -- 172.21.15.120:0/2652683631 shutdown_connections 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.989+0000 7fb657a00700 1 -- 172.21.15.120:0/2652683631 wait complete. 2024-05-14T09:20:36.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.990+0000 7fb657a00700 1 Processor -- start 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb657a00700 1 -- start start 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb657a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6501045d0 0x7fb65019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb657a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb650108f00 0x7fb65019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb657a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb650109850 0x7fb6501a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb657a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb650114330 con 0x7fb6501045d0 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb657a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501141b0 con 0x7fb650109850 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb657a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501144b0 con 0x7fb650108f00 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb655000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6501045d0 0x7fb65019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb655000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6501045d0 0x7fb65019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54600/0 (socket says 172.21.15.120:54600) 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.991+0000 7fb655000700 1 -- 172.21.15.120:0/2516925983 learned_addr learned my addr 172.21.15.120:0/2516925983 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb64fe00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb650108f00 0x7fb65019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb655a00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb650109850 0x7fb6501a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb655000700 1 -- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb650108f00 msgr2=0x7fb65019d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb655000700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb650108f00 0x7fb65019d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb655000700 1 -- 172.21.15.120:0/2516925983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb650109850 msgr2=0x7fb6501a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb655000700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb650109850 0x7fb6501a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb655000700 1 -- 172.21.15.120:0/2516925983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6501a1c80 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.992+0000 7fb655000700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6501045d0 0x7fb65019ce60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c9b0 tx=0x7fb64400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.993+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644007b00 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.993+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb644007ca0 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.993+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6501a1f70 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.993+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644018660 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.993+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6501a24b0 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.994+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6501080c0 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.996+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fb64400f450 con 0x7fb6501045d0 2024-05-14T09:20:36.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.998+0000 7fb64d600700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb6380b2910 0x7fb6380b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.998+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb6440e2ca0 con 0x7fb6501045d0 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.998+0000 7fb64fe00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb6380b2910 0x7fb6380b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.998+0000 7fb64d600700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] conn(0x7fb6380bdbe0 0x7fb6380c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.998+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 --> [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb644007e50 con 0x7fb6380bdbe0 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.998+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fb6440e3050 con 0x7fb6501045d0 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:35.999+0000 7fb64fe00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb6380b2910 0x7fb6380b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005fd0 tx=0x7fb63c00af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.004+0000 7fb655a00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] conn(0x7fb6380bdbe0 0x7fb6380c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.006+0000 7fb655a00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] conn(0x7fb6380bdbe0 0x7fb6380c00b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:36.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.008+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== osd.8 v2:172.21.15.175:6816/3403319131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb644007e50 con 0x7fb6380bdbe0 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.026+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 --> [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb650105a80 con 0x7fb6380bdbe0 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.027+0000 7fb64d600700 1 -- 172.21.15.120:0/2516925983 <== osd.8 v2:172.21.15.175:6816/3403319131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb650105a80 con 0x7fb6380bdbe0 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.027+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] conn(0x7fb6380bdbe0 msgr2=0x7fb6380c00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.027+0000 7fb657a00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] conn(0x7fb6380bdbe0 0x7fb6380c00b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.027+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb6380b2910 msgr2=0x7fb6380b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.027+0000 7fb657a00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb6380b2910 0x7fb6380b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005fd0 tx=0x7fb63c00af20 comp rx=0 tx=0).stop 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.027+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6501045d0 msgr2=0x7fb65019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.027+0000 7fb657a00700 1 --2- 172.21.15.120:0/2516925983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6501045d0 0x7fb65019ce60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c9b0 tx=0x7fb64400cd70 comp rx=0 tx=0).stop 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.028+0000 7fb655a00700 1 -- 172.21.15.120:0/2516925983 reap_dead start 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.028+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 shutdown_connections 2024-05-14T09:20:36.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.028+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 >> 172.21.15.120:0/2516925983 conn(0x7fb6500ffea0 msgr2=0x7fb650110e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:36.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.028+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 shutdown_connections 2024-05-14T09:20:36.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:36.028+0000 7fb657a00700 1 -- 172.21.15.120:0/2516925983 wait complete. 2024-05-14T09:20:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:35 smithi152 ceph-mon[34868]: pgmap v467: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:35 smithi175 ceph-mon[35353]: pgmap v467: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:36.886 INFO:teuthology.orchestra.run.smithi120.stdout:137438953574 2024-05-14T09:20:36.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-14T09:20:38.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:37 smithi120 ceph-mon[31085]: pgmap v468: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:37 smithi152 ceph-mon[34868]: pgmap v468: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:38.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:37 smithi175 ceph-mon[35353]: pgmap v468: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:38.378 INFO:teuthology.orchestra.run.smithi120.stdout:206158430287 2024-05-14T09:20:38.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-14T09:20:40.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:39 smithi120 ceph-mon[31085]: pgmap v469: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:40.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:39 smithi175 ceph-mon[35353]: pgmap v469: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:40.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:39 smithi152 ceph-mon[34868]: pgmap v469: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:41.947 INFO:teuthology.orchestra.run.smithi120.stdout:231928234057 2024-05-14T09:20:41.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-14T09:20:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:41 smithi175 ceph-mon[35353]: pgmap v470: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:20:42.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:41 smithi120 ceph-mon[31085]: pgmap v470: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:20:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:41 smithi152 ceph-mon[34868]: pgmap v470: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:20:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:43 smithi175 ceph-mon[35353]: pgmap v471: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:44.229 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:43 smithi120 ceph-mon[31085]: pgmap v471: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:44.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.656+0000 7f853cc00700 1 -- 172.21.15.120:0/1678264659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8538110970 msgr2=0x7f8538110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.656+0000 7f853cc00700 1 --2- 172.21.15.120:0/1678264659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8538110970 0x7f8538110d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8528009990 tx=0x7f8528009ca0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.657+0000 7f853cc00700 1 -- 172.21.15.120:0/1678264659 shutdown_connections 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.657+0000 7f853cc00700 1 --2- 172.21.15.120:0/1678264659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f853810b2e0 0x7f8538117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.657+0000 7f853cc00700 1 --2- 172.21.15.120:0/1678264659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8538110970 0x7f8538110d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.657+0000 7f853cc00700 1 --2- 172.21.15.120:0/1678264659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853810a990 0x7f853810ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.657+0000 7f853cc00700 1 -- 172.21.15.120:0/1678264659 >> 172.21.15.120:0/1678264659 conn(0x7f8538077c80 msgr2=0x7f85380780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.657+0000 7f853cc00700 1 -- 172.21.15.120:0/1678264659 shutdown_connections 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.657+0000 7f853cc00700 1 -- 172.21.15.120:0/1678264659 wait complete. 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.658+0000 7f853cc00700 1 Processor -- start 2024-05-14T09:20:44.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.658+0000 7f853cc00700 1 -- start start 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.658+0000 7f853cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f853810a990 0x7f85381a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.658+0000 7f853cc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853810b2e0 0x7f85381a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.658+0000 7f853cc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8538110970 0x7f85381a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f853cc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f853811a930 con 0x7f853810a990 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f853cc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f853811a7b0 con 0x7f8538110970 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f853cc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f853811aab0 con 0x7f853810b2e0 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f853810a990 0x7f85381a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f853810a990 0x7f85381a1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42394/0 (socket says 172.21.15.120:42394) 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 -- 172.21.15.120:0/1795681488 learned_addr learned my addr 172.21.15.120:0/1795681488 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8536800700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8538110970 0x7f85381a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:44.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 -- 172.21.15.120:0/1795681488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853810b2e0 msgr2=0x7f85381a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:44.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853810b2e0 0x7f85381a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 -- 172.21.15.120:0/1795681488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8538110970 msgr2=0x7f85381a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:44.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8538110970 0x7f85381a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.659+0000 7f8535e00700 1 -- 172.21.15.120:0/1795681488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85381a6250 con 0x7f853810a990 2024-05-14T09:20:44.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.660+0000 7f8535e00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f853810a990 0x7f85381a1380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8528000c00 tx=0x7f8528005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:44.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.660+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528027070 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.660+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f852800fd40 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.660+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528022ca0 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.660+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85381a64e0 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.660+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85381a6970 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.661+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8538063f50 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.664+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f852802a070 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.665+0000 7f852ea00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f851c0b2910 0x7f851c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.665+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f85280e3b60 con 0x7f853810a990 2024-05-14T09:20:44.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.665+0000 7f8535400700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f851c0b2910 0x7f851c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.666+0000 7f852ea00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] conn(0x7f851c0bdbe0 0x7f851c0c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.666+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 --> [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f852800b0b0 con 0x7f851c0bdbe0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.666+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f85280e3f10 con 0x7f853810a990 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.666+0000 7f8535400700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f851c0b2910 0x7f851c0b4e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8520005950 tx=0x7f85200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.666+0000 7f8536800700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] conn(0x7f851c0bdbe0 0x7f851c0c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.667+0000 7f8536800700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] conn(0x7f851c0bdbe0 0x7f851c0c00b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.669+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== osd.11 v2:172.21.15.175:6824/82369907 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f852800b0b0 con 0x7f851c0bdbe0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.688+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 --> [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f85380643d0 con 0x7f851c0bdbe0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.689+0000 7f852ea00700 1 -- 172.21.15.120:0/1795681488 <== osd.11 v2:172.21.15.175:6824/82369907 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f85380643d0 con 0x7f851c0bdbe0 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.689+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 >> [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] conn(0x7f851c0bdbe0 msgr2=0x7f851c0c00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:44.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.689+0000 7f853cc00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] conn(0x7f851c0bdbe0 0x7f851c0c00b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f851c0b2910 msgr2=0x7f851c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f851c0b2910 0x7f851c0b4e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8520005950 tx=0x7f85200058e0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f853810a990 msgr2=0x7f85381a1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 --2- 172.21.15.120:0/1795681488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f853810a990 0x7f85381a1380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8528000c00 tx=0x7f8528005ef0 comp rx=0 tx=0).stop 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f8536800700 1 -- 172.21.15.120:0/1795681488 reap_dead start 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 shutdown_connections 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 >> 172.21.15.120:0/1795681488 conn(0x7f8538077c80 msgr2=0x7f853807bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 shutdown_connections 2024-05-14T09:20:44.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:43.690+0000 7f853cc00700 1 -- 172.21.15.120:0/1795681488 wait complete. 2024-05-14T09:20:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:43 smithi152 ceph-mon[34868]: pgmap v471: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:45.091 INFO:teuthology.orchestra.run.smithi120.stdout:304942678069 2024-05-14T09:20:45.091 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-14T09:20:45.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 -- 172.21.15.120:0/702625265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9481054e0 msgr2=0x7fe9481058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:45.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 --2- 172.21.15.120:0/702625265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9481054e0 0x7fe9481058f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe938009990 tx=0x7fe938009ca0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 -- 172.21.15.120:0/702625265 shutdown_connections 2024-05-14T09:20:45.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 --2- 172.21.15.120:0/702625265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe94810e910 0x7fe948110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 --2- 172.21.15.120:0/702625265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9481054e0 0x7fe9481058f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 --2- 172.21.15.120:0/702625265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe948105e30 0x7fe94810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 -- 172.21.15.120:0/702625265 >> 172.21.15.120:0/702625265 conn(0x7fe9480fedc0 msgr2=0x7fe9481011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:45.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 -- 172.21.15.120:0/702625265 shutdown_connections 2024-05-14T09:20:45.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.538+0000 7fe94ee00700 1 -- 172.21.15.120:0/702625265 wait complete. 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.539+0000 7fe94ee00700 1 Processor -- start 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.540+0000 7fe94ee00700 1 -- start start 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.540+0000 7fe94ee00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9481054e0 0x7fe94819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.540+0000 7fe94ee00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe948105e30 0x7fe94819d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.540+0000 7fe94ee00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe94810e910 0x7fe9481a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.540+0000 7fe94ee00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481142e0 con 0x7fe94810e910 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.540+0000 7fe94ee00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe948114160 con 0x7fe9481054e0 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.540+0000 7fe94ee00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe948114460 con 0x7fe948105e30 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe94810e910 0x7fe9481a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe94810e910 0x7fe9481a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42408/0 (socket says 172.21.15.120:42408) 2024-05-14T09:20:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 -- 172.21.15.120:0/4122795845 learned_addr learned my addr 172.21.15.120:0/4122795845 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:45.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe947e00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9481054e0 0x7fe94819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:45.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe947400700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe948105e30 0x7fe94819d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:45.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 -- 172.21.15.120:0/4122795845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe948105e30 msgr2=0x7fe94819d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:45.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe948105e30 0x7fe94819d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 -- 172.21.15.120:0/4122795845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9481054e0 msgr2=0x7fe94819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:45.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9481054e0 0x7fe94819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.541+0000 7fe94ce00700 1 -- 172.21.15.120:0/4122795845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9481a1de0 con 0x7fe94810e910 2024-05-14T09:20:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.542+0000 7fe94ce00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe94810e910 0x7fe9481a1740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe94000ef30 tx=0x7fe94000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.542+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400092e0 con 0x7fe94810e910 2024-05-14T09:20:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.542+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9481a2070 con 0x7fe94810e910 2024-05-14T09:20:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.542+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe940004bb0 con 0x7fe94810e910 2024-05-14T09:20:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.542+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940004020 con 0x7fe94810e910 2024-05-14T09:20:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.542+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9481a99f0 con 0x7fe94810e910 2024-05-14T09:20:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.543+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe948063f50 con 0x7fe94810e910 2024-05-14T09:20:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.546+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fe94001b030 con 0x7fe94810e910 2024-05-14T09:20:45.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.548+0000 7fe944c00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe92c0b2910 0x7fe92c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:45.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.548+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe9400e2b60 con 0x7fe94810e910 2024-05-14T09:20:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.548+0000 7fe947e00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe92c0b2910 0x7fe92c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.548+0000 7fe944c00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] conn(0x7fe92c0bdbe0 0x7fe92c0c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.548+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 --> [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe940008ec0 con 0x7fe92c0bdbe0 2024-05-14T09:20:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.549+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe9400e2f10 con 0x7fe94810e910 2024-05-14T09:20:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.549+0000 7fe947400700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] conn(0x7fe92c0bdbe0 0x7fe92c0c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.549+0000 7fe947e00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe92c0b2910 0x7fe92c0b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe93800b2e0 tx=0x7fe938005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.550+0000 7fe947400700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] conn(0x7fe92c0bdbe0 0x7fe92c0c00b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:45.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.551+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== osd.6 v2:172.21.15.120:6818/3056363875 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe940008ec0 con 0x7fe92c0bdbe0 2024-05-14T09:20:45.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.570+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 --> [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe9480643d0 con 0x7fe92c0bdbe0 2024-05-14T09:20:45.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.570+0000 7fe944c00700 1 -- 172.21.15.120:0/4122795845 <== osd.6 v2:172.21.15.120:6818/3056363875 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe9480643d0 con 0x7fe92c0bdbe0 2024-05-14T09:20:45.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] conn(0x7fe92c0bdbe0 msgr2=0x7fe92c0c00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:45.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] conn(0x7fe92c0bdbe0 0x7fe92c0c00b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe92c0b2910 msgr2=0x7fe92c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe92c0b2910 0x7fe92c0b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe93800b2e0 tx=0x7fe938005fb0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe94810e910 msgr2=0x7fe9481a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 --2- 172.21.15.120:0/4122795845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe94810e910 0x7fe9481a1740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe94000ef30 tx=0x7fe94000c3a0 comp rx=0 tx=0).stop 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ce00700 1 -- 172.21.15.120:0/4122795845 reap_dead start 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 shutdown_connections 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 >> 172.21.15.120:0/4122795845 conn(0x7fe9480fedc0 msgr2=0x7fe948103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 shutdown_connections 2024-05-14T09:20:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:45.571+0000 7fe94ee00700 1 -- 172.21.15.120:0/4122795845 wait complete. 2024-05-14T09:20:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:45 smithi175 ceph-mon[35353]: pgmap v472: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 -- 172.21.15.120:0/615735192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 msgr2=0x7fe1b8109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 --2- 172.21.15.120:0/615735192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 0x7fe1b8109140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40099c0 tx=0x7fe1a4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 -- 172.21.15.120:0/615735192 shutdown_connections 2024-05-14T09:20:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 --2- 172.21.15.120:0/615735192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b8109680 0x7fe1b8110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 --2- 172.21.15.120:0/615735192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b8104400 0x7fe1b8104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 --2- 172.21.15.120:0/615735192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 0x7fe1b8109140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 -- 172.21.15.120:0/615735192 >> 172.21.15.120:0/615735192 conn(0x7fe1b8079d10 msgr2=0x7fe1b807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:46.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.247+0000 7fe1bcc00700 1 -- 172.21.15.120:0/615735192 shutdown_connections 2024-05-14T09:20:46.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.248+0000 7fe1bcc00700 1 -- 172.21.15.120:0/615735192 wait complete. 2024-05-14T09:20:46.249 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:45 smithi120 ceph-mon[31085]: pgmap v472: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:46.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.249+0000 7fe1bcc00700 1 Processor -- start 2024-05-14T09:20:46.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.250+0000 7fe1bcc00700 1 -- start start 2024-05-14T09:20:46.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.250+0000 7fe1bcc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b8104400 0x7fe1b81a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:46.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.250+0000 7fe1bcc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 0x7fe1b81a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:46.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.250+0000 7fe1bcc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b8109680 0x7fe1b819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:46.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.250+0000 7fe1bcc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8114140 con 0x7fe1b8108d30 2024-05-14T09:20:46.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.250+0000 7fe1bcc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8113fc0 con 0x7fe1b8104400 2024-05-14T09:20:46.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.250+0000 7fe1bcc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81142c0 con 0x7fe1b8109680 2024-05-14T09:20:46.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 0x7fe1b81a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:46.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 0x7fe1b81a0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42418/0 (socket says 172.21.15.120:42418) 2024-05-14T09:20:46.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 -- 172.21.15.120:0/1345978329 learned_addr learned my addr 172.21.15.120:0/1345978329 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:46.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b7400700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b8104400 0x7fe1b81a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:46.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b7e00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b8109680 0x7fe1b819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:46.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 -- 172.21.15.120:0/1345978329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b8109680 msgr2=0x7fe1b819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:46.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b8109680 0x7fe1b819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 -- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b8104400 msgr2=0x7fe1b81a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:46.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b8104400 0x7fe1b81a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b6a00700 1 -- 172.21.15.120:0/1345978329 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b819b0e0 con 0x7fe1b8108d30 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.251+0000 7fe1b7400700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b8104400 0x7fe1b81a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.252+0000 7fe1b6a00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 0x7fe1b81a0dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400b580 tx=0x7fe1a400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.252+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4026070 con 0x7fe1b8108d30 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.252+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1a4005030 con 0x7fe1b8108d30 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.252+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b819b370 con 0x7fe1b8108d30 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.252+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40049f0 con 0x7fe1b8108d30 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.252+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b819b850 con 0x7fe1b8108d30 2024-05-14T09:20:46.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.253+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1b8063e90 con 0x7fe1b8108d30 2024-05-14T09:20:46.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.256+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fe1a4029070 con 0x7fe1b8108d30 2024-05-14T09:20:46.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.258+0000 7fe1afe00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe19c0b2910 0x7fe19c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:46.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.258+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe1a40e3bf0 con 0x7fe1b8108d30 2024-05-14T09:20:46.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.258+0000 7fe1b7400700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe19c0b2910 0x7fe19c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.258+0000 7fe1afe00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] conn(0x7fe19c0bdab0 0x7fe19c0bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.258+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 --> [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1a400eea0 con 0x7fe19c0bdab0 2024-05-14T09:20:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.258+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe1a40e3fa0 con 0x7fe1b8108d30 2024-05-14T09:20:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.259+0000 7fe1b7400700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe19c0b2910 0x7fe19c0b4e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8005950 tx=0x7fe1a80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.259+0000 7fe1b7e00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] conn(0x7fe19c0bdab0 0x7fe19c0bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:46.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.260+0000 7fe1b7e00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] conn(0x7fe19c0bdab0 0x7fe19c0bff80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:46.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.262+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== osd.10 v2:172.21.15.152:6824/832573806 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1a400eea0 con 0x7fe19c0bdab0 2024-05-14T09:20:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.280+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 --> [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe1b8064310 con 0x7fe19c0bdab0 2024-05-14T09:20:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.281+0000 7fe1afe00700 1 -- 172.21.15.120:0/1345978329 <== osd.10 v2:172.21.15.152:6824/832573806 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe1b8064310 con 0x7fe19c0bdab0 2024-05-14T09:20:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.282+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] conn(0x7fe19c0bdab0 msgr2=0x7fe19c0bff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.282+0000 7fe1bcc00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] conn(0x7fe19c0bdab0 0x7fe19c0bff80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.282+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe19c0b2910 msgr2=0x7fe19c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.282+0000 7fe1bcc00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe19c0b2910 0x7fe19c0b4e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8005950 tx=0x7fe1a80058e0 comp rx=0 tx=0).stop 2024-05-14T09:20:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.282+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 msgr2=0x7fe1b81a0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.282+0000 7fe1bcc00700 1 --2- 172.21.15.120:0/1345978329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1b8108d30 0x7fe1b81a0dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400b580 tx=0x7fe1a400f510 comp rx=0 tx=0).stop 2024-05-14T09:20:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.282+0000 7fe1b7e00700 1 -- 172.21.15.120:0/1345978329 reap_dead start 2024-05-14T09:20:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.283+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 shutdown_connections 2024-05-14T09:20:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.283+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 >> 172.21.15.120:0/1345978329 conn(0x7fe1b8079d10 msgr2=0x7fe1b8101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.283+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 shutdown_connections 2024-05-14T09:20:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:46.283+0000 7fe1bcc00700 1 -- 172.21.15.120:0/1345978329 wait complete. 2024-05-14T09:20:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:45 smithi152 ceph-mon[34868]: pgmap v472: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:47.836 INFO:teuthology.orchestra.run.smithi120.stdout:279172874300 2024-05-14T09:20:47.836 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-14T09:20:48.310 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:47 smithi120 ceph-mon[31085]: pgmap v473: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 -- 172.21.15.120:0/572783927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 msgr2=0x7faab4109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 --2- 172.21.15.120:0/572783927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 0x7faab4109140 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faaa00099c0 tx=0x7faaa0009cd0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 -- 172.21.15.120:0/572783927 shutdown_connections 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 --2- 172.21.15.120:0/572783927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faab4109680 0x7faab4110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 --2- 172.21.15.120:0/572783927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab4104400 0x7faab4104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 --2- 172.21.15.120:0/572783927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 0x7faab4109140 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 -- 172.21.15.120:0/572783927 >> 172.21.15.120:0/572783927 conn(0x7faab4079d10 msgr2=0x7faab407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 -- 172.21.15.120:0/572783927 shutdown_connections 2024-05-14T09:20:48.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.443+0000 7faaba200700 1 -- 172.21.15.120:0/572783927 wait complete. 2024-05-14T09:20:48.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.444+0000 7faaba200700 1 Processor -- start 2024-05-14T09:20:48.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faaba200700 1 -- start start 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faaba200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab4104400 0x7faab419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faaba200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 0x7faab419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faaba200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faab4109680 0x7faab41a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faaba200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faab4114190 con 0x7faab4108d30 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faaba200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faab4114010 con 0x7faab4109680 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faaba200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faab4114310 con 0x7faab4104400 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faab3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 0x7faab419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faab3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 0x7faab419d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40608/0 (socket says 172.21.15.120:40608) 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.445+0000 7faab3e00700 1 -- 172.21.15.120:0/2475872927 learned_addr learned my addr 172.21.15.120:0/2475872927 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab8e00700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab4104400 0x7faab419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab9800700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faab4109680 0x7faab41a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab3e00700 1 -- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab4104400 msgr2=0x7faab419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab3e00700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab4104400 0x7faab419ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab3e00700 1 -- 172.21.15.120:0/2475872927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faab4109680 msgr2=0x7faab41a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab3e00700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faab4109680 0x7faab41a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab3e00700 1 -- 172.21.15.120:0/2475872927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab41a1d10 con 0x7faab4108d30 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.446+0000 7faab3e00700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 0x7faab419d3e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b580 tx=0x7faaa00057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.447+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0027070 con 0x7faab4108d30 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.447+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faaa000fd30 con 0x7faab4108d30 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.447+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab41a1fa0 con 0x7faab4108d30 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.447+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0022e50 con 0x7faab4108d30 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.447+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab41a2480 con 0x7faab4108d30 2024-05-14T09:20:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.448+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faab4102580 con 0x7faab4108d30 2024-05-14T09:20:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.451+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7faaa002a070 con 0x7faab4108d30 2024-05-14T09:20:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.452+0000 7faab1600700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa9c0b2ab0 0x7faa9c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.453+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7faaa00e38e0 con 0x7faab4108d30 2024-05-14T09:20:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.453+0000 7faab8e00700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa9c0b2ab0 0x7faa9c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.453+0000 7faab1600700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] conn(0x7faa9c0bdd80 0x7faa9c0c0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.453+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 --> [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faaa0023e80 con 0x7faa9c0bdd80 2024-05-14T09:20:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.453+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7faaa00e3c90 con 0x7faab4108d30 2024-05-14T09:20:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.453+0000 7faab9800700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] conn(0x7faa9c0bdd80 0x7faa9c0c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.454+0000 7faab8e00700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa9c0b2ab0 0x7faa9c0b4fc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faaa8005950 tx=0x7faaa800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:48.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.455+0000 7faab9800700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] conn(0x7faa9c0bdd80 0x7faa9c0c0250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:48.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.457+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== osd.2 v2:172.21.15.175:6800/636369105 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faaa0023e80 con 0x7faa9c0bdd80 2024-05-14T09:20:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:47 smithi152 ceph-mon[34868]: pgmap v473: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-05-14T09:20:48.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.475+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 --> [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faab41058b0 con 0x7faa9c0bdd80 2024-05-14T09:20:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:47 smithi175 ceph-mon[35353]: pgmap v473: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-05-14T09:20:48.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faab1600700 1 -- 172.21.15.120:0/2475872927 <== osd.2 v2:172.21.15.175:6800/636369105 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faab41058b0 con 0x7faa9c0bdd80 2024-05-14T09:20:48.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] conn(0x7faa9c0bdd80 msgr2=0x7faa9c0c0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:48.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] conn(0x7faa9c0bdd80 0x7faa9c0c0250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa9c0b2ab0 msgr2=0x7faa9c0b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa9c0b2ab0 0x7faa9c0b4fc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faaa8005950 tx=0x7faaa800b410 comp rx=0 tx=0).stop 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 msgr2=0x7faab419d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 --2- 172.21.15.120:0/2475872927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faab4108d30 0x7faab419d3e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b580 tx=0x7faaa00057c0 comp rx=0 tx=0).stop 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faab9800700 1 -- 172.21.15.120:0/2475872927 reap_dead start 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 shutdown_connections 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.477+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 >> 172.21.15.120:0/2475872927 conn(0x7faab4079d10 msgr2=0x7faab4101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.478+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 shutdown_connections 2024-05-14T09:20:48.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:48.478+0000 7faaba200700 1 -- 172.21.15.120:0/2475872927 wait complete. 2024-05-14T09:20:49.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.112+0000 7f6624600700 1 -- 172.21.15.120:0/1475743830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 msgr2=0x7f661c117790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:49.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.112+0000 7f6624600700 1 --2- 172.21.15.120:0/1475743830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 0x7f661c117790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f661400b0a0 tx=0x7f661400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.113+0000 7f6624600700 1 -- 172.21.15.120:0/1475743830 shutdown_connections 2024-05-14T09:20:49.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.113+0000 7f6624600700 1 --2- 172.21.15.120:0/1475743830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 0x7f661c117790 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.113+0000 7f6624600700 1 --2- 172.21.15.120:0/1475743830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c075b60 0x7f661c075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.113+0000 7f6624600700 1 --2- 172.21.15.120:0/1475743830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0764b0 0x7f661c114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.113+0000 7f6624600700 1 -- 172.21.15.120:0/1475743830 >> 172.21.15.120:0/1475743830 conn(0x7f661c100040 msgr2=0x7f661c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.113+0000 7f6624600700 1 -- 172.21.15.120:0/1475743830 shutdown_connections 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.113+0000 7f6624600700 1 -- 172.21.15.120:0/1475743830 wait complete. 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.114+0000 7f6624600700 1 Processor -- start 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.114+0000 7f6624600700 1 -- start start 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.114+0000 7f6624600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c075b60 0x7f661c1a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6624600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0764b0 0x7f661c1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6624600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 0x7f661c1a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6624600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f661c11a920 con 0x7f661c115370 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6624600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f661c11a7a0 con 0x7f661c0764b0 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6624600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f661c11aaa0 con 0x7f661c075b60 2024-05-14T09:20:49.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6622600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 0x7f661c1a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6622600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 0x7f661c1a5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40632/0 (socket says 172.21.15.120:40632) 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6622600700 1 -- 172.21.15.120:0/1788475500 learned_addr learned my addr 172.21.15.120:0/1788475500 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6621200700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0764b0 0x7f661c1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6621c00700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c075b60 0x7f661c1a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.115+0000 7f6622600700 1 -- 172.21.15.120:0/1788475500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c075b60 msgr2=0x7f661c1a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6622600700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c075b60 0x7f661c1a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6622600700 1 -- 172.21.15.120:0/1788475500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0764b0 msgr2=0x7f661c1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6622600700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0764b0 0x7f661c1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6622600700 1 -- 172.21.15.120:0/1788475500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661c1a61a0 con 0x7f661c115370 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6621c00700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c075b60 0x7f661c1a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6622600700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 0x7f661c1a5b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f661400b830 tx=0x7f6614004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614021070 con 0x7f661c115370 2024-05-14T09:20:49.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6614007b80 con 0x7f661c115370 2024-05-14T09:20:49.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66140052a0 con 0x7f661c115370 2024-05-14T09:20:49.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661c1a6430 con 0x7f661c115370 2024-05-14T09:20:49.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.116+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661c1addb0 con 0x7f661c115370 2024-05-14T09:20:49.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.117+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f661c063f50 con 0x7f661c115370 2024-05-14T09:20:49.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.120+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f6614024070 con 0x7f661c115370 2024-05-14T09:20:49.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.122+0000 7f661a000700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f66040b2990 0x7f66040b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:49.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.122+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f661400f020 con 0x7f661c115370 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.122+0000 7f6621c00700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f66040b2990 0x7f66040b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.122+0000 7f661a000700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] conn(0x7f66040bdc60 0x7f66040c0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.122+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 --> [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f661402ce50 con 0x7f66040bdc60 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.122+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f66140e4360 con 0x7f661c115370 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.123+0000 7f6621200700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] conn(0x7f66040bdc60 0x7f66040c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.123+0000 7f6621c00700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f66040b2990 0x7f66040b4ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6610005950 tx=0x7f66100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.123+0000 7f6621200700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] conn(0x7f66040bdc60 0x7f66040c0130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.124+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== osd.3 v2:172.21.15.120:6810/920546533 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f661402ce50 con 0x7f66040bdc60 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.143+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 --> [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f661c064350 con 0x7f66040bdc60 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.143+0000 7f661a000700 1 -- 172.21.15.120:0/1788475500 <== osd.3 v2:172.21.15.120:6810/920546533 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f661c064350 con 0x7f66040bdc60 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] conn(0x7f66040bdc60 msgr2=0x7f66040c0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:49.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] conn(0x7f66040bdc60 0x7f66040c0130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f66040b2990 msgr2=0x7f66040b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f66040b2990 0x7f66040b4ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6610005950 tx=0x7f66100058e0 comp rx=0 tx=0).stop 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 msgr2=0x7f661c1a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 --2- 172.21.15.120:0/1788475500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f661c115370 0x7f661c1a5b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f661400b830 tx=0x7f6614004d00 comp rx=0 tx=0).stop 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6622600700 1 -- 172.21.15.120:0/1788475500 reap_dead start 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 shutdown_connections 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 >> 172.21.15.120:0/1788475500 conn(0x7f661c100040 msgr2=0x7f661c100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.144+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 shutdown_connections 2024-05-14T09:20:49.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.145+0000 7f6624600700 1 -- 172.21.15.120:0/1788475500 wait complete. 2024-05-14T09:20:50.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 -- 172.21.15.120:0/2624196806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 msgr2=0x7fd8701038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 --2- 172.21.15.120:0/2624196806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 0x7fd8701038d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd8600099c0 tx=0x7fd860009cd0 comp rx=0 tx=0).stop 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 -- 172.21.15.120:0/2624196806 shutdown_connections 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 --2- 172.21.15.120:0/2624196806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd870108740 0x7fd8701100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 --2- 172.21.15.120:0/2624196806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 0x7fd8701038d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 --2- 172.21.15.120:0/2624196806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870107df0 0x7fd870108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 -- 172.21.15.120:0/2624196806 >> 172.21.15.120:0/2624196806 conn(0x7fd8700fedc0 msgr2=0x7fd8701011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 -- 172.21.15.120:0/2624196806 shutdown_connections 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.702+0000 7fd874c00700 1 -- 172.21.15.120:0/2624196806 wait complete. 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 Processor -- start 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 -- start start 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 0x7fd87019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd870107df0 0x7fd87019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870108740 0x7fd8701a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd870113220 con 0x7fd8701034c0 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701130a0 con 0x7fd870107df0 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.704+0000 7fd874c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701133a0 con 0x7fd870108740 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 0x7fd87019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 0x7fd87019cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42432/0 (socket says 172.21.15.120:42432) 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 -- 172.21.15.120:0/1646534287 learned_addr learned my addr 172.21.15.120:0/1646534287 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86d400700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd870107df0 0x7fd87019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86e800700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870108740 0x7fd8701a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 -- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870108740 msgr2=0x7fd8701a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870108740 0x7fd8701a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 -- 172.21.15.120:0/1646534287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd870107df0 msgr2=0x7fd87019d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd870107df0 0x7fd87019d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.705+0000 7fd86de00700 1 -- 172.21.15.120:0/1646534287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8701a1dc0 con 0x7fd8701034c0 2024-05-14T09:20:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.706+0000 7fd86de00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 0x7fd87019cef0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd860006010 tx=0x7fd860004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.706+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860026070 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.706+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd86000f460 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.706+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8701a2050 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.706+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860009e60 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.706+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8701a99d0 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.707+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd870063f50 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.710+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fd860029070 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.711+0000 7fd866a00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd8540b2990 0x7fd8540b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.711+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd8600e35b0 con 0x7fd8701034c0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.712+0000 7fd86d400700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd8540b2990 0x7fd8540b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.712+0000 7fd866a00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] conn(0x7fd8540bdc60 0x7fd8540c0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.712+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 --> [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd86002ae50 con 0x7fd8540bdc60 2024-05-14T09:20:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.712+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd8600e3960 con 0x7fd8701034c0 2024-05-14T09:20:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.712+0000 7fd86d400700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd8540b2990 0x7fd8540b4ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd87006c410 tx=0x7fd85c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.712+0000 7fd86e800700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] conn(0x7fd8540bdc60 0x7fd8540c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.713+0000 7fd86e800700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] conn(0x7fd8540bdc60 0x7fd8540c0130 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.716+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== osd.5 v2:172.21.15.175:6808/10166549 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd86002ae50 con 0x7fd8540bdc60 2024-05-14T09:20:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.736+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 --> [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd870064350 con 0x7fd8540bdc60 2024-05-14T09:20:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.737+0000 7fd866a00700 1 -- 172.21.15.120:0/1646534287 <== osd.5 v2:172.21.15.175:6808/10166549 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd870064350 con 0x7fd8540bdc60 2024-05-14T09:20:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.737+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] conn(0x7fd8540bdc60 msgr2=0x7fd8540c0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.737+0000 7fd874c00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] conn(0x7fd8540bdc60 0x7fd8540c0130 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd8540b2990 msgr2=0x7fd8540b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd8540b2990 0x7fd8540b4ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd87006c410 tx=0x7fd85c009260 comp rx=0 tx=0).stop 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 msgr2=0x7fd87019cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 --2- 172.21.15.120:0/1646534287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8701034c0 0x7fd87019cef0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd860006010 tx=0x7fd860004690 comp rx=0 tx=0).stop 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd86e800700 1 -- 172.21.15.120:0/1646534287 reap_dead start 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 shutdown_connections 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 >> 172.21.15.120:0/1646534287 conn(0x7fd8700fedc0 msgr2=0x7fd870109760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 shutdown_connections 2024-05-14T09:20:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:47.738+0000 7fd874c00700 1 -- 172.21.15.120:0/1646534287 wait complete. 2024-05-14T09:20:50.311 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:49 smithi120 ceph-mon[31085]: pgmap v474: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:20:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:49 smithi152 ceph-mon[34868]: pgmap v474: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:20:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:49 smithi175 ceph-mon[35353]: pgmap v474: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:20:50.996 INFO:teuthology.orchestra.run.smithi120.stdout:184683593817 2024-05-14T09:20:50.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-14T09:20:51.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.863+0000 7f07ea200700 1 -- 172.21.15.120:0/105636217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4110bf0 msgr2=0x7f07e4113010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:51.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.863+0000 7f07ea200700 1 --2- 172.21.15.120:0/105636217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4110bf0 0x7f07e4113010 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00b0a0 tx=0x7f07dc00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.864+0000 7f07ea200700 1 -- 172.21.15.120:0/105636217 shutdown_connections 2024-05-14T09:20:51.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.864+0000 7f07ea200700 1 --2- 172.21.15.120:0/105636217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4110bf0 0x7f07e4113010 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.864+0000 7f07ea200700 1 --2- 172.21.15.120:0/105636217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4076c10 0x7f07e4077020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.864+0000 7f07ea200700 1 --2- 172.21.15.120:0/105636217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07e4077560 0x7f07e41106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.864+0000 7f07ea200700 1 -- 172.21.15.120:0/105636217 >> 172.21.15.120:0/105636217 conn(0x7f07e40ffed0 msgr2=0x7f07e4102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.864+0000 7f07ea200700 1 -- 172.21.15.120:0/105636217 shutdown_connections 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.864+0000 7f07ea200700 1 -- 172.21.15.120:0/105636217 wait complete. 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 Processor -- start 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 -- start start 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4076c10 0x7f07e419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07e4077560 0x7f07e419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4110bf0 0x7f07e41a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f07e4116560 con 0x7f07e4076c10 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f07e41163e0 con 0x7f07e4077560 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.865+0000 7f07ea200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07e41166e0 con 0x7f07e4110bf0 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4076c10 0x7f07e419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4076c10 0x7f07e419ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40660/0 (socket says 172.21.15.120:40660) 2024-05-14T09:20:51.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 -- 172.21.15.120:0/2584013253 learned_addr learned my addr 172.21.15.120:0/2584013253 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e2a00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07e4077560 0x7f07e419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3e00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4110bf0 0x7f07e41a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 -- 172.21.15.120:0/2584013253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4110bf0 msgr2=0x7f07e41a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4110bf0 0x7f07e41a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 -- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07e4077560 msgr2=0x7f07e419d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07e4077560 0x7f07e419d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 -- 172.21.15.120:0/2584013253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e41a1cf0 con 0x7f07e4076c10 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3e00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4110bf0 0x7f07e41a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.866+0000 7f07e3400700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4076c10 0x7f07e419ced0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c920 tx=0x7f07d400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.867+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4007b00 con 0x7f07e4076c10 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.867+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07d4004cc0 con 0x7f07e4076c10 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.867+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e41a1f80 con 0x7f07e4076c10 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.867+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40054f0 con 0x7f07e4076c10 2024-05-14T09:20:51.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.867+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e41a24c0 con 0x7f07e4076c10 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.868+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07e4063f50 con 0x7f07e4076c10 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.871+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f07d4007ca0 con 0x7f07e4076c10 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.872+0000 7f07dbe00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f07c80b2910 0x7f07c80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.873+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f07d40e27d0 con 0x7f07e4076c10 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.873+0000 7f07e2a00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f07c80b2910 0x7f07c80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.873+0000 7f07dbe00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] conn(0x7f07c80bdbe0 0x7f07c80c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.873+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 --> [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07d4004b10 con 0x7f07c80bdbe0 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.873+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f07d40e2b80 con 0x7f07e4076c10 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.873+0000 7f07e2a00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f07c80b2910 0x7f07c80b4e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07d0005fd0 tx=0x7f07d000af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.874+0000 7f07e3e00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] conn(0x7f07c80bdbe0 0x7f07c80c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:51.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.875+0000 7f07e3e00700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] conn(0x7f07c80bdbe0 0x7f07c80c00b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.877+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== osd.1 v2:172.21.15.152:6800/3641772741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07d4004b10 con 0x7f07c80bdbe0 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.895+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 --> [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f07e40643d0 con 0x7f07c80bdbe0 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.896+0000 7f07dbe00700 1 -- 172.21.15.120:0/2584013253 <== osd.1 v2:172.21.15.152:6800/3641772741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f07e40643d0 con 0x7f07c80bdbe0 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] conn(0x7f07c80bdbe0 msgr2=0x7f07c80c00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] conn(0x7f07c80bdbe0 0x7f07c80c00b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f07c80b2910 msgr2=0x7f07c80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f07c80b2910 0x7f07c80b4e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07d0005fd0 tx=0x7f07d000af20 comp rx=0 tx=0).stop 2024-05-14T09:20:51.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4076c10 msgr2=0x7f07e419ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:51.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 --2- 172.21.15.120:0/2584013253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07e4076c10 0x7f07e419ced0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c920 tx=0x7f07d400cce0 comp rx=0 tx=0).stop 2024-05-14T09:20:51.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07e3e00700 1 -- 172.21.15.120:0/2584013253 reap_dead start 2024-05-14T09:20:51.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 shutdown_connections 2024-05-14T09:20:51.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.897+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 >> 172.21.15.120:0/2584013253 conn(0x7f07e40ffed0 msgr2=0x7f07e4101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:51.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.898+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 shutdown_connections 2024-05-14T09:20:51.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:50.898+0000 7f07ea200700 1 -- 172.21.15.120:0/2584013253 wait complete. 2024-05-14T09:20:52.313 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:51 smithi120 ceph-mon[31085]: pgmap v475: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:20:52.373 INFO:teuthology.orchestra.run.smithi120.stdout:55834574976 2024-05-14T09:20:52.374 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-14T09:20:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:51 smithi152 ceph-mon[34868]: pgmap v475: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:20:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:51 smithi175 ceph-mon[35353]: pgmap v475: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:20:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 -- 172.21.15.120:0/3691355801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c0108f20 msgr2=0x7f83c0109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 --2- 172.21.15.120:0/3691355801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c0108f20 0x7f83c0109330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0099c0 tx=0x7f83ac009cd0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 -- 172.21.15.120:0/3691355801 shutdown_connections 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 --2- 172.21.15.120:0/3691355801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83c01045f0 0x7f83c0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 --2- 172.21.15.120:0/3691355801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c0109870 0x7f83c01111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 --2- 172.21.15.120:0/3691355801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c0108f20 0x7f83c0109330 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 -- 172.21.15.120:0/3691355801 >> 172.21.15.120:0/3691355801 conn(0x7f83c0100040 msgr2=0x7f83c0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 -- 172.21.15.120:0/3691355801 shutdown_connections 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.250+0000 7f83c7000700 1 -- 172.21.15.120:0/3691355801 wait complete. 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.251+0000 7f83c7000700 1 Processor -- start 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.251+0000 7f83c7000700 1 -- start start 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83c7000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c01045f0 0x7f83c019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83c7000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c0108f20 0x7f83c019d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83c7000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83c0109870 0x7f83c01a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83c7000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f83c0114330 con 0x7f83c01045f0 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83c7000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01141b0 con 0x7f83c0109870 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83c7000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01144b0 con 0x7f83c0108f20 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83bfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c01045f0 0x7f83c019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83bfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c01045f0 0x7f83c019cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40652/0 (socket says 172.21.15.120:40652) 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83bfe00700 1 -- 172.21.15.120:0/2853337189 learned_addr learned my addr 172.21.15.120:0/2853337189 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.252+0000 7f83bf400700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c0108f20 0x7f83c019d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bfe00700 1 -- 172.21.15.120:0/2853337189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c0108f20 msgr2=0x7f83c019d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83c5000700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83c0109870 0x7f83c01a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bfe00700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c0108f20 0x7f83c019d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bfe00700 1 -- 172.21.15.120:0/2853337189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83c0109870 msgr2=0x7f83c01a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bfe00700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83c0109870 0x7f83c01a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bfe00700 1 -- 172.21.15.120:0/2853337189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c01a1e50 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bf400700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c0108f20 0x7f83c019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bfe00700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c01045f0 0x7f83c019cf80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83b000d950 tx=0x7f83b000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0016070 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83b0010460 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c01a2140 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b000f620 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.253+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c01a9a60 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.254+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83c0076d10 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.257+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f83b0019070 con 0x7f83c01045f0 2024-05-14T09:20:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.258+0000 7f83bcc00700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83a40b2910 0x7f83a40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.259+0000 7f83bf400700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83a40b2910 0x7f83a40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.259+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f83b00e28d0 con 0x7f83c01045f0 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.259+0000 7f83bcc00700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] conn(0x7f83a40bdbe0 0x7f83a40c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.259+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 --> [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83a40c0780 con 0x7f83a40bdbe0 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.259+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f83b00e2c80 con 0x7f83c01045f0 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.259+0000 7f83c5000700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] conn(0x7f83a40bdbe0 0x7f83a40c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.260+0000 7f83bf400700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83a40b2910 0x7f83a40b4e20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.260+0000 7f83c5000700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] conn(0x7f83a40bdbe0 0x7f83a40c00b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.261+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== osd.9 v2:172.21.15.120:6826/1052033755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83a40c0780 con 0x7f83a40bdbe0 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.279+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 --> [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83c0105aa0 con 0x7f83a40bdbe0 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.279+0000 7f83bcc00700 1 -- 172.21.15.120:0/2853337189 <== osd.9 v2:172.21.15.120:6826/1052033755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f83c0105aa0 con 0x7f83a40bdbe0 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.279+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] conn(0x7f83a40bdbe0 msgr2=0x7f83a40c00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.279+0000 7f83c7000700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] conn(0x7f83a40bdbe0 0x7f83a40c00b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83a40b2910 msgr2=0x7f83a40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83a40b2910 0x7f83a40b4e20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac005fb0 comp rx=0 tx=0).stop 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c01045f0 msgr2=0x7f83c019cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 --2- 172.21.15.120:0/2853337189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83c01045f0 0x7f83c019cf80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83b000d950 tx=0x7f83b000dd10 comp rx=0 tx=0).stop 2024-05-14T09:20:52.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c5000700 1 -- 172.21.15.120:0/2853337189 reap_dead start 2024-05-14T09:20:52.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 shutdown_connections 2024-05-14T09:20:52.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 >> 172.21.15.120:0/2853337189 conn(0x7f83c0100040 msgr2=0x7f83c010a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:52.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 shutdown_connections 2024-05-14T09:20:52.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:49.280+0000 7f83c7000700 1 -- 172.21.15.120:0/2853337189 wait complete. 2024-05-14T09:20:53.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.095+0000 7fcc19c00700 1 -- 172.21.15.120:0/2112618642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14108f20 msgr2=0x7fcc14109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.095+0000 7fcc19c00700 1 --2- 172.21.15.120:0/2112618642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14108f20 0x7fcc14109330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc000099c0 tx=0x7fcc00009cd0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.096+0000 7fcc19c00700 1 -- 172.21.15.120:0/2112618642 shutdown_connections 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.096+0000 7fcc19c00700 1 --2- 172.21.15.120:0/2112618642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc14109870 0x7fcc141111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.096+0000 7fcc19c00700 1 --2- 172.21.15.120:0/2112618642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc141045f0 0x7fcc14104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.096+0000 7fcc19c00700 1 --2- 172.21.15.120:0/2112618642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14108f20 0x7fcc14109330 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.096+0000 7fcc19c00700 1 -- 172.21.15.120:0/2112618642 >> 172.21.15.120:0/2112618642 conn(0x7fcc14100040 msgr2=0x7fcc14102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.096+0000 7fcc19c00700 1 -- 172.21.15.120:0/2112618642 shutdown_connections 2024-05-14T09:20:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.096+0000 7fcc19c00700 1 -- 172.21.15.120:0/2112618642 wait complete. 2024-05-14T09:20:53.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.097+0000 7fcc19c00700 1 Processor -- start 2024-05-14T09:20:53.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.097+0000 7fcc19c00700 1 -- start start 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc19c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc141045f0 0x7fcc14075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc19c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc14108f20 0x7fcc14076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc19c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14109870 0x7fcc14076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc19c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc14114330 con 0x7fcc14109870 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc19c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcc141141b0 con 0x7fcc141045f0 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc19c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc141144b0 con 0x7fcc14108f20 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc13400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14109870 0x7fcc14076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc13400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14109870 0x7fcc14076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40678/0 (socket says 172.21.15.120:40678) 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc13400700 1 -- 172.21.15.120:0/279197835 learned_addr learned my addr 172.21.15.120:0/279197835 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc12a00700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc141045f0 0x7fcc14075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.098+0000 7fcc12000700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc14108f20 0x7fcc14076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc13400700 1 -- 172.21.15.120:0/279197835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc14108f20 msgr2=0x7fcc14076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc13400700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc14108f20 0x7fcc14076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc13400700 1 -- 172.21.15.120:0/279197835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc141045f0 msgr2=0x7fcc14075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc13400700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc141045f0 0x7fcc14075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc13400700 1 -- 172.21.15.120:0/279197835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc141a9120 con 0x7fcc14109870 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc12000700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc14108f20 0x7fcc14076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc13400700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14109870 0x7fcc14076540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c007ee0 tx=0x7fcc0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.099+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00dbd0 con 0x7fcc14109870 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.100+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc0c00dd70 con 0x7fcc14109870 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.100+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0058d0 con 0x7fcc14109870 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.100+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc141a9410 con 0x7fcc14109870 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.100+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc141a98d0 con 0x7fcc14109870 2024-05-14T09:20:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.101+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc14063e90 con 0x7fcc14109870 2024-05-14T09:20:53.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.104+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fcc0c01a020 con 0x7fcc14109870 2024-05-14T09:20:53.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.106+0000 7fcc0b400700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbf80b2990 0x7fcbf80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:53.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.107+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fcc0c0e24e0 con 0x7fcc14109870 2024-05-14T09:20:53.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.107+0000 7fcc12a00700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbf80b2990 0x7fcbf80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:53.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.107+0000 7fcc0b400700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] conn(0x7fcbf80bdc50 0x7fcbf80c0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:20:53.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.107+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 --> [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbf80c07f0 con 0x7fcbf80bdc50 2024-05-14T09:20:53.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.107+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fcc0c0e2930 con 0x7fcc14109870 2024-05-14T09:20:53.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.108+0000 7fcc12000700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] conn(0x7fcbf80bdc50 0x7fcbf80c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:20:53.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.108+0000 7fcc12a00700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbf80b2990 0x7fcbf80b4ea0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005950 tx=0x7fcc0400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:53.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.108+0000 7fcc12000700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] conn(0x7fcbf80bdc50 0x7fcbf80c0120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:20:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.110+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== osd.0 v2:172.21.15.120:6802/2428528152 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcbf80c07f0 con 0x7fcbf80bdc50 2024-05-14T09:20:53.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.129+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 --> [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc14064310 con 0x7fcbf80bdc50 2024-05-14T09:20:53.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc0b400700 1 -- 172.21.15.120:0/279197835 <== osd.0 v2:172.21.15.120:6802/2428528152 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc14064310 con 0x7fcbf80bdc50 2024-05-14T09:20:53.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] conn(0x7fcbf80bdc50 msgr2=0x7fcbf80c0120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:53.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc19c00700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] conn(0x7fcbf80bdc50 0x7fcbf80c0120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbf80b2990 msgr2=0x7fcbf80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:53.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc19c00700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcbf80b2990 0x7fcbf80b4ea0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005950 tx=0x7fcc0400b410 comp rx=0 tx=0).stop 2024-05-14T09:20:53.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14109870 msgr2=0x7fcc14076540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:20:53.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc19c00700 1 --2- 172.21.15.120:0/279197835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc14109870 0x7fcc14076540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c007ee0 tx=0x7fcc0c00d3b0 comp rx=0 tx=0).stop 2024-05-14T09:20:53.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc13400700 1 -- 172.21.15.120:0/279197835 reap_dead start 2024-05-14T09:20:53.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.130+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 shutdown_connections 2024-05-14T09:20:53.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.131+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 >> 172.21.15.120:0/279197835 conn(0x7fcc14100040 msgr2=0x7fcc1410a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:20:53.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.131+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 shutdown_connections 2024-05-14T09:20:53.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:20:53.131+0000 7fcc19c00700 1 -- 172.21.15.120:0/279197835 wait complete. 2024-05-14T09:20:53.811 INFO:teuthology.orchestra.run.smithi120.stdout:111669149809 2024-05-14T09:20:53.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-14T09:20:54.313 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:54 smithi120 ceph-mon[31085]: pgmap v476: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-14T09:20:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:54 smithi152 ceph-mon[34868]: pgmap v476: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-14T09:20:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:54 smithi175 ceph-mon[35353]: pgmap v476: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-14T09:20:55.062 INFO:teuthology.orchestra.run.smithi120.stdout:158913790051 2024-05-14T09:20:55.062 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-14T09:20:55.246 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:55 smithi120 ceph-mon[31085]: pgmap v477: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:55.248 INFO:teuthology.orchestra.run.smithi120.stdout:77309411449 2024-05-14T09:20:55.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-14T09:20:55.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:55 smithi152 ceph-mon[34868]: pgmap v477: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:55.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:55 smithi175 ceph-mon[35353]: pgmap v477: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:20:55.583 INFO:teuthology.orchestra.run.smithi120.stdout:34359738504 2024-05-14T09:20:55.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-14T09:20:56.150 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:56.163 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:56.171 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:56.178 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:56.187 INFO:teuthology.orchestra.run.smithi120.stdout:257698037828 2024-05-14T09:20:56.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-14T09:20:56.614 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:56.620 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:20:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:57 smithi120 ceph-mon[31085]: pgmap v478: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:57 smithi152 ceph-mon[34868]: pgmap v478: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:57.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:57 smithi175 ceph-mon[35353]: pgmap v478: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:20:59.509 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:20:59 smithi120 ceph-mon[31085]: pgmap v479: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:20:59.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:20:59 smithi152 ceph-mon[34868]: pgmap v479: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:20:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:20:59 smithi175 ceph-mon[35353]: pgmap v479: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:21:01.556 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:01.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:01 smithi152 ceph-mon[34868]: pgmap v480: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-14T09:21:01.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:01 smithi175 ceph-mon[35353]: pgmap v480: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-14T09:21:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:01.774 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:01 smithi120 ceph-mon[31085]: pgmap v480: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-14T09:21:02.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.706+0000 7f4c12c00700 1 -- 172.21.15.120:0/3817887800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c115370 msgr2=0x7f4c0c117790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:02.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.706+0000 7f4c12c00700 1 --2- 172.21.15.120:0/3817887800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c115370 0x7f4c0c117790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400b0a0 tx=0x7f4c0400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.707+0000 7f4c12c00700 1 -- 172.21.15.120:0/3817887800 shutdown_connections 2024-05-14T09:21:02.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.707+0000 7f4c12c00700 1 --2- 172.21.15.120:0/3817887800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c115370 0x7f4c0c117790 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.707+0000 7f4c12c00700 1 --2- 172.21.15.120:0/3817887800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0c075b60 0x7f4c0c075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.707+0000 7f4c12c00700 1 --2- 172.21.15.120:0/3817887800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c0c0764b0 0x7f4c0c114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.707+0000 7f4c12c00700 1 -- 172.21.15.120:0/3817887800 >> 172.21.15.120:0/3817887800 conn(0x7f4c0c100040 msgr2=0x7f4c0c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.708+0000 7f4c12c00700 1 -- 172.21.15.120:0/3817887800 shutdown_connections 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.708+0000 7f4c12c00700 1 -- 172.21.15.120:0/3817887800 wait complete. 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.709+0000 7f4c12c00700 1 Processor -- start 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.709+0000 7f4c12c00700 1 -- start start 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c12c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c0c075b60 0x7f4c0c1a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c12c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c0764b0 0x7f4c0c1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c12c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0c115370 0x7f4c0c1a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c12c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c11a980 con 0x7f4c0c0764b0 2024-05-14T09:21:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c12c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c11a800 con 0x7f4c0c075b60 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c12c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c11ab00 con 0x7f4c0c115370 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c0b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c0764b0 0x7f4c0c1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c0b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c0764b0 0x7f4c0c1a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39404/0 (socket says 172.21.15.120:39404) 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c0b400700 1 -- 172.21.15.120:0/4105619448 learned_addr learned my addr 172.21.15.120:0/4105619448 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c0be00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c0c075b60 0x7f4c0c1a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c10c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0c115370 0x7f4c0c1a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c0b400700 1 -- 172.21.15.120:0/4105619448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0c115370 msgr2=0x7f4c0c1a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c0b400700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0c115370 0x7f4c0c1a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.710+0000 7f4c0b400700 1 -- 172.21.15.120:0/4105619448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c0c075b60 msgr2=0x7f4c0c1a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.711+0000 7f4c0b400700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c0c075b60 0x7f4c0c1a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.711+0000 7f4c0b400700 1 -- 172.21.15.120:0/4105619448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c1a6110 con 0x7f4c0c0764b0 2024-05-14T09:21:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.711+0000 7f4c0b400700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c0764b0 0x7f4c0c1a1890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800c9b0 tx=0x7f4bf800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.711+0000 7f4c08c00700 1 -- 172.21.15.120:0/4105619448 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8007b00 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.711+0000 7f4c08c00700 1 -- 172.21.15.120:0/4105619448 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bf8007ca0 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.711+0000 7f4c08c00700 1 -- 172.21.15.120:0/4105619448 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8018660 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.711+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c1a6400 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.712+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c1addd0 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.713+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c0512c0 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.717+0000 7f4c08c00700 1 -- 172.21.15.120:0/4105619448 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f4bf800f450 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.718+0000 7f4c08c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4bf00b2990 0x7f4bf00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.719+0000 7f4c08c00700 1 -- 172.21.15.120:0/4105619448 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4bf80e2730 con 0x7f4c0c0764b0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.719+0000 7f4c0be00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4bf00b2990 0x7f4bf00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.720+0000 7f4c0be00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4bf00b2990 0x7f4bf00b4ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc005fd0 tx=0x7f4bfc00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.724+0000 7f4c08c00700 1 -- 172.21.15.120:0/4105619448 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4bf8014030 con 0x7f4c0c0764b0 2024-05-14T09:21:02.785 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:02.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.973+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4c0c1a2650 con 0x7f4c0c0764b0 2024-05-14T09:21:02.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.973+0000 7f4c08c00700 1 -- 172.21.15.120:0/4105619448 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4bf80a9ef0 con 0x7f4c0c0764b0 2024-05-14T09:21:02.973 INFO:teuthology.orchestra.run.smithi120.stdout:137438953580 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4bf00b2990 msgr2=0x7f4bf00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4bf00b2990 0x7f4bf00b4ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc005fd0 tx=0x7f4bfc00a560 comp rx=0 tx=0).stop 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c0764b0 msgr2=0x7f4c0c1a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c0764b0 0x7f4c0c1a1890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800c9b0 tx=0x7f4bf800cd70 comp rx=0 tx=0).stop 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 shutdown_connections 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4bf00b2990 0x7f4bf00b4ea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c0c075b60 0x7f4c0c1a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0c115370 0x7f4c0c1a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 --2- 172.21.15.120:0/4105619448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c0c0764b0 0x7f4c0c1a1890 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 >> 172.21.15.120:0/4105619448 conn(0x7f4c0c100040 msgr2=0x7f4c0c1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 shutdown_connections 2024-05-14T09:21:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:02.977+0000 7f4c12c00700 1 -- 172.21.15.120:0/4105619448 wait complete. 2024-05-14T09:21:03.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:03 smithi152 ceph-mon[34868]: pgmap v481: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T09:21:03.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:03 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4105619448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T09:21:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:03 smithi175 ceph-mon[35353]: pgmap v481: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T09:21:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:03 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4105619448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T09:21:03.814 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:03 smithi120 ceph-mon[31085]: pgmap v481: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T09:21:03.814 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:03 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4105619448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T09:21:05.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:05 smithi152 ceph-mon[34868]: pgmap v482: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-05-14T09:21:05.719 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:05 smithi120 ceph-mon[31085]: pgmap v482: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-05-14T09:21:05.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:05 smithi175 ceph-mon[35353]: pgmap v482: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.633+0000 7f5dfaa00700 1 -- 172.21.15.120:0/888771311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 msgr2=0x7f5df4109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.633+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/888771311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df4109330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5de00099c0 tx=0x7f5de0009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.634+0000 7f5dfaa00700 1 -- 172.21.15.120:0/888771311 shutdown_connections 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.634+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/888771311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df4109870 0x7f5df41111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.634+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/888771311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df41045f0 0x7f5df4104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.634+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/888771311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df4109330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.634+0000 7f5dfaa00700 1 -- 172.21.15.120:0/888771311 >> 172.21.15.120:0/888771311 conn(0x7f5df4100040 msgr2=0x7f5df4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.634+0000 7f5dfaa00700 1 -- 172.21.15.120:0/888771311 shutdown_connections 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.634+0000 7f5dfaa00700 1 -- 172.21.15.120:0/888771311 wait complete. 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 Processor -- start 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 -- start start 2024-05-14T09:21:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df41045f0 0x7f5df419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4109870 0x7f5df419f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5df4114350 con 0x7f5df4108f20 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41141d0 con 0x7f5df41045f0 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.635+0000 7f5dfaa00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41144d0 con 0x7f5df4109870 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df419b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39414/0 (socket says 172.21.15.120:39414) 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 -- 172.21.15.120:0/3422918355 learned_addr learned my addr 172.21.15.120:0/3422918355 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3e00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df41045f0 0x7f5df419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df8a00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4109870 0x7f5df419f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 -- 172.21.15.120:0/3422918355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4109870 msgr2=0x7f5df419f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4109870 0x7f5df419f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 -- 172.21.15.120:0/3422918355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df41045f0 msgr2=0x7f5df419ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df41045f0 0x7f5df419ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df3400700 1 -- 172.21.15.120:0/3422918355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df419fc70 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.636+0000 7f5df8a00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4109870 0x7f5df419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.637+0000 7f5df3400700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df419b340 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5de0006010 tx=0x7f5de00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.637+0000 7f5df0c00700 1 -- 172.21.15.120:0/3422918355 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0027070 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.637+0000 7f5df0c00700 1 -- 172.21.15.120:0/3422918355 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5de0003ff0 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.637+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df419ff00 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.637+0000 7f5df0c00700 1 -- 172.21.15.120:0/3422918355 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0022cd0 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.637+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df41a03e0 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.639+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df40512c0 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.641+0000 7f5df0c00700 1 -- 172.21.15.120:0/3422918355 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f5de002a070 con 0x7f5df4108f20 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.642+0000 7f5df0c00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5dd80b2910 0x7f5dd80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.642+0000 7f5df0c00700 1 -- 172.21.15.120:0/3422918355 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5de00e3510 con 0x7f5df4108f20 2024-05-14T09:21:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.642+0000 7f5df3e00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5dd80b2910 0x7f5dd80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.643+0000 7f5df3e00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5dd80b2910 0x7f5dd80b4e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5de4005950 tx=0x7f5de40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.646+0000 7f5df0c00700 1 -- 172.21.15.120:0/3422918355 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5de0013070 con 0x7f5df4108f20 2024-05-14T09:21:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.886+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5df402e5f0 con 0x7f5df4108f20 2024-05-14T09:21:06.050 INFO:teuthology.orchestra.run.smithi120.stdout:206158430293 2024-05-14T09:21:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.887+0000 7f5df0c00700 1 -- 172.21.15.120:0/3422918355 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5de00aad60 con 0x7f5df4108f20 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.890+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5dd80b2910 msgr2=0x7f5dd80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.890+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5dd80b2910 0x7f5dd80b4e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5de4005950 tx=0x7f5de40058e0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.890+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 msgr2=0x7f5df419b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.890+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df419b340 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5de0006010 tx=0x7f5de00047b0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 shutdown_connections 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5dd80b2910 0x7f5dd80b4e20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df41045f0 0x7f5df419ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4109870 0x7f5df419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 --2- 172.21.15.120:0/3422918355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5df4108f20 0x7f5df419b340 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 >> 172.21.15.120:0/3422918355 conn(0x7f5df4100040 msgr2=0x7f5df410a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 shutdown_connections 2024-05-14T09:21:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:05.891+0000 7f5dfaa00700 1 -- 172.21.15.120:0/3422918355 wait complete. 2024-05-14T09:21:06.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:06 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3422918355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T09:21:06.709 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:06 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3422918355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T09:21:06.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:06 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3422918355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T09:21:07.187 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953574 got 137438953580 for osd.4 2024-05-14T09:21:07.187 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:07 smithi120 ceph-mon[31085]: pgmap v483: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:07.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:07 smithi175 ceph-mon[35353]: pgmap v483: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:07 smithi152 ceph-mon[34868]: pgmap v483: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:09.497 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:09 smithi120 ceph-mon[31085]: pgmap v484: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:09.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:09 smithi175 ceph-mon[35353]: pgmap v484: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:09 smithi152 ceph-mon[34868]: pgmap v484: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:10.686 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:21:10.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:21:10.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:21:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:11 smithi120 ceph-mon[31085]: pgmap v485: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:11 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3201501475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T09:21:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:11 smithi152 ceph-mon[34868]: pgmap v485: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:11 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3201501475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T09:21:11.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.971+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2840391588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1045f0 msgr2=0x7f9fac104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:11.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.971+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2840391588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1045f0 0x7f9fac104a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0099c0 tx=0x7f9f9c009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:11.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.971+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2840391588 shutdown_connections 2024-05-14T09:21:11.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.971+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2840391588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fac109870 0x7f9fac1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:11.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.971+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2840391588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1045f0 0x7f9fac104a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:11.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.972+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2840391588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fac108f20 0x7f9fac109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:11.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.972+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2840391588 >> 172.21.15.120:0/2840391588 conn(0x7f9fac100040 msgr2=0x7f9fac102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:11.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.972+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2840391588 shutdown_connections 2024-05-14T09:21:11.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.972+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2840391588 wait complete. 2024-05-14T09:21:11.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 Processor -- start 2024-05-14T09:21:11.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 -- start start 2024-05-14T09:21:11.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fac1045f0 0x7f9fac19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:11.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fac108f20 0x7f9fac19d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:11.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac109870 0x7f9fac1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac1143c0 con 0x7f9fac109870 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac114240 con 0x7f9fac108f20 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.973+0000 7f9fb1e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac114540 con 0x7f9fac1045f0 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac109870 0x7f9fac1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9faaa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fac1045f0 0x7f9fac19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac109870 0x7f9fac1a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35854/0 (socket says 172.21.15.120:35854) 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 -- 172.21.15.120:0/2074382228 learned_addr learned my addr 172.21.15.120:0/2074382228 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9faa000700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fac108f20 0x7f9fac19d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 -- 172.21.15.120:0/2074382228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fac1045f0 msgr2=0x7f9fac19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fac1045f0 0x7f9fac19cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 -- 172.21.15.120:0/2074382228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fac108f20 msgr2=0x7f9fac19d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fac108f20 0x7f9fac19d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9fab400700 1 -- 172.21.15.120:0/2074382228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fac1a1e80 con 0x7f9fac109870 2024-05-14T09:21:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.974+0000 7f9faaa00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fac1045f0 0x7f9fac19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:21:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.975+0000 7f9fab400700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac109870 0x7f9fac1a17e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4007ee0 tx=0x7f9fa400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:11 smithi175 ceph-mon[35353]: pgmap v485: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:11 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3201501475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T09:21:11.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.976+0000 7f9fb0a00700 1 -- 172.21.15.120:0/2074382228 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004bb0 con 0x7f9fac109870 2024-05-14T09:21:11.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.976+0000 7f9fb0a00700 1 -- 172.21.15.120:0/2074382228 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fa4004d50 con 0x7f9fac109870 2024-05-14T09:21:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.976+0000 7f9fb0a00700 1 -- 172.21.15.120:0/2074382228 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40058b0 con 0x7f9fac109870 2024-05-14T09:21:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.976+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fac1a2170 con 0x7f9fac109870 2024-05-14T09:21:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.976+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fac1a9a90 con 0x7f9fac109870 2024-05-14T09:21:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.978+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fac0512c0 con 0x7f9fac109870 2024-05-14T09:21:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.980+0000 7f9fb0a00700 1 -- 172.21.15.120:0/2074382228 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f9fa401a020 con 0x7f9fac109870 2024-05-14T09:21:11.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.981+0000 7f9fb0a00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9f900b2900 0x7f9f900b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:11.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.981+0000 7f9fb0a00700 1 -- 172.21.15.120:0/2074382228 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9fa40e1c50 con 0x7f9fac109870 2024-05-14T09:21:11.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.982+0000 7f9faaa00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9f900b2900 0x7f9f900b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:11.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.983+0000 7f9faaa00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9f900b2900 0x7f9f900b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0058e0 tx=0x7f9f9c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:11.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.986+0000 7f9fb0a00700 1 -- 172.21.15.120:0/2074382228 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9fa4010070 con 0x7f9fac109870 2024-05-14T09:21:12.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 -- 172.21.15.120:0/1678189852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9668107df0 msgr2=0x7f9668108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 --2- 172.21.15.120:0/1678189852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9668107df0 0x7f9668108200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f96540099c0 tx=0x7f9654009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 -- 172.21.15.120:0/1678189852 shutdown_connections 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 --2- 172.21.15.120:0/1678189852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96681034c0 0x7f96681038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 --2- 172.21.15.120:0/1678189852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9668108740 0x7f96681100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 --2- 172.21.15.120:0/1678189852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9668107df0 0x7f9668108200 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 -- 172.21.15.120:0/1678189852 >> 172.21.15.120:0/1678189852 conn(0x7f96680fedf0 msgr2=0x7f9668101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 -- 172.21.15.120:0/1678189852 shutdown_connections 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.112+0000 7f966f000700 1 -- 172.21.15.120:0/1678189852 wait complete. 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.113+0000 7f966f000700 1 Processor -- start 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.113+0000 7f966f000700 1 -- start start 2024-05-14T09:21:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f966f000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96681034c0 0x7f966819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f966f000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9668107df0 0x7f966819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f966f000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9668108740 0x7f966819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f966f000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9668113250 con 0x7f96681034c0 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f966f000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f96681130d0 con 0x7f9668108740 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f966f000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96681133d0 con 0x7f9668107df0 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f9667e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96681034c0 0x7f966819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f9667e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96681034c0 0x7f966819ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35786/0 (socket says 172.21.15.120:35786) 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.114+0000 7f9667e00700 1 -- 172.21.15.120:0/3201501475 learned_addr learned my addr 172.21.15.120:0/3201501475 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f9667400700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9668107df0 0x7f966819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f966d000700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9668108740 0x7f966819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f9667e00700 1 -- 172.21.15.120:0/3201501475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9668107df0 msgr2=0x7f966819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f9667e00700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9668107df0 0x7f966819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f9667e00700 1 -- 172.21.15.120:0/3201501475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9668108740 msgr2=0x7f966819f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f9667e00700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9668108740 0x7f966819f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f9667e00700 1 -- 172.21.15.120:0/3201501475 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966819fc40 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.115+0000 7f9667e00700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96681034c0 0x7f966819ad70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f965800d950 tx=0x7f965800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.116+0000 7f9664c00700 1 -- 172.21.15.120:0/3201501475 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658016070 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.116+0000 7f9664c00700 1 -- 172.21.15.120:0/3201501475 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9658010460 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.116+0000 7f9664c00700 1 -- 172.21.15.120:0/3201501475 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965800f620 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.116+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966819ff30 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.116+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96681a7850 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.118+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96680512c0 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.121+0000 7f9664c00700 1 -- 172.21.15.120:0/3201501475 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f9658019070 con 0x7f96681034c0 2024-05-14T09:21:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.122+0000 7f9664c00700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f964c0b2a60 0x7f964c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.123+0000 7f9664c00700 1 -- 172.21.15.120:0/3201501475 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f96580e22a0 con 0x7f96681034c0 2024-05-14T09:21:12.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.124+0000 7f9667400700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f964c0b2a60 0x7f964c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:12.139 INFO:teuthology.orchestra.run.smithi120.stdout:304942678074 2024-05-14T09:21:12.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.124+0000 7f9667400700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f964c0b2a60 0x7f964c0b4f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9654009990 tx=0x7f96540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.130+0000 7f9664c00700 1 -- 172.21.15.120:0/3201501475 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f96580a9ae0 con 0x7f96681034c0 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.376+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f966819c0d0 con 0x7f96681034c0 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.378+0000 7f9664c00700 1 -- 172.21.15.120:0/3201501475 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f96580a93e0 con 0x7f96681034c0 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f964c0b2a60 msgr2=0x7f964c0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f964c0b2a60 0x7f964c0b4f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9654009990 tx=0x7f96540058e0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96681034c0 msgr2=0x7f966819ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96681034c0 0x7f966819ad70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f965800d950 tx=0x7f965800dd10 comp rx=0 tx=0).stop 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 shutdown_connections 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f964c0b2a60 0x7f964c0b4f70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9668108740 0x7f966819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96681034c0 0x7f966819ad70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 --2- 172.21.15.120:0/3201501475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9668107df0 0x7f966819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 >> 172.21.15.120:0/3201501475 conn(0x7f96680fedf0 msgr2=0x7f9668075dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 shutdown_connections 2024-05-14T09:21:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.381+0000 7f966f000700 1 -- 172.21.15.120:0/3201501475 wait complete. 2024-05-14T09:21:12.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.212+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9fac1a9c60 con 0x7f9fac109870 2024-05-14T09:21:12.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.213+0000 7f9fb0a00700 1 -- 172.21.15.120:0/2074382228 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9fa40a9570 con 0x7f9fac109870 2024-05-14T09:21:12.213 INFO:teuthology.orchestra.run.smithi120.stdout:184683593822 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9f900b2900 msgr2=0x7f9f900b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9f900b2900 0x7f9f900b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0058e0 tx=0x7f9f9c005fb0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac109870 msgr2=0x7f9fac1a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac109870 0x7f9fac1a17e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4007ee0 tx=0x7f9fa400d3b0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 shutdown_connections 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9f900b2900 0x7f9f900b4e10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac109870 0x7f9fac1a17e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fac1045f0 0x7f9fac19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 --2- 172.21.15.120:0/2074382228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fac108f20 0x7f9fac19d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 >> 172.21.15.120:0/2074382228 conn(0x7f9fac100040 msgr2=0x7f9fac10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 shutdown_connections 2024-05-14T09:21:12.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:12.216+0000 7f9fb1e00700 1 -- 172.21.15.120:0/2074382228 wait complete. 2024-05-14T09:21:12.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.604+0000 7f2c11a00700 1 -- 172.21.15.120:0/2803395771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 msgr2=0x7f2c0c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.604+0000 7f2c11a00700 1 --2- 172.21.15.120:0/2803395771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c104a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0099c0 tx=0x7f2bfc009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.605+0000 7f2c11a00700 1 -- 172.21.15.120:0/2803395771 shutdown_connections 2024-05-14T09:21:12.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.605+0000 7f2c11a00700 1 --2- 172.21.15.120:0/2803395771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c0c109870 0x7f2c0c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.605+0000 7f2c11a00700 1 --2- 172.21.15.120:0/2803395771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c104a00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.605+0000 7f2c11a00700 1 --2- 172.21.15.120:0/2803395771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c0c108f20 0x7f2c0c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.605+0000 7f2c11a00700 1 -- 172.21.15.120:0/2803395771 >> 172.21.15.120:0/2803395771 conn(0x7f2c0c100040 msgr2=0x7f2c0c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.606+0000 7f2c11a00700 1 -- 172.21.15.120:0/2803395771 shutdown_connections 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.606+0000 7f2c11a00700 1 -- 172.21.15.120:0/2803395771 wait complete. 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 Processor -- start 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 -- start start 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c0c108f20 0x7f2c0c19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c0c109870 0x7f2c0c1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1143a0 con 0x7f2c0c1045f0 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c114220 con 0x7f2c0c108f20 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.608+0000 7f2c11a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c114520 con 0x7f2c0c109870 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c19d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35814/0 (socket says 172.21.15.120:35814) 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 -- 172.21.15.120:0/3788917883 learned_addr learned my addr 172.21.15.120:0/3788917883 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:12.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0b400700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c0c109870 0x7f2c0c1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 -- 172.21.15.120:0/3788917883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c0c109870 msgr2=0x7f2c0c1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c0c109870 0x7f2c0c1a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 -- 172.21.15.120:0/3788917883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c0c108f20 msgr2=0x7f2c0c19d5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c0c108f20 0x7f2c0c19d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.609+0000 7f2c0aa00700 1 -- 172.21.15.120:0/3788917883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c1a1f00 con 0x7f2c0c1045f0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.610+0000 7f2c0aa00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c19d030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc000c00 tx=0x7f2bfc00f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.610+0000 7f2c03400700 1 -- 172.21.15.120:0/3788917883 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc027070 con 0x7f2c0c1045f0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.610+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c1a2190 con 0x7f2c0c1045f0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.610+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1a9b10 con 0x7f2c0c1045f0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.611+0000 7f2c03400700 1 -- 172.21.15.120:0/3788917883 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bfc00fda0 con 0x7f2c0c1045f0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.611+0000 7f2c03400700 1 -- 172.21.15.120:0/3788917883 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc022e30 con 0x7f2c0c1045f0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.613+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bec005360 con 0x7f2c0c1045f0 2024-05-14T09:21:12.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.615+0000 7f2c03400700 1 -- 172.21.15.120:0/3788917883 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2bfc02a070 con 0x7f2c0c1045f0 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.617+0000 7f2c03400700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2bf00b2900 0x7f2bf00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.617+0000 7f2c03400700 1 -- 172.21.15.120:0/3788917883 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2bfc0e2fe0 con 0x7f2c0c1045f0 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.617+0000 7f2c0a000700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2bf00b2900 0x7f2bf00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.618+0000 7f2c0a000700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2bf00b2900 0x7f2bf00b4e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c107e20 tx=0x7f2bf800b3f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.625+0000 7f2c03400700 1 -- 172.21.15.120:0/3788917883 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2bfc013070 con 0x7f2c0c1045f0 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.872+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2bec005650 con 0x7f2c0c1045f0 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.873+0000 7f2c03400700 1 -- 172.21.15.120:0/3788917883 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2bfc0aa990 con 0x7f2c0c1045f0 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stdout:55834574979 2024-05-14T09:21:12.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2bf00b2900 msgr2=0x7f2bf00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2bf00b2900 0x7f2bf00b4e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c107e20 tx=0x7f2bf800b3f0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 msgr2=0x7f2c0c19d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c19d030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc000c00 tx=0x7f2bfc00f460 comp rx=0 tx=0).stop 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 shutdown_connections 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2bf00b2900 0x7f2bf00b4e10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c0c109870 0x7f2c0c1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c0c1045f0 0x7f2c0c19d030 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 --2- 172.21.15.120:0/3788917883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c0c108f20 0x7f2c0c19d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.875+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 >> 172.21.15.120:0/3788917883 conn(0x7f2c0c100040 msgr2=0x7f2c0c10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.876+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 shutdown_connections 2024-05-14T09:21:12.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.876+0000 7f2c11a00700 1 -- 172.21.15.120:0/3788917883 wait complete. 2024-05-14T09:21:12.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:12 smithi120 ceph-mon[31085]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-14T09:21:12.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:21:12.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:21:12.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:21:12.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:12 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3788917883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T09:21:12.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:12 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2695419612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T09:21:12.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:12 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2074382228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T09:21:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:12 smithi152 ceph-mon[34868]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-14T09:21:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:21:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:21:12.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:21:12.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:12 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3788917883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T09:21:12.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:12 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2695419612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T09:21:12.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:12 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2074382228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T09:21:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:12 smithi175 ceph-mon[35353]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-14T09:21:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:21:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:21:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:21:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:12 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3788917883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T09:21:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:12 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2695419612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T09:21:12.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:12 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2074382228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T09:21:13.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.091+0000 7f2159a00700 1 -- 172.21.15.120:0/3662264280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 msgr2=0x7f2154109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.091+0000 7f2159a00700 1 --2- 172.21.15.120:0/3662264280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f2154109140 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f213c0099c0 tx=0x7f213c009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.092+0000 7f2159a00700 1 -- 172.21.15.120:0/3662264280 shutdown_connections 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.092+0000 7f2159a00700 1 --2- 172.21.15.120:0/3662264280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2154109680 0x7f2154110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.092+0000 7f2159a00700 1 --2- 172.21.15.120:0/3662264280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2154104400 0x7f2154104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.092+0000 7f2159a00700 1 --2- 172.21.15.120:0/3662264280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f2154109140 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.092+0000 7f2159a00700 1 -- 172.21.15.120:0/3662264280 >> 172.21.15.120:0/3662264280 conn(0x7f2154079d10 msgr2=0x7f215407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.092+0000 7f2159a00700 1 -- 172.21.15.120:0/3662264280 shutdown_connections 2024-05-14T09:21:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.092+0000 7f2159a00700 1 -- 172.21.15.120:0/3662264280 wait complete. 2024-05-14T09:21:13.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.093+0000 7f2159a00700 1 Processor -- start 2024-05-14T09:21:13.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.093+0000 7f2159a00700 1 -- start start 2024-05-14T09:21:13.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f2159a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2154104400 0x7f21541a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f2159a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f21541a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f2159a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2154109680 0x7f215419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f2159a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2154114190 con 0x7f2154108d30 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f2159a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2154114010 con 0x7f2154109680 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f2159a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2154114310 con 0x7f2154104400 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f214b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f21541a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f214b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f21541a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35868/0 (socket says 172.21.15.120:35868) 2024-05-14T09:21:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.094+0000 7f214b400700 1 -- 172.21.15.120:0/4264785317 learned_addr learned my addr 172.21.15.120:0/4264785317 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:13.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f2153e00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2154104400 0x7f21541a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:13.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f2159000700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2154109680 0x7f215419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:13.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f214b400700 1 -- 172.21.15.120:0/4264785317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2154104400 msgr2=0x7f21541a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:13.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f214b400700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2154104400 0x7f21541a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f214b400700 1 -- 172.21.15.120:0/4264785317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2154109680 msgr2=0x7f215419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f214b400700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2154109680 0x7f215419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f214b400700 1 -- 172.21.15.120:0/4264785317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215419b140 con 0x7f2154108d30 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f2159000700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2154109680 0x7f215419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.095+0000 7f214b400700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f21541a0df0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f213c0098e0 tx=0x7f213c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.096+0000 7f2151600700 1 -- 172.21.15.120:0/4264785317 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c027070 con 0x7f2154108d30 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.096+0000 7f2151600700 1 -- 172.21.15.120:0/4264785317 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f213c00fbf0 con 0x7f2154108d30 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.096+0000 7f2151600700 1 -- 172.21.15.120:0/4264785317 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c0173f0 con 0x7f2154108d30 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.096+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215419b3d0 con 0x7f2154108d30 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.096+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215419b900 con 0x7f2154108d30 2024-05-14T09:21:13.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.097+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21541058b0 con 0x7f2154108d30 2024-05-14T09:21:13.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.099+0000 7f2151600700 1 -- 172.21.15.120:0/4264785317 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f213c02a070 con 0x7f2154108d30 2024-05-14T09:21:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.101+0000 7f2151600700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f21380b2900 0x7f21380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:13.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.101+0000 7f2151600700 1 -- 172.21.15.120:0/4264785317 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f213c0e3500 con 0x7f2154108d30 2024-05-14T09:21:13.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.101+0000 7f2153e00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f21380b2900 0x7f21380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:13.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.102+0000 7f2153e00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f21380b2900 0x7f21380b4e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2144005ea0 tx=0x7f2144005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:13.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.106+0000 7f2151600700 1 -- 172.21.15.120:0/4264785317 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f215419b900 con 0x7f2154108d30 2024-05-14T09:21:13.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.349+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f215402e5f0 con 0x7f2154108d30 2024-05-14T09:21:13.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.350+0000 7f2151600700 1 -- 172.21.15.120:0/4264785317 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f213c013070 con 0x7f2154108d30 2024-05-14T09:21:13.350 INFO:teuthology.orchestra.run.smithi120.stdout:77309411454 2024-05-14T09:21:13.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f21380b2900 msgr2=0x7f21380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:13.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f21380b2900 0x7f21380b4e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2144005ea0 tx=0x7f2144005e30 comp rx=0 tx=0).stop 2024-05-14T09:21:13.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 msgr2=0x7f21541a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:13.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f21541a0df0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f213c0098e0 tx=0x7f213c00f740 comp rx=0 tx=0).stop 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 shutdown_connections 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f21380b2900 0x7f21380b4e10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2154109680 0x7f215419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2154104400 0x7f21541a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 --2- 172.21.15.120:0/4264785317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154108d30 0x7f21541a0df0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 >> 172.21.15.120:0/4264785317 conn(0x7f2154079d10 msgr2=0x7f2154101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 shutdown_connections 2024-05-14T09:21:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:13.353+0000 7f2159a00700 1 -- 172.21.15.120:0/4264785317 wait complete. 2024-05-14T09:21:13.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:13 smithi120 ceph-mon[31085]: pgmap v486: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T09:21:13.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:13 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4264785317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T09:21:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:13 smithi152 ceph-mon[34868]: pgmap v486: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T09:21:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:13 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4264785317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T09:21:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:13 smithi175 ceph-mon[35353]: pgmap v486: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T09:21:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:13 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4264785317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 -- 172.21.15.120:0/2084071716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc108740 msgr2=0x7f82fc1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 --2- 172.21.15.120:0/2084071716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc108740 0x7f82fc1100a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f82f40099c0 tx=0x7f82f4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 -- 172.21.15.120:0/2084071716 shutdown_connections 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 --2- 172.21.15.120:0/2084071716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc108740 0x7f82fc1100a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 --2- 172.21.15.120:0/2084071716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82fc1034c0 0x7f82fc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 --2- 172.21.15.120:0/2084071716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc107df0 0x7f82fc108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 -- 172.21.15.120:0/2084071716 >> 172.21.15.120:0/2084071716 conn(0x7f82fc0fedc0 msgr2=0x7f82fc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:14.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 -- 172.21.15.120:0/2084071716 shutdown_connections 2024-05-14T09:21:14.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.288+0000 7f8303400700 1 -- 172.21.15.120:0/2084071716 wait complete. 2024-05-14T09:21:14.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 Processor -- start 2024-05-14T09:21:14.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 -- start start 2024-05-14T09:21:14.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc1034c0 0x7f82fc19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc107df0 0x7f82fc19d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82fc108740 0x7f82fc1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc113220 con 0x7f82fc107df0 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc1130a0 con 0x7f82fc1034c0 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.290+0000 7f8303400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc1133a0 con 0x7f82fc108740 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc107df0 0x7f82fc19d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc107df0 0x7f82fc19d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35890/0 (socket says 172.21.15.120:35890) 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 -- 172.21.15.120:0/384227388 learned_addr learned my addr 172.21.15.120:0/384227388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f8300a00700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc1034c0 0x7f82fc19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f8301400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82fc108740 0x7f82fc1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 -- 172.21.15.120:0/384227388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82fc108740 msgr2=0x7f82fc1a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82fc108740 0x7f82fc1a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 -- 172.21.15.120:0/384227388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc1034c0 msgr2=0x7f82fc19cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc1034c0 0x7f82fc19cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f82f3e00700 1 -- 172.21.15.120:0/384227388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82fc1a1e70 con 0x7f82fc107df0 2024-05-14T09:21:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f8301400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82fc108740 0x7f82fc1a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.291+0000 7f8300a00700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc1034c0 0x7f82fc19cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:21:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.292+0000 7f82f3e00700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc107df0 0x7f82fc19d540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f82e400d980 tx=0x7f82e400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.292+0000 7f82fa000700 1 -- 172.21.15.120:0/384227388 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4017070 con 0x7f82fc107df0 2024-05-14T09:21:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.292+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82fc1a2160 con 0x7f82fc107df0 2024-05-14T09:21:14.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.292+0000 7f82fa000700 1 -- 172.21.15.120:0/384227388 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82e4010460 con 0x7f82fc107df0 2024-05-14T09:21:14.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.292+0000 7f82fa000700 1 -- 172.21.15.120:0/384227388 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e400de60 con 0x7f82fc107df0 2024-05-14T09:21:14.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.292+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82fc1a9a80 con 0x7f82fc107df0 2024-05-14T09:21:14.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.294+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82fc0512c0 con 0x7f82fc107df0 2024-05-14T09:21:14.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.296+0000 7f82fa000700 1 -- 172.21.15.120:0/384227388 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f82e4010610 con 0x7f82fc107df0 2024-05-14T09:21:14.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.298+0000 7f82fa000700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82e00b2900 0x7f82e00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:14.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.298+0000 7f82fa000700 1 -- 172.21.15.120:0/384227388 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f82e40e2060 con 0x7f82fc107df0 2024-05-14T09:21:14.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.298+0000 7f8300a00700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82e00b2900 0x7f82e00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:14.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.299+0000 7f8300a00700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82e00b2900 0x7f82e00b4e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009dd0 tx=0x7f82ec009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:14.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.302+0000 7f82fa000700 1 -- 172.21.15.120:0/384227388 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f82e40a9980 con 0x7f82fc107df0 2024-05-14T09:21:14.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.541+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f82fc02e5f0 con 0x7f82fc107df0 2024-05-14T09:21:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.543+0000 7f82fa000700 1 -- 172.21.15.120:0/384227388 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82e40a9280 con 0x7f82fc107df0 2024-05-14T09:21:14.544 INFO:teuthology.orchestra.run.smithi120.stdout:34359738507 2024-05-14T09:21:14.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82e00b2900 msgr2=0x7f82e00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:14.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82e00b2900 0x7f82e00b4e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009dd0 tx=0x7f82ec009040 comp rx=0 tx=0).stop 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc107df0 msgr2=0x7f82fc19d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc107df0 0x7f82fc19d540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f82e400d980 tx=0x7f82e400dd40 comp rx=0 tx=0).stop 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 shutdown_connections 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82e00b2900 0x7f82e00b4e10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc1034c0 0x7f82fc19cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82fc108740 0x7f82fc1a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 --2- 172.21.15.120:0/384227388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82fc107df0 0x7f82fc19d540 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 >> 172.21.15.120:0/384227388 conn(0x7f82fc0fedc0 msgr2=0x7f82fc10ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 shutdown_connections 2024-05-14T09:21:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:14.546+0000 7f8303400700 1 -- 172.21.15.120:0/384227388 wait complete. 2024-05-14T09:21:14.832 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:14 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/384227388' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T09:21:14.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:14 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/384227388' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T09:21:14.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:14 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/384227388' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T09:21:15.728 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678069 got 304942678074 for osd.11 2024-05-14T09:21:15.728 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:15 smithi152 ceph-mon[34868]: pgmap v487: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-14T09:21:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:15 smithi175 ceph-mon[35353]: pgmap v487: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-14T09:21:15.989 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:15 smithi120 ceph-mon[31085]: pgmap v487: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-14T09:21:16.815 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574976 got 55834574979 for osd.1 2024-05-14T09:21:16.815 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.681+0000 7ff549800700 1 -- 172.21.15.120:0/2240865767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 msgr2=0x7ff544117790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.681+0000 7ff549800700 1 --2- 172.21.15.120:0/2240865767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff544117790 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b0a0 tx=0x7ff53c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.681+0000 7ff549800700 1 -- 172.21.15.120:0/2240865767 shutdown_connections 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.681+0000 7ff549800700 1 --2- 172.21.15.120:0/2240865767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff544075b60 0x7ff544075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.682+0000 7ff549800700 1 --2- 172.21.15.120:0/2240865767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff544117790 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.682+0000 7ff549800700 1 --2- 172.21.15.120:0/2240865767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5440764b0 0x7ff544114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.682+0000 7ff549800700 1 -- 172.21.15.120:0/2240865767 >> 172.21.15.120:0/2240865767 conn(0x7ff544100040 msgr2=0x7ff544102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.682+0000 7ff549800700 1 -- 172.21.15.120:0/2240865767 shutdown_connections 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.682+0000 7ff549800700 1 -- 172.21.15.120:0/2240865767 wait complete. 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.683+0000 7ff549800700 1 Processor -- start 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.684+0000 7ff549800700 1 -- start start 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.684+0000 7ff549800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544075b60 0x7ff5441a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.684+0000 7ff549800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5440764b0 0x7ff5441a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.684+0000 7ff549800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff5441a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.684+0000 7ff549800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff54411a980 con 0x7ff544115370 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.684+0000 7ff549800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff54411a800 con 0x7ff5440764b0 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.684+0000 7ff549800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff54411ab00 con 0x7ff544075b60 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff5441a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff5441a5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35904/0 (socket says 172.21.15.120:35904) 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 -- 172.21.15.120:0/3442500662 learned_addr learned my addr 172.21.15.120:0/3442500662 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff542000700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5440764b0 0x7ff5441a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff542a00700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544075b60 0x7ff5441a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 -- 172.21.15.120:0/3442500662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544075b60 msgr2=0x7ff5441a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544075b60 0x7ff5441a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 -- 172.21.15.120:0/3442500662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5440764b0 msgr2=0x7ff5441a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5440764b0 0x7ff5441a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.685+0000 7ff543400700 1 -- 172.21.15.120:0/3442500662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5441a61e0 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.686+0000 7ff543400700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff5441a5b40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b070 tx=0x7ff53c004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.686+0000 7ff53b400700 1 -- 172.21.15.120:0/3442500662 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c021070 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.686+0000 7ff53b400700 1 -- 172.21.15.120:0/3442500662 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff53c007b80 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.686+0000 7ff53b400700 1 -- 172.21.15.120:0/3442500662 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c004770 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.686+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5441a6470 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.686+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441a6950 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.688+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5440512c0 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.692+0000 7ff53b400700 1 -- 172.21.15.120:0/3442500662 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff53c003a00 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.695+0000 7ff53b400700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff5280b2900 0x7ff5280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.695+0000 7ff53b400700 1 -- 172.21.15.120:0/3442500662 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff53c0e36b0 con 0x7ff544115370 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.695+0000 7ff542a00700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff5280b2900 0x7ff5280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.696+0000 7ff542a00700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff5280b2900 0x7ff5280b4e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff534005950 tx=0x7ff5340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:17.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.699+0000 7ff53b400700 1 -- 172.21.15.120:0/3442500662 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff53c0ab0c0 con 0x7ff544115370 2024-05-14T09:21:17.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.943+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff54402e5f0 con 0x7ff544115370 2024-05-14T09:21:17.059 INFO:teuthology.orchestra.run.smithi120.stdout:158913790056 2024-05-14T09:21:17.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.944+0000 7ff53b400700 1 -- 172.21.15.120:0/3442500662 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff53c0aa9c0 con 0x7ff544115370 2024-05-14T09:21:17.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff5280b2900 msgr2=0x7ff5280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff5280b2900 0x7ff5280b4e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff534005950 tx=0x7ff5340058e0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 msgr2=0x7ff5441a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff5441a5b40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b070 tx=0x7ff53c004d50 comp rx=0 tx=0).stop 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 shutdown_connections 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff5280b2900 0x7ff5280b4e10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff544115370 0x7ff5441a5b40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544075b60 0x7ff5441a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 --2- 172.21.15.120:0/3442500662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5440764b0 0x7ff5441a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 >> 172.21.15.120:0/3442500662 conn(0x7ff544100040 msgr2=0x7ff544100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 shutdown_connections 2024-05-14T09:21:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:16.947+0000 7ff549800700 1 -- 172.21.15.120:0/3442500662 wait complete. 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 -- 172.21.15.120:0/4237649925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810f6c0 msgr2=0x7f5ab810fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 --2- 172.21.15.120:0/4237649925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810f6c0 0x7f5ab810fad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009990 tx=0x7f5aac009ca0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 -- 172.21.15.120:0/4237649925 shutdown_connections 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 --2- 172.21.15.120:0/4237649925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab810b110 0x7f5ab8117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 --2- 172.21.15.120:0/4237649925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810f6c0 0x7f5ab810fad0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 --2- 172.21.15.120:0/4237649925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ab810a7c0 0x7f5ab810abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 -- 172.21.15.120:0/4237649925 >> 172.21.15.120:0/4237649925 conn(0x7f5ab8076b00 msgr2=0x7f5ab8076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 -- 172.21.15.120:0/4237649925 shutdown_connections 2024-05-14T09:21:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.108+0000 7f5abe600700 1 -- 172.21.15.120:0/4237649925 wait complete. 2024-05-14T09:21:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.110+0000 7f5abe600700 1 Processor -- start 2024-05-14T09:21:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.110+0000 7f5abe600700 1 -- start start 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.110+0000 7f5abe600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810a7c0 0x7f5ab81a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.110+0000 7f5abe600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ab810b110 0x7f5ab81a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.110+0000 7f5abe600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab810f6c0 0x7f5ab81a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abe600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab811a7b0 con 0x7f5ab810a7c0 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abe600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab811a630 con 0x7f5ab810f6c0 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abe600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab811a930 con 0x7f5ab810b110 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810a7c0 0x7f5ab81a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810a7c0 0x7f5ab81a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35924/0 (socket says 172.21.15.120:35924) 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 -- 172.21.15.120:0/1326554021 learned_addr learned my addr 172.21.15.120:0/1326554021 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abdc00700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab810f6c0 0x7f5ab81a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5ab7e00700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ab810b110 0x7f5ab81a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 -- 172.21.15.120:0/1326554021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ab810b110 msgr2=0x7f5ab81a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ab810b110 0x7f5ab81a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 -- 172.21.15.120:0/1326554021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab810f6c0 msgr2=0x7f5ab81a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab810f6c0 0x7f5ab81a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.111+0000 7f5abd200700 1 -- 172.21.15.120:0/1326554021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab81a5fa0 con 0x7f5ab810a7c0 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.112+0000 7f5abd200700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810a7c0 0x7f5ab81a1180 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5aac000c00 tx=0x7f5aac005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.112+0000 7f5ab5600700 1 -- 172.21.15.120:0/1326554021 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac027070 con 0x7f5ab810a7c0 2024-05-14T09:21:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.112+0000 7f5ab5600700 1 -- 172.21.15.120:0/1326554021 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5aac00fb80 con 0x7f5ab810a7c0 2024-05-14T09:21:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.112+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab81a6230 con 0x7f5ab810a7c0 2024-05-14T09:21:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.112+0000 7f5ab5600700 1 -- 172.21.15.120:0/1326554021 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac022c30 con 0x7f5ab810a7c0 2024-05-14T09:21:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.112+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab81a6760 con 0x7f5ab810a7c0 2024-05-14T09:21:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.113+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab80512c0 con 0x7f5ab810a7c0 2024-05-14T09:21:17.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.117+0000 7f5ab5600700 1 -- 172.21.15.120:0/1326554021 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5aac02a070 con 0x7f5ab810a7c0 2024-05-14T09:21:17.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.119+0000 7f5ab5600700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa00b2900 0x7f5aa00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.119+0000 7f5ab5600700 1 -- 172.21.15.120:0/1326554021 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5aac0e3810 con 0x7f5ab810a7c0 2024-05-14T09:21:17.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.119+0000 7f5ab7e00700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa00b2900 0x7f5aa00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.120+0000 7f5ab7e00700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa00b2900 0x7f5aa00b4e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4005ea0 tx=0x7f5aa4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:17.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.122+0000 7f5ab5600700 1 -- 172.21.15.120:0/1326554021 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5aac05fdf0 con 0x7f5ab810a7c0 2024-05-14T09:21:17.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.357+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5ab802e5f0 con 0x7f5ab810a7c0 2024-05-14T09:21:17.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.358+0000 7f5ab5600700 1 -- 172.21.15.120:0/1326554021 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5aac013070 con 0x7f5ab810a7c0 2024-05-14T09:21:17.359 INFO:teuthology.orchestra.run.smithi120.stdout:111669149814 2024-05-14T09:21:17.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.360+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa00b2900 msgr2=0x7f5aa00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.360+0000 7f5abe600700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa00b2900 0x7f5aa00b4e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4005ea0 tx=0x7f5aa4005e30 comp rx=0 tx=0).stop 2024-05-14T09:21:17.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.360+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810a7c0 msgr2=0x7f5ab81a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.360+0000 7f5abe600700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810a7c0 0x7f5ab81a1180 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5aac000c00 tx=0x7f5aac005ef0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 shutdown_connections 2024-05-14T09:21:17.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa00b2900 0x7f5aa00b4e10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab810f6c0 0x7f5ab81a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab810a7c0 0x7f5ab81a1180 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 --2- 172.21.15.120:0/1326554021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ab810b110 0x7f5ab81a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 >> 172.21.15.120:0/1326554021 conn(0x7f5ab8076b00 msgr2=0x7f5ab81088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:17.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 shutdown_connections 2024-05-14T09:21:17.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:17.361+0000 7f5abe600700 1 -- 172.21.15.120:0/1326554021 wait complete. 2024-05-14T09:21:17.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 -- 172.21.15.120:0/465769173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 msgr2=0x7f4138102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 --2- 172.21.15.120:0/465769173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f4138102bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4124009990 tx=0x7f4124009ca0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 -- 172.21.15.120:0/465769173 shutdown_connections 2024-05-14T09:21:17.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 --2- 172.21.15.120:0/465769173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413810a3e0 0x7f413810a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 --2- 172.21.15.120:0/465769173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4138103130 0x7f4138111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 --2- 172.21.15.120:0/465769173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f4138102bf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 -- 172.21.15.120:0/465769173 >> 172.21.15.120:0/465769173 conn(0x7f41380fe6f0 msgr2=0x7f4138100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 -- 172.21.15.120:0/465769173 shutdown_connections 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.726+0000 7f413fa00700 1 -- 172.21.15.120:0/465769173 wait complete. 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.727+0000 7f413fa00700 1 Processor -- start 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.727+0000 7f413fa00700 1 -- start start 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413fa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f413819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413fa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4138103130 0x7f413819d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413fa00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413810a3e0 0x7f41381a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413fa00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4138114310 con 0x7f41381027e0 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413fa00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4138114190 con 0x7f413810a3e0 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413fa00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4138114490 con 0x7f4138103130 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413d000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f413819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413d000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f413819cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35826/0 (socket says 172.21.15.120:35826) 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.728+0000 7f413d000700 1 -- 172.21.15.120:0/2695419612 learned_addr learned my addr 172.21.15.120:0/2695419612 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f4137e00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4138103130 0x7f413819d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413da00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413810a3e0 0x7f41381a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413d000700 1 -- 172.21.15.120:0/2695419612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4138103130 msgr2=0x7f413819d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413d000700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4138103130 0x7f413819d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413d000700 1 -- 172.21.15.120:0/2695419612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413810a3e0 msgr2=0x7f41381a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413d000700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413810a3e0 0x7f41381a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413d000700 1 -- 172.21.15.120:0/2695419612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41381a1d80 con 0x7f41381027e0 2024-05-14T09:21:17.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f4137e00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4138103130 0x7f413819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:17.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413da00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413810a3e0 0x7f41381a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:17.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.729+0000 7f413d000700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f413819cf60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f412c00c9b0 tx=0x7f412c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:17.384 INFO:teuthology.orchestra.run.smithi120.stdout:231928234064 2024-05-14T09:21:17.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.730+0000 7f4135600700 1 -- 172.21.15.120:0/2695419612 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c007b00 con 0x7f41381027e0 2024-05-14T09:21:17.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.730+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41381a2070 con 0x7f41381027e0 2024-05-14T09:21:17.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.730+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41381a9a40 con 0x7f41381027e0 2024-05-14T09:21:17.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.730+0000 7f4135600700 1 -- 172.21.15.120:0/2695419612 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f412c007ca0 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.731+0000 7f4135600700 1 -- 172.21.15.120:0/2695419612 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c018660 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.734+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4118005330 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.735+0000 7f4135600700 1 -- 172.21.15.120:0/2695419612 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f412c0188c0 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.737+0000 7f4135600700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f41200b2880 0x7f41200b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.739+0000 7f4135600700 1 -- 172.21.15.120:0/2695419612 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f412c0e2510 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.741+0000 7f4137e00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f41200b2880 0x7f41200b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.742+0000 7f4137e00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f41200b2880 0x7f41200b4d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4124000c00 tx=0x7f4124005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.745+0000 7f4135600700 1 -- 172.21.15.120:0/2695419612 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f412c014030 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.988+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f4118005620 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.988+0000 7f4135600700 1 -- 172.21.15.120:0/2695419612 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f412c0a9e90 con 0x7f41381027e0 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f41200b2880 msgr2=0x7f41200b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f41200b2880 0x7f41200b4d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4124000c00 tx=0x7f4124005fb0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 msgr2=0x7f413819cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:17.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f413819cf60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f412c00c9b0 tx=0x7f412c00cd70 comp rx=0 tx=0).stop 2024-05-14T09:21:17.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 shutdown_connections 2024-05-14T09:21:17.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f41200b2880 0x7f41200b4d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413810a3e0 0x7f41381a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41381027e0 0x7f413819cf60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 --2- 172.21.15.120:0/2695419612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4138103130 0x7f413819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:17.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.990+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 >> 172.21.15.120:0/2695419612 conn(0x7f41380fe6f0 msgr2=0x7f41381038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:17.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.991+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 shutdown_connections 2024-05-14T09:21:17.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:11.991+0000 7f413fa00700 1 -- 172.21.15.120:0/2695419612 wait complete. 2024-05-14T09:21:17.653 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593817 got 184683593822 for osd.6 2024-05-14T09:21:17.653 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:17.946 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:17 smithi120 ceph-mon[31085]: pgmap v488: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T09:21:17.946 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:17 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3442500662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T09:21:17.946 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:17 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1326554021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T09:21:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:17 smithi152 ceph-mon[34868]: pgmap v488: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T09:21:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:17 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3442500662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T09:21:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:17 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1326554021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T09:21:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:17 smithi175 ceph-mon[35353]: pgmap v488: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T09:21:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:17 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3442500662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T09:21:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:17 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1326554021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T09:21:18.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738504 got 34359738507 for osd.0 2024-05-14T09:21:18.375 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:18.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 -- 172.21.15.120:0/267651354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c1054e0 msgr2=0x7faa4c1058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 --2- 172.21.15.120:0/267651354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c1054e0 0x7faa4c1058f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009990 tx=0x7faa3c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 -- 172.21.15.120:0/267651354 shutdown_connections 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 --2- 172.21.15.120:0/267651354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa4c10e910 0x7faa4c110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 --2- 172.21.15.120:0/267651354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c1054e0 0x7faa4c1058f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 --2- 172.21.15.120:0/267651354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c105e30 0x7faa4c10e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 -- 172.21.15.120:0/267651354 >> 172.21.15.120:0/267651354 conn(0x7faa4c0fedc0 msgr2=0x7faa4c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 -- 172.21.15.120:0/267651354 shutdown_connections 2024-05-14T09:21:18.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.739+0000 7faa52200700 1 -- 172.21.15.120:0/267651354 wait complete. 2024-05-14T09:21:18.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.740+0000 7faa52200700 1 Processor -- start 2024-05-14T09:21:18.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.740+0000 7faa52200700 1 -- start start 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa52200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa4c1054e0 0x7faa4c1031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa52200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c105e30 0x7faa4c103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa52200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c10e910 0x7faa4c103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa52200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c114330 con 0x7faa4c105e30 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa52200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1141b0 con 0x7faa4c1054e0 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa52200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1144b0 con 0x7faa4c10e910 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa4aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c105e30 0x7faa4c103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa4aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c105e30 0x7faa4c103710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38014/0 (socket says 172.21.15.120:38014) 2024-05-14T09:21:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.741+0000 7faa4aa00700 1 -- 172.21.15.120:0/2031411880 learned_addr learned my addr 172.21.15.120:0/2031411880 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:18.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4b400700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa4c1054e0 0x7faa4c1031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4be00700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c10e910 0x7faa4c103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4aa00700 1 -- 172.21.15.120:0/2031411880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c10e910 msgr2=0x7faa4c103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4aa00700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c10e910 0x7faa4c103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4aa00700 1 -- 172.21.15.120:0/2031411880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa4c1054e0 msgr2=0x7faa4c1031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4aa00700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa4c1054e0 0x7faa4c1031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4aa00700 1 -- 172.21.15.120:0/2031411880 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c1a90b0 con 0x7faa4c105e30 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4b400700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa4c1054e0 0x7faa4c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.742+0000 7faa4aa00700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c105e30 0x7faa4c103710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d950 tx=0x7faa3800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.743+0000 7faa43e00700 1 -- 172.21.15.120:0/2031411880 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38016070 con 0x7faa4c105e30 2024-05-14T09:21:18.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.743+0000 7faa43e00700 1 -- 172.21.15.120:0/2031411880 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa38010460 con 0x7faa4c105e30 2024-05-14T09:21:18.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.743+0000 7faa43e00700 1 -- 172.21.15.120:0/2031411880 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3800f620 con 0x7faa4c105e30 2024-05-14T09:21:18.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.743+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4c1a93a0 con 0x7faa4c105e30 2024-05-14T09:21:18.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.743+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4c1a9890 con 0x7faa4c105e30 2024-05-14T09:21:18.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.744+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4c0512c0 con 0x7faa4c105e30 2024-05-14T09:21:18.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.748+0000 7faa43e00700 1 -- 172.21.15.120:0/2031411880 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7faa38019070 con 0x7faa4c105e30 2024-05-14T09:21:18.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.751+0000 7faa43e00700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa300b2900 0x7faa300b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:18.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.751+0000 7faa43e00700 1 -- 172.21.15.120:0/2031411880 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7faa380e2730 con 0x7faa4c105e30 2024-05-14T09:21:18.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.751+0000 7faa4b400700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa300b2900 0x7faa300b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:18.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.752+0000 7faa4b400700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa300b2900 0x7faa300b4e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006010 tx=0x7faa3c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:18.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.753+0000 7faa43e00700 1 -- 172.21.15.120:0/2031411880 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faa38020070 con 0x7faa4c105e30 2024-05-14T09:21:18.761 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430287 got 206158430293 for osd.7 2024-05-14T09:21:18.761 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:18.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.993+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7faa4c02e5f0 con 0x7faa4c105e30 2024-05-14T09:21:18.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.993+0000 7faa43e00700 1 -- 172.21.15.120:0/2031411880 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7faa380aa050 con 0x7faa4c105e30 2024-05-14T09:21:18.994 INFO:teuthology.orchestra.run.smithi120.stdout:279172874306 2024-05-14T09:21:18.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa300b2900 msgr2=0x7faa300b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa300b2900 0x7faa300b4e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006010 tx=0x7faa3c00b540 comp rx=0 tx=0).stop 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c105e30 msgr2=0x7faa4c103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c105e30 0x7faa4c103710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d950 tx=0x7faa3800dd10 comp rx=0 tx=0).stop 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 shutdown_connections 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faa300b2900 0x7faa300b4e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa4c1054e0 0x7faa4c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c10e910 0x7faa4c103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 --2- 172.21.15.120:0/2031411880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c105e30 0x7faa4c103710 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.996+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 >> 172.21.15.120:0/2031411880 conn(0x7faa4c0fedc0 msgr2=0x7faa4c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:18.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.997+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 shutdown_connections 2024-05-14T09:21:18.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:18.997+0000 7faa52200700 1 -- 172.21.15.120:0/2031411880 wait complete. 2024-05-14T09:21:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:19.312 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234057 got 231928234064 for osd.8 2024-05-14T09:21:19.312 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:19.815 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:19 smithi120 ceph-mon[31085]: pgmap v489: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T09:21:19.815 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:19 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2031411880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T09:21:19.886 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790051 got 158913790056 for osd.5 2024-05-14T09:21:19.887 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:19 smithi152 ceph-mon[34868]: pgmap v489: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T09:21:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:19 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2031411880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T09:21:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:19 smithi175 ceph-mon[35353]: pgmap v489: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T09:21:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:19 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2031411880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T09:21:20.468 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411449 got 77309411454 for osd.2 2024-05-14T09:21:20.468 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:21.243 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874300 got 279172874306 for osd.10 2024-05-14T09:21:21.244 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:21.845 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:21 smithi120 ceph-mon[31085]: pgmap v490: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-14T09:21:21.902 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149809 got 111669149814 for osd.3 2024-05-14T09:21:21.903 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:21 smithi152 ceph-mon[34868]: pgmap v490: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-14T09:21:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:21 smithi175 ceph-mon[35353]: pgmap v490: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-14T09:21:23.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 -- 172.21.15.120:0/366718546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc109870 msgr2=0x7f4ddc1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:23.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 --2- 172.21.15.120:0/366718546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc109870 0x7f4ddc1111d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400b0d0 tx=0x7f4dd400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:21:23.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 -- 172.21.15.120:0/366718546 shutdown_connections 2024-05-14T09:21:23.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 --2- 172.21.15.120:0/366718546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc109870 0x7f4ddc1111d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:23.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 --2- 172.21.15.120:0/366718546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ddc1045f0 0x7f4ddc104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:23.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 --2- 172.21.15.120:0/366718546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ddc108f20 0x7f4ddc109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:23.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 -- 172.21.15.120:0/366718546 >> 172.21.15.120:0/366718546 conn(0x7f4ddc100040 msgr2=0x7f4ddc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:23.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 -- 172.21.15.120:0/366718546 shutdown_connections 2024-05-14T09:21:23.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.762+0000 7f4de0c00700 1 -- 172.21.15.120:0/366718546 wait complete. 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.763+0000 7f4de0c00700 1 Processor -- start 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.763+0000 7f4de0c00700 1 -- start start 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4de0c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ddc1045f0 0x7f4ddc19ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4de0c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc108f20 0x7f4ddc19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4de0c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ddc109870 0x7f4ddc19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4de0c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc1143a0 con 0x7f4ddc108f20 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4de0c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc114220 con 0x7f4ddc1045f0 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4de0c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc114520 con 0x7f4ddc109870 2024-05-14T09:21:23.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4dd9400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc108f20 0x7f4ddc19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:23.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4dd9400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc108f20 0x7f4ddc19b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38036/0 (socket says 172.21.15.120:38036) 2024-05-14T09:21:23.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.764+0000 7f4dd9400700 1 -- 172.21.15.120:0/3143108780 learned_addr learned my addr 172.21.15.120:0/3143108780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:23.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dda800700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ddc109870 0x7f4ddc19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:23.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9e00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ddc1045f0 0x7f4ddc19ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9400700 1 -- 172.21.15.120:0/3143108780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ddc109870 msgr2=0x7f4ddc19f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9400700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ddc109870 0x7f4ddc19f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9400700 1 -- 172.21.15.120:0/3143108780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ddc1045f0 msgr2=0x7f4ddc19ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9400700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ddc1045f0 0x7f4ddc19ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9400700 1 -- 172.21.15.120:0/3143108780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc19fb90 con 0x7f4ddc108f20 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9e00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ddc1045f0 0x7f4ddc19ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.765+0000 7f4dd9400700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc108f20 0x7f4ddc19b310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800d980 tx=0x7f4dc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:23.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.766+0000 7f4dd2a00700 1 -- 172.21.15.120:0/3143108780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8017070 con 0x7f4ddc108f20 2024-05-14T09:21:23.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.766+0000 7f4dd2a00700 1 -- 172.21.15.120:0/3143108780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dc8009dc0 con 0x7f4ddc108f20 2024-05-14T09:21:23.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.766+0000 7f4dd2a00700 1 -- 172.21.15.120:0/3143108780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800f3c0 con 0x7f4ddc108f20 2024-05-14T09:21:23.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.766+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc19fe80 con 0x7f4ddc108f20 2024-05-14T09:21:23.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.766+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc1a0370 con 0x7f4ddc108f20 2024-05-14T09:21:23.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.767+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ddc0512c0 con 0x7f4ddc108f20 2024-05-14T09:21:23.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.770+0000 7f4dd2a00700 1 -- 172.21.15.120:0/3143108780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4dc8009930 con 0x7f4ddc108f20 2024-05-14T09:21:23.771 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:23 smithi120 ceph-mon[31085]: pgmap v491: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T09:21:23.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.772+0000 7f4dd2a00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4dc00b2880 0x7f4dc00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:23.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.773+0000 7f4dd2a00700 1 -- 172.21.15.120:0/3143108780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4dc80e20a0 con 0x7f4ddc108f20 2024-05-14T09:21:23.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.773+0000 7f4dd9e00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4dc00b2880 0x7f4dc00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:23.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.774+0000 7f4dd9e00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4dc00b2880 0x7f4dc00b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc005fd0 tx=0x7f4dcc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:23.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:23.775+0000 7f4dd2a00700 1 -- 172.21.15.120:0/3143108780 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4dc80a99c0 con 0x7f4ddc108f20 2024-05-14T09:21:23.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:23 smithi152 ceph-mon[34868]: pgmap v491: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T09:21:23.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:23 smithi175 ceph-mon[35353]: pgmap v491: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T09:21:24.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.008+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f4ddc02e5f0 con 0x7f4ddc108f20 2024-05-14T09:21:24.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.009+0000 7f4dd2a00700 1 -- 172.21.15.120:0/3143108780 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4dc80a92c0 con 0x7f4ddc108f20 2024-05-14T09:21:24.009 INFO:teuthology.orchestra.run.smithi120.stdout:257698037834 2024-05-14T09:21:24.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4dc00b2880 msgr2=0x7f4dc00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:24.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4dc00b2880 0x7f4dc00b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc005fd0 tx=0x7f4dcc005e30 comp rx=0 tx=0).stop 2024-05-14T09:21:24.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc108f20 msgr2=0x7f4ddc19b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:24.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc108f20 0x7f4ddc19b310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800d980 tx=0x7f4dc800dc90 comp rx=0 tx=0).stop 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 shutdown_connections 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4dc00b2880 0x7f4dc00b4d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ddc1045f0 0x7f4ddc19ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ddc109870 0x7f4ddc19f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 --2- 172.21.15.120:0/3143108780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4ddc108f20 0x7f4ddc19b310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 >> 172.21.15.120:0/3143108780 conn(0x7f4ddc100040 msgr2=0x7f4ddc108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 shutdown_connections 2024-05-14T09:21:24.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:24.012+0000 7f4de0c00700 1 -- 172.21.15.120:0/3143108780 wait complete. 2024-05-14T09:21:24.773 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:24 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3143108780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T09:21:24.851 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037828 got 257698037834 for osd.9 2024-05-14T09:21:24.852 DEBUG:teuthology.parallel:result is None 2024-05-14T09:21:24.852 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-14T09:21:24.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T09:21:24.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:24 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3143108780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T09:21:24.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:24 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3143108780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T09:21:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:25.760 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:25 smithi120 ceph-mon[31085]: pgmap v492: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T09:21:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:25 smithi152 ceph-mon[34868]: pgmap v492: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T09:21:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:25 smithi175 ceph-mon[35353]: pgmap v492: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 -- 172.21.15.120:0/1414854934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328104400 msgr2=0x7f8328104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 --2- 172.21.15.120:0/1414854934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328104400 0x7f8328104810 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f831c0099c0 tx=0x7f831c009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 -- 172.21.15.120:0/1414854934 shutdown_connections 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 --2- 172.21.15.120:0/1414854934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8328109680 0x7f8328110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 --2- 172.21.15.120:0/1414854934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328104400 0x7f8328104810 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 --2- 172.21.15.120:0/1414854934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8328108d30 0x7f8328109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 -- 172.21.15.120:0/1414854934 >> 172.21.15.120:0/1414854934 conn(0x7f8328079d10 msgr2=0x7f832807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 -- 172.21.15.120:0/1414854934 shutdown_connections 2024-05-14T09:21:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.558+0000 7f832e000700 1 -- 172.21.15.120:0/1414854934 wait complete. 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.559+0000 7f832e000700 1 Processor -- start 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.559+0000 7f832e000700 1 -- start start 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832e000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8328104400 0x7f832819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832e000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8328108d30 0x7f832819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328109680 0x7f83281a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832e000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f83281141b0 con 0x7f8328109680 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832e000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8328114030 con 0x7f8328108d30 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832e000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8328114330 con 0x7f8328104400 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832d600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328109680 0x7f83281a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832d600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328109680 0x7f83281a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38054/0 (socket says 172.21.15.120:38054) 2024-05-14T09:21:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832d600700 1 -- 172.21.15.120:0/1617252386 learned_addr learned my addr 172.21.15.120:0/1617252386 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:27.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f832cc00700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8328104400 0x7f832819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:27.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.560+0000 7f8327e00700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8328108d30 0x7f832819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f832d600700 1 -- 172.21.15.120:0/1617252386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8328104400 msgr2=0x7f832819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f832d600700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8328104400 0x7f832819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f832d600700 1 -- 172.21.15.120:0/1617252386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8328108d30 msgr2=0x7f832819d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f832d600700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8328108d30 0x7f832819d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f832d600700 1 -- 172.21.15.120:0/1617252386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83281a1d30 con 0x7f8328109680 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f832d600700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328109680 0x7f83281a1690 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8320007ee0 tx=0x7f832000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f8325600700 1 -- 172.21.15.120:0/1617252386 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832000dbd0 con 0x7f8328109680 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f8325600700 1 -- 172.21.15.120:0/1617252386 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f832000dd70 con 0x7f8328109680 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83281a2020 con 0x7f8328109680 2024-05-14T09:21:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.561+0000 7f8325600700 1 -- 172.21.15.120:0/1617252386 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200058d0 con 0x7f8328109680 2024-05-14T09:21:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.562+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83281a9940 con 0x7f8328109680 2024-05-14T09:21:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.563+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83281058b0 con 0x7f8328109680 2024-05-14T09:21:27.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.565+0000 7f8325600700 1 -- 172.21.15.120:0/1617252386 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f832001a020 con 0x7f8328109680 2024-05-14T09:21:27.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.567+0000 7f8325600700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83100b2880 0x7f83100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:27.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.567+0000 7f8325600700 1 -- 172.21.15.120:0/1617252386 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f83200e23b0 con 0x7f8328109680 2024-05-14T09:21:27.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.567+0000 7f832cc00700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83100b2880 0x7f83100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:27.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.568+0000 7f832cc00700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83100b2880 0x7f83100b4d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f831c000c00 tx=0x7f831c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:27.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.570+0000 7f8325600700 1 -- 172.21.15.120:0/1617252386 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8320010070 con 0x7f8328109680 2024-05-14T09:21:27.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.795+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8328102290 con 0x7f83100b2880 2024-05-14T09:21:27.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.813+0000 7f8325600700 1 -- 172.21.15.120:0/1617252386 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340541 (secure 0 0 0) 0x7f831c07b250 con 0x7f83100b2880 2024-05-14T09:21:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:21:27.821 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:27 smithi120 ceph-mon[31085]: pgmap v493: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T09:21:27.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.821+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83100b2880 msgr2=0x7f83100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:27.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.821+0000 7f832e000700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83100b2880 0x7f83100b4d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f831c000c00 tx=0x7f831c005fb0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.821+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328109680 msgr2=0x7f83281a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.821+0000 7f832e000700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328109680 0x7f83281a1690 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8320007ee0 tx=0x7f832000d3b0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 shutdown_connections 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f83100b2880 0x7f83100b4d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8328109680 0x7f83281a1690 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8328104400 0x7f832819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 --2- 172.21.15.120:0/1617252386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8328108d30 0x7f832819d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 >> 172.21.15.120:0/1617252386 conn(0x7f8328079d10 msgr2=0x7f8328101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 shutdown_connections 2024-05-14T09:21:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:27.822+0000 7f832e000700 1 -- 172.21.15.120:0/1617252386 wait complete. 2024-05-14T09:21:27.824 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-05-14T09:21:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:27 smithi152 ceph-mon[34868]: pgmap v493: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T09:21:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:27 smithi175 ceph-mon[35353]: pgmap v493: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T09:21:28.634 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":493,"stamp":"2024-05-14T09:21:26.373146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667099,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1268,"num_read_kb":748,"num_write":389,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363500,"kb_used_data":14348,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578324,"statfs":{"total":1151940427776,"available":1151568203776,"internally_reserved":0,"allocated":14692352,"data_stored":8193983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":66,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006522"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291216+0000","last_change":"2024-05-14T09:18:02.795124+0000","last_active":"2024-05-14T09:21:10.291216+0000","last_peered":"2024-05-14T09:21:10.291216+0000","last_clean":"2024-05-14T09:21:10.291216+0000","last_became_active":"2024-05-14T09:18:02.794129+0000","last_became_peered":"2024-05-14T09:18:02.794129+0000","last_unstale":"2024-05-14T09:21:10.291216+0000","last_undegraded":"2024-05-14T09:21:10.291216+0000","last_fullsized":"2024-05-14T09:21:10.291216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:54.875120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284580+0000","last_change":"2024-05-14T09:18:02.775506+0000","last_active":"2024-05-14T09:21:10.284580+0000","last_peered":"2024-05-14T09:21:10.284580+0000","last_clean":"2024-05-14T09:21:10.284580+0000","last_became_active":"2024-05-14T09:18:02.774491+0000","last_became_peered":"2024-05-14T09:18:02.774491+0000","last_unstale":"2024-05-14T09:21:10.284580+0000","last_undegraded":"2024-05-14T09:21:10.284580+0000","last_fullsized":"2024-05-14T09:21:10.284580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:36:40.414254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293171+0000","last_change":"2024-05-14T09:18:02.792681+0000","last_active":"2024-05-14T09:21:10.293171+0000","last_peered":"2024-05-14T09:21:10.293171+0000","last_clean":"2024-05-14T09:21:10.293171+0000","last_became_active":"2024-05-14T09:18:02.791903+0000","last_became_peered":"2024-05-14T09:18:02.791903+0000","last_unstale":"2024-05-14T09:21:10.293171+0000","last_undegraded":"2024-05-14T09:21:10.293171+0000","last_fullsized":"2024-05-14T09:21:10.293171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:09:31.027641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271675+0000","last_change":"2024-05-14T09:18:41.667606+0000","last_active":"2024-05-14T09:21:10.271675+0000","last_peered":"2024-05-14T09:21:10.271675+0000","last_clean":"2024-05-14T09:21:10.271675+0000","last_became_active":"2024-05-14T09:18:41.666853+0000","last_became_peered":"2024-05-14T09:18:41.666853+0000","last_unstale":"2024-05-14T09:21:10.271675+0000","last_undegraded":"2024-05-14T09:21:10.271675+0000","last_fullsized":"2024-05-14T09:21:10.271675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:13:40.719553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280567+0000","last_change":"2024-05-14T09:18:02.775383+0000","last_active":"2024-05-14T09:21:10.280567+0000","last_peered":"2024-05-14T09:21:10.280567+0000","last_clean":"2024-05-14T09:21:10.280567+0000","last_became_active":"2024-05-14T09:18:02.774694+0000","last_became_peered":"2024-05-14T09:18:02.774694+0000","last_unstale":"2024-05-14T09:21:10.280567+0000","last_undegraded":"2024-05-14T09:21:10.280567+0000","last_fullsized":"2024-05-14T09:21:10.280567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:47.289929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.276436+0000","last_change":"2024-05-14T09:18:02.782178+0000","last_active":"2024-05-14T09:21:10.276436+0000","last_peered":"2024-05-14T09:21:10.276436+0000","last_clean":"2024-05-14T09:21:10.276436+0000","last_became_active":"2024-05-14T09:18:02.781714+0000","last_became_peered":"2024-05-14T09:18:02.781714+0000","last_unstale":"2024-05-14T09:21:10.276436+0000","last_undegraded":"2024-05-14T09:21:10.276436+0000","last_fullsized":"2024-05-14T09:21:10.276436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:43:02.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262651+0000","last_change":"2024-05-14T09:18:02.774434+0000","last_active":"2024-05-14T09:21:10.262651+0000","last_peered":"2024-05-14T09:21:10.262651+0000","last_clean":"2024-05-14T09:21:10.262651+0000","last_became_active":"2024-05-14T09:18:02.774054+0000","last_became_peered":"2024-05-14T09:18:02.774054+0000","last_unstale":"2024-05-14T09:21:10.262651+0000","last_undegraded":"2024-05-14T09:21:10.262651+0000","last_fullsized":"2024-05-14T09:21:10.262651+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:10.640939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279174+0000","last_change":"2024-05-14T09:18:02.780444+0000","last_active":"2024-05-14T09:21:10.279174+0000","last_peered":"2024-05-14T09:21:10.279174+0000","last_clean":"2024-05-14T09:21:10.279174+0000","last_became_active":"2024-05-14T09:18:02.779992+0000","last_became_peered":"2024-05-14T09:18:02.779992+0000","last_unstale":"2024-05-14T09:21:10.279174+0000","last_undegraded":"2024-05-14T09:21:10.279174+0000","last_fullsized":"2024-05-14T09:21:10.279174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:32:14.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286832+0000","last_change":"2024-05-14T09:18:02.790247+0000","last_active":"2024-05-14T09:21:10.286832+0000","last_peered":"2024-05-14T09:21:10.286832+0000","last_clean":"2024-05-14T09:21:10.286832+0000","last_became_active":"2024-05-14T09:18:02.789293+0000","last_became_peered":"2024-05-14T09:18:02.789293+0000","last_unstale":"2024-05-14T09:21:10.286832+0000","last_undegraded":"2024-05-14T09:21:10.286832+0000","last_fullsized":"2024-05-14T09:21:10.286832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:01.939326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.285657+0000","last_change":"2024-05-14T09:18:02.785167+0000","last_active":"2024-05-14T09:21:10.285657+0000","last_peered":"2024-05-14T09:21:10.285657+0000","last_clean":"2024-05-14T09:21:10.285657+0000","last_became_active":"2024-05-14T09:18:02.784772+0000","last_became_peered":"2024-05-14T09:18:02.784772+0000","last_unstale":"2024-05-14T09:21:10.285657+0000","last_undegraded":"2024-05-14T09:21:10.285657+0000","last_fullsized":"2024-05-14T09:21:10.285657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:06.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290977+0000","last_change":"2024-05-14T09:18:02.793000+0000","last_active":"2024-05-14T09:21:10.290977+0000","last_peered":"2024-05-14T09:21:10.290977+0000","last_clean":"2024-05-14T09:21:10.290977+0000","last_became_active":"2024-05-14T09:18:02.791895+0000","last_became_peered":"2024-05-14T09:18:02.791895+0000","last_unstale":"2024-05-14T09:21:10.290977+0000","last_undegraded":"2024-05-14T09:21:10.290977+0000","last_fullsized":"2024-05-14T09:21:10.290977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:17.313383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279161+0000","last_change":"2024-05-14T09:18:02.776309+0000","last_active":"2024-05-14T09:21:10.279161+0000","last_peered":"2024-05-14T09:21:10.279161+0000","last_clean":"2024-05-14T09:21:10.279161+0000","last_became_active":"2024-05-14T09:18:02.769218+0000","last_became_peered":"2024-05-14T09:18:02.769218+0000","last_unstale":"2024-05-14T09:21:10.279161+0000","last_undegraded":"2024-05-14T09:21:10.279161+0000","last_fullsized":"2024-05-14T09:21:10.279161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:54.793852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.288047+0000","last_change":"2024-05-14T09:18:41.667109+0000","last_active":"2024-05-14T09:21:10.288047+0000","last_peered":"2024-05-14T09:21:10.288047+0000","last_clean":"2024-05-14T09:21:10.288047+0000","last_became_active":"2024-05-14T09:18:41.666437+0000","last_became_peered":"2024-05-14T09:18:41.666437+0000","last_unstale":"2024-05-14T09:21:10.288047+0000","last_undegraded":"2024-05-14T09:21:10.288047+0000","last_fullsized":"2024-05-14T09:21:10.288047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:14.806924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284272+0000","last_change":"2024-05-14T09:18:02.777380+0000","last_active":"2024-05-14T09:21:10.284272+0000","last_peered":"2024-05-14T09:21:10.284272+0000","last_clean":"2024-05-14T09:21:10.284272+0000","last_became_active":"2024-05-14T09:18:02.777035+0000","last_became_peered":"2024-05-14T09:18:02.777035+0000","last_unstale":"2024-05-14T09:21:10.284272+0000","last_undegraded":"2024-05-14T09:21:10.284272+0000","last_fullsized":"2024-05-14T09:21:10.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:56.906077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291464+0000","last_change":"2024-05-14T09:18:02.784577+0000","last_active":"2024-05-14T09:21:10.291464+0000","last_peered":"2024-05-14T09:21:10.291464+0000","last_clean":"2024-05-14T09:21:10.291464+0000","last_became_active":"2024-05-14T09:18:02.784185+0000","last_became_peered":"2024-05-14T09:18:02.784185+0000","last_unstale":"2024-05-14T09:21:10.291464+0000","last_undegraded":"2024-05-14T09:21:10.291464+0000","last_fullsized":"2024-05-14T09:21:10.291464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:44:38.518861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289529+0000","last_change":"2024-05-14T09:18:02.783262+0000","last_active":"2024-05-14T09:21:10.289529+0000","last_peered":"2024-05-14T09:21:10.289529+0000","last_clean":"2024-05-14T09:21:10.289529+0000","last_became_active":"2024-05-14T09:18:02.780405+0000","last_became_peered":"2024-05-14T09:18:02.780405+0000","last_unstale":"2024-05-14T09:21:10.289529+0000","last_undegraded":"2024-05-14T09:21:10.289529+0000","last_fullsized":"2024-05-14T09:21:10.289529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:01:50.437966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291346+0000","last_change":"2024-05-14T09:18:02.789155+0000","last_active":"2024-05-14T09:21:10.291346+0000","last_peered":"2024-05-14T09:21:10.291346+0000","last_clean":"2024-05-14T09:21:10.291346+0000","last_became_active":"2024-05-14T09:18:02.788703+0000","last_became_peered":"2024-05-14T09:18:02.788703+0000","last_unstale":"2024-05-14T09:21:10.291346+0000","last_undegraded":"2024-05-14T09:21:10.291346+0000","last_fullsized":"2024-05-14T09:21:10.291346+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:27:18.593797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293578+0000","last_change":"2024-05-14T09:18:02.788856+0000","last_active":"2024-05-14T09:21:10.293578+0000","last_peered":"2024-05-14T09:21:10.293578+0000","last_clean":"2024-05-14T09:21:10.293578+0000","last_became_active":"2024-05-14T09:18:02.788477+0000","last_became_peered":"2024-05-14T09:18:02.788477+0000","last_unstale":"2024-05-14T09:21:10.293578+0000","last_undegraded":"2024-05-14T09:21:10.293578+0000","last_fullsized":"2024-05-14T09:21:10.293578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:14:09.943568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277936+0000","last_change":"2024-05-14T09:18:02.781087+0000","last_active":"2024-05-14T09:21:10.277936+0000","last_peered":"2024-05-14T09:21:10.277936+0000","last_clean":"2024-05-14T09:21:10.277936+0000","last_became_active":"2024-05-14T09:18:02.780584+0000","last_became_peered":"2024-05-14T09:18:02.780584+0000","last_unstale":"2024-05-14T09:21:10.277936+0000","last_undegraded":"2024-05-14T09:21:10.277936+0000","last_fullsized":"2024-05-14T09:21:10.277936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:02:23.587235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891830+0000","last_change":"2024-05-14T09:19:42.889482+0000","last_active":"2024-05-14T09:19:42.891830+0000","last_peered":"2024-05-14T09:19:42.891830+0000","last_clean":"2024-05-14T09:19:42.891830+0000","last_became_active":"2024-05-14T09:19:42.887316+0000","last_became_peered":"2024-05-14T09:19:42.887316+0000","last_unstale":"2024-05-14T09:19:42.891830+0000","last_undegraded":"2024-05-14T09:19:42.891830+0000","last_fullsized":"2024-05-14T09:19:42.891830+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:13:44.778215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'14","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:21.328611+0000","last_change":"2024-05-14T09:17:57.708207+0000","last_active":"2024-05-14T09:21:21.328611+0000","last_peered":"2024-05-14T09:21:21.328611+0000","last_clean":"2024-05-14T09:21:21.328611+0000","last_became_active":"2024-05-14T09:17:57.707547+0000","last_became_peered":"2024-05-14T09:17:57.707547+0000","last_unstale":"2024-05-14T09:21:21.328611+0000","last_undegraded":"2024-05-14T09:21:21.328611+0000","last_fullsized":"2024-05-14T09:21:21.328611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.378254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.264303+0000","last_change":"2024-05-14T09:18:02.782461+0000","last_active":"2024-05-14T09:21:10.264303+0000","last_peered":"2024-05-14T09:21:10.264303+0000","last_clean":"2024-05-14T09:21:10.264303+0000","last_became_active":"2024-05-14T09:18:02.781014+0000","last_became_peered":"2024-05-14T09:18:02.781014+0000","last_unstale":"2024-05-14T09:21:10.264303+0000","last_undegraded":"2024-05-14T09:21:10.264303+0000","last_fullsized":"2024-05-14T09:21:10.264303+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:21:13.024727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466163+0000","last_change":"2024-05-14T09:18:15.878163+0000","last_active":"2024-05-14T09:19:42.466163+0000","last_peered":"2024-05-14T09:19:42.466163+0000","last_clean":"2024-05-14T09:19:42.466163+0000","last_became_active":"2024-05-14T09:18:15.877097+0000","last_became_peered":"2024-05-14T09:18:15.877097+0000","last_unstale":"2024-05-14T09:19:42.466163+0000","last_undegraded":"2024-05-14T09:19:42.466163+0000","last_fullsized":"2024-05-14T09:19:42.466163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:59.570534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811245+0000","last_change":"2024-05-14T09:17:57.773712+0000","last_active":"2024-05-14T09:19:42.811245+0000","last_peered":"2024-05-14T09:19:42.811245+0000","last_clean":"2024-05-14T09:19:42.811245+0000","last_became_active":"2024-05-14T09:17:57.772849+0000","last_became_peered":"2024-05-14T09:17:57.772849+0000","last_unstale":"2024-05-14T09:19:42.811245+0000","last_undegraded":"2024-05-14T09:19:42.811245+0000","last_fullsized":"2024-05-14T09:19:42.811245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:20.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293116+0000","last_change":"2024-05-14T09:18:02.790490+0000","last_active":"2024-05-14T09:21:10.293116+0000","last_peered":"2024-05-14T09:21:10.293116+0000","last_clean":"2024-05-14T09:21:10.293116+0000","last_became_active":"2024-05-14T09:18:02.790112+0000","last_became_peered":"2024-05-14T09:18:02.790112+0000","last_unstale":"2024-05-14T09:21:10.293116+0000","last_undegraded":"2024-05-14T09:21:10.293116+0000","last_fullsized":"2024-05-14T09:21:10.293116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:15.851585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466989+0000","last_change":"2024-05-14T09:18:15.888894+0000","last_active":"2024-05-14T09:19:42.466989+0000","last_peered":"2024-05-14T09:19:42.466989+0000","last_clean":"2024-05-14T09:19:42.466989+0000","last_became_active":"2024-05-14T09:18:15.888327+0000","last_became_peered":"2024-05-14T09:18:15.888327+0000","last_unstale":"2024-05-14T09:19:42.466989+0000","last_undegraded":"2024-05-14T09:19:42.466989+0000","last_fullsized":"2024-05-14T09:19:42.466989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:13:19.871380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814843+0000","last_change":"2024-05-14T09:17:57.717745+0000","last_active":"2024-05-14T09:19:42.814843+0000","last_peered":"2024-05-14T09:19:42.814843+0000","last_clean":"2024-05-14T09:19:42.814843+0000","last_became_active":"2024-05-14T09:17:57.716822+0000","last_became_peered":"2024-05-14T09:17:57.716822+0000","last_unstale":"2024-05-14T09:19:42.814843+0000","last_undegraded":"2024-05-14T09:19:42.814843+0000","last_fullsized":"2024-05-14T09:19:42.814843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:47:40.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292202+0000","last_change":"2024-05-14T09:18:02.788276+0000","last_active":"2024-05-14T09:21:10.292202+0000","last_peered":"2024-05-14T09:21:10.292202+0000","last_clean":"2024-05-14T09:21:10.292202+0000","last_became_active":"2024-05-14T09:18:02.787446+0000","last_became_peered":"2024-05-14T09:18:02.787446+0000","last_unstale":"2024-05-14T09:21:10.292202+0000","last_undegraded":"2024-05-14T09:21:10.292202+0000","last_fullsized":"2024-05-14T09:21:10.292202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:07:36.574378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466534+0000","last_change":"2024-05-14T09:18:15.887824+0000","last_active":"2024-05-14T09:19:42.466534+0000","last_peered":"2024-05-14T09:19:42.466534+0000","last_clean":"2024-05-14T09:19:42.466534+0000","last_became_active":"2024-05-14T09:18:15.887152+0000","last_became_peered":"2024-05-14T09:18:15.887152+0000","last_unstale":"2024-05-14T09:19:42.466534+0000","last_undegraded":"2024-05-14T09:19:42.466534+0000","last_fullsized":"2024-05-14T09:19:42.466534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:54.778329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814849+0000","last_change":"2024-05-14T09:17:57.717528+0000","last_active":"2024-05-14T09:19:42.814849+0000","last_peered":"2024-05-14T09:19:42.814849+0000","last_clean":"2024-05-14T09:19:42.814849+0000","last_became_active":"2024-05-14T09:17:57.716251+0000","last_became_peered":"2024-05-14T09:17:57.716251+0000","last_unstale":"2024-05-14T09:19:42.814849+0000","last_undegraded":"2024-05-14T09:19:42.814849+0000","last_fullsized":"2024-05-14T09:19:42.814849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:29:08.080292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290450+0000","last_change":"2024-05-14T09:18:02.790132+0000","last_active":"2024-05-14T09:21:10.290450+0000","last_peered":"2024-05-14T09:21:10.290450+0000","last_clean":"2024-05-14T09:21:10.290450+0000","last_became_active":"2024-05-14T09:18:02.789461+0000","last_became_peered":"2024-05-14T09:18:02.789461+0000","last_unstale":"2024-05-14T09:21:10.290450+0000","last_undegraded":"2024-05-14T09:21:10.290450+0000","last_fullsized":"2024-05-14T09:21:10.290450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:36:55.261959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466002+0000","last_change":"2024-05-14T09:18:15.893674+0000","last_active":"2024-05-14T09:19:42.466002+0000","last_peered":"2024-05-14T09:19:42.466002+0000","last_clean":"2024-05-14T09:19:42.466002+0000","last_became_active":"2024-05-14T09:18:15.891857+0000","last_became_peered":"2024-05-14T09:18:15.891857+0000","last_unstale":"2024-05-14T09:19:42.466002+0000","last_undegraded":"2024-05-14T09:19:42.466002+0000","last_fullsized":"2024-05-14T09:19:42.466002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:14:55.020773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":173,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:20.341922+0000","last_change":"2024-05-14T09:18:41.982086+0000","last_active":"2024-05-14T09:21:20.341922+0000","last_peered":"2024-05-14T09:21:20.341922+0000","last_clean":"2024-05-14T09:21:20.341922+0000","last_became_active":"2024-05-14T09:18:41.981103+0000","last_became_peered":"2024-05-14T09:18:41.981103+0000","last_unstale":"2024-05-14T09:21:20.341922+0000","last_undegraded":"2024-05-14T09:21:20.341922+0000","last_fullsized":"2024-05-14T09:21:20.341922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:25:26.896681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.268564+0000","last_change":"2024-05-14T09:18:02.775834+0000","last_active":"2024-05-14T09:21:10.268564+0000","last_peered":"2024-05-14T09:21:10.268564+0000","last_clean":"2024-05-14T09:21:10.268564+0000","last_became_active":"2024-05-14T09:18:02.773708+0000","last_became_peered":"2024-05-14T09:18:02.773708+0000","last_unstale":"2024-05-14T09:21:10.268564+0000","last_undegraded":"2024-05-14T09:21:10.268564+0000","last_fullsized":"2024-05-14T09:21:10.268564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:00.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.900704+0000","last_change":"2024-05-14T09:19:42.899138+0000","last_active":"2024-05-14T09:19:42.900704+0000","last_peered":"2024-05-14T09:19:42.900704+0000","last_clean":"2024-05-14T09:19:42.900704+0000","last_became_active":"2024-05-14T09:19:42.897588+0000","last_became_peered":"2024-05-14T09:19:42.897588+0000","last_unstale":"2024-05-14T09:19:42.900704+0000","last_undegraded":"2024-05-14T09:19:42.900704+0000","last_fullsized":"2024-05-14T09:19:42.900704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:13:05.760525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894483+0000","last_change":"2024-05-14T09:18:42.326203+0000","last_active":"2024-05-14T09:19:42.894483+0000","last_peered":"2024-05-14T09:19:42.894483+0000","last_clean":"2024-05-14T09:19:42.894483+0000","last_became_active":"2024-05-14T09:18:42.324907+0000","last_became_peered":"2024-05-14T09:18:42.324907+0000","last_unstale":"2024-05-14T09:19:42.894483+0000","last_undegraded":"2024-05-14T09:19:42.894483+0000","last_fullsized":"2024-05-14T09:19:42.894483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:50.408706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.273984+0000","last_change":"2024-05-14T09:18:41.669731+0000","last_active":"2024-05-14T09:21:10.273984+0000","last_peered":"2024-05-14T09:21:10.273984+0000","last_clean":"2024-05-14T09:21:10.273984+0000","last_became_active":"2024-05-14T09:18:41.667039+0000","last_became_peered":"2024-05-14T09:18:41.667039+0000","last_unstale":"2024-05-14T09:21:10.273984+0000","last_undegraded":"2024-05-14T09:21:10.273984+0000","last_fullsized":"2024-05-14T09:21:10.273984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:33:30.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891033+0000","last_change":"2024-05-14T09:18:15.894314+0000","last_active":"2024-05-14T09:19:42.891033+0000","last_peered":"2024-05-14T09:19:42.891033+0000","last_clean":"2024-05-14T09:19:42.891033+0000","last_became_active":"2024-05-14T09:18:15.893173+0000","last_became_peered":"2024-05-14T09:18:15.893173+0000","last_unstale":"2024-05-14T09:19:42.891033+0000","last_undegraded":"2024-05-14T09:19:42.891033+0000","last_fullsized":"2024-05-14T09:19:42.891033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:19:25.467141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458591+0000","last_change":"2024-05-14T09:17:57.704612+0000","last_active":"2024-05-14T09:19:42.458591+0000","last_peered":"2024-05-14T09:19:42.458591+0000","last_clean":"2024-05-14T09:19:42.458591+0000","last_became_active":"2024-05-14T09:17:57.703979+0000","last_became_peered":"2024-05-14T09:17:57.703979+0000","last_unstale":"2024-05-14T09:19:42.458591+0000","last_undegraded":"2024-05-14T09:19:42.458591+0000","last_fullsized":"2024-05-14T09:19:42.458591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:08.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280799+0000","last_change":"2024-05-14T09:18:02.774778+0000","last_active":"2024-05-14T09:21:10.280799+0000","last_peered":"2024-05-14T09:21:10.280799+0000","last_clean":"2024-05-14T09:21:10.280799+0000","last_became_active":"2024-05-14T09:18:02.774406+0000","last_became_peered":"2024-05-14T09:18:02.774406+0000","last_unstale":"2024-05-14T09:21:10.280799+0000","last_undegraded":"2024-05-14T09:21:10.280799+0000","last_fullsized":"2024-05-14T09:21:10.280799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.135221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886288+0000","last_change":"2024-05-14T09:18:15.885921+0000","last_active":"2024-05-14T09:19:42.886288+0000","last_peered":"2024-05-14T09:19:42.886288+0000","last_clean":"2024-05-14T09:19:42.886288+0000","last_became_active":"2024-05-14T09:18:15.885261+0000","last_became_peered":"2024-05-14T09:18:15.885261+0000","last_unstale":"2024-05-14T09:19:42.886288+0000","last_undegraded":"2024-05-14T09:19:42.886288+0000","last_fullsized":"2024-05-14T09:19:42.886288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:57.438626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459775+0000","last_change":"2024-05-14T09:17:57.714662+0000","last_active":"2024-05-14T09:19:42.459775+0000","last_peered":"2024-05-14T09:19:42.459775+0000","last_clean":"2024-05-14T09:19:42.459775+0000","last_became_active":"2024-05-14T09:17:57.714086+0000","last_became_peered":"2024-05-14T09:17:57.714086+0000","last_unstale":"2024-05-14T09:19:42.459775+0000","last_undegraded":"2024-05-14T09:19:42.459775+0000","last_fullsized":"2024-05-14T09:19:42.459775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:20.609634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281356+0000","last_change":"2024-05-14T09:18:02.767521+0000","last_active":"2024-05-14T09:21:10.281356+0000","last_peered":"2024-05-14T09:21:10.281356+0000","last_clean":"2024-05-14T09:21:10.281356+0000","last_became_active":"2024-05-14T09:18:02.767035+0000","last_became_peered":"2024-05-14T09:18:02.767035+0000","last_unstale":"2024-05-14T09:21:10.281356+0000","last_undegraded":"2024-05-14T09:21:10.281356+0000","last_fullsized":"2024-05-14T09:21:10.281356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:00:30.251960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810625+0000","last_change":"2024-05-14T09:18:15.890254+0000","last_active":"2024-05-14T09:19:42.810625+0000","last_peered":"2024-05-14T09:19:42.810625+0000","last_clean":"2024-05-14T09:19:42.810625+0000","last_became_active":"2024-05-14T09:18:15.887699+0000","last_became_peered":"2024-05-14T09:18:15.887699+0000","last_unstale":"2024-05-14T09:19:42.810625+0000","last_undegraded":"2024-05-14T09:19:42.810625+0000","last_fullsized":"2024-05-14T09:19:42.810625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:30:39.578671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'6","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:25.353950+0000","last_change":"2024-05-14T09:17:57.712559+0000","last_active":"2024-05-14T09:21:25.353950+0000","last_peered":"2024-05-14T09:21:25.353950+0000","last_clean":"2024-05-14T09:21:25.353950+0000","last_became_active":"2024-05-14T09:17:57.711265+0000","last_became_peered":"2024-05-14T09:17:57.711265+0000","last_unstale":"2024-05-14T09:21:25.353950+0000","last_undegraded":"2024-05-14T09:21:25.353950+0000","last_fullsized":"2024-05-14T09:21:25.353950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:37:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292025+0000","last_change":"2024-05-14T09:18:02.793657+0000","last_active":"2024-05-14T09:21:10.292025+0000","last_peered":"2024-05-14T09:21:10.292025+0000","last_clean":"2024-05-14T09:21:10.292025+0000","last_became_active":"2024-05-14T09:18:02.789550+0000","last_became_peered":"2024-05-14T09:18:02.789550+0000","last_unstale":"2024-05-14T09:21:10.292025+0000","last_undegraded":"2024-05-14T09:21:10.292025+0000","last_fullsized":"2024-05-14T09:21:10.292025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:31.933523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807080+0000","last_change":"2024-05-14T09:18:15.877290+0000","last_active":"2024-05-14T09:19:42.807080+0000","last_peered":"2024-05-14T09:19:42.807080+0000","last_clean":"2024-05-14T09:19:42.807080+0000","last_became_active":"2024-05-14T09:18:15.874522+0000","last_became_peered":"2024-05-14T09:18:15.874522+0000","last_unstale":"2024-05-14T09:19:42.807080+0000","last_undegraded":"2024-05-14T09:19:42.807080+0000","last_fullsized":"2024-05-14T09:19:42.807080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:16.774709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461771+0000","last_change":"2024-05-14T09:17:57.710407+0000","last_active":"2024-05-14T09:19:42.461771+0000","last_peered":"2024-05-14T09:19:42.461771+0000","last_clean":"2024-05-14T09:19:42.461771+0000","last_became_active":"2024-05-14T09:17:57.709776+0000","last_became_peered":"2024-05-14T09:17:57.709776+0000","last_unstale":"2024-05-14T09:19:42.461771+0000","last_undegraded":"2024-05-14T09:19:42.461771+0000","last_fullsized":"2024-05-14T09:19:42.461771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:28:04.838236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290978+0000","last_change":"2024-05-14T09:18:41.664954+0000","last_active":"2024-05-14T09:21:10.290978+0000","last_peered":"2024-05-14T09:21:10.290978+0000","last_clean":"2024-05-14T09:21:10.290978+0000","last_became_active":"2024-05-14T09:18:41.663825+0000","last_became_peered":"2024-05-14T09:18:41.663825+0000","last_unstale":"2024-05-14T09:21:10.290978+0000","last_undegraded":"2024-05-14T09:21:10.290978+0000","last_fullsized":"2024-05-14T09:21:10.290978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:50.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467322+0000","last_change":"2024-05-14T09:18:15.882918+0000","last_active":"2024-05-14T09:19:42.467322+0000","last_peered":"2024-05-14T09:19:42.467322+0000","last_clean":"2024-05-14T09:19:42.467322+0000","last_became_active":"2024-05-14T09:18:15.880220+0000","last_became_peered":"2024-05-14T09:18:15.880220+0000","last_unstale":"2024-05-14T09:19:42.467322+0000","last_undegraded":"2024-05-14T09:19:42.467322+0000","last_fullsized":"2024-05-14T09:19:42.467322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:49.777319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461691+0000","last_change":"2024-05-14T09:17:57.775417+0000","last_active":"2024-05-14T09:19:42.461691+0000","last_peered":"2024-05-14T09:19:42.461691+0000","last_clean":"2024-05-14T09:19:42.461691+0000","last_became_active":"2024-05-14T09:17:57.774362+0000","last_became_peered":"2024-05-14T09:17:57.774362+0000","last_unstale":"2024-05-14T09:19:42.461691+0000","last_undegraded":"2024-05-14T09:19:42.461691+0000","last_fullsized":"2024-05-14T09:19:42.461691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:27.320060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292609+0000","last_change":"2024-05-14T09:18:02.794096+0000","last_active":"2024-05-14T09:21:10.292609+0000","last_peered":"2024-05-14T09:21:10.292609+0000","last_clean":"2024-05-14T09:21:10.292609+0000","last_became_active":"2024-05-14T09:18:02.788361+0000","last_became_peered":"2024-05-14T09:18:02.788361+0000","last_unstale":"2024-05-14T09:21:10.292609+0000","last_undegraded":"2024-05-14T09:21:10.292609+0000","last_fullsized":"2024-05-14T09:21:10.292609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:41.485460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807185+0000","last_change":"2024-05-14T09:18:15.886317+0000","last_active":"2024-05-14T09:19:42.807185+0000","last_peered":"2024-05-14T09:19:42.807185+0000","last_clean":"2024-05-14T09:19:42.807185+0000","last_became_active":"2024-05-14T09:18:15.885903+0000","last_became_peered":"2024-05-14T09:18:15.885903+0000","last_unstale":"2024-05-14T09:19:42.807185+0000","last_undegraded":"2024-05-14T09:19:42.807185+0000","last_fullsized":"2024-05-14T09:19:42.807185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:26:59.892672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":329,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:25.373092+0000","last_change":"2024-05-14T09:17:57.717013+0000","last_active":"2024-05-14T09:21:25.373092+0000","last_peered":"2024-05-14T09:21:25.373092+0000","last_clean":"2024-05-14T09:21:25.373092+0000","last_became_active":"2024-05-14T09:17:57.714552+0000","last_became_peered":"2024-05-14T09:17:57.714552+0000","last_unstale":"2024-05-14T09:21:25.373092+0000","last_undegraded":"2024-05-14T09:21:25.373092+0000","last_fullsized":"2024-05-14T09:21:25.373092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:16.042573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68479,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":244,"num_read_kb":190,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262210+0000","last_change":"2024-05-14T09:18:02.782446+0000","last_active":"2024-05-14T09:21:10.262210+0000","last_peered":"2024-05-14T09:21:10.262210+0000","last_clean":"2024-05-14T09:21:10.262210+0000","last_became_active":"2024-05-14T09:18:02.779998+0000","last_became_peered":"2024-05-14T09:18:02.779998+0000","last_unstale":"2024-05-14T09:21:10.262210+0000","last_undegraded":"2024-05-14T09:21:10.262210+0000","last_fullsized":"2024-05-14T09:21:10.262210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:50.734227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462571+0000","last_change":"2024-05-14T09:18:15.894372+0000","last_active":"2024-05-14T09:19:42.462571+0000","last_peered":"2024-05-14T09:19:42.462571+0000","last_clean":"2024-05-14T09:19:42.462571+0000","last_became_active":"2024-05-14T09:18:15.893842+0000","last_became_peered":"2024-05-14T09:18:15.893842+0000","last_unstale":"2024-05-14T09:19:42.462571+0000","last_undegraded":"2024-05-14T09:19:42.462571+0000","last_fullsized":"2024-05-14T09:19:42.462571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:57.675242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890689+0000","last_change":"2024-05-14T09:18:41.675372+0000","last_active":"2024-05-14T09:19:42.890689+0000","last_peered":"2024-05-14T09:19:42.890689+0000","last_clean":"2024-05-14T09:19:42.890689+0000","last_became_active":"2024-05-14T09:18:41.659107+0000","last_became_peered":"2024-05-14T09:18:41.659107+0000","last_unstale":"2024-05-14T09:19:42.890689+0000","last_undegraded":"2024-05-14T09:19:42.890689+0000","last_fullsized":"2024-05-14T09:19:42.890689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:55:43.567929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280030+0000","last_change":"2024-05-14T09:18:02.780558+0000","last_active":"2024-05-14T09:21:10.280030+0000","last_peered":"2024-05-14T09:21:10.280030+0000","last_clean":"2024-05-14T09:21:10.280030+0000","last_became_active":"2024-05-14T09:18:02.779955+0000","last_became_peered":"2024-05-14T09:18:02.779955+0000","last_unstale":"2024-05-14T09:21:10.280030+0000","last_undegraded":"2024-05-14T09:21:10.280030+0000","last_fullsized":"2024-05-14T09:21:10.280030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:28:59.821879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891138+0000","last_change":"2024-05-14T09:18:15.892207+0000","last_active":"2024-05-14T09:19:42.891138+0000","last_peered":"2024-05-14T09:19:42.891138+0000","last_clean":"2024-05-14T09:19:42.891138+0000","last_became_active":"2024-05-14T09:18:15.891646+0000","last_became_peered":"2024-05-14T09:18:15.891646+0000","last_unstale":"2024-05-14T09:19:42.891138+0000","last_undegraded":"2024-05-14T09:19:42.891138+0000","last_fullsized":"2024-05-14T09:19:42.891138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:06:48.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461245+0000","last_change":"2024-05-14T09:17:57.717130+0000","last_active":"2024-05-14T09:19:42.461245+0000","last_peered":"2024-05-14T09:19:42.461245+0000","last_clean":"2024-05-14T09:19:42.461245+0000","last_became_active":"2024-05-14T09:17:57.716738+0000","last_became_peered":"2024-05-14T09:17:57.716738+0000","last_unstale":"2024-05-14T09:19:42.461245+0000","last_undegraded":"2024-05-14T09:19:42.461245+0000","last_fullsized":"2024-05-14T09:19:42.461245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:20:16.246789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286689+0000","last_change":"2024-05-14T09:18:02.783073+0000","last_active":"2024-05-14T09:21:10.286689+0000","last_peered":"2024-05-14T09:21:10.286689+0000","last_clean":"2024-05-14T09:21:10.286689+0000","last_became_active":"2024-05-14T09:18:02.782657+0000","last_became_peered":"2024-05-14T09:18:02.782657+0000","last_unstale":"2024-05-14T09:21:10.286689+0000","last_undegraded":"2024-05-14T09:21:10.286689+0000","last_fullsized":"2024-05-14T09:21:10.286689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:39:46.649875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.808011+0000","last_change":"2024-05-14T09:18:15.885231+0000","last_active":"2024-05-14T09:19:42.808011+0000","last_peered":"2024-05-14T09:19:42.808011+0000","last_clean":"2024-05-14T09:19:42.808011+0000","last_became_active":"2024-05-14T09:18:15.880199+0000","last_became_peered":"2024-05-14T09:18:15.880199+0000","last_unstale":"2024-05-14T09:19:42.808011+0000","last_undegraded":"2024-05-14T09:19:42.808011+0000","last_fullsized":"2024-05-14T09:19:42.808011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:10:22.707034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:23.345346+0000","last_change":"2024-05-14T09:17:57.718596+0000","last_active":"2024-05-14T09:21:23.345346+0000","last_peered":"2024-05-14T09:21:23.345346+0000","last_clean":"2024-05-14T09:21:23.345346+0000","last_became_active":"2024-05-14T09:17:57.717735+0000","last_became_peered":"2024-05-14T09:17:57.717735+0000","last_unstale":"2024-05-14T09:21:23.345346+0000","last_undegraded":"2024-05-14T09:21:23.345346+0000","last_fullsized":"2024-05-14T09:21:23.345346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:45.110512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.283223+0000","last_change":"2024-05-14T09:18:02.780222+0000","last_active":"2024-05-14T09:21:10.283223+0000","last_peered":"2024-05-14T09:21:10.283223+0000","last_clean":"2024-05-14T09:21:10.283223+0000","last_became_active":"2024-05-14T09:18:02.779842+0000","last_became_peered":"2024-05-14T09:18:02.779842+0000","last_unstale":"2024-05-14T09:21:10.283223+0000","last_undegraded":"2024-05-14T09:21:10.283223+0000","last_fullsized":"2024-05-14T09:21:10.283223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:46.726665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459325+0000","last_change":"2024-05-14T09:18:15.885248+0000","last_active":"2024-05-14T09:19:42.459325+0000","last_peered":"2024-05-14T09:19:42.459325+0000","last_clean":"2024-05-14T09:19:42.459325+0000","last_became_active":"2024-05-14T09:18:15.884675+0000","last_became_peered":"2024-05-14T09:18:15.884675+0000","last_unstale":"2024-05-14T09:19:42.459325+0000","last_undegraded":"2024-05-14T09:19:42.459325+0000","last_fullsized":"2024-05-14T09:19:42.459325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:28:14.278141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890385+0000","last_change":"2024-05-14T09:18:41.687983+0000","last_active":"2024-05-14T09:19:42.890385+0000","last_peered":"2024-05-14T09:19:42.890385+0000","last_clean":"2024-05-14T09:19:42.890385+0000","last_became_active":"2024-05-14T09:18:41.666942+0000","last_became_peered":"2024-05-14T09:18:41.666942+0000","last_unstale":"2024-05-14T09:19:42.890385+0000","last_undegraded":"2024-05-14T09:19:42.890385+0000","last_fullsized":"2024-05-14T09:19:42.890385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:38:24.183297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.287576+0000","last_change":"2024-05-14T09:18:02.788509+0000","last_active":"2024-05-14T09:21:10.287576+0000","last_peered":"2024-05-14T09:21:10.287576+0000","last_clean":"2024-05-14T09:21:10.287576+0000","last_became_active":"2024-05-14T09:18:02.786886+0000","last_became_peered":"2024-05-14T09:18:02.786886+0000","last_unstale":"2024-05-14T09:21:10.287576+0000","last_undegraded":"2024-05-14T09:21:10.287576+0000","last_fullsized":"2024-05-14T09:21:10.287576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:29:38.765565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460028+0000","last_change":"2024-05-14T09:18:15.895299+0000","last_active":"2024-05-14T09:19:42.460028+0000","last_peered":"2024-05-14T09:19:42.460028+0000","last_clean":"2024-05-14T09:19:42.460028+0000","last_became_active":"2024-05-14T09:18:15.893663+0000","last_became_peered":"2024-05-14T09:18:15.893663+0000","last_unstale":"2024-05-14T09:19:42.460028+0000","last_undegraded":"2024-05-14T09:19:42.460028+0000","last_fullsized":"2024-05-14T09:19:42.460028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:58:24.950436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814740+0000","last_change":"2024-05-14T09:17:57.710933+0000","last_active":"2024-05-14T09:19:42.814740+0000","last_peered":"2024-05-14T09:19:42.814740+0000","last_clean":"2024-05-14T09:19:42.814740+0000","last_became_active":"2024-05-14T09:17:57.710255+0000","last_became_peered":"2024-05-14T09:17:57.710255+0000","last_unstale":"2024-05-14T09:19:42.814740+0000","last_undegraded":"2024-05-14T09:19:42.814740+0000","last_fullsized":"2024-05-14T09:19:42.814740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:30.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274588+0000","last_change":"2024-05-14T09:18:02.781494+0000","last_active":"2024-05-14T09:21:10.274588+0000","last_peered":"2024-05-14T09:21:10.274588+0000","last_clean":"2024-05-14T09:21:10.274588+0000","last_became_active":"2024-05-14T09:18:02.781112+0000","last_became_peered":"2024-05-14T09:18:02.781112+0000","last_unstale":"2024-05-14T09:21:10.274588+0000","last_undegraded":"2024-05-14T09:21:10.274588+0000","last_fullsized":"2024-05-14T09:21:10.274588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:27.109538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813533+0000","last_change":"2024-05-14T09:18:16.135447+0000","last_active":"2024-05-14T09:19:42.813533+0000","last_peered":"2024-05-14T09:19:42.813533+0000","last_clean":"2024-05-14T09:19:42.813533+0000","last_became_active":"2024-05-14T09:18:16.133770+0000","last_became_peered":"2024-05-14T09:18:16.133770+0000","last_unstale":"2024-05-14T09:19:42.813533+0000","last_undegraded":"2024-05-14T09:19:42.813533+0000","last_fullsized":"2024-05-14T09:19:42.813533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:29.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807668+0000","last_change":"2024-05-14T09:17:57.776542+0000","last_active":"2024-05-14T09:19:42.807668+0000","last_peered":"2024-05-14T09:19:42.807668+0000","last_clean":"2024-05-14T09:19:42.807668+0000","last_became_active":"2024-05-14T09:17:57.775370+0000","last_became_peered":"2024-05-14T09:17:57.775370+0000","last_unstale":"2024-05-14T09:19:42.807668+0000","last_undegraded":"2024-05-14T09:19:42.807668+0000","last_fullsized":"2024-05-14T09:19:42.807668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:24.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280562+0000","last_change":"2024-05-14T09:18:02.776673+0000","last_active":"2024-05-14T09:21:10.280562+0000","last_peered":"2024-05-14T09:21:10.280562+0000","last_clean":"2024-05-14T09:21:10.280562+0000","last_became_active":"2024-05-14T09:18:02.776243+0000","last_became_peered":"2024-05-14T09:18:02.776243+0000","last_unstale":"2024-05-14T09:21:10.280562+0000","last_undegraded":"2024-05-14T09:21:10.280562+0000","last_fullsized":"2024-05-14T09:21:10.280562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:21.226977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459397+0000","last_change":"2024-05-14T09:18:15.885039+0000","last_active":"2024-05-14T09:19:42.459397+0000","last_peered":"2024-05-14T09:19:42.459397+0000","last_clean":"2024-05-14T09:19:42.459397+0000","last_became_active":"2024-05-14T09:18:15.884466+0000","last_became_peered":"2024-05-14T09:18:15.884466+0000","last_unstale":"2024-05-14T09:19:42.459397+0000","last_undegraded":"2024-05-14T09:19:42.459397+0000","last_fullsized":"2024-05-14T09:19:42.459397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:12.000203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'7","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:20.327049+0000","last_change":"2024-05-14T09:17:57.712259+0000","last_active":"2024-05-14T09:21:20.327049+0000","last_peered":"2024-05-14T09:21:20.327049+0000","last_clean":"2024-05-14T09:21:20.327049+0000","last_became_active":"2024-05-14T09:17:57.711663+0000","last_became_peered":"2024-05-14T09:17:57.711663+0000","last_unstale":"2024-05-14T09:21:20.327049+0000","last_undegraded":"2024-05-14T09:21:20.327049+0000","last_fullsized":"2024-05-14T09:21:20.327049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:40:31.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291464+0000","last_change":"2024-05-14T09:18:02.783586+0000","last_active":"2024-05-14T09:21:10.291464+0000","last_peered":"2024-05-14T09:21:10.291464+0000","last_clean":"2024-05-14T09:21:10.291464+0000","last_became_active":"2024-05-14T09:18:02.783122+0000","last_became_peered":"2024-05-14T09:18:02.783122+0000","last_unstale":"2024-05-14T09:21:10.291464+0000","last_undegraded":"2024-05-14T09:21:10.291464+0000","last_fullsized":"2024-05-14T09:21:10.291464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:32:24.966064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459709+0000","last_change":"2024-05-14T09:18:16.132825+0000","last_active":"2024-05-14T09:19:42.459709+0000","last_peered":"2024-05-14T09:19:42.459709+0000","last_clean":"2024-05-14T09:19:42.459709+0000","last_became_active":"2024-05-14T09:18:16.132155+0000","last_became_peered":"2024-05-14T09:18:16.132155+0000","last_unstale":"2024-05-14T09:19:42.459709+0000","last_undegraded":"2024-05-14T09:19:42.459709+0000","last_fullsized":"2024-05-14T09:19:42.459709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:43.579951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.273937+0000","last_change":"2024-05-14T09:18:02.788407+0000","last_active":"2024-05-14T09:21:10.273937+0000","last_peered":"2024-05-14T09:21:10.273937+0000","last_clean":"2024-05-14T09:21:10.273937+0000","last_became_active":"2024-05-14T09:18:02.785934+0000","last_became_peered":"2024-05-14T09:18:02.785934+0000","last_unstale":"2024-05-14T09:21:10.273937+0000","last_undegraded":"2024-05-14T09:21:10.273937+0000","last_fullsized":"2024-05-14T09:21:10.273937+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:21.337287+0000","last_change":"2024-05-14T09:17:57.781016+0000","last_active":"2024-05-14T09:21:21.337287+0000","last_peered":"2024-05-14T09:21:21.337287+0000","last_clean":"2024-05-14T09:21:21.337287+0000","last_became_active":"2024-05-14T09:17:57.777442+0000","last_became_peered":"2024-05-14T09:17:57.777442+0000","last_unstale":"2024-05-14T09:21:21.337287+0000","last_undegraded":"2024-05-14T09:21:21.337287+0000","last_fullsized":"2024-05-14T09:21:21.337287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:17:06.992053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461149+0000","last_change":"2024-05-14T09:18:15.891299+0000","last_active":"2024-05-14T09:19:42.461149+0000","last_peered":"2024-05-14T09:19:42.461149+0000","last_clean":"2024-05-14T09:19:42.461149+0000","last_became_active":"2024-05-14T09:18:15.890552+0000","last_became_peered":"2024-05-14T09:18:15.890552+0000","last_unstale":"2024-05-14T09:19:42.461149+0000","last_undegraded":"2024-05-14T09:19:42.461149+0000","last_fullsized":"2024-05-14T09:19:42.461149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:03:44.936117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291905+0000","last_change":"2024-05-14T09:18:02.793484+0000","last_active":"2024-05-14T09:21:10.291905+0000","last_peered":"2024-05-14T09:21:10.291905+0000","last_clean":"2024-05-14T09:21:10.291905+0000","last_became_active":"2024-05-14T09:18:02.792888+0000","last_became_peered":"2024-05-14T09:18:02.792888+0000","last_unstale":"2024-05-14T09:21:10.291905+0000","last_undegraded":"2024-05-14T09:21:10.291905+0000","last_fullsized":"2024-05-14T09:21:10.291905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:19.212025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467101+0000","last_change":"2024-05-14T09:17:57.715271+0000","last_active":"2024-05-14T09:19:42.467101+0000","last_peered":"2024-05-14T09:19:42.467101+0000","last_clean":"2024-05-14T09:19:42.467101+0000","last_became_active":"2024-05-14T09:17:57.712524+0000","last_became_peered":"2024-05-14T09:17:57.712524+0000","last_unstale":"2024-05-14T09:19:42.467101+0000","last_undegraded":"2024-05-14T09:19:42.467101+0000","last_fullsized":"2024-05-14T09:19:42.467101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:39:46.868509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":119,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460162+0000","last_change":"2024-05-14T09:16:01.832034+0000","last_active":"2024-05-14T09:19:42.460162+0000","last_peered":"2024-05-14T09:19:42.460162+0000","last_clean":"2024-05-14T09:19:42.460162+0000","last_became_active":"2024-05-14T09:16:01.815331+0000","last_became_peered":"2024-05-14T09:16:01.815331+0000","last_unstale":"2024-05-14T09:19:42.460162+0000","last_undegraded":"2024-05-14T09:19:42.460162+0000","last_fullsized":"2024-05-14T09:19:42.460162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_clean_scrub_stamp":"2024-05-14T09:11:00.916612+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:04:45.123827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461633+0000","last_change":"2024-05-14T09:18:16.136149+0000","last_active":"2024-05-14T09:19:42.461633+0000","last_peered":"2024-05-14T09:19:42.461633+0000","last_clean":"2024-05-14T09:19:42.461633+0000","last_became_active":"2024-05-14T09:18:16.134655+0000","last_became_peered":"2024-05-14T09:18:16.134655+0000","last_unstale":"2024-05-14T09:19:42.461633+0000","last_undegraded":"2024-05-14T09:19:42.461633+0000","last_fullsized":"2024-05-14T09:19:42.461633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:51.879763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274051+0000","last_change":"2024-05-14T09:18:02.791068+0000","last_active":"2024-05-14T09:21:10.274051+0000","last_peered":"2024-05-14T09:21:10.274051+0000","last_clean":"2024-05-14T09:21:10.274051+0000","last_became_active":"2024-05-14T09:18:02.785294+0000","last_became_peered":"2024-05-14T09:18:02.785294+0000","last_unstale":"2024-05-14T09:21:10.274051+0000","last_undegraded":"2024-05-14T09:21:10.274051+0000","last_fullsized":"2024-05-14T09:21:10.274051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:06:25.554475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460448+0000","last_change":"2024-05-14T09:17:57.715272+0000","last_active":"2024-05-14T09:19:42.460448+0000","last_peered":"2024-05-14T09:19:42.460448+0000","last_clean":"2024-05-14T09:19:42.460448+0000","last_became_active":"2024-05-14T09:17:57.713504+0000","last_became_peered":"2024-05-14T09:17:57.713504+0000","last_unstale":"2024-05-14T09:19:42.460448+0000","last_undegraded":"2024-05-14T09:19:42.460448+0000","last_fullsized":"2024-05-14T09:19:42.460448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:27:26.071204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890852+0000","last_change":"2024-05-14T09:18:15.893437+0000","last_active":"2024-05-14T09:19:42.890852+0000","last_peered":"2024-05-14T09:19:42.890852+0000","last_clean":"2024-05-14T09:19:42.890852+0000","last_became_active":"2024-05-14T09:18:15.890908+0000","last_became_peered":"2024-05-14T09:18:15.890908+0000","last_unstale":"2024-05-14T09:19:42.890852+0000","last_undegraded":"2024-05-14T09:19:42.890852+0000","last_fullsized":"2024-05-14T09:19:42.890852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:15.339562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814448+0000","last_change":"2024-05-14T09:17:57.779601+0000","last_active":"2024-05-14T09:19:42.814448+0000","last_peered":"2024-05-14T09:19:42.814448+0000","last_clean":"2024-05-14T09:19:42.814448+0000","last_became_active":"2024-05-14T09:17:57.778730+0000","last_became_peered":"2024-05-14T09:17:57.778730+0000","last_unstale":"2024-05-14T09:19:42.814448+0000","last_undegraded":"2024-05-14T09:19:42.814448+0000","last_fullsized":"2024-05-14T09:19:42.814448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:01:07.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274595+0000","last_change":"2024-05-14T09:18:02.786283+0000","last_active":"2024-05-14T09:21:10.274595+0000","last_peered":"2024-05-14T09:21:10.274595+0000","last_clean":"2024-05-14T09:21:10.274595+0000","last_became_active":"2024-05-14T09:18:02.785158+0000","last_became_peered":"2024-05-14T09:18:02.785158+0000","last_unstale":"2024-05-14T09:21:10.274595+0000","last_undegraded":"2024-05-14T09:21:10.274595+0000","last_fullsized":"2024-05-14T09:21:10.274595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:28.804419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810124+0000","last_change":"2024-05-14T09:18:16.133898+0000","last_active":"2024-05-14T09:19:42.810124+0000","last_peered":"2024-05-14T09:19:42.810124+0000","last_clean":"2024-05-14T09:19:42.810124+0000","last_became_active":"2024-05-14T09:18:16.132493+0000","last_became_peered":"2024-05-14T09:18:16.132493+0000","last_unstale":"2024-05-14T09:19:42.810124+0000","last_undegraded":"2024-05-14T09:19:42.810124+0000","last_fullsized":"2024-05-14T09:19:42.810124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:38:15.126883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'17","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:07.825674+0000","last_change":"2024-05-14T09:17:57.710000+0000","last_active":"2024-05-14T09:20:07.825674+0000","last_peered":"2024-05-14T09:20:07.825674+0000","last_clean":"2024-05-14T09:20:07.825674+0000","last_became_active":"2024-05-14T09:17:57.709546+0000","last_became_peered":"2024-05-14T09:17:57.709546+0000","last_unstale":"2024-05-14T09:20:07.825674+0000","last_undegraded":"2024-05-14T09:20:07.825674+0000","last_fullsized":"2024-05-14T09:20:07.825674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:09.681936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278822+0000","last_change":"2024-05-14T09:18:02.786342+0000","last_active":"2024-05-14T09:21:10.278822+0000","last_peered":"2024-05-14T09:21:10.278822+0000","last_clean":"2024-05-14T09:21:10.278822+0000","last_became_active":"2024-05-14T09:18:02.785981+0000","last_became_peered":"2024-05-14T09:18:02.785981+0000","last_unstale":"2024-05-14T09:21:10.278822+0000","last_undegraded":"2024-05-14T09:21:10.278822+0000","last_fullsized":"2024-05-14T09:21:10.278822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:59:43.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.464123+0000","last_change":"2024-05-14T09:18:15.882171+0000","last_active":"2024-05-14T09:19:42.464123+0000","last_peered":"2024-05-14T09:19:42.464123+0000","last_clean":"2024-05-14T09:19:42.464123+0000","last_became_active":"2024-05-14T09:18:15.881015+0000","last_became_peered":"2024-05-14T09:18:15.881015+0000","last_unstale":"2024-05-14T09:19:42.464123+0000","last_undegraded":"2024-05-14T09:19:42.464123+0000","last_fullsized":"2024-05-14T09:19:42.464123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:18.832868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.468836+0000","last_change":"2024-05-14T09:17:58.254067+0000","last_active":"2024-05-14T09:19:42.468836+0000","last_peered":"2024-05-14T09:19:42.468836+0000","last_clean":"2024-05-14T09:19:42.468836+0000","last_became_active":"2024-05-14T09:17:58.253140+0000","last_became_peered":"2024-05-14T09:17:58.253140+0000","last_unstale":"2024-05-14T09:19:42.468836+0000","last_undegraded":"2024-05-14T09:19:42.468836+0000","last_fullsized":"2024-05-14T09:19:42.468836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:20.263028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289818+0000","last_change":"2024-05-14T09:18:02.775968+0000","last_active":"2024-05-14T09:21:10.289818+0000","last_peered":"2024-05-14T09:21:10.289818+0000","last_clean":"2024-05-14T09:21:10.289818+0000","last_became_active":"2024-05-14T09:18:02.775639+0000","last_became_peered":"2024-05-14T09:18:02.775639+0000","last_unstale":"2024-05-14T09:21:10.289818+0000","last_undegraded":"2024-05-14T09:21:10.289818+0000","last_fullsized":"2024-05-14T09:21:10.289818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:27:52.179647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467974+0000","last_change":"2024-05-14T09:18:16.139823+0000","last_active":"2024-05-14T09:19:42.467974+0000","last_peered":"2024-05-14T09:19:42.467974+0000","last_clean":"2024-05-14T09:19:42.467974+0000","last_became_active":"2024-05-14T09:18:16.138075+0000","last_became_peered":"2024-05-14T09:18:16.138075+0000","last_unstale":"2024-05-14T09:19:42.467974+0000","last_undegraded":"2024-05-14T09:19:42.467974+0000","last_fullsized":"2024-05-14T09:19:42.467974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:41.186678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890566+0000","last_change":"2024-05-14T09:17:57.773751+0000","last_active":"2024-05-14T09:19:42.890566+0000","last_peered":"2024-05-14T09:19:42.890566+0000","last_clean":"2024-05-14T09:19:42.890566+0000","last_became_active":"2024-05-14T09:17:57.772964+0000","last_became_peered":"2024-05-14T09:17:57.772964+0000","last_unstale":"2024-05-14T09:19:42.890566+0000","last_undegraded":"2024-05-14T09:19:42.890566+0000","last_fullsized":"2024-05-14T09:19:42.890566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:08:01.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.216577+0000","last_change":"2024-05-14T09:18:02.774847+0000","last_active":"2024-05-14T09:21:10.216577+0000","last_peered":"2024-05-14T09:21:10.216577+0000","last_clean":"2024-05-14T09:21:10.216577+0000","last_became_active":"2024-05-14T09:18:02.774384+0000","last_became_peered":"2024-05-14T09:18:02.774384+0000","last_unstale":"2024-05-14T09:21:10.216577+0000","last_undegraded":"2024-05-14T09:21:10.216577+0000","last_fullsized":"2024-05-14T09:21:10.216577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:54:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.808103+0000","last_change":"2024-05-14T09:18:15.887656+0000","last_active":"2024-05-14T09:19:42.808103+0000","last_peered":"2024-05-14T09:19:42.808103+0000","last_clean":"2024-05-14T09:19:42.808103+0000","last_became_active":"2024-05-14T09:18:15.887203+0000","last_became_peered":"2024-05-14T09:18:15.887203+0000","last_unstale":"2024-05-14T09:19:42.808103+0000","last_undegraded":"2024-05-14T09:19:42.808103+0000","last_fullsized":"2024-05-14T09:19:42.808103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:27.080959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810765+0000","last_change":"2024-05-14T09:17:57.707511+0000","last_active":"2024-05-14T09:19:42.810765+0000","last_peered":"2024-05-14T09:19:42.810765+0000","last_clean":"2024-05-14T09:19:42.810765+0000","last_became_active":"2024-05-14T09:17:57.706706+0000","last_became_peered":"2024-05-14T09:17:57.706706+0000","last_unstale":"2024-05-14T09:19:42.810765+0000","last_undegraded":"2024-05-14T09:19:42.810765+0000","last_fullsized":"2024-05-14T09:19:42.810765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:25.325832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291104+0000","last_change":"2024-05-14T09:18:02.787800+0000","last_active":"2024-05-14T09:21:10.291104+0000","last_peered":"2024-05-14T09:21:10.291104+0000","last_clean":"2024-05-14T09:21:10.291104+0000","last_became_active":"2024-05-14T09:18:02.785115+0000","last_became_peered":"2024-05-14T09:18:02.785115+0000","last_unstale":"2024-05-14T09:21:10.291104+0000","last_undegraded":"2024-05-14T09:21:10.291104+0000","last_fullsized":"2024-05-14T09:21:10.291104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:23.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:49.483709+0000","last_change":"2024-05-14T09:19:42.898356+0000","last_active":"2024-05-14T09:19:49.483709+0000","last_peered":"2024-05-14T09:19:49.483709+0000","last_clean":"2024-05-14T09:19:49.483709+0000","last_became_active":"2024-05-14T09:19:42.896256+0000","last_became_peered":"2024-05-14T09:19:42.896256+0000","last_unstale":"2024-05-14T09:19:49.483709+0000","last_undegraded":"2024-05-14T09:19:49.483709+0000","last_fullsized":"2024-05-14T09:19:49.483709+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:59:09.389588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465077+0000","last_change":"2024-05-14T09:17:57.710472+0000","last_active":"2024-05-14T09:19:42.465077+0000","last_peered":"2024-05-14T09:19:42.465077+0000","last_clean":"2024-05-14T09:19:42.465077+0000","last_became_active":"2024-05-14T09:17:57.710056+0000","last_became_peered":"2024-05-14T09:17:57.710056+0000","last_unstale":"2024-05-14T09:19:42.465077+0000","last_undegraded":"2024-05-14T09:19:42.465077+0000","last_fullsized":"2024-05-14T09:19:42.465077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:45.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280818+0000","last_change":"2024-05-14T09:18:02.779982+0000","last_active":"2024-05-14T09:21:10.280818+0000","last_peered":"2024-05-14T09:21:10.280818+0000","last_clean":"2024-05-14T09:21:10.280818+0000","last_became_active":"2024-05-14T09:18:02.779595+0000","last_became_peered":"2024-05-14T09:18:02.779595+0000","last_unstale":"2024-05-14T09:21:10.280818+0000","last_undegraded":"2024-05-14T09:21:10.280818+0000","last_fullsized":"2024-05-14T09:21:10.280818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:06.520980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467599+0000","last_change":"2024-05-14T09:18:16.137850+0000","last_active":"2024-05-14T09:19:42.467599+0000","last_peered":"2024-05-14T09:19:42.467599+0000","last_clean":"2024-05-14T09:19:42.467599+0000","last_became_active":"2024-05-14T09:18:16.135097+0000","last_became_peered":"2024-05-14T09:18:16.135097+0000","last_unstale":"2024-05-14T09:19:42.467599+0000","last_undegraded":"2024-05-14T09:19:42.467599+0000","last_fullsized":"2024-05-14T09:19:42.467599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:29:09.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813607+0000","last_change":"2024-05-14T09:17:57.720232+0000","last_active":"2024-05-14T09:19:42.813607+0000","last_peered":"2024-05-14T09:19:42.813607+0000","last_clean":"2024-05-14T09:19:42.813607+0000","last_became_active":"2024-05-14T09:17:57.719057+0000","last_became_peered":"2024-05-14T09:17:57.719057+0000","last_unstale":"2024-05-14T09:19:42.813607+0000","last_undegraded":"2024-05-14T09:19:42.813607+0000","last_fullsized":"2024-05-14T09:19:42.813607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:34.378868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292124+0000","last_change":"2024-05-14T09:18:02.788106+0000","last_active":"2024-05-14T09:21:10.292124+0000","last_peered":"2024-05-14T09:21:10.292124+0000","last_clean":"2024-05-14T09:21:10.292124+0000","last_became_active":"2024-05-14T09:18:02.787631+0000","last_became_peered":"2024-05-14T09:18:02.787631+0000","last_unstale":"2024-05-14T09:21:10.292124+0000","last_undegraded":"2024-05-14T09:21:10.292124+0000","last_fullsized":"2024-05-14T09:21:10.292124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:59:45.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891043+0000","last_change":"2024-05-14T09:18:15.889654+0000","last_active":"2024-05-14T09:19:42.891043+0000","last_peered":"2024-05-14T09:19:42.891043+0000","last_clean":"2024-05-14T09:19:42.891043+0000","last_became_active":"2024-05-14T09:18:15.888915+0000","last_became_peered":"2024-05-14T09:18:15.888915+0000","last_unstale":"2024-05-14T09:19:42.891043+0000","last_undegraded":"2024-05-14T09:19:42.891043+0000","last_fullsized":"2024-05-14T09:19:42.891043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:52:27.127246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'7","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:23.349068+0000","last_change":"2024-05-14T09:17:58.253945+0000","last_active":"2024-05-14T09:21:23.349068+0000","last_peered":"2024-05-14T09:21:23.349068+0000","last_clean":"2024-05-14T09:21:23.349068+0000","last_became_active":"2024-05-14T09:17:58.252807+0000","last_became_peered":"2024-05-14T09:17:58.252807+0000","last_unstale":"2024-05-14T09:21:23.349068+0000","last_undegraded":"2024-05-14T09:21:23.349068+0000","last_fullsized":"2024-05-14T09:21:23.349068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:56:52.853589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290907+0000","last_change":"2024-05-14T09:18:02.792743+0000","last_active":"2024-05-14T09:21:10.290907+0000","last_peered":"2024-05-14T09:21:10.290907+0000","last_clean":"2024-05-14T09:21:10.290907+0000","last_became_active":"2024-05-14T09:18:02.792371+0000","last_became_peered":"2024-05-14T09:18:02.792371+0000","last_unstale":"2024-05-14T09:21:10.290907+0000","last_undegraded":"2024-05-14T09:21:10.290907+0000","last_fullsized":"2024-05-14T09:21:10.290907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:10:00.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885686+0000","last_change":"2024-05-14T09:18:15.884104+0000","last_active":"2024-05-14T09:19:42.885686+0000","last_peered":"2024-05-14T09:19:42.885686+0000","last_clean":"2024-05-14T09:19:42.885686+0000","last_became_active":"2024-05-14T09:18:15.881737+0000","last_became_peered":"2024-05-14T09:18:15.881737+0000","last_unstale":"2024-05-14T09:19:42.885686+0000","last_undegraded":"2024-05-14T09:19:42.885686+0000","last_fullsized":"2024-05-14T09:19:42.885686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:27:57.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462194+0000","last_change":"2024-05-14T09:17:57.717776+0000","last_active":"2024-05-14T09:19:42.462194+0000","last_peered":"2024-05-14T09:19:42.462194+0000","last_clean":"2024-05-14T09:19:42.462194+0000","last_became_active":"2024-05-14T09:17:57.717338+0000","last_became_peered":"2024-05-14T09:17:57.717338+0000","last_unstale":"2024-05-14T09:19:42.462194+0000","last_undegraded":"2024-05-14T09:19:42.462194+0000","last_fullsized":"2024-05-14T09:19:42.462194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:38.441355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270809+0000","last_change":"2024-05-14T09:18:02.786286+0000","last_active":"2024-05-14T09:21:10.270809+0000","last_peered":"2024-05-14T09:21:10.270809+0000","last_clean":"2024-05-14T09:21:10.270809+0000","last_became_active":"2024-05-14T09:18:02.785915+0000","last_became_peered":"2024-05-14T09:18:02.785915+0000","last_unstale":"2024-05-14T09:21:10.270809+0000","last_undegraded":"2024-05-14T09:21:10.270809+0000","last_fullsized":"2024-05-14T09:21:10.270809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:54:08.960145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459498+0000","last_change":"2024-05-14T09:18:15.889692+0000","last_active":"2024-05-14T09:19:42.459498+0000","last_peered":"2024-05-14T09:19:42.459498+0000","last_clean":"2024-05-14T09:19:42.459498+0000","last_became_active":"2024-05-14T09:18:15.888675+0000","last_became_peered":"2024-05-14T09:18:15.888675+0000","last_unstale":"2024-05-14T09:19:42.459498+0000","last_undegraded":"2024-05-14T09:19:42.459498+0000","last_fullsized":"2024-05-14T09:19:42.459498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:11:20.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459141+0000","last_change":"2024-05-14T09:17:57.694782+0000","last_active":"2024-05-14T09:19:42.459141+0000","last_peered":"2024-05-14T09:19:42.459141+0000","last_clean":"2024-05-14T09:19:42.459141+0000","last_became_active":"2024-05-14T09:17:57.693913+0000","last_became_peered":"2024-05-14T09:17:57.693913+0000","last_unstale":"2024-05-14T09:19:42.459141+0000","last_undegraded":"2024-05-14T09:19:42.459141+0000","last_fullsized":"2024-05-14T09:19:42.459141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:36:10.758138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280309+0000","last_change":"2024-05-14T09:18:02.784340+0000","last_active":"2024-05-14T09:21:10.280309+0000","last_peered":"2024-05-14T09:21:10.280309+0000","last_clean":"2024-05-14T09:21:10.280309+0000","last_became_active":"2024-05-14T09:18:02.783905+0000","last_became_peered":"2024-05-14T09:18:02.783905+0000","last_unstale":"2024-05-14T09:21:10.280309+0000","last_undegraded":"2024-05-14T09:21:10.280309+0000","last_fullsized":"2024-05-14T09:21:10.280309+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:57:57.219324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274129+0000","last_change":"2024-05-14T09:18:02.789214+0000","last_active":"2024-05-14T09:21:10.274129+0000","last_peered":"2024-05-14T09:21:10.274129+0000","last_clean":"2024-05-14T09:21:10.274129+0000","last_became_active":"2024-05-14T09:18:02.788764+0000","last_became_peered":"2024-05-14T09:18:02.788764+0000","last_unstale":"2024-05-14T09:21:10.274129+0000","last_undegraded":"2024-05-14T09:21:10.274129+0000","last_fullsized":"2024-05-14T09:21:10.274129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:13.665828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277326+0000","last_change":"2024-05-14T09:18:02.782255+0000","last_active":"2024-05-14T09:21:10.277326+0000","last_peered":"2024-05-14T09:21:10.277326+0000","last_clean":"2024-05-14T09:21:10.277326+0000","last_became_active":"2024-05-14T09:18:02.781817+0000","last_became_peered":"2024-05-14T09:18:02.781817+0000","last_unstale":"2024-05-14T09:21:10.277326+0000","last_undegraded":"2024-05-14T09:21:10.277326+0000","last_fullsized":"2024-05-14T09:21:10.277326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:56:31.544934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262567+0000","last_change":"2024-05-14T09:18:02.781737+0000","last_active":"2024-05-14T09:21:10.262567+0000","last_peered":"2024-05-14T09:21:10.262567+0000","last_clean":"2024-05-14T09:21:10.262567+0000","last_became_active":"2024-05-14T09:18:02.778429+0000","last_became_peered":"2024-05-14T09:18:02.778429+0000","last_unstale":"2024-05-14T09:21:10.262567+0000","last_undegraded":"2024-05-14T09:21:10.262567+0000","last_fullsized":"2024-05-14T09:21:10.262567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:52.699915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290070+0000","last_change":"2024-05-14T09:18:02.787107+0000","last_active":"2024-05-14T09:21:10.290070+0000","last_peered":"2024-05-14T09:21:10.290070+0000","last_clean":"2024-05-14T09:21:10.290070+0000","last_became_active":"2024-05-14T09:18:02.786259+0000","last_became_peered":"2024-05-14T09:18:02.786259+0000","last_unstale":"2024-05-14T09:21:10.290070+0000","last_undegraded":"2024-05-14T09:21:10.290070+0000","last_fullsized":"2024-05-14T09:21:10.290070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:50.103862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.287758+0000","last_change":"2024-05-14T09:18:02.792086+0000","last_active":"2024-05-14T09:21:10.287758+0000","last_peered":"2024-05-14T09:21:10.287758+0000","last_clean":"2024-05-14T09:21:10.287758+0000","last_became_active":"2024-05-14T09:18:02.785795+0000","last_became_peered":"2024-05-14T09:18:02.785795+0000","last_unstale":"2024-05-14T09:21:10.287758+0000","last_undegraded":"2024-05-14T09:21:10.287758+0000","last_fullsized":"2024-05-14T09:21:10.287758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:58.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.272502+0000","last_change":"2024-05-14T09:18:02.787934+0000","last_active":"2024-05-14T09:21:10.272502+0000","last_peered":"2024-05-14T09:21:10.272502+0000","last_clean":"2024-05-14T09:21:10.272502+0000","last_became_active":"2024-05-14T09:18:02.787030+0000","last_became_peered":"2024-05-14T09:18:02.787030+0000","last_unstale":"2024-05-14T09:21:10.272502+0000","last_undegraded":"2024-05-14T09:21:10.272502+0000","last_fullsized":"2024-05-14T09:21:10.272502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:02:57.521485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292758+0000","last_change":"2024-05-14T09:18:02.791714+0000","last_active":"2024-05-14T09:21:10.292758+0000","last_peered":"2024-05-14T09:21:10.292758+0000","last_clean":"2024-05-14T09:21:10.292758+0000","last_became_active":"2024-05-14T09:18:02.791184+0000","last_became_peered":"2024-05-14T09:18:02.791184+0000","last_unstale":"2024-05-14T09:21:10.292758+0000","last_undegraded":"2024-05-14T09:21:10.292758+0000","last_fullsized":"2024-05-14T09:21:10.292758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:55:03.943446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.266548+0000","last_change":"2024-05-14T09:18:02.790270+0000","last_active":"2024-05-14T09:21:10.266548+0000","last_peered":"2024-05-14T09:21:10.266548+0000","last_clean":"2024-05-14T09:21:10.266548+0000","last_became_active":"2024-05-14T09:18:02.789845+0000","last_became_peered":"2024-05-14T09:18:02.789845+0000","last_unstale":"2024-05-14T09:21:10.266548+0000","last_undegraded":"2024-05-14T09:21:10.266548+0000","last_fullsized":"2024-05-14T09:21:10.266548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:10:43.469279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.272800+0000","last_change":"2024-05-14T09:18:02.778122+0000","last_active":"2024-05-14T09:21:10.272800+0000","last_peered":"2024-05-14T09:21:10.272800+0000","last_clean":"2024-05-14T09:21:10.272800+0000","last_became_active":"2024-05-14T09:18:02.775013+0000","last_became_peered":"2024-05-14T09:18:02.775013+0000","last_unstale":"2024-05-14T09:21:10.272800+0000","last_undegraded":"2024-05-14T09:21:10.272800+0000","last_fullsized":"2024-05-14T09:21:10.272800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:49:35.138229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.264910+0000","last_change":"2024-05-14T09:18:41.667927+0000","last_active":"2024-05-14T09:21:10.264910+0000","last_peered":"2024-05-14T09:21:10.264910+0000","last_clean":"2024-05-14T09:21:10.264910+0000","last_became_active":"2024-05-14T09:18:41.667390+0000","last_became_peered":"2024-05-14T09:18:41.667390+0000","last_unstale":"2024-05-14T09:21:10.264910+0000","last_undegraded":"2024-05-14T09:21:10.264910+0000","last_fullsized":"2024-05-14T09:21:10.264910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:47.648872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291110+0000","last_change":"2024-05-14T09:18:02.794924+0000","last_active":"2024-05-14T09:21:10.291110+0000","last_peered":"2024-05-14T09:21:10.291110+0000","last_clean":"2024-05-14T09:21:10.291110+0000","last_became_active":"2024-05-14T09:18:02.794505+0000","last_became_peered":"2024-05-14T09:18:02.794505+0000","last_unstale":"2024-05-14T09:21:10.291110+0000","last_undegraded":"2024-05-14T09:21:10.291110+0000","last_fullsized":"2024-05-14T09:21:10.291110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:39.150209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289236+0000","last_change":"2024-05-14T09:18:02.781514+0000","last_active":"2024-05-14T09:21:10.289236+0000","last_peered":"2024-05-14T09:21:10.289236+0000","last_clean":"2024-05-14T09:21:10.289236+0000","last_became_active":"2024-05-14T09:18:02.779948+0000","last_became_peered":"2024-05-14T09:18:02.779948+0000","last_unstale":"2024-05-14T09:21:10.289236+0000","last_undegraded":"2024-05-14T09:21:10.289236+0000","last_fullsized":"2024-05-14T09:21:10.289236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:25.125018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.276756+0000","last_change":"2024-05-14T09:18:02.785558+0000","last_active":"2024-05-14T09:21:10.276756+0000","last_peered":"2024-05-14T09:21:10.276756+0000","last_clean":"2024-05-14T09:21:10.276756+0000","last_became_active":"2024-05-14T09:18:02.785086+0000","last_became_peered":"2024-05-14T09:18:02.785086+0000","last_unstale":"2024-05-14T09:21:10.276756+0000","last_undegraded":"2024-05-14T09:21:10.276756+0000","last_fullsized":"2024-05-14T09:21:10.276756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:39:13.087341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76497,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1192,"num_read_kb":684,"num_write":264,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":229491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678077,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":519385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874308,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28720,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716432,"statfs":{"total":95995035648,"available":95965626368,"internally_reserved":0,"allocated":1744896,"data_stored":1178064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037835,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":518603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234067,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":518869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430297,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1116151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593825,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":514639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":584148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738510,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":516095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":583678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149816,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":513815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953585,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":519335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790058,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1667072,"data_stored":1111201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:21:28.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T09:21:28.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:28 smithi120 ceph-mon[31085]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:21:28.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:28 smithi152 ceph-mon[34868]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:21:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:28 smithi175 ceph-mon[35353]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:21:29.118 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:29.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:29 smithi120 ceph-mon[31085]: pgmap v494: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:29 smithi152 ceph-mon[34868]: pgmap v494: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:29 smithi175 ceph-mon[35353]: pgmap v494: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 -- 172.21.15.120:0/433363783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 msgr2=0x7f4f08110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 --2- 172.21.15.120:0/433363783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f08110660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009990 tx=0x7f4ef0009ca0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 -- 172.21.15.120:0/433363783 shutdown_connections 2024-05-14T09:21:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 --2- 172.21.15.120:0/433363783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08110ba0 0x7f4f08113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 --2- 172.21.15.120:0/433363783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08075d30 0x7f4f08076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 --2- 172.21.15.120:0/433363783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f08110660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 -- 172.21.15.120:0/433363783 >> 172.21.15.120:0/433363783 conn(0x7f4f08100040 msgr2=0x7f4f08102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 -- 172.21.15.120:0/433363783 shutdown_connections 2024-05-14T09:21:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.390+0000 7f4f0d800700 1 -- 172.21.15.120:0/433363783 wait complete. 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.391+0000 7f4f0d800700 1 Processor -- start 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.391+0000 7f4f0d800700 1 -- start start 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4f0d800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08075d30 0x7f4f0819d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4f0d800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f0819d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4f0d800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08110ba0 0x7f4f081a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4f0d800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4f081165a0 con 0x7f4f08076680 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4f0d800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f08116420 con 0x7f4f08110ba0 2024-05-14T09:21:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4f0d800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f08116720 con 0x7f4f08075d30 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4efe000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f0819d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4efe000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f0819d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57938/0 (socket says 172.21.15.120:57938) 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4efe000700 1 -- 172.21.15.120:0/125636983 learned_addr learned my addr 172.21.15.120:0/125636983 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.392+0000 7f4f06a00700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08075d30 0x7f4f0819d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4f07400700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08110ba0 0x7f4f081a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4efe000700 1 -- 172.21.15.120:0/125636983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08075d30 msgr2=0x7f4f0819d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4efe000700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08075d30 0x7f4f0819d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4efe000700 1 -- 172.21.15.120:0/125636983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08110ba0 msgr2=0x7f4f081a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4efe000700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08110ba0 0x7f4f081a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4efe000700 1 -- 172.21.15.120:0/125636983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f081a1e30 con 0x7f4f08076680 2024-05-14T09:21:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4efe000700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f0819d5b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0005910 tx=0x7f4ef00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.393+0000 7f4effe00700 1 -- 172.21.15.120:0/125636983 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0004830 con 0x7f4f08076680 2024-05-14T09:21:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.394+0000 7f4effe00700 1 -- 172.21.15.120:0/125636983 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef0005020 con 0x7f4f08076680 2024-05-14T09:21:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.394+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f081a20c0 con 0x7f4f08076680 2024-05-14T09:21:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.394+0000 7f4effe00700 1 -- 172.21.15.120:0/125636983 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000f960 con 0x7f4f08076680 2024-05-14T09:21:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.394+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f081a2590 con 0x7f4f08076680 2024-05-14T09:21:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.395+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f080512c0 con 0x7f4f08076680 2024-05-14T09:21:31.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.397+0000 7f4effe00700 1 -- 172.21.15.120:0/125636983 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4ef00054d0 con 0x7f4f08076680 2024-05-14T09:21:31.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.399+0000 7f4effe00700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4eec0b2900 0x7f4eec0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:31.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.399+0000 7f4effe00700 1 -- 172.21.15.120:0/125636983 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4ef00e3850 con 0x7f4f08076680 2024-05-14T09:21:31.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.400+0000 7f4f06a00700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4eec0b2900 0x7f4eec0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:31.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.400+0000 7f4f06a00700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4eec0b2900 0x7f4eec0b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8005950 tx=0x7f4ef800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.402+0000 7f4effe00700 1 -- 172.21.15.120:0/125636983 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4ef0013070 con 0x7f4f08076680 2024-05-14T09:21:31.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.628+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f08063c00 con 0x7f4eec0b2900 2024-05-14T09:21:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.639+0000 7f4effe00700 1 -- 172.21.15.120:0/125636983 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340539 (secure 0 0 0) 0x7f4f08063c00 con 0x7f4eec0b2900 2024-05-14T09:21:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:21:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4eec0b2900 msgr2=0x7f4eec0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4eec0b2900 0x7f4eec0b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8005950 tx=0x7f4ef800b410 comp rx=0 tx=0).stop 2024-05-14T09:21:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 msgr2=0x7f4f0819d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f0819d5b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0005910 tx=0x7f4ef00047b0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 shutdown_connections 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4eec0b2900 0x7f4eec0b4e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08110ba0 0x7f4f081a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08075d30 0x7f4f0819d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 --2- 172.21.15.120:0/125636983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f08076680 0x7f4f0819d5b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 >> 172.21.15.120:0/125636983 conn(0x7f4f08100040 msgr2=0x7f4f08100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.648+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 shutdown_connections 2024-05-14T09:21:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:31.649+0000 7f4f0d800700 1 -- 172.21.15.120:0/125636983 wait complete. 2024-05-14T09:21:31.651 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-05-14T09:21:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:31 smithi175 ceph-mon[35353]: pgmap v495: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:32.047 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:31 smithi120 ceph-mon[31085]: pgmap v495: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:31 smithi152 ceph-mon[34868]: pgmap v495: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:32.477 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2024-05-14T09:21:30.375701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667099,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1298,"num_read_kb":758,"num_write":389,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363500,"kb_used_data":14348,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578324,"statfs":{"total":1151940427776,"available":1151568203776,"internally_reserved":0,"allocated":14692352,"data_stored":8193983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006797"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291216+0000","last_change":"2024-05-14T09:18:02.795124+0000","last_active":"2024-05-14T09:21:10.291216+0000","last_peered":"2024-05-14T09:21:10.291216+0000","last_clean":"2024-05-14T09:21:10.291216+0000","last_became_active":"2024-05-14T09:18:02.794129+0000","last_became_peered":"2024-05-14T09:18:02.794129+0000","last_unstale":"2024-05-14T09:21:10.291216+0000","last_undegraded":"2024-05-14T09:21:10.291216+0000","last_fullsized":"2024-05-14T09:21:10.291216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:54.875120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284580+0000","last_change":"2024-05-14T09:18:02.775506+0000","last_active":"2024-05-14T09:21:10.284580+0000","last_peered":"2024-05-14T09:21:10.284580+0000","last_clean":"2024-05-14T09:21:10.284580+0000","last_became_active":"2024-05-14T09:18:02.774491+0000","last_became_peered":"2024-05-14T09:18:02.774491+0000","last_unstale":"2024-05-14T09:21:10.284580+0000","last_undegraded":"2024-05-14T09:21:10.284580+0000","last_fullsized":"2024-05-14T09:21:10.284580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:36:40.414254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293171+0000","last_change":"2024-05-14T09:18:02.792681+0000","last_active":"2024-05-14T09:21:10.293171+0000","last_peered":"2024-05-14T09:21:10.293171+0000","last_clean":"2024-05-14T09:21:10.293171+0000","last_became_active":"2024-05-14T09:18:02.791903+0000","last_became_peered":"2024-05-14T09:18:02.791903+0000","last_unstale":"2024-05-14T09:21:10.293171+0000","last_undegraded":"2024-05-14T09:21:10.293171+0000","last_fullsized":"2024-05-14T09:21:10.293171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:09:31.027641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271675+0000","last_change":"2024-05-14T09:18:41.667606+0000","last_active":"2024-05-14T09:21:10.271675+0000","last_peered":"2024-05-14T09:21:10.271675+0000","last_clean":"2024-05-14T09:21:10.271675+0000","last_became_active":"2024-05-14T09:18:41.666853+0000","last_became_peered":"2024-05-14T09:18:41.666853+0000","last_unstale":"2024-05-14T09:21:10.271675+0000","last_undegraded":"2024-05-14T09:21:10.271675+0000","last_fullsized":"2024-05-14T09:21:10.271675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:13:40.719553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280567+0000","last_change":"2024-05-14T09:18:02.775383+0000","last_active":"2024-05-14T09:21:10.280567+0000","last_peered":"2024-05-14T09:21:10.280567+0000","last_clean":"2024-05-14T09:21:10.280567+0000","last_became_active":"2024-05-14T09:18:02.774694+0000","last_became_peered":"2024-05-14T09:18:02.774694+0000","last_unstale":"2024-05-14T09:21:10.280567+0000","last_undegraded":"2024-05-14T09:21:10.280567+0000","last_fullsized":"2024-05-14T09:21:10.280567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:47.289929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.276436+0000","last_change":"2024-05-14T09:18:02.782178+0000","last_active":"2024-05-14T09:21:10.276436+0000","last_peered":"2024-05-14T09:21:10.276436+0000","last_clean":"2024-05-14T09:21:10.276436+0000","last_became_active":"2024-05-14T09:18:02.781714+0000","last_became_peered":"2024-05-14T09:18:02.781714+0000","last_unstale":"2024-05-14T09:21:10.276436+0000","last_undegraded":"2024-05-14T09:21:10.276436+0000","last_fullsized":"2024-05-14T09:21:10.276436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:43:02.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262651+0000","last_change":"2024-05-14T09:18:02.774434+0000","last_active":"2024-05-14T09:21:10.262651+0000","last_peered":"2024-05-14T09:21:10.262651+0000","last_clean":"2024-05-14T09:21:10.262651+0000","last_became_active":"2024-05-14T09:18:02.774054+0000","last_became_peered":"2024-05-14T09:18:02.774054+0000","last_unstale":"2024-05-14T09:21:10.262651+0000","last_undegraded":"2024-05-14T09:21:10.262651+0000","last_fullsized":"2024-05-14T09:21:10.262651+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:10.640939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279174+0000","last_change":"2024-05-14T09:18:02.780444+0000","last_active":"2024-05-14T09:21:10.279174+0000","last_peered":"2024-05-14T09:21:10.279174+0000","last_clean":"2024-05-14T09:21:10.279174+0000","last_became_active":"2024-05-14T09:18:02.779992+0000","last_became_peered":"2024-05-14T09:18:02.779992+0000","last_unstale":"2024-05-14T09:21:10.279174+0000","last_undegraded":"2024-05-14T09:21:10.279174+0000","last_fullsized":"2024-05-14T09:21:10.279174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:32:14.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286832+0000","last_change":"2024-05-14T09:18:02.790247+0000","last_active":"2024-05-14T09:21:10.286832+0000","last_peered":"2024-05-14T09:21:10.286832+0000","last_clean":"2024-05-14T09:21:10.286832+0000","last_became_active":"2024-05-14T09:18:02.789293+0000","last_became_peered":"2024-05-14T09:18:02.789293+0000","last_unstale":"2024-05-14T09:21:10.286832+0000","last_undegraded":"2024-05-14T09:21:10.286832+0000","last_fullsized":"2024-05-14T09:21:10.286832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:01.939326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.285657+0000","last_change":"2024-05-14T09:18:02.785167+0000","last_active":"2024-05-14T09:21:10.285657+0000","last_peered":"2024-05-14T09:21:10.285657+0000","last_clean":"2024-05-14T09:21:10.285657+0000","last_became_active":"2024-05-14T09:18:02.784772+0000","last_became_peered":"2024-05-14T09:18:02.784772+0000","last_unstale":"2024-05-14T09:21:10.285657+0000","last_undegraded":"2024-05-14T09:21:10.285657+0000","last_fullsized":"2024-05-14T09:21:10.285657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:06.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290977+0000","last_change":"2024-05-14T09:18:02.793000+0000","last_active":"2024-05-14T09:21:10.290977+0000","last_peered":"2024-05-14T09:21:10.290977+0000","last_clean":"2024-05-14T09:21:10.290977+0000","last_became_active":"2024-05-14T09:18:02.791895+0000","last_became_peered":"2024-05-14T09:18:02.791895+0000","last_unstale":"2024-05-14T09:21:10.290977+0000","last_undegraded":"2024-05-14T09:21:10.290977+0000","last_fullsized":"2024-05-14T09:21:10.290977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:17.313383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279161+0000","last_change":"2024-05-14T09:18:02.776309+0000","last_active":"2024-05-14T09:21:10.279161+0000","last_peered":"2024-05-14T09:21:10.279161+0000","last_clean":"2024-05-14T09:21:10.279161+0000","last_became_active":"2024-05-14T09:18:02.769218+0000","last_became_peered":"2024-05-14T09:18:02.769218+0000","last_unstale":"2024-05-14T09:21:10.279161+0000","last_undegraded":"2024-05-14T09:21:10.279161+0000","last_fullsized":"2024-05-14T09:21:10.279161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:54.793852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.288047+0000","last_change":"2024-05-14T09:18:41.667109+0000","last_active":"2024-05-14T09:21:10.288047+0000","last_peered":"2024-05-14T09:21:10.288047+0000","last_clean":"2024-05-14T09:21:10.288047+0000","last_became_active":"2024-05-14T09:18:41.666437+0000","last_became_peered":"2024-05-14T09:18:41.666437+0000","last_unstale":"2024-05-14T09:21:10.288047+0000","last_undegraded":"2024-05-14T09:21:10.288047+0000","last_fullsized":"2024-05-14T09:21:10.288047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:14.806924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284272+0000","last_change":"2024-05-14T09:18:02.777380+0000","last_active":"2024-05-14T09:21:10.284272+0000","last_peered":"2024-05-14T09:21:10.284272+0000","last_clean":"2024-05-14T09:21:10.284272+0000","last_became_active":"2024-05-14T09:18:02.777035+0000","last_became_peered":"2024-05-14T09:18:02.777035+0000","last_unstale":"2024-05-14T09:21:10.284272+0000","last_undegraded":"2024-05-14T09:21:10.284272+0000","last_fullsized":"2024-05-14T09:21:10.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:56.906077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291464+0000","last_change":"2024-05-14T09:18:02.784577+0000","last_active":"2024-05-14T09:21:10.291464+0000","last_peered":"2024-05-14T09:21:10.291464+0000","last_clean":"2024-05-14T09:21:10.291464+0000","last_became_active":"2024-05-14T09:18:02.784185+0000","last_became_peered":"2024-05-14T09:18:02.784185+0000","last_unstale":"2024-05-14T09:21:10.291464+0000","last_undegraded":"2024-05-14T09:21:10.291464+0000","last_fullsized":"2024-05-14T09:21:10.291464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:44:38.518861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289529+0000","last_change":"2024-05-14T09:18:02.783262+0000","last_active":"2024-05-14T09:21:10.289529+0000","last_peered":"2024-05-14T09:21:10.289529+0000","last_clean":"2024-05-14T09:21:10.289529+0000","last_became_active":"2024-05-14T09:18:02.780405+0000","last_became_peered":"2024-05-14T09:18:02.780405+0000","last_unstale":"2024-05-14T09:21:10.289529+0000","last_undegraded":"2024-05-14T09:21:10.289529+0000","last_fullsized":"2024-05-14T09:21:10.289529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:01:50.437966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291346+0000","last_change":"2024-05-14T09:18:02.789155+0000","last_active":"2024-05-14T09:21:10.291346+0000","last_peered":"2024-05-14T09:21:10.291346+0000","last_clean":"2024-05-14T09:21:10.291346+0000","last_became_active":"2024-05-14T09:18:02.788703+0000","last_became_peered":"2024-05-14T09:18:02.788703+0000","last_unstale":"2024-05-14T09:21:10.291346+0000","last_undegraded":"2024-05-14T09:21:10.291346+0000","last_fullsized":"2024-05-14T09:21:10.291346+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:27:18.593797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293578+0000","last_change":"2024-05-14T09:18:02.788856+0000","last_active":"2024-05-14T09:21:10.293578+0000","last_peered":"2024-05-14T09:21:10.293578+0000","last_clean":"2024-05-14T09:21:10.293578+0000","last_became_active":"2024-05-14T09:18:02.788477+0000","last_became_peered":"2024-05-14T09:18:02.788477+0000","last_unstale":"2024-05-14T09:21:10.293578+0000","last_undegraded":"2024-05-14T09:21:10.293578+0000","last_fullsized":"2024-05-14T09:21:10.293578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:14:09.943568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277936+0000","last_change":"2024-05-14T09:18:02.781087+0000","last_active":"2024-05-14T09:21:10.277936+0000","last_peered":"2024-05-14T09:21:10.277936+0000","last_clean":"2024-05-14T09:21:10.277936+0000","last_became_active":"2024-05-14T09:18:02.780584+0000","last_became_peered":"2024-05-14T09:18:02.780584+0000","last_unstale":"2024-05-14T09:21:10.277936+0000","last_undegraded":"2024-05-14T09:21:10.277936+0000","last_fullsized":"2024-05-14T09:21:10.277936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:02:23.587235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891830+0000","last_change":"2024-05-14T09:19:42.889482+0000","last_active":"2024-05-14T09:19:42.891830+0000","last_peered":"2024-05-14T09:19:42.891830+0000","last_clean":"2024-05-14T09:19:42.891830+0000","last_became_active":"2024-05-14T09:19:42.887316+0000","last_became_peered":"2024-05-14T09:19:42.887316+0000","last_unstale":"2024-05-14T09:19:42.891830+0000","last_undegraded":"2024-05-14T09:19:42.891830+0000","last_fullsized":"2024-05-14T09:19:42.891830+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:13:44.778215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'14","reported_seq":177,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:26.342585+0000","last_change":"2024-05-14T09:17:57.708207+0000","last_active":"2024-05-14T09:21:26.342585+0000","last_peered":"2024-05-14T09:21:26.342585+0000","last_clean":"2024-05-14T09:21:26.342585+0000","last_became_active":"2024-05-14T09:17:57.707547+0000","last_became_peered":"2024-05-14T09:17:57.707547+0000","last_unstale":"2024-05-14T09:21:26.342585+0000","last_undegraded":"2024-05-14T09:21:26.342585+0000","last_fullsized":"2024-05-14T09:21:26.342585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.378254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.264303+0000","last_change":"2024-05-14T09:18:02.782461+0000","last_active":"2024-05-14T09:21:10.264303+0000","last_peered":"2024-05-14T09:21:10.264303+0000","last_clean":"2024-05-14T09:21:10.264303+0000","last_became_active":"2024-05-14T09:18:02.781014+0000","last_became_peered":"2024-05-14T09:18:02.781014+0000","last_unstale":"2024-05-14T09:21:10.264303+0000","last_undegraded":"2024-05-14T09:21:10.264303+0000","last_fullsized":"2024-05-14T09:21:10.264303+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:21:13.024727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466163+0000","last_change":"2024-05-14T09:18:15.878163+0000","last_active":"2024-05-14T09:19:42.466163+0000","last_peered":"2024-05-14T09:19:42.466163+0000","last_clean":"2024-05-14T09:19:42.466163+0000","last_became_active":"2024-05-14T09:18:15.877097+0000","last_became_peered":"2024-05-14T09:18:15.877097+0000","last_unstale":"2024-05-14T09:19:42.466163+0000","last_undegraded":"2024-05-14T09:19:42.466163+0000","last_fullsized":"2024-05-14T09:19:42.466163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:59.570534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.811245+0000","last_change":"2024-05-14T09:17:57.773712+0000","last_active":"2024-05-14T09:19:42.811245+0000","last_peered":"2024-05-14T09:19:42.811245+0000","last_clean":"2024-05-14T09:19:42.811245+0000","last_became_active":"2024-05-14T09:17:57.772849+0000","last_became_peered":"2024-05-14T09:17:57.772849+0000","last_unstale":"2024-05-14T09:19:42.811245+0000","last_undegraded":"2024-05-14T09:19:42.811245+0000","last_fullsized":"2024-05-14T09:19:42.811245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:20.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293116+0000","last_change":"2024-05-14T09:18:02.790490+0000","last_active":"2024-05-14T09:21:10.293116+0000","last_peered":"2024-05-14T09:21:10.293116+0000","last_clean":"2024-05-14T09:21:10.293116+0000","last_became_active":"2024-05-14T09:18:02.790112+0000","last_became_peered":"2024-05-14T09:18:02.790112+0000","last_unstale":"2024-05-14T09:21:10.293116+0000","last_undegraded":"2024-05-14T09:21:10.293116+0000","last_fullsized":"2024-05-14T09:21:10.293116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:15.851585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466989+0000","last_change":"2024-05-14T09:18:15.888894+0000","last_active":"2024-05-14T09:19:42.466989+0000","last_peered":"2024-05-14T09:19:42.466989+0000","last_clean":"2024-05-14T09:19:42.466989+0000","last_became_active":"2024-05-14T09:18:15.888327+0000","last_became_peered":"2024-05-14T09:18:15.888327+0000","last_unstale":"2024-05-14T09:19:42.466989+0000","last_undegraded":"2024-05-14T09:19:42.466989+0000","last_fullsized":"2024-05-14T09:19:42.466989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:13:19.871380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814843+0000","last_change":"2024-05-14T09:17:57.717745+0000","last_active":"2024-05-14T09:19:42.814843+0000","last_peered":"2024-05-14T09:19:42.814843+0000","last_clean":"2024-05-14T09:19:42.814843+0000","last_became_active":"2024-05-14T09:17:57.716822+0000","last_became_peered":"2024-05-14T09:17:57.716822+0000","last_unstale":"2024-05-14T09:19:42.814843+0000","last_undegraded":"2024-05-14T09:19:42.814843+0000","last_fullsized":"2024-05-14T09:19:42.814843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:47:40.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292202+0000","last_change":"2024-05-14T09:18:02.788276+0000","last_active":"2024-05-14T09:21:10.292202+0000","last_peered":"2024-05-14T09:21:10.292202+0000","last_clean":"2024-05-14T09:21:10.292202+0000","last_became_active":"2024-05-14T09:18:02.787446+0000","last_became_peered":"2024-05-14T09:18:02.787446+0000","last_unstale":"2024-05-14T09:21:10.292202+0000","last_undegraded":"2024-05-14T09:21:10.292202+0000","last_fullsized":"2024-05-14T09:21:10.292202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:07:36.574378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466534+0000","last_change":"2024-05-14T09:18:15.887824+0000","last_active":"2024-05-14T09:19:42.466534+0000","last_peered":"2024-05-14T09:19:42.466534+0000","last_clean":"2024-05-14T09:19:42.466534+0000","last_became_active":"2024-05-14T09:18:15.887152+0000","last_became_peered":"2024-05-14T09:18:15.887152+0000","last_unstale":"2024-05-14T09:19:42.466534+0000","last_undegraded":"2024-05-14T09:19:42.466534+0000","last_fullsized":"2024-05-14T09:19:42.466534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:54.778329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814849+0000","last_change":"2024-05-14T09:17:57.717528+0000","last_active":"2024-05-14T09:19:42.814849+0000","last_peered":"2024-05-14T09:19:42.814849+0000","last_clean":"2024-05-14T09:19:42.814849+0000","last_became_active":"2024-05-14T09:17:57.716251+0000","last_became_peered":"2024-05-14T09:17:57.716251+0000","last_unstale":"2024-05-14T09:19:42.814849+0000","last_undegraded":"2024-05-14T09:19:42.814849+0000","last_fullsized":"2024-05-14T09:19:42.814849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:29:08.080292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290450+0000","last_change":"2024-05-14T09:18:02.790132+0000","last_active":"2024-05-14T09:21:10.290450+0000","last_peered":"2024-05-14T09:21:10.290450+0000","last_clean":"2024-05-14T09:21:10.290450+0000","last_became_active":"2024-05-14T09:18:02.789461+0000","last_became_peered":"2024-05-14T09:18:02.789461+0000","last_unstale":"2024-05-14T09:21:10.290450+0000","last_undegraded":"2024-05-14T09:21:10.290450+0000","last_fullsized":"2024-05-14T09:21:10.290450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:36:55.261959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.466002+0000","last_change":"2024-05-14T09:18:15.893674+0000","last_active":"2024-05-14T09:19:42.466002+0000","last_peered":"2024-05-14T09:19:42.466002+0000","last_clean":"2024-05-14T09:19:42.466002+0000","last_became_active":"2024-05-14T09:18:15.891857+0000","last_became_peered":"2024-05-14T09:18:15.891857+0000","last_unstale":"2024-05-14T09:19:42.466002+0000","last_undegraded":"2024-05-14T09:19:42.466002+0000","last_fullsized":"2024-05-14T09:19:42.466002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:14:55.020773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:25.358060+0000","last_change":"2024-05-14T09:18:41.982086+0000","last_active":"2024-05-14T09:21:25.358060+0000","last_peered":"2024-05-14T09:21:25.358060+0000","last_clean":"2024-05-14T09:21:25.358060+0000","last_became_active":"2024-05-14T09:18:41.981103+0000","last_became_peered":"2024-05-14T09:18:41.981103+0000","last_unstale":"2024-05-14T09:21:25.358060+0000","last_undegraded":"2024-05-14T09:21:25.358060+0000","last_fullsized":"2024-05-14T09:21:25.358060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:25:26.896681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.268564+0000","last_change":"2024-05-14T09:18:02.775834+0000","last_active":"2024-05-14T09:21:10.268564+0000","last_peered":"2024-05-14T09:21:10.268564+0000","last_clean":"2024-05-14T09:21:10.268564+0000","last_became_active":"2024-05-14T09:18:02.773708+0000","last_became_peered":"2024-05-14T09:18:02.773708+0000","last_unstale":"2024-05-14T09:21:10.268564+0000","last_undegraded":"2024-05-14T09:21:10.268564+0000","last_fullsized":"2024-05-14T09:21:10.268564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:00.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.900704+0000","last_change":"2024-05-14T09:19:42.899138+0000","last_active":"2024-05-14T09:19:42.900704+0000","last_peered":"2024-05-14T09:19:42.900704+0000","last_clean":"2024-05-14T09:19:42.900704+0000","last_became_active":"2024-05-14T09:19:42.897588+0000","last_became_peered":"2024-05-14T09:19:42.897588+0000","last_unstale":"2024-05-14T09:19:42.900704+0000","last_undegraded":"2024-05-14T09:19:42.900704+0000","last_fullsized":"2024-05-14T09:19:42.900704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:13:05.760525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.894483+0000","last_change":"2024-05-14T09:18:42.326203+0000","last_active":"2024-05-14T09:19:42.894483+0000","last_peered":"2024-05-14T09:19:42.894483+0000","last_clean":"2024-05-14T09:19:42.894483+0000","last_became_active":"2024-05-14T09:18:42.324907+0000","last_became_peered":"2024-05-14T09:18:42.324907+0000","last_unstale":"2024-05-14T09:19:42.894483+0000","last_undegraded":"2024-05-14T09:19:42.894483+0000","last_fullsized":"2024-05-14T09:19:42.894483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:50.408706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.273984+0000","last_change":"2024-05-14T09:18:41.669731+0000","last_active":"2024-05-14T09:21:10.273984+0000","last_peered":"2024-05-14T09:21:10.273984+0000","last_clean":"2024-05-14T09:21:10.273984+0000","last_became_active":"2024-05-14T09:18:41.667039+0000","last_became_peered":"2024-05-14T09:18:41.667039+0000","last_unstale":"2024-05-14T09:21:10.273984+0000","last_undegraded":"2024-05-14T09:21:10.273984+0000","last_fullsized":"2024-05-14T09:21:10.273984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:33:30.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891033+0000","last_change":"2024-05-14T09:18:15.894314+0000","last_active":"2024-05-14T09:19:42.891033+0000","last_peered":"2024-05-14T09:19:42.891033+0000","last_clean":"2024-05-14T09:19:42.891033+0000","last_became_active":"2024-05-14T09:18:15.893173+0000","last_became_peered":"2024-05-14T09:18:15.893173+0000","last_unstale":"2024-05-14T09:19:42.891033+0000","last_undegraded":"2024-05-14T09:19:42.891033+0000","last_fullsized":"2024-05-14T09:19:42.891033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:19:25.467141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.458591+0000","last_change":"2024-05-14T09:17:57.704612+0000","last_active":"2024-05-14T09:19:42.458591+0000","last_peered":"2024-05-14T09:19:42.458591+0000","last_clean":"2024-05-14T09:19:42.458591+0000","last_became_active":"2024-05-14T09:17:57.703979+0000","last_became_peered":"2024-05-14T09:17:57.703979+0000","last_unstale":"2024-05-14T09:19:42.458591+0000","last_undegraded":"2024-05-14T09:19:42.458591+0000","last_fullsized":"2024-05-14T09:19:42.458591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:08.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280799+0000","last_change":"2024-05-14T09:18:02.774778+0000","last_active":"2024-05-14T09:21:10.280799+0000","last_peered":"2024-05-14T09:21:10.280799+0000","last_clean":"2024-05-14T09:21:10.280799+0000","last_became_active":"2024-05-14T09:18:02.774406+0000","last_became_peered":"2024-05-14T09:18:02.774406+0000","last_unstale":"2024-05-14T09:21:10.280799+0000","last_undegraded":"2024-05-14T09:21:10.280799+0000","last_fullsized":"2024-05-14T09:21:10.280799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.135221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.886288+0000","last_change":"2024-05-14T09:18:15.885921+0000","last_active":"2024-05-14T09:19:42.886288+0000","last_peered":"2024-05-14T09:19:42.886288+0000","last_clean":"2024-05-14T09:19:42.886288+0000","last_became_active":"2024-05-14T09:18:15.885261+0000","last_became_peered":"2024-05-14T09:18:15.885261+0000","last_unstale":"2024-05-14T09:19:42.886288+0000","last_undegraded":"2024-05-14T09:19:42.886288+0000","last_fullsized":"2024-05-14T09:19:42.886288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:57.438626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459775+0000","last_change":"2024-05-14T09:17:57.714662+0000","last_active":"2024-05-14T09:19:42.459775+0000","last_peered":"2024-05-14T09:19:42.459775+0000","last_clean":"2024-05-14T09:19:42.459775+0000","last_became_active":"2024-05-14T09:17:57.714086+0000","last_became_peered":"2024-05-14T09:17:57.714086+0000","last_unstale":"2024-05-14T09:19:42.459775+0000","last_undegraded":"2024-05-14T09:19:42.459775+0000","last_fullsized":"2024-05-14T09:19:42.459775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:20.609634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281356+0000","last_change":"2024-05-14T09:18:02.767521+0000","last_active":"2024-05-14T09:21:10.281356+0000","last_peered":"2024-05-14T09:21:10.281356+0000","last_clean":"2024-05-14T09:21:10.281356+0000","last_became_active":"2024-05-14T09:18:02.767035+0000","last_became_peered":"2024-05-14T09:18:02.767035+0000","last_unstale":"2024-05-14T09:21:10.281356+0000","last_undegraded":"2024-05-14T09:21:10.281356+0000","last_fullsized":"2024-05-14T09:21:10.281356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:00:30.251960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810625+0000","last_change":"2024-05-14T09:18:15.890254+0000","last_active":"2024-05-14T09:19:42.810625+0000","last_peered":"2024-05-14T09:19:42.810625+0000","last_clean":"2024-05-14T09:19:42.810625+0000","last_became_active":"2024-05-14T09:18:15.887699+0000","last_became_peered":"2024-05-14T09:18:15.887699+0000","last_unstale":"2024-05-14T09:19:42.810625+0000","last_undegraded":"2024-05-14T09:19:42.810625+0000","last_fullsized":"2024-05-14T09:19:42.810625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:30:39.578671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'6","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:25.353950+0000","last_change":"2024-05-14T09:17:57.712559+0000","last_active":"2024-05-14T09:21:25.353950+0000","last_peered":"2024-05-14T09:21:25.353950+0000","last_clean":"2024-05-14T09:21:25.353950+0000","last_became_active":"2024-05-14T09:17:57.711265+0000","last_became_peered":"2024-05-14T09:17:57.711265+0000","last_unstale":"2024-05-14T09:21:25.353950+0000","last_undegraded":"2024-05-14T09:21:25.353950+0000","last_fullsized":"2024-05-14T09:21:25.353950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:37:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292025+0000","last_change":"2024-05-14T09:18:02.793657+0000","last_active":"2024-05-14T09:21:10.292025+0000","last_peered":"2024-05-14T09:21:10.292025+0000","last_clean":"2024-05-14T09:21:10.292025+0000","last_became_active":"2024-05-14T09:18:02.789550+0000","last_became_peered":"2024-05-14T09:18:02.789550+0000","last_unstale":"2024-05-14T09:21:10.292025+0000","last_undegraded":"2024-05-14T09:21:10.292025+0000","last_fullsized":"2024-05-14T09:21:10.292025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:31.933523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807080+0000","last_change":"2024-05-14T09:18:15.877290+0000","last_active":"2024-05-14T09:19:42.807080+0000","last_peered":"2024-05-14T09:19:42.807080+0000","last_clean":"2024-05-14T09:19:42.807080+0000","last_became_active":"2024-05-14T09:18:15.874522+0000","last_became_peered":"2024-05-14T09:18:15.874522+0000","last_unstale":"2024-05-14T09:19:42.807080+0000","last_undegraded":"2024-05-14T09:19:42.807080+0000","last_fullsized":"2024-05-14T09:19:42.807080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:16.774709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461771+0000","last_change":"2024-05-14T09:17:57.710407+0000","last_active":"2024-05-14T09:19:42.461771+0000","last_peered":"2024-05-14T09:19:42.461771+0000","last_clean":"2024-05-14T09:19:42.461771+0000","last_became_active":"2024-05-14T09:17:57.709776+0000","last_became_peered":"2024-05-14T09:17:57.709776+0000","last_unstale":"2024-05-14T09:19:42.461771+0000","last_undegraded":"2024-05-14T09:19:42.461771+0000","last_fullsized":"2024-05-14T09:19:42.461771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:28:04.838236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290978+0000","last_change":"2024-05-14T09:18:41.664954+0000","last_active":"2024-05-14T09:21:10.290978+0000","last_peered":"2024-05-14T09:21:10.290978+0000","last_clean":"2024-05-14T09:21:10.290978+0000","last_became_active":"2024-05-14T09:18:41.663825+0000","last_became_peered":"2024-05-14T09:18:41.663825+0000","last_unstale":"2024-05-14T09:21:10.290978+0000","last_undegraded":"2024-05-14T09:21:10.290978+0000","last_fullsized":"2024-05-14T09:21:10.290978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:50.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467322+0000","last_change":"2024-05-14T09:18:15.882918+0000","last_active":"2024-05-14T09:19:42.467322+0000","last_peered":"2024-05-14T09:19:42.467322+0000","last_clean":"2024-05-14T09:19:42.467322+0000","last_became_active":"2024-05-14T09:18:15.880220+0000","last_became_peered":"2024-05-14T09:18:15.880220+0000","last_unstale":"2024-05-14T09:19:42.467322+0000","last_undegraded":"2024-05-14T09:19:42.467322+0000","last_fullsized":"2024-05-14T09:19:42.467322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:49.777319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461691+0000","last_change":"2024-05-14T09:17:57.775417+0000","last_active":"2024-05-14T09:19:42.461691+0000","last_peered":"2024-05-14T09:19:42.461691+0000","last_clean":"2024-05-14T09:19:42.461691+0000","last_became_active":"2024-05-14T09:17:57.774362+0000","last_became_peered":"2024-05-14T09:17:57.774362+0000","last_unstale":"2024-05-14T09:19:42.461691+0000","last_undegraded":"2024-05-14T09:19:42.461691+0000","last_fullsized":"2024-05-14T09:19:42.461691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:27.320060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292609+0000","last_change":"2024-05-14T09:18:02.794096+0000","last_active":"2024-05-14T09:21:10.292609+0000","last_peered":"2024-05-14T09:21:10.292609+0000","last_clean":"2024-05-14T09:21:10.292609+0000","last_became_active":"2024-05-14T09:18:02.788361+0000","last_became_peered":"2024-05-14T09:18:02.788361+0000","last_unstale":"2024-05-14T09:21:10.292609+0000","last_undegraded":"2024-05-14T09:21:10.292609+0000","last_fullsized":"2024-05-14T09:21:10.292609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:41.485460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807185+0000","last_change":"2024-05-14T09:18:15.886317+0000","last_active":"2024-05-14T09:19:42.807185+0000","last_peered":"2024-05-14T09:19:42.807185+0000","last_clean":"2024-05-14T09:19:42.807185+0000","last_became_active":"2024-05-14T09:18:15.885903+0000","last_became_peered":"2024-05-14T09:18:15.885903+0000","last_unstale":"2024-05-14T09:19:42.807185+0000","last_undegraded":"2024-05-14T09:19:42.807185+0000","last_fullsized":"2024-05-14T09:19:42.807185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:26:59.892672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":329,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:25.373092+0000","last_change":"2024-05-14T09:17:57.717013+0000","last_active":"2024-05-14T09:21:25.373092+0000","last_peered":"2024-05-14T09:21:25.373092+0000","last_clean":"2024-05-14T09:21:25.373092+0000","last_became_active":"2024-05-14T09:17:57.714552+0000","last_became_peered":"2024-05-14T09:17:57.714552+0000","last_unstale":"2024-05-14T09:21:25.373092+0000","last_undegraded":"2024-05-14T09:21:25.373092+0000","last_fullsized":"2024-05-14T09:21:25.373092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:16.042573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68479,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":244,"num_read_kb":190,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262210+0000","last_change":"2024-05-14T09:18:02.782446+0000","last_active":"2024-05-14T09:21:10.262210+0000","last_peered":"2024-05-14T09:21:10.262210+0000","last_clean":"2024-05-14T09:21:10.262210+0000","last_became_active":"2024-05-14T09:18:02.779998+0000","last_became_peered":"2024-05-14T09:18:02.779998+0000","last_unstale":"2024-05-14T09:21:10.262210+0000","last_undegraded":"2024-05-14T09:21:10.262210+0000","last_fullsized":"2024-05-14T09:21:10.262210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:50.734227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462571+0000","last_change":"2024-05-14T09:18:15.894372+0000","last_active":"2024-05-14T09:19:42.462571+0000","last_peered":"2024-05-14T09:19:42.462571+0000","last_clean":"2024-05-14T09:19:42.462571+0000","last_became_active":"2024-05-14T09:18:15.893842+0000","last_became_peered":"2024-05-14T09:18:15.893842+0000","last_unstale":"2024-05-14T09:19:42.462571+0000","last_undegraded":"2024-05-14T09:19:42.462571+0000","last_fullsized":"2024-05-14T09:19:42.462571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:57.675242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890689+0000","last_change":"2024-05-14T09:18:41.675372+0000","last_active":"2024-05-14T09:19:42.890689+0000","last_peered":"2024-05-14T09:19:42.890689+0000","last_clean":"2024-05-14T09:19:42.890689+0000","last_became_active":"2024-05-14T09:18:41.659107+0000","last_became_peered":"2024-05-14T09:18:41.659107+0000","last_unstale":"2024-05-14T09:19:42.890689+0000","last_undegraded":"2024-05-14T09:19:42.890689+0000","last_fullsized":"2024-05-14T09:19:42.890689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:55:43.567929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280030+0000","last_change":"2024-05-14T09:18:02.780558+0000","last_active":"2024-05-14T09:21:10.280030+0000","last_peered":"2024-05-14T09:21:10.280030+0000","last_clean":"2024-05-14T09:21:10.280030+0000","last_became_active":"2024-05-14T09:18:02.779955+0000","last_became_peered":"2024-05-14T09:18:02.779955+0000","last_unstale":"2024-05-14T09:21:10.280030+0000","last_undegraded":"2024-05-14T09:21:10.280030+0000","last_fullsized":"2024-05-14T09:21:10.280030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:28:59.821879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891138+0000","last_change":"2024-05-14T09:18:15.892207+0000","last_active":"2024-05-14T09:19:42.891138+0000","last_peered":"2024-05-14T09:19:42.891138+0000","last_clean":"2024-05-14T09:19:42.891138+0000","last_became_active":"2024-05-14T09:18:15.891646+0000","last_became_peered":"2024-05-14T09:18:15.891646+0000","last_unstale":"2024-05-14T09:19:42.891138+0000","last_undegraded":"2024-05-14T09:19:42.891138+0000","last_fullsized":"2024-05-14T09:19:42.891138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:06:48.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461245+0000","last_change":"2024-05-14T09:17:57.717130+0000","last_active":"2024-05-14T09:19:42.461245+0000","last_peered":"2024-05-14T09:19:42.461245+0000","last_clean":"2024-05-14T09:19:42.461245+0000","last_became_active":"2024-05-14T09:17:57.716738+0000","last_became_peered":"2024-05-14T09:17:57.716738+0000","last_unstale":"2024-05-14T09:19:42.461245+0000","last_undegraded":"2024-05-14T09:19:42.461245+0000","last_fullsized":"2024-05-14T09:19:42.461245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:20:16.246789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286689+0000","last_change":"2024-05-14T09:18:02.783073+0000","last_active":"2024-05-14T09:21:10.286689+0000","last_peered":"2024-05-14T09:21:10.286689+0000","last_clean":"2024-05-14T09:21:10.286689+0000","last_became_active":"2024-05-14T09:18:02.782657+0000","last_became_peered":"2024-05-14T09:18:02.782657+0000","last_unstale":"2024-05-14T09:21:10.286689+0000","last_undegraded":"2024-05-14T09:21:10.286689+0000","last_fullsized":"2024-05-14T09:21:10.286689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:39:46.649875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.808011+0000","last_change":"2024-05-14T09:18:15.885231+0000","last_active":"2024-05-14T09:19:42.808011+0000","last_peered":"2024-05-14T09:19:42.808011+0000","last_clean":"2024-05-14T09:19:42.808011+0000","last_became_active":"2024-05-14T09:18:15.880199+0000","last_became_peered":"2024-05-14T09:18:15.880199+0000","last_unstale":"2024-05-14T09:19:42.808011+0000","last_undegraded":"2024-05-14T09:19:42.808011+0000","last_fullsized":"2024-05-14T09:19:42.808011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:10:22.707034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:28.360717+0000","last_change":"2024-05-14T09:17:57.718596+0000","last_active":"2024-05-14T09:21:28.360717+0000","last_peered":"2024-05-14T09:21:28.360717+0000","last_clean":"2024-05-14T09:21:28.360717+0000","last_became_active":"2024-05-14T09:17:57.717735+0000","last_became_peered":"2024-05-14T09:17:57.717735+0000","last_unstale":"2024-05-14T09:21:28.360717+0000","last_undegraded":"2024-05-14T09:21:28.360717+0000","last_fullsized":"2024-05-14T09:21:28.360717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:45.110512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.283223+0000","last_change":"2024-05-14T09:18:02.780222+0000","last_active":"2024-05-14T09:21:10.283223+0000","last_peered":"2024-05-14T09:21:10.283223+0000","last_clean":"2024-05-14T09:21:10.283223+0000","last_became_active":"2024-05-14T09:18:02.779842+0000","last_became_peered":"2024-05-14T09:18:02.779842+0000","last_unstale":"2024-05-14T09:21:10.283223+0000","last_undegraded":"2024-05-14T09:21:10.283223+0000","last_fullsized":"2024-05-14T09:21:10.283223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:46.726665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459325+0000","last_change":"2024-05-14T09:18:15.885248+0000","last_active":"2024-05-14T09:19:42.459325+0000","last_peered":"2024-05-14T09:19:42.459325+0000","last_clean":"2024-05-14T09:19:42.459325+0000","last_became_active":"2024-05-14T09:18:15.884675+0000","last_became_peered":"2024-05-14T09:18:15.884675+0000","last_unstale":"2024-05-14T09:19:42.459325+0000","last_undegraded":"2024-05-14T09:19:42.459325+0000","last_fullsized":"2024-05-14T09:19:42.459325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:28:14.278141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890385+0000","last_change":"2024-05-14T09:18:41.687983+0000","last_active":"2024-05-14T09:19:42.890385+0000","last_peered":"2024-05-14T09:19:42.890385+0000","last_clean":"2024-05-14T09:19:42.890385+0000","last_became_active":"2024-05-14T09:18:41.666942+0000","last_became_peered":"2024-05-14T09:18:41.666942+0000","last_unstale":"2024-05-14T09:19:42.890385+0000","last_undegraded":"2024-05-14T09:19:42.890385+0000","last_fullsized":"2024-05-14T09:19:42.890385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:38:24.183297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.287576+0000","last_change":"2024-05-14T09:18:02.788509+0000","last_active":"2024-05-14T09:21:10.287576+0000","last_peered":"2024-05-14T09:21:10.287576+0000","last_clean":"2024-05-14T09:21:10.287576+0000","last_became_active":"2024-05-14T09:18:02.786886+0000","last_became_peered":"2024-05-14T09:18:02.786886+0000","last_unstale":"2024-05-14T09:21:10.287576+0000","last_undegraded":"2024-05-14T09:21:10.287576+0000","last_fullsized":"2024-05-14T09:21:10.287576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:29:38.765565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460028+0000","last_change":"2024-05-14T09:18:15.895299+0000","last_active":"2024-05-14T09:19:42.460028+0000","last_peered":"2024-05-14T09:19:42.460028+0000","last_clean":"2024-05-14T09:19:42.460028+0000","last_became_active":"2024-05-14T09:18:15.893663+0000","last_became_peered":"2024-05-14T09:18:15.893663+0000","last_unstale":"2024-05-14T09:19:42.460028+0000","last_undegraded":"2024-05-14T09:19:42.460028+0000","last_fullsized":"2024-05-14T09:19:42.460028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:58:24.950436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814740+0000","last_change":"2024-05-14T09:17:57.710933+0000","last_active":"2024-05-14T09:19:42.814740+0000","last_peered":"2024-05-14T09:19:42.814740+0000","last_clean":"2024-05-14T09:19:42.814740+0000","last_became_active":"2024-05-14T09:17:57.710255+0000","last_became_peered":"2024-05-14T09:17:57.710255+0000","last_unstale":"2024-05-14T09:19:42.814740+0000","last_undegraded":"2024-05-14T09:19:42.814740+0000","last_fullsized":"2024-05-14T09:19:42.814740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:30.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274588+0000","last_change":"2024-05-14T09:18:02.781494+0000","last_active":"2024-05-14T09:21:10.274588+0000","last_peered":"2024-05-14T09:21:10.274588+0000","last_clean":"2024-05-14T09:21:10.274588+0000","last_became_active":"2024-05-14T09:18:02.781112+0000","last_became_peered":"2024-05-14T09:18:02.781112+0000","last_unstale":"2024-05-14T09:21:10.274588+0000","last_undegraded":"2024-05-14T09:21:10.274588+0000","last_fullsized":"2024-05-14T09:21:10.274588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:27.109538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813533+0000","last_change":"2024-05-14T09:18:16.135447+0000","last_active":"2024-05-14T09:19:42.813533+0000","last_peered":"2024-05-14T09:19:42.813533+0000","last_clean":"2024-05-14T09:19:42.813533+0000","last_became_active":"2024-05-14T09:18:16.133770+0000","last_became_peered":"2024-05-14T09:18:16.133770+0000","last_unstale":"2024-05-14T09:19:42.813533+0000","last_undegraded":"2024-05-14T09:19:42.813533+0000","last_fullsized":"2024-05-14T09:19:42.813533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:29.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.807668+0000","last_change":"2024-05-14T09:17:57.776542+0000","last_active":"2024-05-14T09:19:42.807668+0000","last_peered":"2024-05-14T09:19:42.807668+0000","last_clean":"2024-05-14T09:19:42.807668+0000","last_became_active":"2024-05-14T09:17:57.775370+0000","last_became_peered":"2024-05-14T09:17:57.775370+0000","last_unstale":"2024-05-14T09:19:42.807668+0000","last_undegraded":"2024-05-14T09:19:42.807668+0000","last_fullsized":"2024-05-14T09:19:42.807668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:24.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280562+0000","last_change":"2024-05-14T09:18:02.776673+0000","last_active":"2024-05-14T09:21:10.280562+0000","last_peered":"2024-05-14T09:21:10.280562+0000","last_clean":"2024-05-14T09:21:10.280562+0000","last_became_active":"2024-05-14T09:18:02.776243+0000","last_became_peered":"2024-05-14T09:18:02.776243+0000","last_unstale":"2024-05-14T09:21:10.280562+0000","last_undegraded":"2024-05-14T09:21:10.280562+0000","last_fullsized":"2024-05-14T09:21:10.280562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:21.226977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459397+0000","last_change":"2024-05-14T09:18:15.885039+0000","last_active":"2024-05-14T09:19:42.459397+0000","last_peered":"2024-05-14T09:19:42.459397+0000","last_clean":"2024-05-14T09:19:42.459397+0000","last_became_active":"2024-05-14T09:18:15.884466+0000","last_became_peered":"2024-05-14T09:18:15.884466+0000","last_unstale":"2024-05-14T09:19:42.459397+0000","last_undegraded":"2024-05-14T09:19:42.459397+0000","last_fullsized":"2024-05-14T09:19:42.459397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:12.000203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'7","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:25.341103+0000","last_change":"2024-05-14T09:17:57.712259+0000","last_active":"2024-05-14T09:21:25.341103+0000","last_peered":"2024-05-14T09:21:25.341103+0000","last_clean":"2024-05-14T09:21:25.341103+0000","last_became_active":"2024-05-14T09:17:57.711663+0000","last_became_peered":"2024-05-14T09:17:57.711663+0000","last_unstale":"2024-05-14T09:21:25.341103+0000","last_undegraded":"2024-05-14T09:21:25.341103+0000","last_fullsized":"2024-05-14T09:21:25.341103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:40:31.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291464+0000","last_change":"2024-05-14T09:18:02.783586+0000","last_active":"2024-05-14T09:21:10.291464+0000","last_peered":"2024-05-14T09:21:10.291464+0000","last_clean":"2024-05-14T09:21:10.291464+0000","last_became_active":"2024-05-14T09:18:02.783122+0000","last_became_peered":"2024-05-14T09:18:02.783122+0000","last_unstale":"2024-05-14T09:21:10.291464+0000","last_undegraded":"2024-05-14T09:21:10.291464+0000","last_fullsized":"2024-05-14T09:21:10.291464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:32:24.966064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459709+0000","last_change":"2024-05-14T09:18:16.132825+0000","last_active":"2024-05-14T09:19:42.459709+0000","last_peered":"2024-05-14T09:19:42.459709+0000","last_clean":"2024-05-14T09:19:42.459709+0000","last_became_active":"2024-05-14T09:18:16.132155+0000","last_became_peered":"2024-05-14T09:18:16.132155+0000","last_unstale":"2024-05-14T09:19:42.459709+0000","last_undegraded":"2024-05-14T09:19:42.459709+0000","last_fullsized":"2024-05-14T09:19:42.459709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:43.579951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.273937+0000","last_change":"2024-05-14T09:18:02.788407+0000","last_active":"2024-05-14T09:21:10.273937+0000","last_peered":"2024-05-14T09:21:10.273937+0000","last_clean":"2024-05-14T09:21:10.273937+0000","last_became_active":"2024-05-14T09:18:02.785934+0000","last_became_peered":"2024-05-14T09:18:02.785934+0000","last_unstale":"2024-05-14T09:21:10.273937+0000","last_undegraded":"2024-05-14T09:21:10.273937+0000","last_fullsized":"2024-05-14T09:21:10.273937+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:26.353122+0000","last_change":"2024-05-14T09:17:57.781016+0000","last_active":"2024-05-14T09:21:26.353122+0000","last_peered":"2024-05-14T09:21:26.353122+0000","last_clean":"2024-05-14T09:21:26.353122+0000","last_became_active":"2024-05-14T09:17:57.777442+0000","last_became_peered":"2024-05-14T09:17:57.777442+0000","last_unstale":"2024-05-14T09:21:26.353122+0000","last_undegraded":"2024-05-14T09:21:26.353122+0000","last_fullsized":"2024-05-14T09:21:26.353122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:17:06.992053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461149+0000","last_change":"2024-05-14T09:18:15.891299+0000","last_active":"2024-05-14T09:19:42.461149+0000","last_peered":"2024-05-14T09:19:42.461149+0000","last_clean":"2024-05-14T09:19:42.461149+0000","last_became_active":"2024-05-14T09:18:15.890552+0000","last_became_peered":"2024-05-14T09:18:15.890552+0000","last_unstale":"2024-05-14T09:19:42.461149+0000","last_undegraded":"2024-05-14T09:19:42.461149+0000","last_fullsized":"2024-05-14T09:19:42.461149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:03:44.936117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291905+0000","last_change":"2024-05-14T09:18:02.793484+0000","last_active":"2024-05-14T09:21:10.291905+0000","last_peered":"2024-05-14T09:21:10.291905+0000","last_clean":"2024-05-14T09:21:10.291905+0000","last_became_active":"2024-05-14T09:18:02.792888+0000","last_became_peered":"2024-05-14T09:18:02.792888+0000","last_unstale":"2024-05-14T09:21:10.291905+0000","last_undegraded":"2024-05-14T09:21:10.291905+0000","last_fullsized":"2024-05-14T09:21:10.291905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:19.212025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467101+0000","last_change":"2024-05-14T09:17:57.715271+0000","last_active":"2024-05-14T09:19:42.467101+0000","last_peered":"2024-05-14T09:19:42.467101+0000","last_clean":"2024-05-14T09:19:42.467101+0000","last_became_active":"2024-05-14T09:17:57.712524+0000","last_became_peered":"2024-05-14T09:17:57.712524+0000","last_unstale":"2024-05-14T09:19:42.467101+0000","last_undegraded":"2024-05-14T09:19:42.467101+0000","last_fullsized":"2024-05-14T09:19:42.467101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:39:46.868509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":119,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460162+0000","last_change":"2024-05-14T09:16:01.832034+0000","last_active":"2024-05-14T09:19:42.460162+0000","last_peered":"2024-05-14T09:19:42.460162+0000","last_clean":"2024-05-14T09:19:42.460162+0000","last_became_active":"2024-05-14T09:16:01.815331+0000","last_became_peered":"2024-05-14T09:16:01.815331+0000","last_unstale":"2024-05-14T09:19:42.460162+0000","last_undegraded":"2024-05-14T09:19:42.460162+0000","last_fullsized":"2024-05-14T09:19:42.460162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_clean_scrub_stamp":"2024-05-14T09:11:00.916612+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:04:45.123827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.461633+0000","last_change":"2024-05-14T09:18:16.136149+0000","last_active":"2024-05-14T09:19:42.461633+0000","last_peered":"2024-05-14T09:19:42.461633+0000","last_clean":"2024-05-14T09:19:42.461633+0000","last_became_active":"2024-05-14T09:18:16.134655+0000","last_became_peered":"2024-05-14T09:18:16.134655+0000","last_unstale":"2024-05-14T09:19:42.461633+0000","last_undegraded":"2024-05-14T09:19:42.461633+0000","last_fullsized":"2024-05-14T09:19:42.461633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:51.879763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274051+0000","last_change":"2024-05-14T09:18:02.791068+0000","last_active":"2024-05-14T09:21:10.274051+0000","last_peered":"2024-05-14T09:21:10.274051+0000","last_clean":"2024-05-14T09:21:10.274051+0000","last_became_active":"2024-05-14T09:18:02.785294+0000","last_became_peered":"2024-05-14T09:18:02.785294+0000","last_unstale":"2024-05-14T09:21:10.274051+0000","last_undegraded":"2024-05-14T09:21:10.274051+0000","last_fullsized":"2024-05-14T09:21:10.274051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:06:25.554475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.460448+0000","last_change":"2024-05-14T09:17:57.715272+0000","last_active":"2024-05-14T09:19:42.460448+0000","last_peered":"2024-05-14T09:19:42.460448+0000","last_clean":"2024-05-14T09:19:42.460448+0000","last_became_active":"2024-05-14T09:17:57.713504+0000","last_became_peered":"2024-05-14T09:17:57.713504+0000","last_unstale":"2024-05-14T09:19:42.460448+0000","last_undegraded":"2024-05-14T09:19:42.460448+0000","last_fullsized":"2024-05-14T09:19:42.460448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:27:26.071204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890852+0000","last_change":"2024-05-14T09:18:15.893437+0000","last_active":"2024-05-14T09:19:42.890852+0000","last_peered":"2024-05-14T09:19:42.890852+0000","last_clean":"2024-05-14T09:19:42.890852+0000","last_became_active":"2024-05-14T09:18:15.890908+0000","last_became_peered":"2024-05-14T09:18:15.890908+0000","last_unstale":"2024-05-14T09:19:42.890852+0000","last_undegraded":"2024-05-14T09:19:42.890852+0000","last_fullsized":"2024-05-14T09:19:42.890852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:15.339562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.814448+0000","last_change":"2024-05-14T09:17:57.779601+0000","last_active":"2024-05-14T09:19:42.814448+0000","last_peered":"2024-05-14T09:19:42.814448+0000","last_clean":"2024-05-14T09:19:42.814448+0000","last_became_active":"2024-05-14T09:17:57.778730+0000","last_became_peered":"2024-05-14T09:17:57.778730+0000","last_unstale":"2024-05-14T09:19:42.814448+0000","last_undegraded":"2024-05-14T09:19:42.814448+0000","last_fullsized":"2024-05-14T09:19:42.814448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:01:07.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274595+0000","last_change":"2024-05-14T09:18:02.786283+0000","last_active":"2024-05-14T09:21:10.274595+0000","last_peered":"2024-05-14T09:21:10.274595+0000","last_clean":"2024-05-14T09:21:10.274595+0000","last_became_active":"2024-05-14T09:18:02.785158+0000","last_became_peered":"2024-05-14T09:18:02.785158+0000","last_unstale":"2024-05-14T09:21:10.274595+0000","last_undegraded":"2024-05-14T09:21:10.274595+0000","last_fullsized":"2024-05-14T09:21:10.274595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:28.804419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810124+0000","last_change":"2024-05-14T09:18:16.133898+0000","last_active":"2024-05-14T09:19:42.810124+0000","last_peered":"2024-05-14T09:19:42.810124+0000","last_clean":"2024-05-14T09:19:42.810124+0000","last_became_active":"2024-05-14T09:18:16.132493+0000","last_became_peered":"2024-05-14T09:18:16.132493+0000","last_unstale":"2024-05-14T09:19:42.810124+0000","last_undegraded":"2024-05-14T09:19:42.810124+0000","last_fullsized":"2024-05-14T09:19:42.810124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:38:15.126883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'17","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:07.825674+0000","last_change":"2024-05-14T09:17:57.710000+0000","last_active":"2024-05-14T09:20:07.825674+0000","last_peered":"2024-05-14T09:20:07.825674+0000","last_clean":"2024-05-14T09:20:07.825674+0000","last_became_active":"2024-05-14T09:17:57.709546+0000","last_became_peered":"2024-05-14T09:17:57.709546+0000","last_unstale":"2024-05-14T09:20:07.825674+0000","last_undegraded":"2024-05-14T09:20:07.825674+0000","last_fullsized":"2024-05-14T09:20:07.825674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:09.681936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278822+0000","last_change":"2024-05-14T09:18:02.786342+0000","last_active":"2024-05-14T09:21:10.278822+0000","last_peered":"2024-05-14T09:21:10.278822+0000","last_clean":"2024-05-14T09:21:10.278822+0000","last_became_active":"2024-05-14T09:18:02.785981+0000","last_became_peered":"2024-05-14T09:18:02.785981+0000","last_unstale":"2024-05-14T09:21:10.278822+0000","last_undegraded":"2024-05-14T09:21:10.278822+0000","last_fullsized":"2024-05-14T09:21:10.278822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:59:43.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.464123+0000","last_change":"2024-05-14T09:18:15.882171+0000","last_active":"2024-05-14T09:19:42.464123+0000","last_peered":"2024-05-14T09:19:42.464123+0000","last_clean":"2024-05-14T09:19:42.464123+0000","last_became_active":"2024-05-14T09:18:15.881015+0000","last_became_peered":"2024-05-14T09:18:15.881015+0000","last_unstale":"2024-05-14T09:19:42.464123+0000","last_undegraded":"2024-05-14T09:19:42.464123+0000","last_fullsized":"2024-05-14T09:19:42.464123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:18.832868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.468836+0000","last_change":"2024-05-14T09:17:58.254067+0000","last_active":"2024-05-14T09:19:42.468836+0000","last_peered":"2024-05-14T09:19:42.468836+0000","last_clean":"2024-05-14T09:19:42.468836+0000","last_became_active":"2024-05-14T09:17:58.253140+0000","last_became_peered":"2024-05-14T09:17:58.253140+0000","last_unstale":"2024-05-14T09:19:42.468836+0000","last_undegraded":"2024-05-14T09:19:42.468836+0000","last_fullsized":"2024-05-14T09:19:42.468836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:20.263028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289818+0000","last_change":"2024-05-14T09:18:02.775968+0000","last_active":"2024-05-14T09:21:10.289818+0000","last_peered":"2024-05-14T09:21:10.289818+0000","last_clean":"2024-05-14T09:21:10.289818+0000","last_became_active":"2024-05-14T09:18:02.775639+0000","last_became_peered":"2024-05-14T09:18:02.775639+0000","last_unstale":"2024-05-14T09:21:10.289818+0000","last_undegraded":"2024-05-14T09:21:10.289818+0000","last_fullsized":"2024-05-14T09:21:10.289818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:27:52.179647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467974+0000","last_change":"2024-05-14T09:18:16.139823+0000","last_active":"2024-05-14T09:19:42.467974+0000","last_peered":"2024-05-14T09:19:42.467974+0000","last_clean":"2024-05-14T09:19:42.467974+0000","last_became_active":"2024-05-14T09:18:16.138075+0000","last_became_peered":"2024-05-14T09:18:16.138075+0000","last_unstale":"2024-05-14T09:19:42.467974+0000","last_undegraded":"2024-05-14T09:19:42.467974+0000","last_fullsized":"2024-05-14T09:19:42.467974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:41.186678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.890566+0000","last_change":"2024-05-14T09:17:57.773751+0000","last_active":"2024-05-14T09:19:42.890566+0000","last_peered":"2024-05-14T09:19:42.890566+0000","last_clean":"2024-05-14T09:19:42.890566+0000","last_became_active":"2024-05-14T09:17:57.772964+0000","last_became_peered":"2024-05-14T09:17:57.772964+0000","last_unstale":"2024-05-14T09:19:42.890566+0000","last_undegraded":"2024-05-14T09:19:42.890566+0000","last_fullsized":"2024-05-14T09:19:42.890566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:08:01.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.216577+0000","last_change":"2024-05-14T09:18:02.774847+0000","last_active":"2024-05-14T09:21:10.216577+0000","last_peered":"2024-05-14T09:21:10.216577+0000","last_clean":"2024-05-14T09:21:10.216577+0000","last_became_active":"2024-05-14T09:18:02.774384+0000","last_became_peered":"2024-05-14T09:18:02.774384+0000","last_unstale":"2024-05-14T09:21:10.216577+0000","last_undegraded":"2024-05-14T09:21:10.216577+0000","last_fullsized":"2024-05-14T09:21:10.216577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:54:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.808103+0000","last_change":"2024-05-14T09:18:15.887656+0000","last_active":"2024-05-14T09:19:42.808103+0000","last_peered":"2024-05-14T09:19:42.808103+0000","last_clean":"2024-05-14T09:19:42.808103+0000","last_became_active":"2024-05-14T09:18:15.887203+0000","last_became_peered":"2024-05-14T09:18:15.887203+0000","last_unstale":"2024-05-14T09:19:42.808103+0000","last_undegraded":"2024-05-14T09:19:42.808103+0000","last_fullsized":"2024-05-14T09:19:42.808103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:27.080959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.810765+0000","last_change":"2024-05-14T09:17:57.707511+0000","last_active":"2024-05-14T09:19:42.810765+0000","last_peered":"2024-05-14T09:19:42.810765+0000","last_clean":"2024-05-14T09:19:42.810765+0000","last_became_active":"2024-05-14T09:17:57.706706+0000","last_became_peered":"2024-05-14T09:17:57.706706+0000","last_unstale":"2024-05-14T09:19:42.810765+0000","last_undegraded":"2024-05-14T09:19:42.810765+0000","last_fullsized":"2024-05-14T09:19:42.810765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:25.325832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291104+0000","last_change":"2024-05-14T09:18:02.787800+0000","last_active":"2024-05-14T09:21:10.291104+0000","last_peered":"2024-05-14T09:21:10.291104+0000","last_clean":"2024-05-14T09:21:10.291104+0000","last_became_active":"2024-05-14T09:18:02.785115+0000","last_became_peered":"2024-05-14T09:18:02.785115+0000","last_unstale":"2024-05-14T09:21:10.291104+0000","last_undegraded":"2024-05-14T09:21:10.291104+0000","last_fullsized":"2024-05-14T09:21:10.291104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:23.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:49.483709+0000","last_change":"2024-05-14T09:19:42.898356+0000","last_active":"2024-05-14T09:19:49.483709+0000","last_peered":"2024-05-14T09:19:49.483709+0000","last_clean":"2024-05-14T09:19:49.483709+0000","last_became_active":"2024-05-14T09:19:42.896256+0000","last_became_peered":"2024-05-14T09:19:42.896256+0000","last_unstale":"2024-05-14T09:19:49.483709+0000","last_undegraded":"2024-05-14T09:19:49.483709+0000","last_fullsized":"2024-05-14T09:19:49.483709+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:59:09.389588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.465077+0000","last_change":"2024-05-14T09:17:57.710472+0000","last_active":"2024-05-14T09:19:42.465077+0000","last_peered":"2024-05-14T09:19:42.465077+0000","last_clean":"2024-05-14T09:19:42.465077+0000","last_became_active":"2024-05-14T09:17:57.710056+0000","last_became_peered":"2024-05-14T09:17:57.710056+0000","last_unstale":"2024-05-14T09:19:42.465077+0000","last_undegraded":"2024-05-14T09:19:42.465077+0000","last_fullsized":"2024-05-14T09:19:42.465077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:45.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280818+0000","last_change":"2024-05-14T09:18:02.779982+0000","last_active":"2024-05-14T09:21:10.280818+0000","last_peered":"2024-05-14T09:21:10.280818+0000","last_clean":"2024-05-14T09:21:10.280818+0000","last_became_active":"2024-05-14T09:18:02.779595+0000","last_became_peered":"2024-05-14T09:18:02.779595+0000","last_unstale":"2024-05-14T09:21:10.280818+0000","last_undegraded":"2024-05-14T09:21:10.280818+0000","last_fullsized":"2024-05-14T09:21:10.280818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:06.520980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.467599+0000","last_change":"2024-05-14T09:18:16.137850+0000","last_active":"2024-05-14T09:19:42.467599+0000","last_peered":"2024-05-14T09:19:42.467599+0000","last_clean":"2024-05-14T09:19:42.467599+0000","last_became_active":"2024-05-14T09:18:16.135097+0000","last_became_peered":"2024-05-14T09:18:16.135097+0000","last_unstale":"2024-05-14T09:19:42.467599+0000","last_undegraded":"2024-05-14T09:19:42.467599+0000","last_fullsized":"2024-05-14T09:19:42.467599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:29:09.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.813607+0000","last_change":"2024-05-14T09:17:57.720232+0000","last_active":"2024-05-14T09:19:42.813607+0000","last_peered":"2024-05-14T09:19:42.813607+0000","last_clean":"2024-05-14T09:19:42.813607+0000","last_became_active":"2024-05-14T09:17:57.719057+0000","last_became_peered":"2024-05-14T09:17:57.719057+0000","last_unstale":"2024-05-14T09:19:42.813607+0000","last_undegraded":"2024-05-14T09:19:42.813607+0000","last_fullsized":"2024-05-14T09:19:42.813607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:34.378868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292124+0000","last_change":"2024-05-14T09:18:02.788106+0000","last_active":"2024-05-14T09:21:10.292124+0000","last_peered":"2024-05-14T09:21:10.292124+0000","last_clean":"2024-05-14T09:21:10.292124+0000","last_became_active":"2024-05-14T09:18:02.787631+0000","last_became_peered":"2024-05-14T09:18:02.787631+0000","last_unstale":"2024-05-14T09:21:10.292124+0000","last_undegraded":"2024-05-14T09:21:10.292124+0000","last_fullsized":"2024-05-14T09:21:10.292124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:59:45.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.891043+0000","last_change":"2024-05-14T09:18:15.889654+0000","last_active":"2024-05-14T09:19:42.891043+0000","last_peered":"2024-05-14T09:19:42.891043+0000","last_clean":"2024-05-14T09:19:42.891043+0000","last_became_active":"2024-05-14T09:18:15.888915+0000","last_became_peered":"2024-05-14T09:18:15.888915+0000","last_unstale":"2024-05-14T09:19:42.891043+0000","last_undegraded":"2024-05-14T09:19:42.891043+0000","last_fullsized":"2024-05-14T09:19:42.891043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:52:27.127246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'7","reported_seq":176,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:28.364605+0000","last_change":"2024-05-14T09:17:58.253945+0000","last_active":"2024-05-14T09:21:28.364605+0000","last_peered":"2024-05-14T09:21:28.364605+0000","last_clean":"2024-05-14T09:21:28.364605+0000","last_became_active":"2024-05-14T09:17:58.252807+0000","last_became_peered":"2024-05-14T09:17:58.252807+0000","last_unstale":"2024-05-14T09:21:28.364605+0000","last_undegraded":"2024-05-14T09:21:28.364605+0000","last_fullsized":"2024-05-14T09:21:28.364605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:56:52.853589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290907+0000","last_change":"2024-05-14T09:18:02.792743+0000","last_active":"2024-05-14T09:21:10.290907+0000","last_peered":"2024-05-14T09:21:10.290907+0000","last_clean":"2024-05-14T09:21:10.290907+0000","last_became_active":"2024-05-14T09:18:02.792371+0000","last_became_peered":"2024-05-14T09:18:02.792371+0000","last_unstale":"2024-05-14T09:21:10.290907+0000","last_undegraded":"2024-05-14T09:21:10.290907+0000","last_fullsized":"2024-05-14T09:21:10.290907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:10:00.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.885686+0000","last_change":"2024-05-14T09:18:15.884104+0000","last_active":"2024-05-14T09:19:42.885686+0000","last_peered":"2024-05-14T09:19:42.885686+0000","last_clean":"2024-05-14T09:19:42.885686+0000","last_became_active":"2024-05-14T09:18:15.881737+0000","last_became_peered":"2024-05-14T09:18:15.881737+0000","last_unstale":"2024-05-14T09:19:42.885686+0000","last_undegraded":"2024-05-14T09:19:42.885686+0000","last_fullsized":"2024-05-14T09:19:42.885686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:27:57.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.462194+0000","last_change":"2024-05-14T09:17:57.717776+0000","last_active":"2024-05-14T09:19:42.462194+0000","last_peered":"2024-05-14T09:19:42.462194+0000","last_clean":"2024-05-14T09:19:42.462194+0000","last_became_active":"2024-05-14T09:17:57.717338+0000","last_became_peered":"2024-05-14T09:17:57.717338+0000","last_unstale":"2024-05-14T09:19:42.462194+0000","last_undegraded":"2024-05-14T09:19:42.462194+0000","last_fullsized":"2024-05-14T09:19:42.462194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:38.441355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270809+0000","last_change":"2024-05-14T09:18:02.786286+0000","last_active":"2024-05-14T09:21:10.270809+0000","last_peered":"2024-05-14T09:21:10.270809+0000","last_clean":"2024-05-14T09:21:10.270809+0000","last_became_active":"2024-05-14T09:18:02.785915+0000","last_became_peered":"2024-05-14T09:18:02.785915+0000","last_unstale":"2024-05-14T09:21:10.270809+0000","last_undegraded":"2024-05-14T09:21:10.270809+0000","last_fullsized":"2024-05-14T09:21:10.270809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:54:08.960145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459498+0000","last_change":"2024-05-14T09:18:15.889692+0000","last_active":"2024-05-14T09:19:42.459498+0000","last_peered":"2024-05-14T09:19:42.459498+0000","last_clean":"2024-05-14T09:19:42.459498+0000","last_became_active":"2024-05-14T09:18:15.888675+0000","last_became_peered":"2024-05-14T09:18:15.888675+0000","last_unstale":"2024-05-14T09:19:42.459498+0000","last_undegraded":"2024-05-14T09:19:42.459498+0000","last_fullsized":"2024-05-14T09:19:42.459498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:11:20.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:42.459141+0000","last_change":"2024-05-14T09:17:57.694782+0000","last_active":"2024-05-14T09:19:42.459141+0000","last_peered":"2024-05-14T09:19:42.459141+0000","last_clean":"2024-05-14T09:19:42.459141+0000","last_became_active":"2024-05-14T09:17:57.693913+0000","last_became_peered":"2024-05-14T09:17:57.693913+0000","last_unstale":"2024-05-14T09:19:42.459141+0000","last_undegraded":"2024-05-14T09:19:42.459141+0000","last_fullsized":"2024-05-14T09:19:42.459141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:36:10.758138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280309+0000","last_change":"2024-05-14T09:18:02.784340+0000","last_active":"2024-05-14T09:21:10.280309+0000","last_peered":"2024-05-14T09:21:10.280309+0000","last_clean":"2024-05-14T09:21:10.280309+0000","last_became_active":"2024-05-14T09:18:02.783905+0000","last_became_peered":"2024-05-14T09:18:02.783905+0000","last_unstale":"2024-05-14T09:21:10.280309+0000","last_undegraded":"2024-05-14T09:21:10.280309+0000","last_fullsized":"2024-05-14T09:21:10.280309+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:57:57.219324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274129+0000","last_change":"2024-05-14T09:18:02.789214+0000","last_active":"2024-05-14T09:21:10.274129+0000","last_peered":"2024-05-14T09:21:10.274129+0000","last_clean":"2024-05-14T09:21:10.274129+0000","last_became_active":"2024-05-14T09:18:02.788764+0000","last_became_peered":"2024-05-14T09:18:02.788764+0000","last_unstale":"2024-05-14T09:21:10.274129+0000","last_undegraded":"2024-05-14T09:21:10.274129+0000","last_fullsized":"2024-05-14T09:21:10.274129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:13.665828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277326+0000","last_change":"2024-05-14T09:18:02.782255+0000","last_active":"2024-05-14T09:21:10.277326+0000","last_peered":"2024-05-14T09:21:10.277326+0000","last_clean":"2024-05-14T09:21:10.277326+0000","last_became_active":"2024-05-14T09:18:02.781817+0000","last_became_peered":"2024-05-14T09:18:02.781817+0000","last_unstale":"2024-05-14T09:21:10.277326+0000","last_undegraded":"2024-05-14T09:21:10.277326+0000","last_fullsized":"2024-05-14T09:21:10.277326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:56:31.544934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262567+0000","last_change":"2024-05-14T09:18:02.781737+0000","last_active":"2024-05-14T09:21:10.262567+0000","last_peered":"2024-05-14T09:21:10.262567+0000","last_clean":"2024-05-14T09:21:10.262567+0000","last_became_active":"2024-05-14T09:18:02.778429+0000","last_became_peered":"2024-05-14T09:18:02.778429+0000","last_unstale":"2024-05-14T09:21:10.262567+0000","last_undegraded":"2024-05-14T09:21:10.262567+0000","last_fullsized":"2024-05-14T09:21:10.262567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:52.699915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290070+0000","last_change":"2024-05-14T09:18:02.787107+0000","last_active":"2024-05-14T09:21:10.290070+0000","last_peered":"2024-05-14T09:21:10.290070+0000","last_clean":"2024-05-14T09:21:10.290070+0000","last_became_active":"2024-05-14T09:18:02.786259+0000","last_became_peered":"2024-05-14T09:18:02.786259+0000","last_unstale":"2024-05-14T09:21:10.290070+0000","last_undegraded":"2024-05-14T09:21:10.290070+0000","last_fullsized":"2024-05-14T09:21:10.290070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:50.103862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.287758+0000","last_change":"2024-05-14T09:18:02.792086+0000","last_active":"2024-05-14T09:21:10.287758+0000","last_peered":"2024-05-14T09:21:10.287758+0000","last_clean":"2024-05-14T09:21:10.287758+0000","last_became_active":"2024-05-14T09:18:02.785795+0000","last_became_peered":"2024-05-14T09:18:02.785795+0000","last_unstale":"2024-05-14T09:21:10.287758+0000","last_undegraded":"2024-05-14T09:21:10.287758+0000","last_fullsized":"2024-05-14T09:21:10.287758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:58.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.272502+0000","last_change":"2024-05-14T09:18:02.787934+0000","last_active":"2024-05-14T09:21:10.272502+0000","last_peered":"2024-05-14T09:21:10.272502+0000","last_clean":"2024-05-14T09:21:10.272502+0000","last_became_active":"2024-05-14T09:18:02.787030+0000","last_became_peered":"2024-05-14T09:18:02.787030+0000","last_unstale":"2024-05-14T09:21:10.272502+0000","last_undegraded":"2024-05-14T09:21:10.272502+0000","last_fullsized":"2024-05-14T09:21:10.272502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:02:57.521485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292758+0000","last_change":"2024-05-14T09:18:02.791714+0000","last_active":"2024-05-14T09:21:10.292758+0000","last_peered":"2024-05-14T09:21:10.292758+0000","last_clean":"2024-05-14T09:21:10.292758+0000","last_became_active":"2024-05-14T09:18:02.791184+0000","last_became_peered":"2024-05-14T09:18:02.791184+0000","last_unstale":"2024-05-14T09:21:10.292758+0000","last_undegraded":"2024-05-14T09:21:10.292758+0000","last_fullsized":"2024-05-14T09:21:10.292758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:55:03.943446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.266548+0000","last_change":"2024-05-14T09:18:02.790270+0000","last_active":"2024-05-14T09:21:10.266548+0000","last_peered":"2024-05-14T09:21:10.266548+0000","last_clean":"2024-05-14T09:21:10.266548+0000","last_became_active":"2024-05-14T09:18:02.789845+0000","last_became_peered":"2024-05-14T09:18:02.789845+0000","last_unstale":"2024-05-14T09:21:10.266548+0000","last_undegraded":"2024-05-14T09:21:10.266548+0000","last_fullsized":"2024-05-14T09:21:10.266548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:10:43.469279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.272800+0000","last_change":"2024-05-14T09:18:02.778122+0000","last_active":"2024-05-14T09:21:10.272800+0000","last_peered":"2024-05-14T09:21:10.272800+0000","last_clean":"2024-05-14T09:21:10.272800+0000","last_became_active":"2024-05-14T09:18:02.775013+0000","last_became_peered":"2024-05-14T09:18:02.775013+0000","last_unstale":"2024-05-14T09:21:10.272800+0000","last_undegraded":"2024-05-14T09:21:10.272800+0000","last_fullsized":"2024-05-14T09:21:10.272800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:49:35.138229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.264910+0000","last_change":"2024-05-14T09:18:41.667927+0000","last_active":"2024-05-14T09:21:10.264910+0000","last_peered":"2024-05-14T09:21:10.264910+0000","last_clean":"2024-05-14T09:21:10.264910+0000","last_became_active":"2024-05-14T09:18:41.667390+0000","last_became_peered":"2024-05-14T09:18:41.667390+0000","last_unstale":"2024-05-14T09:21:10.264910+0000","last_undegraded":"2024-05-14T09:21:10.264910+0000","last_fullsized":"2024-05-14T09:21:10.264910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:47.648872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291110+0000","last_change":"2024-05-14T09:18:02.794924+0000","last_active":"2024-05-14T09:21:10.291110+0000","last_peered":"2024-05-14T09:21:10.291110+0000","last_clean":"2024-05-14T09:21:10.291110+0000","last_became_active":"2024-05-14T09:18:02.794505+0000","last_became_peered":"2024-05-14T09:18:02.794505+0000","last_unstale":"2024-05-14T09:21:10.291110+0000","last_undegraded":"2024-05-14T09:21:10.291110+0000","last_fullsized":"2024-05-14T09:21:10.291110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:39.150209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289236+0000","last_change":"2024-05-14T09:18:02.781514+0000","last_active":"2024-05-14T09:21:10.289236+0000","last_peered":"2024-05-14T09:21:10.289236+0000","last_clean":"2024-05-14T09:21:10.289236+0000","last_became_active":"2024-05-14T09:18:02.779948+0000","last_became_peered":"2024-05-14T09:18:02.779948+0000","last_unstale":"2024-05-14T09:21:10.289236+0000","last_undegraded":"2024-05-14T09:21:10.289236+0000","last_fullsized":"2024-05-14T09:21:10.289236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:25.125018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.276756+0000","last_change":"2024-05-14T09:18:02.785558+0000","last_active":"2024-05-14T09:21:10.276756+0000","last_peered":"2024-05-14T09:21:10.276756+0000","last_clean":"2024-05-14T09:21:10.276756+0000","last_became_active":"2024-05-14T09:18:02.785086+0000","last_became_peered":"2024-05-14T09:18:02.785086+0000","last_unstale":"2024-05-14T09:21:10.276756+0000","last_undegraded":"2024-05-14T09:21:10.276756+0000","last_fullsized":"2024-05-14T09:21:10.276756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:39:13.087341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76497,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1222,"num_read_kb":694,"num_write":264,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":229491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678078,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":519385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874308,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28720,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716432,"statfs":{"total":95995035648,"available":95965626368,"internally_reserved":0,"allocated":1744896,"data_stored":1178064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037836,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":518603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234068,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":518869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430298,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1116151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593826,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":514639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":584148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738511,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":516095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411458,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":583678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149817,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":513815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953586,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":519335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790059,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1667072,"data_stored":1111201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:21:32.483 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-14T09:21:32.483 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-14T09:21:32.483 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-14T09:21:32.483 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph health --format=json 2024-05-14T09:21:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:32.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:32 smithi175 ceph-mon[35353]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:21:33.107 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:32 smithi120 ceph-mon[31085]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:21:33.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:32 smithi152 ceph-mon[34868]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:21:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:33 smithi175 ceph-mon[35353]: pgmap v496: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:33.980 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:33 smithi120 ceph-mon[31085]: pgmap v496: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:34.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:33 smithi152 ceph-mon[34868]: pgmap v496: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:35.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.238+0000 7fd96cc00700 1 -- 172.21.15.120:0/2620401877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd96810af60 msgr2=0x7fd96810b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:35.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.238+0000 7fd96cc00700 1 --2- 172.21.15.120:0/2620401877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd96810af60 0x7fd96810b370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd9540099c0 tx=0x7fd954009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.238+0000 7fd96cc00700 1 -- 172.21.15.120:0/2620401877 shutdown_connections 2024-05-14T09:21:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.238+0000 7fd96cc00700 1 --2- 172.21.15.120:0/2620401877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd96810b8b0 0x7fd968113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.238+0000 7fd96cc00700 1 --2- 172.21.15.120:0/2620401877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd968106630 0x7fd968106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.238+0000 7fd96cc00700 1 --2- 172.21.15.120:0/2620401877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd96810af60 0x7fd96810b370 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.238+0000 7fd96cc00700 1 -- 172.21.15.120:0/2620401877 >> 172.21.15.120:0/2620401877 conn(0x7fd968101ed0 msgr2=0x7fd9681042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.239+0000 7fd96cc00700 1 -- 172.21.15.120:0/2620401877 shutdown_connections 2024-05-14T09:21:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.239+0000 7fd96cc00700 1 -- 172.21.15.120:0/2620401877 wait complete. 2024-05-14T09:21:35.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 Processor -- start 2024-05-14T09:21:35.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 -- start start 2024-05-14T09:21:35.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd968106630 0x7fd96819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:35.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd96810af60 0x7fd96819d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:35.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96810b8b0 0x7fd9681a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:35.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd9681163c0 con 0x7fd968106630 2024-05-14T09:21:35.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd968116240 con 0x7fd96810af60 2024-05-14T09:21:35.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.240+0000 7fd96cc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd968116540 con 0x7fd96810b8b0 2024-05-14T09:21:35.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd968106630 0x7fd96819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:35.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd968106630 0x7fd96819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57968/0 (socket says 172.21.15.120:57968) 2024-05-14T09:21:35.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 -- 172.21.15.120:0/562248970 learned_addr learned my addr 172.21.15.120:0/562248970 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd966a00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd96810af60 0x7fd96819d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967e00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96810b8b0 0x7fd9681a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 -- 172.21.15.120:0/562248970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96810b8b0 msgr2=0x7fd9681a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96810b8b0 0x7fd9681a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 -- 172.21.15.120:0/562248970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd96810af60 msgr2=0x7fd96819d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd96810af60 0x7fd96819d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.241+0000 7fd967400700 1 -- 172.21.15.120:0/562248970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9681a1c30 con 0x7fd968106630 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.242+0000 7fd967400700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd968106630 0x7fd96819ce10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c9b0 tx=0x7fd95800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.242+0000 7fd95fe00700 1 -- 172.21.15.120:0/562248970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958007b00 con 0x7fd968106630 2024-05-14T09:21:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.242+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9681a1f20 con 0x7fd968106630 2024-05-14T09:21:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.242+0000 7fd95fe00700 1 -- 172.21.15.120:0/562248970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd958007ca0 con 0x7fd968106630 2024-05-14T09:21:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.242+0000 7fd95fe00700 1 -- 172.21.15.120:0/562248970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958018660 con 0x7fd968106630 2024-05-14T09:21:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.242+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9681a2480 con 0x7fd968106630 2024-05-14T09:21:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.244+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9680512c0 con 0x7fd968106630 2024-05-14T09:21:35.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.246+0000 7fd95fe00700 1 -- 172.21.15.120:0/562248970 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd95800f450 con 0x7fd968106630 2024-05-14T09:21:35.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.248+0000 7fd95fe00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd94c0b2880 0x7fd94c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:35.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.249+0000 7fd95fe00700 1 -- 172.21.15.120:0/562248970 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd9580e26e0 con 0x7fd968106630 2024-05-14T09:21:35.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.249+0000 7fd966a00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd94c0b2880 0x7fd94c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:35.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.250+0000 7fd966a00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd94c0b2880 0x7fd94c0b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd954009990 tx=0x7fd954005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:35.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.254+0000 7fd95fe00700 1 -- 172.21.15.120:0/562248970 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd958014030 con 0x7fd968106630 2024-05-14T09:21:35.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.530+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd96802e5f0 con 0x7fd968106630 2024-05-14T09:21:35.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.530+0000 7fd95fe00700 1 -- 172.21.15.120:0/562248970 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd9580aa000 con 0x7fd968106630 2024-05-14T09:21:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:21:35.531 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd94c0b2880 msgr2=0x7fd94c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd94c0b2880 0x7fd94c0b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd954009990 tx=0x7fd954005fb0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd968106630 msgr2=0x7fd96819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd968106630 0x7fd96819ce10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c9b0 tx=0x7fd95800cd70 comp rx=0 tx=0).stop 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 shutdown_connections 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd94c0b2880 0x7fd94c0b4d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96810b8b0 0x7fd9681a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd968106630 0x7fd96819ce10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 --2- 172.21.15.120:0/562248970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd96810af60 0x7fd96819d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:35.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.533+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 >> 172.21.15.120:0/562248970 conn(0x7fd968101ed0 msgr2=0x7fd9681025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:35.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.534+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 shutdown_connections 2024-05-14T09:21:35.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:35.534+0000 7fd96cc00700 1 -- 172.21.15.120:0/562248970 wait complete. 2024-05-14T09:21:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:35 smithi120 ceph-mon[31085]: pgmap v497: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:35.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:35 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/562248970' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T09:21:36.011 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:35 smithi152 ceph-mon[34868]: pgmap v497: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:36.011 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:35 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/562248970' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T09:21:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:35 smithi175 ceph-mon[35353]: pgmap v497: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:35 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/562248970' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T09:21:36.321 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-14T09:21:36.322 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:21:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:37.946 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:37 smithi120 ceph-mon[31085]: pgmap v498: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:37 smithi152 ceph-mon[34868]: pgmap v498: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:38.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:37 smithi175 ceph-mon[35353]: pgmap v498: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.927+0000 7f65c8800700 1 -- 172.21.15.120:0/890171151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 msgr2=0x7f65c01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.927+0000 7f65c8800700 1 --2- 172.21.15.120:0/890171151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c01038d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f65b40099c0 tx=0x7f65b4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.927+0000 7f65c8800700 1 -- 172.21.15.120:0/890171151 shutdown_connections 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.927+0000 7f65c8800700 1 --2- 172.21.15.120:0/890171151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0108740 0x7f65c01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.927+0000 7f65c8800700 1 --2- 172.21.15.120:0/890171151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c01038d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.927+0000 7f65c8800700 1 --2- 172.21.15.120:0/890171151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c0107df0 0x7f65c0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.927+0000 7f65c8800700 1 -- 172.21.15.120:0/890171151 >> 172.21.15.120:0/890171151 conn(0x7f65c00fedc0 msgr2=0x7f65c01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.928+0000 7f65c8800700 1 -- 172.21.15.120:0/890171151 shutdown_connections 2024-05-14T09:21:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.928+0000 7f65c8800700 1 -- 172.21.15.120:0/890171151 wait complete. 2024-05-14T09:21:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.929+0000 7f65c8800700 1 Processor -- start 2024-05-14T09:21:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.929+0000 7f65c8800700 1 -- start start 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c8800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c0110a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c8800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c0107df0 0x7f65c0110fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c8800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0108740 0x7f65c0111500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c8800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f65c01143c0 con 0x7f65c01034c0 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c8800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0114240 con 0x7f65c0108740 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c8800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0114540 con 0x7f65c0107df0 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c0110a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c0110a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36582/0 (socket says 172.21.15.120:36582) 2024-05-14T09:21:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c5e00700 1 -- 172.21.15.120:0/1678481948 learned_addr learned my addr 172.21.15.120:0/1678481948 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c5400700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c0107df0 0x7f65c0110fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.930+0000 7f65c6800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0108740 0x7f65c0111500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c5e00700 1 -- 172.21.15.120:0/1678481948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c0107df0 msgr2=0x7f65c0110fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c5e00700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c0107df0 0x7f65c0110fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c5e00700 1 -- 172.21.15.120:0/1678481948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0108740 msgr2=0x7f65c0111500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c5e00700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0108740 0x7f65c0111500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c5e00700 1 -- 172.21.15.120:0/1678481948 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c01a9150 con 0x7f65c01034c0 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c6800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0108740 0x7f65c0111500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c5e00700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c0110a80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f65b400b580 tx=0x7f65b400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65baa00700 1 -- 172.21.15.120:0/1678481948 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4026070 con 0x7f65c01034c0 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65baa00700 1 -- 172.21.15.120:0/1678481948 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65b40054c0 con 0x7f65c01034c0 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65baa00700 1 -- 172.21.15.120:0/1678481948 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4004c00 con 0x7f65c01034c0 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c01a93e0 con 0x7f65c01034c0 2024-05-14T09:21:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.931+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c01a9830 con 0x7f65c01034c0 2024-05-14T09:21:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.932+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c00512c0 con 0x7f65c01034c0 2024-05-14T09:21:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.937+0000 7f65baa00700 1 -- 172.21.15.120:0/1678481948 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f65b4029070 con 0x7f65c01034c0 2024-05-14T09:21:38.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.938+0000 7f65baa00700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f65a80b2880 0x7f65a80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:38.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.938+0000 7f65baa00700 1 -- 172.21.15.120:0/1678481948 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f65b40e3980 con 0x7f65c01034c0 2024-05-14T09:21:38.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.938+0000 7f65c5400700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f65a80b2880 0x7f65a80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:38.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.939+0000 7f65c5400700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f65a80b2880 0x7f65a80b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f65b0005fd0 tx=0x7f65b0005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:38.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:38.941+0000 7f65baa00700 1 -- 172.21.15.120:0/1678481948 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f65b4013070 con 0x7f65c01034c0 2024-05-14T09:21:39.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.221+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65c002e5f0 con 0x7f65c01034c0 2024-05-14T09:21:39.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.222+0000 7f65baa00700 1 -- 172.21.15.120:0/1678481948 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11957 (secure 0 0 0) 0x7f65b40ab330 con 0x7f65c01034c0 2024-05-14T09:21:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:21:39.222 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:19:33.941015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:21:39.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f65a80b2880 msgr2=0x7f65a80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:39.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f65a80b2880 0x7f65a80b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f65b0005fd0 tx=0x7f65b0005db0 comp rx=0 tx=0).stop 2024-05-14T09:21:39.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 msgr2=0x7f65c0110a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:39.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c0110a80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f65b400b580 tx=0x7f65b400f740 comp rx=0 tx=0).stop 2024-05-14T09:21:39.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 shutdown_connections 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f65a80b2880 0x7f65a80b4d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0108740 0x7f65c0111500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65c01034c0 0x7f65c0110a80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.225+0000 7f65c8800700 1 --2- 172.21.15.120:0/1678481948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c0107df0 0x7f65c0110fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.226+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 >> 172.21.15.120:0/1678481948 conn(0x7f65c00fedc0 msgr2=0x7f65c01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.226+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 shutdown_connections 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:39.226+0000 7f65c8800700 1 -- 172.21.15.120:0/1678481948 wait complete. 2024-05-14T09:21:39.226 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-05-14T09:21:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:39 smithi120 ceph-mon[31085]: pgmap v499: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:39 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1678481948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:40.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:21:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:39 smithi152 ceph-mon[34868]: pgmap v499: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:39 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1678481948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:40.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:39 smithi175 ceph-mon[35353]: pgmap v499: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:40.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:39 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1678481948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:40.586 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:41 smithi120 ceph-mon[31085]: pgmap v500: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:42.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:41 smithi152 ceph-mon[34868]: pgmap v500: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:41 smithi175 ceph-mon[35353]: pgmap v500: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:42.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 -- 172.21.15.120:0/1085949261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea0105e30 msgr2=0x7f2ea010e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:42.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1085949261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea0105e30 0x7f2ea010e380 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009990 tx=0x7f2e88009ca0 comp rx=0 tx=0).stop 2024-05-14T09:21:42.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 -- 172.21.15.120:0/1085949261 shutdown_connections 2024-05-14T09:21:42.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1085949261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ea010e910 0x7f2ea0110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:42.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1085949261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea01054e0 0x7f2ea01058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:42.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1085949261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea0105e30 0x7f2ea010e380 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:42.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 -- 172.21.15.120:0/1085949261 >> 172.21.15.120:0/1085949261 conn(0x7f2ea00fef30 msgr2=0x7f2ea0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:42.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 -- 172.21.15.120:0/1085949261 shutdown_connections 2024-05-14T09:21:42.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.942+0000 7f2ea6000700 1 -- 172.21.15.120:0/1085949261 wait complete. 2024-05-14T09:21:42.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 Processor -- start 2024-05-14T09:21:42.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 -- start start 2024-05-14T09:21:42.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea01054e0 0x7f2ea019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:42.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea0105e30 0x7f2ea019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:42.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ea010e910 0x7f2ea019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:42.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0114390 con 0x7f2ea01054e0 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0114210 con 0x7f2ea010e910 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.944+0000 7f2ea6000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0114510 con 0x7f2ea0105e30 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea01054e0 0x7f2ea019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea01054e0 0x7f2ea019ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36594/0 (socket says 172.21.15.120:36594) 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 -- 172.21.15.120:0/1003597763 learned_addr learned my addr 172.21.15.120:0/1003597763 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9fe00700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ea010e910 0x7f2ea019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9ea00700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea0105e30 0x7f2ea019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 -- 172.21.15.120:0/1003597763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea0105e30 msgr2=0x7f2ea019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea0105e30 0x7f2ea019b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 -- 172.21.15.120:0/1003597763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ea010e910 msgr2=0x7f2ea019f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ea010e910 0x7f2ea019f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 -- 172.21.15.120:0/1003597763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea019fba0 con 0x7f2ea01054e0 2024-05-14T09:21:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9fe00700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ea010e910 0x7f2ea019f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:42.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.945+0000 7f2e9f400700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea01054e0 0x7f2ea019ad80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c970 tx=0x7f2e9000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:42.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.946+0000 7f2e97e00700 1 -- 172.21.15.120:0/1003597763 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90007aa0 con 0x7f2ea01054e0 2024-05-14T09:21:42.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.946+0000 7f2e97e00700 1 -- 172.21.15.120:0/1003597763 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e90004cc0 con 0x7f2ea01054e0 2024-05-14T09:21:42.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.946+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea019fe90 con 0x7f2ea01054e0 2024-05-14T09:21:42.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.946+0000 7f2e97e00700 1 -- 172.21.15.120:0/1003597763 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90005560 con 0x7f2ea01054e0 2024-05-14T09:21:42.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.946+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea01a0380 con 0x7f2ea01054e0 2024-05-14T09:21:42.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.947+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea00512c0 con 0x7f2ea01054e0 2024-05-14T09:21:42.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.950+0000 7f2e97e00700 1 -- 172.21.15.120:0/1003597763 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2e90007cd0 con 0x7f2ea01054e0 2024-05-14T09:21:42.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.951+0000 7f2e97e00700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e840b2880 0x7f2e840b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:42.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.951+0000 7f2e97e00700 1 -- 172.21.15.120:0/1003597763 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2e900e26b0 con 0x7f2ea01054e0 2024-05-14T09:21:42.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.952+0000 7f2e9ea00700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e840b2880 0x7f2e840b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:42.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.952+0000 7f2e9ea00700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e840b2880 0x7f2e840b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2e88003760 tx=0x7f2e88005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:42.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:42.954+0000 7f2e97e00700 1 -- 172.21.15.120:0/1003597763 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e900aa150 con 0x7f2ea01054e0 2024-05-14T09:21:43.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.237+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ea019c0e0 con 0x7f2ea01054e0 2024-05-14T09:21:43.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.238+0000 7f2e97e00700 1 -- 172.21.15.120:0/1003597763 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11957 (secure 0 0 0) 0x7f2e90005700 con 0x7f2ea01054e0 2024-05-14T09:21:43.238 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:21:43.238 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:19:33.941015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:21:43.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e840b2880 msgr2=0x7f2e840b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:43.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e840b2880 0x7f2e840b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2e88003760 tx=0x7f2e88005fb0 comp rx=0 tx=0).stop 2024-05-14T09:21:43.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea01054e0 msgr2=0x7f2ea019ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:43.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea01054e0 0x7f2ea019ad80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c970 tx=0x7f2e9000cd30 comp rx=0 tx=0).stop 2024-05-14T09:21:43.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 shutdown_connections 2024-05-14T09:21:43.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2e840b2880 0x7f2e840b4d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:43.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ea010e910 0x7f2ea019f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:43.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ea01054e0 0x7f2ea019ad80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:43.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 --2- 172.21.15.120:0/1003597763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea0105e30 0x7f2ea019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:43.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.241+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 >> 172.21.15.120:0/1003597763 conn(0x7f2ea00fef30 msgr2=0x7f2ea00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:43.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.242+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 shutdown_connections 2024-05-14T09:21:43.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:43.242+0000 7f2ea6000700 1 -- 172.21.15.120:0/1003597763 wait complete. 2024-05-14T09:21:43.243 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-05-14T09:21:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:43 smithi120 ceph-mon[31085]: pgmap v501: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:43.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:43 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1003597763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:44.110 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:21:44.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:43 smithi152 ceph-mon[34868]: pgmap v501: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:44.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:43 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1003597763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:43 smithi175 ceph-mon[35353]: pgmap v501: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:43 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1003597763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:46.079 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:45 smithi120 ceph-mon[31085]: pgmap v502: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:45 smithi152 ceph-mon[34868]: pgmap v502: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:45 smithi175 ceph-mon[35353]: pgmap v502: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 -- 172.21.15.120:0/1459554409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 msgr2=0x7f04a8117620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 --2- 172.21.15.120:0/1459554409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a8117620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f04a000b0a0 tx=0x7f04a000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 -- 172.21.15.120:0/1459554409 shutdown_connections 2024-05-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 --2- 172.21.15.120:0/1459554409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04a810f6c0 0x7f04a810fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 --2- 172.21.15.120:0/1459554409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a8117620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 --2- 172.21.15.120:0/1459554409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04a810a7c0 0x7f04a810abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 -- 172.21.15.120:0/1459554409 >> 172.21.15.120:0/1459554409 conn(0x7f04a8076b00 msgr2=0x7f04a8076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 -- 172.21.15.120:0/1459554409 shutdown_connections 2024-05-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.030+0000 7f04af000700 1 -- 172.21.15.120:0/1459554409 wait complete. 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.031+0000 7f04af000700 1 Processor -- start 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.031+0000 7f04af000700 1 -- start start 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04af000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04a810a7c0 0x7f04a81a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04af000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a81a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04af000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04a810f6c0 0x7f04a81a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04af000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f04a811a7a0 con 0x7f04a810b110 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04af000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04a811a620 con 0x7f04a810a7c0 2024-05-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04af000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04a811a920 con 0x7f04a810f6c0 2024-05-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04ad200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a81a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04ad200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a81a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36608/0 (socket says 172.21.15.120:36608) 2024-05-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.032+0000 7f04ad200700 1 -- 172.21.15.120:0/395972481 learned_addr learned my addr 172.21.15.120:0/395972481 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04ae600700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04a810f6c0 0x7f04a81a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04adc00700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04a810a7c0 0x7f04a81a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04ad200700 1 -- 172.21.15.120:0/395972481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04a810f6c0 msgr2=0x7f04a81a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04ad200700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04a810f6c0 0x7f04a81a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04ad200700 1 -- 172.21.15.120:0/395972481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04a810a7c0 msgr2=0x7f04a81a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04ad200700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04a810a7c0 0x7f04a81a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04ad200700 1 -- 172.21.15.120:0/395972481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a81a5fa0 con 0x7f04a810b110 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.033+0000 7f04ad200700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a81a1670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f049400d950 tx=0x7f049400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.034+0000 7f04a6000700 1 -- 172.21.15.120:0/395972481 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494016070 con 0x7f04a810b110 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.034+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a81a6230 con 0x7f04a810b110 2024-05-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.034+0000 7f04a6000700 1 -- 172.21.15.120:0/395972481 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0494009dd0 con 0x7f04a810b110 2024-05-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.034+0000 7f04a6000700 1 -- 172.21.15.120:0/395972481 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049400f3c0 con 0x7f04a810b110 2024-05-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.034+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a81adbb0 con 0x7f04a810b110 2024-05-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.035+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a80512c0 con 0x7f04a810b110 2024-05-14T09:21:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.039+0000 7f04a6000700 1 -- 172.21.15.120:0/395972481 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f0494019070 con 0x7f04a810b110 2024-05-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.041+0000 7f04a6000700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04900b2900 0x7f04900b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.041+0000 7f04a6000700 1 -- 172.21.15.120:0/395972481 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f04940e21f0 con 0x7f04a810b110 2024-05-14T09:21:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.041+0000 7f04adc00700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04900b2900 0x7f04900b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.042+0000 7f04adc00700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04900b2900 0x7f04900b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f049c005950 tx=0x7f049c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:47.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.046+0000 7f04a6000700 1 -- 172.21.15.120:0/395972481 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f04940a9b10 con 0x7f04a810b110 2024-05-14T09:21:47.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.283+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04a802e5f0 con 0x7f04a810b110 2024-05-14T09:21:47.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.286+0000 7f04a6000700 1 -- 172.21.15.120:0/395972481 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7f04940a9410 con 0x7f04a810b110 2024-05-14T09:21:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:21:47.287 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:21:47.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.289+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04900b2900 msgr2=0x7f04900b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:47.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.289+0000 7f04af000700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04900b2900 0x7f04900b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f049c005950 tx=0x7f049c0058e0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.289+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 msgr2=0x7f04a81a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.289+0000 7f04af000700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a81a1670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f049400d950 tx=0x7f049400dc60 comp rx=0 tx=0).stop 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 shutdown_connections 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f04900b2900 0x7f04900b4e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04a810a7c0 0x7f04a81a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04a810f6c0 0x7f04a81a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 --2- 172.21.15.120:0/395972481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04a810b110 0x7f04a81a1670 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 >> 172.21.15.120:0/395972481 conn(0x7f04a8076b00 msgr2=0x7f04a8108880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 shutdown_connections 2024-05-14T09:21:47.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:47.290+0000 7f04af000700 1 -- 172.21.15.120:0/395972481 wait complete. 2024-05-14T09:21:48.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:47 smithi120 ceph-mon[31085]: pgmap v503: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:48.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:47 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/395972481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:21:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:47 smithi152 ceph-mon[34868]: pgmap v503: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:47 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/395972481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:21:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:47 smithi175 ceph-mon[35353]: pgmap v503: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:47 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/395972481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:21:48.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:21:48.677 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:49 smithi120 ceph-mon[31085]: pgmap v504: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:49 smithi152 ceph-mon[34868]: pgmap v504: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:49 smithi175 ceph-mon[35353]: pgmap v504: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:51.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 -- 172.21.15.120:0/1596203096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 msgr2=0x7f60881049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 --2- 172.21.15.120:0/1596203096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f60881049e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f60780099c0 tx=0x7f6078009cd0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 -- 172.21.15.120:0/1596203096 shutdown_connections 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 --2- 172.21.15.120:0/1596203096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088109850 0x7f60881111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 --2- 172.21.15.120:0/1596203096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f60881049e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 --2- 172.21.15.120:0/1596203096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6088108f00 0x7f6088109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 -- 172.21.15.120:0/1596203096 >> 172.21.15.120:0/1596203096 conn(0x7f60880ffea0 msgr2=0x7f60881022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.161+0000 7f608cc00700 1 -- 172.21.15.120:0/1596203096 shutdown_connections 2024-05-14T09:21:51.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.162+0000 7f608cc00700 1 -- 172.21.15.120:0/1596203096 wait complete. 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 Processor -- start 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 -- start start 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f608819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6088108f00 0x7f608819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088109850 0x7f608819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6088114330 con 0x7f60881045d0 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f60881141b0 con 0x7f6088109850 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.163+0000 7f608cc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60881144b0 con 0x7f6088108f00 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f608819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f608819ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59282/0 (socket says 172.21.15.120:59282) 2024-05-14T09:21:51.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 -- 172.21.15.120:0/1903066150 learned_addr learned my addr 172.21.15.120:0/1903066150 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6086800700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088109850 0x7f608819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085400700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6088108f00 0x7f608819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 -- 172.21.15.120:0/1903066150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6088108f00 msgr2=0x7f608819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6088108f00 0x7f608819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 -- 172.21.15.120:0/1903066150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088109850 msgr2=0x7f608819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088109850 0x7f608819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.164+0000 7f6085e00700 1 -- 172.21.15.120:0/1903066150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608819fbc0 con 0x7f60881045d0 2024-05-14T09:21:51.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.165+0000 7f6085e00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f608819ada0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6078000c00 tx=0x7f607800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:51.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.165+0000 7f607ea00700 1 -- 172.21.15.120:0/1903066150 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607800f940 con 0x7f60881045d0 2024-05-14T09:21:51.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.165+0000 7f607ea00700 1 -- 172.21.15.120:0/1903066150 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6078004830 con 0x7f60881045d0 2024-05-14T09:21:51.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.165+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608819fe50 con 0x7f60881045d0 2024-05-14T09:21:51.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.165+0000 7f607ea00700 1 -- 172.21.15.120:0/1903066150 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60780054b0 con 0x7f60881045d0 2024-05-14T09:21:51.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.165+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60881a02d0 con 0x7f60881045d0 2024-05-14T09:21:51.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.166+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60880512c0 con 0x7f60881045d0 2024-05-14T09:21:51.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.169+0000 7f607ea00700 1 -- 172.21.15.120:0/1903066150 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6078029060 con 0x7f60881045d0 2024-05-14T09:21:51.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.171+0000 7f607ea00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f606c0b2880 0x7f606c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:51.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.171+0000 7f607ea00700 1 -- 172.21.15.120:0/1903066150 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f60780e34f0 con 0x7f60881045d0 2024-05-14T09:21:51.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.171+0000 7f6085400700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f606c0b2880 0x7f606c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:51.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.172+0000 7f6085400700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f606c0b2880 0x7f606c0b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6074005950 tx=0x7f60740058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:51.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.174+0000 7f607ea00700 1 -- 172.21.15.120:0/1903066150 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6078013070 con 0x7f60881045d0 2024-05-14T09:21:51.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.451+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f608802e5f0 con 0x7f60881045d0 2024-05-14T09:21:51.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.452+0000 7f607ea00700 1 -- 172.21.15.120:0/1903066150 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11957 (secure 0 0 0) 0x7f60780aaea0 con 0x7f60881045d0 2024-05-14T09:21:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:21:51.453 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:19:33.941015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:21:51.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.455+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f606c0b2880 msgr2=0x7f606c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:51.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.455+0000 7f608cc00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f606c0b2880 0x7f606c0b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6074005950 tx=0x7f60740058e0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.455+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 msgr2=0x7f608819ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.455+0000 7f608cc00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f608819ada0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6078000c00 tx=0x7f607800f510 comp rx=0 tx=0).stop 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 shutdown_connections 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f606c0b2880 0x7f606c0b4d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088109850 0x7f608819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60881045d0 0x7f608819ada0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 --2- 172.21.15.120:0/1903066150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6088108f00 0x7f608819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 >> 172.21.15.120:0/1903066150 conn(0x7f60880ffea0 msgr2=0x7f6088102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:51.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 shutdown_connections 2024-05-14T09:21:51.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:51.456+0000 7f608cc00700 1 -- 172.21.15.120:0/1903066150 wait complete. 2024-05-14T09:21:51.457 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-05-14T09:21:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:51 smithi120 ceph-mon[31085]: pgmap v505: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:51 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1903066150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:51 smithi152 ceph-mon[34868]: pgmap v505: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:51 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1903066150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:51 smithi175 ceph-mon[35353]: pgmap v505: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:21:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:51 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1903066150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:21:52.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-14T09:18:05.515901+0000', 'modified': '2024-05-14T09:19:33.941015+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34427, 'mds_1': 34409, 'mds_2': 34388, 'mds_3': 24469, 'mds_4': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.120:6839/3368743010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6838', 'nonce': 3368743010}, {'type': 'v1', 'addr': '172.21.15.120:6839', 'nonce': 3368743010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14589': {'gid': 14589, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.120:6841/1248486929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6840', 'nonce': 1248486929}, {'type': 'v1', 'addr': '172.21.15.120:6841', 'nonce': 1248486929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'b', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6839/256598418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 256598418}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 256598418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/3706419963', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 3706419963}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 3706419963}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6835/1285285129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1285285129}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1285285129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.175:6837/3978387102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 3978387102}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 3978387102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 31, 'addr': '172.21.15.175:6839/339294041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 339294041}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 339294041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34388': {'gid': 34388, 'name': 'k', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 38, 'addr': '172.21.15.152:6833/2515790469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 2515790469}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 2515790469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'e', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 34, 'addr': '172.21.15.152:6835/2913976247', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 2913976247}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 2913976247}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34427': {'gid': 34427, 'name': 'h', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.152:6837/1812479560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 1812479560}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 1812479560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34427, 'qdb_cluster': [34388, 24469, 34409, 24454, 34427]} 2024-05-14T09:21:52.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-14T09:21:52.296 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-14T09:21:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:53.926 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:53 smithi120 ceph-mon[31085]: pgmap v506: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:54.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:53 smithi152 ceph-mon[34868]: pgmap v506: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:53 smithi175 ceph-mon[35353]: pgmap v506: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 -- 172.21.15.120:0/803690584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 msgr2=0x7f9d18110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 --2- 172.21.15.120:0/803690584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d18110d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009990 tx=0x7f9d0c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 -- 172.21.15.120:0/803690584 shutdown_connections 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 --2- 172.21.15.120:0/803690584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d1810b2e0 0x7f9d18117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 --2- 172.21.15.120:0/803690584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d18110d80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 --2- 172.21.15.120:0/803690584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d1810a990 0x7f9d1810ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 -- 172.21.15.120:0/803690584 >> 172.21.15.120:0/803690584 conn(0x7f9d18077c80 msgr2=0x7f9d180780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 -- 172.21.15.120:0/803690584 shutdown_connections 2024-05-14T09:21:54.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.932+0000 7f9d20000700 1 -- 172.21.15.120:0/803690584 wait complete. 2024-05-14T09:21:54.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.933+0000 7f9d20000700 1 Processor -- start 2024-05-14T09:21:54.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.933+0000 7f9d20000700 1 -- start start 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d20000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d1810a990 0x7f9d181a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d20000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d1810b2e0 0x7f9d181a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d20000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d181a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d20000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1811aa70 con 0x7f9d18110970 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d20000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1811a8f0 con 0x7f9d1810b2e0 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d20000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1811abf0 con 0x7f9d1810a990 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d1e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d181a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d1e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d181a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59296/0 (socket says 172.21.15.120:59296) 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d1e000700 1 -- 172.21.15.120:0/1912136216 learned_addr learned my addr 172.21.15.120:0/1912136216 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.934+0000 7f9d1d600700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d1810a990 0x7f9d181a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.935+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d1810b2e0 0x7f9d181a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.935+0000 7f9d1e000700 1 -- 172.21.15.120:0/1912136216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d1810a990 msgr2=0x7f9d181a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.935+0000 7f9d1e000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d1810a990 0x7f9d181a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.935+0000 7f9d1e000700 1 -- 172.21.15.120:0/1912136216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d1810b2e0 msgr2=0x7f9d181a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.935+0000 7f9d1e000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d1810b2e0 0x7f9d181a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.935+0000 7f9d1e000700 1 -- 172.21.15.120:0/1912136216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d181a6490 con 0x7f9d18110970 2024-05-14T09:21:54.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.935+0000 7f9d1e000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d181a5df0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b970 tx=0x7f9d1000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:54.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.936+0000 7f9d16000700 1 -- 172.21.15.120:0/1912136216 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10019070 con 0x7f9d18110970 2024-05-14T09:21:54.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.936+0000 7f9d16000700 1 -- 172.21.15.120:0/1912136216 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d1000cdc0 con 0x7f9d18110970 2024-05-14T09:21:54.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.936+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d181a6780 con 0x7f9d18110970 2024-05-14T09:21:54.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.936+0000 7f9d16000700 1 -- 172.21.15.120:0/1912136216 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10014e30 con 0x7f9d18110970 2024-05-14T09:21:54.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.936+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d181ae0a0 con 0x7f9d18110970 2024-05-14T09:21:54.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.940+0000 7f9d16000700 1 -- 172.21.15.120:0/1912136216 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f9d1001c070 con 0x7f9d18110970 2024-05-14T09:21:54.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.941+0000 7f9d2ea5ab80 1 Processor -- start 2024-05-14T09:21:54.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.941+0000 7f9d2ea5ab80 1 -- start start 2024-05-14T09:21:54.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e05660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dff6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325e00010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564325d219d0 con 0x564325dffc00 2024-05-14T09:21:54.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564325cbf710 con 0x564325c81df0 2024-05-14T09:21:54.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564325d1d990 con 0x564325e05ba0 2024-05-14T09:21:54.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d16000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d000b2900 0x7f9d000b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d1d600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.942+0000 7f9d1cc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e05660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1d600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dff6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:51256/0 (socket says 172.21.15.120:51256) 2024-05-14T09:21:54.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1d600700 1 -- 172.21.15.120:0/2446568198 learned_addr learned my addr 172.21.15.120:0/2446568198 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:54.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1e000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d000b2900 0x7f9d000b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d16000700 1 -- 172.21.15.120:0/1912136216 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9d100e1950 con 0x7f9d18110970 2024-05-14T09:21:54.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1d600700 1 -- 172.21.15.120:0/2446568198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 msgr2=0x564325e05660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1d600700 1 --2- 172.21.15.120:0/2446568198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e05660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1d600700 1 -- 172.21.15.120:0/2446568198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 msgr2=0x564325e00010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1d600700 1 --2- 172.21.15.120:0/2446568198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325e00010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.943+0000 7f9d1d600700 1 -- 172.21.15.120:0/2446568198 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564325c6e880 con 0x564325e05ba0 2024-05-14T09:21:54.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.944+0000 7f9d1e000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d000b2900 0x7f9d000b4e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b940 tx=0x7f9d10004be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:54.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.944+0000 7f9d1d600700 1 --2- 172.21.15.120:0/2446568198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dff6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009990 tx=0x7f9d0c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff6f34afbe206b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:54.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.944+0000 7f9d0aa00700 1 -- 172.21.15.120:0/2446568198 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c027070 con 0x564325e05ba0 2024-05-14T09:21:54.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.944+0000 7f9d0aa00700 1 -- 172.21.15.120:0/2446568198 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d0c0037c0 con 0x564325e05ba0 2024-05-14T09:21:54.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.944+0000 7f9d0aa00700 1 -- 172.21.15.120:0/2446568198 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00bac0 con 0x564325e05ba0 2024-05-14T09:21:54.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.945+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/2446568198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 msgr2=0x564325dff6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.945+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/2446568198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dff6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009990 tx=0x7f9d0c009f90 comp rx=0 tx=0).stop 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/2446568198 shutdown_connections 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/2446568198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e05660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/2446568198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325e00010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/2446568198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dff6c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/2446568198 >> 172.21.15.120:0/2446568198 conn(0x564325cc0a30 msgr2=0x564325dfa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/2446568198 shutdown_connections 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/2446568198 wait complete. 2024-05-14T09:21:54.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.946+0000 7f9d2ea5ab80 1 -- start start 2024-05-14T09:21:54.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 1 Processor -- start 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325c81df0 0x564325e092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325dffc00 0x564325e09830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325e05ba0 0x564325e09d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564325e0c610 con 0x564325c81df0 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564325c87ad0 con 0x564325e05ba0 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564325e0c790 con 0x564325dffc00 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.947+0000 7f9d2ea5ab80 10 client.0 _ll_register_callbacks cb 0x564325cb5330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325c81df0 0x564325e092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325c81df0 0x564325e092f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59314/0 (socket says 172.21.15.120:59314) 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 -- 172.21.15.120:0/1279303663 learned_addr learned my addr 172.21.15.120:0/1279303663 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1d600700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325dffc00 0x564325e09830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325e05ba0 0x564325e09d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 -- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325dffc00 msgr2=0x564325e09830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325dffc00 0x564325e09830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 -- 172.21.15.120:0/1279303663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325e05ba0 msgr2=0x564325e09d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325e05ba0 0x564325e09d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1cc00700 1 -- 172.21.15.120:0/1279303663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564325ce73d0 con 0x564325c81df0 2024-05-14T09:21:54.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.948+0000 7f9d1d600700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325dffc00 0x564325e09830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:21:54.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325c81df0 0x564325e092f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9d040166c0 tx=0x7f9d0400a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b789086caceefff6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9cff400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9cff400700 1 -- 172.21.15.120:0/1279303663 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0401d060 con 0x564325c81df0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d0c0037c0 con 0x564325c81df0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9cff400700 1 -- 172.21.15.120:0/1279303663 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9d04014560 con 0x564325c81df0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9cff400700 1 -- 172.21.15.120:0/1279303663 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d04024050 con 0x564325c81df0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9d2ea5ab80 10 client.15042 fetch_fsmap learned FSMap version 29 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.949+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564325e172a0 con 0x564325c81df0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9cff400700 1 -- 172.21.15.120:0/1279303663 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d0c0037c0 con 0x564325c81df0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9cff400700 1 -- 172.21.15.120:0/1279303663 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9d040176e0 con 0x564325c81df0 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9d2ea5ab80 10 client.15042 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:21:54.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9d2ea5ab80 10 client.15042 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T09:21:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9d2ea5ab80 20 client.15042 populate_metadata read hostname 'smithi120' 2024-05-14T09:21:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e19930 0x564325e1ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9d2ea5ab80 4 client.15042 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:21:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.950+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564325dcc020 con 0x564325e19930 2024-05-14T09:21:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.951+0000 7f9d1d600700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e19930 0x564325e1ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.952+0000 7f9d1d600700 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e19930 0x564325e1ada0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7ad3941345f08e5f server_cookie=34a3d7188e6e6fe0 in_seq=0 out_seq=0 2024-05-14T09:21:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.952+0000 7f9cff400700 10 client.15042 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:21:54.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9cff400700 1 -- 172.21.15.120:0/1279303663 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564325dcc020 con 0x564325e19930 2024-05-14T09:21:54.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9cff400700 10 client.15042 handle_command_reply: tid=0 2024-05-14T09:21:54.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 client.15042 shutdown 2024-05-14T09:21:54.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325c81df0 msgr2=0x564325e092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325c81df0 0x564325e092f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9d040166c0 tx=0x7f9d0400a790 comp rx=0 tx=0).stop 2024-05-14T09:21:54.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 shutdown_connections 2024-05-14T09:21:54.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e19930 0x564325e1ada0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325e05ba0 0x564325e09d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325c81df0 0x564325e092f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/1279303663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325dffc00 0x564325e09830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 >> 172.21.15.120:0/1279303663 conn(0x564325cc0a30 msgr2=0x564325dfe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:54.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.954+0000 7f9cff400700 0 client.15042 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:21:54.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.955+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 shutdown_connections 2024-05-14T09:21:54.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.955+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/1279303663 wait complete. 2024-05-14T09:21:54.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.955+0000 7f9d2ea5ab80 20 client.15042 trim_cache size 0 max 16384 2024-05-14T09:21:54.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 Processor -- start 2024-05-14T09:21:54.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 -- start start 2024-05-14T09:21:54.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325c81df0 0x564325dff6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325dffc00 0x564325e04470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325e05ba0 0x564325e049b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564325e190e0 con 0x564325e05ba0 2024-05-14T09:21:54.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564325e197b0 con 0x564325dffc00 2024-05-14T09:21:54.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564325e19e80 con 0x564325c81df0 2024-05-14T09:21:54.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.978+0000 7f9d1cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325e05ba0 0x564325e049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325e05ba0 0x564325e049b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59324/0 (socket says 172.21.15.120:59324) 2024-05-14T09:21:54.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 -- 172.21.15.120:0/4054291712 learned_addr learned my addr 172.21.15.120:0/4054291712 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:54.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325c81df0 0x564325dff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1d600700 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325dffc00 0x564325e04470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 -- 172.21.15.120:0/4054291712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325c81df0 msgr2=0x564325dff6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325c81df0 0x564325dff6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 -- 172.21.15.120:0/4054291712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325dffc00 msgr2=0x564325e04470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325dffc00 0x564325e04470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 -- 172.21.15.120:0/4054291712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564325e0c090 con 0x564325e05ba0 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.979+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325e05ba0 0x564325e049b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400a4d0 tx=0x7f9d04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb14a03b41f7e2da server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.980+0000 7f9d0a000700 1 -- 172.21.15.120:0/4054291712 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04017e80 con 0x564325e05ba0 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.980+0000 7f9d0a000700 1 -- 172.21.15.120:0/4054291712 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d04031070 con 0x564325e05ba0 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.980+0000 7f9d0a000700 1 -- 172.21.15.120:0/4054291712 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04017390 con 0x564325e05ba0 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/4054291712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325e05ba0 msgr2=0x564325e049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325e05ba0 0x564325e049b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400a4d0 tx=0x7f9d04004750 comp rx=0 tx=0).stop 2024-05-14T09:21:54.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/4054291712 shutdown_connections 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325e05ba0 0x564325e049b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325c81df0 0x564325dff6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/4054291712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325dffc00 0x564325e04470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/4054291712 >> 172.21.15.120:0/4054291712 conn(0x564325cc0a30 msgr2=0x564325e07be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/4054291712 shutdown_connections 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/4054291712 wait complete. 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.981+0000 7f9d2ea5ab80 1 -- start start 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 1 Processor -- start 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e24490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325dfe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dfebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564325e1ac20 con 0x564325dffc00 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564325e1a550 con 0x564325c81df0 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564325e1b2f0 con 0x564325e05ba0 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.982+0000 7f9d2ea5ab80 10 client.0 _ll_register_callbacks cb 0x564325cb5330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325dfe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325dfe6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59326/0 (socket says 172.21.15.120:59326) 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 -- 172.21.15.120:0/3150341953 learned_addr learned my addr 172.21.15.120:0/3150341953 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e24490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dfebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 -- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 msgr2=0x564325dfebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dfebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 -- 172.21.15.120:0/3150341953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 msgr2=0x564325e24490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:54.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e24490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 -- 172.21.15.120:0/3150341953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564325dff130 con 0x564325dffc00 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dfebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9d1d600700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325dfe6b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c000c00 tx=0x7f9d0c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccf496d667fa7f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.983+0000 7f9cff400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9cff400700 1 -- 172.21.15.120:0/3150341953 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c037070 con 0x564325dffc00 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9cff400700 1 -- 172.21.15.120:0/3150341953 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9d0c0053d0 con 0x564325dffc00 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d04031070 con 0x564325dffc00 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9cff400700 1 -- 172.21.15.120:0/3150341953 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d0c040050 con 0x564325dffc00 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9d2ea5ab80 10 client.15048 fetch_fsmap learned FSMap version 29 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564325e23e50 con 0x564325dffc00 2024-05-14T09:21:54.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9cff400700 1 -- 172.21.15.120:0/3150341953 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d04031070 con 0x564325dffc00 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.984+0000 7f9cff400700 1 -- 172.21.15.120:0/3150341953 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9d0c03a020 con 0x564325dffc00 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.985+0000 7f9d2ea5ab80 10 client.15048 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.985+0000 7f9d2ea5ab80 10 client.15048 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.985+0000 7f9d2ea5ab80 20 client.15048 populate_metadata read hostname 'smithi120' 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.985+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e868e0 0x564325e87d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.985+0000 7f9d2ea5ab80 4 client.15048 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.985+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "status"}) -- 0x564325d2f3b0 con 0x564325e868e0 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.985+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e868e0 0x564325e87d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.986+0000 7f9d1cc00700 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e868e0 0x564325e87d50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e759b823492ce28f server_cookie=ae67613e50a7d7a7 in_seq=0 out_seq=0 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.986+0000 7f9cff400700 10 client.15048 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:21:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9cff400700 1 -- 172.21.15.120:0/3150341953 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564325d2f3b0 con 0x564325e868e0 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9cff400700 10 client.15048 handle_command_reply: tid=0 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 client.15048 shutdown 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 msgr2=0x564325dfe6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325dfe6b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c000c00 tx=0x7f9d0c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 shutdown_connections 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x564325e868e0 0x564325e87d50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564325c81df0 0x564325e24490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564325e05ba0 0x564325dfebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 --2- 172.21.15.120:0/3150341953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564325dffc00 0x564325dfe6b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 >> 172.21.15.120:0/3150341953 conn(0x564325cc0a30 msgr2=0x564325e02fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9cff400700 0 client.15048 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.987+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 shutdown_connections 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.988+0000 7f9d2ea5ab80 1 -- 172.21.15.120:0/3150341953 wait complete. 2024-05-14T09:21:54.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.988+0000 7f9d2ea5ab80 20 client.15048 trim_cache size 0 max 16384 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 4, 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24454, 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 146.017992475, 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:21:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:21:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:21:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 272.24550446699999 2024-05-14T09:21:54.995 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:21:54.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.988+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d000b2900 msgr2=0x7f9d000b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.988+0000 7f9d20000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d000b2900 0x7f9d000b4e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b940 tx=0x7f9d10004be0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 msgr2=0x7f9d181a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d181a5df0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b970 tx=0x7f9d1000bc80 comp rx=0 tx=0).stop 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 shutdown_connections 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d000b2900 0x7f9d000b4e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18110970 0x7f9d181a5df0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d1810a990 0x7f9d181a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 --2- 172.21.15.120:0/1912136216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d1810b2e0 0x7f9d181a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 >> 172.21.15.120:0/1912136216 conn(0x7f9d18077c80 msgr2=0x7f9d1807bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 shutdown_connections 2024-05-14T09:21:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:54.989+0000 7f9d20000700 1 -- 172.21.15.120:0/1912136216 wait complete. 2024-05-14T09:21:55.802 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-14T09:21:56.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:55 smithi120 ceph-mon[31085]: pgmap v507: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:55 smithi152 ceph-mon[34868]: pgmap v507: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:55 smithi175 ceph-mon[35353]: pgmap v507: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:21:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:21:58.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:57 smithi120 ceph-mon[31085]: pgmap v508: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:57 smithi152 ceph-mon[34868]: pgmap v508: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:57 smithi175 ceph-mon[35353]: pgmap v508: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:21:58.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 -- 172.21.15.120:0/2976552297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7924109850 msgr2=0x7f79241111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 --2- 172.21.15.120:0/2976552297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7924109850 0x7f79241111b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f791c00b0d0 tx=0x7f791c00b3e0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 -- 172.21.15.120:0/2976552297 shutdown_connections 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 --2- 172.21.15.120:0/2976552297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7924109850 0x7f79241111b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 --2- 172.21.15.120:0/2976552297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79241045d0 0x7f79241049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 --2- 172.21.15.120:0/2976552297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924108f00 0x7f7924109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 -- 172.21.15.120:0/2976552297 >> 172.21.15.120:0/2976552297 conn(0x7f79240ffea0 msgr2=0x7f79241022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.590+0000 7f792c200700 1 -- 172.21.15.120:0/2976552297 shutdown_connections 2024-05-14T09:21:58.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.591+0000 7f792c200700 1 -- 172.21.15.120:0/2976552297 wait complete. 2024-05-14T09:21:58.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.592+0000 7f792c200700 1 Processor -- start 2024-05-14T09:21:58.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.592+0000 7f792c200700 1 -- start start 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f792c200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79241045d0 0x7f7924076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f792c200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7924108f00 0x7f7924077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f792c200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924109850 0x7f7924077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f792c200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7924114380 con 0x7f79241045d0 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f792c200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7924114200 con 0x7f7924109850 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f792c200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7924114500 con 0x7f7924108f00 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f7929800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79241045d0 0x7f7924076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f7929800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79241045d0 0x7f7924076bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59836/0 (socket says 172.21.15.120:59836) 2024-05-14T09:21:58.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.593+0000 7f7929800700 1 -- 172.21.15.120:0/2969175200 learned_addr learned my addr 172.21.15.120:0/2969175200 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:58.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f7928e00700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7924108f00 0x7f7924077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f792a200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924109850 0x7f7924077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f7929800700 1 -- 172.21.15.120:0/2969175200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7924108f00 msgr2=0x7f7924077110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f7929800700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7924108f00 0x7f7924077110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f7929800700 1 -- 172.21.15.120:0/2969175200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924109850 msgr2=0x7f7924077650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f7929800700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924109850 0x7f7924077650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f7929800700 1 -- 172.21.15.120:0/2969175200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79241a9020 con 0x7f79241045d0 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f792a200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924109850 0x7f7924077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.594+0000 7f7929800700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79241045d0 0x7f7924076bd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f791800d950 tx=0x7f791800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.595+0000 7f7922000700 1 -- 172.21.15.120:0/2969175200 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918016070 con 0x7f79241045d0 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.595+0000 7f7922000700 1 -- 172.21.15.120:0/2969175200 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7918010460 con 0x7f79241045d0 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.595+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79241a9310 con 0x7f79241045d0 2024-05-14T09:21:58.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.595+0000 7f7922000700 1 -- 172.21.15.120:0/2969175200 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791800f620 con 0x7f79241045d0 2024-05-14T09:21:58.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.595+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79241a98a0 con 0x7f79241045d0 2024-05-14T09:21:58.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.599+0000 7f7922000700 1 -- 172.21.15.120:0/2969175200 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7918019070 con 0x7f79241045d0 2024-05-14T09:21:58.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.600+0000 7f793ad12b80 1 Processor -- start 2024-05-14T09:21:58.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.600+0000 7f793ad12b80 1 -- start start 2024-05-14T09:21:58.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.600+0000 7f7922000700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f790c0b2900 0x7f790c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.600+0000 7f7922000700 1 -- 172.21.15.120:0/2969175200 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f79180e21a0 con 0x7f79241045d0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.600+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7cbedf0 0x561cc7e422a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.600+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e427e0 0x561cc7e3c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.600+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f793ad12b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561cc7d5e9d0 con 0x561cc7e3c9a0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f793ad12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561cc7cfc710 con 0x561cc7e427e0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f793ad12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561cc7d5a990 con 0x561cc7cbedf0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f792a200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f790c0b2900 0x7f790c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f7928e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e427e0 0x561cc7e3c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f7929800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7cbedf0 0x561cc7e422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f792a200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f7929800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7cbedf0 0x561cc7e422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:47316/0 (socket says 172.21.15.120:47316) 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f7928e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e427e0 0x561cc7e3c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55386/0 (socket says 172.21.15.120:55386) 2024-05-14T09:21:58.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.601+0000 7f7929800700 1 -- 172.21.15.120:0/1975041785 learned_addr learned my addr 172.21.15.120:0/1975041785 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:58.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f792a200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f790c0b2900 0x7f790c0b4e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f791c00b0d0 tx=0x7f791c009230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:58.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f7929800700 1 -- 172.21.15.120:0/1975041785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e427e0 msgr2=0x561cc7e3c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f7929800700 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e427e0 0x561cc7e3c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f7929800700 1 -- 172.21.15.120:0/1975041785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 msgr2=0x561cc7e3cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f7929800700 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f7929800700 1 -- 172.21.15.120:0/1975041785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc7cab880 con 0x561cc7cbedf0 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f792a200700 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.602+0000 7f7929800700 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7cbedf0 0x561cc7e422a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79180a5440 tx=0x7f79180a8ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46166652b8d719d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.603+0000 7f7916a00700 1 -- 172.21.15.120:0/1975041785 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918020070 con 0x561cc7cbedf0 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.603+0000 7f7916a00700 1 -- 172.21.15.120:0/1975041785 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79180a93c0 con 0x561cc7cbedf0 2024-05-14T09:21:58.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.603+0000 7f7916a00700 1 -- 172.21.15.120:0/1975041785 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180a9880 con 0x561cc7cbedf0 2024-05-14T09:21:58.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 -- 172.21.15.120:0/1975041785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7cbedf0 msgr2=0x561cc7e422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7cbedf0 0x561cc7e422a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79180a5440 tx=0x7f79180a8ed0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 -- 172.21.15.120:0/1975041785 shutdown_connections 2024-05-14T09:21:58.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7cbedf0 0x561cc7e422a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1975041785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e427e0 0x561cc7e3c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 -- 172.21.15.120:0/1975041785 >> 172.21.15.120:0/1975041785 conn(0x561cc7d03f20 msgr2=0x561cc7e37280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:58.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 -- 172.21.15.120:0/1975041785 shutdown_connections 2024-05-14T09:21:58.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.604+0000 7f793ad12b80 1 -- 172.21.15.120:0/1975041785 wait complete. 2024-05-14T09:21:58.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 -- start start 2024-05-14T09:21:58.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 Processor -- start 2024-05-14T09:21:58.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e45ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e46410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 0x561cc7e46950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e49260 con 0x561cc7e3c9a0 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561cc7cc4ad0 con 0x561cc7cbedf0 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.605+0000 7f793ad12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e493e0 con 0x561cc7e427e0 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f793ad12b80 10 client.0 _ll_register_callbacks cb 0x561cc7d05c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e46410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e46410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59850/0 (socket says 172.21.15.120:59850) 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 -- 172.21.15.120:0/78947046 learned_addr learned my addr 172.21.15.120:0/78947046 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7929800700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e45ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f792a200700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 0x561cc7e46950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 -- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 msgr2=0x561cc7e46950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 0x561cc7e46950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 -- 172.21.15.120:0/78947046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 msgr2=0x561cc7e45ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e45ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7928e00700 1 -- 172.21.15.120:0/78947046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc7d243d0 con 0x561cc7e3c9a0 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.606+0000 7f7929800700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e45ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f7928e00700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e46410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7910011730 tx=0x7f7910011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946f41d5d6dbeda9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f790b400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f790b400700 1 -- 172.21.15.120:0/78947046 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791001e060 con 0x561cc7e3c9a0 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79180a93c0 con 0x561cc7e3c9a0 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f790b400700 1 -- 172.21.15.120:0/78947046 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f791000f9f0 con 0x561cc7e3c9a0 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f790b400700 1 -- 172.21.15.120:0/78947046 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7910025050 con 0x561cc7e3c9a0 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f793ad12b80 10 client.15060 fetch_fsmap learned FSMap version 29 2024-05-14T09:21:58.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.607+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561cc7e53e10 con 0x561cc7e3c9a0 2024-05-14T09:21:58.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f790b400700 1 -- 172.21.15.120:0/78947046 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79180a93c0 con 0x561cc7e3c9a0 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f790b400700 1 -- 172.21.15.120:0/78947046 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7910018030 con 0x561cc7e3c9a0 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f793ad12b80 10 client.15060 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f793ad12b80 10 client.15060 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f793ad12b80 20 client.15060 populate_metadata read hostname 'smithi120' 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f793ad12b80 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7e56420 0x561cc7e57890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f793ad12b80 4 client.15060 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.608+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc7e09170 con 0x561cc7e56420 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.609+0000 7f7929800700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7e56420 0x561cc7e57890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.610+0000 7f7929800700 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7e56420 0x561cc7e57890 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c11a6305524f8502 server_cookie=24ce340d283e5bcf in_seq=0 out_seq=0 2024-05-14T09:21:58.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.610+0000 7f790b400700 10 client.15060 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.612+0000 7f790b400700 1 -- 172.21.15.120:0/78947046 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561cc7e09170 con 0x561cc7e56420 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.612+0000 7f790b400700 10 client.15060 handle_command_reply: tid=0 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.612+0000 7f793ad12b80 1 client.15060 shutdown 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.612+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 msgr2=0x561cc7e46410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.612+0000 7f793ad12b80 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e46410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7910011730 tx=0x7f7910011af0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 shutdown_connections 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e45ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7e56420 0x561cc7e57890 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 0x561cc7e46950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 --2- 172.21.15.120:0/78947046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e3c9a0 0x561cc7e46410 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 >> 172.21.15.120:0/78947046 conn(0x561cc7d03f20 msgr2=0x561cc7e3b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:58.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f790b400700 0 client.15060 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:21:58.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 shutdown_connections 2024-05-14T09:21:58.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 1 -- 172.21.15.120:0/78947046 wait complete. 2024-05-14T09:21:58.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.613+0000 7f793ad12b80 20 client.15060 trim_cache size 0 max 16384 2024-05-14T09:21:58.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.636+0000 7f793ad12b80 1 Processor -- start 2024-05-14T09:21:58.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f793ad12b80 1 -- start start 2024-05-14T09:21:58.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e3c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e427e0 0x561cc7e3fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f793ad12b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e55bd0 con 0x561cc7e427e0 2024-05-14T09:21:58.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f793ad12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e562a0 con 0x561cc7cbedf0 2024-05-14T09:21:58.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f793ad12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e56970 con 0x561cc7e3c9a0 2024-05-14T09:21:58.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.637+0000 7f792a200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e427e0 0x561cc7e3fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e427e0 0x561cc7e3fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59866/0 (socket says 172.21.15.120:59866) 2024-05-14T09:21:58.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 -- 172.21.15.120:0/1182622680 learned_addr learned my addr 172.21.15.120:0/1182622680 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:58.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f7929800700 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e3c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f7928e00700 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 -- 172.21.15.120:0/1182622680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e3c9a0 msgr2=0x561cc7e3cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 -- 172.21.15.120:0/1182622680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 msgr2=0x561cc7e3c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e3c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 -- 172.21.15.120:0/1182622680 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc7e48eb0 con 0x561cc7e427e0 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.638+0000 7f792a200700 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e427e0 0x561cc7e3fc60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f791c004ce0 tx=0x7f791c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d900d4f22a96fa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.639+0000 7f7916000700 1 -- 172.21.15.120:0/1182622680 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c02e070 con 0x561cc7e427e0 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.639+0000 7f7916000700 1 -- 172.21.15.120:0/1182622680 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f791c007c70 con 0x561cc7e427e0 2024-05-14T09:21:58.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.639+0000 7f7916000700 1 -- 172.21.15.120:0/1182622680 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c026070 con 0x561cc7e427e0 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 -- 172.21.15.120:0/1182622680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e427e0 msgr2=0x561cc7e3fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e427e0 0x561cc7e3fc60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f791c004ce0 tx=0x7f791c022000 comp rx=0 tx=0).stop 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 -- 172.21.15.120:0/1182622680 shutdown_connections 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7cbedf0 0x561cc7e3c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7e427e0 0x561cc7e3fc60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 --2- 172.21.15.120:0/1182622680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 -- 172.21.15.120:0/1182622680 >> 172.21.15.120:0/1182622680 conn(0x561cc7d03f20 msgr2=0x561cc7e447c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 -- 172.21.15.120:0/1182622680 shutdown_connections 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 -- 172.21.15.120:0/1182622680 wait complete. 2024-05-14T09:21:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.640+0000 7f793ad12b80 1 -- start start 2024-05-14T09:21:58.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 1 Processor -- start 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7cbedf0 0x561cc7e3b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 0x561cc7e3c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e57710 con 0x561cc7cbedf0 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e57040 con 0x561cc7e3c9a0 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561cc7e57de0 con 0x561cc7e427e0 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f793ad12b80 10 client.0 _ll_register_callbacks cb 0x561cc7d05c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.641+0000 7f7929800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7cbedf0 0x561cc7e3b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7cbedf0 0x561cc7e3b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59874/0 (socket says 172.21.15.120:59874) 2024-05-14T09:21:58.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 -- 172.21.15.120:0/4058180847 learned_addr learned my addr 172.21.15.120:0/4058180847 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7928e00700 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 -- 172.21.15.120:0/4058180847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 msgr2=0x561cc7e3c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 0x561cc7e3c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 -- 172.21.15.120:0/4058180847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e3c9a0 msgr2=0x561cc7e3bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 -- 172.21.15.120:0/4058180847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc7e5f090 con 0x561cc7cbedf0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f7929800700 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7cbedf0 0x561cc7e3b5d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79180a6630 tx=0x7f7918000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97800be6515742f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.642+0000 7f790b400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f790b400700 1 -- 172.21.15.120:0/4058180847 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180c2070 con 0x561cc7cbedf0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f790b400700 1 -- 172.21.15.120:0/4058180847 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f79180a9820 con 0x561cc7cbedf0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f791c007c70 con 0x561cc7cbedf0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f790b400700 1 -- 172.21.15.120:0/4058180847 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7918020040 con 0x561cc7cbedf0 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f793ad12b80 10 client.15066 fetch_fsmap learned FSMap version 29 2024-05-14T09:21:58.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561cc7ec1b10 con 0x561cc7cbedf0 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f790b400700 1 -- 172.21.15.120:0/4058180847 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f791c007c70 con 0x561cc7cbedf0 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f790b400700 1 -- 172.21.15.120:0/4058180847 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f79180a8620 con 0x561cc7cbedf0 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f793ad12b80 10 client.15066 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f793ad12b80 10 client.15066 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f793ad12b80 20 client.15066 populate_metadata read hostname 'smithi120' 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.643+0000 7f793ad12b80 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7ec3ae0 0x561cc7ec4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.644+0000 7f793ad12b80 4 client.15066 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:21:58.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.644+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "status"}) -- 0x561cc7d6c3b0 con 0x561cc7ec3ae0 2024-05-14T09:21:58.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.644+0000 7f7928e00700 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7ec3ae0 0x561cc7ec4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.645+0000 7f7928e00700 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7ec3ae0 0x561cc7ec4f50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e52fe43bc1a628ec server_cookie=f94ff6a3fc56446 in_seq=0 out_seq=0 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.645+0000 7f790b400700 10 client.15066 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f790b400700 1 -- 172.21.15.120:0/4058180847 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561cc7d6c3b0 con 0x561cc7ec3ae0 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f790b400700 10 client.15066 handle_command_reply: tid=0 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 client.15066 shutdown 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7cbedf0 msgr2=0x561cc7e3b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7cbedf0 0x561cc7e3b5d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79180a6630 tx=0x7f7918000bc0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 shutdown_connections 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x561cc7ec3ae0 0x561cc7ec4f50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc7e427e0 0x561cc7e3c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561cc7cbedf0 0x561cc7e3b5d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 --2- 172.21.15.120:0/4058180847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cc7e3c9a0 0x561cc7e3bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 >> 172.21.15.120:0/4058180847 conn(0x561cc7d03f20 msgr2=0x561cc7e3fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f790b400700 0 client.15066 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 shutdown_connections 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 1 -- 172.21.15.120:0/4058180847 wait complete. 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.646+0000 7f793ad12b80 20 client.15066 trim_cache size 0 max 16384 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 3, 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24469, 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:21:58.649 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:21:58.650 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 150.69369442999999, 2024-05-14T09:21:58.650 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:21:58.650 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:21:58.650 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:21:58.650 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 267.361974911 2024-05-14T09:21:58.650 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f790c0b2900 msgr2=0x7f790c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f790c0b2900 0x7f790c0b4e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f791c00b0d0 tx=0x7f791c009230 comp rx=0 tx=0).stop 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79241045d0 msgr2=0x7f7924076bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79241045d0 0x7f7924076bd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f791800d950 tx=0x7f791800dd10 comp rx=0 tx=0).stop 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 shutdown_connections 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f790c0b2900 0x7f790c0b4e10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924109850 0x7f7924077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79241045d0 0x7f7924076bd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 --2- 172.21.15.120:0/2969175200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7924108f00 0x7f7924077110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 >> 172.21.15.120:0/2969175200 conn(0x7f79240ffea0 msgr2=0x7f79241086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 shutdown_connections 2024-05-14T09:21:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:21:58.647+0000 7f792c200700 1 -- 172.21.15.120:0/2969175200 wait complete. 2024-05-14T09:21:59.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.k status 2024-05-14T09:21:59.961 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:00.107 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:21:59 smithi120 ceph-mon[31085]: pgmap v509: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:21:59 smithi152 ceph-mon[34868]: pgmap v509: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:21:59 smithi175 ceph-mon[35353]: pgmap v509: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:02.061 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:01 smithi120 ceph-mon[31085]: pgmap v510: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:01 smithi152 ceph-mon[34868]: pgmap v510: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:01 smithi175 ceph-mon[35353]: pgmap v510: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 -- 172.21.15.120:0/3066535520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48110ba0 msgr2=0x7ffa48113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 --2- 172.21.15.120:0/3066535520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48110ba0 0x7ffa48113000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000b0a0 tx=0x7ffa4000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 -- 172.21.15.120:0/3066535520 shutdown_connections 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 --2- 172.21.15.120:0/3066535520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48110ba0 0x7ffa48113000 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 --2- 172.21.15.120:0/3066535520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa48075d30 0x7ffa48076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 --2- 172.21.15.120:0/3066535520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa48076680 0x7ffa48110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 -- 172.21.15.120:0/3066535520 >> 172.21.15.120:0/3066535520 conn(0x7ffa48100040 msgr2=0x7ffa48102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 -- 172.21.15.120:0/3066535520 shutdown_connections 2024-05-14T09:22:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.438+0000 7ffa4e800700 1 -- 172.21.15.120:0/3066535520 wait complete. 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.439+0000 7ffa4e800700 1 Processor -- start 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.439+0000 7ffa4e800700 1 -- start start 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.439+0000 7ffa4e800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48075d30 0x7ffa4819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.439+0000 7ffa4e800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa48076680 0x7ffa4819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.439+0000 7ffa4e800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa48110ba0 0x7ffa481a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa4e800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48116530 con 0x7ffa48075d30 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa4e800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481163b0 con 0x7ffa48076680 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa4e800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481166b0 con 0x7ffa48110ba0 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48075d30 0x7ffa4819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48075d30 0x7ffa4819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59890/0 (socket says 172.21.15.120:59890) 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 -- 172.21.15.120:0/120389095 learned_addr learned my addr 172.21.15.120:0/120389095 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa48076680 0x7ffa4819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47e00700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa48110ba0 0x7ffa481a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 -- 172.21.15.120:0/120389095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa48110ba0 msgr2=0x7ffa481a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa48110ba0 0x7ffa481a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 -- 172.21.15.120:0/120389095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa48076680 msgr2=0x7ffa4819d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa48076680 0x7ffa4819d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47400700 1 -- 172.21.15.120:0/120389095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa481a1d90 con 0x7ffa48075d30 2024-05-14T09:22:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.440+0000 7ffa47e00700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa48110ba0 0x7ffa481a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:02.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.441+0000 7ffa47400700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48075d30 0x7ffa4819cec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c920 tx=0x7ffa3800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:02.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.441+0000 7ffa44c00700 1 -- 172.21.15.120:0/120389095 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38007b00 con 0x7ffa48075d30 2024-05-14T09:22:02.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.441+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa481a2020 con 0x7ffa48075d30 2024-05-14T09:22:02.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.441+0000 7ffa44c00700 1 -- 172.21.15.120:0/120389095 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa38004cc0 con 0x7ffa48075d30 2024-05-14T09:22:02.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.441+0000 7ffa44c00700 1 -- 172.21.15.120:0/120389095 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380054a0 con 0x7ffa48075d30 2024-05-14T09:22:02.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.441+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa481a99a0 con 0x7ffa48075d30 2024-05-14T09:22:02.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.445+0000 7ffa44c00700 1 -- 172.21.15.120:0/120389095 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ffa38004750 con 0x7ffa48075d30 2024-05-14T09:22:02.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.446+0000 7ffa5d298b80 1 Processor -- start 2024-05-14T09:22:02.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.446+0000 7ffa5d298b80 1 -- start start 2024-05-14T09:22:02.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893afc00 0x5619893b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5619892d19d0 con 0x561989231df0 2024-05-14T09:22:02.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56198926f710 con 0x5619893afc00 2024-05-14T09:22:02.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619892cd990 con 0x5619893b5ba0 2024-05-14T09:22:02.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa44c00700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffa2c0b2900 0x7ffa2c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa47e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa47e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893b5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59904/0 (socket says 172.21.15.120:59904) 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa47e00700 1 -- 172.21.15.120:0/713644315 learned_addr learned my addr 172.21.15.120:0/713644315 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa44c00700 1 -- 172.21.15.120:0/120389095 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ffa380e21b0 con 0x7ffa48075d30 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.447+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893afc00 0x5619893b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.448+0000 7ffa47e00700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffa2c0b2900 0x7ffa2c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.448+0000 7ffa47400700 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.448+0000 7ffa47e00700 1 -- 172.21.15.120:0/713644315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 msgr2=0x5619893af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.448+0000 7ffa47e00700 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.448+0000 7ffa47e00700 1 -- 172.21.15.120:0/713644315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893afc00 msgr2=0x5619893b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.448+0000 7ffa47e00700 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893afc00 0x5619893b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.448+0000 7ffa47e00700 1 -- 172.21.15.120:0/713644315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198921e880 con 0x561989231df0 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.449+0000 7ffa47e00700 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893b5660 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffa40015000 tx=0x7ffa40004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3d2295c85f2f5d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.449+0000 7ffa47e00700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffa2c0b2900 0x7ffa2c0b4e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000b070 tx=0x7ffa40013000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.449+0000 7ffa3cc00700 1 -- 172.21.15.120:0/713644315 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4002c020 con 0x561989231df0 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.449+0000 7ffa3cc00700 1 -- 172.21.15.120:0/713644315 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa40009270 con 0x561989231df0 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.449+0000 7ffa3cc00700 1 -- 172.21.15.120:0/713644315 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4001eb30 con 0x561989231df0 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 -- 172.21.15.120:0/713644315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 msgr2=0x5619893b5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893b5660 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffa40015000 tx=0x7ffa40004bb0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 -- 172.21.15.120:0/713644315 shutdown_connections 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893afc00 0x5619893b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893b5660 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/713644315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 -- 172.21.15.120:0/713644315 >> 172.21.15.120:0/713644315 conn(0x561989270a30 msgr2=0x5619893aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 -- 172.21.15.120:0/713644315 shutdown_connections 2024-05-14T09:22:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.450+0000 7ffa5d298b80 1 -- 172.21.15.120:0/713644315 wait complete. 2024-05-14T09:22:02.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.451+0000 7ffa5d298b80 1 -- start start 2024-05-14T09:22:02.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.451+0000 7ffa5d298b80 1 Processor -- start 2024-05-14T09:22:02.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561989231df0 0x5619893b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893b9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5619893bc610 con 0x5619893afc00 2024-05-14T09:22:02.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561989237ad0 con 0x561989231df0 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619893bc790 con 0x5619893b5ba0 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa5d298b80 10 client.0 _ll_register_callbacks cb 0x561989265330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa3ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa3ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59914/0 (socket says 172.21.15.120:59914) 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa3ea00700 1 -- 172.21.15.120:0/2125481118 learned_addr learned my addr 172.21.15.120:0/2125481118 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa47400700 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561989231df0 0x5619893b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.452+0000 7ffa47e00700 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893b9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa3ea00700 1 -- 172.21.15.120:0/2125481118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 msgr2=0x5619893b9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893b9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa3ea00700 1 -- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561989231df0 msgr2=0x5619893b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561989231df0 0x5619893b93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa3ea00700 1 -- 172.21.15.120:0/2125481118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619892973d0 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b9910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000da10 tx=0x7ffa3000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb01aadc6912fa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa35600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa35600700 1 -- 172.21.15.120:0/2125481118 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30011440 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa40009270 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.453+0000 7ffa35600700 1 -- 172.21.15.120:0/2125481118 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ffa300115e0 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa35600700 1 -- 172.21.15.120:0/2125481118 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffa300117e0 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa5d298b80 10 client.15078 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5619893c72d0 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa35600700 1 -- 172.21.15.120:0/2125481118 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa40009270 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa35600700 1 -- 172.21.15.120:0/2125481118 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffa30019030 con 0x5619893afc00 2024-05-14T09:22:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa5d298b80 10 client.15078 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa5d298b80 10 client.15078 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa5d298b80 20 client.15078 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.454+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5619893c98f0 0x5619893cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.455+0000 7ffa5d298b80 4 client.15078 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.455+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56198937c020 con 0x5619893c98f0 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.455+0000 7ffa47400700 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5619893c98f0 0x5619893cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.456+0000 7ffa35600700 10 client.15078 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:02.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.456+0000 7ffa47400700 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5619893c98f0 0x5619893cad60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b7c1720f1b4f062 server_cookie=5f673d7c684fe3f2 in_seq=0 out_seq=0 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa35600700 1 -- 172.21.15.120:0/2125481118 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56198937c020 con 0x5619893c98f0 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa35600700 10 client.15078 handle_command_reply: tid=0 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 client.15078 shutdown 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 msgr2=0x5619893b9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b9910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000da10 tx=0x7ffa3000ddd0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 shutdown_connections 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561989231df0 0x5619893b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5619893c98f0 0x5619893cad60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893b5ba0 0x5619893b9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/2125481118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b9910 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 >> 172.21.15.120:0/2125481118 conn(0x561989270a30 msgr2=0x5619893ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:02.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.459+0000 7ffa35600700 0 client.15078 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:02.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.460+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 shutdown_connections 2024-05-14T09:22:02.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.460+0000 7ffa5d298b80 1 -- 172.21.15.120:0/2125481118 wait complete. 2024-05-14T09:22:02.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.460+0000 7ffa5d298b80 20 client.15078 trim_cache size 0 max 16384 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.483+0000 7ffa5d298b80 1 Processor -- start 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.483+0000 7ffa5d298b80 1 -- start start 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561989231df0 0x5619893af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5619893c90a0 con 0x5619893afc00 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5619893c9770 con 0x5619893b5ba0 2024-05-14T09:22:02.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619893c9e40 con 0x561989231df0 2024-05-14T09:22:02.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa3ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa3ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59928/0 (socket says 172.21.15.120:59928) 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa3ea00700 1 -- 172.21.15.120:0/3166762708 learned_addr learned my addr 172.21.15.120:0/3166762708 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa47e00700 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa47400700 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561989231df0 0x5619893af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa3ea00700 1 -- 172.21.15.120:0/3166762708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561989231df0 msgr2=0x5619893af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561989231df0 0x5619893af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa3ea00700 1 -- 172.21.15.120:0/3166762708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 msgr2=0x5619893c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.484+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.485+0000 7ffa3ea00700 1 -- 172.21.15.120:0/3166762708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619893bbc70 con 0x5619893afc00 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.485+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b8330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffa3001ab30 tx=0x7ffa3000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fda490f487e6c15 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.485+0000 7ffa37e00700 1 -- 172.21.15.120:0/3166762708 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30011440 con 0x5619893afc00 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.485+0000 7ffa37e00700 1 -- 172.21.15.120:0/3166762708 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa3002c070 con 0x5619893afc00 2024-05-14T09:22:02.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.485+0000 7ffa37e00700 1 -- 172.21.15.120:0/3166762708 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30011d00 con 0x5619893afc00 2024-05-14T09:22:02.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3166762708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 msgr2=0x5619893b8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b8330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffa3001ab30 tx=0x7ffa3000df70 comp rx=0 tx=0).stop 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3166762708 shutdown_connections 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561989231df0 0x5619893af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3166762708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619893afc00 0x5619893b8330 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3166762708 >> 172.21.15.120:0/3166762708 conn(0x561989270a30 msgr2=0x5619893a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3166762708 shutdown_connections 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.486+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3166762708 wait complete. 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.487+0000 7ffa5d298b80 1 -- start start 2024-05-14T09:22:02.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.487+0000 7ffa5d298b80 1 Processor -- start 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893d4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893afc00 0x5619893c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa5d298b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5619893cabe0 con 0x561989231df0 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5619893ca510 con 0x5619893b5ba0 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa5d298b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619893cb2b0 con 0x5619893afc00 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa5d298b80 10 client.0 _ll_register_callbacks cb 0x561989265330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa47400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893d4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa47400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893d4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59934/0 (socket says 172.21.15.120:59934) 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa47400700 1 -- 172.21.15.120:0/3683109309 learned_addr learned my addr 172.21.15.120:0/3683109309 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa47e00700 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.488+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893afc00 0x5619893c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa47400700 1 -- 172.21.15.120:0/3683109309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893afc00 msgr2=0x5619893c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa47400700 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893afc00 0x5619893c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa47400700 1 -- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 msgr2=0x5619893c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa47400700 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa47400700 1 -- 172.21.15.120:0/3683109309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619893c5700 con 0x561989231df0 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa47400700 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893d4710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffa380a90d0 tx=0x7ffa380b22e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f723705892c5ba5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa35600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa35600700 1 -- 172.21.15.120:0/3683109309 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380c3060 con 0x561989231df0 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa35600700 1 -- 172.21.15.120:0/3683109309 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ffa38007ca0 con 0x561989231df0 2024-05-14T09:22:02.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.489+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa3002c070 con 0x561989231df0 2024-05-14T09:22:02.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa35600700 1 -- 172.21.15.120:0/3683109309 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffa3801d040 con 0x561989231df0 2024-05-14T09:22:02.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 10 client.15084 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:02.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56198943d570 con 0x561989231df0 2024-05-14T09:22:02.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa35600700 1 -- 172.21.15.120:0/3683109309 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa3002c070 con 0x561989231df0 2024-05-14T09:22:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa35600700 1 -- 172.21.15.120:0/3683109309 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffa380ca240 con 0x561989231df0 2024-05-14T09:22:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 10 client.15084 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 10 client.15084 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T09:22:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 20 client.15084 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x56198943fa10 0x561989440e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 4 client.15084 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:22:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.490+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "status"}) -- 0x5619892df3b0 con 0x56198943fa10 2024-05-14T09:22:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.491+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x56198943fa10 0x561989440e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.492+0000 7ffa3ea00700 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x56198943fa10 0x561989440e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c5c8741abf754d4 server_cookie=6957f2c4f4a8b03f in_seq=0 out_seq=0 2024-05-14T09:22:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.492+0000 7ffa35600700 10 client.15084 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa35600700 1 -- 172.21.15.120:0/3683109309 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5619892df3b0 con 0x56198943fa10 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa35600700 10 client.15084 handle_command_reply: tid=0 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 client.15084 shutdown 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 msgr2=0x5619893d4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893d4710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffa380a90d0 tx=0x7ffa380b22e0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 shutdown_connections 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619893b5ba0 0x5619893c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x56198943fa10 0x561989440e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561989231df0 0x5619893d4710 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 --2- 172.21.15.120:0/3683109309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619893afc00 0x5619893c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 >> 172.21.15.120:0/3683109309 conn(0x561989270a30 msgr2=0x5619893a9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa35600700 0 client.15084 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 shutdown_connections 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.493+0000 7ffa5d298b80 1 -- 172.21.15.120:0/3683109309 wait complete. 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa5d298b80 20 client.15084 trim_cache size 0 max 16384 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 34388, 2024-05-14T09:22:02.496 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 155.55945897199999, 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 302.113497 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:22:02.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffa2c0b2900 msgr2=0x7ffa2c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffa2c0b2900 0x7ffa2c0b4e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000b070 tx=0x7ffa40013000 comp rx=0 tx=0).stop 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48075d30 msgr2=0x7ffa4819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48075d30 0x7ffa4819cec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c920 tx=0x7ffa3800cce0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 shutdown_connections 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffa2c0b2900 0x7ffa2c0b4e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa48110ba0 0x7ffa481a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa48075d30 0x7ffa4819cec0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 --2- 172.21.15.120:0/120389095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa48076680 0x7ffa4819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.494+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 >> 172.21.15.120:0/120389095 conn(0x7ffa48100040 msgr2=0x7ffa48100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.495+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 shutdown_connections 2024-05-14T09:22:02.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:02.495+0000 7ffa4e800700 1 -- 172.21.15.120:0/120389095 wait complete. 2024-05-14T09:22:03.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.e status 2024-05-14T09:22:03.857 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:03 smithi120 ceph-mon[31085]: pgmap v511: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:03 smithi152 ceph-mon[34868]: pgmap v511: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:03 smithi175 ceph-mon[35353]: pgmap v511: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:06.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.075+0000 7fad1ec00700 1 -- 172.21.15.120:0/3442833275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 msgr2=0x7fad18108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.075+0000 7fad1ec00700 1 --2- 172.21.15.120:0/3442833275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad18108200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fad040099c0 tx=0x7fad04009cd0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.076+0000 7fad1ec00700 1 -- 172.21.15.120:0/3442833275 shutdown_connections 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.076+0000 7fad1ec00700 1 --2- 172.21.15.120:0/3442833275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad18108740 0x7fad181100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.076+0000 7fad1ec00700 1 --2- 172.21.15.120:0/3442833275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad181034c0 0x7fad181038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.076+0000 7fad1ec00700 1 --2- 172.21.15.120:0/3442833275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad18108200 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.076+0000 7fad1ec00700 1 -- 172.21.15.120:0/3442833275 >> 172.21.15.120:0/3442833275 conn(0x7fad180fedc0 msgr2=0x7fad181011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.076+0000 7fad1ec00700 1 -- 172.21.15.120:0/3442833275 shutdown_connections 2024-05-14T09:22:06.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.076+0000 7fad1ec00700 1 -- 172.21.15.120:0/3442833275 wait complete. 2024-05-14T09:22:06.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 Processor -- start 2024-05-14T09:22:06.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 -- start start 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad181034c0 0x7fad1819ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad1819b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad18108740 0x7fad1819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fad18114330 con 0x7fad18107df0 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad181141b0 con 0x7fad18108740 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.077+0000 7fad1ec00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad181144b0 con 0x7fad181034c0 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad1819b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad1819b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59954/0 (socket says 172.21.15.120:59954) 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 -- 172.21.15.120:0/1420285842 learned_addr learned my addr 172.21.15.120:0/1420285842 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17e00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad181034c0 0x7fad1819ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad1cc00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad18108740 0x7fad1819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.080 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:05 smithi120 ceph-mon[31085]: pgmap v512: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:06.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 -- 172.21.15.120:0/1420285842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad181034c0 msgr2=0x7fad1819ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad181034c0 0x7fad1819ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 -- 172.21.15.120:0/1420285842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad18108740 msgr2=0x7fad1819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad18108740 0x7fad1819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.078+0000 7fad17400700 1 -- 172.21.15.120:0/1420285842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1819fbf0 con 0x7fad18107df0 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.079+0000 7fad1cc00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad18108740 0x7fad1819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.079+0000 7fad17400700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad1819b2c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad0400b580 tx=0x7fad040057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.079+0000 7fad14c00700 1 -- 172.21.15.120:0/1420285842 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04027070 con 0x7fad18107df0 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.079+0000 7fad14c00700 1 -- 172.21.15.120:0/1420285842 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad0400fd30 con 0x7fad18107df0 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.079+0000 7fad14c00700 1 -- 172.21.15.120:0/1420285842 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040173f0 con 0x7fad18107df0 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.079+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1819fe80 con 0x7fad18107df0 2024-05-14T09:22:06.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.080+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad181a7800 con 0x7fad18107df0 2024-05-14T09:22:06.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.084+0000 7fad14c00700 1 -- 172.21.15.120:0/1420285842 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fad0402a070 con 0x7fad18107df0 2024-05-14T09:22:06.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.084+0000 7fad2d661b80 1 Processor -- start 2024-05-14T09:22:06.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad2d661b80 1 -- start start 2024-05-14T09:22:06.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef702fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef7029ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef702a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad2d661b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559ef6f479d0 con 0x559ef702a010 2024-05-14T09:22:06.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad2d661b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ef6ee5710 con 0x559ef702ff60 2024-05-14T09:22:06.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad2d661b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559ef6f43990 con 0x559ef6ea7df0 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.085+0000 7fad17400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef702a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef702a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59960/0 (socket says 172.21.15.120:59960) 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17400700 1 -- 172.21.15.120:0/3695620724 learned_addr learned my addr 172.21.15.120:0/3695620724 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad1cc00700 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef702fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17e00700 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef7029ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad14c00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facfc0b2900 0x7facfc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17400700 1 -- 172.21.15.120:0/3695620724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 msgr2=0x559ef702fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17400700 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef702fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17400700 1 -- 172.21.15.120:0/3695620724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 msgr2=0x559ef7029ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17400700 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef7029ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17400700 1 -- 172.21.15.120:0/3695620724 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef6e94880 con 0x559ef702a010 2024-05-14T09:22:06.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad17e00700 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef7029ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:22:06.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.086+0000 7fad14c00700 1 -- 172.21.15.120:0/1420285842 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fad040e33c0 con 0x7fad18107df0 2024-05-14T09:22:06.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.087+0000 7fad1cc00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facfc0b2900 0x7facfc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.087+0000 7fad17400700 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef702a420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad04077890 tx=0x7fad0406fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72270c1afa7e567 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.087+0000 7fad0d600700 1 -- 172.21.15.120:0/3695620724 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040aa440 con 0x559ef702a010 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.087+0000 7fad0d600700 1 -- 172.21.15.120:0/3695620724 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad04077060 con 0x559ef702a010 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.087+0000 7fad0d600700 1 -- 172.21.15.120:0/3695620724 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040700c0 con 0x559ef702a010 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.088+0000 7fad2d661b80 1 -- 172.21.15.120:0/3695620724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 msgr2=0x559ef702a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.088+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef702a420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad04077890 tx=0x7fad0406fbb0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.088+0000 7fad1cc00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facfc0b2900 0x7facfc0b4e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad1000de10 tx=0x7fad10004750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 -- 172.21.15.120:0/3695620724 shutdown_connections 2024-05-14T09:22:06.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef702a420 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef702fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3695620724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef7029ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 -- 172.21.15.120:0/3695620724 >> 172.21.15.120:0/3695620724 conn(0x559ef6ee6a30 msgr2=0x559ef7020740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:06.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 -- 172.21.15.120:0/3695620724 shutdown_connections 2024-05-14T09:22:06.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 -- 172.21.15.120:0/3695620724 wait complete. 2024-05-14T09:22:06.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.089+0000 7fad2d661b80 1 -- start start 2024-05-14T09:22:06.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 1 Processor -- start 2024-05-14T09:22:06.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef6ea7df0 0x559ef7033780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef7033cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef702ff60 0x559ef7034200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559ef7036820 con 0x559ef6ea7df0 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ef6eadad0 con 0x559ef702a010 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559ef70369a0 con 0x559ef702ff60 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.090+0000 7fad2d661b80 10 client.0 _ll_register_callbacks cb 0x559ef6edb330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef6ea7df0 0x559ef7033780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef6ea7df0 0x559ef7033780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59974/0 (socket says 172.21.15.120:59974) 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 -- 172.21.15.120:0/3343639399 learned_addr learned my addr 172.21.15.120:0/3343639399 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17400700 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef7033cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad1cc00700 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef702ff60 0x559ef7034200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 -- 172.21.15.120:0/3343639399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef702ff60 msgr2=0x559ef7034200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef702ff60 0x559ef7034200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 -- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 msgr2=0x559ef7033cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef7033cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.091+0000 7fad17e00700 1 -- 172.21.15.120:0/3343639399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef6f0d3d0 con 0x559ef6ea7df0 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad17e00700 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef6ea7df0 0x559ef7033780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad08004320 tx=0x7fad080046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e677542baea95cd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad02000700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad02000700 1 -- 172.21.15.120:0/3343639399 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0801a020 con 0x559ef6ea7df0 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad02000700 1 -- 172.21.15.120:0/3343639399 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fad08007bf0 con 0x559ef6ea7df0 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ef6ff2020 con 0x559ef6ea7df0 2024-05-14T09:22:06.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad02000700 1 -- 172.21.15.120:0/3343639399 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad08025050 con 0x559ef6ea7df0 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad2d661b80 10 client.15096 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ef7041340 con 0x559ef6ea7df0 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.092+0000 7fad02000700 1 -- 172.21.15.120:0/3343639399 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559ef6ff2020 con 0x559ef6ea7df0 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.093+0000 7fad02000700 1 -- 172.21.15.120:0/3343639399 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fad080153c0 con 0x559ef6ea7df0 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.093+0000 7fad2d661b80 10 client.15096 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.093+0000 7fad2d661b80 10 client.15096 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.093+0000 7fad2d661b80 20 client.15096 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.093+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70439c0 0x559ef7044e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.093+0000 7fad2d661b80 4 client.15096 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.093+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ef6f553b0 con 0x559ef70439c0 2024-05-14T09:22:06.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.094+0000 7fad17400700 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70439c0 0x559ef7044e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.095+0000 7fad02000700 10 client.15096 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:22:06.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.095+0000 7fad17400700 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70439c0 0x559ef7044e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d005fddcb2a69d1b server_cookie=5f4fb9d15923536c in_seq=0 out_seq=0 2024-05-14T09:22:06.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.097+0000 7fad02000700 1 -- 172.21.15.120:0/3343639399 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559ef6f553b0 con 0x559ef70439c0 2024-05-14T09:22:06.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.097+0000 7fad02000700 10 client.15096 handle_command_reply: tid=0 2024-05-14T09:22:06.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.097+0000 7fad2d661b80 1 client.15096 shutdown 2024-05-14T09:22:06.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef6ea7df0 msgr2=0x559ef7033780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef6ea7df0 0x559ef7033780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad08004320 tx=0x7fad080046e0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 shutdown_connections 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70439c0 0x559ef7044e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef702ff60 0x559ef7034200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef6ea7df0 0x559ef7033780 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 --2- 172.21.15.120:0/3343639399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef7033cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad02000700 0 client.15096 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 >> 172.21.15.120:0/3343639399 conn(0x559ef6ee6a30 msgr2=0x559ef70246b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 shutdown_connections 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 1 -- 172.21.15.120:0/3343639399 wait complete. 2024-05-14T09:22:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.098+0000 7fad2d661b80 20 client.15096 trim_cache size 0 max 16384 2024-05-14T09:22:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.121+0000 7fad2d661b80 1 Processor -- start 2024-05-14T09:22:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.121+0000 7fad2d661b80 1 -- start start 2024-05-14T09:22:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef7034040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef702daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702ff60 0x559ef703f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad2d661b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559ef7043170 con 0x559ef702ff60 2024-05-14T09:22:06.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad2d661b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ef7043840 con 0x559ef702a010 2024-05-14T09:22:06.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad2d661b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559ef7043f10 con 0x559ef6ea7df0 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad1cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702ff60 0x559ef703f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad1cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702ff60 0x559ef703f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59978/0 (socket says 172.21.15.120:59978) 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad1cc00700 1 -- 172.21.15.120:0/2782531297 learned_addr learned my addr 172.21.15.120:0/2782531297 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad17e00700 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef7034040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.122+0000 7fad17400700 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef702daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad1cc00700 1 -- 172.21.15.120:0/2782531297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 msgr2=0x559ef7034040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad1cc00700 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef7034040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad1cc00700 1 -- 172.21.15.120:0/2782531297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 msgr2=0x559ef702daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad1cc00700 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef702daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad1cc00700 1 -- 172.21.15.120:0/2782531297 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef70213a0 con 0x559ef702ff60 2024-05-14T09:22:06.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad1cc00700 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702ff60 0x559ef703f7b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fad1001e870 tx=0x7fad10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72576c51c9ef397 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:06.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad0cc00700 1 -- 172.21.15.120:0/2782531297 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1001e110 con 0x559ef702ff60 2024-05-14T09:22:06.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad0cc00700 1 -- 172.21.15.120:0/2782531297 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad1001e2b0 con 0x559ef702ff60 2024-05-14T09:22:06.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.123+0000 7fad0cc00700 1 -- 172.21.15.120:0/2782531297 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad100055a0 con 0x559ef702ff60 2024-05-14T09:22:06.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 -- 172.21.15.120:0/2782531297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702ff60 msgr2=0x559ef703f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702ff60 0x559ef703f7b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fad1001e870 tx=0x7fad10015000 comp rx=0 tx=0).stop 2024-05-14T09:22:06.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 -- 172.21.15.120:0/2782531297 shutdown_connections 2024-05-14T09:22:06.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702ff60 0x559ef703f7b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef7034040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2782531297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702a010 0x559ef702daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 -- 172.21.15.120:0/2782531297 >> 172.21.15.120:0/2782531297 conn(0x559ef6ee6a30 msgr2=0x559ef702d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 -- 172.21.15.120:0/2782531297 shutdown_connections 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.124+0000 7fad2d661b80 1 -- 172.21.15.120:0/2782531297 wait complete. 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.125+0000 7fad2d661b80 1 -- start start 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.125+0000 7fad2d661b80 1 Processor -- start 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef703ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef703f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad2d661b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef703f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad2d661b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559ef7044cb0 con 0x559ef702a010 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad2d661b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ef70445e0 con 0x559ef702ff60 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad2d661b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559ef7045380 con 0x559ef6ea7df0 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad2d661b80 10 client.0 _ll_register_callbacks cb 0x559ef6edb330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:06.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef703f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef703f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59982/0 (socket says 172.21.15.120:59982) 2024-05-14T09:22:06.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 -- 172.21.15.120:0/2254977386 learned_addr learned my addr 172.21.15.120:0/2254977386 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:06.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad1cc00700 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef703f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17e00700 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef703ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 -- 172.21.15.120:0/2254977386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 msgr2=0x559ef703ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef703ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 -- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 msgr2=0x559ef703f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef703f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.126+0000 7fad17400700 1 -- 172.21.15.120:0/2254977386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef704c5b0 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad17400700 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef703f340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fad040aa2a0 tx=0x7fad04092040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168997476c2fa9f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad02000700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad02000700 1 -- 172.21.15.120:0/2254977386 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04070af0 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad02000700 1 -- 172.21.15.120:0/2254977386 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fad040e0bd0 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad1001e2b0 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad02000700 1 -- 172.21.15.120:0/2254977386 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad040a9de0 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad2d661b80 10 client.15102 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.127+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ef70aefd0 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad02000700 1 -- 172.21.15.120:0/2254977386 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad1001e2b0 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad02000700 1 -- 172.21.15.120:0/2254977386 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fad04022690 con 0x559ef702a010 2024-05-14T09:22:06.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad2d661b80 10 client.15102 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:06.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad2d661b80 10 client.15102 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T09:22:06.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad2d661b80 20 client.15102 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:06.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70b1210 0x559ef70b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:06.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad2d661b80 4 client.15102 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:22:06.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.128+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "status"}) -- 0x559ef6f4f450 con 0x559ef70b1210 2024-05-14T09:22:06.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.129+0000 7fad17e00700 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70b1210 0x559ef70b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:06.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.130+0000 7fad17e00700 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70b1210 0x559ef70b2680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce64807b96cfba65 server_cookie=89a3ae528b86f413 in_seq=0 out_seq=0 2024-05-14T09:22:06.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.130+0000 7fad02000700 10 client.15102 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:22:06.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.130+0000 7fad02000700 1 -- 172.21.15.120:0/2254977386 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559ef6f4f450 con 0x559ef70b1210 2024-05-14T09:22:06.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.130+0000 7fad02000700 10 client.15102 handle_command_reply: tid=0 2024-05-14T09:22:06.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.130+0000 7fad2d661b80 1 client.15102 shutdown 2024-05-14T09:22:06.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 msgr2=0x559ef703f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef703f340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fad040aa2a0 tx=0x7fad04092040 comp rx=0 tx=0).stop 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 shutdown_connections 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x559ef70b1210 0x559ef70b2680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef702ff60 0x559ef703f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ef6ea7df0 0x559ef703ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 --2- 172.21.15.120:0/2254977386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ef702a010 0x559ef703f340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad02000700 0 client.15102 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 >> 172.21.15.120:0/2254977386 conn(0x559ef6ee6a30 msgr2=0x559ef702d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 shutdown_connections 2024-05-14T09:22:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 1 -- 172.21.15.120:0/2254977386 wait complete. 2024-05-14T09:22:06.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.131+0000 7fad2d661b80 20 client.15102 trim_cache size 0 max 16384 2024-05-14T09:22:06.134 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:22:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:22:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-05-14T09:22:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 34409, 2024-05-14T09:22:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 160.22459873099999, 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 291.96799016300002 2024-05-14T09:22:06.135 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facfc0b2900 msgr2=0x7facfc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facfc0b2900 0x7facfc0b4e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad1000de10 tx=0x7fad10004750 comp rx=0 tx=0).stop 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 msgr2=0x7fad1819b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad1819b2c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad0400b580 tx=0x7fad040057c0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 shutdown_connections 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facfc0b2900 0x7facfc0b4e10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad18108740 0x7fad1819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad181034c0 0x7fad1819ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 --2- 172.21.15.120:0/1420285842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad18107df0 0x7fad1819b2c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 >> 172.21.15.120:0/1420285842 conn(0x7fad180fedc0 msgr2=0x7fad181011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 shutdown_connections 2024-05-14T09:22:06.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:06.132+0000 7fad1ec00700 1 -- 172.21.15.120:0/1420285842 wait complete. 2024-05-14T09:22:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:05 smithi152 ceph-mon[34868]: pgmap v512: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:05 smithi175 ceph-mon[35353]: pgmap v512: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:07.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-14T09:22:07.466 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:08.039 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:07 smithi120 ceph-mon[31085]: pgmap v513: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:07 smithi152 ceph-mon[34868]: pgmap v513: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:07 smithi175 ceph-mon[35353]: pgmap v513: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:09.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 -- 172.21.15.120:0/812392876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 msgr2=0x7f4114109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 --2- 172.21.15.120:0/812392876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f4114109330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f41000099c0 tx=0x7f4100009cd0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 -- 172.21.15.120:0/812392876 shutdown_connections 2024-05-14T09:22:09.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 --2- 172.21.15.120:0/812392876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4114109870 0x7f41141111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 --2- 172.21.15.120:0/812392876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41141045f0 0x7f4114104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 --2- 172.21.15.120:0/812392876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f4114109330 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 -- 172.21.15.120:0/812392876 >> 172.21.15.120:0/812392876 conn(0x7f4114100040 msgr2=0x7f4114102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 -- 172.21.15.120:0/812392876 shutdown_connections 2024-05-14T09:22:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.621+0000 7f411a400700 1 -- 172.21.15.120:0/812392876 wait complete. 2024-05-14T09:22:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.622+0000 7f411a400700 1 Processor -- start 2024-05-14T09:22:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.622+0000 7f411a400700 1 -- start start 2024-05-14T09:22:09.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f411a400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41141045f0 0x7f411419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f411a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f411419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f411a400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114109870 0x7f41141a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f411a400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4114114380 con 0x7f4114108f20 2024-05-14T09:22:09.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f411a400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4114114200 con 0x7f41141045f0 2024-05-14T09:22:09.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f411a400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4114114500 con 0x7f4114109870 2024-05-14T09:22:09.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f4112a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f411419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f4112a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f411419d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50046/0 (socket says 172.21.15.120:50046) 2024-05-14T09:22:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f4112a00700 1 -- 172.21.15.120:0/955505279 learned_addr learned my addr 172.21.15.120:0/955505279 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f4113400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41141045f0 0x7f411419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.623+0000 7f4113e00700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114109870 0x7f41141a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f4112a00700 1 -- 172.21.15.120:0/955505279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114109870 msgr2=0x7f41141a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f4112a00700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114109870 0x7f41141a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f4112a00700 1 -- 172.21.15.120:0/955505279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41141045f0 msgr2=0x7f411419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f4112a00700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41141045f0 0x7f411419d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f4112a00700 1 -- 172.21.15.120:0/955505279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41141a1e90 con 0x7f4114108f20 2024-05-14T09:22:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f4112a00700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f411419d5b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f41000098e0 tx=0x7f41000047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f410be00700 1 -- 172.21.15.120:0/955505279 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100027070 con 0x7f4114108f20 2024-05-14T09:22:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f410be00700 1 -- 172.21.15.120:0/955505279 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f410000fd30 con 0x7f4114108f20 2024-05-14T09:22:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.624+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41141a2120 con 0x7f4114108f20 2024-05-14T09:22:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.625+0000 7f410be00700 1 -- 172.21.15.120:0/955505279 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100022dc0 con 0x7f4114108f20 2024-05-14T09:22:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.625+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41141a9aa0 con 0x7f4114108f20 2024-05-14T09:22:09.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.628+0000 7f410be00700 1 -- 172.21.15.120:0/955505279 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f410002a070 con 0x7f4114108f20 2024-05-14T09:22:09.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.630+0000 7f410be00700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40f80b2900 0x7f40f80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.630+0000 7f410be00700 1 -- 172.21.15.120:0/955505279 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f41000e31c0 con 0x7f4114108f20 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.630+0000 7f4113400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40f80b2900 0x7f40f80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 Processor -- start 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 -- start start 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4113400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40f80b2900 0x7f40f80b4e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4104005950 tx=0x7f410400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3a43df0 0x560dc3bc72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3bc1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc19a0 0x560dc3bc1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560dc3ae39d0 con 0x560dc3bc77e0 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dc3a81710 con 0x560dc3bc19a0 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.631+0000 7f4128f06b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560dc3adf990 con 0x560dc3a43df0 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3bc1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3bc1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50054/0 (socket says 172.21.15.120:50054) 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 -- 172.21.15.120:0/242829645 learned_addr learned my addr 172.21.15.120:0/242829645 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4113e00700 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc19a0 0x560dc3bc1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4113400700 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3a43df0 0x560dc3bc72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 -- 172.21.15.120:0/242829645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3a43df0 msgr2=0x560dc3bc72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3a43df0 0x560dc3bc72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 -- 172.21.15.120:0/242829645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc19a0 msgr2=0x560dc3bc1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc19a0 0x560dc3bc1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.632+0000 7f4112a00700 1 -- 172.21.15.120:0/242829645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc3a30880 con 0x560dc3bc77e0 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.633+0000 7f4112a00700 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3bc1460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f41000a9d30 tx=0x7f41000a9d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fe4dff116c62f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.633+0000 7f4108c00700 1 -- 172.21.15.120:0/242829645 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41000a9530 con 0x560dc3bc77e0 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.633+0000 7f4108c00700 1 -- 172.21.15.120:0/242829645 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41000aab70 con 0x560dc3bc77e0 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.633+0000 7f4108c00700 1 -- 172.21.15.120:0/242829645 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41000b3010 con 0x560dc3bc77e0 2024-05-14T09:22:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 -- 172.21.15.120:0/242829645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 msgr2=0x560dc3bc1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3bc1460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f41000a9d30 tx=0x7f41000a9d60 comp rx=0 tx=0).stop 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 -- 172.21.15.120:0/242829645 shutdown_connections 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc19a0 0x560dc3bc1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3a43df0 0x560dc3bc72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 --2- 172.21.15.120:0/242829645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3bc1460 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 -- 172.21.15.120:0/242829645 >> 172.21.15.120:0/242829645 conn(0x560dc3a88f20 msgr2=0x560dc3bbc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 -- 172.21.15.120:0/242829645 shutdown_connections 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.634+0000 7f4128f06b80 1 -- 172.21.15.120:0/242829645 wait complete. 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.635+0000 7f4128f06b80 1 -- start start 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.635+0000 7f4128f06b80 1 Processor -- start 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bcaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bcb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 0x560dc3bcb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4128f06b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560dc3bce080 con 0x560dc3a43df0 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4128f06b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dc3a49ad0 con 0x560dc3bc77e0 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4128f06b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560dc3bce200 con 0x560dc3bc19a0 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4128f06b80 10 client.0 _ll_register_callbacks cb 0x560dc3a8ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4113400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bcaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4113400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bcaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50066/0 (socket says 172.21.15.120:50066) 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4113400700 1 -- 172.21.15.120:0/699781927 learned_addr learned my addr 172.21.15.120:0/699781927 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.636+0000 7f4112a00700 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bcb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f4113e00700 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 0x560dc3bcb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f4113400700 1 -- 172.21.15.120:0/699781927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 msgr2=0x560dc3bcb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f4113400700 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bcb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f4113400700 1 -- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 msgr2=0x560dc3bcb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f4113400700 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 0x560dc3bcb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f4113400700 1 -- 172.21.15.120:0/699781927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dc3aa93d0 con 0x560dc3a43df0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f4113400700 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bcaed0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f41040116c0 tx=0x7f41040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504ff483a13d517d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f40fd600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f40fd600700 1 -- 172.21.15.120:0/699781927 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104004a30 con 0x560dc3a43df0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.637+0000 7f40fd600700 1 -- 172.21.15.120:0/699781927 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4104004bd0 con 0x560dc3a43df0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.638+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41000aab70 con 0x560dc3a43df0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.638+0000 7f40fd600700 1 -- 172.21.15.120:0/699781927 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4104004dd0 con 0x560dc3a43df0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.638+0000 7f4128f06b80 10 client.15114 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.638+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560dc3be12d0 con 0x560dc3a43df0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.638+0000 7f40fd600700 1 -- 172.21.15.120:0/699781927 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41000aab70 con 0x560dc3a43df0 2024-05-14T09:22:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.638+0000 7f40fd600700 1 -- 172.21.15.120:0/699781927 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f410401f910 con 0x560dc3a43df0 2024-05-14T09:22:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.638+0000 7f4128f06b80 10 client.15114 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.639+0000 7f4128f06b80 10 client.15114 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T09:22:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.639+0000 7f4128f06b80 20 client.15114 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.639+0000 7f4128f06b80 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3be3910 0x560dc3be4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.639+0000 7f4128f06b80 4 client.15114 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:22:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.639+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dc3b8e170 con 0x560dc3be3910 2024-05-14T09:22:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.639+0000 7f4112a00700 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3be3910 0x560dc3be4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.640+0000 7f4112a00700 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3be3910 0x560dc3be4d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58566c97428e4b81 server_cookie=295bca7ded27b025 in_seq=0 out_seq=0 2024-05-14T09:22:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.640+0000 7f40fd600700 10 client.15114 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:22:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.642+0000 7f40fd600700 1 -- 172.21.15.120:0/699781927 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560dc3b8e170 con 0x560dc3be3910 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.642+0000 7f40fd600700 10 client.15114 handle_command_reply: tid=0 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.642+0000 7f4128f06b80 1 client.15114 shutdown 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.642+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 msgr2=0x560dc3bcaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.642+0000 7f4128f06b80 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bcaed0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f41040116c0 tx=0x7f41040047c0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 shutdown_connections 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3be3910 0x560dc3be4d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 0x560dc3bcb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bcaed0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f40fd600700 0 client.15114 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 --2- 172.21.15.120:0/699781927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bcb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 >> 172.21.15.120:0/699781927 conn(0x560dc3a88f20 msgr2=0x560dc3bc0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 shutdown_connections 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 1 -- 172.21.15.120:0/699781927 wait complete. 2024-05-14T09:22:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.643+0000 7f4128f06b80 20 client.15114 trim_cache size 0 max 16384 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 Processor -- start 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 -- start start 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bc1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bb5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 0x560dc3bcb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560dc3be30c0 con 0x560dc3a43df0 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dc3be3790 con 0x560dc3bc77e0 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4128f06b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560dc3be3e60 con 0x560dc3bc19a0 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.666+0000 7f4113400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bc1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bc1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50082/0 (socket says 172.21.15.120:50082) 2024-05-14T09:22:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 -- 172.21.15.120:0/1372391547 learned_addr learned my addr 172.21.15.120:0/1372391547 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4112a00700 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bb5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 -- 172.21.15.120:0/1372391547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 msgr2=0x560dc3bb5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bb5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 -- 172.21.15.120:0/1372391547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 msgr2=0x560dc3bcb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 0x560dc3bcb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 -- 172.21.15.120:0/1372391547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc3bcbcd0 con 0x560dc3a43df0 2024-05-14T09:22:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4112a00700 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bb5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.667+0000 7f4113400700 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bc1460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f410401fdb0 tx=0x7f410400b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6781c8a3582c86 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.668+0000 7f40ffe00700 1 -- 172.21.15.120:0/1372391547 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104004af0 con 0x560dc3a43df0 2024-05-14T09:22:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.668+0000 7f40ffe00700 1 -- 172.21.15.120:0/1372391547 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4104039070 con 0x560dc3a43df0 2024-05-14T09:22:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.668+0000 7f40ffe00700 1 -- 172.21.15.120:0/1372391547 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104005740 con 0x560dc3a43df0 2024-05-14T09:22:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 -- 172.21.15.120:0/1372391547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 msgr2=0x560dc3bc1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bc1460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f410401fdb0 tx=0x7f410400b550 comp rx=0 tx=0).stop 2024-05-14T09:22:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 -- 172.21.15.120:0/1372391547 shutdown_connections 2024-05-14T09:22:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3bc77e0 0x560dc3bcb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3a43df0 0x560dc3bc1460 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 --2- 172.21.15.120:0/1372391547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bb5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 -- 172.21.15.120:0/1372391547 >> 172.21.15.120:0/1372391547 conn(0x560dc3a88f20 msgr2=0x560dc3bbbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 -- 172.21.15.120:0/1372391547 shutdown_connections 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 -- 172.21.15.120:0/1372391547 wait complete. 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.669+0000 7f4128f06b80 1 -- start start 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 1 Processor -- start 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3a43df0 0x560dc3bee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3be91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560dc3be4c00 con 0x560dc3bc77e0 2024-05-14T09:22:09.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dc3be4530 con 0x560dc3a43df0 2024-05-14T09:22:09.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560dc3be52d0 con 0x560dc3bc19a0 2024-05-14T09:22:09.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.670+0000 7f4128f06b80 10 client.0 _ll_register_callbacks cb 0x560dc3a8ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:09.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3be91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3be91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50090/0 (socket says 172.21.15.120:50090) 2024-05-14T09:22:09.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 -- 172.21.15.120:0/2680547481 learned_addr learned my addr 172.21.15.120:0/2680547481 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:09.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113400700 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3a43df0 0x560dc3bee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4112a00700 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 -- 172.21.15.120:0/2680547481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 msgr2=0x560dc3bee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bee740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 -- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3a43df0 msgr2=0x560dc3bee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3a43df0 0x560dc3bee200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 -- 172.21.15.120:0/2680547481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dc3be96f0 con 0x560dc3bc77e0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f40fd600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.671+0000 7f4113e00700 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3be91b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f410c007af0 tx=0x7f410c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba1d6962d992421 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.672+0000 7f40fd600700 1 -- 172.21.15.120:0/2680547481 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c01b070 con 0x560dc3bc77e0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.672+0000 7f40fd600700 1 -- 172.21.15.120:0/2680547481 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f410c0138a0 con 0x560dc3bc77e0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.672+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4104039070 con 0x560dc3bc77e0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.672+0000 7f40fd600700 1 -- 172.21.15.120:0/2680547481 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f410c025050 con 0x560dc3bc77e0 2024-05-14T09:22:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.672+0000 7f4128f06b80 10 client.15120 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.672+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560dc3c4f430 con 0x560dc3bc77e0 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f40fd600700 1 -- 172.21.15.120:0/2680547481 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4104039070 con 0x560dc3bc77e0 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f40fd600700 1 -- 172.21.15.120:0/2680547481 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f410c020be0 con 0x560dc3bc77e0 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f4128f06b80 10 client.15120 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f4128f06b80 10 client.15120 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f4128f06b80 20 client.15120 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f4128f06b80 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3c51900 0x560dc3c52d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f4128f06b80 4 client.15120 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.673+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "status"}) -- 0x560dc3af13b0 con 0x560dc3c51900 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.674+0000 7f4113400700 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3c51900 0x560dc3c52d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.675+0000 7f40fd600700 10 client.15120 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.675+0000 7f4113400700 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3c51900 0x560dc3c52d70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d184f2b598a8492 server_cookie=b2b5717b0187830e in_seq=0 out_seq=0 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.675+0000 7f40fd600700 1 -- 172.21.15.120:0/2680547481 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x7f4104044150 con 0x560dc3c51900 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.675+0000 7f40fd600700 10 client.15120 handle_command_reply: tid=0 2024-05-14T09:22:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.675+0000 7f4128f06b80 1 client.15120 shutdown 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 msgr2=0x560dc3be91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3be91b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f410c007af0 tx=0x7f410c007eb0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 shutdown_connections 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dc3c51900 0x560dc3c52d70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dc3a43df0 0x560dc3bee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dc3bc77e0 0x560dc3be91b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 --2- 172.21.15.120:0/2680547481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dc3bc19a0 0x560dc3bee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 >> 172.21.15.120:0/2680547481 conn(0x560dc3a88f20 msgr2=0x560dc3bb6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f40fd600700 0 client.15120 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 shutdown_connections 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.676+0000 7f4128f06b80 1 -- 172.21.15.120:0/2680547481 wait complete. 2024-05-14T09:22:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.677+0000 7f4128f06b80 20 client.15120 trim_cache size 0 max 16384 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 34427, 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 243.898601079, 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 282.60580384399998 2024-05-14T09:22:09.681 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:22:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.677+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40f80b2900 msgr2=0x7f40f80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.677+0000 7f411a400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40f80b2900 0x7f40f80b4e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4104005950 tx=0x7f410400b410 comp rx=0 tx=0).stop 2024-05-14T09:22:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.677+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 msgr2=0x7f411419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.677+0000 7f411a400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f411419d5b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f41000098e0 tx=0x7f41000047b0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 shutdown_connections 2024-05-14T09:22:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f40f80b2900 0x7f40f80b4e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41141045f0 0x7f411419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114109870 0x7f41141a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 --2- 172.21.15.120:0/955505279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4114108f20 0x7f411419d5b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 >> 172.21.15.120:0/955505279 conn(0x7f4114100040 msgr2=0x7f411410a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 shutdown_connections 2024-05-14T09:22:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:09.678+0000 7f411a400700 1 -- 172.21.15.120:0/955505279 wait complete. 2024-05-14T09:22:10.104 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:09 smithi120 ceph-mon[31085]: pgmap v514: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:09 smithi152 ceph-mon[34868]: pgmap v514: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:09 smithi175 ceph-mon[35353]: pgmap v514: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:10.630 INFO:tasks.cephadm:Setup complete, yielding 2024-05-14T09:22:10.630 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-14T09:22:10.640 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:22:10.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- bash -c 'ceph orch status' 2024-05-14T09:22:11.097 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:12.124 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:11 smithi120 ceph-mon[31085]: pgmap v515: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:11 smithi152 ceph-mon[34868]: pgmap v515: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:12.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:11 smithi175 ceph-mon[35353]: pgmap v515: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:13.036 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:12 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:22:13.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:12 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:22:13.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:12 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:22:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 -- 172.21.15.120:0/294763433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 msgr2=0x7f0f5c105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 --2- 172.21.15.120:0/294763433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c105880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009990 tx=0x7f0f48009ca0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 -- 172.21.15.120:0/294763433 shutdown_connections 2024-05-14T09:22:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 --2- 172.21.15.120:0/294763433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f5c105e10 0x7f0f5c10c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 --2- 172.21.15.120:0/294763433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5c104340 0x7f0f5c104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 --2- 172.21.15.120:0/294763433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c105880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 -- 172.21.15.120:0/294763433 >> 172.21.15.120:0/294763433 conn(0x7f0f5c0ff9c0 msgr2=0x7f0f5c101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 -- 172.21.15.120:0/294763433 shutdown_connections 2024-05-14T09:22:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.398+0000 7f0f63800700 1 -- 172.21.15.120:0/294763433 wait complete. 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.399+0000 7f0f63800700 1 Processor -- start 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f63800700 1 -- start start 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f63800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f5c104340 0x7f0f5c077410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f63800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f63800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5c105e10 0x7f0f5c076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f63800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10fca0 con 0x7f0f5c105470 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f63800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10fb20 con 0x7f0f5c104340 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f63800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10fe20 con 0x7f0f5c105e10 2024-05-14T09:22:13.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.400+0000 7f0f5be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:13.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c075b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50118/0 (socket says 172.21.15.120:50118) 2024-05-14T09:22:13.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 -- 172.21.15.120:0/4215147889 learned_addr learned my addr 172.21.15.120:0/4215147889 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:13.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f60e00700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f5c104340 0x7f0f5c077410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 -- 172.21.15.120:0/4215147889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5c105e10 msgr2=0x7f0f5c076050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5c105e10 0x7f0f5c076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 -- 172.21.15.120:0/4215147889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f5c104340 msgr2=0x7f0f5c077410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f5c104340 0x7f0f5c077410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 -- 172.21.15.120:0/4215147889 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c076760 con 0x7f0f5c105470 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.401+0000 7f0f5be00700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c075b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f48000c00 tx=0x7f0f48009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.402+0000 7f0f59600700 1 -- 172.21.15.120:0/4215147889 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48027070 con 0x7f0f5c105470 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.402+0000 7f0f59600700 1 -- 172.21.15.120:0/4215147889 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f480040a0 con 0x7f0f5c105470 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.402+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c1a49a0 con 0x7f0f5c105470 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.402+0000 7f0f59600700 1 -- 172.21.15.120:0/4215147889 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48022d50 con 0x7f0f5c105470 2024-05-14T09:22:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.402+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1a4d40 con 0x7f0f5c105470 2024-05-14T09:22:13.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.403+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c0512c0 con 0x7f0f5c105470 2024-05-14T09:22:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.405+0000 7f0f59600700 1 -- 172.21.15.120:0/4215147889 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f0f4802a070 con 0x7f0f5c105470 2024-05-14T09:22:13.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.407+0000 7f0f59600700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0f440b2900 0x7f0f440b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:13.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.407+0000 7f0f59600700 1 -- 172.21.15.120:0/4215147889 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0f480e3600 con 0x7f0f5c105470 2024-05-14T09:22:13.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.407+0000 7f0f60e00700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0f440b2900 0x7f0f440b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:13.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.408+0000 7f0f60e00700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0f440b2900 0x7f0f440b4e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f50005950 tx=0x7f0f500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.412+0000 7f0f59600700 1 -- 172.21.15.120:0/4215147889 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0f48013070 con 0x7f0f5c105470 2024-05-14T09:22:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.666+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f0f5c02ea40 con 0x7f0f440b2900 2024-05-14T09:22:13.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.670+0000 7f0f59600700 1 -- 172.21.15.120:0/4215147889 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f0f5c02ea40 con 0x7f0f440b2900 2024-05-14T09:22:13.671 INFO:teuthology.orchestra.run.smithi120.stdout:Backend: cephadm 2024-05-14T09:22:13.671 INFO:teuthology.orchestra.run.smithi120.stdout:Available: Yes 2024-05-14T09:22:13.671 INFO:teuthology.orchestra.run.smithi120.stdout:Paused: No 2024-05-14T09:22:13.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0f440b2900 msgr2=0x7f0f440b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:13.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0f440b2900 0x7f0f440b4e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f50005950 tx=0x7f0f500058e0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 msgr2=0x7f0f5c075b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:13.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c075b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f48000c00 tx=0x7f0f48009580 comp rx=0 tx=0).stop 2024-05-14T09:22:13.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 shutdown_connections 2024-05-14T09:22:13.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0f440b2900 0x7f0f440b4e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f5c104340 0x7f0f5c077410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5c105e10 0x7f0f5c076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 --2- 172.21.15.120:0/4215147889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f5c105470 0x7f0f5c075b10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:13.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 >> 172.21.15.120:0/4215147889 conn(0x7f0f5c0ff9c0 msgr2=0x7f0f5c1086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:13.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.674+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 shutdown_connections 2024-05-14T09:22:13.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:13.675+0000 7f0f63800700 1 -- 172.21.15.120:0/4215147889 wait complete. 2024-05-14T09:22:14.050 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:13 smithi120 ceph-mon[31085]: pgmap v516: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:14.050 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:22:14.050 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:22:14.050 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:13 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:22:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:13 smithi152 ceph-mon[34868]: pgmap v516: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:22:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:22:14.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:13 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:22:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:13 smithi175 ceph-mon[35353]: pgmap v516: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:22:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:22:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:13 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:22:14.566 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-14T09:22:15.027 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:15.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:14 smithi120 ceph-mon[31085]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:15.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:14 smithi152 ceph-mon[34868]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:15.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:14 smithi175 ceph-mon[35353]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:15 smithi120 ceph-mon[31085]: pgmap v517: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:15 smithi152 ceph-mon[34868]: pgmap v517: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:15 smithi175 ceph-mon[35353]: pgmap v517: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 -- 172.21.15.120:0/4253882799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810c420 msgr2=0x7faf58112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 --2- 172.21.15.120:0/4253882799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810c420 0x7faf58112cd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf5000b0a0 tx=0x7faf5000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 -- 172.21.15.120:0/4253882799 shutdown_connections 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 --2- 172.21.15.120:0/4253882799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5810ab10 0x7faf5810af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 --2- 172.21.15.120:0/4253882799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810c420 0x7faf58112cd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 --2- 172.21.15.120:0/4253882799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf5810ba80 0x7faf5810be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 -- 172.21.15.120:0/4253882799 >> 172.21.15.120:0/4253882799 conn(0x7faf580799c0 msgr2=0x7faf5807be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 -- 172.21.15.120:0/4253882799 shutdown_connections 2024-05-14T09:22:17.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.371+0000 7faf5e000700 1 -- 172.21.15.120:0/4253882799 wait complete. 2024-05-14T09:22:17.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 Processor -- start 2024-05-14T09:22:17.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 -- start start 2024-05-14T09:22:17.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5810ab10 0x7faf581a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:17.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810ba80 0x7faf581a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:17.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf5810c420 0x7faf581a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:17.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faf581162c0 con 0x7faf5810ba80 2024-05-14T09:22:17.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf58116140 con 0x7faf5810ab10 2024-05-14T09:22:17.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.373+0000 7faf5e000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf58116440 con 0x7faf5810c420 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810ba80 0x7faf581a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810ba80 0x7faf581a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50128/0 (socket says 172.21.15.120:50128) 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 -- 172.21.15.120:0/1875745773 learned_addr learned my addr 172.21.15.120:0/1875745773 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf57400700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5810ab10 0x7faf581a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf57e00700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf5810c420 0x7faf581a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 -- 172.21.15.120:0/1875745773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf5810c420 msgr2=0x7faf581a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf5810c420 0x7faf581a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 -- 172.21.15.120:0/1875745773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5810ab10 msgr2=0x7faf581a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:17.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5810ab10 0x7faf581a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.374+0000 7faf56a00700 1 -- 172.21.15.120:0/1875745773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf581a8960 con 0x7faf5810ba80 2024-05-14T09:22:17.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.375+0000 7faf56a00700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810ba80 0x7faf581a1340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d950 tx=0x7faf4400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:17.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.375+0000 7faf4fe00700 1 -- 172.21.15.120:0/1875745773 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44016070 con 0x7faf5810ba80 2024-05-14T09:22:17.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.375+0000 7faf4fe00700 1 -- 172.21.15.120:0/1875745773 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf44010460 con 0x7faf5810ba80 2024-05-14T09:22:17.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.375+0000 7faf4fe00700 1 -- 172.21.15.120:0/1875745773 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4400f620 con 0x7faf5810ba80 2024-05-14T09:22:17.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.375+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf581a8c50 con 0x7faf5810ba80 2024-05-14T09:22:17.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.375+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf581a9140 con 0x7faf5810ba80 2024-05-14T09:22:17.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.376+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf580512c0 con 0x7faf5810ba80 2024-05-14T09:22:17.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.380+0000 7faf4fe00700 1 -- 172.21.15.120:0/1875745773 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7faf44019070 con 0x7faf5810ba80 2024-05-14T09:22:17.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.381+0000 7faf4fe00700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf3c0b2880 0x7faf3c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.381+0000 7faf4fe00700 1 -- 172.21.15.120:0/1875745773 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7faf440e2250 con 0x7faf5810ba80 2024-05-14T09:22:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.381+0000 7faf57400700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf3c0b2880 0x7faf3c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:17.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.382+0000 7faf57400700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf3c0b2880 0x7faf3c0b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf48005950 tx=0x7faf480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:17.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.386+0000 7faf4fe00700 1 -- 172.21.15.120:0/1875745773 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faf440a9b70 con 0x7faf5810ba80 2024-05-14T09:22:17.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.629+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7faf58063c00 con 0x7faf3c0b2880 2024-05-14T09:22:17.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.671+0000 7faf4fe00700 1 -- 172.21.15.120:0/1875745773 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7faf58063c00 con 0x7faf3c0b2880 2024-05-14T09:22:17.673 INFO:teuthology.orchestra.run.smithi120.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-14T09:22:17.673 INFO:teuthology.orchestra.run.smithi120.stdout:mds.a smithi120 running (4m) 2m ago 4m 82.4M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 9297adf698af 2024-05-14T09:22:17.673 INFO:teuthology.orchestra.run.smithi120.stdout:mds.b smithi152 running (4m) 2m ago 4m 82.4M - 19.0.0-3588-ge2b755a6 bc14c6192b1a b1c50458a172 2024-05-14T09:22:17.673 INFO:teuthology.orchestra.run.smithi120.stdout:mds.c smithi175 running (4m) 2m ago 4m 83.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a ef5aee604f06 2024-05-14T09:22:17.673 INFO:teuthology.orchestra.run.smithi120.stdout:mds.d smithi120 running (5m) 2m ago 5m 80.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a a63a79f73d8b 2024-05-14T09:22:17.673 INFO:teuthology.orchestra.run.smithi120.stdout:mds.e smithi152 running (5m) 2m ago 5m 83.9M - 19.0.0-3588-ge2b755a6 bc14c6192b1a a6583a746bbd 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mds.f smithi175 running (4m) 2m ago 4m 83.8M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 306d3a69e921 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mds.g smithi120 running (4m) 2m ago 4m 82.4M - 19.0.0-3588-ge2b755a6 bc14c6192b1a add6a555e558 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mds.h smithi152 running (4m) 2m ago 4m 92.3M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 4ba25ddb775a 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mds.i smithi175 running (4m) 2m ago 4m 83.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a caf092ae6b78 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mds.j smithi120 running (5m) 2m ago 5m 80.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 89f1d5c8991d 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mds.k smithi152 running (5m) 2m ago 5m 83.8M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 3ec99715c27d 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mds.l smithi175 running (5m) 2m ago 5m 82.7M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 530e1f350350 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mgr.x smithi120 *:9283,8765 running (15m) 2m ago 15m 598M - 19.0.0-3588-ge2b755a6 bc14c6192b1a b226b2d5171a 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mgr.y smithi152 *:8443,8765 running (12m) 2m ago 12m 534M - 19.0.0-3588-ge2b755a6 bc14c6192b1a e61ff104d4bc 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mgr.z smithi175 *:8443,8765 running (13m) 2m ago 13m 534M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 09f3351b5f0c 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mon.a smithi120 running (15m) 2m ago 15m 118M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a 44b134424df3 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mon.b smithi152 running (13m) 2m ago 13m 108M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a 75509f1e0e41 2024-05-14T09:22:17.674 INFO:teuthology.orchestra.run.smithi120.stdout:mon.c smithi175 running (13m) 2m ago 13m 108M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a d5aa159258ef 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 smithi120 running (12m) 2m ago 12m 112M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 945ae1b9a70b 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 smithi152 running (12m) 2m ago 12m 121M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 303f8201c540 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 smithi175 running (11m) 2m ago 11m 114M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a d832cb389f0a 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 smithi120 running (10m) 2m ago 10m 119M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a d63cf4e8068b 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 smithi152 running (10m) 2m ago 10m 117M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a cce87c9a0997 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 smithi175 running (9m) 2m ago 9m 119M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 81c2ec005abb 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 smithi120 running (8m) 2m ago 8m 109M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a dc319a5f960b 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 smithi152 running (8m) 2m ago 8m 112M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a b86b7ad08588 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.8 smithi175 running (7m) 2m ago 7m 118M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 4918c78a2e02 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.9 smithi120 running (7m) 2m ago 7m 111M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a d586a4001539 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.10 smithi152 running (6m) 2m ago 6m 111M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 59c05d5ad50f 2024-05-14T09:22:17.675 INFO:teuthology.orchestra.run.smithi120.stdout:osd.11 smithi175 running (5m) 2m ago 5m 109M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 2a909d046f0b 2024-05-14T09:22:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf3c0b2880 msgr2=0x7faf3c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf3c0b2880 0x7faf3c0b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf48005950 tx=0x7faf480058e0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810ba80 msgr2=0x7faf581a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810ba80 0x7faf581a1340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d950 tx=0x7faf4400dd10 comp rx=0 tx=0).stop 2024-05-14T09:22:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 shutdown_connections 2024-05-14T09:22:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7faf3c0b2880 0x7faf3c0b4d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5810ab10 0x7faf581a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf5810c420 0x7faf581a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 --2- 172.21.15.120:0/1875745773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf5810ba80 0x7faf581a1340 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.675+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 >> 172.21.15.120:0/1875745773 conn(0x7faf580799c0 msgr2=0x7faf5810ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.676+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 shutdown_connections 2024-05-14T09:22:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:17.676+0000 7faf5e000700 1 -- 172.21.15.120:0/1875745773 wait complete. 2024-05-14T09:22:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:17 smithi152 ceph-mon[34868]: pgmap v518: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:17 smithi175 ceph-mon[35353]: pgmap v518: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:18.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:17 smithi120 ceph-mon[31085]: pgmap v518: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:18.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-14T09:22:18.966 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:18 smithi152 ceph-mon[34868]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:19.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:18 smithi175 ceph-mon[35353]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:19.263 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:18 smithi120 ceph-mon[31085]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:19 smithi152 ceph-mon[34868]: pgmap v519: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:19 smithi175 ceph-mon[35353]: pgmap v519: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:19 smithi120 ceph-mon[31085]: pgmap v519: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 -- 172.21.15.120:0/3274547047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd94410c1f0 msgr2=0x7fd94410e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 --2- 172.21.15.120:0/3274547047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd94410c1f0 0x7fd94410e700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00b0a0 tx=0x7fd93c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 -- 172.21.15.120:0/3274547047 shutdown_connections 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 --2- 172.21.15.120:0/3274547047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd94410c1f0 0x7fd94410e700 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 --2- 172.21.15.120:0/3274547047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9440776e0 0x7fd944075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 --2- 172.21.15.120:0/3274547047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9440760f0 0x7fd944076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 -- 172.21.15.120:0/3274547047 >> 172.21.15.120:0/3274547047 conn(0x7fd9440ff9c0 msgr2=0x7fd944101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 -- 172.21.15.120:0/3274547047 shutdown_connections 2024-05-14T09:22:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.339+0000 7fd949600700 1 -- 172.21.15.120:0/3274547047 wait complete. 2024-05-14T09:22:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.340+0000 7fd949600700 1 Processor -- start 2024-05-14T09:22:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.340+0000 7fd949600700 1 -- start start 2024-05-14T09:22:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd949600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9440760f0 0x7fd94419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd949600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9440776e0 0x7fd94419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd949600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd94410c1f0 0x7fd9441a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd949600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111e50 con 0x7fd9440776e0 2024-05-14T09:22:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd949600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111cd0 con 0x7fd9440760f0 2024-05-14T09:22:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd949600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111fd0 con 0x7fd94410c1f0 2024-05-14T09:22:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd93a000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9440776e0 0x7fd94419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd93a000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9440776e0 0x7fd94419ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35650/0 (socket says 172.21.15.120:35650) 2024-05-14T09:22:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd93a000700 1 -- 172.21.15.120:0/385625938 learned_addr learned my addr 172.21.15.120:0/385625938 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd942a00700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9440760f0 0x7fd94419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.341+0000 7fd943400700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd94410c1f0 0x7fd9441a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93a000700 1 -- 172.21.15.120:0/385625938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd94410c1f0 msgr2=0x7fd9441a3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93a000700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd94410c1f0 0x7fd9441a3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93a000700 1 -- 172.21.15.120:0/385625938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9440760f0 msgr2=0x7fd94419c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93a000700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9440760f0 0x7fd94419c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93a000700 1 -- 172.21.15.120:0/385625938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9441a44f0 con 0x7fd9440776e0 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd942a00700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9440760f0 0x7fd94419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93a000700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9440776e0 0x7fd94419ced0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00d950 tx=0x7fd92c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93be00700 1 -- 172.21.15.120:0/385625938 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c016070 con 0x7fd9440776e0 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93be00700 1 -- 172.21.15.120:0/385625938 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd92c010460 con 0x7fd9440776e0 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9441a47e0 con 0x7fd9440776e0 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.342+0000 7fd93be00700 1 -- 172.21.15.120:0/385625938 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00f620 con 0x7fd9440776e0 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.343+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9441a4d20 con 0x7fd9440776e0 2024-05-14T09:22:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.344+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9440512c0 con 0x7fd9440776e0 2024-05-14T09:22:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.346+0000 7fd93be00700 1 -- 172.21.15.120:0/385625938 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd92c019070 con 0x7fd9440776e0 2024-05-14T09:22:21.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.349+0000 7fd93be00700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9280b2880 0x7fd9280b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:21.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.349+0000 7fd93be00700 1 -- 172.21.15.120:0/385625938 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd92c0e2220 con 0x7fd9440776e0 2024-05-14T09:22:21.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.349+0000 7fd942a00700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9280b2880 0x7fd9280b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:21.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.350+0000 7fd942a00700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9280b2880 0x7fd9280b4d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd934005950 tx=0x7fd9340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:21.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.351+0000 7fd93be00700 1 -- 172.21.15.120:0/385625938 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd92c0a9b40 con 0x7fd9440776e0 2024-05-14T09:22:21.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.589+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd944063c00 con 0x7fd9280b2880 2024-05-14T09:22:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.596+0000 7fd93be00700 1 -- 172.21.15.120:0/385625938 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd944063c00 con 0x7fd9280b2880 2024-05-14T09:22:21.596 INFO:teuthology.orchestra.run.smithi120.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-14T09:22:21.596 INFO:teuthology.orchestra.run.smithi120.stdout:mds.all 12/12 2m ago 5m smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-05-14T09:22:21.596 INFO:teuthology.orchestra.run.smithi120.stdout:mgr 3/3 2m ago 13m smithi120=x;smithi152=y;smithi175=z;count:3 2024-05-14T09:22:21.596 INFO:teuthology.orchestra.run.smithi120.stdout:mon 3/3 2m ago 13m smithi120:172.21.15.120=a;smithi152:172.21.15.152=b;smithi175:172.21.15.175=c;count:3 2024-05-14T09:22:21.596 INFO:teuthology.orchestra.run.smithi120.stdout:osd 12 2m ago - 2024-05-14T09:22:21.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.599+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9280b2880 msgr2=0x7fd9280b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:21.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.599+0000 7fd949600700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9280b2880 0x7fd9280b4d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd934005950 tx=0x7fd9340058e0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.599+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9440776e0 msgr2=0x7fd94419ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:21.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.599+0000 7fd949600700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9440776e0 0x7fd94419ced0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00d950 tx=0x7fd92c00dd10 comp rx=0 tx=0).stop 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 shutdown_connections 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9280b2880 0x7fd9280b4d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9440760f0 0x7fd94419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd94410c1f0 0x7fd9441a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 --2- 172.21.15.120:0/385625938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9440776e0 0x7fd94419ced0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 >> 172.21.15.120:0/385625938 conn(0x7fd9440ff9c0 msgr2=0x7fd944108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 shutdown_connections 2024-05-14T09:22:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:21.600+0000 7fd949600700 1 -- 172.21.15.120:0/385625938 wait complete. 2024-05-14T09:22:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:21 smithi152 ceph-mon[34868]: pgmap v520: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:21 smithi175 ceph-mon[35353]: pgmap v520: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:21 smithi120 ceph-mon[31085]: pgmap v520: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:22.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-14T09:22:22.944 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:23.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:22 smithi152 ceph-mon[34868]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:23.216 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:22 smithi120 ceph-mon[31085]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:22 smithi175 ceph-mon[35353]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:23 smithi152 ceph-mon[34868]: pgmap v521: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:23 smithi175 ceph-mon[35353]: pgmap v521: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:24.241 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:23 smithi120 ceph-mon[31085]: pgmap v521: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:25.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 -- 172.21.15.120:0/471885045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 msgr2=0x7ffbcc109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:25.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 --2- 172.21.15.120:0/471885045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc109bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009990 tx=0x7ffbbc009ca0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 -- 172.21.15.120:0/471885045 shutdown_connections 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 --2- 172.21.15.120:0/471885045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbcc104e40 0x7ffbcc107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 --2- 172.21.15.120:0/471885045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbcc10a100 0x7ffbcc10c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 --2- 172.21.15.120:0/471885045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc109bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 -- 172.21.15.120:0/471885045 >> 172.21.15.120:0/471885045 conn(0x7ffbcc0fe880 msgr2=0x7ffbcc100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 -- 172.21.15.120:0/471885045 shutdown_connections 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.151+0000 7ffbd4800700 1 -- 172.21.15.120:0/471885045 wait complete. 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 Processor -- start 2024-05-14T09:22:25.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 -- start start 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbcc104e40 0x7ffbcc19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbcc10a100 0x7ffbcc1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc10fc90 con 0x7ffbcc1077a0 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc10fb10 con 0x7ffbcc10a100 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.152+0000 7ffbd4800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc10fe10 con 0x7ffbcc104e40 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc19adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35658/0 (socket says 172.21.15.120:35658) 2024-05-14T09:22:25.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 -- 172.21.15.120:0/2002766495 learned_addr learned my addr 172.21.15.120:0/2002766495 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd2800700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbcc10a100 0x7ffbcc1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1e00700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbcc104e40 0x7ffbcc19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 -- 172.21.15.120:0/2002766495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbcc104e40 msgr2=0x7ffbcc19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbcc104e40 0x7ffbcc19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 -- 172.21.15.120:0/2002766495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbcc10a100 msgr2=0x7ffbcc1a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbcc10a100 0x7ffbcc1a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.153+0000 7ffbd1400700 1 -- 172.21.15.120:0/2002766495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc1a23d0 con 0x7ffbcc1077a0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.154+0000 7ffbd1400700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc19adb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc000c00 tx=0x7ffbbc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.154+0000 7ffbc6a00700 1 -- 172.21.15.120:0/2002766495 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc027070 con 0x7ffbcc1077a0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.154+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc1a2660 con 0x7ffbcc1077a0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.154+0000 7ffbc6a00700 1 -- 172.21.15.120:0/2002766495 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbbc0041a0 con 0x7ffbcc1077a0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.154+0000 7ffbc6a00700 1 -- 172.21.15.120:0/2002766495 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc022e50 con 0x7ffbcc1077a0 2024-05-14T09:22:25.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.154+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc1a2b10 con 0x7ffbcc1077a0 2024-05-14T09:22:25.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.156+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc0512c0 con 0x7ffbcc1077a0 2024-05-14T09:22:25.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.158+0000 7ffbc6a00700 1 -- 172.21.15.120:0/2002766495 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ffbbc02a070 con 0x7ffbcc1077a0 2024-05-14T09:22:25.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.159+0000 7ffbc6a00700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbb40b2a20 0x7ffbb40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:25.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.159+0000 7ffbc6a00700 1 -- 172.21.15.120:0/2002766495 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ffbbc0e35a0 con 0x7ffbcc1077a0 2024-05-14T09:22:25.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.160+0000 7ffbd1e00700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbb40b2a20 0x7ffbb40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:25.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.160+0000 7ffbd1e00700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbb40b2a20 0x7ffbb40b4f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005fd0 tx=0x7ffbc000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:25.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.164+0000 7ffbc6a00700 1 -- 172.21.15.120:0/2002766495 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffbbc013070 con 0x7ffbcc1077a0 2024-05-14T09:22:25.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.402+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ffbcc063c00 con 0x7ffbb40b2a20 2024-05-14T09:22:25.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.406+0000 7ffbc6a00700 1 -- 172.21.15.120:0/2002766495 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ffbcc063c00 con 0x7ffbb40b2a20 2024-05-14T09:22:25.406 INFO:teuthology.orchestra.run.smithi120.stdout:HOST ADDR LABELS STATUS 2024-05-14T09:22:25.406 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120 172.21.15.120 2024-05-14T09:22:25.406 INFO:teuthology.orchestra.run.smithi120.stdout:smithi152 172.21.15.152 2024-05-14T09:22:25.406 INFO:teuthology.orchestra.run.smithi120.stdout:smithi175 172.21.15.175 2024-05-14T09:22:25.406 INFO:teuthology.orchestra.run.smithi120.stdout:3 hosts in cluster 2024-05-14T09:22:25.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbb40b2a20 msgr2=0x7ffbb40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:25.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbb40b2a20 0x7ffbb40b4f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005fd0 tx=0x7ffbc000a560 comp rx=0 tx=0).stop 2024-05-14T09:22:25.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 msgr2=0x7ffbcc19adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:25.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc19adb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc000c00 tx=0x7ffbbc005ef0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 shutdown_connections 2024-05-14T09:22:25.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbb40b2a20 0x7ffbb40b4f30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbcc10a100 0x7ffbcc1a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbcc104e40 0x7ffbcc19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 --2- 172.21.15.120:0/2002766495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbcc1077a0 0x7ffbcc19adb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:25.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.409+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 >> 172.21.15.120:0/2002766495 conn(0x7ffbcc0fe880 msgr2=0x7ffbcc105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:25.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.410+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 shutdown_connections 2024-05-14T09:22:25.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:25.410+0000 7ffbd4800700 1 -- 172.21.15.120:0/2002766495 wait complete. 2024-05-14T09:22:26.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:25 smithi120 ceph-mon[31085]: pgmap v522: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:25 smithi152 ceph-mon[34868]: pgmap v522: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:25 smithi175 ceph-mon[35353]: pgmap v522: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:26.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-14T09:22:26.677 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:27.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:26 smithi120 ceph-mon[31085]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:27.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:26 smithi152 ceph-mon[34868]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:27.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:26 smithi175 ceph-mon[35353]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:27 smithi175 ceph-mon[35353]: pgmap v523: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:27 smithi120 ceph-mon[31085]: pgmap v523: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:27 smithi152 ceph-mon[34868]: pgmap v523: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:29.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.092+0000 7ffa05c00700 1 -- 172.21.15.120:0/3475298828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa0010c020 msgr2=0x7ffa0010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:29.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.092+0000 7ffa05c00700 1 --2- 172.21.15.120:0/3475298828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa0010c020 0x7ffa0010e530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800b0a0 tx=0x7ff9f800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.092+0000 7ffa05c00700 1 -- 172.21.15.120:0/3475298828 shutdown_connections 2024-05-14T09:22:29.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.092+0000 7ffa05c00700 1 --2- 172.21.15.120:0/3475298828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa000776e0 0x7ffa00075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.092+0000 7ffa05c00700 1 --2- 172.21.15.120:0/3475298828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa0010c020 0x7ffa0010e530 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.092+0000 7ffa05c00700 1 --2- 172.21.15.120:0/3475298828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa000760f0 0x7ffa00076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.092+0000 7ffa05c00700 1 -- 172.21.15.120:0/3475298828 >> 172.21.15.120:0/3475298828 conn(0x7ffa000ff7b0 msgr2=0x7ffa00101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:29.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.093+0000 7ffa05c00700 1 -- 172.21.15.120:0/3475298828 shutdown_connections 2024-05-14T09:22:29.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.093+0000 7ffa05c00700 1 -- 172.21.15.120:0/3475298828 wait complete. 2024-05-14T09:22:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 Processor -- start 2024-05-14T09:22:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 -- start start 2024-05-14T09:22:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa000760f0 0x7ffa0019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa000776e0 0x7ffa0019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa0010c020 0x7ffa001a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00111c80 con 0x7ffa000760f0 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00111b00 con 0x7ffa000776e0 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.094+0000 7ffa05c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00111e00 con 0x7ffa0010c020 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa000760f0 0x7ffa0019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa000760f0 0x7ffa0019c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54572/0 (socket says 172.21.15.120:54572) 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 -- 172.21.15.120:0/2836571485 learned_addr learned my addr 172.21.15.120:0/2836571485 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ff400700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa000776e0 0x7ffa0019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ffa05200700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa0010c020 0x7ffa001a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 -- 172.21.15.120:0/2836571485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa0010c020 msgr2=0x7ffa001a3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa0010c020 0x7ffa001a3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 -- 172.21.15.120:0/2836571485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa000776e0 msgr2=0x7ffa0019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa000776e0 0x7ffa0019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ff9ffe00700 1 -- 172.21.15.120:0/2836571485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa001a4360 con 0x7ffa000760f0 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.095+0000 7ffa05200700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa0010c020 0x7ffa001a3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.096+0000 7ff9ffe00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa000760f0 0x7ffa0019c800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000c8f0 tx=0x7ff9f000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:29.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.096+0000 7ff9fcc00700 1 -- 172.21.15.120:0/2836571485 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0007940 con 0x7ffa000760f0 2024-05-14T09:22:29.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.096+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa001a4650 con 0x7ffa000760f0 2024-05-14T09:22:29.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.096+0000 7ff9fcc00700 1 -- 172.21.15.120:0/2836571485 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9f000f450 con 0x7ffa000760f0 2024-05-14T09:22:29.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.096+0000 7ff9fcc00700 1 -- 172.21.15.120:0/2836571485 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0018660 con 0x7ffa000760f0 2024-05-14T09:22:29.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.096+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa001a4b90 con 0x7ffa000760f0 2024-05-14T09:22:29.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.098+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa000512c0 con 0x7ffa000760f0 2024-05-14T09:22:29.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.101+0000 7ff9fcc00700 1 -- 172.21.15.120:0/2836571485 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff9f000f900 con 0x7ffa000760f0 2024-05-14T09:22:29.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.103+0000 7ff9fcc00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9e40b2880 0x7ff9e40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:29.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.103+0000 7ff9fcc00700 1 -- 172.21.15.120:0/2836571485 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff9f00e24e0 con 0x7ffa000760f0 2024-05-14T09:22:29.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.103+0000 7ff9ff400700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9e40b2880 0x7ff9e40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:29.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.104+0000 7ff9ff400700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9e40b2880 0x7ff9e40b4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec005950 tx=0x7ff9ec00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:29.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.108+0000 7ff9fcc00700 1 -- 172.21.15.120:0/2836571485 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff9f0014030 con 0x7ffa000760f0 2024-05-14T09:22:29.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.352+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ffa00063c00 con 0x7ff9e40b2880 2024-05-14T09:22:29.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.356+0000 7ff9fcc00700 1 -- 172.21.15.120:0/2836571485 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ffa00063c00 con 0x7ff9e40b2880 2024-05-14T09:22:29.355 INFO:teuthology.orchestra.run.smithi120.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-14T09:22:29.355 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XV400BGN 372G No 7m ago Has a FileSystem, LVM detected 2024-05-14T09:22:29.356 INFO:teuthology.orchestra.run.smithi120.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-05-14T09:22:29.356 INFO:teuthology.orchestra.run.smithi120.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-14T09:22:29.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.358+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9e40b2880 msgr2=0x7ff9e40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:29.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.358+0000 7ffa05c00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9e40b2880 0x7ff9e40b4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec005950 tx=0x7ff9ec00a300 comp rx=0 tx=0).stop 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.358+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa000760f0 msgr2=0x7ffa0019c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.358+0000 7ffa05c00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa000760f0 0x7ffa0019c800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000c8f0 tx=0x7ff9f000cc00 comp rx=0 tx=0).stop 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 shutdown_connections 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff9e40b2880 0x7ff9e40b4d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa0010c020 0x7ffa001a3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa000760f0 0x7ffa0019c800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 --2- 172.21.15.120:0/2836571485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa000776e0 0x7ffa0019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 >> 172.21.15.120:0/2836571485 conn(0x7ffa000ff7b0 msgr2=0x7ffa00107fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 shutdown_connections 2024-05-14T09:22:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:29.359+0000 7ffa05c00700 1 -- 172.21.15.120:0/2836571485 wait complete. 2024-05-14T09:22:30.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:29 smithi175 ceph-mon[35353]: pgmap v524: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-05-14T09:22:30.244 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:29 smithi120 ceph-mon[31085]: pgmap v524: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-05-14T09:22:30.247 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-14T09:22:30.259 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:22:30.259 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-14T09:22:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:29 smithi152 ceph-mon[34868]: pgmap v524: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-05-14T09:22:30.705 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:31.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:30 smithi120 ceph-mon[31085]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:31.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:30 smithi152 ceph-mon[34868]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:31.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:30 smithi175 ceph-mon[35353]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T09:22:32.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:31 smithi120 ceph-mon[31085]: pgmap v525: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-14T09:22:32.379 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:31 smithi175 ceph-mon[35353]: pgmap v525: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-14T09:22:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:31 smithi152 ceph-mon[34868]: pgmap v525: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 -- 172.21.15.120:0/3342090414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 msgr2=0x7f5a7c109960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 --2- 172.21.15.120:0/3342090414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c109960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009990 tx=0x7f5a68009ca0 comp rx=0 tx=0).stop 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 -- 172.21.15.120:0/3342090414 shutdown_connections 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 --2- 172.21.15.120:0/3342090414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a7c109ff0 0x7f5a7c10c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 --2- 172.21.15.120:0/3342090414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7c06c2d0 0x7f5a7c106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 --2- 172.21.15.120:0/3342090414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c109960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 -- 172.21.15.120:0/3342090414 >> 172.21.15.120:0/3342090414 conn(0x7f5a7c0fe880 msgr2=0x7f5a7c100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 -- 172.21.15.120:0/3342090414 shutdown_connections 2024-05-14T09:22:32.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.968+0000 7f5a81600700 1 -- 172.21.15.120:0/3342090414 wait complete. 2024-05-14T09:22:32.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.969+0000 7f5a81600700 1 Processor -- start 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.969+0000 7f5a81600700 1 -- start start 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.969+0000 7f5a81600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a7c06c2d0 0x7f5a7c19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.969+0000 7f5a81600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a81600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7c109ff0 0x7f5a7c1a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a81600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c10fc30 con 0x7f5a7c107480 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a81600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c10fab0 con 0x7f5a7c06c2d0 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a81600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c10fdb0 con 0x7f5a7c109ff0 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c19cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54586/0 (socket says 172.21.15.120:54586) 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 -- 172.21.15.120:0/966735311 learned_addr learned my addr 172.21.15.120:0/966735311 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7aa00700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a7c06c2d0 0x7f5a7c19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:32.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7b400700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7c109ff0 0x7f5a7c1a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:32.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 -- 172.21.15.120:0/966735311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7c109ff0 msgr2=0x7f5a7c1a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:32.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7c109ff0 0x7f5a7c1a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:32.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 -- 172.21.15.120:0/966735311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a7c06c2d0 msgr2=0x7f5a7c19ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:32.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a7c06c2d0 0x7f5a7c19ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:32.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.970+0000 7f5a7a000700 1 -- 172.21.15.120:0/966735311 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c1a4570 con 0x7f5a7c107480 2024-05-14T09:22:32.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.971+0000 7f5a7a000700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c19cf50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5a680098e0 tx=0x7f5a680047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:32.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.971+0000 7f5a73400700 1 -- 172.21.15.120:0/966735311 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68003c10 con 0x7f5a7c107480 2024-05-14T09:22:32.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.971+0000 7f5a73400700 1 -- 172.21.15.120:0/966735311 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a68004830 con 0x7f5a7c107480 2024-05-14T09:22:32.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.971+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c1a4800 con 0x7f5a7c107480 2024-05-14T09:22:32.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.971+0000 7f5a73400700 1 -- 172.21.15.120:0/966735311 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68005350 con 0x7f5a7c107480 2024-05-14T09:22:32.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.971+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c1a4bf0 con 0x7f5a7c107480 2024-05-14T09:22:32.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.973+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c0512c0 con 0x7f5a7c107480 2024-05-14T09:22:32.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.977+0000 7f5a73400700 1 -- 172.21.15.120:0/966735311 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5a680054f0 con 0x7f5a7c107480 2024-05-14T09:22:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.979+0000 7f5a73400700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a600b2880 0x7f5a600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.979+0000 7f5a73400700 1 -- 172.21.15.120:0/966735311 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5a680e3b40 con 0x7f5a7c107480 2024-05-14T09:22:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.979+0000 7f5a7aa00700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a600b2880 0x7f5a600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.980+0000 7f5a7aa00700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a600b2880 0x7f5a600b4d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c005950 tx=0x7f5a6c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:32.982+0000 7f5a73400700 1 -- 172.21.15.120:0/966735311 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5a68013070 con 0x7f5a7c107480 2024-05-14T09:22:33.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.258+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5a7c1a5070 con 0x7f5a7c107480 2024-05-14T09:22:33.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.259+0000 7f5a73400700 1 -- 172.21.15.120:0/966735311 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3109 (secure 0 0 0) 0x7f5a680ab4f0 con 0x7f5a7c107480 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:e29 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:legacy client fscid: 1 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:Filesystem 'cephfs' (1) 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:fs_name cephfs 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 29 2024-05-14T09:22:33.260 INFO:teuthology.orchestra.run.smithi120.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-05-14T09:18:05.515901+0000 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:modified 2024-05-14T09:19:33.941015+0000 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:tableserver 0 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:root 0 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:session_timeout 300 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:session_autoclose 300 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:max_file_size 1099511627776 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:max_xattr_size 65536 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:required_client_features {} 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:last_failure 0 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:last_failure_osd_epoch 0 2024-05-14T09:22:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:max_mds 5 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:in 0,1,2,3,4 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:up {0=34427,1=34409,2=34388,3=24469,4=24454} 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:failed 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:damaged 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:stopped 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:data_pools [3,4] 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:metadata_pool 2 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:inline_data disabled 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:balancer 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:bal_rank_mask -1 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:standby_count_wanted 0 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:qdb_cluster leader: 34427 members: 34388,24469,34409,24454,34427 2024-05-14T09:22:33.262 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.h{0:34427} state up:active seq 11 addr [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.f{0:24442} state up:standby-replay seq 1 addr [v2:172.21.15.175:6834/1285285129,v1:172.21.15.175:6835/1285285129] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.e{1:34409} state up:active seq 34 addr [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.l{1:24400} state up:standby-replay seq 1 addr [v2:172.21.15.175:6832/3706419963,v1:172.21.15.175:6833/3706419963] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.k{2:34388} state up:active seq 38 addr [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b{2:14601} state up:standby-replay seq 1 addr [v2:172.21.15.152:6838/256598418,v1:172.21.15.152:6839/256598418] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.i{3:24469} state up:active seq 31 addr [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a{3:14589} state up:standby-replay seq 1 addr [v2:172.21.15.120:6840/1248486929,v1:172.21.15.120:6841/1248486929] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c{4:24454} state up:active seq 33 addr [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.g{4:14583} state up:standby-replay seq 1 addr [v2:172.21.15.120:6838/3368743010,v1:172.21.15.120:6839/3368743010] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:Standby daemons: 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.j{-1:14523} state up:standby seq 1 addr [v2:172.21.15.120:6834/1838398514,v1:172.21.15.120:6835/1838398514] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d{-1:14529} state up:standby seq 1 addr [v2:172.21.15.120:6836/1071479620,v1:172.21.15.120:6837/1071479620] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T09:22:33.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a600b2880 msgr2=0x7f5a600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:33.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a600b2880 0x7f5a600b4d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c005950 tx=0x7f5a6c0058e0 comp rx=0 tx=0).stop 2024-05-14T09:22:33.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 msgr2=0x7f5a7c19cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c19cf50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5a680098e0 tx=0x7f5a680047b0 comp rx=0 tx=0).stop 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 shutdown_connections 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a600b2880 0x7f5a600b4d90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a7c06c2d0 0x7f5a7c19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7c109ff0 0x7f5a7c1a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 --2- 172.21.15.120:0/966735311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a7c107480 0x7f5a7c19cf50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 >> 172.21.15.120:0/966735311 conn(0x7f5a7c0fe880 msgr2=0x7f5a7c100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 shutdown_connections 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:33.262+0000 7f5a81600700 1 -- 172.21.15.120:0/966735311 wait complete. 2024-05-14T09:22:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-05-14T09:22:33.989 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:33 smithi120 ceph-mon[31085]: pgmap v526: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:33.989 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:33 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/966735311' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T09:22:34.173 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-14T09:22:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:33 smithi152 ceph-mon[34868]: pgmap v526: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:33 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/966735311' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T09:22:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:33 smithi175 ceph-mon[35353]: pgmap v526: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:33 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/966735311' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T09:22:34.612 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:36.261 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:35 smithi152 ceph-mon[34868]: pgmap v527: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-05-14T09:22:36.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:35 smithi120 ceph-mon[31085]: pgmap v527: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-05-14T09:22:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:35 smithi175 ceph-mon[35353]: pgmap v527: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-05-14T09:22:37.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 -- 172.21.15.120:0/4489750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 msgr2=0x7fa9a410b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:37.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 --2- 172.21.15.120:0/4489750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a410b5d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b0a0 tx=0x7fa99c00b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 -- 172.21.15.120:0/4489750 shutdown_connections 2024-05-14T09:22:37.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 --2- 172.21.15.120:0/4489750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9a4103250 0x7fa9a4103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 --2- 172.21.15.120:0/4489750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a410b5d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 --2- 172.21.15.120:0/4489750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a4104380 0x7fa9a4104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 -- 172.21.15.120:0/4489750 >> 172.21.15.120:0/4489750 conn(0x7fa9a40fe890 msgr2=0x7fa9a4100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:37.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 -- 172.21.15.120:0/4489750 shutdown_connections 2024-05-14T09:22:37.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.005+0000 7fa9ac200700 1 -- 172.21.15.120:0/4489750 wait complete. 2024-05-14T09:22:37.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.006+0000 7fa9ac200700 1 Processor -- start 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.006+0000 7fa9ac200700 1 -- start start 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.007+0000 7fa9ac200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9a4103250 0x7fa9a419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.007+0000 7fa9ac200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a4104380 0x7fa9a419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.007+0000 7fa9ac200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a41a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.007+0000 7fa9ac200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a410ebc0 con 0x7fa9a4104d20 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.007+0000 7fa9ac200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a410ea40 con 0x7fa9a4103250 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.007+0000 7fa9ac200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a410ed40 con 0x7fa9a4104380 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.007+0000 7fa9aa200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a41a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a41a3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54608/0 (socket says 172.21.15.120:54608) 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 -- 172.21.15.120:0/3187111635 learned_addr learned my addr 172.21.15.120:0/3187111635 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9a8e00700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a4104380 0x7fa9a419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:37.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9a9800700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9a4103250 0x7fa9a419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:37.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 -- 172.21.15.120:0/3187111635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a4104380 msgr2=0x7fa9a419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:37.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a4104380 0x7fa9a419cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 -- 172.21.15.120:0/3187111635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9a4103250 msgr2=0x7fa9a419ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:37.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9a4103250 0x7fa9a419ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 -- 172.21.15.120:0/3187111635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a41a45b0 con 0x7fa9a4104d20 2024-05-14T09:22:37.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.008+0000 7fa9aa200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a41a3f30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b830 tx=0x7fa99c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:37.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.009+0000 7fa9a2000700 1 -- 172.21.15.120:0/3187111635 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c021070 con 0x7fa9a4104d20 2024-05-14T09:22:37.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.009+0000 7fa9a2000700 1 -- 172.21.15.120:0/3187111635 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa99c007c80 con 0x7fa9a4104d20 2024-05-14T09:22:37.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.009+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a41a4840 con 0x7fa9a4104d20 2024-05-14T09:22:37.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.009+0000 7fa9a2000700 1 -- 172.21.15.120:0/3187111635 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c01b7b0 con 0x7fa9a4104d20 2024-05-14T09:22:37.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.009+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a41a4c90 con 0x7fa9a4104d20 2024-05-14T09:22:37.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.010+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a40512c0 con 0x7fa9a4104d20 2024-05-14T09:22:37.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.015+0000 7fa9a2000700 1 -- 172.21.15.120:0/3187111635 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa99c024070 con 0x7fa9a4104d20 2024-05-14T09:22:37.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.016+0000 7fa9a2000700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa98c0b2880 0x7fa98c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:37.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.017+0000 7fa9a2000700 1 -- 172.21.15.120:0/3187111635 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa99c00f020 con 0x7fa9a4104d20 2024-05-14T09:22:37.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.017+0000 7fa9a9800700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa98c0b2880 0x7fa98c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.018+0000 7fa9a9800700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa98c0b2880 0x7fa98c0b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa998005950 tx=0x7fa9980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.019+0000 7fa9a2000700 1 -- 172.21.15.120:0/3187111635 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa99c02b020 con 0x7fa9a4104d20 2024-05-14T09:22:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.251+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fa9a41a5550 con 0x7fa9a4104d20 2024-05-14T09:22:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.252+0000 7fa9a2000700 1 -- 172.21.15.120:0/3187111635 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) ==== 56+0+5675 (secure 0 0 0) 0x7fa99c0ab800 con 0x7fa9a4104d20 2024-05-14T09:22:37.252 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 90 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-05-14T09:06:21.773383+0000 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:modified 2024-05-14T09:19:42.440912+0000 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:crush_version 27 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:full_ratio 0.95 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:backfillfull_ratio 0.9 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:nearfull_ratio 0.85 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:require_min_compat_client luminous 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:min_compat_client luminous 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:require_osd_release squid 2024-05-14T09:22:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:stretch_mode_enabled false 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:max_osd 12 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6802/2428528152,v1:172.21.15.120:6803/2428528152] [v2:172.21.15.120:6804/2428528152,v1:172.21.15.120:6805/2428528152] exists,up eb734948-7a05-48ee-b91b-f35370e93d82 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6800/3641772741,v1:172.21.15.152:6801/3641772741] [v2:172.21.15.152:6802/3641772741,v1:172.21.15.152:6803/3641772741] exists,up 9a48da4c-1105-46af-9372-8403c631030d 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/636369105,v1:172.21.15.175:6801/636369105] [v2:172.21.15.175:6802/636369105,v1:172.21.15.175:6803/636369105] exists,up faf13568-1e16-4349-b77f-ad12a08ef3ec 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 up in weight 1 up_from 26 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6810/920546533,v1:172.21.15.120:6811/920546533] [v2:172.21.15.120:6812/920546533,v1:172.21.15.120:6813/920546533] exists,up dc6567b9-b095-481f-b68a-95e8119e71a1 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 up in weight 1 up_from 32 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6808/3049924657,v1:172.21.15.152:6809/3049924657] [v2:172.21.15.152:6810/3049924657,v1:172.21.15.152:6811/3049924657] exists,up 7d112625-503e-4906-8165-24025f4bd184 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 up in weight 1 up_from 37 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/10166549,v1:172.21.15.175:6809/10166549] [v2:172.21.15.175:6810/10166549,v1:172.21.15.175:6811/10166549] exists,up 1e68188d-0af5-4edf-a9e8-17a5ef0cd98f 2024-05-14T09:22:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 up in weight 1 up_from 43 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6818/3056363875,v1:172.21.15.120:6819/3056363875] [v2:172.21.15.120:6820/3056363875,v1:172.21.15.120:6821/3056363875] exists,up c2d6f698-0513-4b46-a575-24ec7b0bb63b 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 up in weight 1 up_from 48 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6816/2236830001,v1:172.21.15.152:6817/2236830001] [v2:172.21.15.152:6818/2236830001,v1:172.21.15.152:6819/2236830001] exists,up 42fe6ed9-d065-45d6-938c-66322c1ec1c0 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:osd.8 up in weight 1 up_from 54 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/3403319131,v1:172.21.15.175:6817/3403319131] [v2:172.21.15.175:6818/3403319131,v1:172.21.15.175:6819/3403319131] exists,up 6917512f-8d13-47e1-8150-fdc1c89a20f9 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:osd.9 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6826/1052033755,v1:172.21.15.120:6827/1052033755] [v2:172.21.15.120:6828/1052033755,v1:172.21.15.120:6829/1052033755] exists,up b9c8846f-4e89-4037-be61-133dcc3f14b6 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:osd.10 up in weight 1 up_from 65 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6824/832573806,v1:172.21.15.152:6825/832573806] [v2:172.21.15.152:6826/832573806,v1:172.21.15.152:6827/832573806] exists,up 345256b7-22fe-434c-b01b-9fd4b7863770 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:osd.11 up in weight 1 up_from 71 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/82369907,v1:172.21.15.175:6825/82369907] [v2:172.21.15.175:6826/82369907,v1:172.21.15.175:6827/82369907] exists,up 98aafbef-b766-49dc-b707-68043cf59c21 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 2.10 [8,11] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 2.13 [2,11] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 2.1a [8,1] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 2.1b [2,4] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.17 [4,6,5,7] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.1b [4,8] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.29 [3,9] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.33 [5,9] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.3c [4,9] 2024-05-14T09:22:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 4.c [9,10] 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 4.19 [9,8] 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 4.1c [9,8,5,10] 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6800/975840748 expires 2024-05-15T09:07:40.065639+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6801/975840748 expires 2024-05-15T09:07:40.065639+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/1968421814 expires 2024-05-15T09:07:40.065639+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6801/3992386407 expires 2024-05-15T09:07:04.655251+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/2919660982 expires 2024-05-15T09:07:04.655251+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6800/3992386407 expires 2024-05-15T09:07:04.655251+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/2419562786 expires 2024-05-15T09:07:04.655251+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/1457013957 expires 2024-05-15T09:07:40.065639+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/3562327753 expires 2024-05-15T09:07:04.655251+0000 2024-05-14T09:22:37.256 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/119127043 expires 2024-05-15T09:07:40.065639+0000 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa98c0b2880 msgr2=0x7fa98c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa98c0b2880 0x7fa98c0b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa998005950 tx=0x7fa9980058e0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 msgr2=0x7fa9a41a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a41a3f30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b830 tx=0x7fa99c00bd70 comp rx=0 tx=0).stop 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 shutdown_connections 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa98c0b2880 0x7fa98c0b4d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9a4103250 0x7fa9a419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a4104d20 0x7fa9a41a3f30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 --2- 172.21.15.120:0/3187111635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a4104380 0x7fa9a419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:37.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 >> 172.21.15.120:0/3187111635 conn(0x7fa9a40fe890 msgr2=0x7fa9a4100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:37.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 shutdown_connections 2024-05-14T09:22:37.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:37.255+0000 7fa9ac200700 1 -- 172.21.15.120:0/3187111635 wait complete. 2024-05-14T09:22:38.123 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-14T09:22:38.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:22:38.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:38 smithi120 ceph-mon[31085]: pgmap v528: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:38.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:38 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3187111635' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T09:22:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:38 smithi152 ceph-mon[34868]: pgmap v528: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:38 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3187111635' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T09:22:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:38 smithi175 ceph-mon[35353]: pgmap v528: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-14T09:22:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:38 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3187111635' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T09:22:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:40.258 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:40 smithi120 ceph-mon[31085]: pgmap v529: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T09:22:40.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:40 smithi152 ceph-mon[34868]: pgmap v529: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T09:22:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:40 smithi175 ceph-mon[35353]: pgmap v529: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 -- 172.21.15.120:0/884497585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 msgr2=0x7f3818113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 --2- 172.21.15.120:0/884497585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f3818113350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f381000b0a0 tx=0x7f381000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 -- 172.21.15.120:0/884497585 shutdown_connections 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 --2- 172.21.15.120:0/884497585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f3818113350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 --2- 172.21.15.120:0/884497585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f381810c5b0 0x7f381810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 --2- 172.21.15.120:0/884497585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3818106570 0x7f3818106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 -- 172.21.15.120:0/884497585 >> 172.21.15.120:0/884497585 conn(0x7f3818102050 msgr2=0x7f38181044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 -- 172.21.15.120:0/884497585 shutdown_connections 2024-05-14T09:22:40.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.827+0000 7f381d200700 1 -- 172.21.15.120:0/884497585 wait complete. 2024-05-14T09:22:40.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.828+0000 7f381d200700 1 Processor -- start 2024-05-14T09:22:40.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.828+0000 7f381d200700 1 -- start start 2024-05-14T09:22:40.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f381d200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818106570 0x7f381819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:40.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f381d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f381819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:40.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f381d200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f381810c5b0 0x7f38181a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f381d200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f38181165b0 con 0x7f3818106ec0 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f381d200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3818116430 con 0x7f381810c5b0 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f381d200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3818116730 con 0x7f3818106570 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f3815400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f381819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f3815400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f381819d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50870/0 (socket says 172.21.15.120:50870) 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f3815400700 1 -- 172.21.15.120:0/249493113 learned_addr learned my addr 172.21.15.120:0/249493113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.829+0000 7f3815e00700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818106570 0x7f381819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f3816800700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f381810c5b0 0x7f38181a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f3815400700 1 -- 172.21.15.120:0/249493113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818106570 msgr2=0x7f381819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f3815400700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818106570 0x7f381819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f3815400700 1 -- 172.21.15.120:0/249493113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f381810c5b0 msgr2=0x7f38181a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f3815400700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f381810c5b0 0x7f38181a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f3815400700 1 -- 172.21.15.120:0/249493113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38181a1d90 con 0x7f3818106ec0 2024-05-14T09:22:40.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f3815400700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f381819d460 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f380400d950 tx=0x7f380400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:40.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f380ea00700 1 -- 172.21.15.120:0/249493113 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804016070 con 0x7f3818106ec0 2024-05-14T09:22:40.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f380ea00700 1 -- 172.21.15.120:0/249493113 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f380400de30 con 0x7f3818106ec0 2024-05-14T09:22:40.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.830+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38181a2080 con 0x7f3818106ec0 2024-05-14T09:22:40.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.831+0000 7f380ea00700 1 -- 172.21.15.120:0/249493113 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804005280 con 0x7f3818106ec0 2024-05-14T09:22:40.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.831+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38181a99a0 con 0x7f3818106ec0 2024-05-14T09:22:40.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.832+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38180512c0 con 0x7f3818106ec0 2024-05-14T09:22:40.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.835+0000 7f380ea00700 1 -- 172.21.15.120:0/249493113 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3804005420 con 0x7f3818106ec0 2024-05-14T09:22:40.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.836+0000 7f380ea00700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37fc0b2900 0x7f37fc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:40.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.836+0000 7f380ea00700 1 -- 172.21.15.120:0/249493113 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f38040e22a0 con 0x7f3818106ec0 2024-05-14T09:22:40.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.836+0000 7f3815e00700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37fc0b2900 0x7f37fc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:40.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.837+0000 7f3815e00700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37fc0b2900 0x7f37fc0b4e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38181079e0 tx=0x7f380800b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:40.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:40.841+0000 7f380ea00700 1 -- 172.21.15.120:0/249493113 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f380401f070 con 0x7f3818106ec0 2024-05-14T09:22:41.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.124+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f381802e5f0 con 0x7f3818106ec0 2024-05-14T09:22:41.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.126+0000 7f380ea00700 1 -- 172.21.15.120:0/249493113 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11957 (secure 0 0 0) 0x7f38040a9bc0 con 0x7f3818106ec0 2024-05-14T09:22:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:22:41.128 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:19:33.941015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:22:41.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.129+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37fc0b2900 msgr2=0x7f37fc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:41.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.129+0000 7f381d200700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37fc0b2900 0x7f37fc0b4e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38181079e0 tx=0x7f380800b590 comp rx=0 tx=0).stop 2024-05-14T09:22:41.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.129+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 msgr2=0x7f381819d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:41.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.129+0000 7f381d200700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f381819d460 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f380400d950 tx=0x7f380400dd10 comp rx=0 tx=0).stop 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 shutdown_connections 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37fc0b2900 0x7f37fc0b4e10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f381810c5b0 0x7f38181a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818106570 0x7f381819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 --2- 172.21.15.120:0/249493113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3818106ec0 0x7f381819d460 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 >> 172.21.15.120:0/249493113 conn(0x7f3818102050 msgr2=0x7f38181037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 shutdown_connections 2024-05-14T09:22:41.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:41.130+0000 7f381d200700 1 -- 172.21.15.120:0/249493113 wait complete. 2024-05-14T09:22:41.132 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-05-14T09:22:41.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:22:42.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:42 smithi120 ceph-mon[31085]: pgmap v530: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T09:22:42.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:42 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/249493113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:22:42.366 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:42 smithi152 ceph-mon[34868]: pgmap v530: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T09:22:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:42 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/249493113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:22:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:42 smithi175 ceph-mon[35353]: pgmap v530: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T09:22:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:42 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/249493113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:22:44.275 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:44 smithi120 ceph-mon[31085]: pgmap v531: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T09:22:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:44 smithi152 ceph-mon[34868]: pgmap v531: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T09:22:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:44 smithi175 ceph-mon[35353]: pgmap v531: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T09:22:44.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.600+0000 7f20a7200700 1 -- 172.21.15.120:0/729632755 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810f6c0 msgr2=0x7f20a810fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.600+0000 7f20a7200700 1 --2- 172.21.15.120:0/729632755 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810f6c0 0x7f20a810fad0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2098009990 tx=0x7f2098009ca0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.601+0000 7f20a7200700 1 -- 172.21.15.120:0/729632755 shutdown_connections 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.601+0000 7f20a7200700 1 --2- 172.21.15.120:0/729632755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a810b110 0x7f20a8117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.601+0000 7f20a7200700 1 --2- 172.21.15.120:0/729632755 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810f6c0 0x7f20a810fad0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.601+0000 7f20a7200700 1 --2- 172.21.15.120:0/729632755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20a810a7c0 0x7f20a810abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.601+0000 7f20a7200700 1 -- 172.21.15.120:0/729632755 >> 172.21.15.120:0/729632755 conn(0x7f20a8076b00 msgr2=0x7f20a8076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.601+0000 7f20a7200700 1 -- 172.21.15.120:0/729632755 shutdown_connections 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.601+0000 7f20a7200700 1 -- 172.21.15.120:0/729632755 wait complete. 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.602+0000 7f20a7200700 1 Processor -- start 2024-05-14T09:22:44.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.602+0000 7f20a7200700 1 -- start start 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a7200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810a7c0 0x7f20a81a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a7200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a810b110 0x7f20a81a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a7200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20a810f6c0 0x7f20a81a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a7200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f20a811a750 con 0x7f20a810a7c0 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a7200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20a811a5d0 con 0x7f20a810f6c0 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a7200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20a811a8d0 con 0x7f20a810b110 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810a7c0 0x7f20a81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810a7c0 0x7f20a81a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50890/0 (socket says 172.21.15.120:50890) 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a5e00700 1 -- 172.21.15.120:0/1025228965 learned_addr learned my addr 172.21.15.120:0/1025228965 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:44.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a5400700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a810b110 0x7f20a81a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.603+0000 7f20a6800700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20a810f6c0 0x7f20a81a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a5e00700 1 -- 172.21.15.120:0/1025228965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a810b110 msgr2=0x7f20a81a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a5e00700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a810b110 0x7f20a81a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a5e00700 1 -- 172.21.15.120:0/1025228965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20a810f6c0 msgr2=0x7f20a81a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a5e00700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20a810f6c0 0x7f20a81a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a5e00700 1 -- 172.21.15.120:0/1025228965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a81a5fb0 con 0x7f20a810a7c0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a5400700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a810b110 0x7f20a81a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a5e00700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810a7c0 0x7f20a81a10e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2098000c00 tx=0x7f2098009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f209ea00700 1 -- 172.21.15.120:0/1025228965 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098027070 con 0x7f20a810a7c0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a81a6240 con 0x7f20a810a7c0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f209ea00700 1 -- 172.21.15.120:0/1025228965 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f209800fc70 con 0x7f20a810a7c0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.604+0000 7f209ea00700 1 -- 172.21.15.120:0/1025228965 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098022d40 con 0x7f20a810a7c0 2024-05-14T09:22:44.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.605+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a81a6720 con 0x7f20a810a7c0 2024-05-14T09:22:44.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.606+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a80512c0 con 0x7f20a810a7c0 2024-05-14T09:22:44.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.608+0000 7f209ea00700 1 -- 172.21.15.120:0/1025228965 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f209802a070 con 0x7f20a810a7c0 2024-05-14T09:22:44.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.610+0000 7f209ea00700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f208c0b2880 0x7f208c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:44.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.610+0000 7f209ea00700 1 -- 172.21.15.120:0/1025228965 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f20980e33b0 con 0x7f20a810a7c0 2024-05-14T09:22:44.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.610+0000 7f20a5400700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f208c0b2880 0x7f208c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:44.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.611+0000 7f20a5400700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f208c0b2880 0x7f208c0b4d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f20a8077f90 tx=0x7f209400b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:44.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.615+0000 7f209ea00700 1 -- 172.21.15.120:0/1025228965 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f209805fdf0 con 0x7f20a810a7c0 2024-05-14T09:22:44.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.890+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20a802e5f0 con 0x7f20a810a7c0 2024-05-14T09:22:44.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.892+0000 7f209ea00700 1 -- 172.21.15.120:0/1025228965 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11957 (secure 0 0 0) 0x7f2098013070 con 0x7f20a810a7c0 2024-05-14T09:22:44.893 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:22:44.893 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:19:33.941015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:22:44.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f208c0b2880 msgr2=0x7f208c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f208c0b2880 0x7f208c0b4d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f20a8077f90 tx=0x7f209400b5f0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810a7c0 msgr2=0x7f20a81a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810a7c0 0x7f20a81a10e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2098000c00 tx=0x7f2098009f90 comp rx=0 tx=0).stop 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 shutdown_connections 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f208c0b2880 0x7f208c0b4d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20a810f6c0 0x7f20a81a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20a810a7c0 0x7f20a81a10e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 --2- 172.21.15.120:0/1025228965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a810b110 0x7f20a81a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 >> 172.21.15.120:0/1025228965 conn(0x7f20a8076b00 msgr2=0x7f20a81088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 shutdown_connections 2024-05-14T09:22:44.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:44.895+0000 7f20a7200700 1 -- 172.21.15.120:0/1025228965 wait complete. 2024-05-14T09:22:44.897 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-05-14T09:22:45.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:45 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1025228965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:22:45.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:45 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1025228965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:22:45.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:45 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1025228965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:22:45.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:22:46.151 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:46.300 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:46 smithi120 ceph-mon[31085]: pgmap v532: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:46 smithi152 ceph-mon[34868]: pgmap v532: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:46 smithi175 ceph-mon[35353]: pgmap v532: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:47.347 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:47 smithi120 ceph-mon[31085]: pgmap v533: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:47.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:47 smithi152 ceph-mon[34868]: pgmap v533: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:47.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:47 smithi175 ceph-mon[35353]: pgmap v533: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 -- 172.21.15.120:0/4023458430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 msgr2=0x7f6bc4114c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 --2- 172.21.15.120:0/4023458430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc4114c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009990 tx=0x7f6bac009ca0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 -- 172.21.15.120:0/4023458430 shutdown_connections 2024-05-14T09:22:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 --2- 172.21.15.120:0/4023458430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bc4075b60 0x7f6bc4075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 --2- 172.21.15.120:0/4023458430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc4115180 0x7f6bc41175a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 --2- 172.21.15.120:0/4023458430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc4114c40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 -- 172.21.15.120:0/4023458430 >> 172.21.15.120:0/4023458430 conn(0x7f6bc4079d10 msgr2=0x7f6bc407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 -- 172.21.15.120:0/4023458430 shutdown_connections 2024-05-14T09:22:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.541+0000 7f6bc3200700 1 -- 172.21.15.120:0/4023458430 wait complete. 2024-05-14T09:22:48.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.542+0000 7f6bc3200700 1 Processor -- start 2024-05-14T09:22:48.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.542+0000 7f6bc3200700 1 -- start start 2024-05-14T09:22:48.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bc3200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc4075b60 0x7f6bc41a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:48.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bc3200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc41a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bc3200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bc4115180 0x7f6bc41a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bc3200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc411a790 con 0x7f6bc40764b0 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bc3200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc411a610 con 0x7f6bc4115180 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bc3200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc411a910 con 0x7f6bc4075b60 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bb9400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc41a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bb9400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc41a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56244/0 (socket says 172.21.15.120:56244) 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.543+0000 7f6bb9400700 1 -- 172.21.15.120:0/2123044542 learned_addr learned my addr 172.21.15.120:0/2123044542 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bc1e00700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc4075b60 0x7f6bc41a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bc2800700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bc4115180 0x7f6bc41a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bb9400700 1 -- 172.21.15.120:0/2123044542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc4075b60 msgr2=0x7f6bc41a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bb9400700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc4075b60 0x7f6bc41a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bb9400700 1 -- 172.21.15.120:0/2123044542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bc4115180 msgr2=0x7f6bc41a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bb9400700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bc4115180 0x7f6bc41a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bb9400700 1 -- 172.21.15.120:0/2123044542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc41a6060 con 0x7f6bc40764b0 2024-05-14T09:22:48.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.544+0000 7f6bb9400700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc41a17e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6bac000c00 tx=0x7f6bac005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:48.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.545+0000 7f6bbb400700 1 -- 172.21.15.120:0/2123044542 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac027070 con 0x7f6bc40764b0 2024-05-14T09:22:48.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.545+0000 7f6bbb400700 1 -- 172.21.15.120:0/2123044542 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bac00fb80 con 0x7f6bc40764b0 2024-05-14T09:22:48.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.545+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc41a62f0 con 0x7f6bc40764b0 2024-05-14T09:22:48.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.545+0000 7f6bbb400700 1 -- 172.21.15.120:0/2123044542 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac022c30 con 0x7f6bc40764b0 2024-05-14T09:22:48.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.545+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc41a6820 con 0x7f6bc40764b0 2024-05-14T09:22:48.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.546+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc40772a0 con 0x7f6bc40764b0 2024-05-14T09:22:48.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.548+0000 7f6bbb400700 1 -- 172.21.15.120:0/2123044542 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6bac02a070 con 0x7f6bc40764b0 2024-05-14T09:22:48.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.550+0000 7f6bbb400700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ba80b2900 0x7f6ba80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:48.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.550+0000 7f6bbb400700 1 -- 172.21.15.120:0/2123044542 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6bac0e3560 con 0x7f6bc40764b0 2024-05-14T09:22:48.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.550+0000 7f6bc1e00700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ba80b2900 0x7f6ba80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.551+0000 7f6bc1e00700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ba80b2900 0x7f6ba80b4e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d10 tx=0x7f6bb4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:48.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.557+0000 7f6bbb400700 1 -- 172.21.15.120:0/2123044542 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6bac05fdf0 con 0x7f6bc40764b0 2024-05-14T09:22:48.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.794+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bc402e5f0 con 0x7f6bc40764b0 2024-05-14T09:22:48.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.796+0000 7f6bbb400700 1 -- 172.21.15.120:0/2123044542 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7f6bac013070 con 0x7f6bc40764b0 2024-05-14T09:22:48.798 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:22:48.798 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:22:48.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.801+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ba80b2900 msgr2=0x7f6ba80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:48.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.801+0000 7f6bc3200700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ba80b2900 0x7f6ba80b4e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d10 tx=0x7f6bb4009040 comp rx=0 tx=0).stop 2024-05-14T09:22:48.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.801+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 msgr2=0x7f6bc41a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:48.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.801+0000 7f6bc3200700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc41a17e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6bac000c00 tx=0x7f6bac005ef0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 shutdown_connections 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6ba80b2900 0x7f6ba80b4e10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bc4115180 0x7f6bc41a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc4075b60 0x7f6bc41a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 --2- 172.21.15.120:0/2123044542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc40764b0 0x7f6bc41a17e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 >> 172.21.15.120:0/2123044542 conn(0x7f6bc4079d10 msgr2=0x7f6bc4101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 shutdown_connections 2024-05-14T09:22:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:48.802+0000 7f6bc3200700 1 -- 172.21.15.120:0/2123044542 wait complete. 2024-05-14T09:22:49.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-14T09:18:05.515901+0000', 'modified': '2024-05-14T09:19:33.941015+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34427, 'mds_1': 34409, 'mds_2': 34388, 'mds_3': 24469, 'mds_4': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.120:6839/3368743010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6838', 'nonce': 3368743010}, {'type': 'v1', 'addr': '172.21.15.120:6839', 'nonce': 3368743010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14589': {'gid': 14589, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.120:6841/1248486929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6840', 'nonce': 1248486929}, {'type': 'v1', 'addr': '172.21.15.120:6841', 'nonce': 1248486929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'b', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6839/256598418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 256598418}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 256598418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/3706419963', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 3706419963}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 3706419963}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6835/1285285129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1285285129}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1285285129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.175:6837/3978387102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 3978387102}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 3978387102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 31, 'addr': '172.21.15.175:6839/339294041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 339294041}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 339294041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34388': {'gid': 34388, 'name': 'k', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 38, 'addr': '172.21.15.152:6833/2515790469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 2515790469}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 2515790469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'e', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 34, 'addr': '172.21.15.152:6835/2913976247', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 2913976247}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 2913976247}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34427': {'gid': 34427, 'name': 'h', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.152:6837/1812479560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 1812479560}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 1812479560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34427, 'qdb_cluster': [34388, 24469, 34409, 24454, 34427]} 2024-05-14T09:22:49.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-14T09:22:49.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-14T09:22:49.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:49 smithi120 ceph-mon[31085]: pgmap v534: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:49.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:49 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2123044542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:22:49.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:49 smithi152 ceph-mon[34868]: pgmap v534: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:49.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:49 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2123044542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:22:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:49 smithi175 ceph-mon[35353]: pgmap v534: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:49.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:49 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2123044542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:22:50.036 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:51.819 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:51 smithi120 ceph-mon[31085]: pgmap v535: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:51.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:51 smithi152 ceph-mon[34868]: pgmap v535: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:51.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:51 smithi175 ceph-mon[35353]: pgmap v535: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:22:52.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 -- 172.21.15.120:0/1110190963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010b2e0 msgr2=0x7f3e00117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 --2- 172.21.15.120:0/1110190963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010b2e0 0x7f3e00117810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3df800b0a0 tx=0x7f3df800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 -- 172.21.15.120:0/1110190963 shutdown_connections 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 --2- 172.21.15.120:0/1110190963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e00110970 0x7f3e00110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 --2- 172.21.15.120:0/1110190963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010b2e0 0x7f3e00117810 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 --2- 172.21.15.120:0/1110190963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0010a990 0x7f3e0010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 -- 172.21.15.120:0/1110190963 >> 172.21.15.120:0/1110190963 conn(0x7f3e00077c80 msgr2=0x7f3e000780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 -- 172.21.15.120:0/1110190963 shutdown_connections 2024-05-14T09:22:52.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.447+0000 7f3e08000700 1 -- 172.21.15.120:0/1110190963 wait complete. 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.448+0000 7f3e08000700 1 Processor -- start 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e08000700 1 -- start start 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e08000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010a990 0x7f3e001a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e08000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0010b2e0 0x7f3e001a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e08000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e00110970 0x7f3e001a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e08000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0011a940 con 0x7f3e0010a990 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e08000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0011a7c0 con 0x7f3e00110970 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e08000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0011aac0 con 0x7f3e0010b2e0 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.449+0000 7f3e05600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010a990 0x7f3e001a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010a990 0x7f3e001a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56252/0 (socket says 172.21.15.120:56252) 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 -- 172.21.15.120:0/1588227355 learned_addr learned my addr 172.21.15.120:0/1588227355 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e06000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e00110970 0x7f3e001a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e04c00700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0010b2e0 0x7f3e001a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 -- 172.21.15.120:0/1588227355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0010b2e0 msgr2=0x7f3e001a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0010b2e0 0x7f3e001a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 -- 172.21.15.120:0/1588227355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e00110970 msgr2=0x7f3e001a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e00110970 0x7f3e001a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 -- 172.21.15.120:0/1588227355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e001a60f0 con 0x7f3e0010a990 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e06000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e00110970 0x7f3e001a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.450+0000 7f3e05600700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010a990 0x7f3e001a1370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c8f0 tx=0x7f3df400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.451+0000 7f3dfe000700 1 -- 172.21.15.120:0/1588227355 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4007b00 con 0x7f3e0010a990 2024-05-14T09:22:52.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.451+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e001a63e0 con 0x7f3e0010a990 2024-05-14T09:22:52.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.451+0000 7f3dfe000700 1 -- 172.21.15.120:0/1588227355 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df4007ca0 con 0x7f3e0010a990 2024-05-14T09:22:52.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.451+0000 7f3dfe000700 1 -- 172.21.15.120:0/1588227355 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4018600 con 0x7f3e0010a990 2024-05-14T09:22:52.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.451+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e001a6920 con 0x7f3e0010a990 2024-05-14T09:22:52.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.455+0000 7f3dfe000700 1 -- 172.21.15.120:0/1588227355 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3df40187a0 con 0x7f3e0010a990 2024-05-14T09:22:52.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.455+0000 7f3e16abcb80 1 Processor -- start 2024-05-14T09:22:52.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3e16abcb80 1 -- start start 2024-05-14T09:22:52.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d205660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d1ff6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d200010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55de3d1219d0 con 0x55de3d081df0 2024-05-14T09:22:52.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55de3d0bf710 con 0x55de3d205ba0 2024-05-14T09:22:52.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de3d11d990 con 0x55de3d1ffc00 2024-05-14T09:22:52.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.456+0000 7f3dfe000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3de80b2900 0x7f3de80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d205660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d205660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56264/0 (socket says 172.21.15.120:56264) 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3dfe000700 1 -- 172.21.15.120:0/1588227355 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3df40e2650 con 0x7f3e0010a990 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 -- 172.21.15.120:0/427710763 learned_addr learned my addr 172.21.15.120:0/427710763 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e05600700 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d1ff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3de80b2900 0x7f3de80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e04c00700 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d200010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 -- 172.21.15.120:0/427710763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 msgr2=0x55de3d200010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d200010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 -- 172.21.15.120:0/427710763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 msgr2=0x55de3d1ff6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d1ff6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e06000700 1 -- 172.21.15.120:0/427710763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de3d06e880 con 0x55de3d081df0 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e04c00700 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d200010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:22:52.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.457+0000 7f3e05600700 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d1ff6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:22:52.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.458+0000 7f3e06000700 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d205660 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3df8004ee0 tx=0x7f3df8004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45e88b4234af9f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:52.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.458+0000 7f3e06000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3de80b2900 0x7f3de80b4e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007670 tx=0x7f3df8013000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:52.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.458+0000 7f3df2a00700 1 -- 172.21.15.120:0/427710763 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df802d070 con 0x55de3d081df0 2024-05-14T09:22:52.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.458+0000 7f3df2a00700 1 -- 172.21.15.120:0/427710763 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df801f8d0 con 0x55de3d081df0 2024-05-14T09:22:52.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.458+0000 7f3df2a00700 1 -- 172.21.15.120:0/427710763 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8029670 con 0x55de3d081df0 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.459+0000 7f3e16abcb80 1 -- 172.21.15.120:0/427710763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 msgr2=0x55de3d205660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.459+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d205660 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3df8004ee0 tx=0x7f3df8004f10 comp rx=0 tx=0).stop 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.459+0000 7f3e16abcb80 1 -- 172.21.15.120:0/427710763 shutdown_connections 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.459+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d200010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.459+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d205660 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.459+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/427710763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d1ff6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.459+0000 7f3e16abcb80 1 -- 172.21.15.120:0/427710763 >> 172.21.15.120:0/427710763 conn(0x55de3d0c0a30 msgr2=0x55de3d1fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.460+0000 7f3e16abcb80 1 -- 172.21.15.120:0/427710763 shutdown_connections 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.460+0000 7f3e16abcb80 1 -- 172.21.15.120:0/427710763 wait complete. 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.460+0000 7f3e16abcb80 1 -- start start 2024-05-14T09:22:52.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.460+0000 7f3e16abcb80 1 Processor -- start 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d2093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d1ffc00 0x55de3d209910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d205ba0 0x55de3d209e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55de3d20c610 con 0x55de3d081df0 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55de3d087ad0 con 0x55de3d1ffc00 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de3d20c790 con 0x55de3d205ba0 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e16abcb80 10 client.0 _ll_register_callbacks cb 0x55de3d0b5330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.461+0000 7f3e05600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d2093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d2093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56276/0 (socket says 172.21.15.120:56276) 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 -- 172.21.15.120:0/2897527882 learned_addr learned my addr 172.21.15.120:0/2897527882 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e06000700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d205ba0 0x55de3d209e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e04c00700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d1ffc00 0x55de3d209910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 -- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d205ba0 msgr2=0x55de3d209e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d205ba0 0x55de3d209e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 -- 172.21.15.120:0/2897527882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d1ffc00 msgr2=0x55de3d209910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d1ffc00 0x55de3d209910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 -- 172.21.15.120:0/2897527882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de3d0e73d0 con 0x55de3d081df0 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e04c00700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d1ffc00 0x55de3d209910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e06000700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d205ba0 0x55de3d209e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e05600700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d2093d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3df40059d0 tx=0x7f3df40a9380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa1338c81fd3194 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3de7400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3de7400700 1 -- 172.21.15.120:0/2897527882 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df40c2020 con 0x55de3d081df0 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3de7400700 1 -- 172.21.15.120:0/2897527882 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3df40a9ad0 con 0x55de3d081df0 2024-05-14T09:22:52.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.462+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df801f8d0 con 0x55de3d081df0 2024-05-14T09:22:52.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.463+0000 7f3de7400700 1 -- 172.21.15.120:0/2897527882 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3df40adc20 con 0x55de3d081df0 2024-05-14T09:22:52.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.463+0000 7f3e16abcb80 10 client.15192 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:52.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.463+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55de3d217330 con 0x55de3d081df0 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.463+0000 7f3de7400700 1 -- 172.21.15.120:0/2897527882 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df801f8d0 con 0x55de3d081df0 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.463+0000 7f3de7400700 1 -- 172.21.15.120:0/2897527882 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3df40b2240 con 0x55de3d081df0 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.463+0000 7f3e16abcb80 10 client.15192 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.463+0000 7f3e16abcb80 10 client.15192 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.464+0000 7f3e16abcb80 20 client.15192 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.464+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d219a30 0x55de3d21aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.464+0000 7f3e16abcb80 4 client.15192 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.464+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de3d1cc020 con 0x55de3d219a30 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.464+0000 7f3e04c00700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d219a30 0x55de3d21aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.465+0000 7f3e04c00700 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d219a30 0x55de3d21aea0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d8135c5f5de1003c server_cookie=c54b6b9a9fe08506 in_seq=0 out_seq=0 2024-05-14T09:22:52.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.465+0000 7f3de7400700 10 client.15192 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3de7400700 1 -- 172.21.15.120:0/2897527882 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55de3d1cc020 con 0x55de3d219a30 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3de7400700 10 client.15192 handle_command_reply: tid=0 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 client.15192 shutdown 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 msgr2=0x55de3d2093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d2093d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3df40059d0 tx=0x7f3df40a9380 comp rx=0 tx=0).stop 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 shutdown_connections 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d219a30 0x55de3d21aea0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d205ba0 0x55de3d209e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d2093d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/2897527882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d1ffc00 0x55de3d209910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 >> 172.21.15.120:0/2897527882 conn(0x55de3d0c0a30 msgr2=0x55de3d1fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:52.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.468+0000 7f3de7400700 0 client.15192 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:22:52.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.469+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 shutdown_connections 2024-05-14T09:22:52.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.469+0000 7f3e16abcb80 1 -- 172.21.15.120:0/2897527882 wait complete. 2024-05-14T09:22:52.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.469+0000 7f3e16abcb80 20 client.15192 trim_cache size 0 max 16384 2024-05-14T09:22:52.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.491+0000 7f3e16abcb80 1 Processor -- start 2024-05-14T09:22:52.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e16abcb80 1 -- start start 2024-05-14T09:22:52.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d081df0 0x55de3d1ff6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d224300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d205ba0 0x55de3d224840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55de3d2191e0 con 0x55de3d205ba0 2024-05-14T09:22:52.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55de3d2198b0 con 0x55de3d081df0 2024-05-14T09:22:52.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de3d219f80 con 0x55de3d1ffc00 2024-05-14T09:22:52.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e06000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d205ba0 0x55de3d224840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e06000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d205ba0 0x55de3d224840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56288/0 (socket says 172.21.15.120:56288) 2024-05-14T09:22:52.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.492+0000 7f3e06000700 1 -- 172.21.15.120:0/722610166 learned_addr learned my addr 172.21.15.120:0/722610166 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:52.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e04c00700 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d224300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e05600700 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d081df0 0x55de3d1ff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e06000700 1 -- 172.21.15.120:0/722610166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 msgr2=0x55de3d224300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e06000700 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d224300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e06000700 1 -- 172.21.15.120:0/722610166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d081df0 msgr2=0x55de3d1ff6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e06000700 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d081df0 0x55de3d1ff6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e06000700 1 -- 172.21.15.120:0/722610166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de3d205fb0 con 0x55de3d205ba0 2024-05-14T09:22:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.493+0000 7f3e06000700 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d205ba0 0x55de3d224840 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d010 tx=0x7f3df80092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1660cd960167b10 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.494+0000 7f3df2000700 1 -- 172.21.15.120:0/722610166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df802d040 con 0x55de3d205ba0 2024-05-14T09:22:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.494+0000 7f3df2000700 1 -- 172.21.15.120:0/722610166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df8035070 con 0x55de3d205ba0 2024-05-14T09:22:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.494+0000 7f3df2000700 1 -- 172.21.15.120:0/722610166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8029410 con 0x55de3d205ba0 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 -- 172.21.15.120:0/722610166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d205ba0 msgr2=0x55de3d224840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d205ba0 0x55de3d224840 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d010 tx=0x7f3df80092c0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 -- 172.21.15.120:0/722610166 shutdown_connections 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d081df0 0x55de3d1ff6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d205ba0 0x55de3d224840 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/722610166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d224300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 -- 172.21.15.120:0/722610166 >> 172.21.15.120:0/722610166 conn(0x55de3d0c0a30 msgr2=0x55de3d1f43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 -- 172.21.15.120:0/722610166 shutdown_connections 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 -- 172.21.15.120:0/722610166 wait complete. 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.495+0000 7f3e16abcb80 1 -- start start 2024-05-14T09:22:52.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 1 Processor -- start 2024-05-14T09:22:52.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d20a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d20ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d20b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55de3d21ad20 con 0x55de3d081df0 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55de3d21a650 con 0x55de3d205ba0 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de3d21b3f0 con 0x55de3d1ffc00 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e16abcb80 10 client.0 _ll_register_callbacks cb 0x55de3d0b5330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.496+0000 7f3e05600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d20a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d20a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56300/0 (socket says 172.21.15.120:56300) 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 -- 172.21.15.120:0/4225725160 learned_addr learned my addr 172.21.15.120:0/4225725160 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e04c00700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d20ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e06000700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d20b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 -- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 msgr2=0x55de3d20ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d20ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 -- 172.21.15.120:0/4225725160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 msgr2=0x55de3d20b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:52.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d20b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 -- 172.21.15.120:0/4225725160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de3d223a80 con 0x55de3d081df0 2024-05-14T09:22:52.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e04c00700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d20ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:52.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e06000700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d20b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:52.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3e05600700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d20a860 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3df406f470 tx=0x7f3df406f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b99260fb8e4ad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:52.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.497+0000 7f3de7400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:52.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3de7400700 1 -- 172.21.15.120:0/4225725160 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df40c2070 con 0x55de3d081df0 2024-05-14T09:22:52.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3de7400700 1 -- 172.21.15.120:0/4225725160 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3df40a9ad0 con 0x55de3d081df0 2024-05-14T09:22:52.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df8035070 con 0x55de3d081df0 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3de7400700 1 -- 172.21.15.120:0/4225725160 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3df40b2450 con 0x55de3d081df0 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3e16abcb80 10 client.15198 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55de3d224ce0 con 0x55de3d081df0 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3de7400700 1 -- 172.21.15.120:0/4225725160 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df8035070 con 0x55de3d081df0 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3de7400700 1 -- 172.21.15.120:0/4225725160 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3df40a51e0 con 0x55de3d081df0 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3e16abcb80 10 client.15198 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3e16abcb80 10 client.15198 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.498+0000 7f3e16abcb80 20 client.15198 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.499+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d287190 0x55de3d288600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.499+0000 7f3e16abcb80 4 client.15198 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.499+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "status"}) -- 0x55de3d12f3b0 con 0x55de3d287190 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.499+0000 7f3e04c00700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d287190 0x55de3d288600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:52.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.500+0000 7f3e04c00700 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d287190 0x55de3d288600 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c998ebed06f1d8c9 server_cookie=bd55912684057807 in_seq=0 out_seq=0 2024-05-14T09:22:52.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.500+0000 7f3de7400700 10 client.15198 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3de7400700 1 -- 172.21.15.120:0/4225725160 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55de3d12f3b0 con 0x55de3d287190 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3de7400700 10 client.15198 handle_command_reply: tid=0 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 client.15198 shutdown 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 msgr2=0x55de3d20a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d20a860 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3df406f470 tx=0x7f3df406f350 comp rx=0 tx=0).stop 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 shutdown_connections 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55de3d287190 0x55de3d288600 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de3d205ba0 0x55de3d20b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55de3d081df0 0x55de3d20a860 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 --2- 172.21.15.120:0/4225725160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de3d1ffc00 0x55de3d20ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 >> 172.21.15.120:0/4225725160 conn(0x55de3d0c0a30 msgr2=0x55de3d2078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3de7400700 0 client.15198 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 shutdown_connections 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 1 -- 172.21.15.120:0/4225725160 wait complete. 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.501+0000 7f3e16abcb80 20 client.15198 trim_cache size 0 max 16384 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 4, 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24454, 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:22:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 203.53291421399999, 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 329.76042708300002 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:22:52.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3de80b2900 msgr2=0x7f3de80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3de80b2900 0x7f3de80b4e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007670 tx=0x7f3df8013000 comp rx=0 tx=0).stop 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010a990 msgr2=0x7f3e001a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010a990 0x7f3e001a1370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c8f0 tx=0x7f3df400ccb0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 shutdown_connections 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3de80b2900 0x7f3de80b4e10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e00110970 0x7f3e001a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e0010a990 0x7f3e001a1370 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 --2- 172.21.15.120:0/1588227355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0010b2e0 0x7f3e001a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 >> 172.21.15.120:0/1588227355 conn(0x7f3e00077c80 msgr2=0x7f3e0007b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.502+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 shutdown_connections 2024-05-14T09:22:52.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:52.503+0000 7f3e08000700 1 -- 172.21.15.120:0/1588227355 wait complete. 2024-05-14T09:22:53.424 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-14T09:22:53.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:53 smithi120 ceph-mon[31085]: pgmap v536: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:53.875 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:53.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:53 smithi152 ceph-mon[34868]: pgmap v536: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:53.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:53 smithi175 ceph-mon[35353]: pgmap v536: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:55.755 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:55 smithi120 ceph-mon[31085]: pgmap v537: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:55.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:55 smithi152 ceph-mon[34868]: pgmap v537: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:55.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:55 smithi175 ceph-mon[35353]: pgmap v537: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:56.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.099+0000 7f17b0800700 1 -- 172.21.15.120:0/2817505739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a8106ed0 msgr2=0x7f17a8113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.099+0000 7f17b0800700 1 --2- 172.21.15.120:0/2817505739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a8106ed0 0x7f17a8113360 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b0a0 tx=0x7f17a400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.099+0000 7f17b0800700 1 -- 172.21.15.120:0/2817505739 shutdown_connections 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.099+0000 7f17b0800700 1 --2- 172.21.15.120:0/2817505739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a8106ed0 0x7f17a8113360 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.099+0000 7f17b0800700 1 --2- 172.21.15.120:0/2817505739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a810c5c0 0x7f17a810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.099+0000 7f17b0800700 1 --2- 172.21.15.120:0/2817505739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17a8106580 0x7f17a8106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.099+0000 7f17b0800700 1 -- 172.21.15.120:0/2817505739 >> 172.21.15.120:0/2817505739 conn(0x7f17a8102080 msgr2=0x7f17a81044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.100+0000 7f17b0800700 1 -- 172.21.15.120:0/2817505739 shutdown_connections 2024-05-14T09:22:56.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.100+0000 7f17b0800700 1 -- 172.21.15.120:0/2817505739 wait complete. 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.101+0000 7f17b0800700 1 Processor -- start 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.101+0000 7f17b0800700 1 -- start start 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.101+0000 7f17b0800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a8106580 0x7f17a819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17b0800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17a8106ed0 0x7f17a819d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17b0800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a810c5c0 0x7f17a81a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17b0800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17a81165a0 con 0x7f17a810c5c0 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17b0800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8116420 con 0x7f17a8106ed0 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17b0800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8116720 con 0x7f17a8106580 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ae800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a810c5c0 0x7f17a81a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ae800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a810c5c0 0x7f17a81a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56320/0 (socket says 172.21.15.120:56320) 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ae800700 1 -- 172.21.15.120:0/2415866887 learned_addr learned my addr 172.21.15.120:0/2415866887 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:56.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ad400700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17a8106ed0 0x7f17a819d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ade00700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a8106580 0x7f17a819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ae800700 1 -- 172.21.15.120:0/2415866887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a8106580 msgr2=0x7f17a819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ae800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a8106580 0x7f17a819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ae800700 1 -- 172.21.15.120:0/2415866887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17a8106ed0 msgr2=0x7f17a819d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.102+0000 7f17ae800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17a8106ed0 0x7f17a819d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.103+0000 7f17ae800700 1 -- 172.21.15.120:0/2415866887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a81a1da0 con 0x7f17a810c5c0 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.103+0000 7f17ae800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a810c5c0 0x7f17a81a1700 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b830 tx=0x7f17a4004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.103+0000 7f17a2a00700 1 -- 172.21.15.120:0/2415866887 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4021070 con 0x7f17a810c5c0 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.103+0000 7f17a2a00700 1 -- 172.21.15.120:0/2415866887 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17a4007c80 con 0x7f17a810c5c0 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.103+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a81a2030 con 0x7f17a810c5c0 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.103+0000 7f17a2a00700 1 -- 172.21.15.120:0/2415866887 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4005260 con 0x7f17a810c5c0 2024-05-14T09:22:56.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.103+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a81a2510 con 0x7f17a810c5c0 2024-05-14T09:22:56.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.107+0000 7f17a2a00700 1 -- 172.21.15.120:0/2415866887 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f17a4024070 con 0x7f17a810c5c0 2024-05-14T09:22:56.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.108+0000 7f17bf303b80 1 Processor -- start 2024-05-14T09:22:56.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.108+0000 7f17bf303b80 1 -- start start 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef89660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17a2a00700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17900b2880 0x7f17900b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef84010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17bf303b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563f1eea59d0 con 0x563f1ef83c00 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17bf303b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f1ee43710 con 0x563f1ef89ba0 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17bf303b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f1eea1990 con 0x563f1ee05df0 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17a2a00700 1 -- 172.21.15.120:0/2415866887 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f17a400f020 con 0x7f17a810c5c0 2024-05-14T09:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17ae800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef84010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17ae800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef84010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56334/0 (socket says 172.21.15.120:56334) 2024-05-14T09:22:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17ae800700 1 -- 172.21.15.120:0/3135122759 learned_addr learned my addr 172.21.15.120:0/3135122759 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17ade00700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17900b2880 0x7f17900b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.109+0000 7f17ad400700 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef89660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ad400700 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ae800700 1 -- 172.21.15.120:0/3135122759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 msgr2=0x563f1ef89660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ae800700 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef89660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ae800700 1 -- 172.21.15.120:0/3135122759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 msgr2=0x563f1ef836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ae800700 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ae800700 1 -- 172.21.15.120:0/3135122759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f1edf2880 con 0x563f1ef83c00 2024-05-14T09:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ade00700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17900b2880 0x7f17900b4d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f179c005950 tx=0x7f179c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f17ae800700 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef84010 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f17a40e13f0 tx=0x7f17a4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be56df9a798b8297 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f1797400700 1 -- 172.21.15.120:0/3135122759 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40ab6a0 con 0x563f1ef83c00 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.110+0000 7f1797400700 1 -- 172.21.15.120:0/3135122759 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17a4023df0 con 0x563f1ef83c00 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.111+0000 7f1797400700 1 -- 172.21.15.120:0/3135122759 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40b3d70 con 0x563f1ef83c00 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.111+0000 7f17bf303b80 1 -- 172.21.15.120:0/3135122759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 msgr2=0x563f1ef84010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.111+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef84010 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f17a40e13f0 tx=0x7f17a4004f90 comp rx=0 tx=0).stop 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 -- 172.21.15.120:0/3135122759 shutdown_connections 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef84010 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef89660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3135122759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 -- 172.21.15.120:0/3135122759 >> 172.21.15.120:0/3135122759 conn(0x563f1ee44a30 msgr2=0x563f1ef7e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 -- 172.21.15.120:0/3135122759 shutdown_connections 2024-05-14T09:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 -- 172.21.15.120:0/3135122759 wait complete. 2024-05-14T09:22:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.112+0000 7f17bf303b80 1 -- start start 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 1 Processor -- start 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ee05df0 0x563f1ef8d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef83c00 0x563f1ef8d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef89ba0 0x563f1ef8dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef90430 con 0x563f1ee05df0 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f1ee0bad0 con 0x563f1ef83c00 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef905b0 con 0x563f1ef89ba0 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17bf303b80 10 client.0 _ll_register_callbacks cb 0x563f1ee39330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.113+0000 7f17ade00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ee05df0 0x563f1ef8d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ee05df0 0x563f1ef8d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56340/0 (socket says 172.21.15.120:56340) 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 -- 172.21.15.120:0/313402166 learned_addr learned my addr 172.21.15.120:0/313402166 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ad400700 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef83c00 0x563f1ef8d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 -- 172.21.15.120:0/313402166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef89ba0 msgr2=0x563f1ef8dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef89ba0 0x563f1ef8dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 -- 172.21.15.120:0/313402166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef83c00 msgr2=0x563f1ef8d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef83c00 0x563f1ef8d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 -- 172.21.15.120:0/313402166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f1ee6b3d0 con 0x563f1ee05df0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f17ade00700 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ee05df0 0x563f1ef8d290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f179c00feb0 tx=0x7f179c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58107367dfd0f4fe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.114+0000 7f178be00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.115+0000 7f178be00700 1 -- 172.21.15.120:0/313402166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c022070 con 0x563f1ee05df0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.115+0000 7f178be00700 1 -- 172.21.15.120:0/313402166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f179c01e450 con 0x563f1ee05df0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.115+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17a4023df0 con 0x563f1ee05df0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.115+0000 7f178be00700 1 -- 172.21.15.120:0/313402166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f179c02e050 con 0x563f1ee05df0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.115+0000 7f17bf303b80 10 client.15210 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.115+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f1ef9af30 con 0x563f1ee05df0 2024-05-14T09:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.115+0000 7f178be00700 1 -- 172.21.15.120:0/313402166 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17a4023df0 con 0x563f1ee05df0 2024-05-14T09:22:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f178be00700 1 -- 172.21.15.120:0/313402166 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f179c0266b0 con 0x563f1ee05df0 2024-05-14T09:22:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f17bf303b80 10 client.15210 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f17bf303b80 10 client.15210 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T09:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f17bf303b80 20 client.15210 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f17bf303b80 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1ef9d600 0x563f1ef9ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f17bf303b80 4 client.15210 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f1ef50020 con 0x563f1ef9d600 2024-05-14T09:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.116+0000 7f17ad400700 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1ef9d600 0x563f1ef9ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.117+0000 7f17ad400700 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1ef9d600 0x563f1ef9ea70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=43e5d24cbb0d3bdb server_cookie=a1cfaae10a7b3b35 in_seq=0 out_seq=0 2024-05-14T09:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.117+0000 7f178be00700 10 client.15210 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f178be00700 1 -- 172.21.15.120:0/313402166 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563f1ef50020 con 0x563f1ef9d600 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f178be00700 10 client.15210 handle_command_reply: tid=0 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 client.15210 shutdown 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ee05df0 msgr2=0x563f1ef8d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ee05df0 0x563f1ef8d290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f179c00feb0 tx=0x7f179c004750 comp rx=0 tx=0).stop 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 shutdown_connections 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1ef9d600 0x563f1ef9ea70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef89ba0 0x563f1ef8dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ee05df0 0x563f1ef8d290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 --2- 172.21.15.120:0/313402166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef83c00 0x563f1ef8d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 >> 172.21.15.120:0/313402166 conn(0x563f1ee44a30 msgr2=0x563f1ef826b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f178be00700 0 client.15210 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 shutdown_connections 2024-05-14T09:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.120+0000 7f17bf303b80 1 -- 172.21.15.120:0/313402166 wait complete. 2024-05-14T09:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.121+0000 7f17bf303b80 20 client.15210 trim_cache size 0 max 16384 2024-05-14T09:22:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.143+0000 7f17bf303b80 1 Processor -- start 2024-05-14T09:22:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.143+0000 7f17bf303b80 1 -- start start 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef88440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef88980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17bf303b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef9cdb0 con 0x563f1ef83c00 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17bf303b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef9d480 con 0x563f1ef89ba0 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17bf303b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef9db50 con 0x563f1ee05df0 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17ad400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef88440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17ad400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef88440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56352/0 (socket says 172.21.15.120:56352) 2024-05-14T09:22:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17ad400700 1 -- 172.21.15.120:0/2570231110 learned_addr learned my addr 172.21.15.120:0/2570231110 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.144+0000 7f17ade00700 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ad400700 1 -- 172.21.15.120:0/2570231110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 msgr2=0x563f1ef836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ad400700 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ad400700 1 -- 172.21.15.120:0/2570231110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 msgr2=0x563f1ef88980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ae800700 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef88980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ad400700 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef88980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ad400700 1 -- 172.21.15.120:0/2570231110 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f1ef7f5b0 con 0x563f1ef83c00 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ade00700 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f17ad400700 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef88440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f17a806d120 tx=0x7f1798004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baaa25da06904bad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f1796a00700 1 -- 172.21.15.120:0/2570231110 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798022070 con 0x563f1ef83c00 2024-05-14T09:22:56.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f1796a00700 1 -- 172.21.15.120:0/2570231110 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1798004e00 con 0x563f1ef83c00 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.145+0000 7f1796a00700 1 -- 172.21.15.120:0/2570231110 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179801c9f0 con 0x563f1ef83c00 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 -- 172.21.15.120:0/2570231110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 msgr2=0x563f1ef88440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef88440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f17a806d120 tx=0x7f1798004750 comp rx=0 tx=0).stop 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 -- 172.21.15.120:0/2570231110 shutdown_connections 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ef89ba0 0x563f1ef88980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ee05df0 0x563f1ef836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 --2- 172.21.15.120:0/2570231110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef83c00 0x563f1ef88440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 -- 172.21.15.120:0/2570231110 >> 172.21.15.120:0/2570231110 conn(0x563f1ee44a30 msgr2=0x563f1ef8bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 -- 172.21.15.120:0/2570231110 shutdown_connections 2024-05-14T09:22:56.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.146+0000 7f17bf303b80 1 -- 172.21.15.120:0/2570231110 wait complete. 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.147+0000 7f17bf303b80 1 -- start start 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.147+0000 7f17bf303b80 1 Processor -- start 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ee05df0 0x563f1efa8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef83c00 0x563f1ef826b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17bf303b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef89ba0 0x563f1ef82bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17bf303b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef9e8f0 con 0x563f1ef89ba0 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17bf303b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef9e220 con 0x563f1ee05df0 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17bf303b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f1ef9efc0 con 0x563f1ef83c00 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17bf303b80 10 client.0 _ll_register_callbacks cb 0x563f1ee39330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef89ba0 0x563f1ef82bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef89ba0 0x563f1ef82bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56360/0 (socket says 172.21.15.120:56360) 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 -- 172.21.15.120:0/3694599429 learned_addr learned my addr 172.21.15.120:0/3694599429 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ade00700 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ee05df0 0x563f1efa8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ad400700 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef83c00 0x563f1ef826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 -- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef83c00 msgr2=0x563f1ef826b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef83c00 0x563f1ef826b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 -- 172.21.15.120:0/3694599429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ee05df0 msgr2=0x563f1efa8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ee05df0 0x563f1efa8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.148+0000 7f17ae800700 1 -- 172.21.15.120:0/3694599429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f1ef832a0 con 0x563f1ef89ba0 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f17ae800700 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef89ba0 0x563f1ef82bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f17a40a7020 tx=0x7f17a40e1710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bafdf23a0076177 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f178be00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f178be00700 1 -- 172.21.15.120:0/3694599429 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a406e070 con 0x563f1ef89ba0 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f178be00700 1 -- 172.21.15.120:0/3694599429 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f17a401ae00 con 0x563f1ef89ba0 2024-05-14T09:22:56.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1798004e00 con 0x563f1ef89ba0 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f178be00700 1 -- 172.21.15.120:0/3694599429 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f17a40aafa0 con 0x563f1ef89ba0 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f17bf303b80 10 client.15216 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.149+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f1efa6cd0 con 0x563f1ef89ba0 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f178be00700 1 -- 172.21.15.120:0/3694599429 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1798004e00 con 0x563f1ef89ba0 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f178be00700 1 -- 172.21.15.120:0/3694599429 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f17a4011070 con 0x563f1ef89ba0 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f17bf303b80 10 client.15216 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f17bf303b80 10 client.15216 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f17bf303b80 20 client.15216 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1f00aaa0 0x563f1f00bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f17bf303b80 4 client.15216 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:22:56.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.150+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "status"}) -- 0x563f1eeb33b0 con 0x563f1f00aaa0 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.151+0000 7f17ade00700 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1f00aaa0 0x563f1f00bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.152+0000 7f17ade00700 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1f00aaa0 0x563f1f00bf10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36cdc1d921accf3d server_cookie=b3d0a9abc126d55b in_seq=0 out_seq=0 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.152+0000 7f178be00700 10 client.15216 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f178be00700 1 -- 172.21.15.120:0/3694599429 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563f1eeb33b0 con 0x563f1f00aaa0 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f178be00700 10 client.15216 handle_command_reply: tid=0 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 client.15216 shutdown 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef89ba0 msgr2=0x563f1ef82bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef89ba0 0x563f1ef82bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f17a40a7020 tx=0x7f17a40e1710 comp rx=0 tx=0).stop 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 shutdown_connections 2024-05-14T09:22:56.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f1ee05df0 0x563f1efa8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x563f1f00aaa0 0x563f1f00bf10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f1ef89ba0 0x563f1ef82bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 --2- 172.21.15.120:0/3694599429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f1ef83c00 0x563f1ef826b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 >> 172.21.15.120:0/3694599429 conn(0x563f1ee44a30 msgr2=0x563f1ef88440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f178be00700 0 client.15216 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 shutdown_connections 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 1 -- 172.21.15.120:0/3694599429 wait complete. 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.153+0000 7f17bf303b80 20 client.15216 trim_cache size 0 max 16384 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:22:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 3, 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24469, 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 208.20075535300001, 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 324.86903588799998 2024-05-14T09:22:56.157 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:22:56.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17900b2880 msgr2=0x7f17900b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17900b2880 0x7f17900b4d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f179c005950 tx=0x7f179c0058e0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a810c5c0 msgr2=0x7f17a81a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:56.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a810c5c0 0x7f17a81a1700 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b830 tx=0x7f17a4004db0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 shutdown_connections 2024-05-14T09:22:56.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17900b2880 0x7f17900b4d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a810c5c0 0x7f17a81a1700 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a8106580 0x7f17a819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 --2- 172.21.15.120:0/2415866887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17a8106ed0 0x7f17a819d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:56.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.154+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 >> 172.21.15.120:0/2415866887 conn(0x7f17a8102080 msgr2=0x7f17a81047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:56.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.155+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 shutdown_connections 2024-05-14T09:22:56.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:56.155+0000 7f17b0800700 1 -- 172.21.15.120:0/2415866887 wait complete. 2024-05-14T09:22:57.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.k status 2024-05-14T09:22:57.506 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:22:57.832 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:57 smithi120 ceph-mon[31085]: pgmap v538: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:57 smithi152 ceph-mon[34868]: pgmap v538: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:57 smithi175 ceph-mon[35353]: pgmap v538: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 -- 172.21.15.120:0/3867267678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4104400 msgr2=0x7f5cc4104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/3867267678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4104400 0x7f5cc4104810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80099c0 tx=0x7f5cb8009cd0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 -- 172.21.15.120:0/3867267678 shutdown_connections 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/3867267678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc4109680 0x7f5cc4110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/3867267678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4104400 0x7f5cc4104810 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/3867267678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc4108d30 0x7f5cc4109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 -- 172.21.15.120:0/3867267678 >> 172.21.15.120:0/3867267678 conn(0x7f5cc4079d10 msgr2=0x7f5cc407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 -- 172.21.15.120:0/3867267678 shutdown_connections 2024-05-14T09:22:59.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.750+0000 7f5ccaa00700 1 -- 172.21.15.120:0/3867267678 wait complete. 2024-05-14T09:22:59.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.751+0000 7f5ccaa00700 1 Processor -- start 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5ccaa00700 1 -- start start 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5ccaa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc4104400 0x7f5cc4075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5ccaa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4108d30 0x7f5cc4076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5ccaa00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc4109680 0x7f5cc4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5ccaa00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc41141b0 con 0x7f5cc4108d30 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5ccaa00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc4114030 con 0x7f5cc4109680 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5ccaa00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc4114330 con 0x7f5cc4104400 2024-05-14T09:22:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4108d30 0x7f5cc4076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4108d30 0x7f5cc4076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57984/0 (socket says 172.21.15.120:57984) 2024-05-14T09:22:59.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.752+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1251579337 learned_addr learned my addr 172.21.15.120:0/1251579337 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:59.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cc9600700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc4104400 0x7f5cc4075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cca000700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc4109680 0x7f5cc4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1251579337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc4104400 msgr2=0x7f5cc4075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc4104400 0x7f5cc4075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1251579337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc4109680 msgr2=0x7f5cc4076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc4109680 0x7f5cc4076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1251579337 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc41a8f60 con 0x7f5cc4108d30 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.753+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4108d30 0x7f5cc4076000 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000d980 tx=0x7f5cb000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.754+0000 7f5cc2000700 1 -- 172.21.15.120:0/1251579337 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0017070 con 0x7f5cc4108d30 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.754+0000 7f5cc2000700 1 -- 172.21.15.120:0/1251579337 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cb0010460 con 0x7f5cc4108d30 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.754+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc41a9250 con 0x7f5cc4108d30 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.754+0000 7f5cc2000700 1 -- 172.21.15.120:0/1251579337 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000de60 con 0x7f5cc4108d30 2024-05-14T09:22:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.754+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc41a9790 con 0x7f5cc4108d30 2024-05-14T09:22:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.758+0000 7f5cc2000700 1 -- 172.21.15.120:0/1251579337 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5cb0010610 con 0x7f5cc4108d30 2024-05-14T09:22:59.758 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:22:59 smithi120 ceph-mon[31085]: pgmap v539: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:59.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cdab37b80 1 Processor -- start 2024-05-14T09:22:59.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cdab37b80 1 -- start start 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563debebdf0 0x5563ded6f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded6fa30 0x5563ded696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded6a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5563dec8b9d0 con 0x5563ded69bf0 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cc2000700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5cac0b2880 0x7f5cac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.759+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563dec29710 con 0x5563debebdf0 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5563dec87990 con 0x5563ded6fa30 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cc2000700 1 -- 172.21.15.120:0/1251579337 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5cb00e2170 con 0x7f5cc4108d30 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cca000700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5cac0b2880 0x7f5cac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded6a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded6a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57988/0 (socket says 172.21.15.120:57988) 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1311150223 learned_addr learned my addr 172.21.15.120:0/1311150223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cca000700 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563debebdf0 0x5563ded6f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.760+0000 7f5cc9600700 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded6fa30 0x5563ded696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1311150223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded6fa30 msgr2=0x5563ded696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded6fa30 0x5563ded696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1311150223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563debebdf0 msgr2=0x5563ded6f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563debebdf0 0x5563ded6f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cc8c00700 1 -- 172.21.15.120:0/1311150223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563debd8880 con 0x5563ded69bf0 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cc9600700 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded6fa30 0x5563ded696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cca000700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5cac0b2880 0x7f5cac0b4d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009550 tx=0x7f5cbc009be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded6a000 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0000c00 tx=0x7f5cb008c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca99f4b7d8be457f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.761+0000 7f5cb6a00700 1 -- 172.21.15.120:0/1311150223 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0020070 con 0x5563ded69bf0 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.762+0000 7f5cb6a00700 1 -- 172.21.15.120:0/1311150223 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cb00a9a90 con 0x5563ded69bf0 2024-05-14T09:22:59.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.762+0000 7f5cb6a00700 1 -- 172.21.15.120:0/1311150223 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0010ac0 con 0x5563ded69bf0 2024-05-14T09:22:59.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 -- 172.21.15.120:0/1311150223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 msgr2=0x5563ded6a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded6a000 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0000c00 tx=0x7f5cb008c0d0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 -- 172.21.15.120:0/1311150223 shutdown_connections 2024-05-14T09:22:59.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563debebdf0 0x5563ded6f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded6a000 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/1311150223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded6fa30 0x5563ded696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 -- 172.21.15.120:0/1311150223 >> 172.21.15.120:0/1311150223 conn(0x5563dec30f20 msgr2=0x5563ded643b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:59.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 -- 172.21.15.120:0/1311150223 shutdown_connections 2024-05-14T09:22:59.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.763+0000 7f5cdab37b80 1 -- 172.21.15.120:0/1311150223 wait complete. 2024-05-14T09:22:59.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.764+0000 7f5cdab37b80 1 -- start start 2024-05-14T09:22:59.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.764+0000 7f5cdab37b80 1 Processor -- start 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563debebdf0 0x5563ded731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded69bf0 0x5563ded736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded73c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5563ded76440 con 0x5563debebdf0 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563debf1ad0 con 0x5563ded6fa30 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5563ded765c0 con 0x5563ded69bf0 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cdab37b80 10 client.0 _ll_register_callbacks cb 0x5563dec32c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cc9600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563debebdf0 0x5563ded731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cc9600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563debebdf0 0x5563ded731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58004/0 (socket says 172.21.15.120:58004) 2024-05-14T09:22:59.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.765+0000 7f5cc9600700 1 -- 172.21.15.120:0/2924711321 learned_addr learned my addr 172.21.15.120:0/2924711321 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:59.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded69bf0 0x5563ded736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cca000700 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded73c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cc9600700 1 -- 172.21.15.120:0/2924711321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded69bf0 msgr2=0x5563ded736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cc9600700 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded69bf0 0x5563ded736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cc9600700 1 -- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 msgr2=0x5563ded73c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cc9600700 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded73c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cc9600700 1 -- 172.21.15.120:0/2924711321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563dec513d0 con 0x5563debebdf0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cc9600700 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563debebdf0 0x5563ded731b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80099c0 tx=0x7f5cb800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38714af24a4e0a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.766+0000 7f5cab400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.767+0000 7f5cab400700 1 -- 172.21.15.120:0/2924711321 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8027060 con 0x5563debebdf0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.767+0000 7f5cab400700 1 -- 172.21.15.120:0/2924711321 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5cb8005270 con 0x5563debebdf0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.767+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cb00a9a90 con 0x5563debebdf0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.767+0000 7f5cab400700 1 -- 172.21.15.120:0/2924711321 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5cb8005470 con 0x5563debebdf0 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.767+0000 7f5cdab37b80 10 client.15228 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:59.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.767+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563ded80f80 con 0x5563debebdf0 2024-05-14T09:22:59.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cab400700 1 -- 172.21.15.120:0/2924711321 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cb00a9a90 con 0x5563debebdf0 2024-05-14T09:22:59.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cab400700 1 -- 172.21.15.120:0/2924711321 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5cb800f690 con 0x5563debebdf0 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cdab37b80 10 client.15228 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cdab37b80 10 client.15228 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cdab37b80 20 client.15228 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563ded83510 0x5563ded84980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cdab37b80 4 client.15228 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.768+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ded36170 con 0x5563ded83510 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.769+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563ded83510 0x5563ded84980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.770+0000 7f5cab400700 10 client.15228 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:59.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.770+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563ded83510 0x5563ded84980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f77aacac4fd5ff5a server_cookie=4ee0752d28d93d83 in_seq=0 out_seq=0 2024-05-14T09:22:59.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.772+0000 7f5cab400700 1 -- 172.21.15.120:0/2924711321 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5563ded36170 con 0x5563ded83510 2024-05-14T09:22:59.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.772+0000 7f5cab400700 10 client.15228 handle_command_reply: tid=0 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 client.15228 shutdown 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563debebdf0 msgr2=0x5563ded731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563debebdf0 0x5563ded731b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80099c0 tx=0x7f5cb800bea0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 shutdown_connections 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded73c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563ded83510 0x5563ded84980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563debebdf0 0x5563ded731b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/2924711321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563ded69bf0 0x5563ded736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 >> 172.21.15.120:0/2924711321 conn(0x5563dec30f20 msgr2=0x5563ded686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cab400700 0 client.15228 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 shutdown_connections 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 1 -- 172.21.15.120:0/2924711321 wait complete. 2024-05-14T09:22:59.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.773+0000 7f5cdab37b80 20 client.15228 trim_cache size 0 max 16384 2024-05-14T09:22:59.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 Processor -- start 2024-05-14T09:22:59.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 -- start start 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5563ded82cc0 con 0x5563ded69bf0 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563ded83390 con 0x5563ded6fa30 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.796+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5563ded83a60 con 0x5563debebdf0 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58010/0 (socket says 172.21.15.120:58010) 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3706036028 learned_addr learned my addr 172.21.15.120:0/3706036028 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cca000700 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc9600700 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3706036028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 msgr2=0x5563ded696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3706036028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 msgr2=0x5563ded7f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.797+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3706036028 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ded60bf0 con 0x5563ded69bf0 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.798+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded724d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00a9320 tx=0x7f5cb0091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb04db692bb18816 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.798+0000 7f5cb6000700 1 -- 172.21.15.120:0/3706036028 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0020040 con 0x5563ded69bf0 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.798+0000 7f5cb6000700 1 -- 172.21.15.120:0/3706036028 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cb00a9390 con 0x5563ded69bf0 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.798+0000 7f5cb6000700 1 -- 172.21.15.120:0/3706036028 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00a9850 con 0x5563ded69bf0 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3706036028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 msgr2=0x5563ded724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded724d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00a9320 tx=0x7f5cb0091040 comp rx=0 tx=0).stop 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3706036028 shutdown_connections 2024-05-14T09:22:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3706036028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded724d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3706036028 >> 172.21.15.120:0/3706036028 conn(0x5563dec30f20 msgr2=0x5563ded63e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3706036028 shutdown_connections 2024-05-14T09:22:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.799+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3706036028 wait complete. 2024-05-14T09:22:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.800+0000 7f5cdab37b80 1 -- start start 2024-05-14T09:22:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.800+0000 7f5cdab37b80 1 Processor -- start 2024-05-14T09:22:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.800+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded7ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.800+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded7f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.800+0000 7f5cdab37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5563ded84800 con 0x5563ded69bf0 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563ded84130 con 0x5563ded6fa30 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cdab37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5563ded84ed0 con 0x5563debebdf0 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cdab37b80 10 client.0 _ll_register_callbacks cb 0x5563ded65510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded7f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded7f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58014/0 (socket says 172.21.15.120:58014) 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3584711465 learned_addr learned my addr 172.21.15.120:0/3584711465 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc9600700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded7ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cca000700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3584711465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 msgr2=0x5563ded7ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded7ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 msgr2=0x5563ded7f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cc8c00700 1 -- 172.21.15.120:0/3584711465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ded8c4d0 con 0x5563ded69bf0 2024-05-14T09:22:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.801+0000 7f5cca000700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cc8c00700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded7f190 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00a8e50 tx=0x7f5cb00b2370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c11f1794beb667 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cab400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cab400700 1 -- 172.21.15.120:0/3584711465 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0020070 con 0x5563ded69bf0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cab400700 1 -- 172.21.15.120:0/3584711465 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5cb00a97f0 con 0x5563ded69bf0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cb00a9390 con 0x5563ded69bf0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cab400700 1 -- 172.21.15.120:0/3584711465 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5cb00b1d60 con 0x5563ded69bf0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cdab37b80 10 client.15234 fetch_fsmap learned FSMap version 29 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563dedeee40 con 0x5563ded69bf0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.802+0000 7f5cab400700 1 -- 172.21.15.120:0/3584711465 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cb00a9390 con 0x5563ded69bf0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cab400700 1 -- 172.21.15.120:0/3584711465 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5cb008c420 con 0x5563ded69bf0 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cdab37b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cdab37b80 10 client.15234 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cdab37b80 20 client.15234 populate_metadata read hostname 'smithi120' 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563dedf0950 0x5563dedf1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:22:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cdab37b80 4 client.15234 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:22:59.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "status"}) -- 0x5563dec993b0 con 0x5563dedf0950 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.803+0000 7f5cc9600700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563dedf0950 0x5563dedf1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.804+0000 7f5cc9600700 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563dedf0950 0x5563dedf1dc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5fd35f41dcd9b7f8 server_cookie=b31702508ada6d4 in_seq=0 out_seq=0 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.804+0000 7f5cab400700 10 client.15234 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cab400700 1 -- 172.21.15.120:0/3584711465 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5563dec993b0 con 0x5563dedf0950 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cab400700 10 client.15234 handle_command_reply: tid=0 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 client.15234 shutdown 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 msgr2=0x5563ded7f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded7f190 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00a8e50 tx=0x7f5cb00b2370 comp rx=0 tx=0).stop 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 shutdown_connections 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563ded6fa30 0x5563ded7f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5563dedf0950 0x5563dedf1dc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563debebdf0 0x5563ded7ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 --2- 172.21.15.120:0/3584711465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563ded69bf0 0x5563ded7f190 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cab400700 0 client.15234 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 >> 172.21.15.120:0/3584711465 conn(0x5563dec30f20 msgr2=0x5563ded5e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 shutdown_connections 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.805+0000 7f5cdab37b80 1 -- 172.21.15.120:0/3584711465 wait complete. 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.806+0000 7f5cdab37b80 20 client.15234 trim_cache size 0 max 16384 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:22:59.808 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 34388, 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 212.87167972200001, 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 359.42571743100001 2024-05-14T09:22:59.809 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.806+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5cac0b2880 msgr2=0x7f5cac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.806+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5cac0b2880 0x7f5cac0b4d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009550 tx=0x7f5cbc009be0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.806+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4108d30 msgr2=0x7f5cc4076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.806+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4108d30 0x7f5cc4076000 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000d980 tx=0x7f5cb000dd40 comp rx=0 tx=0).stop 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 shutdown_connections 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5cac0b2880 0x7f5cac0b4d90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc4109680 0x7f5cc4076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc4104400 0x7f5cc4075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 --2- 172.21.15.120:0/1251579337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cc4108d30 0x7f5cc4076000 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 >> 172.21.15.120:0/1251579337 conn(0x7f5cc4079d10 msgr2=0x7f5cc4101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:22:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 shutdown_connections 2024-05-14T09:22:59.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:22:59.807+0000 7f5ccaa00700 1 -- 172.21.15.120:0/1251579337 wait complete. 2024-05-14T09:22:59.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:22:59 smithi152 ceph-mon[34868]: pgmap v539: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:22:59.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:22:59 smithi175 ceph-mon[35353]: pgmap v539: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:00.580 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.e status 2024-05-14T09:23:01.044 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:01.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:01 smithi120 ceph-mon[31085]: pgmap v540: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:23:01.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:01 smithi152 ceph-mon[34868]: pgmap v540: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:23:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:01 smithi175 ceph-mon[35353]: pgmap v540: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:23:03.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.405+0000 7fd4d2400700 1 -- 172.21.15.120:0/37247340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10b110 msgr2=0x7fd4cc117620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.405+0000 7fd4d2400700 1 --2- 172.21.15.120:0/37247340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10b110 0x7fd4cc117620 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400b0a0 tx=0x7fd4c400b3b0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.406+0000 7fd4d2400700 1 -- 172.21.15.120:0/37247340 shutdown_connections 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.406+0000 7fd4d2400700 1 --2- 172.21.15.120:0/37247340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4cc10f6c0 0x7fd4cc10fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.406+0000 7fd4d2400700 1 --2- 172.21.15.120:0/37247340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10b110 0x7fd4cc117620 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.406+0000 7fd4d2400700 1 --2- 172.21.15.120:0/37247340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4cc10a7c0 0x7fd4cc10abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.406+0000 7fd4d2400700 1 -- 172.21.15.120:0/37247340 >> 172.21.15.120:0/37247340 conn(0x7fd4cc076b00 msgr2=0x7fd4cc076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.406+0000 7fd4d2400700 1 -- 172.21.15.120:0/37247340 shutdown_connections 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.406+0000 7fd4d2400700 1 -- 172.21.15.120:0/37247340 wait complete. 2024-05-14T09:23:03.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.407+0000 7fd4d2400700 1 Processor -- start 2024-05-14T09:23:03.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d2400700 1 -- start start 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d2400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4cc10a7c0 0x7fd4cc1a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d2400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4cc10b110 0x7fd4cc1a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d2400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10f6c0 0x7fd4cc1a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d2400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc11a760 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d2400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc11a5e0 con 0x7fd4cc10a7c0 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d2400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc11a8e0 con 0x7fd4cc10b110 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d1a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10f6c0 0x7fd4cc1a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d1a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10f6c0 0x7fd4cc1a5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58040/0 (socket says 172.21.15.120:58040) 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.408+0000 7fd4d1a00700 1 -- 172.21.15.120:0/3786300233 learned_addr learned my addr 172.21.15.120:0/3786300233 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4cc10b110 0x7fd4cc1a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4cc10a7c0 0x7fd4cc1a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1a00700 1 -- 172.21.15.120:0/3786300233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4cc10b110 msgr2=0x7fd4cc1a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1a00700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4cc10b110 0x7fd4cc1a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1a00700 1 -- 172.21.15.120:0/3786300233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4cc10a7c0 msgr2=0x7fd4cc1a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1a00700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4cc10a7c0 0x7fd4cc1a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1a00700 1 -- 172.21.15.120:0/3786300233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc1a5e70 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4cc10a7c0 0x7fd4cc1a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4d1a00700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10f6c0 0x7fd4cc1a5880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400b830 tx=0x7fd4c4004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.409+0000 7fd4c9600700 1 -- 172.21.15.120:0/3786300233 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4021070 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.410+0000 7fd4c9600700 1 -- 172.21.15.120:0/3786300233 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4c4007c80 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.410+0000 7fd4c9600700 1 -- 172.21.15.120:0/3786300233 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4005260 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.410+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4cc1a6100 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.410+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4cc1a6590 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.415+0000 7fd4c9600700 1 -- 172.21.15.120:0/3786300233 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd4c4024070 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.416+0000 7fd4e2592b80 1 Processor -- start 2024-05-14T09:23:03.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.416+0000 7fd4e2592b80 1 -- start start 2024-05-14T09:23:03.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.416+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f64014f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.416+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f63fc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f9f631d9d0 con 0x55f9f6401a30 2024-05-14T09:23:03.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9f62bb710 con 0x55f9f63fbbf0 2024-05-14T09:23:03.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6319990 con 0x55f9f627ddf0 2024-05-14T09:23:03.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63fb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58044/0 (socket says 172.21.15.120:58044) 2024-05-14T09:23:03.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 -- 172.21.15.120:0/3336418433 learned_addr learned my addr 172.21.15.120:0/3336418433 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:03.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4c9600700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4b40b2900 0x7fd4b40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f64014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f63fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 -- 172.21.15.120:0/3336418433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 msgr2=0x55f9f64014f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f64014f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4c9600700 1 -- 172.21.15.120:0/3786300233 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd4c400f020 con 0x7fd4cc10f6c0 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 -- 172.21.15.120:0/3336418433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 msgr2=0x55f9f63fc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f63fc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1000700 1 -- 172.21.15.120:0/3336418433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f626a880 con 0x55f9f6401a30 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f63fc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.417+0000 7fd4d1a00700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4b40b2900 0x7fd4b40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.418+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63fb6b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000bc40 tx=0x7fd4c000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9d894598cbf1ff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:03.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.418+0000 7fd4be000700 1 -- 172.21.15.120:0/3336418433 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000de10 con 0x55f9f6401a30 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.418+0000 7fd4d1a00700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4b40b2900 0x7fd4b40b4e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40aac40 tx=0x7fd4c4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.418+0000 7fd4be000700 1 -- 172.21.15.120:0/3336418433 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4c00178b0 con 0x55f9f6401a30 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.418+0000 7fd4be000700 1 -- 172.21.15.120:0/3336418433 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000f910 con 0x55f9f6401a30 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3336418433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 msgr2=0x55f9f63fb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63fb6b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000bc40 tx=0x7fd4c000bf50 comp rx=0 tx=0).stop 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3336418433 shutdown_connections 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f63fc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f64014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3336418433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63fb6b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3336418433 >> 172.21.15.120:0/3336418433 conn(0x55f9f62c2f20 msgr2=0x55f9f63f63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3336418433 shutdown_connections 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.419+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3336418433 wait complete. 2024-05-14T09:23:03.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.420+0000 7fd4e2592b80 1 -- start start 2024-05-14T09:23:03.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.420+0000 7fd4e2592b80 1 Processor -- start 2024-05-14T09:23:03.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f627ddf0 0x55f9f64050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f63fbbf0 0x55f9f6405620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f6401a30 0x55f9f6405b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6408440 con 0x55f9f63fbbf0 2024-05-14T09:23:03.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6283ad0 con 0x55f9f627ddf0 2024-05-14T09:23:03.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9f64085c0 con 0x55f9f6401a30 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4e2592b80 10 client.0 _ll_register_callbacks cb 0x55f9f62c4c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4d1000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f63fbbf0 0x55f9f6405620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4d1000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f63fbbf0 0x55f9f6405620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58060/0 (socket says 172.21.15.120:58060) 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4d1000700 1 -- 172.21.15.120:0/3307144148 learned_addr learned my addr 172.21.15.120:0/3307144148 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.421+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f627ddf0 0x55f9f64050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f6401a30 0x55f9f6405b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4d1000700 1 -- 172.21.15.120:0/3307144148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f6401a30 msgr2=0x55f9f6405b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f6401a30 0x55f9f6405b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4d1000700 1 -- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f627ddf0 msgr2=0x55f9f64050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f627ddf0 0x55f9f64050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4d1000700 1 -- 172.21.15.120:0/3307144148 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f62e33d0 con 0x55f9f63fbbf0 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f627ddf0 0x55f9f64050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f63fbbf0 0x55f9f6405620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0000c00 tx=0x7fd4c0017700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d55961fc695460 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:03.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4b2a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.422+0000 7fd4b2a00700 1 -- 172.21.15.120:0/3307144148 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0026020 con 0x55f9f63fbbf0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.423+0000 7fd4b2a00700 1 -- 172.21.15.120:0/3307144148 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd4c0017d70 con 0x55f9f63fbbf0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.423+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4c00178b0 con 0x55f9f63fbbf0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.423+0000 7fd4b2a00700 1 -- 172.21.15.120:0/3307144148 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4c0031050 con 0x55f9f63fbbf0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.423+0000 7fd4e2592b80 10 client.15246 fetch_fsmap learned FSMap version 29 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.423+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f9f6412f20 con 0x55f9f63fbbf0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.423+0000 7fd4b2a00700 1 -- 172.21.15.120:0/3307144148 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4c00178b0 con 0x55f9f63fbbf0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.423+0000 7fd4b2a00700 1 -- 172.21.15.120:0/3307144148 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd4c00216e0 con 0x55f9f63fbbf0 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.424+0000 7fd4e2592b80 10 client.15246 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.424+0000 7fd4e2592b80 10 client.15246 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.424+0000 7fd4e2592b80 20 client.15246 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.424+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f64151e0 0x55f9f6416650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.424+0000 7fd4e2592b80 4 client.15246 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:23:03.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.424+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9f63c8170 con 0x55f9f64151e0 2024-05-14T09:23:03.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.424+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f64151e0 0x55f9f6416650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.425+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f64151e0 0x55f9f6416650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=138187f0ec0549d server_cookie=6c5ad384cc7fa930 in_seq=0 out_seq=0 2024-05-14T09:23:03.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.425+0000 7fd4b2a00700 10 client.15246 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:23:03.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4b2a00700 1 -- 172.21.15.120:0/3307144148 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f9f63c8170 con 0x55f9f64151e0 2024-05-14T09:23:03.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4b2a00700 10 client.15246 handle_command_reply: tid=0 2024-05-14T09:23:03.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 client.15246 shutdown 2024-05-14T09:23:03.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f63fbbf0 msgr2=0x55f9f6405620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f63fbbf0 0x55f9f6405620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0000c00 tx=0x7fd4c0017700 comp rx=0 tx=0).stop 2024-05-14T09:23:03.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 shutdown_connections 2024-05-14T09:23:03.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f64151e0 0x55f9f6416650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f627ddf0 0x55f9f64050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f6401a30 0x55f9f6405b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3307144148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f63fbbf0 0x55f9f6405620 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4b2a00700 0 client.15246 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:23:03.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 >> 172.21.15.120:0/3307144148 conn(0x55f9f62c2f20 msgr2=0x55f9f63fa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:03.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 shutdown_connections 2024-05-14T09:23:03.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3307144148 wait complete. 2024-05-14T09:23:03.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.428+0000 7fd4e2592b80 20 client.15246 trim_cache size 0 max 16384 2024-05-14T09:23:03.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 Processor -- start 2024-05-14T09:23:03.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 -- start start 2024-05-14T09:23:03.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f63fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6411890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63f0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6414990 con 0x55f9f6401a30 2024-05-14T09:23:03.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6415060 con 0x55f9f63fbbf0 2024-05-14T09:23:03.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.451+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6415730 con 0x55f9f627ddf0 2024-05-14T09:23:03.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58062/0 (socket says 172.21.15.120:58062) 2024-05-14T09:23:03.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 -- 172.21.15.120:0/3017801869 learned_addr learned my addr 172.21.15.120:0/3017801869 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:03.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4d1000700 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6411890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f63fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 -- 172.21.15.120:0/3017801869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 msgr2=0x55f9f63fb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f63fb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 -- 172.21.15.120:0/3017801869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 msgr2=0x55f9f6411890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6411890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.452+0000 7fd4cbe00700 1 -- 172.21.15.120:0/3017801869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f63f2bf0 con 0x55f9f6401a30 2024-05-14T09:23:03.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.453+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63f0250 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55f9f63fc960 tx=0x7fd4b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df10cacc12af3d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:03.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.453+0000 7fd4bd600700 1 -- 172.21.15.120:0/3017801869 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8013ac0 con 0x55f9f6401a30 2024-05-14T09:23:03.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.453+0000 7fd4bd600700 1 -- 172.21.15.120:0/3017801869 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4b8013c60 con 0x55f9f6401a30 2024-05-14T09:23:03.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.453+0000 7fd4bd600700 1 -- 172.21.15.120:0/3017801869 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8029390 con 0x55f9f6401a30 2024-05-14T09:23:03.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3017801869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 msgr2=0x55f9f63f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63f0250 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55f9f63fc960 tx=0x7fd4b8004750 comp rx=0 tx=0).stop 2024-05-14T09:23:03.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3017801869 shutdown_connections 2024-05-14T09:23:03.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f63f0250 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f63fb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/3017801869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6411890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3017801869 >> 172.21.15.120:0/3017801869 conn(0x55f9f62c2f20 msgr2=0x55f9f63f5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3017801869 shutdown_connections 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.454+0000 7fd4e2592b80 1 -- 172.21.15.120:0/3017801869 wait complete. 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.455+0000 7fd4e2592b80 1 -- start start 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.455+0000 7fd4e2592b80 1 Processor -- start 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.455+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f641fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.455+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6420010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4e2592b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f641aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f9f64164d0 con 0x55f9f6401a30 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6415e00 con 0x55f9f63fbbf0 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4e2592b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9f6416ba0 con 0x55f9f627ddf0 2024-05-14T09:23:03.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4e2592b80 10 client.0 _ll_register_callbacks cb 0x55f9f62c4c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f641aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f641aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58072/0 (socket says 172.21.15.120:58072) 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 -- 172.21.15.120:0/456208482 learned_addr learned my addr 172.21.15.120:0/456208482 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f641fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4d1000700 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6420010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 -- 172.21.15.120:0/456208482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 msgr2=0x55f9f641fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f641fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 -- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 msgr2=0x55f9f6420010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6420010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.456+0000 7fd4cbe00700 1 -- 172.21.15.120:0/456208482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f641afc0 con 0x55f9f6401a30 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4cbe00700 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f641aa80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c4f0 tx=0x7fd4b8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac21fe1726de85f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:03.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4b2a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:03.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4b2a00700 1 -- 172.21.15.120:0/456208482 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8004030 con 0x55f9f6401a30 2024-05-14T09:23:03.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4b8013c60 con 0x55f9f6401a30 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4b2a00700 1 -- 172.21.15.120:0/456208482 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd4b80041d0 con 0x55f9f6401a30 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4b2a00700 1 -- 172.21.15.120:0/456208482 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4b80043d0 con 0x55f9f6401a30 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4e2592b80 10 client.15252 fetch_fsmap learned FSMap version 29 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.457+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f9f6480db0 con 0x55f9f6401a30 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4b2a00700 1 -- 172.21.15.120:0/456208482 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4b8013c60 con 0x55f9f6401a30 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4b2a00700 1 -- 172.21.15.120:0/456208482 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd4b8029070 con 0x55f9f6401a30 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4e2592b80 10 client.15252 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4e2592b80 10 client.15252 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4e2592b80 20 client.15252 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f6482fc0 0x55f9f6484430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:03.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4e2592b80 4 client.15252 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.458+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "status"}) -- 0x55f9f632b3b0 con 0x55f9f6482fc0 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.459+0000 7fd4d1000700 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f6482fc0 0x55f9f6484430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.460+0000 7fd4d1000700 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f6482fc0 0x55f9f6484430 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fcfca08467384b6 server_cookie=c67c9c3aa3fa747f in_seq=0 out_seq=0 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.460+0000 7fd4b2a00700 10 client.15252 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.460+0000 7fd4b2a00700 1 -- 172.21.15.120:0/456208482 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f9f632b3b0 con 0x55f9f6482fc0 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.460+0000 7fd4b2a00700 10 client.15252 handle_command_reply: tid=0 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.460+0000 7fd4e2592b80 1 client.15252 shutdown 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 msgr2=0x55f9f641aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f641aa80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c4f0 tx=0x7fd4b8016040 comp rx=0 tx=0).stop 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 shutdown_connections 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55f9f6482fc0 0x55f9f6484430 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9f6401a30 0x55f9f641aa80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9f627ddf0 0x55f9f641fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 --2- 172.21.15.120:0/456208482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9f63fbbf0 0x55f9f6420010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 >> 172.21.15.120:0/456208482 conn(0x55f9f62c2f20 msgr2=0x55f9f63f0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4b2a00700 0 client.15252 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 shutdown_connections 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 1 -- 172.21.15.120:0/456208482 wait complete. 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.461+0000 7fd4e2592b80 20 client.15252 trim_cache size 0 max 16384 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 34409, 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:23:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:23:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 217.554630151, 2024-05-14T09:23:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:23:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:23:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:23:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 349.298021398 2024-05-14T09:23:03.465 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4b40b2900 msgr2=0x7fd4b40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4b40b2900 0x7fd4b40b4e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40aac40 tx=0x7fd4c4009040 comp rx=0 tx=0).stop 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10f6c0 msgr2=0x7fd4cc1a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10f6c0 0x7fd4cc1a5880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400b830 tx=0x7fd4c4004db0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 shutdown_connections 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4b40b2900 0x7fd4b40b4e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4cc10a7c0 0x7fd4cc1a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4cc10f6c0 0x7fd4cc1a5880 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 --2- 172.21.15.120:0/3786300233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4cc10b110 0x7fd4cc1a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 >> 172.21.15.120:0/3786300233 conn(0x7fd4cc076b00 msgr2=0x7fd4cc108820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 shutdown_connections 2024-05-14T09:23:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:03.462+0000 7fd4d2400700 1 -- 172.21.15.120:0/3786300233 wait complete. 2024-05-14T09:23:03.780 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:03 smithi175 ceph-mon[35353]: pgmap v541: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:03.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:03 smithi120 ceph-mon[31085]: pgmap v541: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:03.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:03 smithi152 ceph-mon[34868]: pgmap v541: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:04.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-14T09:23:04.818 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:05.869 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:05 smithi120 ceph-mon[31085]: pgmap v542: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:05.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:05 smithi152 ceph-mon[34868]: pgmap v542: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:05 smithi175 ceph-mon[35353]: pgmap v542: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:07.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 -- 172.21.15.120:0/334487822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c38110970 msgr2=0x7f8c38110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 --2- 172.21.15.120:0/334487822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c38110970 0x7f8c38110d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009990 tx=0x7f8c28009ca0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 -- 172.21.15.120:0/334487822 shutdown_connections 2024-05-14T09:23:07.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 --2- 172.21.15.120:0/334487822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c3810b2e0 0x7f8c38117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 --2- 172.21.15.120:0/334487822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c38110970 0x7f8c38110d80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 --2- 172.21.15.120:0/334487822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c3810a990 0x7f8c3810ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 -- 172.21.15.120:0/334487822 >> 172.21.15.120:0/334487822 conn(0x7f8c38077c80 msgr2=0x7f8c380780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:07.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 -- 172.21.15.120:0/334487822 shutdown_connections 2024-05-14T09:23:07.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.154+0000 7f8c3e600700 1 -- 172.21.15.120:0/334487822 wait complete. 2024-05-14T09:23:07.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.155+0000 7f8c3e600700 1 Processor -- start 2024-05-14T09:23:07.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.155+0000 7f8c3e600700 1 -- start start 2024-05-14T09:23:07.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c3e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3810a990 0x7f8c381a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c3e600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c3810b2e0 0x7f8c381a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c3e600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c38110970 0x7f8c381a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c3e600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3811a970 con 0x7f8c3810a990 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c3e600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3811a7f0 con 0x7f8c38110970 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c3e600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3811aaf0 con 0x7f8c3810b2e0 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c37400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3810a990 0x7f8c381a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c37400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3810a990 0x7f8c381a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58090/0 (socket says 172.21.15.120:58090) 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c37400700 1 -- 172.21.15.120:0/2102371447 learned_addr learned my addr 172.21.15.120:0/2102371447 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.156+0000 7f8c36a00700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c3810b2e0 0x7f8c381a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37e00700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c38110970 0x7f8c381a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37400700 1 -- 172.21.15.120:0/2102371447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c3810b2e0 msgr2=0x7f8c381a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37400700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c3810b2e0 0x7f8c381a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37400700 1 -- 172.21.15.120:0/2102371447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c38110970 msgr2=0x7f8c381a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37400700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c38110970 0x7f8c381a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37400700 1 -- 172.21.15.120:0/2102371447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c381a61e0 con 0x7f8c3810a990 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37e00700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c38110970 0x7f8c381a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c36a00700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c3810b2e0 0x7f8c381a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c37400700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3810a990 0x7f8c381a13c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800b5c0 tx=0x7f8c280047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.157+0000 7f8c2fe00700 1 -- 172.21.15.120:0/2102371447 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28004830 con 0x7f8c3810a990 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.158+0000 7f8c2fe00700 1 -- 172.21.15.120:0/2102371447 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c28005020 con 0x7f8c3810a990 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.158+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c381a6470 con 0x7f8c3810a990 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.158+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c381a68f0 con 0x7f8c3810a990 2024-05-14T09:23:07.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.158+0000 7f8c2fe00700 1 -- 172.21.15.120:0/2102371447 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2800f950 con 0x7f8c3810a990 2024-05-14T09:23:07.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.162+0000 7f8c2fe00700 1 -- 172.21.15.120:0/2102371447 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8c2800fc10 con 0x7f8c3810a990 2024-05-14T09:23:07.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.163+0000 7f8c4d05fb80 1 Processor -- start 2024-05-14T09:23:07.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.163+0000 7f8c4d05fb80 1 -- start start 2024-05-14T09:23:07.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c2fe00700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8c1c0b2880 0x7f8c1c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d69660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d64010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559197c859d0 con 0x559197d69ba0 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559197c23710 con 0x559197be5df0 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559197c81990 con 0x559197d63c00 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c2fe00700 1 -- 172.21.15.120:0/2102371447 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8c280e3220 con 0x7f8c3810a990 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.164+0000 7f8c37e00700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8c1c0b2880 0x7f8c1c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d69660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d64010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d69660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39326/0 (socket says 172.21.15.120:39326) 2024-05-14T09:23:07.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 -- 172.21.15.120:0/747559254 learned_addr learned my addr 172.21.15.120:0/747559254 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:07.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c36a00700 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 -- 172.21.15.120:0/747559254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 msgr2=0x559197d64010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d64010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 -- 172.21.15.120:0/747559254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 msgr2=0x559197d636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.165+0000 7f8c37400700 1 -- 172.21.15.120:0/747559254 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559197bd2880 con 0x559197be5df0 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.166+0000 7f8c37e00700 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.166+0000 7f8c37e00700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8c1c0b2880 0x7f8c1c0b4d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c30012aa0 tx=0x7f8c30012670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.166+0000 7f8c37400700 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d69660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c280aa1d0 tx=0x7f8c2802d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=963fd01015ecba49 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.166+0000 7f8c2cc00700 1 -- 172.21.15.120:0/747559254 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280aabd0 con 0x559197be5df0 2024-05-14T09:23:07.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.166+0000 7f8c2cc00700 1 -- 172.21.15.120:0/747559254 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c280920b0 con 0x559197be5df0 2024-05-14T09:23:07.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.166+0000 7f8c2cc00700 1 -- 172.21.15.120:0/747559254 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280054d0 con 0x559197be5df0 2024-05-14T09:23:07.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.167+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/747559254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 msgr2=0x559197d69660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.167+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d69660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c280aa1d0 tx=0x7f8c2802d000 comp rx=0 tx=0).stop 2024-05-14T09:23:07.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.168+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/747559254 shutdown_connections 2024-05-14T09:23:07.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.168+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d69660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.168+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.168+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/747559254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.168+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/747559254 >> 172.21.15.120:0/747559254 conn(0x559197c24a30 msgr2=0x559197d5e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:07.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.168+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/747559254 shutdown_connections 2024-05-14T09:23:07.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.168+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/747559254 wait complete. 2024-05-14T09:23:07.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.169+0000 7f8c4d05fb80 1 -- start start 2024-05-14T09:23:07.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.169+0000 7f8c4d05fb80 1 Processor -- start 2024-05-14T09:23:07.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.169+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d6d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.169+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d6d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d6dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559197d70430 con 0x559197be5df0 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559197bebad0 con 0x559197d63c00 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559197d705b0 con 0x559197d69ba0 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c4d05fb80 10 client.0 _ll_register_callbacks cb 0x559197c19330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c37400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d6d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c37400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d6d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58098/0 (socket says 172.21.15.120:58098) 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c37400700 1 -- 172.21.15.120:0/207749276 learned_addr learned my addr 172.21.15.120:0/207749276 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:07.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c36a00700 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d6d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.170+0000 7f8c37e00700 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d6dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c37400700 1 -- 172.21.15.120:0/207749276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 msgr2=0x559197d6dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c37400700 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d6dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c37400700 1 -- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 msgr2=0x559197d6d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c37400700 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d6d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c37400700 1 -- 172.21.15.120:0/207749276 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559197c4b3d0 con 0x559197be5df0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c37400700 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d6d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c280a7740 tx=0x7f8c28009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f671645fc327f2ad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c21600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c21600700 1 -- 172.21.15.120:0/207749276 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280aabd0 con 0x559197be5df0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c21600700 1 -- 172.21.15.120:0/207749276 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8c280b2e10 con 0x559197be5df0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.171+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c280920b0 con 0x559197be5df0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c21600700 1 -- 172.21.15.120:0/207749276 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c280b32a0 con 0x559197be5df0 2024-05-14T09:23:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c4d05fb80 10 client.15264 fetch_fsmap learned FSMap version 29 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559197d70430 con 0x559197be5df0 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c21600700 1 -- 172.21.15.120:0/207749276 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c280920b0 con 0x559197be5df0 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c21600700 1 -- 172.21.15.120:0/207749276 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c280a9730 con 0x559197be5df0 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c4d05fb80 10 client.15264 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c4d05fb80 10 client.15264 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c4d05fb80 20 client.15264 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.172+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197d7d480 0x559197d7e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.173+0000 7f8c4d05fb80 4 client.15264 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:23:07.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.173+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559197d30020 con 0x559197d7d480 2024-05-14T09:23:07.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.173+0000 7f8c36a00700 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197d7d480 0x559197d7e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.174+0000 7f8c36a00700 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197d7d480 0x559197d7e8f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fab2a5c9e29f326 server_cookie=2ce00e812030e59e in_seq=0 out_seq=0 2024-05-14T09:23:07.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.174+0000 7f8c21600700 10 client.15264 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:07.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.177+0000 7f8c21600700 1 -- 172.21.15.120:0/207749276 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559197d30020 con 0x559197d7d480 2024-05-14T09:23:07.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.177+0000 7f8c21600700 10 client.15264 handle_command_reply: tid=0 2024-05-14T09:23:07.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.177+0000 7f8c4d05fb80 1 client.15264 shutdown 2024-05-14T09:23:07.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.177+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 msgr2=0x559197d6d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.177+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d6d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c280a7740 tx=0x7f8c28009ca0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 shutdown_connections 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197d7d480 0x559197d7e8f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d6dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d6d300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c21600700 0 client.15264 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/207749276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d6d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 >> 172.21.15.120:0/207749276 conn(0x559197c24a30 msgr2=0x559197d626b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 shutdown_connections 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/207749276 wait complete. 2024-05-14T09:23:07.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.178+0000 7f8c4d05fb80 20 client.15264 trim_cache size 0 max 16384 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.201+0000 7f8c4d05fb80 1 Processor -- start 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.201+0000 7f8c4d05fb80 1 -- start start 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d79810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d68bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559197d7cc30 con 0x559197be5df0 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559197d7d300 con 0x559197d63c00 2024-05-14T09:23:07.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559197d7d9d0 con 0x559197d69ba0 2024-05-14T09:23:07.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58112/0 (socket says 172.21.15.120:58112) 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 -- 172.21.15.120:0/1728500353 learned_addr learned my addr 172.21.15.120:0/1728500353 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c36a00700 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d79810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37e00700 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d68bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 -- 172.21.15.120:0/1728500353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 msgr2=0x559197d68bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d68bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 -- 172.21.15.120:0/1728500353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 msgr2=0x559197d79810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d79810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c37400700 1 -- 172.21.15.120:0/1728500353 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559197d5ad40 con 0x559197be5df0 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.202+0000 7f8c36a00700 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d79810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.203+0000 7f8c37400700 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d636c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8c280a9b00 tx=0x7f8c28005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826bdec96631926c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.203+0000 7f8c23e00700 1 -- 172.21.15.120:0/1728500353 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280aabd0 con 0x559197be5df0 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.203+0000 7f8c23e00700 1 -- 172.21.15.120:0/1728500353 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c280920b0 con 0x559197be5df0 2024-05-14T09:23:07.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.203+0000 7f8c23e00700 1 -- 172.21.15.120:0/1728500353 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280b3070 con 0x559197be5df0 2024-05-14T09:23:07.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1728500353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 msgr2=0x559197d636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d636c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8c280a9b00 tx=0x7f8c28005440 comp rx=0 tx=0).stop 2024-05-14T09:23:07.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1728500353 shutdown_connections 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d69ba0 0x559197d68bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197be5df0 0x559197d636c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1728500353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197d63c00 0x559197d79810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1728500353 >> 172.21.15.120:0/1728500353 conn(0x559197c24a30 msgr2=0x559197d684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1728500353 shutdown_connections 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.204+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1728500353 wait complete. 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.205+0000 7f8c4d05fb80 1 -- start start 2024-05-14T09:23:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.205+0000 7f8c4d05fb80 1 Processor -- start 2024-05-14T09:23:07.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d62ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d62ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c4d05fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d63550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559197d7e770 con 0x559197d69ba0 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559197d7e0a0 con 0x559197be5df0 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c4d05fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559197d7ee40 con 0x559197d63c00 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c4d05fb80 10 client.0 _ll_register_callbacks cb 0x559197c19330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c37e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d63550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c37e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d63550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58114/0 (socket says 172.21.15.120:58114) 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c37e00700 1 -- 172.21.15.120:0/1301583248 learned_addr learned my addr 172.21.15.120:0/1301583248 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c37400700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d62ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.206+0000 7f8c36a00700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d62ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c37e00700 1 -- 172.21.15.120:0/1301583248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 msgr2=0x559197d62ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c37e00700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d62ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c37e00700 1 -- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 msgr2=0x559197d62ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c37e00700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d62ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c37e00700 1 -- 172.21.15.120:0/1301583248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559197d86440 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c36a00700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d62ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c37e00700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d63550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8c30019730 tx=0x7f8c300060d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e2edabfd3979e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c21600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c21600700 1 -- 172.21.15.120:0/1301583248 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30028020 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c21600700 1 -- 172.21.15.120:0/1301583248 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8c30024890 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.207+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c280920b0 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c21600700 1 -- 172.21.15.120:0/1301583248 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c30033050 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 10 client.15270 fetch_fsmap learned FSMap version 29 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559197de8d20 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c21600700 1 -- 172.21.15.120:0/1301583248 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c280920b0 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c21600700 1 -- 172.21.15.120:0/1301583248 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c30023600 con 0x559197d69ba0 2024-05-14T09:23:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 10 client.15270 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T09:23:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 10 client.15270 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T09:23:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 20 client.15270 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197deb240 0x559197dec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 4 client.15270 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:23:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.208+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "status"}) -- 0x559197c933b0 con 0x559197deb240 2024-05-14T09:23:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.209+0000 7f8c37400700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197deb240 0x559197dec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.210+0000 7f8c37400700 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197deb240 0x559197dec6b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7359c9774a0e219c server_cookie=14821400fdd6a1fa in_seq=0 out_seq=0 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.210+0000 7f8c21600700 10 client.15270 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c21600700 1 -- 172.21.15.120:0/1301583248 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559197c933b0 con 0x559197deb240 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c21600700 10 client.15270 handle_command_reply: tid=0 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 client.15270 shutdown 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 msgr2=0x559197d63550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d63550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8c30019730 tx=0x7f8c300060d0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 shutdown_connections 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559197deb240 0x559197dec6b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559197be5df0 0x559197d62ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559197d69ba0 0x559197d63550 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 --2- 172.21.15.120:0/1301583248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559197d63c00 0x559197d62ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c21600700 0 client.15270 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 >> 172.21.15.120:0/1301583248 conn(0x559197c24a30 msgr2=0x559197d6d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 shutdown_connections 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.211+0000 7f8c4d05fb80 1 -- 172.21.15.120:0/1301583248 wait complete. 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c4d05fb80 20 client.15270 trim_cache size 0 max 16384 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "15b5acb4-11d1-11ef-bc98-c7b262605968", 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 34427, 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 301.432844182, 2024-05-14T09:23:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 29, 2024-05-14T09:23:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 90, 2024-05-14T09:23:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 88, 2024-05-14T09:23:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 340.14005548900002 2024-05-14T09:23:07.214 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:23:07.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8c1c0b2880 msgr2=0x7f8c1c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8c1c0b2880 0x7f8c1c0b4d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c30012aa0 tx=0x7f8c30012670 comp rx=0 tx=0).stop 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3810a990 msgr2=0x7f8c381a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3810a990 0x7f8c381a13c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800b5c0 tx=0x7f8c280047b0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 shutdown_connections 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8c1c0b2880 0x7f8c1c0b4d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c38110970 0x7f8c381a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3810a990 0x7f8c381a13c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 --2- 172.21.15.120:0/2102371447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c3810b2e0 0x7f8c381a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.212+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 >> 172.21.15.120:0/2102371447 conn(0x7f8c38077c80 msgr2=0x7f8c3807bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.213+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 shutdown_connections 2024-05-14T09:23:07.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:07.213+0000 7f8c3e600700 1 -- 172.21.15.120:0/2102371447 wait complete. 2024-05-14T09:23:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:07 smithi120 ceph-mon[31085]: pgmap v543: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:07 smithi152 ceph-mon[34868]: pgmap v543: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:07 smithi175 ceph-mon[35353]: pgmap v543: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:08.153 INFO:teuthology.run_tasks:Running task sequential... 2024-05-14T09:23:08.167 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-14T09:23:08.167 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-14T09:23:08.168 INFO:teuthology.task.print:Enabling mgr modules 2024-05-14T09:23:08.168 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-14T09:23:08.190 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-14T09:23:08.190 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-14T09:23:08.190 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-05-14T09:23:08.191 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T09:23:08.191 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-05-14T09:23:08.191 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-05-14T09:23:08.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:08.191 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-05-14T09:23:08.241 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-14T09:23:08.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:08.242 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:23:08.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:08.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-05-14T09:23:08.440 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-14T09:23:08.440 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-14T09:23:08.868 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:09 smithi120 ceph-mon[31085]: pgmap v544: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:09 smithi152 ceph-mon[34868]: pgmap v544: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:09.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:09 smithi175 ceph-mon[35353]: pgmap v544: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 -- 172.21.15.120:0/3697121116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b3010e910 msgr2=0x7f8b30110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 --2- 172.21.15.120:0/3697121116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b3010e910 0x7f8b30110df0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009990 tx=0x7f8b28009ca0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 -- 172.21.15.120:0/3697121116 shutdown_connections 2024-05-14T09:23:11.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 --2- 172.21.15.120:0/3697121116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b301054e0 0x7f8b301058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 --2- 172.21.15.120:0/3697121116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b3010e910 0x7f8b30110df0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 --2- 172.21.15.120:0/3697121116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b30105e30 0x7f8b3010e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 -- 172.21.15.120:0/3697121116 >> 172.21.15.120:0/3697121116 conn(0x7f8b300fef30 msgr2=0x7f8b30101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:11.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.215+0000 7f8b37000700 1 -- 172.21.15.120:0/3697121116 shutdown_connections 2024-05-14T09:23:11.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.216+0000 7f8b37000700 1 -- 172.21.15.120:0/3697121116 wait complete. 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 Processor -- start 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 -- start start 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b301054e0 0x7f8b301031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b30105e30 0x7f8b30103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3010e910 0x7f8b30103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30114320 con 0x7f8b301054e0 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301141a0 con 0x7f8b30105e30 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.217+0000 7f8b37000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301144a0 con 0x7f8b3010e910 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b301054e0 0x7f8b301031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b301054e0 0x7f8b301031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35736/0 (socket says 172.21.15.120:35736) 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 -- 172.21.15.120:0/1583945867 learned_addr learned my addr 172.21.15.120:0/1583945867 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b27400700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b30105e30 0x7f8b30103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b35000700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3010e910 0x7f8b30103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 -- 172.21.15.120:0/1583945867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3010e910 msgr2=0x7f8b30103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3010e910 0x7f8b30103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 -- 172.21.15.120:0/1583945867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b30105e30 msgr2=0x7f8b30103710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b30105e30 0x7f8b30103710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b2fe00700 1 -- 172.21.15.120:0/1583945867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b301a9030 con 0x7f8b301054e0 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.218+0000 7f8b27400700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b30105e30 0x7f8b30103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:11.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.219+0000 7f8b2fe00700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b301054e0 0x7f8b301031d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8b200060b0 tx=0x7f8b20007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.219+0000 7f8b2d600700 1 -- 172.21.15.120:0/1583945867 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2001a070 con 0x7f8b301054e0 2024-05-14T09:23:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.219+0000 7f8b2d600700 1 -- 172.21.15.120:0/1583945867 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b2000de20 con 0x7f8b301054e0 2024-05-14T09:23:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.219+0000 7f8b2d600700 1 -- 172.21.15.120:0/1583945867 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20014690 con 0x7f8b301054e0 2024-05-14T09:23:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.219+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b301a9320 con 0x7f8b301054e0 2024-05-14T09:23:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.219+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b301a9810 con 0x7f8b301054e0 2024-05-14T09:23:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.220+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b300512c0 con 0x7f8b301054e0 2024-05-14T09:23:11.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.223+0000 7f8b2d600700 1 -- 172.21.15.120:0/1583945867 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8b2001d070 con 0x7f8b301054e0 2024-05-14T09:23:11.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.225+0000 7f8b2d600700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8b140b2900 0x7f8b140b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:11.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.226+0000 7f8b2d600700 1 -- 172.21.15.120:0/1583945867 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8b200e2330 con 0x7f8b301054e0 2024-05-14T09:23:11.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.226+0000 7f8b27400700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8b140b2900 0x7f8b140b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.227+0000 7f8b27400700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8b140b2900 0x7f8b140b4e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b18005e10 tx=0x7f8b18005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:11.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.229+0000 7f8b2d600700 1 -- 172.21.15.120:0/1583945867 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8b20010070 con 0x7f8b301054e0 2024-05-14T09:23:11.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.508+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8b3002e5f0 con 0x7f8b301054e0 2024-05-14T09:23:11.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.509+0000 7f8b2d600700 1 -- 172.21.15.120:0/1583945867 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f8b200a9c50 con 0x7f8b301054e0 2024-05-14T09:23:11.509 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8b140b2900 msgr2=0x7f8b140b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8b140b2900 0x7f8b140b4e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b18005e10 tx=0x7f8b18005d60 comp rx=0 tx=0).stop 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b301054e0 msgr2=0x7f8b301031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b301054e0 0x7f8b301031d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8b200060b0 tx=0x7f8b20007f90 comp rx=0 tx=0).stop 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 shutdown_connections 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8b140b2900 0x7f8b140b4e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3010e910 0x7f8b30103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b301054e0 0x7f8b301031d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 --2- 172.21.15.120:0/1583945867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b30105e30 0x7f8b30103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:11.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 >> 172.21.15.120:0/1583945867 conn(0x7f8b300fef30 msgr2=0x7f8b300ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:11.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 shutdown_connections 2024-05-14T09:23:11.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:11.512+0000 7f8b37000700 1 -- 172.21.15.120:0/1583945867 wait complete. 2024-05-14T09:23:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:11 smithi120 ceph-mon[31085]: pgmap v545: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:23:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:11 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1583945867' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T09:23:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:11 smithi152 ceph-mon[34868]: pgmap v545: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:23:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:11 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1583945867' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T09:23:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:11 smithi175 ceph-mon[35353]: pgmap v545: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T09:23:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:11 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1583945867' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T09:23:12.405 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T09:23:12.406 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-05-14T09:23:12.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:12.406 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-05-14T09:23:12.460 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:23:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-05-14T09:23:12.461 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T09:23:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-05-14T09:23:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T09:23:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 41526sec preferred_lft 41526sec 2024-05-14T09:23:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-05-14T09:23:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:23:12.462 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T09:23:12.462 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:23:12.462 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:23:12.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-05-14T09:23:12.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-05-14T09:23:12.463 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-05-14T09:23:12.463 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T09:23:12.463 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:23:12.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:23:12.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:23:12.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:12.713 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T09:23:12.778 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-05-14T09:23:12.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:12.781 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-05-14T09:23:12.827 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-05-14T09:23:12.827 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T09:23:12.827 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T09:23:12.827 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T09:23:12.827 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T09:23:12.828 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:23:12.828 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:23:12.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T09:23:12.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T09:23:12.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T09:23:12.828 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:23:12.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:23:13.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:23:13.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:13.034 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-05-14T09:23:13.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:13.084 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-05-14T09:23:13.132 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:23:13.133 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:23:13.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--tmp-cephfs 2024-05-14T09:23:13.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-05-14T09:23:13.133 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:23:13.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:23:13.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:23:13.311 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-05-14T09:23:13.311 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:23:13.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:23:13.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:23:13.570 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:23:13.570 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-05-14T09:23:13.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-05-14T09:23:13.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T09:23:13.570 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-05-14T09:23:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:23:13.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:23:13.775 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-05-14T09:23:13.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:23:13.775 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /tmp/cephfs 2024-05-14T09:23:13.819 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/tmp/cephfs' 2024-05-14T09:23:13.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:23:13.819 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /tmp/cephfs 2024-05-14T09:23:13.883 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:13 smithi120 ceph-mon[31085]: pgmap v546: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:13.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-05-14T09:23:13.957 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:13 smithi152 ceph-mon[34868]: pgmap v546: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:13.976 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:13 smithi175 ceph-mon[35353]: pgmap v546: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T09:23:14.014 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-05-14T09:23:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:23:14.064 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/95821b8f087c29f15bcddbe75cf573d1567ec30783cafc93ff7b8ef07034a33f/merged 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/24af7e0023a416eadaec87e907f606f46d6a4e07fa8895b37a9a495e471b4625/merged 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b2c5c4124798129e1b2ac12f0627fde7145959ba5ba910edb302acb9daf1b919/merged 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e88bdde8ae9d123541bcdc6aef4f54ad5949284308fbb740a13b4b29ff7f8145/merged 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/06075a78475efd3f13f9430d18d2f4010b8152de1d2f98e4d8d7c21186a890fb/merged 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/a52ee462ee026e4bfcd8e9ccd42a2c344cad40db964e3e504756827eb3006372/merged 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/5abb428e6cd506421d57fb2bb1186e2e35c4bc6c867004fe179076cd70ba8a97/merged 2024-05-14T09:23:14.065 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e2dd0be5dbefb7c322f191f4f3fd976988048cf4458e8a9b058ff8ca4bb6d960/merged 2024-05-14T09:23:14.066 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/9536011080a88def88751493bf6e7f420fc5c41b3e1e978a8cc96d28dac1d8cd/merged 2024-05-14T09:23:14.066 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b70a621bfd2a14d71f4f9a1f974dae3ca943b8c7e3f4cdb34f00e0d2ba7f5442/merged 2024-05-14T09:23:14.066 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-05-14T09:23:14.066 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T09:23:14.066 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T09:23:14.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:14.067 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-05-14T09:23:14.114 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T09:23:14.114 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2024-05-14T09:23:14.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-05-14T09:23:14.230 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-05-14T09:23:14.275 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:23:14.276 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/95821b8f087c29f15bcddbe75cf573d1567ec30783cafc93ff7b8ef07034a33f/merged 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/24af7e0023a416eadaec87e907f606f46d6a4e07fa8895b37a9a495e471b4625/merged 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b2c5c4124798129e1b2ac12f0627fde7145959ba5ba910edb302acb9daf1b919/merged 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e88bdde8ae9d123541bcdc6aef4f54ad5949284308fbb740a13b4b29ff7f8145/merged 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/06075a78475efd3f13f9430d18d2f4010b8152de1d2f98e4d8d7c21186a890fb/merged 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/a52ee462ee026e4bfcd8e9ccd42a2c344cad40db964e3e504756827eb3006372/merged 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/5abb428e6cd506421d57fb2bb1186e2e35c4bc6c867004fe179076cd70ba8a97/merged 2024-05-14T09:23:14.277 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e2dd0be5dbefb7c322f191f4f3fd976988048cf4458e8a9b058ff8ca4bb6d960/merged 2024-05-14T09:23:14.278 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/9536011080a88def88751493bf6e7f420fc5c41b3e1e978a8cc96d28dac1d8cd/merged 2024-05-14T09:23:14.278 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b70a621bfd2a14d71f4f9a1f974dae3ca943b8c7e3f4cdb34f00e0d2ba7f5442/merged 2024-05-14T09:23:14.278 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-05-14T09:23:14.278 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T09:23:14.278 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T09:23:14.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:14.279 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-05-14T09:23:14.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:2024-05-14T09:23:14.418+0000 7f00b0322480 -1 init, newargv = 0x7f009c0047e0 newargc=17 2024-05-14T09:23:14.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[90306]: starting ceph client 2024-05-14T09:23:14.457 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[90306]: starting fuse 2024-05-14T09:23:14.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:23:14.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:23:14.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:23:15.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-05-14T09:23:15.546 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-05-14T09:23:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:23:15.608 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/95821b8f087c29f15bcddbe75cf573d1567ec30783cafc93ff7b8ef07034a33f/merged 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/24af7e0023a416eadaec87e907f606f46d6a4e07fa8895b37a9a495e471b4625/merged 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b2c5c4124798129e1b2ac12f0627fde7145959ba5ba910edb302acb9daf1b919/merged 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e88bdde8ae9d123541bcdc6aef4f54ad5949284308fbb740a13b4b29ff7f8145/merged 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/06075a78475efd3f13f9430d18d2f4010b8152de1d2f98e4d8d7c21186a890fb/merged 2024-05-14T09:23:15.609 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/a52ee462ee026e4bfcd8e9ccd42a2c344cad40db964e3e504756827eb3006372/merged 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/5abb428e6cd506421d57fb2bb1186e2e35c4bc6c867004fe179076cd70ba8a97/merged 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/e2dd0be5dbefb7c322f191f4f3fd976988048cf4458e8a9b058ff8ca4bb6d960/merged 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/9536011080a88def88751493bf6e7f420fc5c41b3e1e978a8cc96d28dac1d8cd/merged 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/b70a621bfd2a14d71f4f9a1f974dae3ca943b8c7e3f4cdb34f00e0d2ba7f5442/merged 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T09:23:15.610 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs 2024-05-14T09:23:15.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:15.611 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-05-14T09:23:15.664 INFO:teuthology.orchestra.run.smithi120.stdout:119 2024-05-14T09:23:15.664 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> import re 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/tmp/cephfs" 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2024-05-14T09:23:15.665 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> return f 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.0")) 2024-05-14T09:23:15.666 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-05-14T09:23:15.832 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.0.90306.asok 2024-05-14T09:23:15.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:23:15.847 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:15 smithi120 ceph-mon[31085]: pgmap v547: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:15.847 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:23:15.847 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:23:15.847 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:23:15.850 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.90306.asok 2024-05-14T09:23:15.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:15.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.90306.asok status 2024-05-14T09:23:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:15 smithi152 ceph-mon[34868]: pgmap v547: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:23:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:23:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:23:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:15 smithi175 ceph-mon[35353]: pgmap v547: 129 pgs: 129 active+clean; 651 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:23:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:23:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:23:16.147 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:23:16.147 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "0", 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/tmp/cephfs", 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "90306", 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e" 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 15282, 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2024-05-14T09:23:16.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 15282 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3973427358 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3973427358 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:23:16.149 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.15282 192.168.0.1:0/3973427358", 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/3973427358", 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 5, 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 29, 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 90, 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2024-05-14T09:23:16.150 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:23:16.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:16.169 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2024-05-14T09:23:16.169 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /tmp/cephfs 2024-05-14T09:23:16.223 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2024-05-14T09:23:16.223 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2024-05-14T09:23:16.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:23:16.223 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /tmp/cephfs 2024-05-14T09:23:16.308 INFO:teuthology.run_tasks:Running task exec... 2024-05-14T09:23:16.321 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T09:23:16.321 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:23:16.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-05-14T09:23:16.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 -- 172.21.15.120:0/119099583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 msgr2=0x7f1000106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:16.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 --2- 172.21.15.120:0/119099583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f1000106a20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009900 tx=0x7f0ff402a410 comp rx=0 tx=0).stop 2024-05-14T09:23:16.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 -- 172.21.15.120:0/119099583 shutdown_connections 2024-05-14T09:23:16.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 --2- 172.21.15.120:0/119099583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f100010bc60 0x7f100010e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:16.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 --2- 172.21.15.120:0/119099583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1000106f60 0x7f1000107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:16.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 --2- 172.21.15.120:0/119099583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f1000106a20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:16.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 -- 172.21.15.120:0/119099583 >> 172.21.15.120:0/119099583 conn(0x7f1000100f10 msgr2=0x7f10001033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:16.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 -- 172.21.15.120:0/119099583 shutdown_connections 2024-05-14T09:23:16.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.584+0000 7f1006a00640 1 -- 172.21.15.120:0/119099583 wait complete. 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.585+0000 7f1006a00640 1 Processor -- start 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1006a00640 1 -- start start 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1006a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f100019c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1006a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1000106f60 0x7f100019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1006a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100010bc60 0x7f10001a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1006a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1000111660 con 0x7f1000105d20 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1006a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f10001114e0 con 0x7f1000106f60 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1006a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f10001117e0 con 0x7f100010bc60 2024-05-14T09:23:16.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1005600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f100019c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1005600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f100019c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35754/0 (socket says 172.21.15.120:35754) 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.586+0000 7f1005600640 1 -- 172.21.15.120:0/2641310142 learned_addr learned my addr 172.21.15.120:0/2641310142 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1006000640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100010bc60 0x7f10001a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1004c00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1000106f60 0x7f100019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1005600640 1 -- 172.21.15.120:0/2641310142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100010bc60 msgr2=0x7f10001a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1005600640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100010bc60 0x7f10001a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1005600640 1 -- 172.21.15.120:0/2641310142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1000106f60 msgr2=0x7f100019c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1005600640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1000106f60 0x7f100019c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1005600640 1 -- 172.21.15.120:0/2641310142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10001a3e60 con 0x7f1000105d20 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1006000640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100010bc60 0x7f10001a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1005600640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f100019c320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4005760 tx=0x7f0ff4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f0ffe000640 1 -- 172.21.15.120:0/2641310142 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff403f030 con 0x7f1000105d20 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f0ffe000640 1 -- 172.21.15.120:0/2641310142 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ff4003a80 con 0x7f1000105d20 2024-05-14T09:23:16.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f0ffe000640 1 -- 172.21.15.120:0/2641310142 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4035070 con 0x7f1000105d20 2024-05-14T09:23:16.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10001a40f0 con 0x7f1000105d20 2024-05-14T09:23:16.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.587+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10001a4590 con 0x7f1000105d20 2024-05-14T09:23:16.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.589+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100010aa70 con 0x7f1000105d20 2024-05-14T09:23:16.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.593+0000 7f0ffe000640 1 -- 172.21.15.120:0/2641310142 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f0ff4042030 con 0x7f1000105d20 2024-05-14T09:23:16.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.594+0000 7f0ffe000640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0fe80b2860 0x7f0fe80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:16.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.594+0000 7f0ffe000640 1 -- 172.21.15.120:0/2641310142 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0ff4103190 con 0x7f1000105d20 2024-05-14T09:23:16.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.594+0000 7f1004c00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0fe80b2860 0x7f0fe80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:16.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.595+0000 7f1004c00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0fe80b2860 0x7f0fe80b4d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0005fd0 tx=0x7f0ff0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:16.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.597+0000 7f0ffe000640 1 -- 172.21.15.120:0/2641310142 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0ff40caab0 con 0x7f1000105d20 2024-05-14T09:23:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:16.850+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f100002dc30 con 0x7f1000105d20 2024-05-14T09:23:17.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.585+0000 7f0ffe000640 1 -- 172.21.15.120:0/2641310142 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v30) ==== 117+0+0 (secure 0 0 0) 0x7f0ff40ca3b0 con 0x7f1000105d20 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0fe80b2860 msgr2=0x7f0fe80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0fe80b2860 0x7f0fe80b4d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0005fd0 tx=0x7f0ff0005850 comp rx=0 tx=0).stop 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 msgr2=0x7f100019c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f100019c320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4005760 tx=0x7f0ff4004270 comp rx=0 tx=0).stop 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 shutdown_connections 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0fe80b2860 0x7f0fe80b4d70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100010bc60 0x7f10001a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1000106f60 0x7f100019c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 --2- 172.21.15.120:0/2641310142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1000105d20 0x7f100019c320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:17.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 >> 172.21.15.120:0/2641310142 conn(0x7f1000100f10 msgr2=0x7f1000107c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:17.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 shutdown_connections 2024-05-14T09:23:17.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:17.590+0000 7f1006a00640 1 -- 172.21.15.120:0/2641310142 wait complete. 2024-05-14T09:23:17.618 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-14T09:23:17.629 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-14T09:23:17.722 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:23:17.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:17 smithi120 ceph-mon[31085]: pgmap v548: 129 pgs: 129 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-14T09:23:17.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:17 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2641310142' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T09:23:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:17 smithi152 ceph-mon[34868]: pgmap v548: 129 pgs: 129 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-14T09:23:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:17 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2641310142' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T09:23:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:17 smithi175 ceph-mon[35353]: pgmap v548: 129 pgs: 129 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-14T09:23:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:17 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2641310142' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 -- 172.21.15.120:0/1966261767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 msgr2=0x7fe7fc1136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 --2- 172.21.15.120:0/1966261767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc1136c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009ca0 tx=0x7fe7f402a8c0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 -- 172.21.15.120:0/1966261767 shutdown_connections 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 --2- 172.21.15.120:0/1966261767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc1136c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 --2- 172.21.15.120:0/1966261767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc10cb90 0x7fe7fc10b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 --2- 172.21.15.120:0/1966261767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7fc10c690 0x7fe7fc10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 -- 172.21.15.120:0/1966261767 >> 172.21.15.120:0/1966261767 conn(0x7fe7fc071720 msgr2=0x7fe7fc073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 -- 172.21.15.120:0/1966261767 shutdown_connections 2024-05-14T09:23:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.001+0000 7fe803400640 1 -- 172.21.15.120:0/1966261767 wait complete. 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.002+0000 7fe803400640 1 Processor -- start 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe803400640 1 -- start start 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe803400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7fc10c690 0x7fe7fc0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe803400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc10cb90 0x7fe7fc071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe803400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe803400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc116d20 con 0x7fe7fc1112a0 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe803400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc116ba0 con 0x7fe7fc10c690 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe803400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc116ea0 con 0x7fe7fc10cb90 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe801400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe801400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc072190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35774/0 (socket says 172.21.15.120:35774) 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.003+0000 7fe801400640 1 -- 172.21.15.120:0/138724219 learned_addr learned my addr 172.21.15.120:0/138724219 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe7fbe00640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc10cb90 0x7fe7fc071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe800a00640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7fc10c690 0x7fe7fc0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe801400640 1 -- 172.21.15.120:0/138724219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc10cb90 msgr2=0x7fe7fc071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe801400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc10cb90 0x7fe7fc071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe801400640 1 -- 172.21.15.120:0/138724219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7fc10c690 msgr2=0x7fe7fc0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe801400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7fc10c690 0x7fe7fc0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe801400640 1 -- 172.21.15.120:0/138724219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc0728c0 con 0x7fe7fc1112a0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe801400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc072190 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40098d0 tx=0x7fe7f4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.004+0000 7fe7f9600640 1 -- 172.21.15.120:0/138724219 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4003d90 con 0x7fe7fc1112a0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.005+0000 7fe7f9600640 1 -- 172.21.15.120:0/138724219 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7f40044d0 con 0x7fe7fc1112a0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.005+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc1acad0 con 0x7fe7fc1112a0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.005+0000 7fe7f9600640 1 -- 172.21.15.120:0/138724219 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4030d10 con 0x7fe7fc1112a0 2024-05-14T09:23:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.005+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7fc1acf30 con 0x7fe7fc1112a0 2024-05-14T09:23:18.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.006+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7fc069e70 con 0x7fe7fc1112a0 2024-05-14T09:23:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.008+0000 7fe7f9600640 1 -- 172.21.15.120:0/138724219 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe7f4004040 con 0x7fe7fc1112a0 2024-05-14T09:23:18.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.011+0000 7fe7f9600640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe7e00b27f0 0x7fe7e00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.011+0000 7fe7f9600640 1 -- 172.21.15.120:0/138724219 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe7f4103d80 con 0x7fe7fc1112a0 2024-05-14T09:23:18.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.011+0000 7fe800a00640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe7e00b27f0 0x7fe7e00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.012+0000 7fe800a00640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe7e00b27f0 0x7fe7e00b4d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec005d00 tx=0x7fe7ec005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:18.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.014+0000 7fe7f9600640 1 -- 172.21.15.120:0/138724219 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe7f40cb6a0 con 0x7fe7fc1112a0 2024-05-14T09:23:18.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.222+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7fc1ad280 con 0x7fe7fc1112a0 2024-05-14T09:23:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.226+0000 7fe7f9600640 1 -- 172.21.15.120:0/138724219 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7fe7fc1ad280 con 0x7fe7fc1112a0 2024-05-14T09:23:18.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:18.227 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:23:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe7e00b27f0 msgr2=0x7fe7e00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe7e00b27f0 0x7fe7e00b4d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec005d00 tx=0x7fe7ec005c50 comp rx=0 tx=0).stop 2024-05-14T09:23:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 msgr2=0x7fe7fc072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc072190 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40098d0 tx=0x7fe7f4003ba0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 shutdown_connections 2024-05-14T09:23:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe7e00b27f0 0x7fe7e00b4d00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7fc1112a0 0x7fe7fc072190 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc10cb90 0x7fe7fc071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 --2- 172.21.15.120:0/138724219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7fc10c690 0x7fe7fc0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.229+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 >> 172.21.15.120:0/138724219 conn(0x7fe7fc071720 msgr2=0x7fe7fc112720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.230+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 shutdown_connections 2024-05-14T09:23:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.230+0000 7fe803400640 1 -- 172.21.15.120:0/138724219 wait complete. 2024-05-14T09:23:18.257 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T09:11:00.255347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T09:17:56.520013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T09:18:00.789799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-14T09:18:13.868113+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-14T09:23:18.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T09:23:18.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 -- 172.21.15.120:0/1722115993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076aa0 msgr2=0x7f4da810b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 --2- 172.21.15.120:0/1722115993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076aa0 0x7f4da810b6f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009900 tx=0x7f4d9402a3f0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 -- 172.21.15.120:0/1722115993 shutdown_connections 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 --2- 172.21.15.120:0/1722115993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4da810bc30 0x7f4da810e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 --2- 172.21.15.120:0/1722115993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076aa0 0x7f4da810b6f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 --2- 172.21.15.120:0/1722115993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8076150 0x7f4da8076560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 -- 172.21.15.120:0/1722115993 >> 172.21.15.120:0/1722115993 conn(0x7f4da80fee70 msgr2=0x7f4da81012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 -- 172.21.15.120:0/1722115993 shutdown_connections 2024-05-14T09:23:18.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.535+0000 7f4dafe00640 1 -- 172.21.15.120:0/1722115993 wait complete. 2024-05-14T09:23:18.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.536+0000 7f4dafe00640 1 Processor -- start 2024-05-14T09:23:18.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.536+0000 7f4dafe00640 1 -- start start 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076150 0x7f4da819c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4da8076aa0 0x7f4da819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da810bc30 0x7f4da81a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dafe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4da8111850 con 0x7f4da8076150 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dafe00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4da81116d0 con 0x7f4da8076aa0 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dafe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4da81119d0 con 0x7f4da810bc30 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076150 0x7f4da819c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076150 0x7f4da819c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38722/0 (socket says 172.21.15.120:38722) 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 -- 172.21.15.120:0/2607802474 learned_addr learned my addr 172.21.15.120:0/2607802474 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4daca00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4da8076aa0 0x7f4da819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dade00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da810bc30 0x7f4da81a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 -- 172.21.15.120:0/2607802474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da810bc30 msgr2=0x7f4da81a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da810bc30 0x7f4da81a3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 -- 172.21.15.120:0/2607802474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4da8076aa0 msgr2=0x7f4da819ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4da8076aa0 0x7f4da819ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.537+0000 7f4dad400640 1 -- 172.21.15.120:0/2607802474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da81a4080 con 0x7f4da8076150 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.538+0000 7f4dad400640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076150 0x7f4da819c540 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d740 tx=0x7f4d9c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.538+0000 7f4da6000640 1 -- 172.21.15.120:0/2607802474 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c017070 con 0x7f4da8076150 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.538+0000 7f4da6000640 1 -- 172.21.15.120:0/2607802474 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d9c00de50 con 0x7f4da8076150 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.538+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da81a4370 con 0x7f4da8076150 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.538+0000 7f4da6000640 1 -- 172.21.15.120:0/2607802474 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c004c60 con 0x7f4da8076150 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.538+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da81a48c0 con 0x7f4da8076150 2024-05-14T09:23:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.539+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da810adf0 con 0x7f4da8076150 2024-05-14T09:23:18.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.542+0000 7f4da6000640 1 -- 172.21.15.120:0/2607802474 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4d9c004e00 con 0x7f4da8076150 2024-05-14T09:23:18.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.544+0000 7f4da6000640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4d900b2870 0x7f4d900b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:18.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.545+0000 7f4da6000640 1 -- 172.21.15.120:0/2607802474 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4d9c0e23a0 con 0x7f4da8076150 2024-05-14T09:23:18.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.545+0000 7f4daca00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4d900b2870 0x7f4d900b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:18.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.545+0000 7f4daca00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4d900b2870 0x7f4d900b4d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4da819d5e0 tx=0x7f4d94000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:18.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.547+0000 7f4da6000640 1 -- 172.21.15.120:0/2607802474 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4d9c0a9d80 con 0x7f4da8076150 2024-05-14T09:23:18.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.755+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4da80638d0 con 0x7f4da8076150 2024-05-14T09:23:18.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.756+0000 7f4da6000640 1 -- 172.21.15.120:0/2607802474 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f4d9c0a9680 con 0x7f4da8076150 2024-05-14T09:23:18.755 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-05-14T09:23:18.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4d900b2870 msgr2=0x7f4d900b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4d900b2870 0x7f4d900b4d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4da819d5e0 tx=0x7f4d94000bc0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076150 msgr2=0x7f4da819c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:18.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076150 0x7f4da819c540 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d740 tx=0x7f4d9c00dc00 comp rx=0 tx=0).stop 2024-05-14T09:23:18.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 shutdown_connections 2024-05-14T09:23:18.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4d900b2870 0x7f4d900b4d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da810bc30 0x7f4da81a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4da8076aa0 0x7f4da819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 --2- 172.21.15.120:0/2607802474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4da8076150 0x7f4da819c540 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.758+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 >> 172.21.15.120:0/2607802474 conn(0x7f4da80fee70 msgr2=0x7f4da80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.759+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 shutdown_connections 2024-05-14T09:23:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:18.759+0000 7f4dafe00640 1 -- 172.21.15.120:0/2607802474 wait complete. 2024-05-14T09:23:18.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T09:23:18.849 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:18 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2641310142' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T09:23:18.849 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:18 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:18.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:18 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/138724219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:23:18.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:18 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2641310142' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T09:23:18.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:18 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:18.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:18 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/138724219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:23:18.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:18 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2641310142' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T09:23:18.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:18 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:18.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:18 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/138724219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:23:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.056+0000 7f6883200640 1 -- 172.21.15.120:0/3004395902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c0799d0 msgr2=0x7f687c079de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.056+0000 7f6883200640 1 --2- 172.21.15.120:0/3004395902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c0799d0 0x7f687c079de0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6878009ca0 tx=0x7f687802a8c0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.057+0000 7f6883200640 1 -- 172.21.15.120:0/3004395902 shutdown_connections 2024-05-14T09:23:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.057+0000 7f6883200640 1 --2- 172.21.15.120:0/3004395902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c0799d0 0x7f687c079de0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.057+0000 7f6883200640 1 --2- 172.21.15.120:0/3004395902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f687c078cd0 0x7f687c0790e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.057+0000 7f6883200640 1 --2- 172.21.15.120:0/3004395902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c077a40 0x7f687c078790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.057+0000 7f6883200640 1 -- 172.21.15.120:0/3004395902 >> 172.21.15.120:0/3004395902 conn(0x7f687c100e50 msgr2=0x7f687c103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.057+0000 7f6883200640 1 -- 172.21.15.120:0/3004395902 shutdown_connections 2024-05-14T09:23:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.057+0000 7f6883200640 1 -- 172.21.15.120:0/3004395902 wait complete. 2024-05-14T09:23:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 Processor -- start 2024-05-14T09:23:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 -- start start 2024-05-14T09:23:19.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f687c077a40 0x7f687c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c078cd0 0x7f687c1a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0799d0 0x7f687c1a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f687c115a70 con 0x7f687c078cd0 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f687c1158f0 con 0x7f687c077a40 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.058+0000 7f6883200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f687c115bf0 con 0x7f687c0799d0 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c078cd0 0x7f687c1a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c078cd0 0x7f687c1a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38752/0 (socket says 172.21.15.120:38752) 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 -- 172.21.15.120:0/3242112294 learned_addr learned my addr 172.21.15.120:0/3242112294 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881e00640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f687c077a40 0x7f687c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6882800640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0799d0 0x7f687c1a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 -- 172.21.15.120:0/3242112294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0799d0 msgr2=0x7f687c1a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0799d0 0x7f687c1a7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 -- 172.21.15.120:0/3242112294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f687c077a40 msgr2=0x7f687c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f687c077a40 0x7f687c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.059+0000 7f6881400640 1 -- 172.21.15.120:0/3242112294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687c1a8150 con 0x7f687c078cd0 2024-05-14T09:23:19.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.060+0000 7f6881400640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c078cd0 0x7f687c1a0b50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d950 tx=0x7f686c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:19.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.060+0000 7f6876a00640 1 -- 172.21.15.120:0/3242112294 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c017070 con 0x7f687c078cd0 2024-05-14T09:23:19.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.060+0000 7f6876a00640 1 -- 172.21.15.120:0/3242112294 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f686c009c30 con 0x7f687c078cd0 2024-05-14T09:23:19.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.060+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687c1a8440 con 0x7f687c078cd0 2024-05-14T09:23:19.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.060+0000 7f6876a00640 1 -- 172.21.15.120:0/3242112294 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c00f620 con 0x7f687c078cd0 2024-05-14T09:23:19.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.060+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687c1a8990 con 0x7f687c078cd0 2024-05-14T09:23:19.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.061+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f687c112460 con 0x7f687c078cd0 2024-05-14T09:23:19.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.064+0000 7f6876a00640 1 -- 172.21.15.120:0/3242112294 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f686c010460 con 0x7f687c078cd0 2024-05-14T09:23:19.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.066+0000 7f6876a00640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68640b27e0 0x7f68640b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.066+0000 7f6876a00640 1 -- 172.21.15.120:0/3242112294 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f686c0e22f0 con 0x7f687c078cd0 2024-05-14T09:23:19.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.066+0000 7f6881e00640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68640b27e0 0x7f68640b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.067+0000 7f6881e00640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68640b27e0 0x7f68640b4cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6870005fd0 tx=0x7f6870005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.070+0000 7f6876a00640 1 -- 172.21.15.120:0/3242112294 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f686c0a9c10 con 0x7f687c078cd0 2024-05-14T09:23:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.275+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f687c0638d0 con 0x7f687c078cd0 2024-05-14T09:23:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.276+0000 7f6876a00640 1 -- 172.21.15.120:0/3242112294 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f686c009de0 con 0x7f687c078cd0 2024-05-14T09:23:19.276 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-05-14T09:23:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68640b27e0 msgr2=0x7f68640b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68640b27e0 0x7f68640b4cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6870005fd0 tx=0x7f6870005850 comp rx=0 tx=0).stop 2024-05-14T09:23:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c078cd0 msgr2=0x7f687c1a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c078cd0 0x7f687c1a0b50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d950 tx=0x7f686c00de10 comp rx=0 tx=0).stop 2024-05-14T09:23:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 shutdown_connections 2024-05-14T09:23:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68640b27e0 0x7f68640b4cf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0799d0 0x7f687c1a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f687c078cd0 0x7f687c1a0b50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 --2- 172.21.15.120:0/3242112294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f687c077a40 0x7f687c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 >> 172.21.15.120:0/3242112294 conn(0x7f687c100e50 msgr2=0x7f687c102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:19.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 shutdown_connections 2024-05-14T09:23:19.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.279+0000 7f6883200640 1 -- 172.21.15.120:0/3242112294 wait complete. 2024-05-14T09:23:19.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T09:23:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 -- 172.21.15.120:0/3837067741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 msgr2=0x7fd07406cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 --2- 172.21.15.120:0/3837067741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd07406cda0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd064009900 tx=0x7fd06402a410 comp rx=0 tx=0).stop 2024-05-14T09:23:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 -- 172.21.15.120:0/3837067741 shutdown_connections 2024-05-14T09:23:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 --2- 172.21.15.120:0/3837067741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0741143d0 0x7fd0741167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 --2- 172.21.15.120:0/3837067741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd07406d2e0 0x7fd074113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 --2- 172.21.15.120:0/3837067741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd07406cda0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 -- 172.21.15.120:0/3837067741 >> 172.21.15.120:0/3837067741 conn(0x7fd074072830 msgr2=0x7fd074109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.581+0000 7fd07c400640 1 -- 172.21.15.120:0/3837067741 shutdown_connections 2024-05-14T09:23:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.582+0000 7fd07c400640 1 -- 172.21.15.120:0/3837067741 wait complete. 2024-05-14T09:23:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 Processor -- start 2024-05-14T09:23:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 -- start start 2024-05-14T09:23:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd0741a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd07406d2e0 0x7fd0741a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0741143d0 0x7fd0741ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd07411a050 con 0x7fd07406c990 2024-05-14T09:23:19.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd074119ed0 con 0x7fd07406d2e0 2024-05-14T09:23:19.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.583+0000 7fd07c400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd07411a1d0 con 0x7fd0741143d0 2024-05-14T09:23:19.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd0741a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd0741a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38774/0 (socket says 172.21.15.120:38774) 2024-05-14T09:23:19.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 -- 172.21.15.120:0/2504868064 learned_addr learned my addr 172.21.15.120:0/2504868064 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:19.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd07a400640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0741143d0 0x7fd0741ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079000640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd07406d2e0 0x7fd0741a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 -- 172.21.15.120:0/2504868064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0741143d0 msgr2=0x7fd0741ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0741143d0 0x7fd0741ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 -- 172.21.15.120:0/2504868064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd07406d2e0 msgr2=0x7fd0741a52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd07406d2e0 0x7fd0741a52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.584+0000 7fd079a00640 1 -- 172.21.15.120:0/2504868064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0741ac8e0 con 0x7fd07406c990 2024-05-14T09:23:19.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.585+0000 7fd079a00640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd0741a4da0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd064031460 tx=0x7fd064003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:19.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.585+0000 7fd072000640 1 -- 172.21.15.120:0/2504868064 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06403f070 con 0x7fd07406c990 2024-05-14T09:23:19.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.585+0000 7fd072000640 1 -- 172.21.15.120:0/2504868064 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd064031da0 con 0x7fd07406c990 2024-05-14T09:23:19.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.585+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0741acb70 con 0x7fd07406c990 2024-05-14T09:23:19.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.585+0000 7fd072000640 1 -- 172.21.15.120:0/2504868064 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064035030 con 0x7fd07406c990 2024-05-14T09:23:19.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.585+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0741ad0b0 con 0x7fd07406c990 2024-05-14T09:23:19.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.586+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd074112ca0 con 0x7fd07406c990 2024-05-14T09:23:19.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.588+0000 7fd072000640 1 -- 172.21.15.120:0/2504868064 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd064042070 con 0x7fd07406c990 2024-05-14T09:23:19.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.591+0000 7fd072000640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd0580b2870 0x7fd0580b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:19.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.591+0000 7fd072000640 1 -- 172.21.15.120:0/2504868064 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd064102e60 con 0x7fd07406c990 2024-05-14T09:23:19.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.591+0000 7fd079000640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd0580b2870 0x7fd0580b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:19.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.592+0000 7fd079000640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd0580b2870 0x7fd0580b4d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd060005fd0 tx=0x7fd060005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.596+0000 7fd072000640 1 -- 172.21.15.120:0/2504868064 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd0640ca780 con 0x7fd07406c990 2024-05-14T09:23:19.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.790+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd074063900 con 0x7fd07406c990 2024-05-14T09:23:19.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.792+0000 7fd072000640 1 -- 172.21.15.120:0/2504868064 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fd0640ca080 con 0x7fd07406c990 2024-05-14T09:23:19.791 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd0580b2870 msgr2=0x7fd0580b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd0580b2870 0x7fd0580b4d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd060005fd0 tx=0x7fd060005850 comp rx=0 tx=0).stop 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 msgr2=0x7fd0741a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd0741a4da0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd064031460 tx=0x7fd064003c80 comp rx=0 tx=0).stop 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 shutdown_connections 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd0580b2870 0x7fd0580b4d80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0741143d0 0x7fd0741ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd07406d2e0 0x7fd0741a52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 --2- 172.21.15.120:0/2504868064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd07406c990 0x7fd0741a4da0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:19.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 >> 172.21.15.120:0/2504868064 conn(0x7fd074072830 msgr2=0x7fd07410fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:19.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.794+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 shutdown_connections 2024-05-14T09:23:19.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:19.795+0000 7fd07c400640 1 -- 172.21.15.120:0/2504868064 wait complete. 2024-05-14T09:23:19.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-14T09:23:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:19 smithi120 ceph-mon[31085]: pgmap v549: 129 pgs: 129 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:19 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2607802474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:23:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:19 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3242112294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T09:23:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:19 smithi152 ceph-mon[34868]: pgmap v549: 129 pgs: 129 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:19 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2607802474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:23:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:19 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3242112294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T09:23:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:19 smithi175 ceph-mon[35353]: pgmap v549: 129 pgs: 129 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:19 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2607802474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:23:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:19 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3242112294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T09:23:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.090+0000 7f63e7e00640 1 -- 172.21.15.120:0/1843511680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 msgr2=0x7f63e810bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.090+0000 7f63e7e00640 1 --2- 172.21.15.120:0/1843511680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e810bda0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009ca0 tx=0x7f63e002a8c0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.090+0000 7f63e7e00640 1 -- 172.21.15.120:0/1843511680 shutdown_connections 2024-05-14T09:23:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.090+0000 7f63e7e00640 1 --2- 172.21.15.120:0/1843511680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e810bda0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.090+0000 7f63e7e00640 1 --2- 172.21.15.120:0/1843511680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e8104c80 0x7f63e8105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.090+0000 7f63e7e00640 1 --2- 172.21.15.120:0/1843511680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e8103a40 0x7f63e8104740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.090+0000 7f63e7e00640 1 -- 172.21.15.120:0/1843511680 >> 172.21.15.120:0/1843511680 conn(0x7f63e80fec50 msgr2=0x7f63e81010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.091+0000 7f63e7e00640 1 -- 172.21.15.120:0/1843511680 shutdown_connections 2024-05-14T09:23:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.091+0000 7f63e7e00640 1 -- 172.21.15.120:0/1843511680 wait complete. 2024-05-14T09:23:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 Processor -- start 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 -- start start 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e8103a40 0x7f63e819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e8104c80 0x7f63e819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e81a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f63e810f450 con 0x7f63e8109980 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63e810f2d0 con 0x7f63e8103a40 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63e810f5d0 con 0x7f63e8104c80 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e81a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e81a3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38798/0 (socket says 172.21.15.120:38798) 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.092+0000 7f63e7400640 1 -- 172.21.15.120:0/3013080760 learned_addr learned my addr 172.21.15.120:0/3013080760 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e6000640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e8104c80 0x7f63e819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e6a00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e8103a40 0x7f63e819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e7400640 1 -- 172.21.15.120:0/3013080760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e8104c80 msgr2=0x7f63e819c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e7400640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e8104c80 0x7f63e819c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e7400640 1 -- 172.21.15.120:0/3013080760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e8103a40 msgr2=0x7f63e819c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e7400640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e8103a40 0x7f63e819c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e7400640 1 -- 172.21.15.120:0/3013080760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e81a3dc0 con 0x7f63e8109980 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e6a00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e8103a40 0x7f63e819c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63e7400640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e81a3750 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098d0 tx=0x7f63e0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63eca00640 1 -- 172.21.15.120:0/3013080760 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0003d90 con 0x7f63e8109980 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63eca00640 1 -- 172.21.15.120:0/3013080760 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63e00044d0 con 0x7f63e8109980 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.093+0000 7f63eca00640 1 -- 172.21.15.120:0/3013080760 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0030d40 con 0x7f63e8109980 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.094+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e81a4050 con 0x7f63e8109980 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.094+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e81a4550 con 0x7f63e8109980 2024-05-14T09:23:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.095+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e81a47b0 con 0x7f63e8109980 2024-05-14T09:23:20.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.099+0000 7f63eca00640 1 -- 172.21.15.120:0/3013080760 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f63e0004040 con 0x7f63e8109980 2024-05-14T09:23:20.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.100+0000 7f63eca00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63cc0b2860 0x7f63cc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:20.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.100+0000 7f63eca00640 1 -- 172.21.15.120:0/3013080760 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f63e0103d10 con 0x7f63e8109980 2024-05-14T09:23:20.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.100+0000 7f63e6a00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63cc0b2860 0x7f63cc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:20.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.101+0000 7f63e6a00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63cc0b2860 0x7f63cc0b4d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f63e8104640 tx=0x7f63d8005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:20.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.102+0000 7f63eca00640 1 -- 172.21.15.120:0/3013080760 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f63e00cb690 con 0x7f63e8109980 2024-05-14T09:23:20.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.309+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f63e81a4980 con 0x7f63e8109980 2024-05-14T09:23:20.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.310+0000 7f63eca00640 1 -- 172.21.15.120:0/3013080760 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f63e00caf90 con 0x7f63e8109980 2024-05-14T09:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-05-14T09:23:20.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63cc0b2860 msgr2=0x7f63cc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:20.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63cc0b2860 0x7f63cc0b4d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f63e8104640 tx=0x7f63d8005e70 comp rx=0 tx=0).stop 2024-05-14T09:23:20.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 msgr2=0x7f63e81a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:20.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e81a3750 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098d0 tx=0x7f63e0003ba0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 shutdown_connections 2024-05-14T09:23:20.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63cc0b2860 0x7f63cc0b4d70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e8109980 0x7f63e81a3750 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e8104c80 0x7f63e819c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 --2- 172.21.15.120:0/3013080760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e8103a40 0x7f63e819c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:20.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.313+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 >> 172.21.15.120:0/3013080760 conn(0x7f63e80fec50 msgr2=0x7f63e80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:20.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.314+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 shutdown_connections 2024-05-14T09:23:20.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:20.314+0000 7f63e7e00640 1 -- 172.21.15.120:0/3013080760 wait complete. 2024-05-14T09:23:20.341 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-14T09:23:20.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:23:20.778 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:20 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2504868064' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T09:23:20.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:20 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3013080760' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T09:23:20.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:20 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2504868064' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T09:23:20.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:20 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3013080760' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T09:23:20.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:20 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2504868064' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T09:23:20.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:20 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3013080760' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T09:23:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:21 smithi120 ceph-mon[31085]: pgmap v550: 129 pgs: 129 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:21 smithi152 ceph-mon[34868]: pgmap v550: 129 pgs: 129 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:21 smithi175 ceph-mon[35353]: pgmap v550: 129 pgs: 129 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 -- 172.21.15.120:0/780851004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f801045f0 msgr2=0x7f8f80104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 --2- 172.21.15.120:0/780851004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f801045f0 0x7f8f80104a00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000b0d0 tx=0x7f8f7000b3e0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 -- 172.21.15.120:0/780851004 shutdown_connections 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 --2- 172.21.15.120:0/780851004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f80109870 0x7f8f801111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 --2- 172.21.15.120:0/780851004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f801045f0 0x7f8f80104a00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 --2- 172.21.15.120:0/780851004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f80108f20 0x7f8f80109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 -- 172.21.15.120:0/780851004 >> 172.21.15.120:0/780851004 conn(0x7f8f80100040 msgr2=0x7f8f80102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 -- 172.21.15.120:0/780851004 shutdown_connections 2024-05-14T09:23:23.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.205+0000 7f8f88200700 1 -- 172.21.15.120:0/780851004 wait complete. 2024-05-14T09:23:23.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.206+0000 7f8f88200700 1 Processor -- start 2024-05-14T09:23:23.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f88200700 1 -- start start 2024-05-14T09:23:23.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f88200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f801045f0 0x7f8f8019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:23.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f88200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f80108f20 0x7f8f8019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:23.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f88200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f80109870 0x7f8f8019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:23.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f88200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8f801143a0 con 0x7f8f80109870 2024-05-14T09:23:23.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f88200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8f80114220 con 0x7f8f801045f0 2024-05-14T09:23:23.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f88200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f80114520 con 0x7f8f80108f20 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f86200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f80109870 0x7f8f8019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.207+0000 7f8f86200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f80109870 0x7f8f8019f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38814/0 (socket says 172.21.15.120:38814) 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f86200700 1 -- 172.21.15.120:0/1520697299 learned_addr learned my addr 172.21.15.120:0/1520697299 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f85800700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f801045f0 0x7f8f8019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f84e00700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f80108f20 0x7f8f8019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f86200700 1 -- 172.21.15.120:0/1520697299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f80108f20 msgr2=0x7f8f8019b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f86200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f80108f20 0x7f8f8019b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f86200700 1 -- 172.21.15.120:0/1520697299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f801045f0 msgr2=0x7f8f8019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f86200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f801045f0 0x7f8f8019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f86200700 1 -- 172.21.15.120:0/1520697299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8019fcd0 con 0x7f8f80109870 2024-05-14T09:23:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.208+0000 7f8f86200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f80109870 0x7f8f8019f630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800c970 tx=0x7f8f7800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:23.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.209+0000 7f8f7e000700 1 -- 172.21.15.120:0/1520697299 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78004a30 con 0x7f8f80109870 2024-05-14T09:23:23.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.209+0000 7f8f7e000700 1 -- 172.21.15.120:0/1520697299 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f780054b0 con 0x7f8f80109870 2024-05-14T09:23:23.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.209+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8019ffc0 con 0x7f8f80109870 2024-05-14T09:23:23.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.209+0000 7f8f7e000700 1 -- 172.21.15.120:0/1520697299 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800eac0 con 0x7f8f80109870 2024-05-14T09:23:23.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.209+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f801a78e0 con 0x7f8f80109870 2024-05-14T09:23:23.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.210+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f800512c0 con 0x7f8f80109870 2024-05-14T09:23:23.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.213+0000 7f8f7e000700 1 -- 172.21.15.120:0/1520697299 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8f7800eca0 con 0x7f8f80109870 2024-05-14T09:23:23.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.214+0000 7f8f7e000700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8f640b2880 0x7f8f640b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:23.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.215+0000 7f8f7e000700 1 -- 172.21.15.120:0/1520697299 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8f780e24c0 con 0x7f8f80109870 2024-05-14T09:23:23.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.215+0000 7f8f85800700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8f640b2880 0x7f8f640b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:23.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.216+0000 7f8f85800700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8f640b2880 0x7f8f640b4d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009900 tx=0x7f8f7000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:23.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.217+0000 7f8f7e000700 1 -- 172.21.15.120:0/1520697299 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8f78014030 con 0x7f8f80109870 2024-05-14T09:23:23.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.497+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f8002e5f0 con 0x7f8f80109870 2024-05-14T09:23:23.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.498+0000 7f8f7e000700 1 -- 172.21.15.120:0/1520697299 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11957 (secure 0 0 0) 0x7f8f78005660 con 0x7f8f80109870 2024-05-14T09:23:23.499 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:23.499 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:23:16.852044+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34427,24454,34409,34388,24469]},"id":1}]} 2024-05-14T09:23:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8f640b2880 msgr2=0x7f8f640b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8f640b2880 0x7f8f640b4d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009900 tx=0x7f8f7000b040 comp rx=0 tx=0).stop 2024-05-14T09:23:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f80109870 msgr2=0x7f8f8019f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f80109870 0x7f8f8019f630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800c970 tx=0x7f8f7800cc80 comp rx=0 tx=0).stop 2024-05-14T09:23:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 shutdown_connections 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8f640b2880 0x7f8f640b4d90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f801045f0 0x7f8f8019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f80109870 0x7f8f8019f630 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 --2- 172.21.15.120:0/1520697299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f80108f20 0x7f8f8019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.501+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 >> 172.21.15.120:0/1520697299 conn(0x7f8f80100040 msgr2=0x7f8f80102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.502+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 shutdown_connections 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:23.502+0000 7f8f88200700 1 -- 172.21.15.120:0/1520697299 wait complete. 2024-05-14T09:23:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2024-05-14T09:23:23.874 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:23 smithi120 ceph-mon[31085]: pgmap v551: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-14T09:23:23.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:23 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1520697299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:23:23.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:23 smithi152 ceph-mon[34868]: pgmap v551: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-14T09:23:23.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:23 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1520697299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:23:23.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:23 smithi175 ceph-mon[35353]: pgmap v551: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-14T09:23:23.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:23 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1520697299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:23:24.334 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-14T09:23:24.334 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-14T09:23:24.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T09:23:24.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 -- 172.21.15.120:0/3907292799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d0103a60 msgr2=0x7f14d0104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:24.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 --2- 172.21.15.120:0/3907292799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d0103a60 0x7f14d0104760 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009900 tx=0x7f14c002a410 comp rx=0 tx=0).stop 2024-05-14T09:23:24.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 -- 172.21.15.120:0/3907292799 shutdown_connections 2024-05-14T09:23:24.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 --2- 172.21.15.120:0/3907292799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d01099a0 0x7f14d010bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 --2- 172.21.15.120:0/3907292799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14d0104ca0 0x7f14d01050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 --2- 172.21.15.120:0/3907292799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d0103a60 0x7f14d0104760 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 -- 172.21.15.120:0/3907292799 >> 172.21.15.120:0/3907292799 conn(0x7f14d00fec50 msgr2=0x7f14d0101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:24.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 -- 172.21.15.120:0/3907292799 shutdown_connections 2024-05-14T09:23:24.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.604+0000 7f14cf200640 1 -- 172.21.15.120:0/3907292799 wait complete. 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 Processor -- start 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 -- start start 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d0103a60 0x7f14d019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14d0104ca0 0x7f14d019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d01099a0 0x7f14d01a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f14d010f460 con 0x7f14d01099a0 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14d010f2e0 con 0x7f14d0104ca0 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.605+0000 7f14cf200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14d010f5e0 con 0x7f14d0103a60 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d01099a0 0x7f14d01a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d01099a0 0x7f14d01a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38826/0 (socket says 172.21.15.120:38826) 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 -- 172.21.15.120:0/2167865303 learned_addr learned my addr 172.21.15.120:0/2167865303 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14cde00640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d0103a60 0x7f14d019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:24.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14cd400640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14d0104ca0 0x7f14d019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:24.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 -- 172.21.15.120:0/2167865303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d0103a60 msgr2=0x7f14d019a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:24.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d0103a60 0x7f14d019a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 -- 172.21.15.120:0/2167865303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14d0104ca0 msgr2=0x7f14d019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:24.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14d0104ca0 0x7f14d019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.606+0000 7f14ce800640 1 -- 172.21.15.120:0/2167865303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d01a1be0 con 0x7f14d01099a0 2024-05-14T09:23:24.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.607+0000 7f14ce800640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d01099a0 0x7f14d01a1570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f14c800eaa0 tx=0x7f14c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:24.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.607+0000 7f14c6a00640 1 -- 172.21.15.120:0/2167865303 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c800cdb0 con 0x7f14d01099a0 2024-05-14T09:23:24.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.607+0000 7f14c6a00640 1 -- 172.21.15.120:0/2167865303 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14c8005020 con 0x7f14d01099a0 2024-05-14T09:23:24.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.607+0000 7f14c6a00640 1 -- 172.21.15.120:0/2167865303 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c80116d0 con 0x7f14d01099a0 2024-05-14T09:23:24.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.607+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d01a1ed0 con 0x7f14d01099a0 2024-05-14T09:23:24.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.607+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d01a22e0 con 0x7f14d01099a0 2024-05-14T09:23:24.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.609+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d01087b0 con 0x7f14d01099a0 2024-05-14T09:23:24.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.611+0000 7f14c6a00640 1 -- 172.21.15.120:0/2167865303 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f14c80051d0 con 0x7f14d01099a0 2024-05-14T09:23:24.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.612+0000 7f14c6a00640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14b40b2860 0x7f14b40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:24.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.613+0000 7f14c6a00640 1 -- 172.21.15.120:0/2167865303 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f14c80e2800 con 0x7f14d01099a0 2024-05-14T09:23:24.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.613+0000 7f14cde00640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14b40b2860 0x7f14b40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:24.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.614+0000 7f14cde00640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14b40b2860 0x7f14b40b4d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f14c002a930 tx=0x7f14c0005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:24.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.617+0000 7f14c6a00640 1 -- 172.21.15.120:0/2167865303 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f14c8016030 con 0x7f14d01099a0 2024-05-14T09:23:24.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.824+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14d0063110 con 0x7f14b40b2860 2024-05-14T09:23:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.839+0000 7f14c6a00640 1 -- 172.21.15.120:0/2167865303 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340607 (secure 0 0 0) 0x7f14d0063110 con 0x7f14b40b2860 2024-05-14T09:23:24.845 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:24.847 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-05-14T09:23:24.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.846+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14b40b2860 msgr2=0x7f14b40b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.846+0000 7f14cf200640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14b40b2860 0x7f14b40b4d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f14c002a930 tx=0x7f14c0005720 comp rx=0 tx=0).stop 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.846+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d01099a0 msgr2=0x7f14d01a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.846+0000 7f14cf200640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d01099a0 0x7f14d01a1570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f14c800eaa0 tx=0x7f14c800ef60 comp rx=0 tx=0).stop 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 shutdown_connections 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14b40b2860 0x7f14b40b4d70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14d01099a0 0x7f14d01a1570 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14d0104ca0 0x7f14d019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 --2- 172.21.15.120:0/2167865303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14d0103a60 0x7f14d019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 >> 172.21.15.120:0/2167865303 conn(0x7f14d00fec50 msgr2=0x7f14d0105980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 shutdown_connections 2024-05-14T09:23:24.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:24.847+0000 7f14cf200640 1 -- 172.21.15.120:0/2167865303 wait complete. 2024-05-14T09:23:24.871 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2024-05-14T09:23:24.437670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":673798,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2440,"num_read_kb":1340,"num_write":410,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":838,"ondisk_log_size":838,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363512,"kb_used_data":14360,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578312,"statfs":{"total":1151940427776,"available":1151568191488,"internally_reserved":0,"allocated":14704640,"data_stored":8214080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6699,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70,"num_write":21,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005703"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291473+0000","last_change":"2024-05-14T09:18:02.795124+0000","last_active":"2024-05-14T09:21:10.291473+0000","last_peered":"2024-05-14T09:21:10.291473+0000","last_clean":"2024-05-14T09:21:10.291473+0000","last_became_active":"2024-05-14T09:18:02.794129+0000","last_became_peered":"2024-05-14T09:18:02.794129+0000","last_unstale":"2024-05-14T09:21:10.291473+0000","last_undegraded":"2024-05-14T09:21:10.291473+0000","last_fullsized":"2024-05-14T09:21:10.291473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:54.875120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284697+0000","last_change":"2024-05-14T09:18:02.775506+0000","last_active":"2024-05-14T09:21:10.284697+0000","last_peered":"2024-05-14T09:21:10.284697+0000","last_clean":"2024-05-14T09:21:10.284697+0000","last_became_active":"2024-05-14T09:18:02.774491+0000","last_became_peered":"2024-05-14T09:18:02.774491+0000","last_unstale":"2024-05-14T09:21:10.284697+0000","last_undegraded":"2024-05-14T09:21:10.284697+0000","last_fullsized":"2024-05-14T09:21:10.284697+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:36:40.414254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293283+0000","last_change":"2024-05-14T09:18:02.792681+0000","last_active":"2024-05-14T09:21:10.293283+0000","last_peered":"2024-05-14T09:21:10.293283+0000","last_clean":"2024-05-14T09:21:10.293283+0000","last_became_active":"2024-05-14T09:18:02.791903+0000","last_became_peered":"2024-05-14T09:18:02.791903+0000","last_unstale":"2024-05-14T09:21:10.293283+0000","last_undegraded":"2024-05-14T09:21:10.293283+0000","last_fullsized":"2024-05-14T09:21:10.293283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:09:31.027641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271919+0000","last_change":"2024-05-14T09:18:41.667606+0000","last_active":"2024-05-14T09:21:10.271919+0000","last_peered":"2024-05-14T09:21:10.271919+0000","last_clean":"2024-05-14T09:21:10.271919+0000","last_became_active":"2024-05-14T09:18:41.666853+0000","last_became_peered":"2024-05-14T09:18:41.666853+0000","last_unstale":"2024-05-14T09:21:10.271919+0000","last_undegraded":"2024-05-14T09:21:10.271919+0000","last_fullsized":"2024-05-14T09:21:10.271919+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:13:40.719553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282389+0000","last_change":"2024-05-14T09:18:02.775383+0000","last_active":"2024-05-14T09:21:10.282389+0000","last_peered":"2024-05-14T09:21:10.282389+0000","last_clean":"2024-05-14T09:21:10.282389+0000","last_became_active":"2024-05-14T09:18:02.774694+0000","last_became_peered":"2024-05-14T09:18:02.774694+0000","last_unstale":"2024-05-14T09:21:10.282389+0000","last_undegraded":"2024-05-14T09:21:10.282389+0000","last_fullsized":"2024-05-14T09:21:10.282389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:47.289929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282164+0000","last_change":"2024-05-14T09:18:02.782178+0000","last_active":"2024-05-14T09:21:10.282164+0000","last_peered":"2024-05-14T09:21:10.282164+0000","last_clean":"2024-05-14T09:21:10.282164+0000","last_became_active":"2024-05-14T09:18:02.781714+0000","last_became_peered":"2024-05-14T09:18:02.781714+0000","last_unstale":"2024-05-14T09:21:10.282164+0000","last_undegraded":"2024-05-14T09:21:10.282164+0000","last_fullsized":"2024-05-14T09:21:10.282164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:43:02.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270677+0000","last_change":"2024-05-14T09:18:02.774434+0000","last_active":"2024-05-14T09:21:10.270677+0000","last_peered":"2024-05-14T09:21:10.270677+0000","last_clean":"2024-05-14T09:21:10.270677+0000","last_became_active":"2024-05-14T09:18:02.774054+0000","last_became_peered":"2024-05-14T09:18:02.774054+0000","last_unstale":"2024-05-14T09:21:10.270677+0000","last_undegraded":"2024-05-14T09:21:10.270677+0000","last_fullsized":"2024-05-14T09:21:10.270677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:10.640939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280964+0000","last_change":"2024-05-14T09:18:02.780444+0000","last_active":"2024-05-14T09:21:10.280964+0000","last_peered":"2024-05-14T09:21:10.280964+0000","last_clean":"2024-05-14T09:21:10.280964+0000","last_became_active":"2024-05-14T09:18:02.779992+0000","last_became_peered":"2024-05-14T09:18:02.779992+0000","last_unstale":"2024-05-14T09:21:10.280964+0000","last_undegraded":"2024-05-14T09:21:10.280964+0000","last_fullsized":"2024-05-14T09:21:10.280964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:32:14.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286957+0000","last_change":"2024-05-14T09:18:02.790247+0000","last_active":"2024-05-14T09:21:10.286957+0000","last_peered":"2024-05-14T09:21:10.286957+0000","last_clean":"2024-05-14T09:21:10.286957+0000","last_became_active":"2024-05-14T09:18:02.789293+0000","last_became_peered":"2024-05-14T09:18:02.789293+0000","last_unstale":"2024-05-14T09:21:10.286957+0000","last_undegraded":"2024-05-14T09:21:10.286957+0000","last_fullsized":"2024-05-14T09:21:10.286957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:01.939326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.285820+0000","last_change":"2024-05-14T09:18:02.785167+0000","last_active":"2024-05-14T09:21:10.285820+0000","last_peered":"2024-05-14T09:21:10.285820+0000","last_clean":"2024-05-14T09:21:10.285820+0000","last_became_active":"2024-05-14T09:18:02.784772+0000","last_became_peered":"2024-05-14T09:18:02.784772+0000","last_unstale":"2024-05-14T09:21:10.285820+0000","last_undegraded":"2024-05-14T09:21:10.285820+0000","last_fullsized":"2024-05-14T09:21:10.285820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:06.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291103+0000","last_change":"2024-05-14T09:18:02.793000+0000","last_active":"2024-05-14T09:21:10.291103+0000","last_peered":"2024-05-14T09:21:10.291103+0000","last_clean":"2024-05-14T09:21:10.291103+0000","last_became_active":"2024-05-14T09:18:02.791895+0000","last_became_peered":"2024-05-14T09:18:02.791895+0000","last_unstale":"2024-05-14T09:21:10.291103+0000","last_undegraded":"2024-05-14T09:21:10.291103+0000","last_fullsized":"2024-05-14T09:21:10.291103+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:17.313383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279354+0000","last_change":"2024-05-14T09:18:02.776309+0000","last_active":"2024-05-14T09:21:10.279354+0000","last_peered":"2024-05-14T09:21:10.279354+0000","last_clean":"2024-05-14T09:21:10.279354+0000","last_became_active":"2024-05-14T09:18:02.769218+0000","last_became_peered":"2024-05-14T09:18:02.769218+0000","last_unstale":"2024-05-14T09:21:10.279354+0000","last_undegraded":"2024-05-14T09:21:10.279354+0000","last_fullsized":"2024-05-14T09:21:10.279354+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:54.793852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.288319+0000","last_change":"2024-05-14T09:18:41.667109+0000","last_active":"2024-05-14T09:21:10.288319+0000","last_peered":"2024-05-14T09:21:10.288319+0000","last_clean":"2024-05-14T09:21:10.288319+0000","last_became_active":"2024-05-14T09:18:41.666437+0000","last_became_peered":"2024-05-14T09:18:41.666437+0000","last_unstale":"2024-05-14T09:21:10.288319+0000","last_undegraded":"2024-05-14T09:21:10.288319+0000","last_fullsized":"2024-05-14T09:21:10.288319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:14.806924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284390+0000","last_change":"2024-05-14T09:18:02.777380+0000","last_active":"2024-05-14T09:21:10.284390+0000","last_peered":"2024-05-14T09:21:10.284390+0000","last_clean":"2024-05-14T09:21:10.284390+0000","last_became_active":"2024-05-14T09:18:02.777035+0000","last_became_peered":"2024-05-14T09:18:02.777035+0000","last_unstale":"2024-05-14T09:21:10.284390+0000","last_undegraded":"2024-05-14T09:21:10.284390+0000","last_fullsized":"2024-05-14T09:21:10.284390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:56.906077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291563+0000","last_change":"2024-05-14T09:18:02.784577+0000","last_active":"2024-05-14T09:21:10.291563+0000","last_peered":"2024-05-14T09:21:10.291563+0000","last_clean":"2024-05-14T09:21:10.291563+0000","last_became_active":"2024-05-14T09:18:02.784185+0000","last_became_peered":"2024-05-14T09:18:02.784185+0000","last_unstale":"2024-05-14T09:21:10.291563+0000","last_undegraded":"2024-05-14T09:21:10.291563+0000","last_fullsized":"2024-05-14T09:21:10.291563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:44:38.518861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292676+0000","last_change":"2024-05-14T09:18:02.783262+0000","last_active":"2024-05-14T09:21:10.292676+0000","last_peered":"2024-05-14T09:21:10.292676+0000","last_clean":"2024-05-14T09:21:10.292676+0000","last_became_active":"2024-05-14T09:18:02.780405+0000","last_became_peered":"2024-05-14T09:18:02.780405+0000","last_unstale":"2024-05-14T09:21:10.292676+0000","last_undegraded":"2024-05-14T09:21:10.292676+0000","last_fullsized":"2024-05-14T09:21:10.292676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:01:50.437966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291477+0000","last_change":"2024-05-14T09:18:02.789155+0000","last_active":"2024-05-14T09:21:10.291477+0000","last_peered":"2024-05-14T09:21:10.291477+0000","last_clean":"2024-05-14T09:21:10.291477+0000","last_became_active":"2024-05-14T09:18:02.788703+0000","last_became_peered":"2024-05-14T09:18:02.788703+0000","last_unstale":"2024-05-14T09:21:10.291477+0000","last_undegraded":"2024-05-14T09:21:10.291477+0000","last_fullsized":"2024-05-14T09:21:10.291477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:27:18.593797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293682+0000","last_change":"2024-05-14T09:18:02.788856+0000","last_active":"2024-05-14T09:21:10.293682+0000","last_peered":"2024-05-14T09:21:10.293682+0000","last_clean":"2024-05-14T09:21:10.293682+0000","last_became_active":"2024-05-14T09:18:02.788477+0000","last_became_peered":"2024-05-14T09:18:02.788477+0000","last_unstale":"2024-05-14T09:21:10.293682+0000","last_undegraded":"2024-05-14T09:21:10.293682+0000","last_fullsized":"2024-05-14T09:21:10.293682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:14:09.943568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278084+0000","last_change":"2024-05-14T09:18:02.781087+0000","last_active":"2024-05-14T09:21:10.278084+0000","last_peered":"2024-05-14T09:21:10.278084+0000","last_clean":"2024-05-14T09:21:10.278084+0000","last_became_active":"2024-05-14T09:18:02.780584+0000","last_became_peered":"2024-05-14T09:18:02.780584+0000","last_unstale":"2024-05-14T09:21:10.278084+0000","last_undegraded":"2024-05-14T09:21:10.278084+0000","last_fullsized":"2024-05-14T09:21:10.278084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:02:23.587235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:40.013591+0000","last_change":"2024-05-14T09:19:42.889482+0000","last_active":"2024-05-14T09:20:40.013591+0000","last_peered":"2024-05-14T09:20:40.013591+0000","last_clean":"2024-05-14T09:20:40.013591+0000","last_became_active":"2024-05-14T09:19:42.887316+0000","last_became_peered":"2024-05-14T09:19:42.887316+0000","last_unstale":"2024-05-14T09:20:40.013591+0000","last_undegraded":"2024-05-14T09:20:40.013591+0000","last_fullsized":"2024-05-14T09:20:40.013591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:13:44.778215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'15","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:21.677099+0000","last_change":"2024-05-14T09:17:57.708207+0000","last_active":"2024-05-14T09:23:21.677099+0000","last_peered":"2024-05-14T09:23:21.677099+0000","last_clean":"2024-05-14T09:23:21.677099+0000","last_became_active":"2024-05-14T09:17:57.707547+0000","last_became_peered":"2024-05-14T09:17:57.707547+0000","last_unstale":"2024-05-14T09:23:21.677099+0000","last_undegraded":"2024-05-14T09:23:21.677099+0000","last_fullsized":"2024-05-14T09:23:21.677099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.378254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271488+0000","last_change":"2024-05-14T09:18:02.782461+0000","last_active":"2024-05-14T09:21:10.271488+0000","last_peered":"2024-05-14T09:21:10.271488+0000","last_clean":"2024-05-14T09:21:10.271488+0000","last_became_active":"2024-05-14T09:18:02.781014+0000","last_became_peered":"2024-05-14T09:18:02.781014+0000","last_unstale":"2024-05-14T09:21:10.271488+0000","last_undegraded":"2024-05-14T09:21:10.271488+0000","last_fullsized":"2024-05-14T09:21:10.271488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:21:13.024727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:44.767239+0000","last_change":"2024-05-14T09:18:15.878163+0000","last_active":"2024-05-14T09:20:44.767239+0000","last_peered":"2024-05-14T09:20:44.767239+0000","last_clean":"2024-05-14T09:20:44.767239+0000","last_became_active":"2024-05-14T09:18:15.877097+0000","last_became_peered":"2024-05-14T09:18:15.877097+0000","last_unstale":"2024-05-14T09:20:44.767239+0000","last_undegraded":"2024-05-14T09:20:44.767239+0000","last_fullsized":"2024-05-14T09:20:44.767239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:59.570534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:57.408487+0000","last_change":"2024-05-14T09:17:57.773712+0000","last_active":"2024-05-14T09:19:57.408487+0000","last_peered":"2024-05-14T09:19:57.408487+0000","last_clean":"2024-05-14T09:19:57.408487+0000","last_became_active":"2024-05-14T09:17:57.772849+0000","last_became_peered":"2024-05-14T09:17:57.772849+0000","last_unstale":"2024-05-14T09:19:57.408487+0000","last_undegraded":"2024-05-14T09:19:57.408487+0000","last_fullsized":"2024-05-14T09:19:57.408487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:20.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293237+0000","last_change":"2024-05-14T09:18:02.790490+0000","last_active":"2024-05-14T09:21:10.293237+0000","last_peered":"2024-05-14T09:21:10.293237+0000","last_clean":"2024-05-14T09:21:10.293237+0000","last_became_active":"2024-05-14T09:18:02.790112+0000","last_became_peered":"2024-05-14T09:18:02.790112+0000","last_unstale":"2024-05-14T09:21:10.293237+0000","last_undegraded":"2024-05-14T09:21:10.293237+0000","last_fullsized":"2024-05-14T09:21:10.293237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:15.851585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:49.768321+0000","last_change":"2024-05-14T09:18:15.888894+0000","last_active":"2024-05-14T09:20:49.768321+0000","last_peered":"2024-05-14T09:20:49.768321+0000","last_clean":"2024-05-14T09:20:49.768321+0000","last_became_active":"2024-05-14T09:18:15.888327+0000","last_became_peered":"2024-05-14T09:18:15.888327+0000","last_unstale":"2024-05-14T09:20:49.768321+0000","last_undegraded":"2024-05-14T09:20:49.768321+0000","last_fullsized":"2024-05-14T09:20:49.768321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:13:19.871380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:29.573100+0000","last_change":"2024-05-14T09:17:57.717745+0000","last_active":"2024-05-14T09:20:29.573100+0000","last_peered":"2024-05-14T09:20:29.573100+0000","last_clean":"2024-05-14T09:20:29.573100+0000","last_became_active":"2024-05-14T09:17:57.716822+0000","last_became_peered":"2024-05-14T09:17:57.716822+0000","last_unstale":"2024-05-14T09:20:29.573100+0000","last_undegraded":"2024-05-14T09:20:29.573100+0000","last_fullsized":"2024-05-14T09:20:29.573100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:47:40.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292522+0000","last_change":"2024-05-14T09:18:02.788276+0000","last_active":"2024-05-14T09:21:10.292522+0000","last_peered":"2024-05-14T09:21:10.292522+0000","last_clean":"2024-05-14T09:21:10.292522+0000","last_became_active":"2024-05-14T09:18:02.787446+0000","last_became_peered":"2024-05-14T09:18:02.787446+0000","last_unstale":"2024-05-14T09:21:10.292522+0000","last_undegraded":"2024-05-14T09:21:10.292522+0000","last_fullsized":"2024-05-14T09:21:10.292522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:07:36.574378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:49.768281+0000","last_change":"2024-05-14T09:18:15.887824+0000","last_active":"2024-05-14T09:20:49.768281+0000","last_peered":"2024-05-14T09:20:49.768281+0000","last_clean":"2024-05-14T09:20:49.768281+0000","last_became_active":"2024-05-14T09:18:15.887152+0000","last_became_peered":"2024-05-14T09:18:15.887152+0000","last_unstale":"2024-05-14T09:20:49.768281+0000","last_undegraded":"2024-05-14T09:20:49.768281+0000","last_fullsized":"2024-05-14T09:20:49.768281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:54.778329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:29.573025+0000","last_change":"2024-05-14T09:17:57.717528+0000","last_active":"2024-05-14T09:20:29.573025+0000","last_peered":"2024-05-14T09:20:29.573025+0000","last_clean":"2024-05-14T09:20:29.573025+0000","last_became_active":"2024-05-14T09:17:57.716251+0000","last_became_peered":"2024-05-14T09:17:57.716251+0000","last_unstale":"2024-05-14T09:20:29.573025+0000","last_undegraded":"2024-05-14T09:20:29.573025+0000","last_fullsized":"2024-05-14T09:20:29.573025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:29:08.080292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290619+0000","last_change":"2024-05-14T09:18:02.790132+0000","last_active":"2024-05-14T09:21:10.290619+0000","last_peered":"2024-05-14T09:21:10.290619+0000","last_clean":"2024-05-14T09:21:10.290619+0000","last_became_active":"2024-05-14T09:18:02.789461+0000","last_became_peered":"2024-05-14T09:18:02.789461+0000","last_unstale":"2024-05-14T09:21:10.290619+0000","last_undegraded":"2024-05-14T09:21:10.290619+0000","last_fullsized":"2024-05-14T09:21:10.290619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:36:55.261959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:45.014800+0000","last_change":"2024-05-14T09:18:15.893674+0000","last_active":"2024-05-14T09:20:45.014800+0000","last_peered":"2024-05-14T09:20:45.014800+0000","last_clean":"2024-05-14T09:20:45.014800+0000","last_became_active":"2024-05-14T09:18:15.891857+0000","last_became_peered":"2024-05-14T09:18:15.891857+0000","last_unstale":"2024-05-14T09:20:45.014800+0000","last_undegraded":"2024-05-14T09:20:45.014800+0000","last_fullsized":"2024-05-14T09:20:45.014800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:14:55.020773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":296,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:20.728045+0000","last_change":"2024-05-14T09:18:41.982086+0000","last_active":"2024-05-14T09:23:20.728045+0000","last_peered":"2024-05-14T09:23:20.728045+0000","last_clean":"2024-05-14T09:23:20.728045+0000","last_became_active":"2024-05-14T09:18:41.981103+0000","last_became_peered":"2024-05-14T09:18:41.981103+0000","last_unstale":"2024-05-14T09:23:20.728045+0000","last_undegraded":"2024-05-14T09:23:20.728045+0000","last_fullsized":"2024-05-14T09:23:20.728045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:25:26.896681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.268707+0000","last_change":"2024-05-14T09:18:02.775834+0000","last_active":"2024-05-14T09:21:10.268707+0000","last_peered":"2024-05-14T09:21:10.268707+0000","last_clean":"2024-05-14T09:21:10.268707+0000","last_became_active":"2024-05-14T09:18:02.773708+0000","last_became_peered":"2024-05-14T09:18:02.773708+0000","last_unstale":"2024-05-14T09:21:10.268707+0000","last_undegraded":"2024-05-14T09:21:10.268707+0000","last_fullsized":"2024-05-14T09:21:10.268707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:00.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:45.014716+0000","last_change":"2024-05-14T09:19:42.899138+0000","last_active":"2024-05-14T09:20:45.014716+0000","last_peered":"2024-05-14T09:20:45.014716+0000","last_clean":"2024-05-14T09:20:45.014716+0000","last_became_active":"2024-05-14T09:19:42.897588+0000","last_became_peered":"2024-05-14T09:19:42.897588+0000","last_unstale":"2024-05-14T09:20:45.014716+0000","last_undegraded":"2024-05-14T09:20:45.014716+0000","last_fullsized":"2024-05-14T09:20:45.014716+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:13:05.760525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:30.522923+0000","last_change":"2024-05-14T09:18:42.326203+0000","last_active":"2024-05-14T09:20:30.522923+0000","last_peered":"2024-05-14T09:20:30.522923+0000","last_clean":"2024-05-14T09:20:30.522923+0000","last_became_active":"2024-05-14T09:18:42.324907+0000","last_became_peered":"2024-05-14T09:18:42.324907+0000","last_unstale":"2024-05-14T09:20:30.522923+0000","last_undegraded":"2024-05-14T09:20:30.522923+0000","last_fullsized":"2024-05-14T09:20:30.522923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:50.408706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274235+0000","last_change":"2024-05-14T09:18:41.669731+0000","last_active":"2024-05-14T09:21:10.274235+0000","last_peered":"2024-05-14T09:21:10.274235+0000","last_clean":"2024-05-14T09:21:10.274235+0000","last_became_active":"2024-05-14T09:18:41.667039+0000","last_became_peered":"2024-05-14T09:18:41.667039+0000","last_unstale":"2024-05-14T09:21:10.274235+0000","last_undegraded":"2024-05-14T09:21:10.274235+0000","last_fullsized":"2024-05-14T09:21:10.274235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:33:30.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.670641+0000","last_change":"2024-05-14T09:18:15.894314+0000","last_active":"2024-05-14T09:20:23.670641+0000","last_peered":"2024-05-14T09:20:23.670641+0000","last_clean":"2024-05-14T09:20:23.670641+0000","last_became_active":"2024-05-14T09:18:15.893173+0000","last_became_peered":"2024-05-14T09:18:15.893173+0000","last_unstale":"2024-05-14T09:20:23.670641+0000","last_undegraded":"2024-05-14T09:20:23.670641+0000","last_fullsized":"2024-05-14T09:20:23.670641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:19:25.467141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.081025+0000","last_change":"2024-05-14T09:17:57.704612+0000","last_active":"2024-05-14T09:20:23.081025+0000","last_peered":"2024-05-14T09:20:23.081025+0000","last_clean":"2024-05-14T09:20:23.081025+0000","last_became_active":"2024-05-14T09:17:57.703979+0000","last_became_peered":"2024-05-14T09:17:57.703979+0000","last_unstale":"2024-05-14T09:20:23.081025+0000","last_undegraded":"2024-05-14T09:20:23.081025+0000","last_fullsized":"2024-05-14T09:20:23.081025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:08.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281081+0000","last_change":"2024-05-14T09:18:02.774778+0000","last_active":"2024-05-14T09:21:10.281081+0000","last_peered":"2024-05-14T09:21:10.281081+0000","last_clean":"2024-05-14T09:21:10.281081+0000","last_became_active":"2024-05-14T09:18:02.774406+0000","last_became_peered":"2024-05-14T09:18:02.774406+0000","last_unstale":"2024-05-14T09:21:10.281081+0000","last_undegraded":"2024-05-14T09:21:10.281081+0000","last_fullsized":"2024-05-14T09:21:10.281081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.135221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:17.722558+0000","last_change":"2024-05-14T09:18:15.885921+0000","last_active":"2024-05-14T09:20:17.722558+0000","last_peered":"2024-05-14T09:20:17.722558+0000","last_clean":"2024-05-14T09:20:17.722558+0000","last_became_active":"2024-05-14T09:18:15.885261+0000","last_became_peered":"2024-05-14T09:18:15.885261+0000","last_unstale":"2024-05-14T09:20:17.722558+0000","last_undegraded":"2024-05-14T09:20:17.722558+0000","last_fullsized":"2024-05-14T09:20:17.722558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:57.438626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:21.830341+0000","last_change":"2024-05-14T09:17:57.714662+0000","last_active":"2024-05-14T09:20:21.830341+0000","last_peered":"2024-05-14T09:20:21.830341+0000","last_clean":"2024-05-14T09:20:21.830341+0000","last_became_active":"2024-05-14T09:17:57.714086+0000","last_became_peered":"2024-05-14T09:17:57.714086+0000","last_unstale":"2024-05-14T09:20:21.830341+0000","last_undegraded":"2024-05-14T09:20:21.830341+0000","last_fullsized":"2024-05-14T09:20:21.830341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:20.609634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281414+0000","last_change":"2024-05-14T09:18:02.767521+0000","last_active":"2024-05-14T09:21:10.281414+0000","last_peered":"2024-05-14T09:21:10.281414+0000","last_clean":"2024-05-14T09:21:10.281414+0000","last_became_active":"2024-05-14T09:18:02.767035+0000","last_became_peered":"2024-05-14T09:18:02.767035+0000","last_unstale":"2024-05-14T09:21:10.281414+0000","last_undegraded":"2024-05-14T09:21:10.281414+0000","last_fullsized":"2024-05-14T09:21:10.281414+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:00:30.251960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.416573+0000","last_change":"2024-05-14T09:18:15.890254+0000","last_active":"2024-05-14T09:20:37.416573+0000","last_peered":"2024-05-14T09:20:37.416573+0000","last_clean":"2024-05-14T09:20:37.416573+0000","last_became_active":"2024-05-14T09:18:15.887699+0000","last_became_peered":"2024-05-14T09:18:15.887699+0000","last_unstale":"2024-05-14T09:20:37.416573+0000","last_undegraded":"2024-05-14T09:20:37.416573+0000","last_fullsized":"2024-05-14T09:20:37.416573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:30:39.578671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'8","reported_seq":514,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:19.714270+0000","last_change":"2024-05-14T09:17:57.712559+0000","last_active":"2024-05-14T09:23:19.714270+0000","last_peered":"2024-05-14T09:23:19.714270+0000","last_clean":"2024-05-14T09:23:19.714270+0000","last_became_active":"2024-05-14T09:17:57.711265+0000","last_became_peered":"2024-05-14T09:17:57.711265+0000","last_unstale":"2024-05-14T09:23:19.714270+0000","last_undegraded":"2024-05-14T09:23:19.714270+0000","last_fullsized":"2024-05-14T09:23:19.714270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:37:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":460,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292233+0000","last_change":"2024-05-14T09:18:02.793657+0000","last_active":"2024-05-14T09:21:10.292233+0000","last_peered":"2024-05-14T09:21:10.292233+0000","last_clean":"2024-05-14T09:21:10.292233+0000","last_became_active":"2024-05-14T09:18:02.789550+0000","last_became_peered":"2024-05-14T09:18:02.789550+0000","last_unstale":"2024-05-14T09:21:10.292233+0000","last_undegraded":"2024-05-14T09:21:10.292233+0000","last_fullsized":"2024-05-14T09:21:10.292233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:31.933523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.831474+0000","last_change":"2024-05-14T09:18:15.877290+0000","last_active":"2024-05-14T09:20:37.831474+0000","last_peered":"2024-05-14T09:20:37.831474+0000","last_clean":"2024-05-14T09:20:37.831474+0000","last_became_active":"2024-05-14T09:18:15.874522+0000","last_became_peered":"2024-05-14T09:18:15.874522+0000","last_unstale":"2024-05-14T09:20:37.831474+0000","last_undegraded":"2024-05-14T09:20:37.831474+0000","last_fullsized":"2024-05-14T09:20:37.831474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:16.774709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:22.254948+0000","last_change":"2024-05-14T09:17:57.710407+0000","last_active":"2024-05-14T09:20:22.254948+0000","last_peered":"2024-05-14T09:20:22.254948+0000","last_clean":"2024-05-14T09:20:22.254948+0000","last_became_active":"2024-05-14T09:17:57.709776+0000","last_became_peered":"2024-05-14T09:17:57.709776+0000","last_unstale":"2024-05-14T09:20:22.254948+0000","last_undegraded":"2024-05-14T09:20:22.254948+0000","last_fullsized":"2024-05-14T09:20:22.254948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:28:04.838236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291060+0000","last_change":"2024-05-14T09:18:41.664954+0000","last_active":"2024-05-14T09:21:10.291060+0000","last_peered":"2024-05-14T09:21:10.291060+0000","last_clean":"2024-05-14T09:21:10.291060+0000","last_became_active":"2024-05-14T09:18:41.663825+0000","last_became_peered":"2024-05-14T09:18:41.663825+0000","last_unstale":"2024-05-14T09:21:10.291060+0000","last_undegraded":"2024-05-14T09:21:10.291060+0000","last_fullsized":"2024-05-14T09:21:10.291060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:50.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:39.766161+0000","last_change":"2024-05-14T09:18:15.882918+0000","last_active":"2024-05-14T09:20:39.766161+0000","last_peered":"2024-05-14T09:20:39.766161+0000","last_clean":"2024-05-14T09:20:39.766161+0000","last_became_active":"2024-05-14T09:18:15.880220+0000","last_became_peered":"2024-05-14T09:18:15.880220+0000","last_unstale":"2024-05-14T09:20:39.766161+0000","last_undegraded":"2024-05-14T09:20:39.766161+0000","last_fullsized":"2024-05-14T09:20:39.766161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:49.777319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:21.830568+0000","last_change":"2024-05-14T09:17:57.775417+0000","last_active":"2024-05-14T09:20:21.830568+0000","last_peered":"2024-05-14T09:20:21.830568+0000","last_clean":"2024-05-14T09:20:21.830568+0000","last_became_active":"2024-05-14T09:17:57.774362+0000","last_became_peered":"2024-05-14T09:17:57.774362+0000","last_unstale":"2024-05-14T09:20:21.830568+0000","last_undegraded":"2024-05-14T09:20:21.830568+0000","last_fullsized":"2024-05-14T09:20:21.830568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:27.320060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292752+0000","last_change":"2024-05-14T09:18:02.794096+0000","last_active":"2024-05-14T09:21:10.292752+0000","last_peered":"2024-05-14T09:21:10.292752+0000","last_clean":"2024-05-14T09:21:10.292752+0000","last_became_active":"2024-05-14T09:18:02.788361+0000","last_became_peered":"2024-05-14T09:18:02.788361+0000","last_unstale":"2024-05-14T09:21:10.292752+0000","last_undegraded":"2024-05-14T09:21:10.292752+0000","last_fullsized":"2024-05-14T09:21:10.292752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:41.485460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.831527+0000","last_change":"2024-05-14T09:18:15.886317+0000","last_active":"2024-05-14T09:20:37.831527+0000","last_peered":"2024-05-14T09:20:37.831527+0000","last_clean":"2024-05-14T09:20:37.831527+0000","last_became_active":"2024-05-14T09:18:15.885903+0000","last_became_peered":"2024-05-14T09:18:15.885903+0000","last_unstale":"2024-05-14T09:20:37.831527+0000","last_undegraded":"2024-05-14T09:20:37.831527+0000","last_fullsized":"2024-05-14T09:20:37.831527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:26:59.892672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'43","reported_seq":563,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:19.723160+0000","last_change":"2024-05-14T09:17:57.717013+0000","last_active":"2024-05-14T09:23:19.723160+0000","last_peered":"2024-05-14T09:23:19.723160+0000","last_clean":"2024-05-14T09:23:19.723160+0000","last_became_active":"2024-05-14T09:17:57.714552+0000","last_became_peered":"2024-05-14T09:17:57.714552+0000","last_unstale":"2024-05-14T09:23:19.723160+0000","last_undegraded":"2024-05-14T09:23:19.723160+0000","last_fullsized":"2024-05-14T09:23:19.723160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:16.042573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73270,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":310,"num_write":45,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262378+0000","last_change":"2024-05-14T09:18:02.782446+0000","last_active":"2024-05-14T09:21:10.262378+0000","last_peered":"2024-05-14T09:21:10.262378+0000","last_clean":"2024-05-14T09:21:10.262378+0000","last_became_active":"2024-05-14T09:18:02.779998+0000","last_became_peered":"2024-05-14T09:18:02.779998+0000","last_unstale":"2024-05-14T09:21:10.262378+0000","last_undegraded":"2024-05-14T09:21:10.262378+0000","last_fullsized":"2024-05-14T09:21:10.262378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:50.734227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:41.835136+0000","last_change":"2024-05-14T09:18:15.894372+0000","last_active":"2024-05-14T09:20:41.835136+0000","last_peered":"2024-05-14T09:20:41.835136+0000","last_clean":"2024-05-14T09:20:41.835136+0000","last_became_active":"2024-05-14T09:18:15.893842+0000","last_became_peered":"2024-05-14T09:18:15.893842+0000","last_unstale":"2024-05-14T09:20:41.835136+0000","last_undegraded":"2024-05-14T09:20:41.835136+0000","last_fullsized":"2024-05-14T09:20:41.835136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:57.675242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:03.679274+0000","last_change":"2024-05-14T09:18:41.675372+0000","last_active":"2024-05-14T09:21:03.679274+0000","last_peered":"2024-05-14T09:21:03.679274+0000","last_clean":"2024-05-14T09:21:03.679274+0000","last_became_active":"2024-05-14T09:18:41.659107+0000","last_became_peered":"2024-05-14T09:18:41.659107+0000","last_unstale":"2024-05-14T09:21:03.679274+0000","last_undegraded":"2024-05-14T09:21:03.679274+0000","last_fullsized":"2024-05-14T09:21:03.679274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:55:43.567929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280144+0000","last_change":"2024-05-14T09:18:02.780558+0000","last_active":"2024-05-14T09:21:10.280144+0000","last_peered":"2024-05-14T09:21:10.280144+0000","last_clean":"2024-05-14T09:21:10.280144+0000","last_became_active":"2024-05-14T09:18:02.779955+0000","last_became_peered":"2024-05-14T09:18:02.779955+0000","last_unstale":"2024-05-14T09:21:10.280144+0000","last_undegraded":"2024-05-14T09:21:10.280144+0000","last_fullsized":"2024-05-14T09:21:10.280144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:28:59.821879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:38.674219+0000","last_change":"2024-05-14T09:18:15.892207+0000","last_active":"2024-05-14T09:20:38.674219+0000","last_peered":"2024-05-14T09:20:38.674219+0000","last_clean":"2024-05-14T09:20:38.674219+0000","last_became_active":"2024-05-14T09:18:15.891646+0000","last_became_peered":"2024-05-14T09:18:15.891646+0000","last_unstale":"2024-05-14T09:20:38.674219+0000","last_undegraded":"2024-05-14T09:20:38.674219+0000","last_fullsized":"2024-05-14T09:20:38.674219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:06:48.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:16.829258+0000","last_change":"2024-05-14T09:17:57.717130+0000","last_active":"2024-05-14T09:20:16.829258+0000","last_peered":"2024-05-14T09:20:16.829258+0000","last_clean":"2024-05-14T09:20:16.829258+0000","last_became_active":"2024-05-14T09:17:57.716738+0000","last_became_peered":"2024-05-14T09:17:57.716738+0000","last_unstale":"2024-05-14T09:20:16.829258+0000","last_undegraded":"2024-05-14T09:20:16.829258+0000","last_fullsized":"2024-05-14T09:20:16.829258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:20:16.246789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286827+0000","last_change":"2024-05-14T09:18:02.783073+0000","last_active":"2024-05-14T09:21:10.286827+0000","last_peered":"2024-05-14T09:21:10.286827+0000","last_clean":"2024-05-14T09:21:10.286827+0000","last_became_active":"2024-05-14T09:18:02.782657+0000","last_became_peered":"2024-05-14T09:18:02.782657+0000","last_unstale":"2024-05-14T09:21:10.286827+0000","last_undegraded":"2024-05-14T09:21:10.286827+0000","last_fullsized":"2024-05-14T09:21:10.286827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:39:46.649875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:42.832376+0000","last_change":"2024-05-14T09:18:15.885231+0000","last_active":"2024-05-14T09:20:42.832376+0000","last_peered":"2024-05-14T09:20:42.832376+0000","last_clean":"2024-05-14T09:20:42.832376+0000","last_became_active":"2024-05-14T09:18:15.880199+0000","last_became_peered":"2024-05-14T09:18:15.880199+0000","last_unstale":"2024-05-14T09:20:42.832376+0000","last_undegraded":"2024-05-14T09:20:42.832376+0000","last_fullsized":"2024-05-14T09:20:42.832376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:10:22.707034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":284,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:18.704526+0000","last_change":"2024-05-14T09:17:57.718596+0000","last_active":"2024-05-14T09:23:18.704526+0000","last_peered":"2024-05-14T09:23:18.704526+0000","last_clean":"2024-05-14T09:23:18.704526+0000","last_became_active":"2024-05-14T09:17:57.717735+0000","last_became_peered":"2024-05-14T09:17:57.717735+0000","last_unstale":"2024-05-14T09:23:18.704526+0000","last_undegraded":"2024-05-14T09:23:18.704526+0000","last_fullsized":"2024-05-14T09:23:18.704526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:45.110512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.283343+0000","last_change":"2024-05-14T09:18:02.780222+0000","last_active":"2024-05-14T09:21:10.283343+0000","last_peered":"2024-05-14T09:21:10.283343+0000","last_clean":"2024-05-14T09:21:10.283343+0000","last_became_active":"2024-05-14T09:18:02.779842+0000","last_became_peered":"2024-05-14T09:18:02.779842+0000","last_unstale":"2024-05-14T09:21:10.283343+0000","last_undegraded":"2024-05-14T09:21:10.283343+0000","last_fullsized":"2024-05-14T09:21:10.283343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:46.726665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:43.084133+0000","last_change":"2024-05-14T09:18:15.885248+0000","last_active":"2024-05-14T09:20:43.084133+0000","last_peered":"2024-05-14T09:20:43.084133+0000","last_clean":"2024-05-14T09:20:43.084133+0000","last_became_active":"2024-05-14T09:18:15.884675+0000","last_became_peered":"2024-05-14T09:18:15.884675+0000","last_unstale":"2024-05-14T09:20:43.084133+0000","last_undegraded":"2024-05-14T09:20:43.084133+0000","last_fullsized":"2024-05-14T09:20:43.084133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:28:14.278141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:03.679217+0000","last_change":"2024-05-14T09:18:41.687983+0000","last_active":"2024-05-14T09:21:03.679217+0000","last_peered":"2024-05-14T09:21:03.679217+0000","last_clean":"2024-05-14T09:21:03.679217+0000","last_became_active":"2024-05-14T09:18:41.666942+0000","last_became_peered":"2024-05-14T09:18:41.666942+0000","last_unstale":"2024-05-14T09:21:03.679217+0000","last_undegraded":"2024-05-14T09:21:03.679217+0000","last_fullsized":"2024-05-14T09:21:03.679217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:38:24.183297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290079+0000","last_change":"2024-05-14T09:18:02.788509+0000","last_active":"2024-05-14T09:21:10.290079+0000","last_peered":"2024-05-14T09:21:10.290079+0000","last_clean":"2024-05-14T09:21:10.290079+0000","last_became_active":"2024-05-14T09:18:02.786886+0000","last_became_peered":"2024-05-14T09:18:02.786886+0000","last_unstale":"2024-05-14T09:21:10.290079+0000","last_undegraded":"2024-05-14T09:21:10.290079+0000","last_fullsized":"2024-05-14T09:21:10.290079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:29:38.765565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831719+0000","last_change":"2024-05-14T09:18:15.895299+0000","last_active":"2024-05-14T09:20:26.831719+0000","last_peered":"2024-05-14T09:20:26.831719+0000","last_clean":"2024-05-14T09:20:26.831719+0000","last_became_active":"2024-05-14T09:18:15.893663+0000","last_became_peered":"2024-05-14T09:18:15.893663+0000","last_unstale":"2024-05-14T09:20:26.831719+0000","last_undegraded":"2024-05-14T09:20:26.831719+0000","last_fullsized":"2024-05-14T09:20:26.831719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:58:24.950436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:22:29.597766+0000","last_change":"2024-05-14T09:17:57.710933+0000","last_active":"2024-05-14T09:22:29.597766+0000","last_peered":"2024-05-14T09:22:29.597766+0000","last_clean":"2024-05-14T09:22:29.597766+0000","last_became_active":"2024-05-14T09:17:57.710255+0000","last_became_peered":"2024-05-14T09:17:57.710255+0000","last_unstale":"2024-05-14T09:22:29.597766+0000","last_undegraded":"2024-05-14T09:22:29.597766+0000","last_fullsized":"2024-05-14T09:22:29.597766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:30.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277135+0000","last_change":"2024-05-14T09:18:02.781494+0000","last_active":"2024-05-14T09:21:10.277135+0000","last_peered":"2024-05-14T09:21:10.277135+0000","last_clean":"2024-05-14T09:21:10.277135+0000","last_became_active":"2024-05-14T09:18:02.781112+0000","last_became_peered":"2024-05-14T09:18:02.781112+0000","last_unstale":"2024-05-14T09:21:10.277135+0000","last_undegraded":"2024-05-14T09:21:10.277135+0000","last_fullsized":"2024-05-14T09:21:10.277135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:27.109538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:24.571869+0000","last_change":"2024-05-14T09:18:16.135447+0000","last_active":"2024-05-14T09:20:24.571869+0000","last_peered":"2024-05-14T09:20:24.571869+0000","last_clean":"2024-05-14T09:20:24.571869+0000","last_became_active":"2024-05-14T09:18:16.133770+0000","last_became_peered":"2024-05-14T09:18:16.133770+0000","last_unstale":"2024-05-14T09:20:24.571869+0000","last_undegraded":"2024-05-14T09:20:24.571869+0000","last_fullsized":"2024-05-14T09:20:24.571869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:29.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:02.824745+0000","last_change":"2024-05-14T09:17:57.776542+0000","last_active":"2024-05-14T09:20:02.824745+0000","last_peered":"2024-05-14T09:20:02.824745+0000","last_clean":"2024-05-14T09:20:02.824745+0000","last_became_active":"2024-05-14T09:17:57.775370+0000","last_became_peered":"2024-05-14T09:17:57.775370+0000","last_unstale":"2024-05-14T09:20:02.824745+0000","last_undegraded":"2024-05-14T09:20:02.824745+0000","last_fullsized":"2024-05-14T09:20:02.824745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:24.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280696+0000","last_change":"2024-05-14T09:18:02.776673+0000","last_active":"2024-05-14T09:21:10.280696+0000","last_peered":"2024-05-14T09:21:10.280696+0000","last_clean":"2024-05-14T09:21:10.280696+0000","last_became_active":"2024-05-14T09:18:02.776243+0000","last_became_peered":"2024-05-14T09:18:02.776243+0000","last_unstale":"2024-05-14T09:21:10.280696+0000","last_undegraded":"2024-05-14T09:21:10.280696+0000","last_fullsized":"2024-05-14T09:21:10.280696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:21.226977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.081080+0000","last_change":"2024-05-14T09:18:15.885039+0000","last_active":"2024-05-14T09:20:23.081080+0000","last_peered":"2024-05-14T09:20:23.081080+0000","last_clean":"2024-05-14T09:20:23.081080+0000","last_became_active":"2024-05-14T09:18:15.884466+0000","last_became_peered":"2024-05-14T09:18:15.884466+0000","last_unstale":"2024-05-14T09:20:23.081080+0000","last_undegraded":"2024-05-14T09:20:23.081080+0000","last_fullsized":"2024-05-14T09:20:23.081080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:12.000203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'8","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:20.675598+0000","last_change":"2024-05-14T09:17:57.712259+0000","last_active":"2024-05-14T09:23:20.675598+0000","last_peered":"2024-05-14T09:23:20.675598+0000","last_clean":"2024-05-14T09:23:20.675598+0000","last_became_active":"2024-05-14T09:17:57.711663+0000","last_became_peered":"2024-05-14T09:17:57.711663+0000","last_unstale":"2024-05-14T09:23:20.675598+0000","last_undegraded":"2024-05-14T09:23:20.675598+0000","last_fullsized":"2024-05-14T09:23:20.675598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:40:31.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291598+0000","last_change":"2024-05-14T09:18:02.783586+0000","last_active":"2024-05-14T09:21:10.291598+0000","last_peered":"2024-05-14T09:21:10.291598+0000","last_clean":"2024-05-14T09:21:10.291598+0000","last_became_active":"2024-05-14T09:18:02.783122+0000","last_became_peered":"2024-05-14T09:18:02.783122+0000","last_unstale":"2024-05-14T09:21:10.291598+0000","last_undegraded":"2024-05-14T09:21:10.291598+0000","last_fullsized":"2024-05-14T09:21:10.291598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:32:24.966064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:28.081683+0000","last_change":"2024-05-14T09:18:16.132825+0000","last_active":"2024-05-14T09:20:28.081683+0000","last_peered":"2024-05-14T09:20:28.081683+0000","last_clean":"2024-05-14T09:20:28.081683+0000","last_became_active":"2024-05-14T09:18:16.132155+0000","last_became_peered":"2024-05-14T09:18:16.132155+0000","last_unstale":"2024-05-14T09:20:28.081683+0000","last_undegraded":"2024-05-14T09:20:28.081683+0000","last_fullsized":"2024-05-14T09:20:28.081683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:43.579951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274056+0000","last_change":"2024-05-14T09:18:02.788407+0000","last_active":"2024-05-14T09:21:10.274056+0000","last_peered":"2024-05-14T09:21:10.274056+0000","last_clean":"2024-05-14T09:21:10.274056+0000","last_became_active":"2024-05-14T09:18:02.785934+0000","last_became_peered":"2024-05-14T09:18:02.785934+0000","last_unstale":"2024-05-14T09:21:10.274056+0000","last_undegraded":"2024-05-14T09:21:10.274056+0000","last_fullsized":"2024-05-14T09:21:10.274056+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":286,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:21.711598+0000","last_change":"2024-05-14T09:17:57.781016+0000","last_active":"2024-05-14T09:23:21.711598+0000","last_peered":"2024-05-14T09:23:21.711598+0000","last_clean":"2024-05-14T09:23:21.711598+0000","last_became_active":"2024-05-14T09:17:57.777442+0000","last_became_peered":"2024-05-14T09:17:57.777442+0000","last_unstale":"2024-05-14T09:23:21.711598+0000","last_undegraded":"2024-05-14T09:23:21.711598+0000","last_fullsized":"2024-05-14T09:23:21.711598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:17:06.992053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:22.254908+0000","last_change":"2024-05-14T09:18:15.891299+0000","last_active":"2024-05-14T09:20:22.254908+0000","last_peered":"2024-05-14T09:20:22.254908+0000","last_clean":"2024-05-14T09:20:22.254908+0000","last_became_active":"2024-05-14T09:18:15.890552+0000","last_became_peered":"2024-05-14T09:18:15.890552+0000","last_unstale":"2024-05-14T09:20:22.254908+0000","last_undegraded":"2024-05-14T09:20:22.254908+0000","last_fullsized":"2024-05-14T09:20:22.254908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:03:44.936117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292043+0000","last_change":"2024-05-14T09:18:02.793484+0000","last_active":"2024-05-14T09:21:10.292043+0000","last_peered":"2024-05-14T09:21:10.292043+0000","last_clean":"2024-05-14T09:21:10.292043+0000","last_became_active":"2024-05-14T09:18:02.792888+0000","last_became_peered":"2024-05-14T09:18:02.792888+0000","last_unstale":"2024-05-14T09:21:10.292043+0000","last_undegraded":"2024-05-14T09:21:10.292043+0000","last_fullsized":"2024-05-14T09:21:10.292043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:19.212025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:04.758799+0000","last_change":"2024-05-14T09:17:57.715271+0000","last_active":"2024-05-14T09:20:04.758799+0000","last_peered":"2024-05-14T09:20:04.758799+0000","last_clean":"2024-05-14T09:20:04.758799+0000","last_became_active":"2024-05-14T09:17:57.712524+0000","last_became_peered":"2024-05-14T09:17:57.712524+0000","last_unstale":"2024-05-14T09:20:04.758799+0000","last_undegraded":"2024-05-14T09:20:04.758799+0000","last_fullsized":"2024-05-14T09:20:04.758799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:39:46.868509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:12.252682+0000","last_change":"2024-05-14T09:16:01.832034+0000","last_active":"2024-05-14T09:20:12.252682+0000","last_peered":"2024-05-14T09:20:12.252682+0000","last_clean":"2024-05-14T09:20:12.252682+0000","last_became_active":"2024-05-14T09:16:01.815331+0000","last_became_peered":"2024-05-14T09:16:01.815331+0000","last_unstale":"2024-05-14T09:20:12.252682+0000","last_undegraded":"2024-05-14T09:20:12.252682+0000","last_fullsized":"2024-05-14T09:20:12.252682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_clean_scrub_stamp":"2024-05-14T09:11:00.916612+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:04:45.123827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831838+0000","last_change":"2024-05-14T09:18:16.136149+0000","last_active":"2024-05-14T09:20:26.831838+0000","last_peered":"2024-05-14T09:20:26.831838+0000","last_clean":"2024-05-14T09:20:26.831838+0000","last_became_active":"2024-05-14T09:18:16.134655+0000","last_became_peered":"2024-05-14T09:18:16.134655+0000","last_unstale":"2024-05-14T09:20:26.831838+0000","last_undegraded":"2024-05-14T09:20:26.831838+0000","last_fullsized":"2024-05-14T09:20:26.831838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:51.879763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274178+0000","last_change":"2024-05-14T09:18:02.791068+0000","last_active":"2024-05-14T09:21:10.274178+0000","last_peered":"2024-05-14T09:21:10.274178+0000","last_clean":"2024-05-14T09:21:10.274178+0000","last_became_active":"2024-05-14T09:18:02.785294+0000","last_became_peered":"2024-05-14T09:18:02.785294+0000","last_unstale":"2024-05-14T09:21:10.274178+0000","last_undegraded":"2024-05-14T09:21:10.274178+0000","last_fullsized":"2024-05-14T09:21:10.274178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:06:25.554475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:57.249555+0000","last_change":"2024-05-14T09:17:57.715272+0000","last_active":"2024-05-14T09:19:57.249555+0000","last_peered":"2024-05-14T09:19:57.249555+0000","last_clean":"2024-05-14T09:19:57.249555+0000","last_became_active":"2024-05-14T09:17:57.713504+0000","last_became_peered":"2024-05-14T09:17:57.713504+0000","last_unstale":"2024-05-14T09:19:57.249555+0000","last_undegraded":"2024-05-14T09:19:57.249555+0000","last_fullsized":"2024-05-14T09:19:57.249555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:27:26.071204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.670583+0000","last_change":"2024-05-14T09:18:15.893437+0000","last_active":"2024-05-14T09:20:23.670583+0000","last_peered":"2024-05-14T09:20:23.670583+0000","last_clean":"2024-05-14T09:20:23.670583+0000","last_became_active":"2024-05-14T09:18:15.890908+0000","last_became_peered":"2024-05-14T09:18:15.890908+0000","last_unstale":"2024-05-14T09:20:23.670583+0000","last_undegraded":"2024-05-14T09:20:23.670583+0000","last_fullsized":"2024-05-14T09:20:23.670583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:15.339562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:04.568011+0000","last_change":"2024-05-14T09:17:57.779601+0000","last_active":"2024-05-14T09:20:04.568011+0000","last_peered":"2024-05-14T09:20:04.568011+0000","last_clean":"2024-05-14T09:20:04.568011+0000","last_became_active":"2024-05-14T09:17:57.778730+0000","last_became_peered":"2024-05-14T09:17:57.778730+0000","last_unstale":"2024-05-14T09:20:04.568011+0000","last_undegraded":"2024-05-14T09:20:04.568011+0000","last_fullsized":"2024-05-14T09:20:04.568011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:01:07.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274698+0000","last_change":"2024-05-14T09:18:02.786283+0000","last_active":"2024-05-14T09:21:10.274698+0000","last_peered":"2024-05-14T09:21:10.274698+0000","last_clean":"2024-05-14T09:21:10.274698+0000","last_became_active":"2024-05-14T09:18:02.785158+0000","last_became_peered":"2024-05-14T09:18:02.785158+0000","last_unstale":"2024-05-14T09:21:10.274698+0000","last_undegraded":"2024-05-14T09:21:10.274698+0000","last_fullsized":"2024-05-14T09:21:10.274698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:28.804419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:17.412357+0000","last_change":"2024-05-14T09:18:16.133898+0000","last_active":"2024-05-14T09:20:17.412357+0000","last_peered":"2024-05-14T09:20:17.412357+0000","last_clean":"2024-05-14T09:20:17.412357+0000","last_became_active":"2024-05-14T09:18:16.132493+0000","last_became_peered":"2024-05-14T09:18:16.132493+0000","last_unstale":"2024-05-14T09:20:17.412357+0000","last_undegraded":"2024-05-14T09:20:17.412357+0000","last_fullsized":"2024-05-14T09:20:17.412357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:38:15.126883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'19","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:14.847618+0000","last_change":"2024-05-14T09:17:57.710000+0000","last_active":"2024-05-14T09:23:14.847618+0000","last_peered":"2024-05-14T09:23:14.847618+0000","last_clean":"2024-05-14T09:23:14.847618+0000","last_became_active":"2024-05-14T09:17:57.709546+0000","last_became_peered":"2024-05-14T09:17:57.709546+0000","last_unstale":"2024-05-14T09:23:14.847618+0000","last_undegraded":"2024-05-14T09:23:14.847618+0000","last_fullsized":"2024-05-14T09:23:14.847618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:09.681936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279023+0000","last_change":"2024-05-14T09:18:02.786342+0000","last_active":"2024-05-14T09:21:10.279023+0000","last_peered":"2024-05-14T09:21:10.279023+0000","last_clean":"2024-05-14T09:21:10.279023+0000","last_became_active":"2024-05-14T09:18:02.785981+0000","last_became_peered":"2024-05-14T09:18:02.785981+0000","last_unstale":"2024-05-14T09:21:10.279023+0000","last_undegraded":"2024-05-14T09:21:10.279023+0000","last_fullsized":"2024-05-14T09:21:10.279023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:59:43.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:20.009606+0000","last_change":"2024-05-14T09:18:15.882171+0000","last_active":"2024-05-14T09:20:20.009606+0000","last_peered":"2024-05-14T09:20:20.009606+0000","last_clean":"2024-05-14T09:20:20.009606+0000","last_became_active":"2024-05-14T09:18:15.881015+0000","last_became_peered":"2024-05-14T09:18:15.881015+0000","last_unstale":"2024-05-14T09:20:20.009606+0000","last_undegraded":"2024-05-14T09:20:20.009606+0000","last_fullsized":"2024-05-14T09:20:20.009606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:18.832868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:09.759495+0000","last_change":"2024-05-14T09:17:58.254067+0000","last_active":"2024-05-14T09:20:09.759495+0000","last_peered":"2024-05-14T09:20:09.759495+0000","last_clean":"2024-05-14T09:20:09.759495+0000","last_became_active":"2024-05-14T09:17:58.253140+0000","last_became_peered":"2024-05-14T09:17:58.253140+0000","last_unstale":"2024-05-14T09:20:09.759495+0000","last_undegraded":"2024-05-14T09:20:09.759495+0000","last_fullsized":"2024-05-14T09:20:09.759495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:20.263028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289930+0000","last_change":"2024-05-14T09:18:02.775968+0000","last_active":"2024-05-14T09:21:10.289930+0000","last_peered":"2024-05-14T09:21:10.289930+0000","last_clean":"2024-05-14T09:21:10.289930+0000","last_became_active":"2024-05-14T09:18:02.775639+0000","last_became_peered":"2024-05-14T09:18:02.775639+0000","last_unstale":"2024-05-14T09:21:10.289930+0000","last_undegraded":"2024-05-14T09:21:10.289930+0000","last_fullsized":"2024-05-14T09:21:10.289930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:27:52.179647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:34.765148+0000","last_change":"2024-05-14T09:18:16.139823+0000","last_active":"2024-05-14T09:20:34.765148+0000","last_peered":"2024-05-14T09:20:34.765148+0000","last_clean":"2024-05-14T09:20:34.765148+0000","last_became_active":"2024-05-14T09:18:16.138075+0000","last_became_peered":"2024-05-14T09:18:16.138075+0000","last_unstale":"2024-05-14T09:20:34.765148+0000","last_undegraded":"2024-05-14T09:20:34.765148+0000","last_fullsized":"2024-05-14T09:20:34.765148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:41.186678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:10.627966+0000","last_change":"2024-05-14T09:17:57.773751+0000","last_active":"2024-05-14T09:20:10.627966+0000","last_peered":"2024-05-14T09:20:10.627966+0000","last_clean":"2024-05-14T09:20:10.627966+0000","last_became_active":"2024-05-14T09:17:57.772964+0000","last_became_peered":"2024-05-14T09:17:57.772964+0000","last_unstale":"2024-05-14T09:20:10.627966+0000","last_undegraded":"2024-05-14T09:20:10.627966+0000","last_fullsized":"2024-05-14T09:20:10.627966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:08:01.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.265284+0000","last_change":"2024-05-14T09:18:02.774847+0000","last_active":"2024-05-14T09:21:10.265284+0000","last_peered":"2024-05-14T09:21:10.265284+0000","last_clean":"2024-05-14T09:21:10.265284+0000","last_became_active":"2024-05-14T09:18:02.774384+0000","last_became_peered":"2024-05-14T09:18:02.774384+0000","last_unstale":"2024-05-14T09:21:10.265284+0000","last_undegraded":"2024-05-14T09:21:10.265284+0000","last_fullsized":"2024-05-14T09:21:10.265284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:54:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:32.830622+0000","last_change":"2024-05-14T09:18:15.887656+0000","last_active":"2024-05-14T09:20:32.830622+0000","last_peered":"2024-05-14T09:20:32.830622+0000","last_clean":"2024-05-14T09:20:32.830622+0000","last_became_active":"2024-05-14T09:18:15.887203+0000","last_became_peered":"2024-05-14T09:18:15.887203+0000","last_unstale":"2024-05-14T09:20:32.830622+0000","last_undegraded":"2024-05-14T09:20:32.830622+0000","last_fullsized":"2024-05-14T09:20:32.830622+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:27.080959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:07.410488+0000","last_change":"2024-05-14T09:17:57.707511+0000","last_active":"2024-05-14T09:20:07.410488+0000","last_peered":"2024-05-14T09:20:07.410488+0000","last_clean":"2024-05-14T09:20:07.410488+0000","last_became_active":"2024-05-14T09:17:57.706706+0000","last_became_peered":"2024-05-14T09:17:57.706706+0000","last_unstale":"2024-05-14T09:20:07.410488+0000","last_undegraded":"2024-05-14T09:20:07.410488+0000","last_fullsized":"2024-05-14T09:20:07.410488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:25.325832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291212+0000","last_change":"2024-05-14T09:18:02.787800+0000","last_active":"2024-05-14T09:21:10.291212+0000","last_peered":"2024-05-14T09:21:10.291212+0000","last_clean":"2024-05-14T09:21:10.291212+0000","last_became_active":"2024-05-14T09:18:02.785115+0000","last_became_peered":"2024-05-14T09:18:02.785115+0000","last_unstale":"2024-05-14T09:21:10.291212+0000","last_undegraded":"2024-05-14T09:21:10.291212+0000","last_fullsized":"2024-05-14T09:21:10.291212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:23.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:33.294146+0000","last_change":"2024-05-14T09:19:42.898356+0000","last_active":"2024-05-14T09:20:33.294146+0000","last_peered":"2024-05-14T09:20:33.294146+0000","last_clean":"2024-05-14T09:20:33.294146+0000","last_became_active":"2024-05-14T09:19:42.896256+0000","last_became_peered":"2024-05-14T09:19:42.896256+0000","last_unstale":"2024-05-14T09:20:33.294146+0000","last_undegraded":"2024-05-14T09:20:33.294146+0000","last_fullsized":"2024-05-14T09:20:33.294146+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:59:09.389588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:14.961672+0000","last_change":"2024-05-14T09:17:57.710472+0000","last_active":"2024-05-14T09:23:14.961672+0000","last_peered":"2024-05-14T09:23:14.961672+0000","last_clean":"2024-05-14T09:23:14.961672+0000","last_became_active":"2024-05-14T09:17:57.710056+0000","last_became_peered":"2024-05-14T09:17:57.710056+0000","last_unstale":"2024-05-14T09:23:14.961672+0000","last_undegraded":"2024-05-14T09:23:14.961672+0000","last_fullsized":"2024-05-14T09:23:14.961672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:45.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282551+0000","last_change":"2024-05-14T09:18:02.779982+0000","last_active":"2024-05-14T09:21:10.282551+0000","last_peered":"2024-05-14T09:21:10.282551+0000","last_clean":"2024-05-14T09:21:10.282551+0000","last_became_active":"2024-05-14T09:18:02.779595+0000","last_became_peered":"2024-05-14T09:18:02.779595+0000","last_unstale":"2024-05-14T09:21:10.282551+0000","last_undegraded":"2024-05-14T09:21:10.282551+0000","last_fullsized":"2024-05-14T09:21:10.282551+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:06.520980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:33.294204+0000","last_change":"2024-05-14T09:18:16.137850+0000","last_active":"2024-05-14T09:20:33.294204+0000","last_peered":"2024-05-14T09:20:33.294204+0000","last_clean":"2024-05-14T09:20:33.294204+0000","last_became_active":"2024-05-14T09:18:16.135097+0000","last_became_peered":"2024-05-14T09:18:16.135097+0000","last_unstale":"2024-05-14T09:20:33.294204+0000","last_undegraded":"2024-05-14T09:20:33.294204+0000","last_fullsized":"2024-05-14T09:20:33.294204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:29:09.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:14.569955+0000","last_change":"2024-05-14T09:17:57.720232+0000","last_active":"2024-05-14T09:20:14.569955+0000","last_peered":"2024-05-14T09:20:14.569955+0000","last_clean":"2024-05-14T09:20:14.569955+0000","last_became_active":"2024-05-14T09:17:57.719057+0000","last_became_peered":"2024-05-14T09:17:57.719057+0000","last_unstale":"2024-05-14T09:20:14.569955+0000","last_undegraded":"2024-05-14T09:20:14.569955+0000","last_fullsized":"2024-05-14T09:20:14.569955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:34.378868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292344+0000","last_change":"2024-05-14T09:18:02.788106+0000","last_active":"2024-05-14T09:21:10.292344+0000","last_peered":"2024-05-14T09:21:10.292344+0000","last_clean":"2024-05-14T09:21:10.292344+0000","last_became_active":"2024-05-14T09:18:02.787631+0000","last_became_peered":"2024-05-14T09:18:02.787631+0000","last_unstale":"2024-05-14T09:21:10.292344+0000","last_undegraded":"2024-05-14T09:21:10.292344+0000","last_fullsized":"2024-05-14T09:21:10.292344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:59:45.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:25.631142+0000","last_change":"2024-05-14T09:18:15.889654+0000","last_active":"2024-05-14T09:20:25.631142+0000","last_peered":"2024-05-14T09:20:25.631142+0000","last_clean":"2024-05-14T09:20:25.631142+0000","last_became_active":"2024-05-14T09:18:15.888915+0000","last_became_peered":"2024-05-14T09:18:15.888915+0000","last_unstale":"2024-05-14T09:20:25.631142+0000","last_undegraded":"2024-05-14T09:20:25.631142+0000","last_fullsized":"2024-05-14T09:20:25.631142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:52:27.127246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'8","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:18.712839+0000","last_change":"2024-05-14T09:17:58.253945+0000","last_active":"2024-05-14T09:23:18.712839+0000","last_peered":"2024-05-14T09:23:18.712839+0000","last_clean":"2024-05-14T09:23:18.712839+0000","last_became_active":"2024-05-14T09:17:58.252807+0000","last_became_peered":"2024-05-14T09:17:58.252807+0000","last_unstale":"2024-05-14T09:23:18.712839+0000","last_undegraded":"2024-05-14T09:23:18.712839+0000","last_fullsized":"2024-05-14T09:23:18.712839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:56:52.853589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291593+0000","last_change":"2024-05-14T09:18:02.792743+0000","last_active":"2024-05-14T09:21:10.291593+0000","last_peered":"2024-05-14T09:21:10.291593+0000","last_clean":"2024-05-14T09:21:10.291593+0000","last_became_active":"2024-05-14T09:18:02.792371+0000","last_became_peered":"2024-05-14T09:18:02.792371+0000","last_unstale":"2024-05-14T09:21:10.291593+0000","last_undegraded":"2024-05-14T09:21:10.291593+0000","last_fullsized":"2024-05-14T09:21:10.291593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:10:00.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:32.725951+0000","last_change":"2024-05-14T09:18:15.884104+0000","last_active":"2024-05-14T09:20:32.725951+0000","last_peered":"2024-05-14T09:20:32.725951+0000","last_clean":"2024-05-14T09:20:32.725951+0000","last_became_active":"2024-05-14T09:18:15.881737+0000","last_became_peered":"2024-05-14T09:18:15.881737+0000","last_unstale":"2024-05-14T09:20:32.725951+0000","last_undegraded":"2024-05-14T09:20:32.725951+0000","last_fullsized":"2024-05-14T09:20:32.725951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:27:57.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:11.828210+0000","last_change":"2024-05-14T09:17:57.717776+0000","last_active":"2024-05-14T09:20:11.828210+0000","last_peered":"2024-05-14T09:20:11.828210+0000","last_clean":"2024-05-14T09:20:11.828210+0000","last_became_active":"2024-05-14T09:17:57.717338+0000","last_became_peered":"2024-05-14T09:17:57.717338+0000","last_unstale":"2024-05-14T09:20:11.828210+0000","last_undegraded":"2024-05-14T09:20:11.828210+0000","last_fullsized":"2024-05-14T09:20:11.828210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:38.441355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270936+0000","last_change":"2024-05-14T09:18:02.786286+0000","last_active":"2024-05-14T09:21:10.270936+0000","last_peered":"2024-05-14T09:21:10.270936+0000","last_clean":"2024-05-14T09:21:10.270936+0000","last_became_active":"2024-05-14T09:18:02.785915+0000","last_became_peered":"2024-05-14T09:18:02.785915+0000","last_unstale":"2024-05-14T09:21:10.270936+0000","last_undegraded":"2024-05-14T09:21:10.270936+0000","last_fullsized":"2024-05-14T09:21:10.270936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:54:08.960145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831575+0000","last_change":"2024-05-14T09:18:15.889692+0000","last_active":"2024-05-14T09:20:26.831575+0000","last_peered":"2024-05-14T09:20:26.831575+0000","last_clean":"2024-05-14T09:20:26.831575+0000","last_became_active":"2024-05-14T09:18:15.888675+0000","last_became_peered":"2024-05-14T09:18:15.888675+0000","last_unstale":"2024-05-14T09:20:26.831575+0000","last_undegraded":"2024-05-14T09:20:26.831575+0000","last_fullsized":"2024-05-14T09:20:26.831575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:11:20.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:13.079415+0000","last_change":"2024-05-14T09:17:57.694782+0000","last_active":"2024-05-14T09:20:13.079415+0000","last_peered":"2024-05-14T09:20:13.079415+0000","last_clean":"2024-05-14T09:20:13.079415+0000","last_became_active":"2024-05-14T09:17:57.693913+0000","last_became_peered":"2024-05-14T09:17:57.693913+0000","last_unstale":"2024-05-14T09:20:13.079415+0000","last_undegraded":"2024-05-14T09:20:13.079415+0000","last_fullsized":"2024-05-14T09:20:13.079415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:36:10.758138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280445+0000","last_change":"2024-05-14T09:18:02.784340+0000","last_active":"2024-05-14T09:21:10.280445+0000","last_peered":"2024-05-14T09:21:10.280445+0000","last_clean":"2024-05-14T09:21:10.280445+0000","last_became_active":"2024-05-14T09:18:02.783905+0000","last_became_peered":"2024-05-14T09:18:02.783905+0000","last_unstale":"2024-05-14T09:21:10.280445+0000","last_undegraded":"2024-05-14T09:21:10.280445+0000","last_fullsized":"2024-05-14T09:21:10.280445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:57:57.219324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.275048+0000","last_change":"2024-05-14T09:18:02.789214+0000","last_active":"2024-05-14T09:21:10.275048+0000","last_peered":"2024-05-14T09:21:10.275048+0000","last_clean":"2024-05-14T09:21:10.275048+0000","last_became_active":"2024-05-14T09:18:02.788764+0000","last_became_peered":"2024-05-14T09:18:02.788764+0000","last_unstale":"2024-05-14T09:21:10.275048+0000","last_undegraded":"2024-05-14T09:21:10.275048+0000","last_fullsized":"2024-05-14T09:21:10.275048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:13.665828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277543+0000","last_change":"2024-05-14T09:18:02.782255+0000","last_active":"2024-05-14T09:21:10.277543+0000","last_peered":"2024-05-14T09:21:10.277543+0000","last_clean":"2024-05-14T09:21:10.277543+0000","last_became_active":"2024-05-14T09:18:02.781817+0000","last_became_peered":"2024-05-14T09:18:02.781817+0000","last_unstale":"2024-05-14T09:21:10.277543+0000","last_undegraded":"2024-05-14T09:21:10.277543+0000","last_fullsized":"2024-05-14T09:21:10.277543+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:56:31.544934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.267934+0000","last_change":"2024-05-14T09:18:02.781737+0000","last_active":"2024-05-14T09:21:10.267934+0000","last_peered":"2024-05-14T09:21:10.267934+0000","last_clean":"2024-05-14T09:21:10.267934+0000","last_became_active":"2024-05-14T09:18:02.778429+0000","last_became_peered":"2024-05-14T09:18:02.778429+0000","last_unstale":"2024-05-14T09:21:10.267934+0000","last_undegraded":"2024-05-14T09:21:10.267934+0000","last_fullsized":"2024-05-14T09:21:10.267934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:52.699915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290185+0000","last_change":"2024-05-14T09:18:02.787107+0000","last_active":"2024-05-14T09:21:10.290185+0000","last_peered":"2024-05-14T09:21:10.290185+0000","last_clean":"2024-05-14T09:21:10.290185+0000","last_became_active":"2024-05-14T09:18:02.786259+0000","last_became_peered":"2024-05-14T09:18:02.786259+0000","last_unstale":"2024-05-14T09:21:10.290185+0000","last_undegraded":"2024-05-14T09:21:10.290185+0000","last_fullsized":"2024-05-14T09:21:10.290185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:50.103862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.287907+0000","last_change":"2024-05-14T09:18:02.792086+0000","last_active":"2024-05-14T09:21:10.287907+0000","last_peered":"2024-05-14T09:21:10.287907+0000","last_clean":"2024-05-14T09:21:10.287907+0000","last_became_active":"2024-05-14T09:18:02.785795+0000","last_became_peered":"2024-05-14T09:18:02.785795+0000","last_unstale":"2024-05-14T09:21:10.287907+0000","last_undegraded":"2024-05-14T09:21:10.287907+0000","last_fullsized":"2024-05-14T09:21:10.287907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:58.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.272731+0000","last_change":"2024-05-14T09:18:02.787934+0000","last_active":"2024-05-14T09:21:10.272731+0000","last_peered":"2024-05-14T09:21:10.272731+0000","last_clean":"2024-05-14T09:21:10.272731+0000","last_became_active":"2024-05-14T09:18:02.787030+0000","last_became_peered":"2024-05-14T09:18:02.787030+0000","last_unstale":"2024-05-14T09:21:10.272731+0000","last_undegraded":"2024-05-14T09:21:10.272731+0000","last_fullsized":"2024-05-14T09:21:10.272731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:02:57.521485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292854+0000","last_change":"2024-05-14T09:18:02.791714+0000","last_active":"2024-05-14T09:21:10.292854+0000","last_peered":"2024-05-14T09:21:10.292854+0000","last_clean":"2024-05-14T09:21:10.292854+0000","last_became_active":"2024-05-14T09:18:02.791184+0000","last_became_peered":"2024-05-14T09:18:02.791184+0000","last_unstale":"2024-05-14T09:21:10.292854+0000","last_undegraded":"2024-05-14T09:21:10.292854+0000","last_fullsized":"2024-05-14T09:21:10.292854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:55:03.943446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271112+0000","last_change":"2024-05-14T09:18:02.790270+0000","last_active":"2024-05-14T09:21:10.271112+0000","last_peered":"2024-05-14T09:21:10.271112+0000","last_clean":"2024-05-14T09:21:10.271112+0000","last_became_active":"2024-05-14T09:18:02.789845+0000","last_became_peered":"2024-05-14T09:18:02.789845+0000","last_unstale":"2024-05-14T09:21:10.271112+0000","last_undegraded":"2024-05-14T09:21:10.271112+0000","last_fullsized":"2024-05-14T09:21:10.271112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:10:43.469279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278395+0000","last_change":"2024-05-14T09:18:02.778122+0000","last_active":"2024-05-14T09:21:10.278395+0000","last_peered":"2024-05-14T09:21:10.278395+0000","last_clean":"2024-05-14T09:21:10.278395+0000","last_became_active":"2024-05-14T09:18:02.775013+0000","last_became_peered":"2024-05-14T09:18:02.775013+0000","last_unstale":"2024-05-14T09:21:10.278395+0000","last_undegraded":"2024-05-14T09:21:10.278395+0000","last_fullsized":"2024-05-14T09:21:10.278395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:49:35.138229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.266845+0000","last_change":"2024-05-14T09:18:41.667927+0000","last_active":"2024-05-14T09:21:10.266845+0000","last_peered":"2024-05-14T09:21:10.266845+0000","last_clean":"2024-05-14T09:21:10.266845+0000","last_became_active":"2024-05-14T09:18:41.667390+0000","last_became_peered":"2024-05-14T09:18:41.667390+0000","last_unstale":"2024-05-14T09:21:10.266845+0000","last_undegraded":"2024-05-14T09:21:10.266845+0000","last_fullsized":"2024-05-14T09:21:10.266845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:47.648872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291545+0000","last_change":"2024-05-14T09:18:02.794924+0000","last_active":"2024-05-14T09:21:10.291545+0000","last_peered":"2024-05-14T09:21:10.291545+0000","last_clean":"2024-05-14T09:21:10.291545+0000","last_became_active":"2024-05-14T09:18:02.794505+0000","last_became_peered":"2024-05-14T09:18:02.794505+0000","last_unstale":"2024-05-14T09:21:10.291545+0000","last_undegraded":"2024-05-14T09:21:10.291545+0000","last_fullsized":"2024-05-14T09:21:10.291545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:39.150209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289384+0000","last_change":"2024-05-14T09:18:02.781514+0000","last_active":"2024-05-14T09:21:10.289384+0000","last_peered":"2024-05-14T09:21:10.289384+0000","last_clean":"2024-05-14T09:21:10.289384+0000","last_became_active":"2024-05-14T09:18:02.779948+0000","last_became_peered":"2024-05-14T09:18:02.779948+0000","last_unstale":"2024-05-14T09:21:10.289384+0000","last_undegraded":"2024-05-14T09:21:10.289384+0000","last_fullsized":"2024-05-14T09:21:10.289384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:25.125018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284228+0000","last_change":"2024-05-14T09:18:02.785558+0000","last_active":"2024-05-14T09:21:10.284228+0000","last_peered":"2024-05-14T09:21:10.284228+0000","last_clean":"2024-05-14T09:21:10.284228+0000","last_became_active":"2024-05-14T09:18:02.785086+0000","last_became_peered":"2024-05-14T09:18:02.785086+0000","last_unstale":"2024-05-14T09:21:10.284228+0000","last_undegraded":"2024-05-14T09:21:10.284228+0000","last_fullsized":"2024-05-14T09:21:10.284228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:39:13.087341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":83196,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2364,"num_read_kb":1276,"num_write":285,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":249588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678101,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":519862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874331,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28724,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716428,"statfs":{"total":95995035648,"available":95965622272,"internally_reserved":0,"allocated":1748992,"data_stored":1183332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":518603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234090,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":518869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430321,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1117582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593849,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":515116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1118208,"data_stored":589416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738534,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":516572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411480,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":588946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149840,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":513815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953608,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":520289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790082,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1667072,"data_stored":1111678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":75561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:23:24.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T09:23:25.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 -- 172.21.15.120:0/4198177948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f8102960 msgr2=0x7f97f8103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 --2- 172.21.15.120:0/4198177948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f8102960 0x7f97f8103660 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009900 tx=0x7f97e802a410 comp rx=0 tx=0).stop 2024-05-14T09:23:25.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 -- 172.21.15.120:0/4198177948 shutdown_connections 2024-05-14T09:23:25.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 --2- 172.21.15.120:0/4198177948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f81088a0 0x7f97f810acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 --2- 172.21.15.120:0/4198177948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103ba0 0x7f97f8103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 --2- 172.21.15.120:0/4198177948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f8102960 0x7f97f8103660 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 -- 172.21.15.120:0/4198177948 >> 172.21.15.120:0/4198177948 conn(0x7f97f80fdb50 msgr2=0x7f97f8100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:25.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 -- 172.21.15.120:0/4198177948 shutdown_connections 2024-05-14T09:23:25.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.197+0000 7f97fd000640 1 -- 172.21.15.120:0/4198177948 wait complete. 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.198+0000 7f97fd000640 1 Processor -- start 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97fd000640 1 -- start start 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97fd000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f8102960 0x7f97f819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97fd000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103ba0 0x7f97f819c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97fd000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f81088a0 0x7f97f81a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97fd000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f97f810f4a0 con 0x7f97f81088a0 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97fd000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97f810f320 con 0x7f97f8102960 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97fd000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97f810f620 con 0x7f97f8103ba0 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97f7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f81088a0 0x7f97f81a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97f7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f81088a0 0x7f97f81a37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38846/0 (socket says 172.21.15.120:38846) 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97f7e00640 1 -- 172.21.15.120:0/1592114734 learned_addr learned my addr 172.21.15.120:0/1592114734 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:25.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.199+0000 7f97f6a00640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103ba0 0x7f97f819c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97f7400640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f8102960 0x7f97f819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97f7e00640 1 -- 172.21.15.120:0/1592114734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103ba0 msgr2=0x7f97f819c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97f7e00640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103ba0 0x7f97f819c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97f7e00640 1 -- 172.21.15.120:0/1592114734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f8102960 msgr2=0x7f97f819c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97f7e00640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f8102960 0x7f97f819c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97f7e00640 1 -- 172.21.15.120:0/1592114734 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f81a3e10 con 0x7f97f81088a0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97f7e00640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f81088a0 0x7f97f81a37a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f97f000cad0 tx=0x7f97f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97efe00640 1 -- 172.21.15.120:0/1592114734 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f000ae20 con 0x7f97f81088a0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97efe00640 1 -- 172.21.15.120:0/1592114734 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97f0005020 con 0x7f97f81088a0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97efe00640 1 -- 172.21.15.120:0/1592114734 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f000f6b0 con 0x7f97f81088a0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f81a4100 con 0x7f97f81088a0 2024-05-14T09:23:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.200+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f81a4650 con 0x7f97f81088a0 2024-05-14T09:23:25.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.201+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f81a4910 con 0x7f97f81088a0 2024-05-14T09:23:25.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.204+0000 7f97efe00640 1 -- 172.21.15.120:0/1592114734 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f97f00051d0 con 0x7f97f81088a0 2024-05-14T09:23:25.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.205+0000 7f97efe00640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97dc0b2860 0x7f97dc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.205+0000 7f97efe00640 1 -- 172.21.15.120:0/1592114734 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f97f00e2a20 con 0x7f97f81088a0 2024-05-14T09:23:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.205+0000 7f97f7400640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97dc0b2860 0x7f97dc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.206+0000 7f97f7400640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97dc0b2860 0x7f97dc0b4d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97e802a930 tx=0x7f97e8005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:25.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.210+0000 7f97efe00640 1 -- 172.21.15.120:0/1592114734 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f97f0014030 con 0x7f97f81088a0 2024-05-14T09:23:25.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.413+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97f80ff860 con 0x7f97dc0b2860 2024-05-14T09:23:25.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.441+0000 7f97efe00640 1 -- 172.21.15.120:0/1592114734 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340607 (secure 0 0 0) 0x7f97f80ff860 con 0x7f97dc0b2860 2024-05-14T09:23:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:25.448 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-05-14T09:23:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.448+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97dc0b2860 msgr2=0x7f97dc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.448+0000 7f97fd000640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97dc0b2860 0x7f97dc0b4d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97e802a930 tx=0x7f97e8005720 comp rx=0 tx=0).stop 2024-05-14T09:23:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.448+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f81088a0 msgr2=0x7f97f81a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.448+0000 7f97fd000640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f81088a0 0x7f97f81a37a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f97f000cad0 tx=0x7f97f000cf90 comp rx=0 tx=0).stop 2024-05-14T09:23:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 shutdown_connections 2024-05-14T09:23:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f97dc0b2860 0x7f97dc0b4d70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97f81088a0 0x7f97f81a37a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103ba0 0x7f97f819c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 --2- 172.21.15.120:0/1592114734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f8102960 0x7f97f819c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 >> 172.21.15.120:0/1592114734 conn(0x7f97f80fdb50 msgr2=0x7f97f80fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 shutdown_connections 2024-05-14T09:23:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.449+0000 7f97fd000640 1 -- 172.21.15.120:0/1592114734 wait complete. 2024-05-14T09:23:25.478 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2024-05-14T09:23:24.437670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":673798,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2440,"num_read_kb":1340,"num_write":410,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":838,"ondisk_log_size":838,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363512,"kb_used_data":14360,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578312,"statfs":{"total":1151940427776,"available":1151568191488,"internally_reserved":0,"allocated":14704640,"data_stored":8214080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6699,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70,"num_write":21,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005703"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291473+0000","last_change":"2024-05-14T09:18:02.795124+0000","last_active":"2024-05-14T09:21:10.291473+0000","last_peered":"2024-05-14T09:21:10.291473+0000","last_clean":"2024-05-14T09:21:10.291473+0000","last_became_active":"2024-05-14T09:18:02.794129+0000","last_became_peered":"2024-05-14T09:18:02.794129+0000","last_unstale":"2024-05-14T09:21:10.291473+0000","last_undegraded":"2024-05-14T09:21:10.291473+0000","last_fullsized":"2024-05-14T09:21:10.291473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:54.875120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284697+0000","last_change":"2024-05-14T09:18:02.775506+0000","last_active":"2024-05-14T09:21:10.284697+0000","last_peered":"2024-05-14T09:21:10.284697+0000","last_clean":"2024-05-14T09:21:10.284697+0000","last_became_active":"2024-05-14T09:18:02.774491+0000","last_became_peered":"2024-05-14T09:18:02.774491+0000","last_unstale":"2024-05-14T09:21:10.284697+0000","last_undegraded":"2024-05-14T09:21:10.284697+0000","last_fullsized":"2024-05-14T09:21:10.284697+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:36:40.414254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293283+0000","last_change":"2024-05-14T09:18:02.792681+0000","last_active":"2024-05-14T09:21:10.293283+0000","last_peered":"2024-05-14T09:21:10.293283+0000","last_clean":"2024-05-14T09:21:10.293283+0000","last_became_active":"2024-05-14T09:18:02.791903+0000","last_became_peered":"2024-05-14T09:18:02.791903+0000","last_unstale":"2024-05-14T09:21:10.293283+0000","last_undegraded":"2024-05-14T09:21:10.293283+0000","last_fullsized":"2024-05-14T09:21:10.293283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:09:31.027641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271919+0000","last_change":"2024-05-14T09:18:41.667606+0000","last_active":"2024-05-14T09:21:10.271919+0000","last_peered":"2024-05-14T09:21:10.271919+0000","last_clean":"2024-05-14T09:21:10.271919+0000","last_became_active":"2024-05-14T09:18:41.666853+0000","last_became_peered":"2024-05-14T09:18:41.666853+0000","last_unstale":"2024-05-14T09:21:10.271919+0000","last_undegraded":"2024-05-14T09:21:10.271919+0000","last_fullsized":"2024-05-14T09:21:10.271919+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:13:40.719553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282389+0000","last_change":"2024-05-14T09:18:02.775383+0000","last_active":"2024-05-14T09:21:10.282389+0000","last_peered":"2024-05-14T09:21:10.282389+0000","last_clean":"2024-05-14T09:21:10.282389+0000","last_became_active":"2024-05-14T09:18:02.774694+0000","last_became_peered":"2024-05-14T09:18:02.774694+0000","last_unstale":"2024-05-14T09:21:10.282389+0000","last_undegraded":"2024-05-14T09:21:10.282389+0000","last_fullsized":"2024-05-14T09:21:10.282389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:47.289929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282164+0000","last_change":"2024-05-14T09:18:02.782178+0000","last_active":"2024-05-14T09:21:10.282164+0000","last_peered":"2024-05-14T09:21:10.282164+0000","last_clean":"2024-05-14T09:21:10.282164+0000","last_became_active":"2024-05-14T09:18:02.781714+0000","last_became_peered":"2024-05-14T09:18:02.781714+0000","last_unstale":"2024-05-14T09:21:10.282164+0000","last_undegraded":"2024-05-14T09:21:10.282164+0000","last_fullsized":"2024-05-14T09:21:10.282164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:43:02.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270677+0000","last_change":"2024-05-14T09:18:02.774434+0000","last_active":"2024-05-14T09:21:10.270677+0000","last_peered":"2024-05-14T09:21:10.270677+0000","last_clean":"2024-05-14T09:21:10.270677+0000","last_became_active":"2024-05-14T09:18:02.774054+0000","last_became_peered":"2024-05-14T09:18:02.774054+0000","last_unstale":"2024-05-14T09:21:10.270677+0000","last_undegraded":"2024-05-14T09:21:10.270677+0000","last_fullsized":"2024-05-14T09:21:10.270677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:10.640939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280964+0000","last_change":"2024-05-14T09:18:02.780444+0000","last_active":"2024-05-14T09:21:10.280964+0000","last_peered":"2024-05-14T09:21:10.280964+0000","last_clean":"2024-05-14T09:21:10.280964+0000","last_became_active":"2024-05-14T09:18:02.779992+0000","last_became_peered":"2024-05-14T09:18:02.779992+0000","last_unstale":"2024-05-14T09:21:10.280964+0000","last_undegraded":"2024-05-14T09:21:10.280964+0000","last_fullsized":"2024-05-14T09:21:10.280964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:32:14.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286957+0000","last_change":"2024-05-14T09:18:02.790247+0000","last_active":"2024-05-14T09:21:10.286957+0000","last_peered":"2024-05-14T09:21:10.286957+0000","last_clean":"2024-05-14T09:21:10.286957+0000","last_became_active":"2024-05-14T09:18:02.789293+0000","last_became_peered":"2024-05-14T09:18:02.789293+0000","last_unstale":"2024-05-14T09:21:10.286957+0000","last_undegraded":"2024-05-14T09:21:10.286957+0000","last_fullsized":"2024-05-14T09:21:10.286957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:01.939326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.285820+0000","last_change":"2024-05-14T09:18:02.785167+0000","last_active":"2024-05-14T09:21:10.285820+0000","last_peered":"2024-05-14T09:21:10.285820+0000","last_clean":"2024-05-14T09:21:10.285820+0000","last_became_active":"2024-05-14T09:18:02.784772+0000","last_became_peered":"2024-05-14T09:18:02.784772+0000","last_unstale":"2024-05-14T09:21:10.285820+0000","last_undegraded":"2024-05-14T09:21:10.285820+0000","last_fullsized":"2024-05-14T09:21:10.285820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:06.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291103+0000","last_change":"2024-05-14T09:18:02.793000+0000","last_active":"2024-05-14T09:21:10.291103+0000","last_peered":"2024-05-14T09:21:10.291103+0000","last_clean":"2024-05-14T09:21:10.291103+0000","last_became_active":"2024-05-14T09:18:02.791895+0000","last_became_peered":"2024-05-14T09:18:02.791895+0000","last_unstale":"2024-05-14T09:21:10.291103+0000","last_undegraded":"2024-05-14T09:21:10.291103+0000","last_fullsized":"2024-05-14T09:21:10.291103+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:17.313383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279354+0000","last_change":"2024-05-14T09:18:02.776309+0000","last_active":"2024-05-14T09:21:10.279354+0000","last_peered":"2024-05-14T09:21:10.279354+0000","last_clean":"2024-05-14T09:21:10.279354+0000","last_became_active":"2024-05-14T09:18:02.769218+0000","last_became_peered":"2024-05-14T09:18:02.769218+0000","last_unstale":"2024-05-14T09:21:10.279354+0000","last_undegraded":"2024-05-14T09:21:10.279354+0000","last_fullsized":"2024-05-14T09:21:10.279354+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:54.793852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.288319+0000","last_change":"2024-05-14T09:18:41.667109+0000","last_active":"2024-05-14T09:21:10.288319+0000","last_peered":"2024-05-14T09:21:10.288319+0000","last_clean":"2024-05-14T09:21:10.288319+0000","last_became_active":"2024-05-14T09:18:41.666437+0000","last_became_peered":"2024-05-14T09:18:41.666437+0000","last_unstale":"2024-05-14T09:21:10.288319+0000","last_undegraded":"2024-05-14T09:21:10.288319+0000","last_fullsized":"2024-05-14T09:21:10.288319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:14.806924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284390+0000","last_change":"2024-05-14T09:18:02.777380+0000","last_active":"2024-05-14T09:21:10.284390+0000","last_peered":"2024-05-14T09:21:10.284390+0000","last_clean":"2024-05-14T09:21:10.284390+0000","last_became_active":"2024-05-14T09:18:02.777035+0000","last_became_peered":"2024-05-14T09:18:02.777035+0000","last_unstale":"2024-05-14T09:21:10.284390+0000","last_undegraded":"2024-05-14T09:21:10.284390+0000","last_fullsized":"2024-05-14T09:21:10.284390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:56.906077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291563+0000","last_change":"2024-05-14T09:18:02.784577+0000","last_active":"2024-05-14T09:21:10.291563+0000","last_peered":"2024-05-14T09:21:10.291563+0000","last_clean":"2024-05-14T09:21:10.291563+0000","last_became_active":"2024-05-14T09:18:02.784185+0000","last_became_peered":"2024-05-14T09:18:02.784185+0000","last_unstale":"2024-05-14T09:21:10.291563+0000","last_undegraded":"2024-05-14T09:21:10.291563+0000","last_fullsized":"2024-05-14T09:21:10.291563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:44:38.518861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292676+0000","last_change":"2024-05-14T09:18:02.783262+0000","last_active":"2024-05-14T09:21:10.292676+0000","last_peered":"2024-05-14T09:21:10.292676+0000","last_clean":"2024-05-14T09:21:10.292676+0000","last_became_active":"2024-05-14T09:18:02.780405+0000","last_became_peered":"2024-05-14T09:18:02.780405+0000","last_unstale":"2024-05-14T09:21:10.292676+0000","last_undegraded":"2024-05-14T09:21:10.292676+0000","last_fullsized":"2024-05-14T09:21:10.292676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:01:50.437966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291477+0000","last_change":"2024-05-14T09:18:02.789155+0000","last_active":"2024-05-14T09:21:10.291477+0000","last_peered":"2024-05-14T09:21:10.291477+0000","last_clean":"2024-05-14T09:21:10.291477+0000","last_became_active":"2024-05-14T09:18:02.788703+0000","last_became_peered":"2024-05-14T09:18:02.788703+0000","last_unstale":"2024-05-14T09:21:10.291477+0000","last_undegraded":"2024-05-14T09:21:10.291477+0000","last_fullsized":"2024-05-14T09:21:10.291477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:27:18.593797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293682+0000","last_change":"2024-05-14T09:18:02.788856+0000","last_active":"2024-05-14T09:21:10.293682+0000","last_peered":"2024-05-14T09:21:10.293682+0000","last_clean":"2024-05-14T09:21:10.293682+0000","last_became_active":"2024-05-14T09:18:02.788477+0000","last_became_peered":"2024-05-14T09:18:02.788477+0000","last_unstale":"2024-05-14T09:21:10.293682+0000","last_undegraded":"2024-05-14T09:21:10.293682+0000","last_fullsized":"2024-05-14T09:21:10.293682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:14:09.943568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278084+0000","last_change":"2024-05-14T09:18:02.781087+0000","last_active":"2024-05-14T09:21:10.278084+0000","last_peered":"2024-05-14T09:21:10.278084+0000","last_clean":"2024-05-14T09:21:10.278084+0000","last_became_active":"2024-05-14T09:18:02.780584+0000","last_became_peered":"2024-05-14T09:18:02.780584+0000","last_unstale":"2024-05-14T09:21:10.278084+0000","last_undegraded":"2024-05-14T09:21:10.278084+0000","last_fullsized":"2024-05-14T09:21:10.278084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:02:23.587235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:40.013591+0000","last_change":"2024-05-14T09:19:42.889482+0000","last_active":"2024-05-14T09:20:40.013591+0000","last_peered":"2024-05-14T09:20:40.013591+0000","last_clean":"2024-05-14T09:20:40.013591+0000","last_became_active":"2024-05-14T09:19:42.887316+0000","last_became_peered":"2024-05-14T09:19:42.887316+0000","last_unstale":"2024-05-14T09:20:40.013591+0000","last_undegraded":"2024-05-14T09:20:40.013591+0000","last_fullsized":"2024-05-14T09:20:40.013591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:13:44.778215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'15","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:21.677099+0000","last_change":"2024-05-14T09:17:57.708207+0000","last_active":"2024-05-14T09:23:21.677099+0000","last_peered":"2024-05-14T09:23:21.677099+0000","last_clean":"2024-05-14T09:23:21.677099+0000","last_became_active":"2024-05-14T09:17:57.707547+0000","last_became_peered":"2024-05-14T09:17:57.707547+0000","last_unstale":"2024-05-14T09:23:21.677099+0000","last_undegraded":"2024-05-14T09:23:21.677099+0000","last_fullsized":"2024-05-14T09:23:21.677099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.378254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271488+0000","last_change":"2024-05-14T09:18:02.782461+0000","last_active":"2024-05-14T09:21:10.271488+0000","last_peered":"2024-05-14T09:21:10.271488+0000","last_clean":"2024-05-14T09:21:10.271488+0000","last_became_active":"2024-05-14T09:18:02.781014+0000","last_became_peered":"2024-05-14T09:18:02.781014+0000","last_unstale":"2024-05-14T09:21:10.271488+0000","last_undegraded":"2024-05-14T09:21:10.271488+0000","last_fullsized":"2024-05-14T09:21:10.271488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:21:13.024727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:44.767239+0000","last_change":"2024-05-14T09:18:15.878163+0000","last_active":"2024-05-14T09:20:44.767239+0000","last_peered":"2024-05-14T09:20:44.767239+0000","last_clean":"2024-05-14T09:20:44.767239+0000","last_became_active":"2024-05-14T09:18:15.877097+0000","last_became_peered":"2024-05-14T09:18:15.877097+0000","last_unstale":"2024-05-14T09:20:44.767239+0000","last_undegraded":"2024-05-14T09:20:44.767239+0000","last_fullsized":"2024-05-14T09:20:44.767239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:59.570534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:57.408487+0000","last_change":"2024-05-14T09:17:57.773712+0000","last_active":"2024-05-14T09:19:57.408487+0000","last_peered":"2024-05-14T09:19:57.408487+0000","last_clean":"2024-05-14T09:19:57.408487+0000","last_became_active":"2024-05-14T09:17:57.772849+0000","last_became_peered":"2024-05-14T09:17:57.772849+0000","last_unstale":"2024-05-14T09:19:57.408487+0000","last_undegraded":"2024-05-14T09:19:57.408487+0000","last_fullsized":"2024-05-14T09:19:57.408487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:20.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293237+0000","last_change":"2024-05-14T09:18:02.790490+0000","last_active":"2024-05-14T09:21:10.293237+0000","last_peered":"2024-05-14T09:21:10.293237+0000","last_clean":"2024-05-14T09:21:10.293237+0000","last_became_active":"2024-05-14T09:18:02.790112+0000","last_became_peered":"2024-05-14T09:18:02.790112+0000","last_unstale":"2024-05-14T09:21:10.293237+0000","last_undegraded":"2024-05-14T09:21:10.293237+0000","last_fullsized":"2024-05-14T09:21:10.293237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:15.851585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:49.768321+0000","last_change":"2024-05-14T09:18:15.888894+0000","last_active":"2024-05-14T09:20:49.768321+0000","last_peered":"2024-05-14T09:20:49.768321+0000","last_clean":"2024-05-14T09:20:49.768321+0000","last_became_active":"2024-05-14T09:18:15.888327+0000","last_became_peered":"2024-05-14T09:18:15.888327+0000","last_unstale":"2024-05-14T09:20:49.768321+0000","last_undegraded":"2024-05-14T09:20:49.768321+0000","last_fullsized":"2024-05-14T09:20:49.768321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:13:19.871380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:29.573100+0000","last_change":"2024-05-14T09:17:57.717745+0000","last_active":"2024-05-14T09:20:29.573100+0000","last_peered":"2024-05-14T09:20:29.573100+0000","last_clean":"2024-05-14T09:20:29.573100+0000","last_became_active":"2024-05-14T09:17:57.716822+0000","last_became_peered":"2024-05-14T09:17:57.716822+0000","last_unstale":"2024-05-14T09:20:29.573100+0000","last_undegraded":"2024-05-14T09:20:29.573100+0000","last_fullsized":"2024-05-14T09:20:29.573100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:47:40.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292522+0000","last_change":"2024-05-14T09:18:02.788276+0000","last_active":"2024-05-14T09:21:10.292522+0000","last_peered":"2024-05-14T09:21:10.292522+0000","last_clean":"2024-05-14T09:21:10.292522+0000","last_became_active":"2024-05-14T09:18:02.787446+0000","last_became_peered":"2024-05-14T09:18:02.787446+0000","last_unstale":"2024-05-14T09:21:10.292522+0000","last_undegraded":"2024-05-14T09:21:10.292522+0000","last_fullsized":"2024-05-14T09:21:10.292522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:07:36.574378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:49.768281+0000","last_change":"2024-05-14T09:18:15.887824+0000","last_active":"2024-05-14T09:20:49.768281+0000","last_peered":"2024-05-14T09:20:49.768281+0000","last_clean":"2024-05-14T09:20:49.768281+0000","last_became_active":"2024-05-14T09:18:15.887152+0000","last_became_peered":"2024-05-14T09:18:15.887152+0000","last_unstale":"2024-05-14T09:20:49.768281+0000","last_undegraded":"2024-05-14T09:20:49.768281+0000","last_fullsized":"2024-05-14T09:20:49.768281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:54.778329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:29.573025+0000","last_change":"2024-05-14T09:17:57.717528+0000","last_active":"2024-05-14T09:20:29.573025+0000","last_peered":"2024-05-14T09:20:29.573025+0000","last_clean":"2024-05-14T09:20:29.573025+0000","last_became_active":"2024-05-14T09:17:57.716251+0000","last_became_peered":"2024-05-14T09:17:57.716251+0000","last_unstale":"2024-05-14T09:20:29.573025+0000","last_undegraded":"2024-05-14T09:20:29.573025+0000","last_fullsized":"2024-05-14T09:20:29.573025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:29:08.080292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290619+0000","last_change":"2024-05-14T09:18:02.790132+0000","last_active":"2024-05-14T09:21:10.290619+0000","last_peered":"2024-05-14T09:21:10.290619+0000","last_clean":"2024-05-14T09:21:10.290619+0000","last_became_active":"2024-05-14T09:18:02.789461+0000","last_became_peered":"2024-05-14T09:18:02.789461+0000","last_unstale":"2024-05-14T09:21:10.290619+0000","last_undegraded":"2024-05-14T09:21:10.290619+0000","last_fullsized":"2024-05-14T09:21:10.290619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:36:55.261959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:45.014800+0000","last_change":"2024-05-14T09:18:15.893674+0000","last_active":"2024-05-14T09:20:45.014800+0000","last_peered":"2024-05-14T09:20:45.014800+0000","last_clean":"2024-05-14T09:20:45.014800+0000","last_became_active":"2024-05-14T09:18:15.891857+0000","last_became_peered":"2024-05-14T09:18:15.891857+0000","last_unstale":"2024-05-14T09:20:45.014800+0000","last_undegraded":"2024-05-14T09:20:45.014800+0000","last_fullsized":"2024-05-14T09:20:45.014800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:14:55.020773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":296,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:20.728045+0000","last_change":"2024-05-14T09:18:41.982086+0000","last_active":"2024-05-14T09:23:20.728045+0000","last_peered":"2024-05-14T09:23:20.728045+0000","last_clean":"2024-05-14T09:23:20.728045+0000","last_became_active":"2024-05-14T09:18:41.981103+0000","last_became_peered":"2024-05-14T09:18:41.981103+0000","last_unstale":"2024-05-14T09:23:20.728045+0000","last_undegraded":"2024-05-14T09:23:20.728045+0000","last_fullsized":"2024-05-14T09:23:20.728045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:25:26.896681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.268707+0000","last_change":"2024-05-14T09:18:02.775834+0000","last_active":"2024-05-14T09:21:10.268707+0000","last_peered":"2024-05-14T09:21:10.268707+0000","last_clean":"2024-05-14T09:21:10.268707+0000","last_became_active":"2024-05-14T09:18:02.773708+0000","last_became_peered":"2024-05-14T09:18:02.773708+0000","last_unstale":"2024-05-14T09:21:10.268707+0000","last_undegraded":"2024-05-14T09:21:10.268707+0000","last_fullsized":"2024-05-14T09:21:10.268707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:00.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:45.014716+0000","last_change":"2024-05-14T09:19:42.899138+0000","last_active":"2024-05-14T09:20:45.014716+0000","last_peered":"2024-05-14T09:20:45.014716+0000","last_clean":"2024-05-14T09:20:45.014716+0000","last_became_active":"2024-05-14T09:19:42.897588+0000","last_became_peered":"2024-05-14T09:19:42.897588+0000","last_unstale":"2024-05-14T09:20:45.014716+0000","last_undegraded":"2024-05-14T09:20:45.014716+0000","last_fullsized":"2024-05-14T09:20:45.014716+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:13:05.760525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:30.522923+0000","last_change":"2024-05-14T09:18:42.326203+0000","last_active":"2024-05-14T09:20:30.522923+0000","last_peered":"2024-05-14T09:20:30.522923+0000","last_clean":"2024-05-14T09:20:30.522923+0000","last_became_active":"2024-05-14T09:18:42.324907+0000","last_became_peered":"2024-05-14T09:18:42.324907+0000","last_unstale":"2024-05-14T09:20:30.522923+0000","last_undegraded":"2024-05-14T09:20:30.522923+0000","last_fullsized":"2024-05-14T09:20:30.522923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:50.408706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274235+0000","last_change":"2024-05-14T09:18:41.669731+0000","last_active":"2024-05-14T09:21:10.274235+0000","last_peered":"2024-05-14T09:21:10.274235+0000","last_clean":"2024-05-14T09:21:10.274235+0000","last_became_active":"2024-05-14T09:18:41.667039+0000","last_became_peered":"2024-05-14T09:18:41.667039+0000","last_unstale":"2024-05-14T09:21:10.274235+0000","last_undegraded":"2024-05-14T09:21:10.274235+0000","last_fullsized":"2024-05-14T09:21:10.274235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:33:30.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.670641+0000","last_change":"2024-05-14T09:18:15.894314+0000","last_active":"2024-05-14T09:20:23.670641+0000","last_peered":"2024-05-14T09:20:23.670641+0000","last_clean":"2024-05-14T09:20:23.670641+0000","last_became_active":"2024-05-14T09:18:15.893173+0000","last_became_peered":"2024-05-14T09:18:15.893173+0000","last_unstale":"2024-05-14T09:20:23.670641+0000","last_undegraded":"2024-05-14T09:20:23.670641+0000","last_fullsized":"2024-05-14T09:20:23.670641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:19:25.467141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.081025+0000","last_change":"2024-05-14T09:17:57.704612+0000","last_active":"2024-05-14T09:20:23.081025+0000","last_peered":"2024-05-14T09:20:23.081025+0000","last_clean":"2024-05-14T09:20:23.081025+0000","last_became_active":"2024-05-14T09:17:57.703979+0000","last_became_peered":"2024-05-14T09:17:57.703979+0000","last_unstale":"2024-05-14T09:20:23.081025+0000","last_undegraded":"2024-05-14T09:20:23.081025+0000","last_fullsized":"2024-05-14T09:20:23.081025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:08.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281081+0000","last_change":"2024-05-14T09:18:02.774778+0000","last_active":"2024-05-14T09:21:10.281081+0000","last_peered":"2024-05-14T09:21:10.281081+0000","last_clean":"2024-05-14T09:21:10.281081+0000","last_became_active":"2024-05-14T09:18:02.774406+0000","last_became_peered":"2024-05-14T09:18:02.774406+0000","last_unstale":"2024-05-14T09:21:10.281081+0000","last_undegraded":"2024-05-14T09:21:10.281081+0000","last_fullsized":"2024-05-14T09:21:10.281081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.135221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:17.722558+0000","last_change":"2024-05-14T09:18:15.885921+0000","last_active":"2024-05-14T09:20:17.722558+0000","last_peered":"2024-05-14T09:20:17.722558+0000","last_clean":"2024-05-14T09:20:17.722558+0000","last_became_active":"2024-05-14T09:18:15.885261+0000","last_became_peered":"2024-05-14T09:18:15.885261+0000","last_unstale":"2024-05-14T09:20:17.722558+0000","last_undegraded":"2024-05-14T09:20:17.722558+0000","last_fullsized":"2024-05-14T09:20:17.722558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:57.438626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:21.830341+0000","last_change":"2024-05-14T09:17:57.714662+0000","last_active":"2024-05-14T09:20:21.830341+0000","last_peered":"2024-05-14T09:20:21.830341+0000","last_clean":"2024-05-14T09:20:21.830341+0000","last_became_active":"2024-05-14T09:17:57.714086+0000","last_became_peered":"2024-05-14T09:17:57.714086+0000","last_unstale":"2024-05-14T09:20:21.830341+0000","last_undegraded":"2024-05-14T09:20:21.830341+0000","last_fullsized":"2024-05-14T09:20:21.830341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:20.609634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281414+0000","last_change":"2024-05-14T09:18:02.767521+0000","last_active":"2024-05-14T09:21:10.281414+0000","last_peered":"2024-05-14T09:21:10.281414+0000","last_clean":"2024-05-14T09:21:10.281414+0000","last_became_active":"2024-05-14T09:18:02.767035+0000","last_became_peered":"2024-05-14T09:18:02.767035+0000","last_unstale":"2024-05-14T09:21:10.281414+0000","last_undegraded":"2024-05-14T09:21:10.281414+0000","last_fullsized":"2024-05-14T09:21:10.281414+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:00:30.251960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.416573+0000","last_change":"2024-05-14T09:18:15.890254+0000","last_active":"2024-05-14T09:20:37.416573+0000","last_peered":"2024-05-14T09:20:37.416573+0000","last_clean":"2024-05-14T09:20:37.416573+0000","last_became_active":"2024-05-14T09:18:15.887699+0000","last_became_peered":"2024-05-14T09:18:15.887699+0000","last_unstale":"2024-05-14T09:20:37.416573+0000","last_undegraded":"2024-05-14T09:20:37.416573+0000","last_fullsized":"2024-05-14T09:20:37.416573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:30:39.578671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'8","reported_seq":514,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:19.714270+0000","last_change":"2024-05-14T09:17:57.712559+0000","last_active":"2024-05-14T09:23:19.714270+0000","last_peered":"2024-05-14T09:23:19.714270+0000","last_clean":"2024-05-14T09:23:19.714270+0000","last_became_active":"2024-05-14T09:17:57.711265+0000","last_became_peered":"2024-05-14T09:17:57.711265+0000","last_unstale":"2024-05-14T09:23:19.714270+0000","last_undegraded":"2024-05-14T09:23:19.714270+0000","last_fullsized":"2024-05-14T09:23:19.714270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:37:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":460,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292233+0000","last_change":"2024-05-14T09:18:02.793657+0000","last_active":"2024-05-14T09:21:10.292233+0000","last_peered":"2024-05-14T09:21:10.292233+0000","last_clean":"2024-05-14T09:21:10.292233+0000","last_became_active":"2024-05-14T09:18:02.789550+0000","last_became_peered":"2024-05-14T09:18:02.789550+0000","last_unstale":"2024-05-14T09:21:10.292233+0000","last_undegraded":"2024-05-14T09:21:10.292233+0000","last_fullsized":"2024-05-14T09:21:10.292233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:31.933523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.831474+0000","last_change":"2024-05-14T09:18:15.877290+0000","last_active":"2024-05-14T09:20:37.831474+0000","last_peered":"2024-05-14T09:20:37.831474+0000","last_clean":"2024-05-14T09:20:37.831474+0000","last_became_active":"2024-05-14T09:18:15.874522+0000","last_became_peered":"2024-05-14T09:18:15.874522+0000","last_unstale":"2024-05-14T09:20:37.831474+0000","last_undegraded":"2024-05-14T09:20:37.831474+0000","last_fullsized":"2024-05-14T09:20:37.831474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:16.774709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:22.254948+0000","last_change":"2024-05-14T09:17:57.710407+0000","last_active":"2024-05-14T09:20:22.254948+0000","last_peered":"2024-05-14T09:20:22.254948+0000","last_clean":"2024-05-14T09:20:22.254948+0000","last_became_active":"2024-05-14T09:17:57.709776+0000","last_became_peered":"2024-05-14T09:17:57.709776+0000","last_unstale":"2024-05-14T09:20:22.254948+0000","last_undegraded":"2024-05-14T09:20:22.254948+0000","last_fullsized":"2024-05-14T09:20:22.254948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:28:04.838236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291060+0000","last_change":"2024-05-14T09:18:41.664954+0000","last_active":"2024-05-14T09:21:10.291060+0000","last_peered":"2024-05-14T09:21:10.291060+0000","last_clean":"2024-05-14T09:21:10.291060+0000","last_became_active":"2024-05-14T09:18:41.663825+0000","last_became_peered":"2024-05-14T09:18:41.663825+0000","last_unstale":"2024-05-14T09:21:10.291060+0000","last_undegraded":"2024-05-14T09:21:10.291060+0000","last_fullsized":"2024-05-14T09:21:10.291060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:50.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:39.766161+0000","last_change":"2024-05-14T09:18:15.882918+0000","last_active":"2024-05-14T09:20:39.766161+0000","last_peered":"2024-05-14T09:20:39.766161+0000","last_clean":"2024-05-14T09:20:39.766161+0000","last_became_active":"2024-05-14T09:18:15.880220+0000","last_became_peered":"2024-05-14T09:18:15.880220+0000","last_unstale":"2024-05-14T09:20:39.766161+0000","last_undegraded":"2024-05-14T09:20:39.766161+0000","last_fullsized":"2024-05-14T09:20:39.766161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:49.777319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:21.830568+0000","last_change":"2024-05-14T09:17:57.775417+0000","last_active":"2024-05-14T09:20:21.830568+0000","last_peered":"2024-05-14T09:20:21.830568+0000","last_clean":"2024-05-14T09:20:21.830568+0000","last_became_active":"2024-05-14T09:17:57.774362+0000","last_became_peered":"2024-05-14T09:17:57.774362+0000","last_unstale":"2024-05-14T09:20:21.830568+0000","last_undegraded":"2024-05-14T09:20:21.830568+0000","last_fullsized":"2024-05-14T09:20:21.830568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:27.320060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292752+0000","last_change":"2024-05-14T09:18:02.794096+0000","last_active":"2024-05-14T09:21:10.292752+0000","last_peered":"2024-05-14T09:21:10.292752+0000","last_clean":"2024-05-14T09:21:10.292752+0000","last_became_active":"2024-05-14T09:18:02.788361+0000","last_became_peered":"2024-05-14T09:18:02.788361+0000","last_unstale":"2024-05-14T09:21:10.292752+0000","last_undegraded":"2024-05-14T09:21:10.292752+0000","last_fullsized":"2024-05-14T09:21:10.292752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:41.485460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.831527+0000","last_change":"2024-05-14T09:18:15.886317+0000","last_active":"2024-05-14T09:20:37.831527+0000","last_peered":"2024-05-14T09:20:37.831527+0000","last_clean":"2024-05-14T09:20:37.831527+0000","last_became_active":"2024-05-14T09:18:15.885903+0000","last_became_peered":"2024-05-14T09:18:15.885903+0000","last_unstale":"2024-05-14T09:20:37.831527+0000","last_undegraded":"2024-05-14T09:20:37.831527+0000","last_fullsized":"2024-05-14T09:20:37.831527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:26:59.892672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'43","reported_seq":563,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:19.723160+0000","last_change":"2024-05-14T09:17:57.717013+0000","last_active":"2024-05-14T09:23:19.723160+0000","last_peered":"2024-05-14T09:23:19.723160+0000","last_clean":"2024-05-14T09:23:19.723160+0000","last_became_active":"2024-05-14T09:17:57.714552+0000","last_became_peered":"2024-05-14T09:17:57.714552+0000","last_unstale":"2024-05-14T09:23:19.723160+0000","last_undegraded":"2024-05-14T09:23:19.723160+0000","last_fullsized":"2024-05-14T09:23:19.723160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:16.042573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73270,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":310,"num_write":45,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262378+0000","last_change":"2024-05-14T09:18:02.782446+0000","last_active":"2024-05-14T09:21:10.262378+0000","last_peered":"2024-05-14T09:21:10.262378+0000","last_clean":"2024-05-14T09:21:10.262378+0000","last_became_active":"2024-05-14T09:18:02.779998+0000","last_became_peered":"2024-05-14T09:18:02.779998+0000","last_unstale":"2024-05-14T09:21:10.262378+0000","last_undegraded":"2024-05-14T09:21:10.262378+0000","last_fullsized":"2024-05-14T09:21:10.262378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:50.734227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:41.835136+0000","last_change":"2024-05-14T09:18:15.894372+0000","last_active":"2024-05-14T09:20:41.835136+0000","last_peered":"2024-05-14T09:20:41.835136+0000","last_clean":"2024-05-14T09:20:41.835136+0000","last_became_active":"2024-05-14T09:18:15.893842+0000","last_became_peered":"2024-05-14T09:18:15.893842+0000","last_unstale":"2024-05-14T09:20:41.835136+0000","last_undegraded":"2024-05-14T09:20:41.835136+0000","last_fullsized":"2024-05-14T09:20:41.835136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:57.675242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:03.679274+0000","last_change":"2024-05-14T09:18:41.675372+0000","last_active":"2024-05-14T09:21:03.679274+0000","last_peered":"2024-05-14T09:21:03.679274+0000","last_clean":"2024-05-14T09:21:03.679274+0000","last_became_active":"2024-05-14T09:18:41.659107+0000","last_became_peered":"2024-05-14T09:18:41.659107+0000","last_unstale":"2024-05-14T09:21:03.679274+0000","last_undegraded":"2024-05-14T09:21:03.679274+0000","last_fullsized":"2024-05-14T09:21:03.679274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:55:43.567929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280144+0000","last_change":"2024-05-14T09:18:02.780558+0000","last_active":"2024-05-14T09:21:10.280144+0000","last_peered":"2024-05-14T09:21:10.280144+0000","last_clean":"2024-05-14T09:21:10.280144+0000","last_became_active":"2024-05-14T09:18:02.779955+0000","last_became_peered":"2024-05-14T09:18:02.779955+0000","last_unstale":"2024-05-14T09:21:10.280144+0000","last_undegraded":"2024-05-14T09:21:10.280144+0000","last_fullsized":"2024-05-14T09:21:10.280144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:28:59.821879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:38.674219+0000","last_change":"2024-05-14T09:18:15.892207+0000","last_active":"2024-05-14T09:20:38.674219+0000","last_peered":"2024-05-14T09:20:38.674219+0000","last_clean":"2024-05-14T09:20:38.674219+0000","last_became_active":"2024-05-14T09:18:15.891646+0000","last_became_peered":"2024-05-14T09:18:15.891646+0000","last_unstale":"2024-05-14T09:20:38.674219+0000","last_undegraded":"2024-05-14T09:20:38.674219+0000","last_fullsized":"2024-05-14T09:20:38.674219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:06:48.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:16.829258+0000","last_change":"2024-05-14T09:17:57.717130+0000","last_active":"2024-05-14T09:20:16.829258+0000","last_peered":"2024-05-14T09:20:16.829258+0000","last_clean":"2024-05-14T09:20:16.829258+0000","last_became_active":"2024-05-14T09:17:57.716738+0000","last_became_peered":"2024-05-14T09:17:57.716738+0000","last_unstale":"2024-05-14T09:20:16.829258+0000","last_undegraded":"2024-05-14T09:20:16.829258+0000","last_fullsized":"2024-05-14T09:20:16.829258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:20:16.246789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286827+0000","last_change":"2024-05-14T09:18:02.783073+0000","last_active":"2024-05-14T09:21:10.286827+0000","last_peered":"2024-05-14T09:21:10.286827+0000","last_clean":"2024-05-14T09:21:10.286827+0000","last_became_active":"2024-05-14T09:18:02.782657+0000","last_became_peered":"2024-05-14T09:18:02.782657+0000","last_unstale":"2024-05-14T09:21:10.286827+0000","last_undegraded":"2024-05-14T09:21:10.286827+0000","last_fullsized":"2024-05-14T09:21:10.286827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:39:46.649875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:42.832376+0000","last_change":"2024-05-14T09:18:15.885231+0000","last_active":"2024-05-14T09:20:42.832376+0000","last_peered":"2024-05-14T09:20:42.832376+0000","last_clean":"2024-05-14T09:20:42.832376+0000","last_became_active":"2024-05-14T09:18:15.880199+0000","last_became_peered":"2024-05-14T09:18:15.880199+0000","last_unstale":"2024-05-14T09:20:42.832376+0000","last_undegraded":"2024-05-14T09:20:42.832376+0000","last_fullsized":"2024-05-14T09:20:42.832376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:10:22.707034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":284,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:18.704526+0000","last_change":"2024-05-14T09:17:57.718596+0000","last_active":"2024-05-14T09:23:18.704526+0000","last_peered":"2024-05-14T09:23:18.704526+0000","last_clean":"2024-05-14T09:23:18.704526+0000","last_became_active":"2024-05-14T09:17:57.717735+0000","last_became_peered":"2024-05-14T09:17:57.717735+0000","last_unstale":"2024-05-14T09:23:18.704526+0000","last_undegraded":"2024-05-14T09:23:18.704526+0000","last_fullsized":"2024-05-14T09:23:18.704526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:45.110512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.283343+0000","last_change":"2024-05-14T09:18:02.780222+0000","last_active":"2024-05-14T09:21:10.283343+0000","last_peered":"2024-05-14T09:21:10.283343+0000","last_clean":"2024-05-14T09:21:10.283343+0000","last_became_active":"2024-05-14T09:18:02.779842+0000","last_became_peered":"2024-05-14T09:18:02.779842+0000","last_unstale":"2024-05-14T09:21:10.283343+0000","last_undegraded":"2024-05-14T09:21:10.283343+0000","last_fullsized":"2024-05-14T09:21:10.283343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:46.726665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:43.084133+0000","last_change":"2024-05-14T09:18:15.885248+0000","last_active":"2024-05-14T09:20:43.084133+0000","last_peered":"2024-05-14T09:20:43.084133+0000","last_clean":"2024-05-14T09:20:43.084133+0000","last_became_active":"2024-05-14T09:18:15.884675+0000","last_became_peered":"2024-05-14T09:18:15.884675+0000","last_unstale":"2024-05-14T09:20:43.084133+0000","last_undegraded":"2024-05-14T09:20:43.084133+0000","last_fullsized":"2024-05-14T09:20:43.084133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:28:14.278141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:03.679217+0000","last_change":"2024-05-14T09:18:41.687983+0000","last_active":"2024-05-14T09:21:03.679217+0000","last_peered":"2024-05-14T09:21:03.679217+0000","last_clean":"2024-05-14T09:21:03.679217+0000","last_became_active":"2024-05-14T09:18:41.666942+0000","last_became_peered":"2024-05-14T09:18:41.666942+0000","last_unstale":"2024-05-14T09:21:03.679217+0000","last_undegraded":"2024-05-14T09:21:03.679217+0000","last_fullsized":"2024-05-14T09:21:03.679217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:38:24.183297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290079+0000","last_change":"2024-05-14T09:18:02.788509+0000","last_active":"2024-05-14T09:21:10.290079+0000","last_peered":"2024-05-14T09:21:10.290079+0000","last_clean":"2024-05-14T09:21:10.290079+0000","last_became_active":"2024-05-14T09:18:02.786886+0000","last_became_peered":"2024-05-14T09:18:02.786886+0000","last_unstale":"2024-05-14T09:21:10.290079+0000","last_undegraded":"2024-05-14T09:21:10.290079+0000","last_fullsized":"2024-05-14T09:21:10.290079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:29:38.765565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831719+0000","last_change":"2024-05-14T09:18:15.895299+0000","last_active":"2024-05-14T09:20:26.831719+0000","last_peered":"2024-05-14T09:20:26.831719+0000","last_clean":"2024-05-14T09:20:26.831719+0000","last_became_active":"2024-05-14T09:18:15.893663+0000","last_became_peered":"2024-05-14T09:18:15.893663+0000","last_unstale":"2024-05-14T09:20:26.831719+0000","last_undegraded":"2024-05-14T09:20:26.831719+0000","last_fullsized":"2024-05-14T09:20:26.831719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:58:24.950436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:22:29.597766+0000","last_change":"2024-05-14T09:17:57.710933+0000","last_active":"2024-05-14T09:22:29.597766+0000","last_peered":"2024-05-14T09:22:29.597766+0000","last_clean":"2024-05-14T09:22:29.597766+0000","last_became_active":"2024-05-14T09:17:57.710255+0000","last_became_peered":"2024-05-14T09:17:57.710255+0000","last_unstale":"2024-05-14T09:22:29.597766+0000","last_undegraded":"2024-05-14T09:22:29.597766+0000","last_fullsized":"2024-05-14T09:22:29.597766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:30.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277135+0000","last_change":"2024-05-14T09:18:02.781494+0000","last_active":"2024-05-14T09:21:10.277135+0000","last_peered":"2024-05-14T09:21:10.277135+0000","last_clean":"2024-05-14T09:21:10.277135+0000","last_became_active":"2024-05-14T09:18:02.781112+0000","last_became_peered":"2024-05-14T09:18:02.781112+0000","last_unstale":"2024-05-14T09:21:10.277135+0000","last_undegraded":"2024-05-14T09:21:10.277135+0000","last_fullsized":"2024-05-14T09:21:10.277135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:27.109538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:24.571869+0000","last_change":"2024-05-14T09:18:16.135447+0000","last_active":"2024-05-14T09:20:24.571869+0000","last_peered":"2024-05-14T09:20:24.571869+0000","last_clean":"2024-05-14T09:20:24.571869+0000","last_became_active":"2024-05-14T09:18:16.133770+0000","last_became_peered":"2024-05-14T09:18:16.133770+0000","last_unstale":"2024-05-14T09:20:24.571869+0000","last_undegraded":"2024-05-14T09:20:24.571869+0000","last_fullsized":"2024-05-14T09:20:24.571869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:29.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:02.824745+0000","last_change":"2024-05-14T09:17:57.776542+0000","last_active":"2024-05-14T09:20:02.824745+0000","last_peered":"2024-05-14T09:20:02.824745+0000","last_clean":"2024-05-14T09:20:02.824745+0000","last_became_active":"2024-05-14T09:17:57.775370+0000","last_became_peered":"2024-05-14T09:17:57.775370+0000","last_unstale":"2024-05-14T09:20:02.824745+0000","last_undegraded":"2024-05-14T09:20:02.824745+0000","last_fullsized":"2024-05-14T09:20:02.824745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:24.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280696+0000","last_change":"2024-05-14T09:18:02.776673+0000","last_active":"2024-05-14T09:21:10.280696+0000","last_peered":"2024-05-14T09:21:10.280696+0000","last_clean":"2024-05-14T09:21:10.280696+0000","last_became_active":"2024-05-14T09:18:02.776243+0000","last_became_peered":"2024-05-14T09:18:02.776243+0000","last_unstale":"2024-05-14T09:21:10.280696+0000","last_undegraded":"2024-05-14T09:21:10.280696+0000","last_fullsized":"2024-05-14T09:21:10.280696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:21.226977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.081080+0000","last_change":"2024-05-14T09:18:15.885039+0000","last_active":"2024-05-14T09:20:23.081080+0000","last_peered":"2024-05-14T09:20:23.081080+0000","last_clean":"2024-05-14T09:20:23.081080+0000","last_became_active":"2024-05-14T09:18:15.884466+0000","last_became_peered":"2024-05-14T09:18:15.884466+0000","last_unstale":"2024-05-14T09:20:23.081080+0000","last_undegraded":"2024-05-14T09:20:23.081080+0000","last_fullsized":"2024-05-14T09:20:23.081080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:12.000203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'8","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:20.675598+0000","last_change":"2024-05-14T09:17:57.712259+0000","last_active":"2024-05-14T09:23:20.675598+0000","last_peered":"2024-05-14T09:23:20.675598+0000","last_clean":"2024-05-14T09:23:20.675598+0000","last_became_active":"2024-05-14T09:17:57.711663+0000","last_became_peered":"2024-05-14T09:17:57.711663+0000","last_unstale":"2024-05-14T09:23:20.675598+0000","last_undegraded":"2024-05-14T09:23:20.675598+0000","last_fullsized":"2024-05-14T09:23:20.675598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:40:31.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291598+0000","last_change":"2024-05-14T09:18:02.783586+0000","last_active":"2024-05-14T09:21:10.291598+0000","last_peered":"2024-05-14T09:21:10.291598+0000","last_clean":"2024-05-14T09:21:10.291598+0000","last_became_active":"2024-05-14T09:18:02.783122+0000","last_became_peered":"2024-05-14T09:18:02.783122+0000","last_unstale":"2024-05-14T09:21:10.291598+0000","last_undegraded":"2024-05-14T09:21:10.291598+0000","last_fullsized":"2024-05-14T09:21:10.291598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:32:24.966064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:28.081683+0000","last_change":"2024-05-14T09:18:16.132825+0000","last_active":"2024-05-14T09:20:28.081683+0000","last_peered":"2024-05-14T09:20:28.081683+0000","last_clean":"2024-05-14T09:20:28.081683+0000","last_became_active":"2024-05-14T09:18:16.132155+0000","last_became_peered":"2024-05-14T09:18:16.132155+0000","last_unstale":"2024-05-14T09:20:28.081683+0000","last_undegraded":"2024-05-14T09:20:28.081683+0000","last_fullsized":"2024-05-14T09:20:28.081683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:43.579951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274056+0000","last_change":"2024-05-14T09:18:02.788407+0000","last_active":"2024-05-14T09:21:10.274056+0000","last_peered":"2024-05-14T09:21:10.274056+0000","last_clean":"2024-05-14T09:21:10.274056+0000","last_became_active":"2024-05-14T09:18:02.785934+0000","last_became_peered":"2024-05-14T09:18:02.785934+0000","last_unstale":"2024-05-14T09:21:10.274056+0000","last_undegraded":"2024-05-14T09:21:10.274056+0000","last_fullsized":"2024-05-14T09:21:10.274056+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":286,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:21.711598+0000","last_change":"2024-05-14T09:17:57.781016+0000","last_active":"2024-05-14T09:23:21.711598+0000","last_peered":"2024-05-14T09:23:21.711598+0000","last_clean":"2024-05-14T09:23:21.711598+0000","last_became_active":"2024-05-14T09:17:57.777442+0000","last_became_peered":"2024-05-14T09:17:57.777442+0000","last_unstale":"2024-05-14T09:23:21.711598+0000","last_undegraded":"2024-05-14T09:23:21.711598+0000","last_fullsized":"2024-05-14T09:23:21.711598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:17:06.992053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:22.254908+0000","last_change":"2024-05-14T09:18:15.891299+0000","last_active":"2024-05-14T09:20:22.254908+0000","last_peered":"2024-05-14T09:20:22.254908+0000","last_clean":"2024-05-14T09:20:22.254908+0000","last_became_active":"2024-05-14T09:18:15.890552+0000","last_became_peered":"2024-05-14T09:18:15.890552+0000","last_unstale":"2024-05-14T09:20:22.254908+0000","last_undegraded":"2024-05-14T09:20:22.254908+0000","last_fullsized":"2024-05-14T09:20:22.254908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:03:44.936117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292043+0000","last_change":"2024-05-14T09:18:02.793484+0000","last_active":"2024-05-14T09:21:10.292043+0000","last_peered":"2024-05-14T09:21:10.292043+0000","last_clean":"2024-05-14T09:21:10.292043+0000","last_became_active":"2024-05-14T09:18:02.792888+0000","last_became_peered":"2024-05-14T09:18:02.792888+0000","last_unstale":"2024-05-14T09:21:10.292043+0000","last_undegraded":"2024-05-14T09:21:10.292043+0000","last_fullsized":"2024-05-14T09:21:10.292043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:19.212025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:04.758799+0000","last_change":"2024-05-14T09:17:57.715271+0000","last_active":"2024-05-14T09:20:04.758799+0000","last_peered":"2024-05-14T09:20:04.758799+0000","last_clean":"2024-05-14T09:20:04.758799+0000","last_became_active":"2024-05-14T09:17:57.712524+0000","last_became_peered":"2024-05-14T09:17:57.712524+0000","last_unstale":"2024-05-14T09:20:04.758799+0000","last_undegraded":"2024-05-14T09:20:04.758799+0000","last_fullsized":"2024-05-14T09:20:04.758799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:39:46.868509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:12.252682+0000","last_change":"2024-05-14T09:16:01.832034+0000","last_active":"2024-05-14T09:20:12.252682+0000","last_peered":"2024-05-14T09:20:12.252682+0000","last_clean":"2024-05-14T09:20:12.252682+0000","last_became_active":"2024-05-14T09:16:01.815331+0000","last_became_peered":"2024-05-14T09:16:01.815331+0000","last_unstale":"2024-05-14T09:20:12.252682+0000","last_undegraded":"2024-05-14T09:20:12.252682+0000","last_fullsized":"2024-05-14T09:20:12.252682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_clean_scrub_stamp":"2024-05-14T09:11:00.916612+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:04:45.123827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831838+0000","last_change":"2024-05-14T09:18:16.136149+0000","last_active":"2024-05-14T09:20:26.831838+0000","last_peered":"2024-05-14T09:20:26.831838+0000","last_clean":"2024-05-14T09:20:26.831838+0000","last_became_active":"2024-05-14T09:18:16.134655+0000","last_became_peered":"2024-05-14T09:18:16.134655+0000","last_unstale":"2024-05-14T09:20:26.831838+0000","last_undegraded":"2024-05-14T09:20:26.831838+0000","last_fullsized":"2024-05-14T09:20:26.831838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:51.879763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274178+0000","last_change":"2024-05-14T09:18:02.791068+0000","last_active":"2024-05-14T09:21:10.274178+0000","last_peered":"2024-05-14T09:21:10.274178+0000","last_clean":"2024-05-14T09:21:10.274178+0000","last_became_active":"2024-05-14T09:18:02.785294+0000","last_became_peered":"2024-05-14T09:18:02.785294+0000","last_unstale":"2024-05-14T09:21:10.274178+0000","last_undegraded":"2024-05-14T09:21:10.274178+0000","last_fullsized":"2024-05-14T09:21:10.274178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:06:25.554475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:57.249555+0000","last_change":"2024-05-14T09:17:57.715272+0000","last_active":"2024-05-14T09:19:57.249555+0000","last_peered":"2024-05-14T09:19:57.249555+0000","last_clean":"2024-05-14T09:19:57.249555+0000","last_became_active":"2024-05-14T09:17:57.713504+0000","last_became_peered":"2024-05-14T09:17:57.713504+0000","last_unstale":"2024-05-14T09:19:57.249555+0000","last_undegraded":"2024-05-14T09:19:57.249555+0000","last_fullsized":"2024-05-14T09:19:57.249555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:27:26.071204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.670583+0000","last_change":"2024-05-14T09:18:15.893437+0000","last_active":"2024-05-14T09:20:23.670583+0000","last_peered":"2024-05-14T09:20:23.670583+0000","last_clean":"2024-05-14T09:20:23.670583+0000","last_became_active":"2024-05-14T09:18:15.890908+0000","last_became_peered":"2024-05-14T09:18:15.890908+0000","last_unstale":"2024-05-14T09:20:23.670583+0000","last_undegraded":"2024-05-14T09:20:23.670583+0000","last_fullsized":"2024-05-14T09:20:23.670583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:15.339562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:04.568011+0000","last_change":"2024-05-14T09:17:57.779601+0000","last_active":"2024-05-14T09:20:04.568011+0000","last_peered":"2024-05-14T09:20:04.568011+0000","last_clean":"2024-05-14T09:20:04.568011+0000","last_became_active":"2024-05-14T09:17:57.778730+0000","last_became_peered":"2024-05-14T09:17:57.778730+0000","last_unstale":"2024-05-14T09:20:04.568011+0000","last_undegraded":"2024-05-14T09:20:04.568011+0000","last_fullsized":"2024-05-14T09:20:04.568011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:01:07.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274698+0000","last_change":"2024-05-14T09:18:02.786283+0000","last_active":"2024-05-14T09:21:10.274698+0000","last_peered":"2024-05-14T09:21:10.274698+0000","last_clean":"2024-05-14T09:21:10.274698+0000","last_became_active":"2024-05-14T09:18:02.785158+0000","last_became_peered":"2024-05-14T09:18:02.785158+0000","last_unstale":"2024-05-14T09:21:10.274698+0000","last_undegraded":"2024-05-14T09:21:10.274698+0000","last_fullsized":"2024-05-14T09:21:10.274698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:28.804419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:17.412357+0000","last_change":"2024-05-14T09:18:16.133898+0000","last_active":"2024-05-14T09:20:17.412357+0000","last_peered":"2024-05-14T09:20:17.412357+0000","last_clean":"2024-05-14T09:20:17.412357+0000","last_became_active":"2024-05-14T09:18:16.132493+0000","last_became_peered":"2024-05-14T09:18:16.132493+0000","last_unstale":"2024-05-14T09:20:17.412357+0000","last_undegraded":"2024-05-14T09:20:17.412357+0000","last_fullsized":"2024-05-14T09:20:17.412357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:38:15.126883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'19","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:14.847618+0000","last_change":"2024-05-14T09:17:57.710000+0000","last_active":"2024-05-14T09:23:14.847618+0000","last_peered":"2024-05-14T09:23:14.847618+0000","last_clean":"2024-05-14T09:23:14.847618+0000","last_became_active":"2024-05-14T09:17:57.709546+0000","last_became_peered":"2024-05-14T09:17:57.709546+0000","last_unstale":"2024-05-14T09:23:14.847618+0000","last_undegraded":"2024-05-14T09:23:14.847618+0000","last_fullsized":"2024-05-14T09:23:14.847618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:09.681936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279023+0000","last_change":"2024-05-14T09:18:02.786342+0000","last_active":"2024-05-14T09:21:10.279023+0000","last_peered":"2024-05-14T09:21:10.279023+0000","last_clean":"2024-05-14T09:21:10.279023+0000","last_became_active":"2024-05-14T09:18:02.785981+0000","last_became_peered":"2024-05-14T09:18:02.785981+0000","last_unstale":"2024-05-14T09:21:10.279023+0000","last_undegraded":"2024-05-14T09:21:10.279023+0000","last_fullsized":"2024-05-14T09:21:10.279023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:59:43.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:20.009606+0000","last_change":"2024-05-14T09:18:15.882171+0000","last_active":"2024-05-14T09:20:20.009606+0000","last_peered":"2024-05-14T09:20:20.009606+0000","last_clean":"2024-05-14T09:20:20.009606+0000","last_became_active":"2024-05-14T09:18:15.881015+0000","last_became_peered":"2024-05-14T09:18:15.881015+0000","last_unstale":"2024-05-14T09:20:20.009606+0000","last_undegraded":"2024-05-14T09:20:20.009606+0000","last_fullsized":"2024-05-14T09:20:20.009606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:18.832868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:09.759495+0000","last_change":"2024-05-14T09:17:58.254067+0000","last_active":"2024-05-14T09:20:09.759495+0000","last_peered":"2024-05-14T09:20:09.759495+0000","last_clean":"2024-05-14T09:20:09.759495+0000","last_became_active":"2024-05-14T09:17:58.253140+0000","last_became_peered":"2024-05-14T09:17:58.253140+0000","last_unstale":"2024-05-14T09:20:09.759495+0000","last_undegraded":"2024-05-14T09:20:09.759495+0000","last_fullsized":"2024-05-14T09:20:09.759495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:20.263028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289930+0000","last_change":"2024-05-14T09:18:02.775968+0000","last_active":"2024-05-14T09:21:10.289930+0000","last_peered":"2024-05-14T09:21:10.289930+0000","last_clean":"2024-05-14T09:21:10.289930+0000","last_became_active":"2024-05-14T09:18:02.775639+0000","last_became_peered":"2024-05-14T09:18:02.775639+0000","last_unstale":"2024-05-14T09:21:10.289930+0000","last_undegraded":"2024-05-14T09:21:10.289930+0000","last_fullsized":"2024-05-14T09:21:10.289930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:27:52.179647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:34.765148+0000","last_change":"2024-05-14T09:18:16.139823+0000","last_active":"2024-05-14T09:20:34.765148+0000","last_peered":"2024-05-14T09:20:34.765148+0000","last_clean":"2024-05-14T09:20:34.765148+0000","last_became_active":"2024-05-14T09:18:16.138075+0000","last_became_peered":"2024-05-14T09:18:16.138075+0000","last_unstale":"2024-05-14T09:20:34.765148+0000","last_undegraded":"2024-05-14T09:20:34.765148+0000","last_fullsized":"2024-05-14T09:20:34.765148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:41.186678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:10.627966+0000","last_change":"2024-05-14T09:17:57.773751+0000","last_active":"2024-05-14T09:20:10.627966+0000","last_peered":"2024-05-14T09:20:10.627966+0000","last_clean":"2024-05-14T09:20:10.627966+0000","last_became_active":"2024-05-14T09:17:57.772964+0000","last_became_peered":"2024-05-14T09:17:57.772964+0000","last_unstale":"2024-05-14T09:20:10.627966+0000","last_undegraded":"2024-05-14T09:20:10.627966+0000","last_fullsized":"2024-05-14T09:20:10.627966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:08:01.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.265284+0000","last_change":"2024-05-14T09:18:02.774847+0000","last_active":"2024-05-14T09:21:10.265284+0000","last_peered":"2024-05-14T09:21:10.265284+0000","last_clean":"2024-05-14T09:21:10.265284+0000","last_became_active":"2024-05-14T09:18:02.774384+0000","last_became_peered":"2024-05-14T09:18:02.774384+0000","last_unstale":"2024-05-14T09:21:10.265284+0000","last_undegraded":"2024-05-14T09:21:10.265284+0000","last_fullsized":"2024-05-14T09:21:10.265284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:54:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:32.830622+0000","last_change":"2024-05-14T09:18:15.887656+0000","last_active":"2024-05-14T09:20:32.830622+0000","last_peered":"2024-05-14T09:20:32.830622+0000","last_clean":"2024-05-14T09:20:32.830622+0000","last_became_active":"2024-05-14T09:18:15.887203+0000","last_became_peered":"2024-05-14T09:18:15.887203+0000","last_unstale":"2024-05-14T09:20:32.830622+0000","last_undegraded":"2024-05-14T09:20:32.830622+0000","last_fullsized":"2024-05-14T09:20:32.830622+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:27.080959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:07.410488+0000","last_change":"2024-05-14T09:17:57.707511+0000","last_active":"2024-05-14T09:20:07.410488+0000","last_peered":"2024-05-14T09:20:07.410488+0000","last_clean":"2024-05-14T09:20:07.410488+0000","last_became_active":"2024-05-14T09:17:57.706706+0000","last_became_peered":"2024-05-14T09:17:57.706706+0000","last_unstale":"2024-05-14T09:20:07.410488+0000","last_undegraded":"2024-05-14T09:20:07.410488+0000","last_fullsized":"2024-05-14T09:20:07.410488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:25.325832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291212+0000","last_change":"2024-05-14T09:18:02.787800+0000","last_active":"2024-05-14T09:21:10.291212+0000","last_peered":"2024-05-14T09:21:10.291212+0000","last_clean":"2024-05-14T09:21:10.291212+0000","last_became_active":"2024-05-14T09:18:02.785115+0000","last_became_peered":"2024-05-14T09:18:02.785115+0000","last_unstale":"2024-05-14T09:21:10.291212+0000","last_undegraded":"2024-05-14T09:21:10.291212+0000","last_fullsized":"2024-05-14T09:21:10.291212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:23.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:33.294146+0000","last_change":"2024-05-14T09:19:42.898356+0000","last_active":"2024-05-14T09:20:33.294146+0000","last_peered":"2024-05-14T09:20:33.294146+0000","last_clean":"2024-05-14T09:20:33.294146+0000","last_became_active":"2024-05-14T09:19:42.896256+0000","last_became_peered":"2024-05-14T09:19:42.896256+0000","last_unstale":"2024-05-14T09:20:33.294146+0000","last_undegraded":"2024-05-14T09:20:33.294146+0000","last_fullsized":"2024-05-14T09:20:33.294146+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:59:09.389588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:14.961672+0000","last_change":"2024-05-14T09:17:57.710472+0000","last_active":"2024-05-14T09:23:14.961672+0000","last_peered":"2024-05-14T09:23:14.961672+0000","last_clean":"2024-05-14T09:23:14.961672+0000","last_became_active":"2024-05-14T09:17:57.710056+0000","last_became_peered":"2024-05-14T09:17:57.710056+0000","last_unstale":"2024-05-14T09:23:14.961672+0000","last_undegraded":"2024-05-14T09:23:14.961672+0000","last_fullsized":"2024-05-14T09:23:14.961672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:45.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282551+0000","last_change":"2024-05-14T09:18:02.779982+0000","last_active":"2024-05-14T09:21:10.282551+0000","last_peered":"2024-05-14T09:21:10.282551+0000","last_clean":"2024-05-14T09:21:10.282551+0000","last_became_active":"2024-05-14T09:18:02.779595+0000","last_became_peered":"2024-05-14T09:18:02.779595+0000","last_unstale":"2024-05-14T09:21:10.282551+0000","last_undegraded":"2024-05-14T09:21:10.282551+0000","last_fullsized":"2024-05-14T09:21:10.282551+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:06.520980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:33.294204+0000","last_change":"2024-05-14T09:18:16.137850+0000","last_active":"2024-05-14T09:20:33.294204+0000","last_peered":"2024-05-14T09:20:33.294204+0000","last_clean":"2024-05-14T09:20:33.294204+0000","last_became_active":"2024-05-14T09:18:16.135097+0000","last_became_peered":"2024-05-14T09:18:16.135097+0000","last_unstale":"2024-05-14T09:20:33.294204+0000","last_undegraded":"2024-05-14T09:20:33.294204+0000","last_fullsized":"2024-05-14T09:20:33.294204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:29:09.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:14.569955+0000","last_change":"2024-05-14T09:17:57.720232+0000","last_active":"2024-05-14T09:20:14.569955+0000","last_peered":"2024-05-14T09:20:14.569955+0000","last_clean":"2024-05-14T09:20:14.569955+0000","last_became_active":"2024-05-14T09:17:57.719057+0000","last_became_peered":"2024-05-14T09:17:57.719057+0000","last_unstale":"2024-05-14T09:20:14.569955+0000","last_undegraded":"2024-05-14T09:20:14.569955+0000","last_fullsized":"2024-05-14T09:20:14.569955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:34.378868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292344+0000","last_change":"2024-05-14T09:18:02.788106+0000","last_active":"2024-05-14T09:21:10.292344+0000","last_peered":"2024-05-14T09:21:10.292344+0000","last_clean":"2024-05-14T09:21:10.292344+0000","last_became_active":"2024-05-14T09:18:02.787631+0000","last_became_peered":"2024-05-14T09:18:02.787631+0000","last_unstale":"2024-05-14T09:21:10.292344+0000","last_undegraded":"2024-05-14T09:21:10.292344+0000","last_fullsized":"2024-05-14T09:21:10.292344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:59:45.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:25.631142+0000","last_change":"2024-05-14T09:18:15.889654+0000","last_active":"2024-05-14T09:20:25.631142+0000","last_peered":"2024-05-14T09:20:25.631142+0000","last_clean":"2024-05-14T09:20:25.631142+0000","last_became_active":"2024-05-14T09:18:15.888915+0000","last_became_peered":"2024-05-14T09:18:15.888915+0000","last_unstale":"2024-05-14T09:20:25.631142+0000","last_undegraded":"2024-05-14T09:20:25.631142+0000","last_fullsized":"2024-05-14T09:20:25.631142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:52:27.127246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'8","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:18.712839+0000","last_change":"2024-05-14T09:17:58.253945+0000","last_active":"2024-05-14T09:23:18.712839+0000","last_peered":"2024-05-14T09:23:18.712839+0000","last_clean":"2024-05-14T09:23:18.712839+0000","last_became_active":"2024-05-14T09:17:58.252807+0000","last_became_peered":"2024-05-14T09:17:58.252807+0000","last_unstale":"2024-05-14T09:23:18.712839+0000","last_undegraded":"2024-05-14T09:23:18.712839+0000","last_fullsized":"2024-05-14T09:23:18.712839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:56:52.853589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291593+0000","last_change":"2024-05-14T09:18:02.792743+0000","last_active":"2024-05-14T09:21:10.291593+0000","last_peered":"2024-05-14T09:21:10.291593+0000","last_clean":"2024-05-14T09:21:10.291593+0000","last_became_active":"2024-05-14T09:18:02.792371+0000","last_became_peered":"2024-05-14T09:18:02.792371+0000","last_unstale":"2024-05-14T09:21:10.291593+0000","last_undegraded":"2024-05-14T09:21:10.291593+0000","last_fullsized":"2024-05-14T09:21:10.291593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:10:00.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:32.725951+0000","last_change":"2024-05-14T09:18:15.884104+0000","last_active":"2024-05-14T09:20:32.725951+0000","last_peered":"2024-05-14T09:20:32.725951+0000","last_clean":"2024-05-14T09:20:32.725951+0000","last_became_active":"2024-05-14T09:18:15.881737+0000","last_became_peered":"2024-05-14T09:18:15.881737+0000","last_unstale":"2024-05-14T09:20:32.725951+0000","last_undegraded":"2024-05-14T09:20:32.725951+0000","last_fullsized":"2024-05-14T09:20:32.725951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:27:57.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:11.828210+0000","last_change":"2024-05-14T09:17:57.717776+0000","last_active":"2024-05-14T09:20:11.828210+0000","last_peered":"2024-05-14T09:20:11.828210+0000","last_clean":"2024-05-14T09:20:11.828210+0000","last_became_active":"2024-05-14T09:17:57.717338+0000","last_became_peered":"2024-05-14T09:17:57.717338+0000","last_unstale":"2024-05-14T09:20:11.828210+0000","last_undegraded":"2024-05-14T09:20:11.828210+0000","last_fullsized":"2024-05-14T09:20:11.828210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:38.441355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270936+0000","last_change":"2024-05-14T09:18:02.786286+0000","last_active":"2024-05-14T09:21:10.270936+0000","last_peered":"2024-05-14T09:21:10.270936+0000","last_clean":"2024-05-14T09:21:10.270936+0000","last_became_active":"2024-05-14T09:18:02.785915+0000","last_became_peered":"2024-05-14T09:18:02.785915+0000","last_unstale":"2024-05-14T09:21:10.270936+0000","last_undegraded":"2024-05-14T09:21:10.270936+0000","last_fullsized":"2024-05-14T09:21:10.270936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:54:08.960145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831575+0000","last_change":"2024-05-14T09:18:15.889692+0000","last_active":"2024-05-14T09:20:26.831575+0000","last_peered":"2024-05-14T09:20:26.831575+0000","last_clean":"2024-05-14T09:20:26.831575+0000","last_became_active":"2024-05-14T09:18:15.888675+0000","last_became_peered":"2024-05-14T09:18:15.888675+0000","last_unstale":"2024-05-14T09:20:26.831575+0000","last_undegraded":"2024-05-14T09:20:26.831575+0000","last_fullsized":"2024-05-14T09:20:26.831575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:11:20.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:13.079415+0000","last_change":"2024-05-14T09:17:57.694782+0000","last_active":"2024-05-14T09:20:13.079415+0000","last_peered":"2024-05-14T09:20:13.079415+0000","last_clean":"2024-05-14T09:20:13.079415+0000","last_became_active":"2024-05-14T09:17:57.693913+0000","last_became_peered":"2024-05-14T09:17:57.693913+0000","last_unstale":"2024-05-14T09:20:13.079415+0000","last_undegraded":"2024-05-14T09:20:13.079415+0000","last_fullsized":"2024-05-14T09:20:13.079415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:36:10.758138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280445+0000","last_change":"2024-05-14T09:18:02.784340+0000","last_active":"2024-05-14T09:21:10.280445+0000","last_peered":"2024-05-14T09:21:10.280445+0000","last_clean":"2024-05-14T09:21:10.280445+0000","last_became_active":"2024-05-14T09:18:02.783905+0000","last_became_peered":"2024-05-14T09:18:02.783905+0000","last_unstale":"2024-05-14T09:21:10.280445+0000","last_undegraded":"2024-05-14T09:21:10.280445+0000","last_fullsized":"2024-05-14T09:21:10.280445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:57:57.219324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.275048+0000","last_change":"2024-05-14T09:18:02.789214+0000","last_active":"2024-05-14T09:21:10.275048+0000","last_peered":"2024-05-14T09:21:10.275048+0000","last_clean":"2024-05-14T09:21:10.275048+0000","last_became_active":"2024-05-14T09:18:02.788764+0000","last_became_peered":"2024-05-14T09:18:02.788764+0000","last_unstale":"2024-05-14T09:21:10.275048+0000","last_undegraded":"2024-05-14T09:21:10.275048+0000","last_fullsized":"2024-05-14T09:21:10.275048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:13.665828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277543+0000","last_change":"2024-05-14T09:18:02.782255+0000","last_active":"2024-05-14T09:21:10.277543+0000","last_peered":"2024-05-14T09:21:10.277543+0000","last_clean":"2024-05-14T09:21:10.277543+0000","last_became_active":"2024-05-14T09:18:02.781817+0000","last_became_peered":"2024-05-14T09:18:02.781817+0000","last_unstale":"2024-05-14T09:21:10.277543+0000","last_undegraded":"2024-05-14T09:21:10.277543+0000","last_fullsized":"2024-05-14T09:21:10.277543+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:56:31.544934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.267934+0000","last_change":"2024-05-14T09:18:02.781737+0000","last_active":"2024-05-14T09:21:10.267934+0000","last_peered":"2024-05-14T09:21:10.267934+0000","last_clean":"2024-05-14T09:21:10.267934+0000","last_became_active":"2024-05-14T09:18:02.778429+0000","last_became_peered":"2024-05-14T09:18:02.778429+0000","last_unstale":"2024-05-14T09:21:10.267934+0000","last_undegraded":"2024-05-14T09:21:10.267934+0000","last_fullsized":"2024-05-14T09:21:10.267934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:52.699915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290185+0000","last_change":"2024-05-14T09:18:02.787107+0000","last_active":"2024-05-14T09:21:10.290185+0000","last_peered":"2024-05-14T09:21:10.290185+0000","last_clean":"2024-05-14T09:21:10.290185+0000","last_became_active":"2024-05-14T09:18:02.786259+0000","last_became_peered":"2024-05-14T09:18:02.786259+0000","last_unstale":"2024-05-14T09:21:10.290185+0000","last_undegraded":"2024-05-14T09:21:10.290185+0000","last_fullsized":"2024-05-14T09:21:10.290185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:50.103862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.287907+0000","last_change":"2024-05-14T09:18:02.792086+0000","last_active":"2024-05-14T09:21:10.287907+0000","last_peered":"2024-05-14T09:21:10.287907+0000","last_clean":"2024-05-14T09:21:10.287907+0000","last_became_active":"2024-05-14T09:18:02.785795+0000","last_became_peered":"2024-05-14T09:18:02.785795+0000","last_unstale":"2024-05-14T09:21:10.287907+0000","last_undegraded":"2024-05-14T09:21:10.287907+0000","last_fullsized":"2024-05-14T09:21:10.287907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:58.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.272731+0000","last_change":"2024-05-14T09:18:02.787934+0000","last_active":"2024-05-14T09:21:10.272731+0000","last_peered":"2024-05-14T09:21:10.272731+0000","last_clean":"2024-05-14T09:21:10.272731+0000","last_became_active":"2024-05-14T09:18:02.787030+0000","last_became_peered":"2024-05-14T09:18:02.787030+0000","last_unstale":"2024-05-14T09:21:10.272731+0000","last_undegraded":"2024-05-14T09:21:10.272731+0000","last_fullsized":"2024-05-14T09:21:10.272731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:02:57.521485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292854+0000","last_change":"2024-05-14T09:18:02.791714+0000","last_active":"2024-05-14T09:21:10.292854+0000","last_peered":"2024-05-14T09:21:10.292854+0000","last_clean":"2024-05-14T09:21:10.292854+0000","last_became_active":"2024-05-14T09:18:02.791184+0000","last_became_peered":"2024-05-14T09:18:02.791184+0000","last_unstale":"2024-05-14T09:21:10.292854+0000","last_undegraded":"2024-05-14T09:21:10.292854+0000","last_fullsized":"2024-05-14T09:21:10.292854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:55:03.943446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271112+0000","last_change":"2024-05-14T09:18:02.790270+0000","last_active":"2024-05-14T09:21:10.271112+0000","last_peered":"2024-05-14T09:21:10.271112+0000","last_clean":"2024-05-14T09:21:10.271112+0000","last_became_active":"2024-05-14T09:18:02.789845+0000","last_became_peered":"2024-05-14T09:18:02.789845+0000","last_unstale":"2024-05-14T09:21:10.271112+0000","last_undegraded":"2024-05-14T09:21:10.271112+0000","last_fullsized":"2024-05-14T09:21:10.271112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:10:43.469279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278395+0000","last_change":"2024-05-14T09:18:02.778122+0000","last_active":"2024-05-14T09:21:10.278395+0000","last_peered":"2024-05-14T09:21:10.278395+0000","last_clean":"2024-05-14T09:21:10.278395+0000","last_became_active":"2024-05-14T09:18:02.775013+0000","last_became_peered":"2024-05-14T09:18:02.775013+0000","last_unstale":"2024-05-14T09:21:10.278395+0000","last_undegraded":"2024-05-14T09:21:10.278395+0000","last_fullsized":"2024-05-14T09:21:10.278395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:49:35.138229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.266845+0000","last_change":"2024-05-14T09:18:41.667927+0000","last_active":"2024-05-14T09:21:10.266845+0000","last_peered":"2024-05-14T09:21:10.266845+0000","last_clean":"2024-05-14T09:21:10.266845+0000","last_became_active":"2024-05-14T09:18:41.667390+0000","last_became_peered":"2024-05-14T09:18:41.667390+0000","last_unstale":"2024-05-14T09:21:10.266845+0000","last_undegraded":"2024-05-14T09:21:10.266845+0000","last_fullsized":"2024-05-14T09:21:10.266845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:47.648872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291545+0000","last_change":"2024-05-14T09:18:02.794924+0000","last_active":"2024-05-14T09:21:10.291545+0000","last_peered":"2024-05-14T09:21:10.291545+0000","last_clean":"2024-05-14T09:21:10.291545+0000","last_became_active":"2024-05-14T09:18:02.794505+0000","last_became_peered":"2024-05-14T09:18:02.794505+0000","last_unstale":"2024-05-14T09:21:10.291545+0000","last_undegraded":"2024-05-14T09:21:10.291545+0000","last_fullsized":"2024-05-14T09:21:10.291545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:39.150209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289384+0000","last_change":"2024-05-14T09:18:02.781514+0000","last_active":"2024-05-14T09:21:10.289384+0000","last_peered":"2024-05-14T09:21:10.289384+0000","last_clean":"2024-05-14T09:21:10.289384+0000","last_became_active":"2024-05-14T09:18:02.779948+0000","last_became_peered":"2024-05-14T09:18:02.779948+0000","last_unstale":"2024-05-14T09:21:10.289384+0000","last_undegraded":"2024-05-14T09:21:10.289384+0000","last_fullsized":"2024-05-14T09:21:10.289384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:25.125018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284228+0000","last_change":"2024-05-14T09:18:02.785558+0000","last_active":"2024-05-14T09:21:10.284228+0000","last_peered":"2024-05-14T09:21:10.284228+0000","last_clean":"2024-05-14T09:21:10.284228+0000","last_became_active":"2024-05-14T09:18:02.785086+0000","last_became_peered":"2024-05-14T09:18:02.785086+0000","last_unstale":"2024-05-14T09:21:10.284228+0000","last_undegraded":"2024-05-14T09:21:10.284228+0000","last_fullsized":"2024-05-14T09:21:10.284228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:39:13.087341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":83196,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2364,"num_read_kb":1276,"num_write":285,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":249588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678101,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":519862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874331,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28724,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716428,"statfs":{"total":95995035648,"available":95965622272,"internally_reserved":0,"allocated":1748992,"data_stored":1183332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":518603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234090,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":518869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430321,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1117582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593849,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":515116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1118208,"data_stored":589416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738534,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":516572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411480,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":588946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149840,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":513815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953608,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":520289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790082,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1667072,"data_stored":1111678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":75561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:23:25.483 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-14T09:23:25.483 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 -- 172.21.15.120:0/3866384341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 msgr2=0x7fbf981092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 --2- 172.21.15.120:0/3866384341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf981092a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009900 tx=0x7fbf8402a410 comp rx=0 tx=0).stop 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 -- 172.21.15.120:0/3866384341 shutdown_connections 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 --2- 172.21.15.120:0/3866384341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf981097e0 0x7fbf9810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 --2- 172.21.15.120:0/3866384341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf981092a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 --2- 172.21.15.120:0/3866384341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf98104520 0x7fbf98106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 -- 172.21.15.120:0/3866384341 >> 172.21.15.120:0/3866384341 conn(0x7fbf980fdb20 msgr2=0x7fbf980fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 -- 172.21.15.120:0/3866384341 shutdown_connections 2024-05-14T09:23:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.795+0000 7fbf97200640 1 -- 172.21.15.120:0/3866384341 wait complete. 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.796+0000 7fbf97200640 1 Processor -- start 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.796+0000 7fbf97200640 1 -- start start 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf97200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98104520 0x7fbf9819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf97200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf9819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf97200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf981097e0 0x7fbf981a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf97200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810f440 con 0x7fbf98106e80 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf97200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810f2c0 con 0x7fbf98104520 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf97200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810f5c0 con 0x7fbf981097e0 2024-05-14T09:23:25.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf95400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf9819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf95400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf9819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38860/0 (socket says 172.21.15.120:38860) 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf95400640 1 -- 172.21.15.120:0/3101654122 learned_addr learned my addr 172.21.15.120:0/3101654122 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf95e00640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98104520 0x7fbf9819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.797+0000 7fbf96800640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf981097e0 0x7fbf981a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf95400640 1 -- 172.21.15.120:0/3101654122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf981097e0 msgr2=0x7fbf981a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf95400640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf981097e0 0x7fbf981a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf95400640 1 -- 172.21.15.120:0/3101654122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98104520 msgr2=0x7fbf9819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf95400640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98104520 0x7fbf9819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf95400640 1 -- 172.21.15.120:0/3101654122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf981a1bf0 con 0x7fbf98106e80 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf95e00640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98104520 0x7fbf9819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf95400640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf9819a5f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbf84005760 tx=0x7fbf84003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf8ea00640 1 -- 172.21.15.120:0/3101654122 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8403f070 con 0x7fbf98106e80 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf8ea00640 1 -- 172.21.15.120:0/3101654122 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf84031da0 con 0x7fbf98106e80 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf981a1e80 con 0x7fbf98106e80 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf8ea00640 1 -- 172.21.15.120:0/3101654122 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84035030 con 0x7fbf98106e80 2024-05-14T09:23:25.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.798+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981a2290 con 0x7fbf98106e80 2024-05-14T09:23:25.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.799+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf980ff640 con 0x7fbf98106e80 2024-05-14T09:23:25.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.802+0000 7fbf8ea00640 1 -- 172.21.15.120:0/3101654122 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fbf84042070 con 0x7fbf98106e80 2024-05-14T09:23:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.804+0000 7fbf8ea00640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf7c0b27e0 0x7fbf7c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.804+0000 7fbf8ea00640 1 -- 172.21.15.120:0/3101654122 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fbf84102ff0 con 0x7fbf98106e80 2024-05-14T09:23:25.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.804+0000 7fbf95e00640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf7c0b27e0 0x7fbf7c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:25.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.805+0000 7fbf95e00640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf7c0b27e0 0x7fbf7c0b4cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005d00 tx=0x7fbf88005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:25.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:25.809+0000 7fbf8ea00640 1 -- 172.21.15.120:0/3101654122 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbf840ca950 con 0x7fbf98106e80 2024-05-14T09:23:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:25 smithi120 ceph-mon[31085]: pgmap v552: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T09:23:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:25 smithi120 ceph-mon[31085]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:25 smithi152 ceph-mon[34868]: pgmap v552: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T09:23:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:25 smithi152 ceph-mon[34868]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:25 smithi175 ceph-mon[35353]: pgmap v552: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T09:23:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:25 smithi175 ceph-mon[35353]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:26.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.013+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 --> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf98063110 con 0x7fbf7c0b27e0 2024-05-14T09:23:26.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.025+0000 7fbf8ea00640 1 -- 172.21.15.120:0/3101654122 <== mgr.14152 v2:172.21.15.120:6800/197404993 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340607 (secure 0 0 0) 0x7fbf98063110 con 0x7fbf7c0b27e0 2024-05-14T09:23:26.030 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-05-14T09:23:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf7c0b27e0 msgr2=0x7fbf7c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf7c0b27e0 0x7fbf7c0b4cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005d00 tx=0x7fbf88005c70 comp rx=0 tx=0).stop 2024-05-14T09:23:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 msgr2=0x7fbf9819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf9819a5f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbf84005760 tx=0x7fbf84003d50 comp rx=0 tx=0).stop 2024-05-14T09:23:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 shutdown_connections 2024-05-14T09:23:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbf7c0b27e0 0x7fbf7c0b4cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf981097e0 0x7fbf981a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf98106e80 0x7fbf9819a5f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 --2- 172.21.15.120:0/3101654122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98104520 0x7fbf9819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 >> 172.21.15.120:0/3101654122 conn(0x7fbf980fdb20 msgr2=0x7fbf98105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 shutdown_connections 2024-05-14T09:23:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:26.032+0000 7fbf97200640 1 -- 172.21.15.120:0/3101654122 wait complete. 2024-05-14T09:23:26.060 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2024-05-14T09:23:24.437670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":673798,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2440,"num_read_kb":1340,"num_write":410,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":838,"ondisk_log_size":838,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363512,"kb_used_data":14360,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578312,"statfs":{"total":1151940427776,"available":1151568191488,"internally_reserved":0,"allocated":14704640,"data_stored":8214080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6699,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70,"num_write":21,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005703"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291473+0000","last_change":"2024-05-14T09:18:02.795124+0000","last_active":"2024-05-14T09:21:10.291473+0000","last_peered":"2024-05-14T09:21:10.291473+0000","last_clean":"2024-05-14T09:21:10.291473+0000","last_became_active":"2024-05-14T09:18:02.794129+0000","last_became_peered":"2024-05-14T09:18:02.794129+0000","last_unstale":"2024-05-14T09:21:10.291473+0000","last_undegraded":"2024-05-14T09:21:10.291473+0000","last_fullsized":"2024-05-14T09:21:10.291473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:54.875120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284697+0000","last_change":"2024-05-14T09:18:02.775506+0000","last_active":"2024-05-14T09:21:10.284697+0000","last_peered":"2024-05-14T09:21:10.284697+0000","last_clean":"2024-05-14T09:21:10.284697+0000","last_became_active":"2024-05-14T09:18:02.774491+0000","last_became_peered":"2024-05-14T09:18:02.774491+0000","last_unstale":"2024-05-14T09:21:10.284697+0000","last_undegraded":"2024-05-14T09:21:10.284697+0000","last_fullsized":"2024-05-14T09:21:10.284697+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:36:40.414254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293283+0000","last_change":"2024-05-14T09:18:02.792681+0000","last_active":"2024-05-14T09:21:10.293283+0000","last_peered":"2024-05-14T09:21:10.293283+0000","last_clean":"2024-05-14T09:21:10.293283+0000","last_became_active":"2024-05-14T09:18:02.791903+0000","last_became_peered":"2024-05-14T09:18:02.791903+0000","last_unstale":"2024-05-14T09:21:10.293283+0000","last_undegraded":"2024-05-14T09:21:10.293283+0000","last_fullsized":"2024-05-14T09:21:10.293283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:09:31.027641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271919+0000","last_change":"2024-05-14T09:18:41.667606+0000","last_active":"2024-05-14T09:21:10.271919+0000","last_peered":"2024-05-14T09:21:10.271919+0000","last_clean":"2024-05-14T09:21:10.271919+0000","last_became_active":"2024-05-14T09:18:41.666853+0000","last_became_peered":"2024-05-14T09:18:41.666853+0000","last_unstale":"2024-05-14T09:21:10.271919+0000","last_undegraded":"2024-05-14T09:21:10.271919+0000","last_fullsized":"2024-05-14T09:21:10.271919+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:13:40.719553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282389+0000","last_change":"2024-05-14T09:18:02.775383+0000","last_active":"2024-05-14T09:21:10.282389+0000","last_peered":"2024-05-14T09:21:10.282389+0000","last_clean":"2024-05-14T09:21:10.282389+0000","last_became_active":"2024-05-14T09:18:02.774694+0000","last_became_peered":"2024-05-14T09:18:02.774694+0000","last_unstale":"2024-05-14T09:21:10.282389+0000","last_undegraded":"2024-05-14T09:21:10.282389+0000","last_fullsized":"2024-05-14T09:21:10.282389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:47.289929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282164+0000","last_change":"2024-05-14T09:18:02.782178+0000","last_active":"2024-05-14T09:21:10.282164+0000","last_peered":"2024-05-14T09:21:10.282164+0000","last_clean":"2024-05-14T09:21:10.282164+0000","last_became_active":"2024-05-14T09:18:02.781714+0000","last_became_peered":"2024-05-14T09:18:02.781714+0000","last_unstale":"2024-05-14T09:21:10.282164+0000","last_undegraded":"2024-05-14T09:21:10.282164+0000","last_fullsized":"2024-05-14T09:21:10.282164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:43:02.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270677+0000","last_change":"2024-05-14T09:18:02.774434+0000","last_active":"2024-05-14T09:21:10.270677+0000","last_peered":"2024-05-14T09:21:10.270677+0000","last_clean":"2024-05-14T09:21:10.270677+0000","last_became_active":"2024-05-14T09:18:02.774054+0000","last_became_peered":"2024-05-14T09:18:02.774054+0000","last_unstale":"2024-05-14T09:21:10.270677+0000","last_undegraded":"2024-05-14T09:21:10.270677+0000","last_fullsized":"2024-05-14T09:21:10.270677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:10.640939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280964+0000","last_change":"2024-05-14T09:18:02.780444+0000","last_active":"2024-05-14T09:21:10.280964+0000","last_peered":"2024-05-14T09:21:10.280964+0000","last_clean":"2024-05-14T09:21:10.280964+0000","last_became_active":"2024-05-14T09:18:02.779992+0000","last_became_peered":"2024-05-14T09:18:02.779992+0000","last_unstale":"2024-05-14T09:21:10.280964+0000","last_undegraded":"2024-05-14T09:21:10.280964+0000","last_fullsized":"2024-05-14T09:21:10.280964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:32:14.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286957+0000","last_change":"2024-05-14T09:18:02.790247+0000","last_active":"2024-05-14T09:21:10.286957+0000","last_peered":"2024-05-14T09:21:10.286957+0000","last_clean":"2024-05-14T09:21:10.286957+0000","last_became_active":"2024-05-14T09:18:02.789293+0000","last_became_peered":"2024-05-14T09:18:02.789293+0000","last_unstale":"2024-05-14T09:21:10.286957+0000","last_undegraded":"2024-05-14T09:21:10.286957+0000","last_fullsized":"2024-05-14T09:21:10.286957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:01.939326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.285820+0000","last_change":"2024-05-14T09:18:02.785167+0000","last_active":"2024-05-14T09:21:10.285820+0000","last_peered":"2024-05-14T09:21:10.285820+0000","last_clean":"2024-05-14T09:21:10.285820+0000","last_became_active":"2024-05-14T09:18:02.784772+0000","last_became_peered":"2024-05-14T09:18:02.784772+0000","last_unstale":"2024-05-14T09:21:10.285820+0000","last_undegraded":"2024-05-14T09:21:10.285820+0000","last_fullsized":"2024-05-14T09:21:10.285820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:06.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291103+0000","last_change":"2024-05-14T09:18:02.793000+0000","last_active":"2024-05-14T09:21:10.291103+0000","last_peered":"2024-05-14T09:21:10.291103+0000","last_clean":"2024-05-14T09:21:10.291103+0000","last_became_active":"2024-05-14T09:18:02.791895+0000","last_became_peered":"2024-05-14T09:18:02.791895+0000","last_unstale":"2024-05-14T09:21:10.291103+0000","last_undegraded":"2024-05-14T09:21:10.291103+0000","last_fullsized":"2024-05-14T09:21:10.291103+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:05:17.313383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279354+0000","last_change":"2024-05-14T09:18:02.776309+0000","last_active":"2024-05-14T09:21:10.279354+0000","last_peered":"2024-05-14T09:21:10.279354+0000","last_clean":"2024-05-14T09:21:10.279354+0000","last_became_active":"2024-05-14T09:18:02.769218+0000","last_became_peered":"2024-05-14T09:18:02.769218+0000","last_unstale":"2024-05-14T09:21:10.279354+0000","last_undegraded":"2024-05-14T09:21:10.279354+0000","last_fullsized":"2024-05-14T09:21:10.279354+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:54.793852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.288319+0000","last_change":"2024-05-14T09:18:41.667109+0000","last_active":"2024-05-14T09:21:10.288319+0000","last_peered":"2024-05-14T09:21:10.288319+0000","last_clean":"2024-05-14T09:21:10.288319+0000","last_became_active":"2024-05-14T09:18:41.666437+0000","last_became_peered":"2024-05-14T09:18:41.666437+0000","last_unstale":"2024-05-14T09:21:10.288319+0000","last_undegraded":"2024-05-14T09:21:10.288319+0000","last_fullsized":"2024-05-14T09:21:10.288319+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:14.806924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284390+0000","last_change":"2024-05-14T09:18:02.777380+0000","last_active":"2024-05-14T09:21:10.284390+0000","last_peered":"2024-05-14T09:21:10.284390+0000","last_clean":"2024-05-14T09:21:10.284390+0000","last_became_active":"2024-05-14T09:18:02.777035+0000","last_became_peered":"2024-05-14T09:18:02.777035+0000","last_unstale":"2024-05-14T09:21:10.284390+0000","last_undegraded":"2024-05-14T09:21:10.284390+0000","last_fullsized":"2024-05-14T09:21:10.284390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:56.906077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291563+0000","last_change":"2024-05-14T09:18:02.784577+0000","last_active":"2024-05-14T09:21:10.291563+0000","last_peered":"2024-05-14T09:21:10.291563+0000","last_clean":"2024-05-14T09:21:10.291563+0000","last_became_active":"2024-05-14T09:18:02.784185+0000","last_became_peered":"2024-05-14T09:18:02.784185+0000","last_unstale":"2024-05-14T09:21:10.291563+0000","last_undegraded":"2024-05-14T09:21:10.291563+0000","last_fullsized":"2024-05-14T09:21:10.291563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:44:38.518861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292676+0000","last_change":"2024-05-14T09:18:02.783262+0000","last_active":"2024-05-14T09:21:10.292676+0000","last_peered":"2024-05-14T09:21:10.292676+0000","last_clean":"2024-05-14T09:21:10.292676+0000","last_became_active":"2024-05-14T09:18:02.780405+0000","last_became_peered":"2024-05-14T09:18:02.780405+0000","last_unstale":"2024-05-14T09:21:10.292676+0000","last_undegraded":"2024-05-14T09:21:10.292676+0000","last_fullsized":"2024-05-14T09:21:10.292676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:01:50.437966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291477+0000","last_change":"2024-05-14T09:18:02.789155+0000","last_active":"2024-05-14T09:21:10.291477+0000","last_peered":"2024-05-14T09:21:10.291477+0000","last_clean":"2024-05-14T09:21:10.291477+0000","last_became_active":"2024-05-14T09:18:02.788703+0000","last_became_peered":"2024-05-14T09:18:02.788703+0000","last_unstale":"2024-05-14T09:21:10.291477+0000","last_undegraded":"2024-05-14T09:21:10.291477+0000","last_fullsized":"2024-05-14T09:21:10.291477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:27:18.593797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293682+0000","last_change":"2024-05-14T09:18:02.788856+0000","last_active":"2024-05-14T09:21:10.293682+0000","last_peered":"2024-05-14T09:21:10.293682+0000","last_clean":"2024-05-14T09:21:10.293682+0000","last_became_active":"2024-05-14T09:18:02.788477+0000","last_became_peered":"2024-05-14T09:18:02.788477+0000","last_unstale":"2024-05-14T09:21:10.293682+0000","last_undegraded":"2024-05-14T09:21:10.293682+0000","last_fullsized":"2024-05-14T09:21:10.293682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:14:09.943568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278084+0000","last_change":"2024-05-14T09:18:02.781087+0000","last_active":"2024-05-14T09:21:10.278084+0000","last_peered":"2024-05-14T09:21:10.278084+0000","last_clean":"2024-05-14T09:21:10.278084+0000","last_became_active":"2024-05-14T09:18:02.780584+0000","last_became_peered":"2024-05-14T09:18:02.780584+0000","last_unstale":"2024-05-14T09:21:10.278084+0000","last_undegraded":"2024-05-14T09:21:10.278084+0000","last_fullsized":"2024-05-14T09:21:10.278084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:02:23.587235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:40.013591+0000","last_change":"2024-05-14T09:19:42.889482+0000","last_active":"2024-05-14T09:20:40.013591+0000","last_peered":"2024-05-14T09:20:40.013591+0000","last_clean":"2024-05-14T09:20:40.013591+0000","last_became_active":"2024-05-14T09:19:42.887316+0000","last_became_peered":"2024-05-14T09:19:42.887316+0000","last_unstale":"2024-05-14T09:20:40.013591+0000","last_undegraded":"2024-05-14T09:20:40.013591+0000","last_fullsized":"2024-05-14T09:20:40.013591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:13:44.778215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'15","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:21.677099+0000","last_change":"2024-05-14T09:17:57.708207+0000","last_active":"2024-05-14T09:23:21.677099+0000","last_peered":"2024-05-14T09:23:21.677099+0000","last_clean":"2024-05-14T09:23:21.677099+0000","last_became_active":"2024-05-14T09:17:57.707547+0000","last_became_peered":"2024-05-14T09:17:57.707547+0000","last_unstale":"2024-05-14T09:23:21.677099+0000","last_undegraded":"2024-05-14T09:23:21.677099+0000","last_fullsized":"2024-05-14T09:23:21.677099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.378254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271488+0000","last_change":"2024-05-14T09:18:02.782461+0000","last_active":"2024-05-14T09:21:10.271488+0000","last_peered":"2024-05-14T09:21:10.271488+0000","last_clean":"2024-05-14T09:21:10.271488+0000","last_became_active":"2024-05-14T09:18:02.781014+0000","last_became_peered":"2024-05-14T09:18:02.781014+0000","last_unstale":"2024-05-14T09:21:10.271488+0000","last_undegraded":"2024-05-14T09:21:10.271488+0000","last_fullsized":"2024-05-14T09:21:10.271488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:21:13.024727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:44.767239+0000","last_change":"2024-05-14T09:18:15.878163+0000","last_active":"2024-05-14T09:20:44.767239+0000","last_peered":"2024-05-14T09:20:44.767239+0000","last_clean":"2024-05-14T09:20:44.767239+0000","last_became_active":"2024-05-14T09:18:15.877097+0000","last_became_peered":"2024-05-14T09:18:15.877097+0000","last_unstale":"2024-05-14T09:20:44.767239+0000","last_undegraded":"2024-05-14T09:20:44.767239+0000","last_fullsized":"2024-05-14T09:20:44.767239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:59.570534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:57.408487+0000","last_change":"2024-05-14T09:17:57.773712+0000","last_active":"2024-05-14T09:19:57.408487+0000","last_peered":"2024-05-14T09:19:57.408487+0000","last_clean":"2024-05-14T09:19:57.408487+0000","last_became_active":"2024-05-14T09:17:57.772849+0000","last_became_peered":"2024-05-14T09:17:57.772849+0000","last_unstale":"2024-05-14T09:19:57.408487+0000","last_undegraded":"2024-05-14T09:19:57.408487+0000","last_fullsized":"2024-05-14T09:19:57.408487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:20.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.293237+0000","last_change":"2024-05-14T09:18:02.790490+0000","last_active":"2024-05-14T09:21:10.293237+0000","last_peered":"2024-05-14T09:21:10.293237+0000","last_clean":"2024-05-14T09:21:10.293237+0000","last_became_active":"2024-05-14T09:18:02.790112+0000","last_became_peered":"2024-05-14T09:18:02.790112+0000","last_unstale":"2024-05-14T09:21:10.293237+0000","last_undegraded":"2024-05-14T09:21:10.293237+0000","last_fullsized":"2024-05-14T09:21:10.293237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:15.851585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:49.768321+0000","last_change":"2024-05-14T09:18:15.888894+0000","last_active":"2024-05-14T09:20:49.768321+0000","last_peered":"2024-05-14T09:20:49.768321+0000","last_clean":"2024-05-14T09:20:49.768321+0000","last_became_active":"2024-05-14T09:18:15.888327+0000","last_became_peered":"2024-05-14T09:18:15.888327+0000","last_unstale":"2024-05-14T09:20:49.768321+0000","last_undegraded":"2024-05-14T09:20:49.768321+0000","last_fullsized":"2024-05-14T09:20:49.768321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:13:19.871380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:29.573100+0000","last_change":"2024-05-14T09:17:57.717745+0000","last_active":"2024-05-14T09:20:29.573100+0000","last_peered":"2024-05-14T09:20:29.573100+0000","last_clean":"2024-05-14T09:20:29.573100+0000","last_became_active":"2024-05-14T09:17:57.716822+0000","last_became_peered":"2024-05-14T09:17:57.716822+0000","last_unstale":"2024-05-14T09:20:29.573100+0000","last_undegraded":"2024-05-14T09:20:29.573100+0000","last_fullsized":"2024-05-14T09:20:29.573100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:47:40.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292522+0000","last_change":"2024-05-14T09:18:02.788276+0000","last_active":"2024-05-14T09:21:10.292522+0000","last_peered":"2024-05-14T09:21:10.292522+0000","last_clean":"2024-05-14T09:21:10.292522+0000","last_became_active":"2024-05-14T09:18:02.787446+0000","last_became_peered":"2024-05-14T09:18:02.787446+0000","last_unstale":"2024-05-14T09:21:10.292522+0000","last_undegraded":"2024-05-14T09:21:10.292522+0000","last_fullsized":"2024-05-14T09:21:10.292522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:07:36.574378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:49.768281+0000","last_change":"2024-05-14T09:18:15.887824+0000","last_active":"2024-05-14T09:20:49.768281+0000","last_peered":"2024-05-14T09:20:49.768281+0000","last_clean":"2024-05-14T09:20:49.768281+0000","last_became_active":"2024-05-14T09:18:15.887152+0000","last_became_peered":"2024-05-14T09:18:15.887152+0000","last_unstale":"2024-05-14T09:20:49.768281+0000","last_undegraded":"2024-05-14T09:20:49.768281+0000","last_fullsized":"2024-05-14T09:20:49.768281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:54.778329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:29.573025+0000","last_change":"2024-05-14T09:17:57.717528+0000","last_active":"2024-05-14T09:20:29.573025+0000","last_peered":"2024-05-14T09:20:29.573025+0000","last_clean":"2024-05-14T09:20:29.573025+0000","last_became_active":"2024-05-14T09:17:57.716251+0000","last_became_peered":"2024-05-14T09:17:57.716251+0000","last_unstale":"2024-05-14T09:20:29.573025+0000","last_undegraded":"2024-05-14T09:20:29.573025+0000","last_fullsized":"2024-05-14T09:20:29.573025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:29:08.080292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290619+0000","last_change":"2024-05-14T09:18:02.790132+0000","last_active":"2024-05-14T09:21:10.290619+0000","last_peered":"2024-05-14T09:21:10.290619+0000","last_clean":"2024-05-14T09:21:10.290619+0000","last_became_active":"2024-05-14T09:18:02.789461+0000","last_became_peered":"2024-05-14T09:18:02.789461+0000","last_unstale":"2024-05-14T09:21:10.290619+0000","last_undegraded":"2024-05-14T09:21:10.290619+0000","last_fullsized":"2024-05-14T09:21:10.290619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:36:55.261959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:45.014800+0000","last_change":"2024-05-14T09:18:15.893674+0000","last_active":"2024-05-14T09:20:45.014800+0000","last_peered":"2024-05-14T09:20:45.014800+0000","last_clean":"2024-05-14T09:20:45.014800+0000","last_became_active":"2024-05-14T09:18:15.891857+0000","last_became_peered":"2024-05-14T09:18:15.891857+0000","last_unstale":"2024-05-14T09:20:45.014800+0000","last_undegraded":"2024-05-14T09:20:45.014800+0000","last_fullsized":"2024-05-14T09:20:45.014800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:14:55.020773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":296,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:20.728045+0000","last_change":"2024-05-14T09:18:41.982086+0000","last_active":"2024-05-14T09:23:20.728045+0000","last_peered":"2024-05-14T09:23:20.728045+0000","last_clean":"2024-05-14T09:23:20.728045+0000","last_became_active":"2024-05-14T09:18:41.981103+0000","last_became_peered":"2024-05-14T09:18:41.981103+0000","last_unstale":"2024-05-14T09:23:20.728045+0000","last_undegraded":"2024-05-14T09:23:20.728045+0000","last_fullsized":"2024-05-14T09:23:20.728045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:25:26.896681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.268707+0000","last_change":"2024-05-14T09:18:02.775834+0000","last_active":"2024-05-14T09:21:10.268707+0000","last_peered":"2024-05-14T09:21:10.268707+0000","last_clean":"2024-05-14T09:21:10.268707+0000","last_became_active":"2024-05-14T09:18:02.773708+0000","last_became_peered":"2024-05-14T09:18:02.773708+0000","last_unstale":"2024-05-14T09:21:10.268707+0000","last_undegraded":"2024-05-14T09:21:10.268707+0000","last_fullsized":"2024-05-14T09:21:10.268707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:00.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:45.014716+0000","last_change":"2024-05-14T09:19:42.899138+0000","last_active":"2024-05-14T09:20:45.014716+0000","last_peered":"2024-05-14T09:20:45.014716+0000","last_clean":"2024-05-14T09:20:45.014716+0000","last_became_active":"2024-05-14T09:19:42.897588+0000","last_became_peered":"2024-05-14T09:19:42.897588+0000","last_unstale":"2024-05-14T09:20:45.014716+0000","last_undegraded":"2024-05-14T09:20:45.014716+0000","last_fullsized":"2024-05-14T09:20:45.014716+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:13:05.760525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:30.522923+0000","last_change":"2024-05-14T09:18:42.326203+0000","last_active":"2024-05-14T09:20:30.522923+0000","last_peered":"2024-05-14T09:20:30.522923+0000","last_clean":"2024-05-14T09:20:30.522923+0000","last_became_active":"2024-05-14T09:18:42.324907+0000","last_became_peered":"2024-05-14T09:18:42.324907+0000","last_unstale":"2024-05-14T09:20:30.522923+0000","last_undegraded":"2024-05-14T09:20:30.522923+0000","last_fullsized":"2024-05-14T09:20:30.522923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:50.408706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274235+0000","last_change":"2024-05-14T09:18:41.669731+0000","last_active":"2024-05-14T09:21:10.274235+0000","last_peered":"2024-05-14T09:21:10.274235+0000","last_clean":"2024-05-14T09:21:10.274235+0000","last_became_active":"2024-05-14T09:18:41.667039+0000","last_became_peered":"2024-05-14T09:18:41.667039+0000","last_unstale":"2024-05-14T09:21:10.274235+0000","last_undegraded":"2024-05-14T09:21:10.274235+0000","last_fullsized":"2024-05-14T09:21:10.274235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:33:30.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.670641+0000","last_change":"2024-05-14T09:18:15.894314+0000","last_active":"2024-05-14T09:20:23.670641+0000","last_peered":"2024-05-14T09:20:23.670641+0000","last_clean":"2024-05-14T09:20:23.670641+0000","last_became_active":"2024-05-14T09:18:15.893173+0000","last_became_peered":"2024-05-14T09:18:15.893173+0000","last_unstale":"2024-05-14T09:20:23.670641+0000","last_undegraded":"2024-05-14T09:20:23.670641+0000","last_fullsized":"2024-05-14T09:20:23.670641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:19:25.467141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.081025+0000","last_change":"2024-05-14T09:17:57.704612+0000","last_active":"2024-05-14T09:20:23.081025+0000","last_peered":"2024-05-14T09:20:23.081025+0000","last_clean":"2024-05-14T09:20:23.081025+0000","last_became_active":"2024-05-14T09:17:57.703979+0000","last_became_peered":"2024-05-14T09:17:57.703979+0000","last_unstale":"2024-05-14T09:20:23.081025+0000","last_undegraded":"2024-05-14T09:20:23.081025+0000","last_fullsized":"2024-05-14T09:20:23.081025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:08.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281081+0000","last_change":"2024-05-14T09:18:02.774778+0000","last_active":"2024-05-14T09:21:10.281081+0000","last_peered":"2024-05-14T09:21:10.281081+0000","last_clean":"2024-05-14T09:21:10.281081+0000","last_became_active":"2024-05-14T09:18:02.774406+0000","last_became_peered":"2024-05-14T09:18:02.774406+0000","last_unstale":"2024-05-14T09:21:10.281081+0000","last_undegraded":"2024-05-14T09:21:10.281081+0000","last_fullsized":"2024-05-14T09:21:10.281081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.135221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:17.722558+0000","last_change":"2024-05-14T09:18:15.885921+0000","last_active":"2024-05-14T09:20:17.722558+0000","last_peered":"2024-05-14T09:20:17.722558+0000","last_clean":"2024-05-14T09:20:17.722558+0000","last_became_active":"2024-05-14T09:18:15.885261+0000","last_became_peered":"2024-05-14T09:18:15.885261+0000","last_unstale":"2024-05-14T09:20:17.722558+0000","last_undegraded":"2024-05-14T09:20:17.722558+0000","last_fullsized":"2024-05-14T09:20:17.722558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:57.438626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:21.830341+0000","last_change":"2024-05-14T09:17:57.714662+0000","last_active":"2024-05-14T09:20:21.830341+0000","last_peered":"2024-05-14T09:20:21.830341+0000","last_clean":"2024-05-14T09:20:21.830341+0000","last_became_active":"2024-05-14T09:17:57.714086+0000","last_became_peered":"2024-05-14T09:17:57.714086+0000","last_unstale":"2024-05-14T09:20:21.830341+0000","last_undegraded":"2024-05-14T09:20:21.830341+0000","last_fullsized":"2024-05-14T09:20:21.830341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:20.609634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.281414+0000","last_change":"2024-05-14T09:18:02.767521+0000","last_active":"2024-05-14T09:21:10.281414+0000","last_peered":"2024-05-14T09:21:10.281414+0000","last_clean":"2024-05-14T09:21:10.281414+0000","last_became_active":"2024-05-14T09:18:02.767035+0000","last_became_peered":"2024-05-14T09:18:02.767035+0000","last_unstale":"2024-05-14T09:21:10.281414+0000","last_undegraded":"2024-05-14T09:21:10.281414+0000","last_fullsized":"2024-05-14T09:21:10.281414+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:00:30.251960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.416573+0000","last_change":"2024-05-14T09:18:15.890254+0000","last_active":"2024-05-14T09:20:37.416573+0000","last_peered":"2024-05-14T09:20:37.416573+0000","last_clean":"2024-05-14T09:20:37.416573+0000","last_became_active":"2024-05-14T09:18:15.887699+0000","last_became_peered":"2024-05-14T09:18:15.887699+0000","last_unstale":"2024-05-14T09:20:37.416573+0000","last_undegraded":"2024-05-14T09:20:37.416573+0000","last_fullsized":"2024-05-14T09:20:37.416573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:30:39.578671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'8","reported_seq":514,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:19.714270+0000","last_change":"2024-05-14T09:17:57.712559+0000","last_active":"2024-05-14T09:23:19.714270+0000","last_peered":"2024-05-14T09:23:19.714270+0000","last_clean":"2024-05-14T09:23:19.714270+0000","last_became_active":"2024-05-14T09:17:57.711265+0000","last_became_peered":"2024-05-14T09:17:57.711265+0000","last_unstale":"2024-05-14T09:23:19.714270+0000","last_undegraded":"2024-05-14T09:23:19.714270+0000","last_fullsized":"2024-05-14T09:23:19.714270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:37:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":460,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292233+0000","last_change":"2024-05-14T09:18:02.793657+0000","last_active":"2024-05-14T09:21:10.292233+0000","last_peered":"2024-05-14T09:21:10.292233+0000","last_clean":"2024-05-14T09:21:10.292233+0000","last_became_active":"2024-05-14T09:18:02.789550+0000","last_became_peered":"2024-05-14T09:18:02.789550+0000","last_unstale":"2024-05-14T09:21:10.292233+0000","last_undegraded":"2024-05-14T09:21:10.292233+0000","last_fullsized":"2024-05-14T09:21:10.292233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:31.933523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.831474+0000","last_change":"2024-05-14T09:18:15.877290+0000","last_active":"2024-05-14T09:20:37.831474+0000","last_peered":"2024-05-14T09:20:37.831474+0000","last_clean":"2024-05-14T09:20:37.831474+0000","last_became_active":"2024-05-14T09:18:15.874522+0000","last_became_peered":"2024-05-14T09:18:15.874522+0000","last_unstale":"2024-05-14T09:20:37.831474+0000","last_undegraded":"2024-05-14T09:20:37.831474+0000","last_fullsized":"2024-05-14T09:20:37.831474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:16.774709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:22.254948+0000","last_change":"2024-05-14T09:17:57.710407+0000","last_active":"2024-05-14T09:20:22.254948+0000","last_peered":"2024-05-14T09:20:22.254948+0000","last_clean":"2024-05-14T09:20:22.254948+0000","last_became_active":"2024-05-14T09:17:57.709776+0000","last_became_peered":"2024-05-14T09:17:57.709776+0000","last_unstale":"2024-05-14T09:20:22.254948+0000","last_undegraded":"2024-05-14T09:20:22.254948+0000","last_fullsized":"2024-05-14T09:20:22.254948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:28:04.838236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291060+0000","last_change":"2024-05-14T09:18:41.664954+0000","last_active":"2024-05-14T09:21:10.291060+0000","last_peered":"2024-05-14T09:21:10.291060+0000","last_clean":"2024-05-14T09:21:10.291060+0000","last_became_active":"2024-05-14T09:18:41.663825+0000","last_became_peered":"2024-05-14T09:18:41.663825+0000","last_unstale":"2024-05-14T09:21:10.291060+0000","last_undegraded":"2024-05-14T09:21:10.291060+0000","last_fullsized":"2024-05-14T09:21:10.291060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:50.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:39.766161+0000","last_change":"2024-05-14T09:18:15.882918+0000","last_active":"2024-05-14T09:20:39.766161+0000","last_peered":"2024-05-14T09:20:39.766161+0000","last_clean":"2024-05-14T09:20:39.766161+0000","last_became_active":"2024-05-14T09:18:15.880220+0000","last_became_peered":"2024-05-14T09:18:15.880220+0000","last_unstale":"2024-05-14T09:20:39.766161+0000","last_undegraded":"2024-05-14T09:20:39.766161+0000","last_fullsized":"2024-05-14T09:20:39.766161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:49.777319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:21.830568+0000","last_change":"2024-05-14T09:17:57.775417+0000","last_active":"2024-05-14T09:20:21.830568+0000","last_peered":"2024-05-14T09:20:21.830568+0000","last_clean":"2024-05-14T09:20:21.830568+0000","last_became_active":"2024-05-14T09:17:57.774362+0000","last_became_peered":"2024-05-14T09:17:57.774362+0000","last_unstale":"2024-05-14T09:20:21.830568+0000","last_undegraded":"2024-05-14T09:20:21.830568+0000","last_fullsized":"2024-05-14T09:20:21.830568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:27.320060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292752+0000","last_change":"2024-05-14T09:18:02.794096+0000","last_active":"2024-05-14T09:21:10.292752+0000","last_peered":"2024-05-14T09:21:10.292752+0000","last_clean":"2024-05-14T09:21:10.292752+0000","last_became_active":"2024-05-14T09:18:02.788361+0000","last_became_peered":"2024-05-14T09:18:02.788361+0000","last_unstale":"2024-05-14T09:21:10.292752+0000","last_undegraded":"2024-05-14T09:21:10.292752+0000","last_fullsized":"2024-05-14T09:21:10.292752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:41.485460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:37.831527+0000","last_change":"2024-05-14T09:18:15.886317+0000","last_active":"2024-05-14T09:20:37.831527+0000","last_peered":"2024-05-14T09:20:37.831527+0000","last_clean":"2024-05-14T09:20:37.831527+0000","last_became_active":"2024-05-14T09:18:15.885903+0000","last_became_peered":"2024-05-14T09:18:15.885903+0000","last_unstale":"2024-05-14T09:20:37.831527+0000","last_undegraded":"2024-05-14T09:20:37.831527+0000","last_fullsized":"2024-05-14T09:20:37.831527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:26:59.892672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'43","reported_seq":563,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:19.723160+0000","last_change":"2024-05-14T09:17:57.717013+0000","last_active":"2024-05-14T09:23:19.723160+0000","last_peered":"2024-05-14T09:23:19.723160+0000","last_clean":"2024-05-14T09:23:19.723160+0000","last_became_active":"2024-05-14T09:17:57.714552+0000","last_became_peered":"2024-05-14T09:17:57.714552+0000","last_unstale":"2024-05-14T09:23:19.723160+0000","last_undegraded":"2024-05-14T09:23:19.723160+0000","last_fullsized":"2024-05-14T09:23:19.723160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:16.042573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73270,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":310,"num_write":45,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.262378+0000","last_change":"2024-05-14T09:18:02.782446+0000","last_active":"2024-05-14T09:21:10.262378+0000","last_peered":"2024-05-14T09:21:10.262378+0000","last_clean":"2024-05-14T09:21:10.262378+0000","last_became_active":"2024-05-14T09:18:02.779998+0000","last_became_peered":"2024-05-14T09:18:02.779998+0000","last_unstale":"2024-05-14T09:21:10.262378+0000","last_undegraded":"2024-05-14T09:21:10.262378+0000","last_fullsized":"2024-05-14T09:21:10.262378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:50.734227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:41.835136+0000","last_change":"2024-05-14T09:18:15.894372+0000","last_active":"2024-05-14T09:20:41.835136+0000","last_peered":"2024-05-14T09:20:41.835136+0000","last_clean":"2024-05-14T09:20:41.835136+0000","last_became_active":"2024-05-14T09:18:15.893842+0000","last_became_peered":"2024-05-14T09:18:15.893842+0000","last_unstale":"2024-05-14T09:20:41.835136+0000","last_undegraded":"2024-05-14T09:20:41.835136+0000","last_fullsized":"2024-05-14T09:20:41.835136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:57.675242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:03.679274+0000","last_change":"2024-05-14T09:18:41.675372+0000","last_active":"2024-05-14T09:21:03.679274+0000","last_peered":"2024-05-14T09:21:03.679274+0000","last_clean":"2024-05-14T09:21:03.679274+0000","last_became_active":"2024-05-14T09:18:41.659107+0000","last_became_peered":"2024-05-14T09:18:41.659107+0000","last_unstale":"2024-05-14T09:21:03.679274+0000","last_undegraded":"2024-05-14T09:21:03.679274+0000","last_fullsized":"2024-05-14T09:21:03.679274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:55:43.567929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280144+0000","last_change":"2024-05-14T09:18:02.780558+0000","last_active":"2024-05-14T09:21:10.280144+0000","last_peered":"2024-05-14T09:21:10.280144+0000","last_clean":"2024-05-14T09:21:10.280144+0000","last_became_active":"2024-05-14T09:18:02.779955+0000","last_became_peered":"2024-05-14T09:18:02.779955+0000","last_unstale":"2024-05-14T09:21:10.280144+0000","last_undegraded":"2024-05-14T09:21:10.280144+0000","last_fullsized":"2024-05-14T09:21:10.280144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:28:59.821879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:38.674219+0000","last_change":"2024-05-14T09:18:15.892207+0000","last_active":"2024-05-14T09:20:38.674219+0000","last_peered":"2024-05-14T09:20:38.674219+0000","last_clean":"2024-05-14T09:20:38.674219+0000","last_became_active":"2024-05-14T09:18:15.891646+0000","last_became_peered":"2024-05-14T09:18:15.891646+0000","last_unstale":"2024-05-14T09:20:38.674219+0000","last_undegraded":"2024-05-14T09:20:38.674219+0000","last_fullsized":"2024-05-14T09:20:38.674219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:06:48.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:16.829258+0000","last_change":"2024-05-14T09:17:57.717130+0000","last_active":"2024-05-14T09:20:16.829258+0000","last_peered":"2024-05-14T09:20:16.829258+0000","last_clean":"2024-05-14T09:20:16.829258+0000","last_became_active":"2024-05-14T09:17:57.716738+0000","last_became_peered":"2024-05-14T09:17:57.716738+0000","last_unstale":"2024-05-14T09:20:16.829258+0000","last_undegraded":"2024-05-14T09:20:16.829258+0000","last_fullsized":"2024-05-14T09:20:16.829258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:20:16.246789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.286827+0000","last_change":"2024-05-14T09:18:02.783073+0000","last_active":"2024-05-14T09:21:10.286827+0000","last_peered":"2024-05-14T09:21:10.286827+0000","last_clean":"2024-05-14T09:21:10.286827+0000","last_became_active":"2024-05-14T09:18:02.782657+0000","last_became_peered":"2024-05-14T09:18:02.782657+0000","last_unstale":"2024-05-14T09:21:10.286827+0000","last_undegraded":"2024-05-14T09:21:10.286827+0000","last_fullsized":"2024-05-14T09:21:10.286827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:39:46.649875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:42.832376+0000","last_change":"2024-05-14T09:18:15.885231+0000","last_active":"2024-05-14T09:20:42.832376+0000","last_peered":"2024-05-14T09:20:42.832376+0000","last_clean":"2024-05-14T09:20:42.832376+0000","last_became_active":"2024-05-14T09:18:15.880199+0000","last_became_peered":"2024-05-14T09:18:15.880199+0000","last_unstale":"2024-05-14T09:20:42.832376+0000","last_undegraded":"2024-05-14T09:20:42.832376+0000","last_fullsized":"2024-05-14T09:20:42.832376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:10:22.707034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":284,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:18.704526+0000","last_change":"2024-05-14T09:17:57.718596+0000","last_active":"2024-05-14T09:23:18.704526+0000","last_peered":"2024-05-14T09:23:18.704526+0000","last_clean":"2024-05-14T09:23:18.704526+0000","last_became_active":"2024-05-14T09:17:57.717735+0000","last_became_peered":"2024-05-14T09:17:57.717735+0000","last_unstale":"2024-05-14T09:23:18.704526+0000","last_undegraded":"2024-05-14T09:23:18.704526+0000","last_fullsized":"2024-05-14T09:23:18.704526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:32:45.110512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.283343+0000","last_change":"2024-05-14T09:18:02.780222+0000","last_active":"2024-05-14T09:21:10.283343+0000","last_peered":"2024-05-14T09:21:10.283343+0000","last_clean":"2024-05-14T09:21:10.283343+0000","last_became_active":"2024-05-14T09:18:02.779842+0000","last_became_peered":"2024-05-14T09:18:02.779842+0000","last_unstale":"2024-05-14T09:21:10.283343+0000","last_undegraded":"2024-05-14T09:21:10.283343+0000","last_fullsized":"2024-05-14T09:21:10.283343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:46.726665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:43.084133+0000","last_change":"2024-05-14T09:18:15.885248+0000","last_active":"2024-05-14T09:20:43.084133+0000","last_peered":"2024-05-14T09:20:43.084133+0000","last_clean":"2024-05-14T09:20:43.084133+0000","last_became_active":"2024-05-14T09:18:15.884675+0000","last_became_peered":"2024-05-14T09:18:15.884675+0000","last_unstale":"2024-05-14T09:20:43.084133+0000","last_undegraded":"2024-05-14T09:20:43.084133+0000","last_fullsized":"2024-05-14T09:20:43.084133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:28:14.278141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:03.679217+0000","last_change":"2024-05-14T09:18:41.687983+0000","last_active":"2024-05-14T09:21:03.679217+0000","last_peered":"2024-05-14T09:21:03.679217+0000","last_clean":"2024-05-14T09:21:03.679217+0000","last_became_active":"2024-05-14T09:18:41.666942+0000","last_became_peered":"2024-05-14T09:18:41.666942+0000","last_unstale":"2024-05-14T09:21:03.679217+0000","last_undegraded":"2024-05-14T09:21:03.679217+0000","last_fullsized":"2024-05-14T09:21:03.679217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:38:24.183297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290079+0000","last_change":"2024-05-14T09:18:02.788509+0000","last_active":"2024-05-14T09:21:10.290079+0000","last_peered":"2024-05-14T09:21:10.290079+0000","last_clean":"2024-05-14T09:21:10.290079+0000","last_became_active":"2024-05-14T09:18:02.786886+0000","last_became_peered":"2024-05-14T09:18:02.786886+0000","last_unstale":"2024-05-14T09:21:10.290079+0000","last_undegraded":"2024-05-14T09:21:10.290079+0000","last_fullsized":"2024-05-14T09:21:10.290079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:29:38.765565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831719+0000","last_change":"2024-05-14T09:18:15.895299+0000","last_active":"2024-05-14T09:20:26.831719+0000","last_peered":"2024-05-14T09:20:26.831719+0000","last_clean":"2024-05-14T09:20:26.831719+0000","last_became_active":"2024-05-14T09:18:15.893663+0000","last_became_peered":"2024-05-14T09:18:15.893663+0000","last_unstale":"2024-05-14T09:20:26.831719+0000","last_undegraded":"2024-05-14T09:20:26.831719+0000","last_fullsized":"2024-05-14T09:20:26.831719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:58:24.950436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:22:29.597766+0000","last_change":"2024-05-14T09:17:57.710933+0000","last_active":"2024-05-14T09:22:29.597766+0000","last_peered":"2024-05-14T09:22:29.597766+0000","last_clean":"2024-05-14T09:22:29.597766+0000","last_became_active":"2024-05-14T09:17:57.710255+0000","last_became_peered":"2024-05-14T09:17:57.710255+0000","last_unstale":"2024-05-14T09:22:29.597766+0000","last_undegraded":"2024-05-14T09:22:29.597766+0000","last_fullsized":"2024-05-14T09:22:29.597766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:30.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277135+0000","last_change":"2024-05-14T09:18:02.781494+0000","last_active":"2024-05-14T09:21:10.277135+0000","last_peered":"2024-05-14T09:21:10.277135+0000","last_clean":"2024-05-14T09:21:10.277135+0000","last_became_active":"2024-05-14T09:18:02.781112+0000","last_became_peered":"2024-05-14T09:18:02.781112+0000","last_unstale":"2024-05-14T09:21:10.277135+0000","last_undegraded":"2024-05-14T09:21:10.277135+0000","last_fullsized":"2024-05-14T09:21:10.277135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:27.109538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:24.571869+0000","last_change":"2024-05-14T09:18:16.135447+0000","last_active":"2024-05-14T09:20:24.571869+0000","last_peered":"2024-05-14T09:20:24.571869+0000","last_clean":"2024-05-14T09:20:24.571869+0000","last_became_active":"2024-05-14T09:18:16.133770+0000","last_became_peered":"2024-05-14T09:18:16.133770+0000","last_unstale":"2024-05-14T09:20:24.571869+0000","last_undegraded":"2024-05-14T09:20:24.571869+0000","last_fullsized":"2024-05-14T09:20:24.571869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:29.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:02.824745+0000","last_change":"2024-05-14T09:17:57.776542+0000","last_active":"2024-05-14T09:20:02.824745+0000","last_peered":"2024-05-14T09:20:02.824745+0000","last_clean":"2024-05-14T09:20:02.824745+0000","last_became_active":"2024-05-14T09:17:57.775370+0000","last_became_peered":"2024-05-14T09:17:57.775370+0000","last_unstale":"2024-05-14T09:20:02.824745+0000","last_undegraded":"2024-05-14T09:20:02.824745+0000","last_fullsized":"2024-05-14T09:20:02.824745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:24.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280696+0000","last_change":"2024-05-14T09:18:02.776673+0000","last_active":"2024-05-14T09:21:10.280696+0000","last_peered":"2024-05-14T09:21:10.280696+0000","last_clean":"2024-05-14T09:21:10.280696+0000","last_became_active":"2024-05-14T09:18:02.776243+0000","last_became_peered":"2024-05-14T09:18:02.776243+0000","last_unstale":"2024-05-14T09:21:10.280696+0000","last_undegraded":"2024-05-14T09:21:10.280696+0000","last_fullsized":"2024-05-14T09:21:10.280696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:21.226977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.081080+0000","last_change":"2024-05-14T09:18:15.885039+0000","last_active":"2024-05-14T09:20:23.081080+0000","last_peered":"2024-05-14T09:20:23.081080+0000","last_clean":"2024-05-14T09:20:23.081080+0000","last_became_active":"2024-05-14T09:18:15.884466+0000","last_became_peered":"2024-05-14T09:18:15.884466+0000","last_unstale":"2024-05-14T09:20:23.081080+0000","last_undegraded":"2024-05-14T09:20:23.081080+0000","last_fullsized":"2024-05-14T09:20:23.081080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:12.000203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'8","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:20.675598+0000","last_change":"2024-05-14T09:17:57.712259+0000","last_active":"2024-05-14T09:23:20.675598+0000","last_peered":"2024-05-14T09:23:20.675598+0000","last_clean":"2024-05-14T09:23:20.675598+0000","last_became_active":"2024-05-14T09:17:57.711663+0000","last_became_peered":"2024-05-14T09:17:57.711663+0000","last_unstale":"2024-05-14T09:23:20.675598+0000","last_undegraded":"2024-05-14T09:23:20.675598+0000","last_fullsized":"2024-05-14T09:23:20.675598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:40:31.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291598+0000","last_change":"2024-05-14T09:18:02.783586+0000","last_active":"2024-05-14T09:21:10.291598+0000","last_peered":"2024-05-14T09:21:10.291598+0000","last_clean":"2024-05-14T09:21:10.291598+0000","last_became_active":"2024-05-14T09:18:02.783122+0000","last_became_peered":"2024-05-14T09:18:02.783122+0000","last_unstale":"2024-05-14T09:21:10.291598+0000","last_undegraded":"2024-05-14T09:21:10.291598+0000","last_fullsized":"2024-05-14T09:21:10.291598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:32:24.966064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:28.081683+0000","last_change":"2024-05-14T09:18:16.132825+0000","last_active":"2024-05-14T09:20:28.081683+0000","last_peered":"2024-05-14T09:20:28.081683+0000","last_clean":"2024-05-14T09:20:28.081683+0000","last_became_active":"2024-05-14T09:18:16.132155+0000","last_became_peered":"2024-05-14T09:18:16.132155+0000","last_unstale":"2024-05-14T09:20:28.081683+0000","last_undegraded":"2024-05-14T09:20:28.081683+0000","last_fullsized":"2024-05-14T09:20:28.081683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:43.579951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274056+0000","last_change":"2024-05-14T09:18:02.788407+0000","last_active":"2024-05-14T09:21:10.274056+0000","last_peered":"2024-05-14T09:21:10.274056+0000","last_clean":"2024-05-14T09:21:10.274056+0000","last_became_active":"2024-05-14T09:18:02.785934+0000","last_became_peered":"2024-05-14T09:18:02.785934+0000","last_unstale":"2024-05-14T09:21:10.274056+0000","last_undegraded":"2024-05-14T09:21:10.274056+0000","last_fullsized":"2024-05-14T09:21:10.274056+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:45.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":286,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:21.711598+0000","last_change":"2024-05-14T09:17:57.781016+0000","last_active":"2024-05-14T09:23:21.711598+0000","last_peered":"2024-05-14T09:23:21.711598+0000","last_clean":"2024-05-14T09:23:21.711598+0000","last_became_active":"2024-05-14T09:17:57.777442+0000","last_became_peered":"2024-05-14T09:17:57.777442+0000","last_unstale":"2024-05-14T09:23:21.711598+0000","last_undegraded":"2024-05-14T09:23:21.711598+0000","last_fullsized":"2024-05-14T09:23:21.711598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:17:06.992053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:22.254908+0000","last_change":"2024-05-14T09:18:15.891299+0000","last_active":"2024-05-14T09:20:22.254908+0000","last_peered":"2024-05-14T09:20:22.254908+0000","last_clean":"2024-05-14T09:20:22.254908+0000","last_became_active":"2024-05-14T09:18:15.890552+0000","last_became_peered":"2024-05-14T09:18:15.890552+0000","last_unstale":"2024-05-14T09:20:22.254908+0000","last_undegraded":"2024-05-14T09:20:22.254908+0000","last_fullsized":"2024-05-14T09:20:22.254908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:03:44.936117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292043+0000","last_change":"2024-05-14T09:18:02.793484+0000","last_active":"2024-05-14T09:21:10.292043+0000","last_peered":"2024-05-14T09:21:10.292043+0000","last_clean":"2024-05-14T09:21:10.292043+0000","last_became_active":"2024-05-14T09:18:02.792888+0000","last_became_peered":"2024-05-14T09:18:02.792888+0000","last_unstale":"2024-05-14T09:21:10.292043+0000","last_undegraded":"2024-05-14T09:21:10.292043+0000","last_fullsized":"2024-05-14T09:21:10.292043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:19.212025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:04.758799+0000","last_change":"2024-05-14T09:17:57.715271+0000","last_active":"2024-05-14T09:20:04.758799+0000","last_peered":"2024-05-14T09:20:04.758799+0000","last_clean":"2024-05-14T09:20:04.758799+0000","last_became_active":"2024-05-14T09:17:57.712524+0000","last_became_peered":"2024-05-14T09:17:57.712524+0000","last_unstale":"2024-05-14T09:20:04.758799+0000","last_undegraded":"2024-05-14T09:20:04.758799+0000","last_fullsized":"2024-05-14T09:20:04.758799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:39:46.868509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:12.252682+0000","last_change":"2024-05-14T09:16:01.832034+0000","last_active":"2024-05-14T09:20:12.252682+0000","last_peered":"2024-05-14T09:20:12.252682+0000","last_clean":"2024-05-14T09:20:12.252682+0000","last_became_active":"2024-05-14T09:16:01.815331+0000","last_became_peered":"2024-05-14T09:16:01.815331+0000","last_unstale":"2024-05-14T09:20:12.252682+0000","last_undegraded":"2024-05-14T09:20:12.252682+0000","last_fullsized":"2024-05-14T09:20:12.252682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:11:00.916612+0000","last_clean_scrub_stamp":"2024-05-14T09:11:00.916612+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:04:45.123827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831838+0000","last_change":"2024-05-14T09:18:16.136149+0000","last_active":"2024-05-14T09:20:26.831838+0000","last_peered":"2024-05-14T09:20:26.831838+0000","last_clean":"2024-05-14T09:20:26.831838+0000","last_became_active":"2024-05-14T09:18:16.134655+0000","last_became_peered":"2024-05-14T09:18:16.134655+0000","last_unstale":"2024-05-14T09:20:26.831838+0000","last_undegraded":"2024-05-14T09:20:26.831838+0000","last_fullsized":"2024-05-14T09:20:26.831838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:51.879763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274178+0000","last_change":"2024-05-14T09:18:02.791068+0000","last_active":"2024-05-14T09:21:10.274178+0000","last_peered":"2024-05-14T09:21:10.274178+0000","last_clean":"2024-05-14T09:21:10.274178+0000","last_became_active":"2024-05-14T09:18:02.785294+0000","last_became_peered":"2024-05-14T09:18:02.785294+0000","last_unstale":"2024-05-14T09:21:10.274178+0000","last_undegraded":"2024-05-14T09:21:10.274178+0000","last_fullsized":"2024-05-14T09:21:10.274178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:06:25.554475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:19:57.249555+0000","last_change":"2024-05-14T09:17:57.715272+0000","last_active":"2024-05-14T09:19:57.249555+0000","last_peered":"2024-05-14T09:19:57.249555+0000","last_clean":"2024-05-14T09:19:57.249555+0000","last_became_active":"2024-05-14T09:17:57.713504+0000","last_became_peered":"2024-05-14T09:17:57.713504+0000","last_unstale":"2024-05-14T09:19:57.249555+0000","last_undegraded":"2024-05-14T09:19:57.249555+0000","last_fullsized":"2024-05-14T09:19:57.249555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:27:26.071204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:23.670583+0000","last_change":"2024-05-14T09:18:15.893437+0000","last_active":"2024-05-14T09:20:23.670583+0000","last_peered":"2024-05-14T09:20:23.670583+0000","last_clean":"2024-05-14T09:20:23.670583+0000","last_became_active":"2024-05-14T09:18:15.890908+0000","last_became_peered":"2024-05-14T09:18:15.890908+0000","last_unstale":"2024-05-14T09:20:23.670583+0000","last_undegraded":"2024-05-14T09:20:23.670583+0000","last_fullsized":"2024-05-14T09:20:23.670583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:15.339562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:04.568011+0000","last_change":"2024-05-14T09:17:57.779601+0000","last_active":"2024-05-14T09:20:04.568011+0000","last_peered":"2024-05-14T09:20:04.568011+0000","last_clean":"2024-05-14T09:20:04.568011+0000","last_became_active":"2024-05-14T09:17:57.778730+0000","last_became_peered":"2024-05-14T09:17:57.778730+0000","last_unstale":"2024-05-14T09:20:04.568011+0000","last_undegraded":"2024-05-14T09:20:04.568011+0000","last_fullsized":"2024-05-14T09:20:04.568011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:01:07.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.274698+0000","last_change":"2024-05-14T09:18:02.786283+0000","last_active":"2024-05-14T09:21:10.274698+0000","last_peered":"2024-05-14T09:21:10.274698+0000","last_clean":"2024-05-14T09:21:10.274698+0000","last_became_active":"2024-05-14T09:18:02.785158+0000","last_became_peered":"2024-05-14T09:18:02.785158+0000","last_unstale":"2024-05-14T09:21:10.274698+0000","last_undegraded":"2024-05-14T09:21:10.274698+0000","last_fullsized":"2024-05-14T09:21:10.274698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:50:28.804419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:17.412357+0000","last_change":"2024-05-14T09:18:16.133898+0000","last_active":"2024-05-14T09:20:17.412357+0000","last_peered":"2024-05-14T09:20:17.412357+0000","last_clean":"2024-05-14T09:20:17.412357+0000","last_became_active":"2024-05-14T09:18:16.132493+0000","last_became_peered":"2024-05-14T09:18:16.132493+0000","last_unstale":"2024-05-14T09:20:17.412357+0000","last_undegraded":"2024-05-14T09:20:17.412357+0000","last_fullsized":"2024-05-14T09:20:17.412357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:38:15.126883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'19","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:14.847618+0000","last_change":"2024-05-14T09:17:57.710000+0000","last_active":"2024-05-14T09:23:14.847618+0000","last_peered":"2024-05-14T09:23:14.847618+0000","last_clean":"2024-05-14T09:23:14.847618+0000","last_became_active":"2024-05-14T09:17:57.709546+0000","last_became_peered":"2024-05-14T09:17:57.709546+0000","last_unstale":"2024-05-14T09:23:14.847618+0000","last_undegraded":"2024-05-14T09:23:14.847618+0000","last_fullsized":"2024-05-14T09:23:14.847618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:09.681936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.279023+0000","last_change":"2024-05-14T09:18:02.786342+0000","last_active":"2024-05-14T09:21:10.279023+0000","last_peered":"2024-05-14T09:21:10.279023+0000","last_clean":"2024-05-14T09:21:10.279023+0000","last_became_active":"2024-05-14T09:18:02.785981+0000","last_became_peered":"2024-05-14T09:18:02.785981+0000","last_unstale":"2024-05-14T09:21:10.279023+0000","last_undegraded":"2024-05-14T09:21:10.279023+0000","last_fullsized":"2024-05-14T09:21:10.279023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:59:43.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:20.009606+0000","last_change":"2024-05-14T09:18:15.882171+0000","last_active":"2024-05-14T09:20:20.009606+0000","last_peered":"2024-05-14T09:20:20.009606+0000","last_clean":"2024-05-14T09:20:20.009606+0000","last_became_active":"2024-05-14T09:18:15.881015+0000","last_became_peered":"2024-05-14T09:18:15.881015+0000","last_unstale":"2024-05-14T09:20:20.009606+0000","last_undegraded":"2024-05-14T09:20:20.009606+0000","last_fullsized":"2024-05-14T09:20:20.009606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:18.832868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:09.759495+0000","last_change":"2024-05-14T09:17:58.254067+0000","last_active":"2024-05-14T09:20:09.759495+0000","last_peered":"2024-05-14T09:20:09.759495+0000","last_clean":"2024-05-14T09:20:09.759495+0000","last_became_active":"2024-05-14T09:17:58.253140+0000","last_became_peered":"2024-05-14T09:17:58.253140+0000","last_unstale":"2024-05-14T09:20:09.759495+0000","last_undegraded":"2024-05-14T09:20:09.759495+0000","last_fullsized":"2024-05-14T09:20:09.759495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:20.263028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289930+0000","last_change":"2024-05-14T09:18:02.775968+0000","last_active":"2024-05-14T09:21:10.289930+0000","last_peered":"2024-05-14T09:21:10.289930+0000","last_clean":"2024-05-14T09:21:10.289930+0000","last_became_active":"2024-05-14T09:18:02.775639+0000","last_became_peered":"2024-05-14T09:18:02.775639+0000","last_unstale":"2024-05-14T09:21:10.289930+0000","last_undegraded":"2024-05-14T09:21:10.289930+0000","last_fullsized":"2024-05-14T09:21:10.289930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:27:52.179647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:34.765148+0000","last_change":"2024-05-14T09:18:16.139823+0000","last_active":"2024-05-14T09:20:34.765148+0000","last_peered":"2024-05-14T09:20:34.765148+0000","last_clean":"2024-05-14T09:20:34.765148+0000","last_became_active":"2024-05-14T09:18:16.138075+0000","last_became_peered":"2024-05-14T09:18:16.138075+0000","last_unstale":"2024-05-14T09:20:34.765148+0000","last_undegraded":"2024-05-14T09:20:34.765148+0000","last_fullsized":"2024-05-14T09:20:34.765148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:41.186678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:10.627966+0000","last_change":"2024-05-14T09:17:57.773751+0000","last_active":"2024-05-14T09:20:10.627966+0000","last_peered":"2024-05-14T09:20:10.627966+0000","last_clean":"2024-05-14T09:20:10.627966+0000","last_became_active":"2024-05-14T09:17:57.772964+0000","last_became_peered":"2024-05-14T09:17:57.772964+0000","last_unstale":"2024-05-14T09:20:10.627966+0000","last_undegraded":"2024-05-14T09:20:10.627966+0000","last_fullsized":"2024-05-14T09:20:10.627966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:08:01.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.265284+0000","last_change":"2024-05-14T09:18:02.774847+0000","last_active":"2024-05-14T09:21:10.265284+0000","last_peered":"2024-05-14T09:21:10.265284+0000","last_clean":"2024-05-14T09:21:10.265284+0000","last_became_active":"2024-05-14T09:18:02.774384+0000","last_became_peered":"2024-05-14T09:18:02.774384+0000","last_unstale":"2024-05-14T09:21:10.265284+0000","last_undegraded":"2024-05-14T09:21:10.265284+0000","last_fullsized":"2024-05-14T09:21:10.265284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:54:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:32.830622+0000","last_change":"2024-05-14T09:18:15.887656+0000","last_active":"2024-05-14T09:20:32.830622+0000","last_peered":"2024-05-14T09:20:32.830622+0000","last_clean":"2024-05-14T09:20:32.830622+0000","last_became_active":"2024-05-14T09:18:15.887203+0000","last_became_peered":"2024-05-14T09:18:15.887203+0000","last_unstale":"2024-05-14T09:20:32.830622+0000","last_undegraded":"2024-05-14T09:20:32.830622+0000","last_fullsized":"2024-05-14T09:20:32.830622+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:27.080959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:07.410488+0000","last_change":"2024-05-14T09:17:57.707511+0000","last_active":"2024-05-14T09:20:07.410488+0000","last_peered":"2024-05-14T09:20:07.410488+0000","last_clean":"2024-05-14T09:20:07.410488+0000","last_became_active":"2024-05-14T09:17:57.706706+0000","last_became_peered":"2024-05-14T09:17:57.706706+0000","last_unstale":"2024-05-14T09:20:07.410488+0000","last_undegraded":"2024-05-14T09:20:07.410488+0000","last_fullsized":"2024-05-14T09:20:07.410488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:25.325832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291212+0000","last_change":"2024-05-14T09:18:02.787800+0000","last_active":"2024-05-14T09:21:10.291212+0000","last_peered":"2024-05-14T09:21:10.291212+0000","last_clean":"2024-05-14T09:21:10.291212+0000","last_became_active":"2024-05-14T09:18:02.785115+0000","last_became_peered":"2024-05-14T09:18:02.785115+0000","last_unstale":"2024-05-14T09:21:10.291212+0000","last_undegraded":"2024-05-14T09:21:10.291212+0000","last_fullsized":"2024-05-14T09:21:10.291212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:23.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:33.294146+0000","last_change":"2024-05-14T09:19:42.898356+0000","last_active":"2024-05-14T09:20:33.294146+0000","last_peered":"2024-05-14T09:20:33.294146+0000","last_clean":"2024-05-14T09:20:33.294146+0000","last_became_active":"2024-05-14T09:19:42.896256+0000","last_became_peered":"2024-05-14T09:19:42.896256+0000","last_unstale":"2024-05-14T09:20:33.294146+0000","last_undegraded":"2024-05-14T09:20:33.294146+0000","last_fullsized":"2024-05-14T09:20:33.294146+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:59:09.389588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:14.961672+0000","last_change":"2024-05-14T09:17:57.710472+0000","last_active":"2024-05-14T09:23:14.961672+0000","last_peered":"2024-05-14T09:23:14.961672+0000","last_clean":"2024-05-14T09:23:14.961672+0000","last_became_active":"2024-05-14T09:17:57.710056+0000","last_became_peered":"2024-05-14T09:17:57.710056+0000","last_unstale":"2024-05-14T09:23:14.961672+0000","last_undegraded":"2024-05-14T09:23:14.961672+0000","last_fullsized":"2024-05-14T09:23:14.961672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:45.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.282551+0000","last_change":"2024-05-14T09:18:02.779982+0000","last_active":"2024-05-14T09:21:10.282551+0000","last_peered":"2024-05-14T09:21:10.282551+0000","last_clean":"2024-05-14T09:21:10.282551+0000","last_became_active":"2024-05-14T09:18:02.779595+0000","last_became_peered":"2024-05-14T09:18:02.779595+0000","last_unstale":"2024-05-14T09:21:10.282551+0000","last_undegraded":"2024-05-14T09:21:10.282551+0000","last_fullsized":"2024-05-14T09:21:10.282551+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:30:06.520980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:33.294204+0000","last_change":"2024-05-14T09:18:16.137850+0000","last_active":"2024-05-14T09:20:33.294204+0000","last_peered":"2024-05-14T09:20:33.294204+0000","last_clean":"2024-05-14T09:20:33.294204+0000","last_became_active":"2024-05-14T09:18:16.135097+0000","last_became_peered":"2024-05-14T09:18:16.135097+0000","last_unstale":"2024-05-14T09:20:33.294204+0000","last_undegraded":"2024-05-14T09:20:33.294204+0000","last_fullsized":"2024-05-14T09:20:33.294204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:29:09.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:14.569955+0000","last_change":"2024-05-14T09:17:57.720232+0000","last_active":"2024-05-14T09:20:14.569955+0000","last_peered":"2024-05-14T09:20:14.569955+0000","last_clean":"2024-05-14T09:20:14.569955+0000","last_became_active":"2024-05-14T09:17:57.719057+0000","last_became_peered":"2024-05-14T09:17:57.719057+0000","last_unstale":"2024-05-14T09:20:14.569955+0000","last_undegraded":"2024-05-14T09:20:14.569955+0000","last_fullsized":"2024-05-14T09:20:14.569955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:34.378868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292344+0000","last_change":"2024-05-14T09:18:02.788106+0000","last_active":"2024-05-14T09:21:10.292344+0000","last_peered":"2024-05-14T09:21:10.292344+0000","last_clean":"2024-05-14T09:21:10.292344+0000","last_became_active":"2024-05-14T09:18:02.787631+0000","last_became_peered":"2024-05-14T09:18:02.787631+0000","last_unstale":"2024-05-14T09:21:10.292344+0000","last_undegraded":"2024-05-14T09:21:10.292344+0000","last_fullsized":"2024-05-14T09:21:10.292344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:59:45.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:25.631142+0000","last_change":"2024-05-14T09:18:15.889654+0000","last_active":"2024-05-14T09:20:25.631142+0000","last_peered":"2024-05-14T09:20:25.631142+0000","last_clean":"2024-05-14T09:20:25.631142+0000","last_became_active":"2024-05-14T09:18:15.888915+0000","last_became_peered":"2024-05-14T09:18:15.888915+0000","last_unstale":"2024-05-14T09:20:25.631142+0000","last_undegraded":"2024-05-14T09:20:25.631142+0000","last_fullsized":"2024-05-14T09:20:25.631142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:52:27.127246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'8","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:23:18.712839+0000","last_change":"2024-05-14T09:17:58.253945+0000","last_active":"2024-05-14T09:23:18.712839+0000","last_peered":"2024-05-14T09:23:18.712839+0000","last_clean":"2024-05-14T09:23:18.712839+0000","last_became_active":"2024-05-14T09:17:58.252807+0000","last_became_peered":"2024-05-14T09:17:58.252807+0000","last_unstale":"2024-05-14T09:23:18.712839+0000","last_undegraded":"2024-05-14T09:23:18.712839+0000","last_fullsized":"2024-05-14T09:23:18.712839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:56:52.853589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291593+0000","last_change":"2024-05-14T09:18:02.792743+0000","last_active":"2024-05-14T09:21:10.291593+0000","last_peered":"2024-05-14T09:21:10.291593+0000","last_clean":"2024-05-14T09:21:10.291593+0000","last_became_active":"2024-05-14T09:18:02.792371+0000","last_became_peered":"2024-05-14T09:18:02.792371+0000","last_unstale":"2024-05-14T09:21:10.291593+0000","last_undegraded":"2024-05-14T09:21:10.291593+0000","last_fullsized":"2024-05-14T09:21:10.291593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:10:00.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:32.725951+0000","last_change":"2024-05-14T09:18:15.884104+0000","last_active":"2024-05-14T09:20:32.725951+0000","last_peered":"2024-05-14T09:20:32.725951+0000","last_clean":"2024-05-14T09:20:32.725951+0000","last_became_active":"2024-05-14T09:18:15.881737+0000","last_became_peered":"2024-05-14T09:18:15.881737+0000","last_unstale":"2024-05-14T09:20:32.725951+0000","last_undegraded":"2024-05-14T09:20:32.725951+0000","last_fullsized":"2024-05-14T09:20:32.725951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:27:57.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:11.828210+0000","last_change":"2024-05-14T09:17:57.717776+0000","last_active":"2024-05-14T09:20:11.828210+0000","last_peered":"2024-05-14T09:20:11.828210+0000","last_clean":"2024-05-14T09:20:11.828210+0000","last_became_active":"2024-05-14T09:17:57.717338+0000","last_became_peered":"2024-05-14T09:17:57.717338+0000","last_unstale":"2024-05-14T09:20:11.828210+0000","last_undegraded":"2024-05-14T09:20:11.828210+0000","last_fullsized":"2024-05-14T09:20:11.828210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:38.441355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.270936+0000","last_change":"2024-05-14T09:18:02.786286+0000","last_active":"2024-05-14T09:21:10.270936+0000","last_peered":"2024-05-14T09:21:10.270936+0000","last_clean":"2024-05-14T09:21:10.270936+0000","last_became_active":"2024-05-14T09:18:02.785915+0000","last_became_peered":"2024-05-14T09:18:02.785915+0000","last_unstale":"2024-05-14T09:21:10.270936+0000","last_undegraded":"2024-05-14T09:21:10.270936+0000","last_fullsized":"2024-05-14T09:21:10.270936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:54:08.960145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:26.831575+0000","last_change":"2024-05-14T09:18:15.889692+0000","last_active":"2024-05-14T09:20:26.831575+0000","last_peered":"2024-05-14T09:20:26.831575+0000","last_clean":"2024-05-14T09:20:26.831575+0000","last_became_active":"2024-05-14T09:18:15.888675+0000","last_became_peered":"2024-05-14T09:18:15.888675+0000","last_unstale":"2024-05-14T09:20:26.831575+0000","last_undegraded":"2024-05-14T09:20:26.831575+0000","last_fullsized":"2024-05-14T09:20:26.831575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:14.839880+0000","last_clean_scrub_stamp":"2024-05-14T09:18:14.839880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:11:20.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:20:13.079415+0000","last_change":"2024-05-14T09:17:57.694782+0000","last_active":"2024-05-14T09:20:13.079415+0000","last_peered":"2024-05-14T09:20:13.079415+0000","last_clean":"2024-05-14T09:20:13.079415+0000","last_became_active":"2024-05-14T09:17:57.693913+0000","last_became_peered":"2024-05-14T09:17:57.693913+0000","last_unstale":"2024-05-14T09:20:13.079415+0000","last_undegraded":"2024-05-14T09:20:13.079415+0000","last_fullsized":"2024-05-14T09:20:13.079415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:17:56.661704+0000","last_clean_scrub_stamp":"2024-05-14T09:17:56.661704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:36:10.758138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.280445+0000","last_change":"2024-05-14T09:18:02.784340+0000","last_active":"2024-05-14T09:21:10.280445+0000","last_peered":"2024-05-14T09:21:10.280445+0000","last_clean":"2024-05-14T09:21:10.280445+0000","last_became_active":"2024-05-14T09:18:02.783905+0000","last_became_peered":"2024-05-14T09:18:02.783905+0000","last_unstale":"2024-05-14T09:21:10.280445+0000","last_undegraded":"2024-05-14T09:21:10.280445+0000","last_fullsized":"2024-05-14T09:21:10.280445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:57:57.219324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.275048+0000","last_change":"2024-05-14T09:18:02.789214+0000","last_active":"2024-05-14T09:21:10.275048+0000","last_peered":"2024-05-14T09:21:10.275048+0000","last_clean":"2024-05-14T09:21:10.275048+0000","last_became_active":"2024-05-14T09:18:02.788764+0000","last_became_peered":"2024-05-14T09:18:02.788764+0000","last_unstale":"2024-05-14T09:21:10.275048+0000","last_undegraded":"2024-05-14T09:21:10.275048+0000","last_fullsized":"2024-05-14T09:21:10.275048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:34:13.665828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.277543+0000","last_change":"2024-05-14T09:18:02.782255+0000","last_active":"2024-05-14T09:21:10.277543+0000","last_peered":"2024-05-14T09:21:10.277543+0000","last_clean":"2024-05-14T09:21:10.277543+0000","last_became_active":"2024-05-14T09:18:02.781817+0000","last_became_peered":"2024-05-14T09:18:02.781817+0000","last_unstale":"2024-05-14T09:21:10.277543+0000","last_undegraded":"2024-05-14T09:21:10.277543+0000","last_fullsized":"2024-05-14T09:21:10.277543+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:56:31.544934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.267934+0000","last_change":"2024-05-14T09:18:02.781737+0000","last_active":"2024-05-14T09:21:10.267934+0000","last_peered":"2024-05-14T09:21:10.267934+0000","last_clean":"2024-05-14T09:21:10.267934+0000","last_became_active":"2024-05-14T09:18:02.778429+0000","last_became_peered":"2024-05-14T09:18:02.778429+0000","last_unstale":"2024-05-14T09:21:10.267934+0000","last_undegraded":"2024-05-14T09:21:10.267934+0000","last_fullsized":"2024-05-14T09:21:10.267934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:52.699915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.290185+0000","last_change":"2024-05-14T09:18:02.787107+0000","last_active":"2024-05-14T09:21:10.290185+0000","last_peered":"2024-05-14T09:21:10.290185+0000","last_clean":"2024-05-14T09:21:10.290185+0000","last_became_active":"2024-05-14T09:18:02.786259+0000","last_became_peered":"2024-05-14T09:18:02.786259+0000","last_unstale":"2024-05-14T09:21:10.290185+0000","last_undegraded":"2024-05-14T09:21:10.290185+0000","last_fullsized":"2024-05-14T09:21:10.290185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:50.103862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.287907+0000","last_change":"2024-05-14T09:18:02.792086+0000","last_active":"2024-05-14T09:21:10.287907+0000","last_peered":"2024-05-14T09:21:10.287907+0000","last_clean":"2024-05-14T09:21:10.287907+0000","last_became_active":"2024-05-14T09:18:02.785795+0000","last_became_peered":"2024-05-14T09:18:02.785795+0000","last_unstale":"2024-05-14T09:21:10.287907+0000","last_undegraded":"2024-05-14T09:21:10.287907+0000","last_fullsized":"2024-05-14T09:21:10.287907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:58.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.272731+0000","last_change":"2024-05-14T09:18:02.787934+0000","last_active":"2024-05-14T09:21:10.272731+0000","last_peered":"2024-05-14T09:21:10.272731+0000","last_clean":"2024-05-14T09:21:10.272731+0000","last_became_active":"2024-05-14T09:18:02.787030+0000","last_became_peered":"2024-05-14T09:18:02.787030+0000","last_unstale":"2024-05-14T09:21:10.272731+0000","last_undegraded":"2024-05-14T09:21:10.272731+0000","last_fullsized":"2024-05-14T09:21:10.272731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:02:57.521485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.292854+0000","last_change":"2024-05-14T09:18:02.791714+0000","last_active":"2024-05-14T09:21:10.292854+0000","last_peered":"2024-05-14T09:21:10.292854+0000","last_clean":"2024-05-14T09:21:10.292854+0000","last_became_active":"2024-05-14T09:18:02.791184+0000","last_became_peered":"2024-05-14T09:18:02.791184+0000","last_unstale":"2024-05-14T09:21:10.292854+0000","last_undegraded":"2024-05-14T09:21:10.292854+0000","last_fullsized":"2024-05-14T09:21:10.292854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:55:03.943446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.271112+0000","last_change":"2024-05-14T09:18:02.790270+0000","last_active":"2024-05-14T09:21:10.271112+0000","last_peered":"2024-05-14T09:21:10.271112+0000","last_clean":"2024-05-14T09:21:10.271112+0000","last_became_active":"2024-05-14T09:18:02.789845+0000","last_became_peered":"2024-05-14T09:18:02.789845+0000","last_unstale":"2024-05-14T09:21:10.271112+0000","last_undegraded":"2024-05-14T09:21:10.271112+0000","last_fullsized":"2024-05-14T09:21:10.271112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:10:43.469279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.278395+0000","last_change":"2024-05-14T09:18:02.778122+0000","last_active":"2024-05-14T09:21:10.278395+0000","last_peered":"2024-05-14T09:21:10.278395+0000","last_clean":"2024-05-14T09:21:10.278395+0000","last_became_active":"2024-05-14T09:18:02.775013+0000","last_became_peered":"2024-05-14T09:18:02.775013+0000","last_unstale":"2024-05-14T09:21:10.278395+0000","last_undegraded":"2024-05-14T09:21:10.278395+0000","last_fullsized":"2024-05-14T09:21:10.278395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:49:35.138229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.266845+0000","last_change":"2024-05-14T09:18:41.667927+0000","last_active":"2024-05-14T09:21:10.266845+0000","last_peered":"2024-05-14T09:21:10.266845+0000","last_clean":"2024-05-14T09:21:10.266845+0000","last_became_active":"2024-05-14T09:18:41.667390+0000","last_became_peered":"2024-05-14T09:18:41.667390+0000","last_unstale":"2024-05-14T09:21:10.266845+0000","last_undegraded":"2024-05-14T09:21:10.266845+0000","last_fullsized":"2024-05-14T09:21:10.266845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:47.648872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.291545+0000","last_change":"2024-05-14T09:18:02.794924+0000","last_active":"2024-05-14T09:21:10.291545+0000","last_peered":"2024-05-14T09:21:10.291545+0000","last_clean":"2024-05-14T09:21:10.291545+0000","last_became_active":"2024-05-14T09:18:02.794505+0000","last_became_peered":"2024-05-14T09:18:02.794505+0000","last_unstale":"2024-05-14T09:21:10.291545+0000","last_undegraded":"2024-05-14T09:21:10.291545+0000","last_fullsized":"2024-05-14T09:21:10.291545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:39.150209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.289384+0000","last_change":"2024-05-14T09:18:02.781514+0000","last_active":"2024-05-14T09:21:10.289384+0000","last_peered":"2024-05-14T09:21:10.289384+0000","last_clean":"2024-05-14T09:21:10.289384+0000","last_became_active":"2024-05-14T09:18:02.779948+0000","last_became_peered":"2024-05-14T09:18:02.779948+0000","last_unstale":"2024-05-14T09:21:10.289384+0000","last_undegraded":"2024-05-14T09:21:10.289384+0000","last_fullsized":"2024-05-14T09:21:10.289384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:25.125018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-14T09:21:10.284228+0000","last_change":"2024-05-14T09:18:02.785558+0000","last_active":"2024-05-14T09:21:10.284228+0000","last_peered":"2024-05-14T09:21:10.284228+0000","last_clean":"2024-05-14T09:21:10.284228+0000","last_became_active":"2024-05-14T09:18:02.785086+0000","last_became_peered":"2024-05-14T09:18:02.785086+0000","last_unstale":"2024-05-14T09:21:10.284228+0000","last_undegraded":"2024-05-14T09:21:10.284228+0000","last_fullsized":"2024-05-14T09:21:10.284228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:18:01.705298+0000","last_clean_scrub_stamp":"2024-05-14T09:18:01.705298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:39:13.087341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":83196,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2364,"num_read_kb":1276,"num_write":285,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":249588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678101,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":519862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874331,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28724,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716428,"statfs":{"total":95995035648,"available":95965622272,"internally_reserved":0,"allocated":1748992,"data_stored":1183332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":518603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234090,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":518869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430321,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1117582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593849,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":515116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1118208,"data_stored":589416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738534,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":516572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411480,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":588946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149840,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":513815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953608,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":520289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790082,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1667072,"data_stored":1111678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":75561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:23:26.066 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:23:26.543 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:26.907 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:26 smithi120 ceph-mon[31085]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:26.907 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:26 smithi120 ceph-mon[31085]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:26.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:26 smithi152 ceph-mon[34868]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:26.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:26 smithi152 ceph-mon[34868]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:26.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:26 smithi175 ceph-mon[35353]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:26.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:26 smithi175 ceph-mon[35353]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T09:23:27.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:27 smithi120 ceph-mon[31085]: pgmap v553: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-14T09:23:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:27 smithi152 ceph-mon[34868]: pgmap v553: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-14T09:23:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:27 smithi175 ceph-mon[35353]: pgmap v553: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-14T09:23:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 -- 172.21.15.120:0/1044347658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4108d30 msgr2=0x7fe0f4109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 --2- 172.21.15.120:0/1044347658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4108d30 0x7fe0f4109140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00099c0 tx=0x7fe0e0009cd0 comp rx=0 tx=0).stop 2024-05-14T09:23:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 -- 172.21.15.120:0/1044347658 shutdown_connections 2024-05-14T09:23:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 --2- 172.21.15.120:0/1044347658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4109680 0x7fe0f4110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 --2- 172.21.15.120:0/1044347658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f4104400 0x7fe0f4104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 --2- 172.21.15.120:0/1044347658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4108d30 0x7fe0f4109140 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:28.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 -- 172.21.15.120:0/1044347658 >> 172.21.15.120:0/1044347658 conn(0x7fe0f4079d10 msgr2=0x7fe0f407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:28.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 -- 172.21.15.120:0/1044347658 shutdown_connections 2024-05-14T09:23:28.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.951+0000 7fe0f9400700 1 -- 172.21.15.120:0/1044347658 wait complete. 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.952+0000 7fe0f9400700 1 Processor -- start 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.952+0000 7fe0f9400700 1 -- start start 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f9400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4104400 0x7fe0f419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f9400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f4108d30 0x7fe0f419d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f9400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4109680 0x7fe0f41a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f9400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4114190 con 0x7fe0f4109680 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f9400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4114010 con 0x7fe0f4104400 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f9400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4114310 con 0x7fe0f4108d30 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f8a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4109680 0x7fe0f41a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:28.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f8a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4109680 0x7fe0f41a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35142/0 (socket says 172.21.15.120:35142) 2024-05-14T09:23:28.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.953+0000 7fe0f8a00700 1 -- 172.21.15.120:0/2208136883 learned_addr learned my addr 172.21.15.120:0/2208136883 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:28.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f3400700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f4108d30 0x7fe0f419d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:28.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f3e00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4104400 0x7fe0f419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f8a00700 1 -- 172.21.15.120:0/2208136883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f4108d30 msgr2=0x7fe0f419d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f8a00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f4108d30 0x7fe0f419d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f8a00700 1 -- 172.21.15.120:0/2208136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4104400 msgr2=0x7fe0f419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f8a00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4104400 0x7fe0f419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f8a00700 1 -- 172.21.15.120:0/2208136883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f41a1c70 con 0x7fe0f4109680 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f3e00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4104400 0x7fe0f419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f8a00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4109680 0x7fe0f41a15d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec007ee0 tx=0x7fe0ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.954+0000 7fe0f0c00700 1 -- 172.21.15.120:0/2208136883 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00dbd0 con 0x7fe0f4109680 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.955+0000 7fe0f0c00700 1 -- 172.21.15.120:0/2208136883 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0ec00dd70 con 0x7fe0f4109680 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.955+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f41a1f60 con 0x7fe0f4109680 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.955+0000 7fe0f0c00700 1 -- 172.21.15.120:0/2208136883 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0058d0 con 0x7fe0f4109680 2024-05-14T09:23:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.955+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f41a9880 con 0x7fe0f4109680 2024-05-14T09:23:28.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.956+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f40512c0 con 0x7fe0f4109680 2024-05-14T09:23:28.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.958+0000 7fe0f0c00700 1 -- 172.21.15.120:0/2208136883 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe0ec01a020 con 0x7fe0f4109680 2024-05-14T09:23:28.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.960+0000 7fe0f0c00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe0d80b2900 0x7fe0d80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:28.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.960+0000 7fe0f0c00700 1 -- 172.21.15.120:0/2208136883 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe0ec0e1ce0 con 0x7fe0f4109680 2024-05-14T09:23:28.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.960+0000 7fe0f3e00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe0d80b2900 0x7fe0d80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:28.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.961+0000 7fe0f3e00700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe0d80b2900 0x7fe0d80b4e10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4005950 tx=0x7fe0e40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:28.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:28.965+0000 7fe0f0c00700 1 -- 172.21.15.120:0/2208136883 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe0ec010070 con 0x7fe0f4109680 2024-05-14T09:23:29.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.246+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0f41a9ab0 con 0x7fe0f4109680 2024-05-14T09:23:29.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.248+0000 7fe0f0c00700 1 -- 172.21.15.120:0/2208136883 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11957 (secure 0 0 0) 0x7fe0ec0cb070 con 0x7fe0f4109680 2024-05-14T09:23:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:29.253 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:23:16.852044+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34427,24454,34409,34388,24469]},"id":1}]} 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.251+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe0d80b2900 msgr2=0x7fe0d80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.251+0000 7fe0f9400700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe0d80b2900 0x7fe0d80b4e10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4005950 tx=0x7fe0e40058e0 comp rx=0 tx=0).stop 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.251+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4109680 msgr2=0x7fe0f41a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.251+0000 7fe0f9400700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4109680 0x7fe0f41a15d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec007ee0 tx=0x7fe0ec00d3b0 comp rx=0 tx=0).stop 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 shutdown_connections 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe0d80b2900 0x7fe0d80b4e10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4104400 0x7fe0f419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f4109680 0x7fe0f41a15d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:29.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 --2- 172.21.15.120:0/2208136883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f4108d30 0x7fe0f419d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:29.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 >> 172.21.15.120:0/2208136883 conn(0x7fe0f4079d10 msgr2=0x7fe0f41015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:29.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 shutdown_connections 2024-05-14T09:23:29.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:29.252+0000 7fe0f9400700 1 -- 172.21.15.120:0/2208136883 wait complete. 2024-05-14T09:23:29.255 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2024-05-14T09:23:29.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:29 smithi120 ceph-mon[31085]: pgmap v554: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-14T09:23:29.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:29 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2208136883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:23:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:29 smithi152 ceph-mon[34868]: pgmap v554: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-14T09:23:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:29 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2208136883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:23:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:29 smithi175 ceph-mon[35353]: pgmap v554: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-14T09:23:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:29 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2208136883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:23:30.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T09:23:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:31.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:31 smithi120 ceph-mon[31085]: pgmap v555: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-14T09:23:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:31 smithi152 ceph-mon[34868]: pgmap v555: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-14T09:23:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:31 smithi175 ceph-mon[35353]: pgmap v555: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-14T09:23:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 -- 172.21.15.120:0/2441018416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0110ba0 msgr2=0x7f29f0113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 --2- 172.21.15.120:0/2441018416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0110ba0 0x7f29f0113000 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f29e800b0a0 tx=0x7f29e800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 -- 172.21.15.120:0/2441018416 shutdown_connections 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 --2- 172.21.15.120:0/2441018416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f0075d30 0x7f29f0076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 --2- 172.21.15.120:0/2441018416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0110ba0 0x7f29f0113000 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 --2- 172.21.15.120:0/2441018416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0076680 0x7f29f0110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 -- 172.21.15.120:0/2441018416 >> 172.21.15.120:0/2441018416 conn(0x7f29f0100040 msgr2=0x7f29f0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 -- 172.21.15.120:0/2441018416 shutdown_connections 2024-05-14T09:23:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.866+0000 7f29f6c00700 1 -- 172.21.15.120:0/2441018416 wait complete. 2024-05-14T09:23:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.867+0000 7f29f6c00700 1 Processor -- start 2024-05-14T09:23:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.867+0000 7f29f6c00700 1 -- start start 2024-05-14T09:23:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29f6c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f0075d30 0x7f29f019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29f6c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0076680 0x7f29f019d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29f6c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0110ba0 0x7f29f01a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29f6c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0116530 con 0x7f29f0076680 2024-05-14T09:23:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29f6c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01163b0 con 0x7f29f0075d30 2024-05-14T09:23:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29f6c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01166b0 con 0x7f29f0110ba0 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29e7400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0076680 0x7f29f019d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29e7400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0076680 0x7f29f019d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35168/0 (socket says 172.21.15.120:35168) 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29e7400700 1 -- 172.21.15.120:0/846175360 learned_addr learned my addr 172.21.15.120:0/846175360 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29efe00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f0075d30 0x7f29f019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.868+0000 7f29f4c00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0110ba0 0x7f29f01a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29e7400700 1 -- 172.21.15.120:0/846175360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0110ba0 msgr2=0x7f29f01a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29e7400700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0110ba0 0x7f29f01a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29e7400700 1 -- 172.21.15.120:0/846175360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f0075d30 msgr2=0x7f29f019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29e7400700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f0075d30 0x7f29f019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29e7400700 1 -- 172.21.15.120:0/846175360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f01a1d90 con 0x7f29f0076680 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29efe00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f0075d30 0x7f29f019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29e7400700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0076680 0x7f29f019d460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f29d800d950 tx=0x7f29d800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29ed600700 1 -- 172.21.15.120:0/846175360 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8016070 con 0x7f29f0076680 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29ed600700 1 -- 172.21.15.120:0/846175360 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29d8010460 con 0x7f29f0076680 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.869+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f01a2080 con 0x7f29f0076680 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.870+0000 7f29ed600700 1 -- 172.21.15.120:0/846175360 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d800f620 con 0x7f29f0076680 2024-05-14T09:23:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.870+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f01a99a0 con 0x7f29f0076680 2024-05-14T09:23:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.871+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f00512c0 con 0x7f29f0076680 2024-05-14T09:23:32.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.874+0000 7f29ed600700 1 -- 172.21.15.120:0/846175360 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f29d8019070 con 0x7f29f0076680 2024-05-14T09:23:32.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.875+0000 7f29ed600700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f29d40b2880 0x7f29d40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:32.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.875+0000 7f29ed600700 1 -- 172.21.15.120:0/846175360 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f29d80e2500 con 0x7f29f0076680 2024-05-14T09:23:32.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.876+0000 7f29efe00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f29d40b2880 0x7f29d40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:32.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.876+0000 7f29efe00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f29d40b2880 0x7f29d40b4d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29e0005950 tx=0x7f29e00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:32.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:32.880+0000 7f29ed600700 1 -- 172.21.15.120:0/846175360 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f29d80a9e20 con 0x7f29f0076680 2024-05-14T09:23:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.109+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29f002e5f0 con 0x7f29f0076680 2024-05-14T09:23:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.114+0000 7f29ed600700 1 -- 172.21.15.120:0/846175360 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7f29d80a9720 con 0x7f29f0076680 2024-05-14T09:23:33.116 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:33.116 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:23:33.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f29d40b2880 msgr2=0x7f29d40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f29d40b2880 0x7f29d40b4d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29e0005950 tx=0x7f29e00058e0 comp rx=0 tx=0).stop 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0076680 msgr2=0x7f29f019d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0076680 0x7f29f019d460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f29d800d950 tx=0x7f29d800dd10 comp rx=0 tx=0).stop 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 shutdown_connections 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f29d40b2880 0x7f29d40b4d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f0075d30 0x7f29f019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0110ba0 0x7f29f01a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 --2- 172.21.15.120:0/846175360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29f0076680 0x7f29f019d460 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 >> 172.21.15.120:0/846175360 conn(0x7f29f0100040 msgr2=0x7f29f0101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 shutdown_connections 2024-05-14T09:23:33.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:33.118+0000 7f29f6c00700 1 -- 172.21.15.120:0/846175360 wait complete. 2024-05-14T09:23:33.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:33 smithi120 ceph-mon[31085]: pgmap v556: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T09:23:33.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:33 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/846175360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:23:33.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:33 smithi152 ceph-mon[34868]: pgmap v556: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T09:23:33.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:33 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/846175360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:23:33.962 DEBUG:tasks.fwd_scrub:Yielding 2024-05-14T09:23:33.962 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-14T09:23:33.972 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:23:33.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-14T09:23:33.973 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-14T09:23:33.973 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T09:23:33.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T09:23:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:33 smithi175 ceph-mon[35353]: pgmap v556: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T09:23:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:33 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/846175360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:23:33.980 INFO:teuthology.run_tasks:Running task exec... 2024-05-14T09:23:33.991 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T09:23:33.992 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:23:33.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-05-14T09:23:34.088 INFO:teuthology.orchestra.run.smithi120.stdout:total 0 2024-05-14T09:23:34.117 INFO:teuthology.orchestra.run.smithi120.stdout:Filesystem Size Used Avail Use% Mounted on 2024-05-14T09:23:34.117 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-fuse 1.1T 356M 1.1T 1% /tmp/cephfs 2024-05-14T09:23:34.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-05-14T09:23:34.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-05-14T09:23:34.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-05-14T09:23:34.416 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:35 smithi152 ceph-mon[34868]: pgmap v557: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:35.971 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:35 smithi120 ceph-mon[31085]: pgmap v557: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:35 smithi175 ceph-mon[35353]: pgmap v557: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T09:23:36.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-05-14T09:23:36.789 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-05-14T09:23:36.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-05-14T09:23:36.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-14T09:23:37.052 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/: 2024-05-14T09:23:37.052 INFO:teuthology.orchestra.run.smithi120.stdout:total 2 2024-05-14T09:23:37.052 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:23:37.052 INFO:teuthology.orchestra.run.smithi120.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 .. 2024-05-14T09:23:37.052 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 data 2024-05-14T09:23:37.053 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:23:37.053 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data: 2024-05-14T09:23:37.053 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:23:37.053 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:23:37.053 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 .. 2024-05-14T09:23:37.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-05-14T09:23:37.186 INFO:teuthology.orchestra.run.smithi120.stdout:[Service] 2024-05-14T09:23:37.186 INFO:teuthology.orchestra.run.smithi120.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-05-14T09:23:37.186 INFO:teuthology.orchestra.run.smithi120.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-05-14T09:23:37.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-05-14T09:23:37.400 INFO:teuthology.orchestra.run.smithi120.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 -- 172.21.15.120:0/1041917405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 msgr2=0x7facc8110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 --2- 172.21.15.120:0/1041917405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc8110710 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7facb4009990 tx=0x7facb4009ca0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 -- 172.21.15.120:0/1041917405 shutdown_connections 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 --2- 172.21.15.120:0/1041917405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facc81030a0 0x7facc81034b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 --2- 172.21.15.120:0/1041917405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc8110c50 0x7facc8113070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 --2- 172.21.15.120:0/1041917405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc8110710 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 -- 172.21.15.120:0/1041917405 >> 172.21.15.120:0/1041917405 conn(0x7facc80fef30 msgr2=0x7facc8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 -- 172.21.15.120:0/1041917405 shutdown_connections 2024-05-14T09:23:37.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.476+0000 7facccc00700 1 -- 172.21.15.120:0/1041917405 wait complete. 2024-05-14T09:23:37.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.477+0000 7facccc00700 1 Processor -- start 2024-05-14T09:23:37.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facccc00700 1 -- start start 2024-05-14T09:23:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facccc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81030a0 0x7facc8105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facccc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc81058c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facccc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facc8110c50 0x7facc8105e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facccc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7facc8116530 con 0x7facc8103a80 2024-05-14T09:23:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facccc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7facc81163b0 con 0x7facc8110c50 2024-05-14T09:23:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facccc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facc81166b0 con 0x7facc81030a0 2024-05-14T09:23:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facc5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc81058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facc5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc81058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35188/0 (socket says 172.21.15.120:35188) 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.478+0000 7facc5400700 1 -- 172.21.15.120:0/2039217634 learned_addr learned my addr 172.21.15.120:0/2039217634 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc5e00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81030a0 0x7facc8105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc6800700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facc8110c50 0x7facc8105e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc5400700 1 -- 172.21.15.120:0/2039217634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81030a0 msgr2=0x7facc8105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc5400700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81030a0 0x7facc8105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc5400700 1 -- 172.21.15.120:0/2039217634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facc8110c50 msgr2=0x7facc8105e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc5400700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facc8110c50 0x7facc8105e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc5400700 1 -- 172.21.15.120:0/2039217634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc81ad580 con 0x7facc8103a80 2024-05-14T09:23:37.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.479+0000 7facc5400700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc81058c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7facb4006010 tx=0x7facb4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:37.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.480+0000 7facbea00700 1 -- 172.21.15.120:0/2039217634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4027070 con 0x7facc8103a80 2024-05-14T09:23:37.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.480+0000 7facbea00700 1 -- 172.21.15.120:0/2039217634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facb400fcf0 con 0x7facc8103a80 2024-05-14T09:23:37.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.480+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc81ad7b0 con 0x7facc8103a80 2024-05-14T09:23:37.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.480+0000 7facbea00700 1 -- 172.21.15.120:0/2039217634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4022e50 con 0x7facc8103a80 2024-05-14T09:23:37.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.480+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81adc00 con 0x7facc8103a80 2024-05-14T09:23:37.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.485+0000 7facbea00700 1 -- 172.21.15.120:0/2039217634 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7facb402a070 con 0x7facc8103a80 2024-05-14T09:23:37.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.487+0000 7facdb74cb80 1 Processor -- start 2024-05-14T09:23:37.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.487+0000 7facdb74cb80 1 -- start start 2024-05-14T09:23:37.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148105ec0 0x556148289370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5561482898b0 0x556148283530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facbea00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facac0b2a20 0x7facac0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x556148283e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facdb74cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5561481a5aa0 con 0x556148105ec0 2024-05-14T09:23:37.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facdb74cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5561481437e0 con 0x5561482898b0 2024-05-14T09:23:37.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facdb74cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5561481a1a60 con 0x556148283a70 2024-05-14T09:23:37.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.488+0000 7facbea00700 1 -- 172.21.15.120:0/2039217634 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7facb40e3480 con 0x7facc8103a80 2024-05-14T09:23:37.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.489+0000 7facc5e00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facac0b2a20 0x7facac0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.489+0000 7facc5400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5561482898b0 0x556148283530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.489+0000 7facc5400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5561482898b0 0x556148283530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:35562/0 (socket says 172.21.15.120:35562) 2024-05-14T09:23:37.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.489+0000 7facc5400700 1 -- 172.21.15.120:0/1972864577 learned_addr learned my addr 172.21.15.120:0/1972864577 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:37.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.489+0000 7facc6800700 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148105ec0 0x556148289370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc5400700 1 -- 172.21.15.120:0/1972864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 msgr2=0x556148283e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc6800700 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x556148283e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc5e00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facac0b2a20 0x7facac0b4f30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7facb8005fd0 tx=0x7facb800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc5400700 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x556148283e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc5400700 1 -- 172.21.15.120:0/1972864577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148105ec0 msgr2=0x556148289370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc5400700 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148105ec0 0x556148289370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc5400700 1 -- 172.21.15.120:0/1972864577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561480f2950 con 0x5561482898b0 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.490+0000 7facc6800700 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x556148283e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:37.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.491+0000 7facc5400700 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5561482898b0 0x556148283530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facb40aa490 tx=0x7facb40a6780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e2353d86a1eb8b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:37.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.491+0000 7facb3400700 1 -- 172.21.15.120:0/1972864577 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40a9f00 con 0x5561482898b0 2024-05-14T09:23:37.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.491+0000 7facb3400700 1 -- 172.21.15.120:0/1972864577 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facb40aa2a0 con 0x5561482898b0 2024-05-14T09:23:37.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.491+0000 7facb3400700 1 -- 172.21.15.120:0/1972864577 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb407d890 con 0x5561482898b0 2024-05-14T09:23:37.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.493+0000 7facdb74cb80 1 -- 172.21.15.120:0/1972864577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5561482898b0 msgr2=0x556148283530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.493+0000 7facdb74cb80 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5561482898b0 0x556148283530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facb40aa490 tx=0x7facb40a6780 comp rx=0 tx=0).stop 2024-05-14T09:23:37.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.494+0000 7facdb74cb80 1 -- 172.21.15.120:0/1972864577 shutdown_connections 2024-05-14T09:23:37.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.494+0000 7facdb74cb80 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x556148283e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.494+0000 7facdb74cb80 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148105ec0 0x556148289370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.494+0000 7facdb74cb80 1 --2- 172.21.15.120:0/1972864577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5561482898b0 0x556148283530 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.494+0000 7facdb74cb80 1 -- 172.21.15.120:0/1972864577 >> 172.21.15.120:0/1972864577 conn(0x55614814aff0 msgr2=0x55614827e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:37.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.494+0000 7facdb74cb80 1 -- 172.21.15.120:0/1972864577 shutdown_connections 2024-05-14T09:23:37.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.494+0000 7facdb74cb80 1 -- 172.21.15.120:0/1972864577 wait complete. 2024-05-14T09:23:37.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.495+0000 7facdb74cb80 1 -- start start 2024-05-14T09:23:37.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.495+0000 7facdb74cb80 1 Processor -- start 2024-05-14T09:23:37.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.496+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614828d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.496+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x55614828d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.496+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x55614828dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.496+0000 7facdb74cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556148290150 con 0x556148283a70 2024-05-14T09:23:37.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.496+0000 7facdb74cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55614810bba0 con 0x556148105ec0 2024-05-14T09:23:37.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.496+0000 7facdb74cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5561482902d0 con 0x5561482898b0 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.496+0000 7facdb74cb80 10 client.0 _ll_register_callbacks cb 0x55614814ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x55614828d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x55614828d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35198/0 (socket says 172.21.15.120:35198) 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 -- 172.21.15.120:0/3807012700 learned_addr learned my addr 172.21.15.120:0/3807012700 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5e00700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614828d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc6800700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x55614828dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 -- 172.21.15.120:0/3807012700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 msgr2=0x55614828dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x55614828dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 -- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 msgr2=0x55614828d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614828d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5400700 1 -- 172.21.15.120:0/3807012700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55614816b4a0 con 0x556148283a70 2024-05-14T09:23:37.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.497+0000 7facc5e00700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614828d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7facc5400700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x55614828d590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7facb400b5c0 tx=0x7facb40b10b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac33ebc258a96b8d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7faca7e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7faca7e00700 1 -- 172.21.15.120:0/3807012700 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40aa790 con 0x556148283a70 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7faca7e00700 1 -- 172.21.15.120:0/3807012700 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7facb40b32e0 con 0x556148283a70 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb40aa2a0 con 0x556148283a70 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7faca7e00700 1 -- 172.21.15.120:0/3807012700 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7facb40aae90 con 0x556148283a70 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7facdb74cb80 10 client.15366 fetch_fsmap learned FSMap version 30 2024-05-14T09:23:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.498+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556148290150 con 0x556148283a70 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7faca7e00700 1 -- 172.21.15.120:0/3807012700 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facb40aa2a0 con 0x556148283a70 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7faca7e00700 1 -- 172.21.15.120:0/3807012700 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7facb40a6100 con 0x556148283a70 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7facdb74cb80 10 client.15366 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7facdb74cb80 10 client.15366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7facdb74cb80 20 client.15366 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55614829cde0 0x55614829f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7facdb74cb80 4 client.15366 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.499+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556148250240 con 0x55614829cde0 2024-05-14T09:23:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.500+0000 7facc5e00700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55614829cde0 0x55614829f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.501+0000 7facc5e00700 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55614829cde0 0x55614829f200 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3862ea016a572612 server_cookie=55f53511530aaa54 in_seq=0 out_seq=0 2024-05-14T09:23:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.501+0000 7faca7e00700 10 client.15366 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.503+0000 7faca7e00700 1 -- 172.21.15.120:0/3807012700 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556148250240 con 0x55614829cde0 2024-05-14T09:23:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.503+0000 7faca7e00700 10 client.15366 handle_command_reply: tid=0 2024-05-14T09:23:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.503+0000 7facdb74cb80 1 client.15366 shutdown 2024-05-14T09:23:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 msgr2=0x55614828d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x55614828d590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7facb400b5c0 tx=0x7facb40b10b0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 shutdown_connections 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55614829cde0 0x55614829f200 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614828d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x55614828dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3807012700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x55614828d590 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 >> 172.21.15.120:0/3807012700 conn(0x55614814aff0 msgr2=0x556148282520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7faca7e00700 0 client.15366 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 shutdown_connections 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 1 -- 172.21.15.120:0/3807012700 wait complete. 2024-05-14T09:23:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.504+0000 7facdb74cb80 20 client.15366 trim_cache size 0 max 16384 2024-05-14T09:23:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.527+0000 7facdb74cb80 1 Processor -- start 2024-05-14T09:23:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.527+0000 7facdb74cb80 1 -- start start 2024-05-14T09:23:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x556148283530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x556148278b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x5561482a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facdb74cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b6900 con 0x556148283a70 2024-05-14T09:23:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facdb74cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b8440 con 0x556148105ec0 2024-05-14T09:23:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facdb74cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b6fd0 con 0x5561482898b0 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facc5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x556148278b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facc5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x556148278b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35204/0 (socket says 172.21.15.120:35204) 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facc5400700 1 -- 172.21.15.120:0/2105682455 learned_addr learned my addr 172.21.15.120:0/2105682455 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facc5e00700 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x556148283530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.528+0000 7facc6800700 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x5561482a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facc5400700 1 -- 172.21.15.120:0/2105682455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 msgr2=0x5561482a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facc5400700 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x5561482a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facc5400700 1 -- 172.21.15.120:0/2105682455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 msgr2=0x556148283530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facc5400700 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x556148283530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facc5400700 1 -- 172.21.15.120:0/2105682455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55614828b5c0 con 0x556148283a70 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facc5400700 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x556148278b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7facb40e0f50 tx=0x7facb40a6780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb456e2ca975ad4b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facb2a00700 1 -- 172.21.15.120:0/2105682455 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb407e030 con 0x556148283a70 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facb2a00700 1 -- 172.21.15.120:0/2105682455 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facb40aa790 con 0x556148283a70 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.529+0000 7facb2a00700 1 -- 172.21.15.120:0/2105682455 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40a99f0 con 0x556148283a70 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.530+0000 7facdb74cb80 1 -- 172.21.15.120:0/2105682455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 msgr2=0x556148278b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.530+0000 7facdb74cb80 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x556148278b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7facb40e0f50 tx=0x7facb40a6780 comp rx=0 tx=0).stop 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.530+0000 7facdb74cb80 1 -- 172.21.15.120:0/2105682455 shutdown_connections 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.530+0000 7facdb74cb80 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x556148283530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.530+0000 7facdb74cb80 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561482898b0 0x5561482a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.530+0000 7facdb74cb80 1 --2- 172.21.15.120:0/2105682455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556148283a70 0x556148278b50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.530+0000 7facdb74cb80 1 -- 172.21.15.120:0/2105682455 >> 172.21.15.120:0/2105682455 conn(0x55614814aff0 msgr2=0x55614828bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.531+0000 7facdb74cb80 1 -- 172.21.15.120:0/2105682455 shutdown_connections 2024-05-14T09:23:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.531+0000 7facdb74cb80 1 -- 172.21.15.120:0/2105682455 wait complete. 2024-05-14T09:23:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.531+0000 7facdb74cb80 1 -- start start 2024-05-14T09:23:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 1 Processor -- start 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614829fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x5561482a0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5561482898b0 0x556148306330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b7d70 con 0x5561482898b0 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b76a0 con 0x556148105ec0 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b48c0 con 0x556148283a70 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.532+0000 7facdb74cb80 10 client.0 _ll_register_callbacks cb 0x55614814ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5561482898b0 0x556148306330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5561482898b0 0x556148306330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35214/0 (socket says 172.21.15.120:35214) 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 -- 172.21.15.120:0/3062560302 learned_addr learned my addr 172.21.15.120:0/3062560302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc5e00700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614829fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc5400700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x5561482a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 -- 172.21.15.120:0/3062560302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 msgr2=0x5561482a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x5561482a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 -- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 msgr2=0x55614829fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614829fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc6800700 1 -- 172.21.15.120:0/3062560302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561482a0be0 con 0x5561482898b0 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.533+0000 7facc5e00700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614829fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7facc6800700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5561482898b0 0x556148306330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7facc000abb0 tx=0x7facc000af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5bd8f3d295571d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7faca7e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7faca7e00700 1 -- 172.21.15.120:0/3062560302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc001c030 con 0x5561482898b0 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7faca7e00700 1 -- 172.21.15.120:0/3062560302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7facc0004bb0 con 0x5561482898b0 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb40aa790 con 0x5561482898b0 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7faca7e00700 1 -- 172.21.15.120:0/3062560302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7facc0026050 con 0x5561482898b0 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7facdb74cb80 10 client.15372 fetch_fsmap learned FSMap version 30 2024-05-14T09:23:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.534+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556148307950 con 0x5561482898b0 2024-05-14T09:23:37.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7faca7e00700 1 -- 172.21.15.120:0/3062560302 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facb40aa790 con 0x5561482898b0 2024-05-14T09:23:37.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7faca7e00700 1 -- 172.21.15.120:0/3062560302 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7facc0018780 con 0x5561482898b0 2024-05-14T09:23:37.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7facdb74cb80 10 client.15372 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T09:23:37.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7facdb74cb80 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:23:37.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7facdb74cb80 20 client.15372 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:37.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5561483080e0 0x55614830a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:37.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7facdb74cb80 4 client.15372 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T09:23:37.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.535+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5561481b3480 con 0x5561483080e0 2024-05-14T09:23:37.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.536+0000 7facc5e00700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5561483080e0 0x55614830a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:37.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.537+0000 7faca7e00700 10 client.15372 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:37.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.537+0000 7facc5e00700 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5561483080e0 0x55614830a500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2376a32e75cc9e9e server_cookie=9e66d7f6ea40406c in_seq=0 out_seq=0 2024-05-14T09:23:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7faca7e00700 1 -- 172.21.15.120:0/3062560302 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5561481b3480 con 0x5561483080e0 2024-05-14T09:23:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7faca7e00700 10 client.15372 handle_command_reply: tid=0 2024-05-14T09:23:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 client.15372 shutdown 2024-05-14T09:23:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5561482898b0 msgr2=0x556148306330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5561482898b0 0x556148306330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7facc000abb0 tx=0x7facc000af70 comp rx=0 tx=0).stop 2024-05-14T09:23:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 shutdown_connections 2024-05-14T09:23:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5561483080e0 0x55614830a500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556148105ec0 0x55614829fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5561482898b0 0x556148306330 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 --2- 172.21.15.120:0/3062560302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556148283a70 0x5561482a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7faca7e00700 0 client.15372 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 >> 172.21.15.120:0/3062560302 conn(0x55614814aff0 msgr2=0x556148286d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.542+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 shutdown_connections 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.543+0000 7facdb74cb80 1 -- 172.21.15.120:0/3062560302 wait complete. 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.543+0000 7facdb74cb80 20 client.15372 trim_cache size 0 max 16384 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-05-14T09:23:37.544 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "4452d397-e775-4d29-8e05-22d7493c4191", 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facac0b2a20 msgr2=0x7facac0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facac0b2a20 0x7facac0b4f30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7facb8005fd0 tx=0x7facb800a560 comp rx=0 tx=0).stop 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 msgr2=0x7facc81058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc81058c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7facb4006010 tx=0x7facb4009f90 comp rx=0 tx=0).stop 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 shutdown_connections 2024-05-14T09:23:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facac0b2a20 0x7facac0b4f30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facc8110c50 0x7facc8105e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81030a0 0x7facc8105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 --2- 172.21.15.120:0/2039217634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc8103a80 0x7facc81058c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:37.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 >> 172.21.15.120:0/2039217634 conn(0x7facc80fef30 msgr2=0x7facc81128f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:37.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 shutdown_connections 2024-05-14T09:23:37.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:37.544+0000 7facccc00700 1 -- 172.21.15.120:0/2039217634 wait complete. 2024-05-14T09:23:37.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:37 smithi120 ceph-mon[31085]: pgmap v558: 129 pgs: 129 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T09:23:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:37 smithi152 ceph-mon[34868]: pgmap v558: 129 pgs: 129 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T09:23:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:37 smithi175 ceph-mon[35353]: pgmap v558: 129 pgs: 129 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T09:23:38.482 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:23:38.689 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:38 smithi120 ceph-mon[31085]: scrub queued for path: / 2024-05-14T09:23:38.689 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:38 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:23:38.689 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:38 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:23:38.689 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:38 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:23:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:23:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:38 smithi152 ceph-mon[34868]: scrub queued for path: / 2024-05-14T09:23:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:38 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:23:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:38 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:23:38.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:38 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:23:38.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:38 smithi175 ceph-mon[35353]: scrub queued for path: / 2024-05-14T09:23:38.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:38 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:23:38.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:38 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:23:38.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:38 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:23:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:39 smithi152 ceph-mon[34868]: pgmap v559: 129 pgs: 129 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:39 smithi175 ceph-mon[35353]: pgmap v559: 129 pgs: 129 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:40.010 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:39 smithi120 ceph-mon[31085]: pgmap v559: 129 pgs: 129 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T09:23:41.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 -- 172.21.15.120:0/3217446377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 msgr2=0x7f2afc1131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 --2- 172.21.15.120:0/3217446377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1131d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2af400b0d0 tx=0x7f2af400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 -- 172.21.15.120:0/3217446377 shutdown_connections 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 --2- 172.21.15.120:0/3217446377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1131d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 --2- 172.21.15.120:0/3217446377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2afc106640 0x7f2afc106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 --2- 172.21.15.120:0/3217446377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2afc10af20 0x7f2afc10b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 -- 172.21.15.120:0/3217446377 >> 172.21.15.120:0/3217446377 conn(0x7f2afc102030 msgr2=0x7f2afc104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 -- 172.21.15.120:0/3217446377 shutdown_connections 2024-05-14T09:23:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.446+0000 7f2afb200700 1 -- 172.21.15.120:0/3217446377 wait complete. 2024-05-14T09:23:41.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.447+0000 7f2afb200700 1 Processor -- start 2024-05-14T09:23:41.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.448+0000 7f2afb200700 1 -- start start 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.448+0000 7f2afb200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2afc106640 0x7f2afc19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.448+0000 7f2afb200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2afc10af20 0x7f2afc19d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.448+0000 7f2afb200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.448+0000 7f2afb200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1163c0 con 0x7f2afc10b870 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.448+0000 7f2afb200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc116240 con 0x7f2afc106640 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.448+0000 7f2afb200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc116540 con 0x7f2afc10af20 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58940/0 (socket says 172.21.15.120:58940) 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 -- 172.21.15.120:0/2252903824 learned_addr learned my addr 172.21.15.120:0/2252903824 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2af9e00700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2afc106640 0x7f2afc19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2af3e00700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2afc10af20 0x7f2afc19d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 -- 172.21.15.120:0/2252903824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2afc10af20 msgr2=0x7f2afc19d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2afc10af20 0x7f2afc19d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 -- 172.21.15.120:0/2252903824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2afc106640 msgr2=0x7f2afc19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2afc106640 0x7f2afc19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 -- 172.21.15.120:0/2252903824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc1a1c40 con 0x7f2afc10b870 2024-05-14T09:23:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2af3e00700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2afc10af20 0x7f2afc19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.449+0000 7f2afa800700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1a15a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007d10 tx=0x7f2af4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.450+0000 7f2af2a00700 1 -- 172.21.15.120:0/2252903824 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af401f070 con 0x7f2afc10b870 2024-05-14T09:23:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.450+0000 7f2af2a00700 1 -- 172.21.15.120:0/2252903824 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2af4003e10 con 0x7f2afc10b870 2024-05-14T09:23:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.450+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc1a1ed0 con 0x7f2afc10b870 2024-05-14T09:23:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.450+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc1a23b0 con 0x7f2afc10b870 2024-05-14T09:23:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.450+0000 7f2af2a00700 1 -- 172.21.15.120:0/2252903824 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af401b820 con 0x7f2afc10b870 2024-05-14T09:23:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.455+0000 7f2af2a00700 1 -- 172.21.15.120:0/2252903824 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2af4022070 con 0x7f2afc10b870 2024-05-14T09:23:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.455+0000 7f2b0fd8bb80 1 Processor -- start 2024-05-14T09:23:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2b0fd8bb80 1 -- start start 2024-05-14T09:23:41.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe15b0e40 0x557fe1734540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe172e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 0x557fe172f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557fe1650a20 con 0x557fe15b0e40 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557fe15ee760 con 0x557fe172ec40 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557fe164c9e0 con 0x557fe1734a80 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe15b0e40 0x557fe1734540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe15b0e40 0x557fe1734540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58944/0 (socket says 172.21.15.120:58944) 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2af3e00700 1 -- 172.21.15.120:0/4077436334 learned_addr learned my addr 172.21.15.120:0/4077436334 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.456+0000 7f2af2a00700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ae00b2880 0x7f2ae00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af9e00700 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe172e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af2a00700 1 -- 172.21.15.120:0/2252903824 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2af400f020 con 0x7f2afc10b870 2024-05-14T09:23:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af3e00700 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 0x557fe172f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2afa800700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ae00b2880 0x7f2ae00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af3e00700 1 -- 172.21.15.120:0/4077436334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 msgr2=0x557fe172e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af3e00700 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe172e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af3e00700 1 -- 172.21.15.120:0/4077436334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 msgr2=0x557fe172f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af3e00700 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 0x557fe172f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.457+0000 7f2af3e00700 1 -- 172.21.15.120:0/4077436334 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe159d8d0 con 0x557fe15b0e40 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.458+0000 7f2af3e00700 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe15b0e40 0x557fe1734540 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40135d0 tx=0x7f2ae400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a700578272e3cbb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.458+0000 7f2afa800700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ae00b2880 0x7f2ae00b4d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2af40aad80 tx=0x7f2af400b3e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.458+0000 7f2aeb400700 1 -- 172.21.15.120:0/4077436334 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4019030 con 0x557fe15b0e40 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.458+0000 7f2aeb400700 1 -- 172.21.15.120:0/4077436334 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ae40044b0 con 0x557fe15b0e40 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.458+0000 7f2aeb400700 1 -- 172.21.15.120:0/4077436334 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4003e30 con 0x557fe15b0e40 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/4077436334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe15b0e40 msgr2=0x557fe1734540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe15b0e40 0x557fe1734540 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40135d0 tx=0x7f2ae400b6b0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/4077436334 shutdown_connections 2024-05-14T09:23:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 0x557fe172f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe15b0e40 0x557fe1734540 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/4077436334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe172e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/4077436334 >> 172.21.15.120:0/4077436334 conn(0x557fe15f5f70 msgr2=0x557fe1729400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/4077436334 shutdown_connections 2024-05-14T09:23:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.459+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/4077436334 wait complete. 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.460+0000 7f2b0fd8bb80 1 -- start start 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.460+0000 7f2b0fd8bb80 1 Processor -- start 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe1738130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe172ec40 0x557fe1738670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe1738bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557fe173b490 con 0x557fe172ec40 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557fe15b6b20 con 0x557fe15b0e40 2024-05-14T09:23:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557fe173b610 con 0x557fe1734a80 2024-05-14T09:23:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2b0fd8bb80 10 client.0 _ll_register_callbacks cb 0x557fe15f7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2af9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe172ec40 0x557fe1738670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2af9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe172ec40 0x557fe1738670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58952/0 (socket says 172.21.15.120:58952) 2024-05-14T09:23:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.461+0000 7f2af9e00700 1 -- 172.21.15.120:0/1698404457 learned_addr learned my addr 172.21.15.120:0/1698404457 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af3e00700 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe1738130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af3e00700 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe1738bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af9e00700 1 -- 172.21.15.120:0/1698404457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 msgr2=0x557fe1738bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af9e00700 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe1738bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af9e00700 1 -- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 msgr2=0x557fe1738130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af9e00700 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe1738130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af9e00700 1 -- 172.21.15.120:0/1698404457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe1616420 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2af9e00700 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe172ec40 0x557fe1738670 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00bf30 tx=0x7f2aec011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaabd731c4ce4ba8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.462+0000 7f2adfe00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.463+0000 7f2adfe00700 1 -- 172.21.15.120:0/1698404457 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec012450 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.463+0000 7f2adfe00700 1 -- 172.21.15.120:0/1698404457 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2aec0125f0 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.463+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae40044b0 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.463+0000 7f2adfe00700 1 -- 172.21.15.120:0/1698404457 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2aec0127f0 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.463+0000 7f2b0fd8bb80 10 client.15384 fetch_fsmap learned FSMap version 30 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.463+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fe1746060 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.463+0000 7f2adfe00700 1 -- 172.21.15.120:0/1698404457 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ae40044b0 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.464+0000 7f2adfe00700 1 -- 172.21.15.120:0/1698404457 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2aec01bad0 con 0x557fe172ec40 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.464+0000 7f2b0fd8bb80 10 client.15384 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.464+0000 7f2b0fd8bb80 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:23:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.464+0000 7f2b0fd8bb80 20 client.15384 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.464+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17486a0 0x557fe174aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.464+0000 7f2b0fd8bb80 4 client.15384 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:23:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.464+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fe16fb1c0 con 0x557fe17486a0 2024-05-14T09:23:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.465+0000 7f2af3e00700 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17486a0 0x557fe174aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.466+0000 7f2af3e00700 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17486a0 0x557fe174aac0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607523d7d3354dfa server_cookie=29f467e831d26f65 in_seq=0 out_seq=0 2024-05-14T09:23:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.466+0000 7f2adfe00700 10 client.15384 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2adfe00700 1 -- 172.21.15.120:0/1698404457 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fe16fb1c0 con 0x557fe17486a0 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2adfe00700 10 client.15384 handle_command_reply: tid=0 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 client.15384 shutdown 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe172ec40 msgr2=0x557fe1738670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe172ec40 0x557fe1738670 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00bf30 tx=0x7f2aec011770 comp rx=0 tx=0).stop 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 shutdown_connections 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17486a0 0x557fe174aac0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe1738130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe1734a80 0x557fe1738bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/1698404457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe172ec40 0x557fe1738670 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 >> 172.21.15.120:0/1698404457 conn(0x557fe15f5f70 msgr2=0x557fe172d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.470+0000 7f2adfe00700 0 client.15384 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.471+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 shutdown_connections 2024-05-14T09:23:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.471+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/1698404457 wait complete. 2024-05-14T09:23:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.471+0000 7f2b0fd8bb80 20 client.15384 trim_cache size 0 max 16384 2024-05-14T09:23:41.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.497+0000 7f2b0fd8bb80 1 Processor -- start 2024-05-14T09:23:41.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.497+0000 7f2b0fd8bb80 1 -- start start 2024-05-14T09:23:41.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe15b0e40 0x557fe172e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 0x557fe1737090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1734a80 0x557fe1732590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1b21e0 con 0x557fe1734a80 2024-05-14T09:23:41.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1b3d20 con 0x557fe172ec40 2024-05-14T09:23:41.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1b28b0 con 0x557fe15b0e40 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1734a80 0x557fe1732590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1734a80 0x557fe1732590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58954/0 (socket says 172.21.15.120:58954) 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2af3e00700 1 -- 172.21.15.120:0/843772612 learned_addr learned my addr 172.21.15.120:0/843772612 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.498+0000 7f2af3e00700 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe15b0e40 0x557fe172e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.499+0000 7f2af3e00700 1 -- 172.21.15.120:0/843772612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe15b0e40 msgr2=0x557fe172e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.499+0000 7f2af3e00700 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe15b0e40 0x557fe172e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.499+0000 7f2af3e00700 1 -- 172.21.15.120:0/843772612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 msgr2=0x557fe1737090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.499+0000 7f2af3e00700 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 0x557fe1737090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.499+0000 7f2af3e00700 1 -- 172.21.15.120:0/843772612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe1725c40 con 0x557fe1734a80 2024-05-14T09:23:41.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.499+0000 7f2af3e00700 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1734a80 0x557fe1732590 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x557fe164c640 tx=0x7f2ae4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9bb1390eb26bab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:41.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.499+0000 7f2aeaa00700 1 -- 172.21.15.120:0/843772612 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4019040 con 0x557fe1734a80 2024-05-14T09:23:41.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.500+0000 7f2aeaa00700 1 -- 172.21.15.120:0/843772612 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ae401a040 con 0x557fe1734a80 2024-05-14T09:23:41.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.500+0000 7f2aeaa00700 1 -- 172.21.15.120:0/843772612 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae401e6c0 con 0x557fe1734a80 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.500+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/843772612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1734a80 msgr2=0x557fe1732590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.500+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1734a80 0x557fe1732590 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x557fe164c640 tx=0x7f2ae4015040 comp rx=0 tx=0).stop 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/843772612 shutdown_connections 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1734a80 0x557fe1732590 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe15b0e40 0x557fe172e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/843772612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe172ec40 0x557fe1737090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/843772612 >> 172.21.15.120:0/843772612 conn(0x557fe15f5f70 msgr2=0x557fe1731e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/843772612 shutdown_connections 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/843772612 wait complete. 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.501+0000 7f2b0fd8bb80 1 -- start start 2024-05-14T09:23:41.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 1 Processor -- start 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe174f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe172ec40 0x557fe174fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1741070 0x557fe1750450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1b3650 con 0x557fe1741070 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1b2f80 con 0x557fe15b0e40 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1b01a0 con 0x557fe172ec40 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.502+0000 7f2b0fd8bb80 10 client.0 _ll_register_callbacks cb 0x557fe15f7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1741070 0x557fe1750450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1741070 0x557fe1750450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58968/0 (socket says 172.21.15.120:58968) 2024-05-14T09:23:41.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 -- 172.21.15.120:0/3803473249 learned_addr learned my addr 172.21.15.120:0/3803473249 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe174f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af9e00700 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe172ec40 0x557fe174fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 -- 172.21.15.120:0/3803473249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe172ec40 msgr2=0x557fe174fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe172ec40 0x557fe174fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 -- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 msgr2=0x557fe174f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe174f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.503+0000 7f2af3e00700 1 -- 172.21.15.120:0/3803473249 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe1729ed0 con 0x557fe1741070 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2af3e00700 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1741070 0x557fe1750450 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4015010 tx=0x7f2ae402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b97cb29e6d7f891 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:41.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2adfe00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:41.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2adfe00700 1 -- 172.21.15.120:0/3803473249 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4019070 con 0x557fe1741070 2024-05-14T09:23:41.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae401a040 con 0x557fe1741070 2024-05-14T09:23:41.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2adfe00700 1 -- 172.21.15.120:0/3803473249 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2ae402a4f0 con 0x557fe1741070 2024-05-14T09:23:41.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2adfe00700 1 -- 172.21.15.120:0/3803473249 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2ae402a6f0 con 0x557fe1741070 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2b0fd8bb80 10 client.15390 fetch_fsmap learned FSMap version 30 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.504+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fe17b3180 con 0x557fe1741070 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2adfe00700 1 -- 172.21.15.120:0/3803473249 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ae401a040 con 0x557fe1741070 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2adfe00700 1 -- 172.21.15.120:0/3803473249 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2ae4010420 con 0x557fe1741070 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2b0fd8bb80 10 client.15390 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2b0fd8bb80 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2b0fd8bb80 20 client.15390 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17b34e0 0x557fe17b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2b0fd8bb80 4 client.15390 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.505+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557fe165e400 con 0x557fe17b34e0 2024-05-14T09:23:41.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.506+0000 7f2af9e00700 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17b34e0 0x557fe17b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:41.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.507+0000 7f2af9e00700 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17b34e0 0x557fe17b5900 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e3121347e32295b server_cookie=4d3f2281a2e993c4 in_seq=0 out_seq=0 2024-05-14T09:23:41.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.507+0000 7f2adfe00700 10 client.15390 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:41.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.509+0000 7f2adfe00700 1 -- 172.21.15.120:0/3803473249 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557fe165e400 con 0x557fe17b34e0 2024-05-14T09:23:41.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.509+0000 7f2adfe00700 10 client.15390 handle_command_reply: tid=0 2024-05-14T09:23:41.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.509+0000 7f2b0fd8bb80 1 client.15390 shutdown 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1741070 msgr2=0x557fe1750450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1741070 0x557fe1750450 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4015010 tx=0x7f2ae402c040 comp rx=0 tx=0).stop 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 shutdown_connections 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557fe17b34e0 0x557fe17b5900 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557fe15b0e40 0x557fe174f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2adfe00700 0 client.15390 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fe1741070 0x557fe1750450 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 --2- 172.21.15.120:0/3803473249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557fe172ec40 0x557fe174fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 >> 172.21.15.120:0/3803473249 conn(0x557fe15f5f70 msgr2=0x557fe17232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 shutdown_connections 2024-05-14T09:23:41.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 1 -- 172.21.15.120:0/3803473249 wait complete. 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.510+0000 7f2b0fd8bb80 20 client.15390 trim_cache size 0 max 16384 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout: "4452d397-e775-4d29-8e05-22d7493c4191": { 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "4452d397-e775-4d29-8e05-22d7493c4191", 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-05-14T09:23:41.512 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:23:41.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:23:41.513 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:23:41.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ae00b2880 msgr2=0x7f2ae00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ae00b2880 0x7f2ae00b4d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2af40aad80 tx=0x7f2af400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 msgr2=0x7f2afc1a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1a15a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007d10 tx=0x7f2af4007df0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 shutdown_connections 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ae00b2880 0x7f2ae00b4d90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2afc106640 0x7f2afc19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc10b870 0x7f2afc1a15a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 --2- 172.21.15.120:0/2252903824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2afc10af20 0x7f2afc19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.511+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 >> 172.21.15.120:0/2252903824 conn(0x7f2afc102030 msgr2=0x7f2afc10a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.512+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 shutdown_connections 2024-05-14T09:23:41.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:23:41.512+0000 7f2afb200700 1 -- 172.21.15.120:0/2252903824 wait complete. 2024-05-14T09:23:41.955 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:41 smithi120 ceph-mon[31085]: pgmap v560: 129 pgs: 129 active+clean; 721 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-05-14T09:23:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:41 smithi152 ceph-mon[34868]: pgmap v560: 129 pgs: 129 active+clean; 721 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-05-14T09:23:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:41 smithi175 ceph-mon[35353]: pgmap v560: 129 pgs: 129 active+clean; 721 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-05-14T09:23:42.508 INFO:tasks.cephfs.filesystem:scrub status for tag:4452d397-e775-4d29-8e05-22d7493c4191 - {'path': '/', 'tag': '4452d397-e775-4d29-8e05-22d7493c4191', 'options': 'recursive,force'} 2024-05-14T09:23:43.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:43 smithi152 ceph-mon[34868]: pgmap v561: 129 pgs: 129 active+clean; 5.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 389 KiB/s wr, 15 op/s 2024-05-14T09:23:43.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:43 smithi175 ceph-mon[35353]: pgmap v561: 129 pgs: 129 active+clean; 5.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 389 KiB/s wr, 15 op/s 2024-05-14T09:23:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:43 smithi120 ceph-mon[31085]: pgmap v561: 129 pgs: 129 active+clean; 5.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 389 KiB/s wr, 15 op/s 2024-05-14T09:23:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:45 smithi175 ceph-mon[35353]: pgmap v562: 129 pgs: 129 active+clean; 18 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-05-14T09:23:46.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:45 smithi120 ceph-mon[31085]: pgmap v562: 129 pgs: 129 active+clean; 18 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-05-14T09:23:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:45 smithi152 ceph-mon[34868]: pgmap v562: 129 pgs: 129 active+clean; 18 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-05-14T09:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.309+0000 7f8a11600640 1 -- 172.21.15.120:0/4289762694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c105ca0 msgr2=0x7f8a0c1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.309+0000 7f8a11600640 1 --2- 172.21.15.120:0/4289762694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c105ca0 0x7f8a0c1069a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009900 tx=0x7f89fc02a3f0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.310+0000 7f8a11600640 1 -- 172.21.15.120:0/4289762694 shutdown_connections 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.310+0000 7f8a11600640 1 --2- 172.21.15.120:0/4289762694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a0c10bbe0 0x7f8a0c10e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.310+0000 7f8a11600640 1 --2- 172.21.15.120:0/4289762694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a0c106ee0 0x7f8a0c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.310+0000 7f8a11600640 1 --2- 172.21.15.120:0/4289762694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c105ca0 0x7f8a0c1069a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.310+0000 7f8a11600640 1 -- 172.21.15.120:0/4289762694 >> 172.21.15.120:0/4289762694 conn(0x7f8a0c100eb0 msgr2=0x7f8a0c103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.310+0000 7f8a11600640 1 -- 172.21.15.120:0/4289762694 shutdown_connections 2024-05-14T09:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.310+0000 7f8a11600640 1 -- 172.21.15.120:0/4289762694 wait complete. 2024-05-14T09:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.311+0000 7f8a11600640 1 Processor -- start 2024-05-14T09:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.311+0000 7f8a11600640 1 -- start start 2024-05-14T09:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a11600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a0c105ca0 0x7f8a0c19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a11600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a0c106ee0 0x7f8a0c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a11600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c10bbe0 0x7f8a0c1a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a11600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c111680 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a11600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c111500 con 0x7f8a0c106ee0 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a11600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c111800 con 0x7f8a0c105ca0 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a10c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c10bbe0 0x7f8a0c1a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a10c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c10bbe0 0x7f8a0c1a3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58980/0 (socket says 172.21.15.120:58980) 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a10c00640 1 -- 172.21.15.120:0/1111714583 learned_addr learned my addr 172.21.15.120:0/1111714583 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a03e00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a0c106ee0 0x7f8a0c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.312+0000 7f8a0be00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a0c105ca0 0x7f8a0c19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a10c00640 1 -- 172.21.15.120:0/1111714583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a0c105ca0 msgr2=0x7f8a0c19c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a10c00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a0c105ca0 0x7f8a0c19c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a10c00640 1 -- 172.21.15.120:0/1111714583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a0c106ee0 msgr2=0x7f8a0c19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a10c00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a0c106ee0 0x7f8a0c19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a10c00640 1 -- 172.21.15.120:0/1111714583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c1a3ce0 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a03e00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a0c106ee0 0x7f8a0c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a10c00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c10bbe0 0x7f8a0c1a3720 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400cce0 tx=0x7f8a0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.313+0000 7f8a09600640 1 -- 172.21.15.120:0/1111714583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400f450 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.314+0000 7f8a09600640 1 -- 172.21.15.120:0/1111714583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a0400fa80 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.314+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c1a3fd0 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.314+0000 7f8a09600640 1 -- 172.21.15.120:0/1111714583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04018ad0 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.314+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c1a43e0 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.317+0000 7f8a19c22740 1 Processor -- start 2024-05-14T09:23:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.317+0000 7f8a09600640 1 -- 172.21.15.120:0/1111714583 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8a0400f5f0 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a19c22740 1 -- start start 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2918300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2918880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b291f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a19c22740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653b287c550 con 0x5653b25554d0 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a19c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5653b2821bc0 con 0x5653b25761b0 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a19c22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5653b2878510 con 0x5653b254d2f0 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.318+0000 7f8a03e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b291f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b291f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58984/0 (socket says 172.21.15.120:58984) 2024-05-14T09:23:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 -- 172.21.15.120:0/399733962 learned_addr learned my addr 172.21.15.120:0/399733962 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a0be00640 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2918880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2918300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 -- 172.21.15.120:0/399733962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 msgr2=0x5653b2918880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2918880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 -- 172.21.15.120:0/399733962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 msgr2=0x5653b2918300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2918300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a03e00640 1 -- 172.21.15.120:0/399733962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b258e210 con 0x5653b25554d0 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.319+0000 7f8a09600640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89f00b27e0 0x7f89f00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.320+0000 7f8a09600640 1 -- 172.21.15.120:0/1111714583 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8a040e2de0 con 0x7f8a0c10bbe0 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.320+0000 7f8a03e00640 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b291f780 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89f4012610 tx=0x7f89f400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e5f10180cdc0bf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.320+0000 7f8a0be00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89f00b27e0 0x7f89f00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.320+0000 7f8a01200640 1 -- 172.21.15.120:0/399733962 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4018070 con 0x5653b25554d0 2024-05-14T09:23:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.320+0000 7f8a01200640 1 -- 172.21.15.120:0/399733962 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89f4010c30 con 0x5653b25554d0 2024-05-14T09:23:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.320+0000 7f8a01200640 1 -- 172.21.15.120:0/399733962 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4003a10 con 0x5653b25554d0 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a0be00640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89f00b27e0 0x7f89f00b4cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89fc02a910 tx=0x7f89fc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 -- 172.21.15.120:0/399733962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 msgr2=0x5653b291f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b291f780 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89f4012610 tx=0x7f89f400b700 comp rx=0 tx=0).stop 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 -- 172.21.15.120:0/399733962 shutdown_connections 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b291f780 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2918880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 --2- 172.21.15.120:0/399733962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2918300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 -- 172.21.15.120:0/399733962 >> 172.21.15.120:0/399733962 conn(0x5653b256a300 msgr2=0x5653b2913c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 -- 172.21.15.120:0/399733962 shutdown_connections 2024-05-14T09:23:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.321+0000 7f8a19c22740 1 -- 172.21.15.120:0/399733962 wait complete. 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.322+0000 7f8a19c22740 1 -- start start 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.322+0000 7f8a19c22740 1 Processor -- start 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b254d2f0 0x5653b2921e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b25554d0 0x5653b29223c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2929320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a19c22740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653b29201d0 con 0x5653b254d2f0 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a19c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5653b2835660 con 0x5653b25761b0 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a19c22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5653b2920350 con 0x5653b25554d0 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a19c22740 10 client.0 _ll_register_callbacks cb 0x5653b27ff400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b254d2f0 0x5653b2921e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b254d2f0 0x5653b2921e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58990/0 (socket says 172.21.15.120:58990) 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a0be00640 1 -- 172.21.15.120:0/2992951939 learned_addr learned my addr 172.21.15.120:0/2992951939 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a03e00640 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b25554d0 0x5653b29223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.323+0000 7f8a10c00640 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2929320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f8a0be00640 1 -- 172.21.15.120:0/2992951939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b25554d0 msgr2=0x5653b29223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f8a0be00640 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b25554d0 0x5653b29223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f8a0be00640 1 -- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 msgr2=0x5653b2929320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f8a0be00640 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2929320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f8a0be00640 1 -- 172.21.15.120:0/2992951939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b265a620 con 0x5653b254d2f0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f8a0be00640 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b254d2f0 0x5653b2921e80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f89fc005f70 tx=0x7f89fc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15df3c3b0e59f224 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f89f9600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f89f9600640 1 -- 172.21.15.120:0/2992951939 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc035040 con 0x5653b254d2f0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f89f9600640 1 -- 172.21.15.120:0/2992951939 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f89fc031910 con 0x5653b254d2f0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.324+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f4010c30 con 0x5653b254d2f0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f89f9600640 1 -- 172.21.15.120:0/2992951939 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f89fc05a050 con 0x5653b254d2f0 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 10 client.15402 fetch_fsmap learned FSMap version 30 2024-05-14T09:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653b292c2c0 con 0x5653b254d2f0 2024-05-14T09:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f89f9600640 1 -- 172.21.15.120:0/2992951939 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89f4010c30 con 0x5653b254d2f0 2024-05-14T09:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f89f9600640 1 -- 172.21.15.120:0/2992951939 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f89fc044030 con 0x5653b254d2f0 2024-05-14T09:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 10 client.15402 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 20 client.15402 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b2534d80 0x5653b292f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 4 client.15402 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.325+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653b288a160 con 0x5653b2534d80 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.326+0000 7f8a03e00640 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b2534d80 0x5653b292f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.327+0000 7f8a03e00640 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b2534d80 0x5653b292f8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c053f37c8de06d42 server_cookie=9c134de8fe752bfd in_seq=0 out_seq=0 2024-05-14T09:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.327+0000 7f89f9600640 10 client.15402 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.329+0000 7f89f9600640 1 -- 172.21.15.120:0/2992951939 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5653b288a160 con 0x5653b2534d80 2024-05-14T09:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.329+0000 7f89f9600640 10 client.15402 handle_command_reply: tid=0 2024-05-14T09:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.329+0000 7f8a19c22740 1 client.15402 shutdown 2024-05-14T09:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b254d2f0 msgr2=0x5653b2921e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b254d2f0 0x5653b2921e80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f89fc005f70 tx=0x7f89fc009260 comp rx=0 tx=0).stop 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 shutdown_connections 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b2534d80 0x5653b292f8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b25761b0 0x5653b2929320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f89f9600640 0 client.15402 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b25554d0 0x5653b29223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2992951939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b254d2f0 0x5653b2921e80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 >> 172.21.15.120:0/2992951939 conn(0x5653b256a300 msgr2=0x5653b2916ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 shutdown_connections 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 1 -- 172.21.15.120:0/2992951939 wait complete. 2024-05-14T09:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.330+0000 7f8a19c22740 20 client.15402 trim_cache size 0 max 16384 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.348+0000 7f8a19c22740 1 Processor -- start 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a19c22740 1 -- start start 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b2534d80 0x5653b2921a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b254d2f0 0x5653b29292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2921f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a19c22740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1ae900 con 0x5653b25554d0 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a19c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1b0440 con 0x5653b254d2f0 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a19c22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1aefd0 con 0x5653b2534d80 2024-05-14T09:23:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a10c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2921f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a10c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2921f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59000/0 (socket says 172.21.15.120:59000) 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a10c00640 1 -- 172.21.15.120:0/2699207962 learned_addr learned my addr 172.21.15.120:0/2699207962 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.349+0000 7f8a0be00640 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b2534d80 0x5653b2921a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a03e00640 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b254d2f0 0x5653b29292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a10c00640 1 -- 172.21.15.120:0/2699207962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b2534d80 msgr2=0x5653b2921a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a10c00640 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b2534d80 0x5653b2921a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a10c00640 1 -- 172.21.15.120:0/2699207962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b254d2f0 msgr2=0x5653b29292b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a10c00640 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b254d2f0 0x5653b29292b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a10c00640 1 -- 172.21.15.120:0/2699207962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b290f4a0 con 0x5653b25554d0 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a03e00640 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b254d2f0 0x5653b29292b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f8a10c00640 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2921f90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400ccb0 tx=0x7f8a0400f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baad97f6cb081fb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f89fbe00640 1 -- 172.21.15.120:0/2699207962 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040ae3b0 con 0x5653b25554d0 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f89fbe00640 1 -- 172.21.15.120:0/2699207962 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a040c4070 con 0x5653b25554d0 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.350+0000 7f89fbe00640 1 -- 172.21.15.120:0/2699207962 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040b2c30 con 0x5653b25554d0 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.351+0000 7f8a19c22740 1 -- 172.21.15.120:0/2699207962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 msgr2=0x5653b2921f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.351+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2921f90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400ccb0 tx=0x7f8a0400f9a0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.351+0000 7f8a19c22740 1 -- 172.21.15.120:0/2699207962 shutdown_connections 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.351+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2921f90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.351+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b254d2f0 0x5653b29292b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.351+0000 7f8a19c22740 1 --2- 172.21.15.120:0/2699207962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b2534d80 0x5653b2921a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.351+0000 7f8a19c22740 1 -- 172.21.15.120:0/2699207962 >> 172.21.15.120:0/2699207962 conn(0x5653b256a300 msgr2=0x5653b291b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.352+0000 7f8a19c22740 1 -- 172.21.15.120:0/2699207962 shutdown_connections 2024-05-14T09:23:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.352+0000 7f8a19c22740 1 -- 172.21.15.120:0/2699207962 wait complete. 2024-05-14T09:23:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.352+0000 7f8a19c22740 1 -- start start 2024-05-14T09:23:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.352+0000 7f8a19c22740 1 Processor -- start 2024-05-14T09:23:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b2534d80 0x5653b29261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2926720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a19c22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2995c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a19c22740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1afd70 con 0x5653b25554d0 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a19c22740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1af6a0 con 0x5653b2534d80 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a19c22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1ac900 con 0x5653b254d2f0 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a19c22740 10 client.0 _ll_register_callbacks cb 0x7f89fc009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2995c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2995c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59010/0 (socket says 172.21.15.120:59010) 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 -- 172.21.15.120:0/3192772313 learned_addr learned my addr 172.21.15.120:0/3192772313 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a0be00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b2534d80 0x5653b29261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a03e00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2926720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 -- 172.21.15.120:0/3192772313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 msgr2=0x5653b2926720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2926720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 -- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b2534d80 msgr2=0x5653b29261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b2534d80 0x5653b29261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a10c00640 1 -- 172.21.15.120:0/3192772313 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b29961d0 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.353+0000 7f8a0be00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b2534d80 0x5653b29261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f8a10c00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2995c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a040a9d00 tx=0x7f8a040ae430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53baceb0cbf97bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f89f9600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f89f9600640 1 -- 172.21.15.120:0/3192772313 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0406d070 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a040c4070 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f89f9600640 1 -- 172.21.15.120:0/3192772313 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8a040a9470 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f89f9600640 1 -- 172.21.15.120:0/3192772313 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8a040a5970 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f8a19c22740 10 client.15408 fetch_fsmap learned FSMap version 30 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653b29972d0 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.354+0000 7f89f9600640 1 -- 172.21.15.120:0/3192772313 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a040c4070 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f89f9600640 1 -- 172.21.15.120:0/3192772313 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8a040af5d0 con 0x5653b25554d0 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f8a19c22740 10 client.15408 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T09:23:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f8a19c22740 10 client.15408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:23:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f8a19c22740 20 client.15408 populate_metadata read hostname 'smithi120' 2024-05-14T09:23:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f8a19c22740 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b25761b0 0x5653b2999c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:23:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f8a19c22740 4 client.15408 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:23:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5653b2883fd0 con 0x5653b25761b0 2024-05-14T09:23:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.355+0000 7f8a0be00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b25761b0 0x5653b2999c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:23:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.357+0000 7f8a0be00640 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b25761b0 0x5653b2999c90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d075b5807dea9ef6 server_cookie=5eb5e443f4642f67 in_seq=0 out_seq=0 2024-05-14T09:23:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.357+0000 7f89f9600640 10 client.15408 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f89f9600640 1 -- 172.21.15.120:0/3192772313 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5653b2883fd0 con 0x5653b25761b0 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f89f9600640 10 client.15408 handle_command_reply: tid=0 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 client.15408 shutdown 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 msgr2=0x5653b2995c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2995c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a040a9d00 tx=0x7f8a040ae430 comp rx=0 tx=0).stop 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 shutdown_connections 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5653b25761b0 0x5653b2999c90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653b25554d0 0x5653b2995c90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653b254d2f0 0x5653b2926720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 --2- 172.21.15.120:0/3192772313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5653b2534d80 0x5653b29261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f89f9600640 0 client.15408 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 >> 172.21.15.120:0/3192772313 conn(0x5653b256a300 msgr2=0x5653b29219b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 shutdown_connections 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.574+0000 7f8a19c22740 1 -- 172.21.15.120:0/3192772313 wait complete. 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a19c22740 20 client.15408 trim_cache size 0 max 16384 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:23:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89f00b27e0 msgr2=0x7f89f00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89f00b27e0 0x7f89f00b4cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89fc02a910 tx=0x7f89fc031400 comp rx=0 tx=0).stop 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c10bbe0 msgr2=0x7f8a0c1a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c10bbe0 0x7f8a0c1a3720 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400cce0 tx=0x7f8a0400a620 comp rx=0 tx=0).stop 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 shutdown_connections 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89f00b27e0 0x7f89f00b4cf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a0c10bbe0 0x7f8a0c1a3720 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a0c106ee0 0x7f8a0c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 --2- 172.21.15.120:0/1111714583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a0c105ca0 0x7f8a0c19c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:23:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.575+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 >> 172.21.15.120:0/1111714583 conn(0x7f8a0c100eb0 msgr2=0x7f8a0c107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:23:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.576+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 shutdown_connections 2024-05-14T09:23:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:23:47.576+0000 7f8a11600640 1 -- 172.21.15.120:0/1111714583 wait complete. 2024-05-14T09:23:47.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:47 smithi175 ceph-mon[35353]: pgmap v563: 129 pgs: 129 active+clean; 19 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.6 MiB/s wr, 23 op/s 2024-05-14T09:23:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:47 smithi120 ceph-mon[31085]: pgmap v563: 129 pgs: 129 active+clean; 19 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.6 MiB/s wr, 23 op/s 2024-05-14T09:23:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:47 smithi152 ceph-mon[34868]: pgmap v563: 129 pgs: 129 active+clean; 19 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.6 MiB/s wr, 23 op/s 2024-05-14T09:23:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:49 smithi120 ceph-mon[31085]: pgmap v564: 129 pgs: 129 active+clean; 21 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.7 MiB/s wr, 52 op/s 2024-05-14T09:23:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:49 smithi152 ceph-mon[34868]: pgmap v564: 129 pgs: 129 active+clean; 21 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.7 MiB/s wr, 52 op/s 2024-05-14T09:23:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:49 smithi175 ceph-mon[35353]: pgmap v564: 129 pgs: 129 active+clean; 21 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.7 MiB/s wr, 52 op/s 2024-05-14T09:23:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:51 smithi120 ceph-mon[31085]: pgmap v565: 129 pgs: 129 active+clean; 22 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-05-14T09:23:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:51 smithi152 ceph-mon[34868]: pgmap v565: 129 pgs: 129 active+clean; 22 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-05-14T09:23:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:51 smithi175 ceph-mon[35353]: pgmap v565: 129 pgs: 129 active+clean; 22 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-05-14T09:23:53.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:52 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:23:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:52 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:23:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:52 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:23:54.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:53 smithi120 ceph-mon[31085]: pgmap v566: 129 pgs: 129 active+clean; 23 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-05-14T09:23:54.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:53 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:53 smithi152 ceph-mon[34868]: pgmap v566: 129 pgs: 129 active+clean; 23 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-05-14T09:23:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:53 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:53 smithi175 ceph-mon[35353]: pgmap v566: 129 pgs: 129 active+clean; 23 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-05-14T09:23:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:53 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:56.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:55 smithi120 ceph-mon[31085]: pgmap v567: 129 pgs: 129 active+clean; 24 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.8 MiB/s wr, 131 op/s 2024-05-14T09:23:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:55 smithi152 ceph-mon[34868]: pgmap v567: 129 pgs: 129 active+clean; 24 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.8 MiB/s wr, 131 op/s 2024-05-14T09:23:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:55 smithi175 ceph-mon[35353]: pgmap v567: 129 pgs: 129 active+clean; 24 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.8 MiB/s wr, 131 op/s 2024-05-14T09:23:58.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:57 smithi120 ceph-mon[31085]: pgmap v568: 129 pgs: 129 active+clean; 26 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 857 KiB/s wr, 139 op/s 2024-05-14T09:23:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:57 smithi152 ceph-mon[34868]: pgmap v568: 129 pgs: 129 active+clean; 26 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 857 KiB/s wr, 139 op/s 2024-05-14T09:23:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:57 smithi175 ceph-mon[35353]: pgmap v568: 129 pgs: 129 active+clean; 26 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 857 KiB/s wr, 139 op/s 2024-05-14T09:23:59.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:58 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:59.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:58 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:23:59.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:58 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:24:00.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:23:59 smithi120 ceph-mon[31085]: pgmap v569: 129 pgs: 129 active+clean; 26 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.1 MiB/s wr, 142 op/s 2024-05-14T09:24:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:23:59 smithi152 ceph-mon[34868]: pgmap v569: 129 pgs: 129 active+clean; 26 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.1 MiB/s wr, 142 op/s 2024-05-14T09:24:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:23:59 smithi175 ceph-mon[35353]: pgmap v569: 129 pgs: 129 active+clean; 26 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.1 MiB/s wr, 142 op/s 2024-05-14T09:24:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 -- 172.21.15.120:0/3423126574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 msgr2=0x7ff0f410acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3423126574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f410acd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009ca0 tx=0x7ff0ec02a8c0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 -- 172.21.15.120:0/3423126574 shutdown_connections 2024-05-14T09:24:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3423126574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f410acd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3423126574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4103bb0 0x7ff0f4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3423126574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4102970 0x7ff0f4103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 -- 172.21.15.120:0/3423126574 >> 172.21.15.120:0/3423126574 conn(0x7ff0f40fdb60 msgr2=0x7ff0f4100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 -- 172.21.15.120:0/3423126574 shutdown_connections 2024-05-14T09:24:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.819+0000 7ff0faa00640 1 -- 172.21.15.120:0/3423126574 wait complete. 2024-05-14T09:24:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.820+0000 7ff0faa00640 1 Processor -- start 2024-05-14T09:24:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.820+0000 7ff0faa00640 1 -- start start 2024-05-14T09:24:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4102970 0x7ff0f40ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0faa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4103bb0 0x7ff0f40fe090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0faa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f40fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0faa00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410e3a0 con 0x7ff0f41088b0 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0faa00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410e220 con 0x7ff0f4103bb0 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0faa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410e520 con 0x7ff0f4102970 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0fa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f40fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0fa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f40fe5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56112/0 (socket says 172.21.15.120:56112) 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0fa000640 1 -- 172.21.15.120:0/3376731209 learned_addr learned my addr 172.21.15.120:0/3376731209 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0f9600640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4102970 0x7ff0f40ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.821+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4103bb0 0x7ff0f40fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.822+0000 7ff0fa000640 1 -- 172.21.15.120:0/3376731209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4102970 msgr2=0x7ff0f40ff9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.822+0000 7ff0fa000640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4102970 0x7ff0f40ff9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.822+0000 7ff0fa000640 1 -- 172.21.15.120:0/3376731209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4103bb0 msgr2=0x7ff0f40fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.822+0000 7ff0fa000640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4103bb0 0x7ff0f40fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.822+0000 7ff0fa000640 1 -- 172.21.15.120:0/3376731209 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f40fed00 con 0x7ff0f41088b0 2024-05-14T09:24:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.822+0000 7ff0fa000640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f40fe5d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0098d0 tx=0x7ff0ec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.823+0000 7ff0f2000640 1 -- 172.21.15.120:0/3376731209 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec003d90 con 0x7ff0f41088b0 2024-05-14T09:24:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.823+0000 7ff0f2000640 1 -- 172.21.15.120:0/3376731209 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0ec0044d0 con 0x7ff0f41088b0 2024-05-14T09:24:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.823+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f41a4150 con 0x7ff0f41088b0 2024-05-14T09:24:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.823+0000 7ff0f2000640 1 -- 172.21.15.120:0/3376731209 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec030d10 con 0x7ff0f41088b0 2024-05-14T09:24:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.823+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f41a4610 con 0x7ff0f41088b0 2024-05-14T09:24:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.826+0000 7ff10303c740 1 Processor -- start 2024-05-14T09:24:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.827+0000 7ff0f2000640 1 -- 172.21.15.120:0/3376731209 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff0ec04e440 con 0x7ff0f41088b0 2024-05-14T09:24:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.827+0000 7ff10303c740 1 -- start start 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff10303c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a8a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff10303c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a8a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff10303c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a91780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff10303c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f9e79ee550 con 0x55f9e76c74d0 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff10303c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9e7993bc0 con 0x55f9e76bf2f0 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff10303c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9e79ea510 con 0x55f9e76e81b0 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff0f8c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a91780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff0f8c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a91780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56128/0 (socket says 172.21.15.120:56128) 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1113258600 learned_addr learned my addr 172.21.15.120:0/1113258600 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff0f9600640 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a8a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.828+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a8a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1113258600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 msgr2=0x55f9e7a8a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a8a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1113258600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 msgr2=0x55f9e7a8a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a8a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1113258600 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e7700210 con 0x55f9e76c74d0 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f2000640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0dc0b2860 0x7ff0dc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f2000640 1 -- 172.21.15.120:0/3376731209 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff0ec103b70 con 0x7ff0f41088b0 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f9600640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0dc0b2860 0x7ff0dc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.829+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a91780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0012770 tx=0x7ff0e000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce51a176693bb3e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.830+0000 7ff0e6600640 1 -- 172.21.15.120:0/1113258600 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0012cf0 con 0x55f9e76c74d0 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.830+0000 7ff0e6600640 1 -- 172.21.15.120:0/1113258600 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0e00044c0 con 0x55f9e76c74d0 2024-05-14T09:24:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.830+0000 7ff0e6600640 1 -- 172.21.15.120:0/1113258600 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00049a0 con 0x55f9e76c74d0 2024-05-14T09:24:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 -- 172.21.15.120:0/1113258600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 msgr2=0x55f9e7a91780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff0f9600640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0dc0b2860 0x7ff0dc0b4d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55f9e7a8b6e0 tx=0x7ff0e800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a91780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0012770 tx=0x7ff0e000b7c0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 -- 172.21.15.120:0/1113258600 shutdown_connections 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a91780 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a8a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 --2- 172.21.15.120:0/1113258600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a8a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 -- 172.21.15.120:0/1113258600 >> 172.21.15.120:0/1113258600 conn(0x55f9e76dc300 msgr2=0x55f9e7a85c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 -- 172.21.15.120:0/1113258600 shutdown_connections 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.831+0000 7ff10303c740 1 -- 172.21.15.120:0/1113258600 wait complete. 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.832+0000 7ff10303c740 1 -- start start 2024-05-14T09:24:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.832+0000 7ff10303c740 1 Processor -- start 2024-05-14T09:24:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.833+0000 7ff10303c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a93eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.833+0000 7ff10303c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a943f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.833+0000 7ff10303c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a9b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.833+0000 7ff10303c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f9e7a921d0 con 0x55f9e76c74d0 2024-05-14T09:24:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.833+0000 7ff10303c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9e79a7660 con 0x55f9e76bf2f0 2024-05-14T09:24:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.833+0000 7ff10303c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9e7a92350 con 0x55f9e76e81b0 2024-05-14T09:24:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.833+0000 7ff10303c740 10 client.0 _ll_register_callbacks cb 0x55f9e7971400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f9600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a93eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a943f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56138/0 (socket says 172.21.15.120:56138) 2024-05-14T09:24:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1252709670 learned_addr learned my addr 172.21.15.120:0/1252709670 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0fa000640 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a9b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1252709670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 msgr2=0x55f9e7a9b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a9b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1252709670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 msgr2=0x55f9e7a93eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a93eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.834+0000 7ff0f8c00640 1 -- 172.21.15.120:0/1252709670 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e77cc620 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a943f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0005460 tx=0x7ff0e0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5b3b4737b5274b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff0daa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff0daa00640 1 -- 172.21.15.120:0/1252709670 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0010970 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff0daa00640 1 -- 172.21.15.120:0/1252709670 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff0e0010b10 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9e79fc160 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff0daa00640 1 -- 172.21.15.120:0/1252709670 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff0e0031050 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff10303c740 10 client.15420 fetch_fsmap learned FSMap version 32 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.835+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f9e7a9e280 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff0daa00640 1 -- 172.21.15.120:0/1252709670 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f9e79fc160 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff0daa00640 1 -- 172.21.15.120:0/1252709670 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7ff0e0026020 con 0x55f9e76c74d0 2024-05-14T09:24:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff10303c740 10 client.15420 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T09:24:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff10303c740 10 client.15420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff10303c740 20 client.15420 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff10303c740 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e76a6d80 0x55f9e7aa1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff10303c740 4 client.15420 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.836+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9e79f5fd0 con 0x55f9e76a6d80 2024-05-14T09:24:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.837+0000 7ff0f9600640 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e76a6d80 0x55f9e7aa1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.838+0000 7ff0daa00640 10 client.15420 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.838+0000 7ff0f9600640 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e76a6d80 0x55f9e7aa1810 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead713e7f160846 server_cookie=b327da772e52d05b in_seq=0 out_seq=0 2024-05-14T09:24:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff0daa00640 1 -- 172.21.15.120:0/1252709670 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f9e79f5fd0 con 0x55f9e76a6d80 2024-05-14T09:24:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff0daa00640 10 client.15420 handle_command_reply: tid=0 2024-05-14T09:24:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 client.15420 shutdown 2024-05-14T09:24:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 msgr2=0x55f9e7a943f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a943f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0005460 tx=0x7ff0e0005f30 comp rx=0 tx=0).stop 2024-05-14T09:24:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 shutdown_connections 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e76a6d80 0x55f9e7aa1810 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a9b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76c74d0 0x55f9e7a943f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 --2- 172.21.15.120:0/1252709670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a93eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff0daa00640 0 client.15420 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.840+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 >> 172.21.15.120:0/1252709670 conn(0x55f9e76dc300 msgr2=0x55f9e7a88ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.841+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 shutdown_connections 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.841+0000 7ff10303c740 1 -- 172.21.15.120:0/1252709670 wait complete. 2024-05-14T09:24:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.841+0000 7ff10303c740 20 client.15420 trim_cache size 0 max 16384 2024-05-14T09:24:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 Processor -- start 2024-05-14T09:24:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 -- start start 2024-05-14T09:24:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a85dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a84960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f41aea50 con 0x55f9e767c1c0 2024-05-14T09:24:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f41b0620 con 0x55f9e76bf2f0 2024-05-14T09:24:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.862+0000 7ff10303c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f41af120 con 0x55f9e76e81b0 2024-05-14T09:24:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56144/0 (socket says 172.21.15.120:56144) 2024-05-14T09:24:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 -- 172.21.15.120:0/2231572972 learned_addr learned my addr 172.21.15.120:0/2231572972 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a84960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0f9600640 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a85dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 -- 172.21.15.120:0/2231572972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 msgr2=0x55f9e7a84960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a84960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 -- 172.21.15.120:0/2231572972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 msgr2=0x55f9e7a85dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a85dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0fa000640 1 -- 172.21.15.120:0/2231572972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e7a814a0 con 0x55f9e767c1c0 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.863+0000 7ff0f9600640 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a85dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.864+0000 7ff0fa000640 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec101320 tx=0x7ff0ec009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a8fa4630ee38fa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.864+0000 7ff0e5c00640 1 -- 172.21.15.120:0/2231572972 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0cb4f0 con 0x55f9e767c1c0 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.864+0000 7ff0e5c00640 1 -- 172.21.15.120:0/2231572972 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0ec036020 con 0x55f9e767c1c0 2024-05-14T09:24:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.864+0000 7ff0e5c00640 1 -- 172.21.15.120:0/2231572972 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0c7080 con 0x55f9e767c1c0 2024-05-14T09:24:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.865+0000 7ff10303c740 1 -- 172.21.15.120:0/2231572972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e767c1c0 msgr2=0x55f9e7a9b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.865+0000 7ff10303c740 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec101320 tx=0x7ff0ec009a20 comp rx=0 tx=0).stop 2024-05-14T09:24:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 -- 172.21.15.120:0/2231572972 shutdown_connections 2024-05-14T09:24:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b310 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e76e81b0 0x55f9e7a84960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 --2- 172.21.15.120:0/2231572972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a85dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 -- 172.21.15.120:0/2231572972 >> 172.21.15.120:0/2231572972 conn(0x55f9e76dc300 msgr2=0x55f9e7a84250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 -- 172.21.15.120:0/2231572972 shutdown_connections 2024-05-14T09:24:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 -- 172.21.15.120:0/2231572972 wait complete. 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.866+0000 7ff10303c740 1 -- start start 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 1 Processor -- start 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a98490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76e81b0 0x55f9e7a989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f41afec0 con 0x55f9e76e81b0 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f41af7f0 con 0x55f9e76bf2f0 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f41aca50 con 0x55f9e767c1c0 2024-05-14T09:24:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.867+0000 7ff10303c740 10 client.0 _ll_register_callbacks cb 0x7ff0e800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.868+0000 7ff0fa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76e81b0 0x55f9e7a989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.868+0000 7ff0fa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76e81b0 0x55f9e7a989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56156/0 (socket says 172.21.15.120:56156) 2024-05-14T09:24:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.868+0000 7ff0fa000640 1 -- 172.21.15.120:0/4195613206 learned_addr learned my addr 172.21.15.120:0/4195613206 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.868+0000 7ff0f8c00640 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a98490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.868+0000 7ff0f9600640 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0fa000640 1 -- 172.21.15.120:0/4195613206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e767c1c0 msgr2=0x55f9e7a9b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0fa000640 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0fa000640 1 -- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 msgr2=0x55f9e7a98490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0fa000640 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a98490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0fa000640 1 -- 172.21.15.120:0/4195613206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e7b07b70 con 0x55f9e76e81b0 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0fa000640 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76e81b0 0x55f9e7a989d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec004af0 tx=0x7ff0ec009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848854f912e64e77 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0daa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.869+0000 7ff0daa00640 1 -- 172.21.15.120:0/4195613206 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0eb070 con 0x55f9e76e81b0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff0daa00640 1 -- 172.21.15.120:0/4195613206 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff0ec0c73e0 con 0x55f9e76e81b0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0ec036020 con 0x55f9e76e81b0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff0daa00640 1 -- 172.21.15.120:0/4195613206 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff0ec0cb4f0 con 0x55f9e76e81b0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff10303c740 10 client.15426 fetch_fsmap learned FSMap version 32 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f9e7b08c80 con 0x55f9e76e81b0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff0daa00640 1 -- 172.21.15.120:0/4195613206 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0ec036020 con 0x55f9e76e81b0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff0daa00640 1 -- 172.21.15.120:0/4195613206 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7ff0ec0d37c0 con 0x55f9e76e81b0 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.870+0000 7ff10303c740 10 client.15426 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.871+0000 7ff10303c740 10 client.15426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.871+0000 7ff10303c740 20 client.15426 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.871+0000 7ff10303c740 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e7b093c0 0x55f9e7b0b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.871+0000 7ff10303c740 4 client.15426 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:24:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.871+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f9e79714b0 con 0x55f9e7b093c0 2024-05-14T09:24:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.871+0000 7ff0f9600640 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e7b093c0 0x55f9e7b0b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.873+0000 7ff0f9600640 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e7b093c0 0x55f9e7b0b7e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e86290eda0281a server_cookie=b8decf027458e90b in_seq=0 out_seq=0 2024-05-14T09:24:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.873+0000 7ff0daa00640 10 client.15426 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.952+0000 7ff0daa00640 1 -- 172.21.15.120:0/4195613206 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f9e79714b0 con 0x55f9e7b093c0 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.952+0000 7ff0daa00640 10 client.15426 handle_command_reply: tid=0 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.952+0000 7ff10303c740 1 client.15426 shutdown 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.952+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76e81b0 msgr2=0x55f9e7a989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.952+0000 7ff10303c740 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76e81b0 0x55f9e7a989d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec004af0 tx=0x7ff0ec009650 comp rx=0 tx=0).stop 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 shutdown_connections 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f9e7b093c0 0x55f9e7b0b7e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f9e76e81b0 0x55f9e7a989d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9e76bf2f0 0x55f9e7a98490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 --2- 172.21.15.120:0/4195613206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9e767c1c0 0x55f9e7a9b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff0daa00640 0 client.15426 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 >> 172.21.15.120:0/4195613206 conn(0x55f9e76dc300 msgr2=0x55f9e7a849e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 shutdown_connections 2024-05-14T09:24:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 1 -- 172.21.15.120:0/4195613206 wait complete. 2024-05-14T09:24:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.953+0000 7ff10303c740 20 client.15426 trim_cache size 0 max 16384 2024-05-14T09:24:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:24:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:24:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:24:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:24:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0dc0b2860 msgr2=0x7ff0dc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0dc0b2860 0x7ff0dc0b4d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55f9e7a8b6e0 tx=0x7ff0e800b390 comp rx=0 tx=0).stop 2024-05-14T09:24:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 msgr2=0x7ff0f40fe5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f40fe5d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0098d0 tx=0x7ff0ec003ba0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 shutdown_connections 2024-05-14T09:24:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff0dc0b2860 0x7ff0dc0b4d70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f41088b0 0x7ff0f40fe5d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f4103bb0 0x7ff0f40fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 --2- 172.21.15.120:0/3376731209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f4102970 0x7ff0f40ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 >> 172.21.15.120:0/3376731209 conn(0x7ff0f40fdb60 msgr2=0x7ff0f4109d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 shutdown_connections 2024-05-14T09:24:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:00.954+0000 7ff0faa00640 1 -- 172.21.15.120:0/3376731209 wait complete. 2024-05-14T09:24:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:01 smithi120 ceph-mon[31085]: pgmap v570: 129 pgs: 129 active+clean; 27 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1007 KiB/s wr, 120 op/s 2024-05-14T09:24:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:01 smithi152 ceph-mon[34868]: pgmap v570: 129 pgs: 129 active+clean; 27 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1007 KiB/s wr, 120 op/s 2024-05-14T09:24:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:01 smithi175 ceph-mon[35353]: pgmap v570: 129 pgs: 129 active+clean; 27 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1007 KiB/s wr, 120 op/s 2024-05-14T09:24:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:03 smithi120 ceph-mon[31085]: pgmap v571: 129 pgs: 129 active+clean; 28 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 1017 KiB/s wr, 106 op/s 2024-05-14T09:24:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:03 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:24:04.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:03 smithi152 ceph-mon[34868]: pgmap v571: 129 pgs: 129 active+clean; 28 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 1017 KiB/s wr, 106 op/s 2024-05-14T09:24:04.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:03 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:24:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:03 smithi175 ceph-mon[35353]: pgmap v571: 129 pgs: 129 active+clean; 28 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 1017 KiB/s wr, 106 op/s 2024-05-14T09:24:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:03 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:24:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:05 smithi120 ceph-mon[31085]: pgmap v572: 129 pgs: 129 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-14T09:24:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:05 smithi152 ceph-mon[34868]: pgmap v572: 129 pgs: 129 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-14T09:24:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:05 smithi175 ceph-mon[35353]: pgmap v572: 129 pgs: 129 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-14T09:24:07.109 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:06 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:24:07.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:06 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:24:07.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:06 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:24:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:07 smithi120 ceph-mon[31085]: pgmap v573: 129 pgs: 129 active+clean; 31 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.5 MiB/s wr, 110 op/s 2024-05-14T09:24:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:07 smithi152 ceph-mon[34868]: pgmap v573: 129 pgs: 129 active+clean; 31 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.5 MiB/s wr, 110 op/s 2024-05-14T09:24:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:07 smithi175 ceph-mon[35353]: pgmap v573: 129 pgs: 129 active+clean; 31 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.5 MiB/s wr, 110 op/s 2024-05-14T09:24:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:09 smithi120 ceph-mon[31085]: pgmap v574: 129 pgs: 129 active+clean; 36 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-05-14T09:24:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:09 smithi152 ceph-mon[34868]: pgmap v574: 129 pgs: 129 active+clean; 36 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-05-14T09:24:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:09 smithi175 ceph-mon[35353]: pgmap v574: 129 pgs: 129 active+clean; 36 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-05-14T09:24:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:11 smithi152 ceph-mon[34868]: pgmap v575: 129 pgs: 129 active+clean; 39 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-05-14T09:24:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:11 smithi175 ceph-mon[35353]: pgmap v575: 129 pgs: 129 active+clean; 39 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-05-14T09:24:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:11 smithi120 ceph-mon[31085]: pgmap v575: 129 pgs: 129 active+clean; 39 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-05-14T09:24:12.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:24:13.003 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:14.185 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:13 smithi120 ceph-mon[31085]: pgmap v576: 129 pgs: 129 active+clean; 42 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 1.9 MiB/s wr, 121 op/s 2024-05-14T09:24:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 -- 172.21.15.120:0/4253943263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac010bbe0 msgr2=0x7f5ac010e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 --2- 172.21.15.120:0/4253943263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac010bbe0 0x7f5ac010e000 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009900 tx=0x7f5ab802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 -- 172.21.15.120:0/4253943263 shutdown_connections 2024-05-14T09:24:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 --2- 172.21.15.120:0/4253943263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac010bbe0 0x7f5ac010e000 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 --2- 172.21.15.120:0/4253943263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0106ee0 0x7f5ac01072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 --2- 172.21.15.120:0/4253943263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac0105ca0 0x7f5ac01069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 -- 172.21.15.120:0/4253943263 >> 172.21.15.120:0/4253943263 conn(0x7f5ac0100ed0 msgr2=0x7f5ac0103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 -- 172.21.15.120:0/4253943263 shutdown_connections 2024-05-14T09:24:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.204+0000 7f5ac6600640 1 -- 172.21.15.120:0/4253943263 wait complete. 2024-05-14T09:24:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.205+0000 7f5ac6600640 1 Processor -- start 2024-05-14T09:24:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.205+0000 7f5ac6600640 1 -- start start 2024-05-14T09:24:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac6600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0105ca0 0x7f5ac019c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac6600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0106ee0 0x7f5ac019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac6600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac010bbe0 0x7f5ac01a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac6600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0111660 con 0x7f5ac0105ca0 2024-05-14T09:24:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac6600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01114e0 con 0x7f5ac0106ee0 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac6600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01117e0 con 0x7f5ac010bbe0 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac5200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0105ca0 0x7f5ac019c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac5200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0105ca0 0x7f5ac019c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58540/0 (socket says 172.21.15.120:58540) 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac5200640 1 -- 172.21.15.120:0/1083246884 learned_addr learned my addr 172.21.15.120:0/1083246884 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5abfe00640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0106ee0 0x7f5ac019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.206+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac010bbe0 0x7f5ac01a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac5200640 1 -- 172.21.15.120:0/1083246884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac010bbe0 msgr2=0x7f5ac01a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac5200640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac010bbe0 0x7f5ac01a36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac5200640 1 -- 172.21.15.120:0/1083246884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0106ee0 msgr2=0x7f5ac019c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac5200640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0106ee0 0x7f5ac019c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac5200640 1 -- 172.21.15.120:0/1083246884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01a3d60 con 0x7f5ac0105ca0 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac010bbe0 0x7f5ac01a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac5200640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0105ca0 0x7f5ac019c290 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000ea50 tx=0x7f5ab000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:14.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:13 smithi152 ceph-mon[34868]: pgmap v576: 129 pgs: 129 active+clean; 42 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 1.9 MiB/s wr, 121 op/s 2024-05-14T09:24:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5abd600640 1 -- 172.21.15.120:0/1083246884 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000cdc0 con 0x7f5ac0105ca0 2024-05-14T09:24:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5abd600640 1 -- 172.21.15.120:0/1083246884 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab0011900 con 0x7f5ac0105ca0 2024-05-14T09:24:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01a3ff0 con 0x7f5ac0105ca0 2024-05-14T09:24:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.207+0000 7f5abd600640 1 -- 172.21.15.120:0/1083246884 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab001a970 con 0x7f5ac0105ca0 2024-05-14T09:24:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.208+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01a44b0 con 0x7f5ac0105ca0 2024-05-14T09:24:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.211+0000 7f5acec2f740 1 Processor -- start 2024-05-14T09:24:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5acec2f740 1 -- start start 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884386300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x556884386880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x55688438d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5acec2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5568842ea550 con 0x556883fe41b0 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5acec2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55688428fbc0 con 0x556883fbb2f0 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5acec2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5568842e6510 con 0x556883fc34d0 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5ac5c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884386300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5ac5c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884386300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58550/0 (socket says 172.21.15.120:58550) 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2130981757 learned_addr learned my addr 172.21.15.120:0/2130981757 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.212+0000 7f5abd600640 1 -- 172.21.15.120:0/1083246884 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5ab001ab10 con 0x7f5ac0105ca0 2024-05-14T09:24:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.213+0000 7f5abfe00640 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x55688438d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.213+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2130981757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 msgr2=0x55688438d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.213+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x55688438d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.213+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2130981757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 msgr2=0x556884386880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.213+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x556884386880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.213+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2130981757 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556883ffc210 con 0x556883fe41b0 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.213+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884386300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8006010 tx=0x7f5ab8031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b6c0a22367ef3e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.214+0000 7f5ab6000640 1 -- 172.21.15.120:0/2130981757 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8035030 con 0x556883fe41b0 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.214+0000 7f5ab6000640 1 -- 172.21.15.120:0/2130981757 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab8004030 con 0x556883fe41b0 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.214+0000 7f5ab6000640 1 -- 172.21.15.120:0/2130981757 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8003b00 con 0x556883fe41b0 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.214+0000 7f5abd600640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa40b27e0 0x7f5aa40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5ac5200640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa40b27e0 0x7f5aa40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5abd600640 1 -- 172.21.15.120:0/1083246884 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5ab00e2c30 con 0x7f5ac0105ca0 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 -- 172.21.15.120:0/2130981757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 msgr2=0x556884386300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884386300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8006010 tx=0x7f5ab8031630 comp rx=0 tx=0).stop 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 -- 172.21.15.120:0/2130981757 shutdown_connections 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x55688438d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x556884386880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2130981757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884386300 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 -- 172.21.15.120:0/2130981757 >> 172.21.15.120:0/2130981757 conn(0x556883fd8300 msgr2=0x556884381c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 -- 172.21.15.120:0/2130981757 shutdown_connections 2024-05-14T09:24:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.215+0000 7f5acec2f740 1 -- 172.21.15.120:0/2130981757 wait complete. 2024-05-14T09:24:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.216+0000 7f5ac5200640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa40b27e0 0x7f5aa40b4cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00a9de0 tx=0x7f5ab000cf60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.216+0000 7f5acec2f740 1 -- start start 2024-05-14T09:24:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.216+0000 7f5acec2f740 1 Processor -- start 2024-05-14T09:24:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x55688438fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884390310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fe41b0 0x556884397270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5acec2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55688438e170 con 0x556883fc34d0 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5acec2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5568842a3660 con 0x556883fbb2f0 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5acec2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55688438e2f0 con 0x556883fe41b0 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5acec2f740 10 client.0 _ll_register_callbacks cb 0x55688426d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884390310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884390310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58564/0 (socket says 172.21.15.120:58564) 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5abfe00640 1 -- 172.21.15.120:0/1194196489 learned_addr learned my addr 172.21.15.120:0/1194196489 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.217+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x55688438fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fe41b0 0x556884397270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5abfe00640 1 -- 172.21.15.120:0/1194196489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fe41b0 msgr2=0x556884397270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5abfe00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fe41b0 0x556884397270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5abfe00640 1 -- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 msgr2=0x55688438fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5abfe00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x55688438fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5abfe00640 1 -- 172.21.15.120:0/1194196489 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568840c8620 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fe41b0 0x556884397270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5abfe00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884390310 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800be90 tx=0x7f5aa80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba432b8236b8140 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5aaea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5aaea00640 1 -- 172.21.15.120:0/1194196489 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8012650 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5aaea00640 1 -- 172.21.15.120:0/1194196489 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5aa80127f0 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.218+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ab8004030 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5aaea00640 1 -- 172.21.15.120:0/1194196489 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5aa80129f0 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 10 client.15438 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55688439a270 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5aaea00640 1 -- 172.21.15.120:0/1194196489 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab8004030 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5aaea00640 1 -- 172.21.15.120:0/1194196489 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f5aa801bc60 con 0x556883fc34d0 2024-05-14T09:24:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 10 client.15438 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 20 client.15438 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883fa2d80 0x55688439daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 4 client.15438 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.219+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568842f8160 con 0x556883fa2d80 2024-05-14T09:24:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.220+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883fa2d80 0x55688439daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.221+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883fa2d80 0x55688439daf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c051cd18f39c2857 server_cookie=614bbdf6621b7727 in_seq=0 out_seq=0 2024-05-14T09:24:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.221+0000 7f5aaea00640 10 client.15438 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.223+0000 7f5aaea00640 1 -- 172.21.15.120:0/1194196489 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5568842f8160 con 0x556883fa2d80 2024-05-14T09:24:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.223+0000 7f5aaea00640 10 client.15438 handle_command_reply: tid=0 2024-05-14T09:24:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.223+0000 7f5acec2f740 1 client.15438 shutdown 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 msgr2=0x556884390310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884390310 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800be90 tx=0x7f5aa80117b0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 shutdown_connections 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883fa2d80 0x55688439daf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fe41b0 0x556884397270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5aaea00640 0 client.15438 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884390310 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 --2- 172.21.15.120:0/1194196489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x55688438fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 >> 172.21.15.120:0/1194196489 conn(0x556883fd8300 msgr2=0x556884380c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 shutdown_connections 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 1 -- 172.21.15.120:0/1194196489 wait complete. 2024-05-14T09:24:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.224+0000 7f5acec2f740 20 client.15438 trim_cache size 0 max 16384 2024-05-14T09:24:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:13 smithi175 ceph-mon[35353]: pgmap v576: 129 pgs: 129 active+clean; 42 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 1.9 MiB/s wr, 121 op/s 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.242+0000 7f5acec2f740 1 Processor -- start 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.242+0000 7f5acec2f740 1 -- start start 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fbb2f0 0x55688438e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884397190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fe41b0 0x55688438ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5acec2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01ae9c0 con 0x556883fc34d0 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5acec2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01b05f0 con 0x556883fe41b0 2024-05-14T09:24:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5acec2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01af090 con 0x556883fbb2f0 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884397190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884397190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58578/0 (socket says 172.21.15.120:58578) 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5abfe00640 1 -- 172.21.15.120:0/2746565517 learned_addr learned my addr 172.21.15.120:0/2746565517 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.243+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fbb2f0 0x55688438e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fe41b0 0x55688438ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5abfe00640 1 -- 172.21.15.120:0/2746565517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fbb2f0 msgr2=0x55688438e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5abfe00640 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fbb2f0 0x55688438e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5abfe00640 1 -- 172.21.15.120:0/2746565517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fe41b0 msgr2=0x55688438ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5abfe00640 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fe41b0 0x55688438ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5abfe00640 1 -- 172.21.15.120:0/2746565517 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55688437d4a0 con 0x556883fc34d0 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5abfe00640 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884397190 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa8011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e74968376cc277 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5ab5600640 1 -- 172.21.15.120:0/2746565517 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa802e030 con 0x556883fc34d0 2024-05-14T09:24:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5ab5600640 1 -- 172.21.15.120:0/2746565517 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5aa8012b90 con 0x556883fc34d0 2024-05-14T09:24:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.244+0000 7f5ab5600640 1 -- 172.21.15.120:0/2746565517 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8005040 con 0x556883fc34d0 2024-05-14T09:24:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.245+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746565517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 msgr2=0x556884397190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.245+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884397190 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa8011d30 comp rx=0 tx=0).stop 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.245+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746565517 shutdown_connections 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.245+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fe41b0 0x55688438ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.245+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fc34d0 0x556884397190 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.245+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746565517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fbb2f0 0x55688438e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.245+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746565517 >> 172.21.15.120:0/2746565517 conn(0x556883fd8300 msgr2=0x55688438a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.246+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746565517 shutdown_connections 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.246+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746565517 wait complete. 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.246+0000 7f5acec2f740 1 -- start start 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.246+0000 7f5acec2f740 1 Processor -- start 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x556884393d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x556884394280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5acec2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884403e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5acec2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01afe60 con 0x556883fe41b0 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5acec2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01af790 con 0x556883fbb2f0 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5acec2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01ac9c0 con 0x556883fc34d0 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5acec2f740 10 client.0 _ll_register_callbacks cb 0x7f5aa800b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5ac5c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884403e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5ac5c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884403e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58590/0 (socket says 172.21.15.120:58590) 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2746308913 learned_addr learned my addr 172.21.15.120:0/2746308913 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5abfe00640 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x556884394280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.247+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x556884393d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2746308913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 msgr2=0x556884394280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x556884394280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 msgr2=0x556884393d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x556884393d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5ac5c00640 1 -- 172.21.15.120:0/2746308913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556884397240 con 0x556883fe41b0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5ac5c00640 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884403e90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005760 tx=0x7f5ab8046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985223ed902352f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5aaea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5aaea00640 1 -- 172.21.15.120:0/2746308913 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8035070 con 0x556883fe41b0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5aaea00640 1 -- 172.21.15.120:0/2746308913 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5ab804d040 con 0x556883fe41b0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.248+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aa8012b90 con 0x556883fe41b0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5aaea00640 1 -- 172.21.15.120:0/2746308913 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5ab80043e0 con 0x556883fe41b0 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5acec2f740 10 client.15444 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556884405240 con 0x556883fe41b0 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5aaea00640 1 -- 172.21.15.120:0/2746308913 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5aa8012b90 con 0x556883fe41b0 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5aaea00640 1 -- 172.21.15.120:0/2746308913 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f5ab803a040 con 0x556883fe41b0 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5acec2f740 10 client.15444 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5acec2f740 10 client.15444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5acec2f740 20 client.15444 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.249+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883f781c0 0x5568844078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.250+0000 7f5acec2f740 4 client.15444 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.250+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568842f1fd0 con 0x556883f781c0 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.250+0000 7f5abfe00640 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883f781c0 0x5568844078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.251+0000 7f5abfe00640 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883f781c0 0x5568844078d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cfdf65f167cd7f8 server_cookie=a2fee9c68f52db43 in_seq=0 out_seq=0 2024-05-14T09:24:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.251+0000 7f5aaea00640 10 client.15444 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:14.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.657+0000 7f5aaea00640 1 -- 172.21.15.120:0/2746308913 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568842f1fd0 con 0x556883f781c0 2024-05-14T09:24:14.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.657+0000 7f5aaea00640 10 client.15444 handle_command_reply: tid=0 2024-05-14T09:24:14.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.657+0000 7f5acec2f740 1 client.15444 shutdown 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.657+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 msgr2=0x556884403e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.657+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884403e90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005760 tx=0x7f5ab8046040 comp rx=0 tx=0).stop 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 shutdown_connections 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556883f781c0 0x5568844078d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556883fe41b0 0x556884403e90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556883fc34d0 0x556884394280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 --2- 172.21.15.120:0/2746308913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556883fbb2f0 0x556884393d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 >> 172.21.15.120:0/2746308913 conn(0x556883fd8300 msgr2=0x55688438e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5aaea00640 0 client.15444 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 shutdown_connections 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 1 -- 172.21.15.120:0/2746308913 wait complete. 2024-05-14T09:24:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.658+0000 7f5acec2f740 20 client.15444 trim_cache size 0 max 16384 2024-05-14T09:24:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:24:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:24:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:24:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa40b27e0 msgr2=0x7f5aa40b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa40b27e0 0x7f5aa40b4cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00a9de0 tx=0x7f5ab000cf60 comp rx=0 tx=0).stop 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0105ca0 msgr2=0x7f5ac019c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0105ca0 0x7f5ac019c290 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000ea50 tx=0x7f5ab000ef10 comp rx=0 tx=0).stop 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 shutdown_connections 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5aa40b27e0 0x7f5aa40b4cf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac010bbe0 0x7f5ac01a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0106ee0 0x7f5ac019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 --2- 172.21.15.120:0/1083246884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0105ca0 0x7f5ac019c290 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 >> 172.21.15.120:0/1083246884 conn(0x7f5ac0100ed0 msgr2=0x7f5ac0107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 shutdown_connections 2024-05-14T09:24:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:14.659+0000 7f5ac6600640 1 -- 172.21.15.120:0/1083246884 wait complete. 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.431+0000 7f2af2200700 1 -- 172.21.15.120:0/4059931829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec104400 msgr2=0x7f2aec104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.431+0000 7f2af2200700 1 --2- 172.21.15.120:0/4059931829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec104400 0x7f2aec104810 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00099c0 tx=0x7f2ae0009cd0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.432+0000 7f2af2200700 1 -- 172.21.15.120:0/4059931829 shutdown_connections 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.432+0000 7f2af2200700 1 --2- 172.21.15.120:0/4059931829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2aec109680 0x7f2aec110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.432+0000 7f2af2200700 1 --2- 172.21.15.120:0/4059931829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec104400 0x7f2aec104810 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.432+0000 7f2af2200700 1 --2- 172.21.15.120:0/4059931829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aec108d30 0x7f2aec109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.432+0000 7f2af2200700 1 -- 172.21.15.120:0/4059931829 >> 172.21.15.120:0/4059931829 conn(0x7f2aec079d10 msgr2=0x7f2aec07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.432+0000 7f2af2200700 1 -- 172.21.15.120:0/4059931829 shutdown_connections 2024-05-14T09:24:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.432+0000 7f2af2200700 1 -- 172.21.15.120:0/4059931829 wait complete. 2024-05-14T09:24:15.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.433+0000 7f2af2200700 1 Processor -- start 2024-05-14T09:24:15.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.434+0000 7f2af2200700 1 -- start start 2024-05-14T09:24:15.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.434+0000 7f2af2200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2aec104400 0x7f2aec19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.434+0000 7f2af2200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec108d30 0x7f2aec19d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.434+0000 7f2af2200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aec109680 0x7f2aec1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.434+0000 7f2af2200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1141b0 con 0x7f2aec108d30 2024-05-14T09:24:15.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.434+0000 7f2af2200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec114030 con 0x7f2aec104400 2024-05-14T09:24:15.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.434+0000 7f2af2200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec114330 con 0x7f2aec109680 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec108d30 0x7f2aec19d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec108d30 0x7f2aec19d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58610/0 (socket says 172.21.15.120:58610) 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 -- 172.21.15.120:0/3022230438 learned_addr learned my addr 172.21.15.120:0/3022230438 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2af0e00700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2aec104400 0x7f2aec19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 -- 172.21.15.120:0/3022230438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aec109680 msgr2=0x7f2aec1a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aec109680 0x7f2aec1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 -- 172.21.15.120:0/3022230438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2aec104400 msgr2=0x7f2aec19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2aec104400 0x7f2aec19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.435+0000 7f2aebe00700 1 -- 172.21.15.120:0/3022230438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec1a1d30 con 0x7f2aec108d30 2024-05-14T09:24:15.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.436+0000 7f2aebe00700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec108d30 0x7f2aec19d400 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800d980 tx=0x7f2ad800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:15.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.436+0000 7f2ae9600700 1 -- 172.21.15.120:0/3022230438 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8017070 con 0x7f2aec108d30 2024-05-14T09:24:15.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.436+0000 7f2ae9600700 1 -- 172.21.15.120:0/3022230438 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad8009dc0 con 0x7f2aec108d30 2024-05-14T09:24:15.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.436+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec1a2020 con 0x7f2aec108d30 2024-05-14T09:24:15.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.436+0000 7f2ae9600700 1 -- 172.21.15.120:0/3022230438 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800f3c0 con 0x7f2aec108d30 2024-05-14T09:24:15.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.436+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec1a9940 con 0x7f2aec108d30 2024-05-14T09:24:15.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.441+0000 7f2ae9600700 1 -- 172.21.15.120:0/3022230438 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2ad800f560 con 0x7f2aec108d30 2024-05-14T09:24:15.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.441+0000 7f2b02305b80 1 Processor -- start 2024-05-14T09:24:15.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.442+0000 7f2b02305b80 1 -- start start 2024-05-14T09:24:15.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.442+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.442+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4280 0x5572322ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.442+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.442+0000 7f2b02305b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5572321c5a20 con 0x5572322a4690 2024-05-14T09:24:15.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.442+0000 7f2b02305b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557232163760 con 0x5572322a4280 2024-05-14T09:24:15.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.442+0000 7f2b02305b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5572321c19e0 con 0x557232125e40 2024-05-14T09:24:15.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.443+0000 7f2aebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.443+0000 7f2aebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58624/0 (socket says 172.21.15.120:58624) 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.443+0000 7f2aebe00700 1 -- 172.21.15.120:0/743460695 learned_addr learned my addr 172.21.15.120:0/743460695 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.443+0000 7f2af1800700 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.443+0000 7f2aebe00700 1 -- 172.21.15.120:0/743460695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 msgr2=0x5572322a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.443+0000 7f2aebe00700 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2aebe00700 1 -- 172.21.15.120:0/743460695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4280 msgr2=0x5572322ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2ae9600700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ad40b2880 0x7f2ad40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2af0e00700 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4280 0x5572322ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2aebe00700 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4280 0x5572322ad8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2aebe00700 1 -- 172.21.15.120:0/743460695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572321128d0 con 0x5572322a4690 2024-05-14T09:24:15.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2af1800700 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:15.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2ae9600700 1 -- 172.21.15.120:0/3022230438 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2ad80e2170 con 0x7f2aec108d30 2024-05-14T09:24:15.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2af1800700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ad40b2880 0x7f2ad40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2aebe00700 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322afe30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80bf2a0 tx=0x7f2ad80a5a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8009c0280052a27 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:15.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.444+0000 7f2ade000700 1 -- 172.21.15.120:0/743460695 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8020070 con 0x5572322a4690 2024-05-14T09:24:15.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.445+0000 7f2ade000700 1 -- 172.21.15.120:0/743460695 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad80a8ea0 con 0x5572322a4690 2024-05-14T09:24:15.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.445+0000 7f2ade000700 1 -- 172.21.15.120:0/743460695 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80a8b00 con 0x5572322a4690 2024-05-14T09:24:15.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 -- 172.21.15.120:0/743460695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 msgr2=0x5572322afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322afe30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80bf2a0 tx=0x7f2ad80a5a60 comp rx=0 tx=0).stop 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2af1800700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ad40b2880 0x7f2ad40b4d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40060b0 tx=0x7f2ae4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 -- 172.21.15.120:0/743460695 shutdown_connections 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322afe30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 --2- 172.21.15.120:0/743460695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4280 0x5572322ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 -- 172.21.15.120:0/743460695 >> 172.21.15.120:0/743460695 conn(0x557232164a80 msgr2=0x55723229eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 -- 172.21.15.120:0/743460695 shutdown_connections 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.446+0000 7f2b02305b80 1 -- 172.21.15.120:0/743460695 wait complete. 2024-05-14T09:24:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.447+0000 7f2b02305b80 1 -- start start 2024-05-14T09:24:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.447+0000 7f2b02305b80 1 Processor -- start 2024-05-14T09:24:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557232125e40 0x5572322ad320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2b02305b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5572322b07a0 con 0x5572322a4690 2024-05-14T09:24:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2b02305b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55723212bb20 con 0x557232125e40 2024-05-14T09:24:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2b02305b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5572322b0920 con 0x5572322a4280 2024-05-14T09:24:15.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2b02305b80 10 client.0 _ll_register_callbacks cb 0x557232159380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:15.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2af1800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2af1800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58628/0 (socket says 172.21.15.120:58628) 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2af1800700 1 -- 172.21.15.120:0/3068249712 learned_addr learned my addr 172.21.15.120:0/3068249712 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2aebe00700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.448+0000 7f2af0e00700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557232125e40 0x5572322ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2af1800700 1 -- 172.21.15.120:0/3068249712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 msgr2=0x5572322ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2af1800700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2af1800700 1 -- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557232125e40 msgr2=0x5572322ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2af1800700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557232125e40 0x5572322ad320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2af1800700 1 -- 172.21.15.120:0/3068249712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723218b420 con 0x5572322a4690 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2af0e00700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557232125e40 0x5572322ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2af1800700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322adda0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009ad0 tx=0x7f2ae4006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce8fb3913ea7e36 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:15.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.449+0000 7f2ad2a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:15.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.450+0000 7f2ad2a00700 1 -- 172.21.15.120:0/3068249712 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4026060 con 0x5572322a4690 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.450+0000 7f2ad2a00700 1 -- 172.21.15.120:0/3068249712 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2ae40147e0 con 0x5572322a4690 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.450+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad80a8ea0 con 0x5572322a4690 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.450+0000 7f2ad2a00700 1 -- 172.21.15.120:0/3068249712 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2ae402d050 con 0x5572322a4690 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.450+0000 7f2b02305b80 10 client.15456 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.450+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5572322bb3e0 con 0x5572322a4690 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.450+0000 7f2ad2a00700 1 -- 172.21.15.120:0/3068249712 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad80a8ea0 con 0x5572322a4690 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.451+0000 7f2ad2a00700 1 -- 172.21.15.120:0/3068249712 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f2ae4020aa0 con 0x5572322a4690 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.451+0000 7f2b02305b80 10 client.15456 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.451+0000 7f2b02305b80 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.451+0000 7f2b02305b80 20 client.15456 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.451+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5572322bda70 0x5572322bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.451+0000 7f2b02305b80 4 client.15456 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.451+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557232270070 con 0x5572322bda70 2024-05-14T09:24:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.452+0000 7f2af0e00700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5572322bda70 0x5572322bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.453+0000 7f2af0e00700 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5572322bda70 0x5572322bfed0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06a1d82ebc9a514 server_cookie=ba12ce86e9219414 in_seq=0 out_seq=0 2024-05-14T09:24:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.453+0000 7f2ad2a00700 10 client.15456 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:15.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2ad2a00700 1 -- 172.21.15.120:0/3068249712 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557232270070 con 0x5572322bda70 2024-05-14T09:24:15.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2ad2a00700 10 client.15456 handle_command_reply: tid=0 2024-05-14T09:24:15.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 client.15456 shutdown 2024-05-14T09:24:15.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 msgr2=0x5572322adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322adda0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009ad0 tx=0x7f2ae4006040 comp rx=0 tx=0).stop 2024-05-14T09:24:15.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 shutdown_connections 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5572322bda70 0x5572322bfed0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557232125e40 0x5572322ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4690 0x5572322adda0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3068249712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 >> 172.21.15.120:0/3068249712 conn(0x557232164a80 msgr2=0x5572322a2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.456+0000 7f2ad2a00700 0 client.15456 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.457+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 shutdown_connections 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.457+0000 7f2b02305b80 1 -- 172.21.15.120:0/3068249712 wait complete. 2024-05-14T09:24:15.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.457+0000 7f2b02305b80 20 client.15456 trim_cache size 0 max 16384 2024-05-14T09:24:15.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 Processor -- start 2024-05-14T09:24:15.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 -- start start 2024-05-14T09:24:15.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4280 0x5572322b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b2450 con 0x5572322a4280 2024-05-14T09:24:15.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b4080 con 0x5572322a4690 2024-05-14T09:24:15.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.485+0000 7f2b02305b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b2b20 con 0x557232125e40 2024-05-14T09:24:15.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4280 0x5572322b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4280 0x5572322b9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58640/0 (socket says 172.21.15.120:58640) 2024-05-14T09:24:15.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 -- 172.21.15.120:0/3060704219 learned_addr learned my addr 172.21.15.120:0/3060704219 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:15.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2af0e00700 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2af1800700 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 -- 172.21.15.120:0/3060704219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 msgr2=0x5572322ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 -- 172.21.15.120:0/3060704219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 msgr2=0x5572322b9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.486+0000 7f2aebe00700 1 -- 172.21.15.120:0/3060704219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723229f6e0 con 0x5572322a4280 2024-05-14T09:24:15.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.487+0000 7f2aebe00700 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4280 0x5572322b9830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80be980 tx=0x7f2ad80a5350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc86abaf68ddf63 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.487+0000 7f2add600700 1 -- 172.21.15.120:0/3060704219 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8020040 con 0x5572322a4280 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.487+0000 7f2add600700 1 -- 172.21.15.120:0/3060704219 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad80a8ea0 con 0x5572322a4280 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.487+0000 7f2add600700 1 -- 172.21.15.120:0/3060704219 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80c3c80 con 0x5572322a4280 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 -- 172.21.15.120:0/3060704219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4280 msgr2=0x5572322b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4280 0x5572322b9830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80be980 tx=0x7f2ad80a5350 comp rx=0 tx=0).stop 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 -- 172.21.15.120:0/3060704219 shutdown_connections 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557232125e40 0x5572322ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 --2- 172.21.15.120:0/3060704219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572322a4280 0x5572322b9830 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 -- 172.21.15.120:0/3060704219 >> 172.21.15.120:0/3060704219 conn(0x557232164a80 msgr2=0x5572322ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:15.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.488+0000 7f2b02305b80 1 -- 172.21.15.120:0/3060704219 shutdown_connections 2024-05-14T09:24:15.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.489+0000 7f2b02305b80 1 -- 172.21.15.120:0/3060704219 wait complete. 2024-05-14T09:24:15.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.489+0000 7f2b02305b80 1 -- start start 2024-05-14T09:24:15.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.489+0000 7f2b02305b80 1 Processor -- start 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.490+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557232125e40 0x5572322b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.490+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.490+0000 7f2b02305b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.490+0000 7f2b02305b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b38f0 con 0x557232125e40 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.490+0000 7f2b02305b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b3220 con 0x5572322a4690 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.490+0000 7f2b02305b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b0410 con 0x5572322a4280 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.490+0000 7f2b02305b80 10 client.0 _ll_register_callbacks cb 0x557232159380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557232125e40 0x5572322b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557232125e40 0x5572322b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58642/0 (socket says 172.21.15.120:58642) 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 -- 172.21.15.120:0/1742517024 learned_addr learned my addr 172.21.15.120:0/1742517024 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af1800700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 -- 172.21.15.120:0/1742517024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 msgr2=0x5572322b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2aebe00700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 -- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 msgr2=0x5572322b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af0e00700 1 -- 172.21.15.120:0/1742517024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572322b1bd0 con 0x557232125e40 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2af1800700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.491+0000 7f2aebe00700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2af0e00700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557232125e40 0x5572322b5dc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000b580 tx=0x7f2ae0005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5af92809cdea83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:15.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2ad2a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:15.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2ad2a00700 1 -- 172.21.15.120:0/1742517024 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae002a070 con 0x557232125e40 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad80a8ea0 con 0x557232125e40 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2ad2a00700 1 -- 172.21.15.120:0/1742517024 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2ae000b990 con 0x557232125e40 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2ad2a00700 1 -- 172.21.15.120:0/1742517024 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2ae0036050 con 0x557232125e40 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2b02305b80 10 client.15462 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.492+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557232327ee0 con 0x557232125e40 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2ad2a00700 1 -- 172.21.15.120:0/1742517024 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad80a8ea0 con 0x557232125e40 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2ad2a00700 1 -- 172.21.15.120:0/1742517024 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f2ae000f460 con 0x557232125e40 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2b02305b80 10 client.15462 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2b02305b80 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2b02305b80 20 client.15462 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2b02305b80 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557232328660 0x55723232aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2b02305b80 4 client.15462 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:24:15.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.493+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572321d3400 con 0x557232328660 2024-05-14T09:24:15.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.494+0000 7f2aebe00700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557232328660 0x55723232aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.495+0000 7f2aebe00700 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557232328660 0x55723232aa80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af7851ed4acab75 server_cookie=aeac94dece13e5d3 in_seq=0 out_seq=0 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.495+0000 7f2ad2a00700 10 client.15462 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2ad2a00700 1 -- 172.21.15.120:0/1742517024 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5572321d3400 con 0x557232328660 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2ad2a00700 10 client.15462 handle_command_reply: tid=0 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 client.15462 shutdown 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557232125e40 msgr2=0x5572322b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557232125e40 0x5572322b5dc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000b580 tx=0x7f2ae0005330 comp rx=0 tx=0).stop 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 shutdown_connections 2024-05-14T09:24:15.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557232328660 0x55723232aa80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572322a4690 0x5572322b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557232125e40 0x5572322b5dc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 --2- 172.21.15.120:0/1742517024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572322a4280 0x5572322b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 >> 172.21.15.120:0/1742517024 conn(0x557232164a80 msgr2=0x5572322ad260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.496+0000 7f2ad2a00700 0 client.15462 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.497+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 shutdown_connections 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.497+0000 7f2b02305b80 1 -- 172.21.15.120:0/1742517024 wait complete. 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.497+0000 7f2b02305b80 20 client.15462 trim_cache size 0 max 16384 2024-05-14T09:24:15.498 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:24:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-05-14T09:24:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-05-14T09:24:15.499 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:24:15.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.497+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ad40b2880 msgr2=0x7f2ad40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.497+0000 7f2af2200700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ad40b2880 0x7f2ad40b4d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40060b0 tx=0x7f2ae4009040 comp rx=0 tx=0).stop 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.497+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec108d30 msgr2=0x7f2aec19d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.497+0000 7f2af2200700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec108d30 0x7f2aec19d400 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800d980 tx=0x7f2ad800dc90 comp rx=0 tx=0).stop 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.498+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 shutdown_connections 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.498+0000 7f2af2200700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ad40b2880 0x7f2ad40b4d90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.498+0000 7f2af2200700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2aec104400 0x7f2aec19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.498+0000 7f2af2200700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aec109680 0x7f2aec1a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.498+0000 7f2af2200700 1 --2- 172.21.15.120:0/3022230438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2aec108d30 0x7f2aec19d400 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.498+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 >> 172.21.15.120:0/3022230438 conn(0x7f2aec079d10 msgr2=0x7f2aec101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.498+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 shutdown_connections 2024-05-14T09:24:15.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:15.499+0000 7f2af2200700 1 -- 172.21.15.120:0/3022230438 wait complete. 2024-05-14T09:24:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:15 smithi120 ceph-mon[31085]: pgmap v577: 129 pgs: 129 active+clean; 45 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 2.1 MiB/s wr, 104 op/s 2024-05-14T09:24:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:15 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:24:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:15 smithi152 ceph-mon[34868]: pgmap v577: 129 pgs: 129 active+clean; 45 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 2.1 MiB/s wr, 104 op/s 2024-05-14T09:24:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:15 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:24:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:15 smithi175 ceph-mon[35353]: pgmap v577: 129 pgs: 129 active+clean; 45 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 2.1 MiB/s wr, 104 op/s 2024-05-14T09:24:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:15 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:24:16.482 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T09:24:16.482 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:24:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:17.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:24:17.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:24:17.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:24:17.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:24:17.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:24:17.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:24:17.326 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:24:17.327 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:24:17.327 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:24:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:17 smithi152 ceph-mon[34868]: pgmap v578: 129 pgs: 129 active+clean; 42 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.9 MiB/s wr, 131 op/s 2024-05-14T09:24:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:17 smithi175 ceph-mon[35353]: pgmap v578: 129 pgs: 129 active+clean; 42 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.9 MiB/s wr, 131 op/s 2024-05-14T09:24:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:17 smithi120 ceph-mon[31085]: pgmap v578: 129 pgs: 129 active+clean; 42 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.9 MiB/s wr, 131 op/s 2024-05-14T09:24:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 -- 172.21.15.120:0/2444340087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1708105350 msgr2=0x7f1708105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 --2- 172.21.15.120:0/2444340087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1708105350 0x7f1708105760 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009990 tx=0x7f16fc009ca0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 -- 172.21.15.120:0/2444340087 shutdown_connections 2024-05-14T09:24:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 --2- 172.21.15.120:0/2444340087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f170810e730 0x7f1708110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 --2- 172.21.15.120:0/2444340087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1708105350 0x7f1708105760 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 --2- 172.21.15.120:0/2444340087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1708105ca0 0x7f170810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 -- 172.21.15.120:0/2444340087 >> 172.21.15.120:0/2444340087 conn(0x7f1708078ac0 msgr2=0x7f1708078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:19.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 -- 172.21.15.120:0/2444340087 shutdown_connections 2024-05-14T09:24:19.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.509+0000 7f170e600700 1 -- 172.21.15.120:0/2444340087 wait complete. 2024-05-14T09:24:19.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 Processor -- start 2024-05-14T09:24:19.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 -- start start 2024-05-14T09:24:19.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1708105350 0x7f1708103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1708105ca0 0x7f1708103580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f170810e730 0x7f1708103ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1708114100 con 0x7f170810e730 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1708113f80 con 0x7f1708105ca0 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.511+0000 7f170e600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1708114280 con 0x7f1708105350 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f170810e730 0x7f1708103ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f170810e730 0x7f1708103ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53672/0 (socket says 172.21.15.120:53672) 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 -- 172.21.15.120:0/3131543596 learned_addr learned my addr 172.21.15.120:0/3131543596 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170d200700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1708105350 0x7f1708103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f1707e00700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1708105ca0 0x7f1708103580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 -- 172.21.15.120:0/3131543596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1708105350 msgr2=0x7f1708103040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1708105350 0x7f1708103040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 -- 172.21.15.120:0/3131543596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1708105ca0 msgr2=0x7f1708103580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1708105ca0 0x7f1708103580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170dc00700 1 -- 172.21.15.120:0/3131543596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17081a8f90 con 0x7f170810e730 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f170d200700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1708105350 0x7f1708103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.512+0000 7f1707e00700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1708105ca0 0x7f1708103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.513+0000 7f170dc00700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f170810e730 0x7f1708103ac0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f170000ada0 tx=0x7f170000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.513+0000 7f1705600700 1 -- 172.21.15.120:0/3131543596 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700017020 con 0x7f170810e730 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.513+0000 7f1705600700 1 -- 172.21.15.120:0/3131543596 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f170000ce10 con 0x7f170810e730 2024-05-14T09:24:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.513+0000 7f1705600700 1 -- 172.21.15.120:0/3131543596 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700005440 con 0x7f170810e730 2024-05-14T09:24:19.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.514+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17081a9280 con 0x7f170810e730 2024-05-14T09:24:19.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.514+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17081a9740 con 0x7f170810e730 2024-05-14T09:24:19.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.516+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17080512c0 con 0x7f170810e730 2024-05-14T09:24:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.519+0000 7f1705600700 1 -- 172.21.15.120:0/3131543596 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f170001a070 con 0x7f170810e730 2024-05-14T09:24:19.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.521+0000 7f1705600700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16f00b2880 0x7f16f00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:19.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.521+0000 7f1705600700 1 -- 172.21.15.120:0/3131543596 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f17000e1b30 con 0x7f170810e730 2024-05-14T09:24:19.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.521+0000 7f170d200700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16f00b2880 0x7f16f00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:19.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.522+0000 7f170d200700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16f00b2880 0x7f16f00b4d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16fc003760 tx=0x7f16fc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:19.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.523+0000 7f1705600700 1 -- 172.21.15.120:0/3131543596 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1700021020 con 0x7f170810e730 2024-05-14T09:24:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.832+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f170802e690 con 0x7f170810e730 2024-05-14T09:24:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.834+0000 7f1705600700 1 -- 172.21.15.120:0/3131543596 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11965 (secure 0 0 0) 0x7f17000a94b0 con 0x7f170810e730 2024-05-14T09:24:19.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:19.835 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:24:05.398565+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34427,24454,34409,34388,24469]},"id":1}]} 2024-05-14T09:24:19.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.837+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16f00b2880 msgr2=0x7f16f00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:19.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.837+0000 7f170e600700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16f00b2880 0x7f16f00b4d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16fc003760 tx=0x7f16fc00b540 comp rx=0 tx=0).stop 2024-05-14T09:24:19.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.837+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f170810e730 msgr2=0x7f1708103ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:19.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.837+0000 7f170e600700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f170810e730 0x7f1708103ac0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f170000ada0 tx=0x7f170000c330 comp rx=0 tx=0).stop 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 shutdown_connections 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f16f00b2880 0x7f16f00b4d90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f170810e730 0x7f1708103ac0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1708105350 0x7f1708103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 --2- 172.21.15.120:0/3131543596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1708105ca0 0x7f1708103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 >> 172.21.15.120:0/3131543596 conn(0x7f1708078ac0 msgr2=0x7f1708101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 shutdown_connections 2024-05-14T09:24:19.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:19.838+0000 7f170e600700 1 -- 172.21.15.120:0/3131543596 wait complete. 2024-05-14T09:24:19.840 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 34 2024-05-14T09:24:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:19 smithi120 ceph-mon[31085]: pgmap v579: 129 pgs: 129 active+clean; 43 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-05-14T09:24:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:19 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3131543596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:24:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:19 smithi152 ceph-mon[34868]: pgmap v579: 129 pgs: 129 active+clean; 43 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-05-14T09:24:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:19 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3131543596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:24:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:19 smithi175 ceph-mon[35353]: pgmap v579: 129 pgs: 129 active+clean; 43 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-05-14T09:24:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:19 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3131543596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:24:20.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T09:24:21.291 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:22.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:21 smithi120 ceph-mon[31085]: pgmap v580: 129 pgs: 129 active+clean; 43 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 1.1 MiB/s wr, 169 op/s 2024-05-14T09:24:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:21 smithi152 ceph-mon[34868]: pgmap v580: 129 pgs: 129 active+clean; 43 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 1.1 MiB/s wr, 169 op/s 2024-05-14T09:24:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:21 smithi175 ceph-mon[35353]: pgmap v580: 129 pgs: 129 active+clean; 43 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 1.1 MiB/s wr, 169 op/s 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.658+0000 7f5a28400700 1 -- 172.21.15.120:0/187819213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 msgr2=0x7f5a20113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.658+0000 7f5a28400700 1 --2- 172.21.15.120:0/187819213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a20113350 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800b0a0 tx=0x7f5a1800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.659+0000 7f5a28400700 1 -- 172.21.15.120:0/187819213 shutdown_connections 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.659+0000 7f5a28400700 1 --2- 172.21.15.120:0/187819213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a2010c5b0 0x7f5a2010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.659+0000 7f5a28400700 1 --2- 172.21.15.120:0/187819213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a20113350 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.659+0000 7f5a28400700 1 --2- 172.21.15.120:0/187819213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a20106570 0x7f5a20106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.659+0000 7f5a28400700 1 -- 172.21.15.120:0/187819213 >> 172.21.15.120:0/187819213 conn(0x7f5a20102050 msgr2=0x7f5a201044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.659+0000 7f5a28400700 1 -- 172.21.15.120:0/187819213 shutdown_connections 2024-05-14T09:24:23.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.659+0000 7f5a28400700 1 -- 172.21.15.120:0/187819213 wait complete. 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.660+0000 7f5a28400700 1 Processor -- start 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.660+0000 7f5a28400700 1 -- start start 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a28400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a20106570 0x7f5a2019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a28400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a2019d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a28400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a2010c5b0 0x7f5a201a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a28400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201165e0 con 0x7f5a20106ec0 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a28400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a20116460 con 0x7f5a20106570 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a28400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a20116760 con 0x7f5a2010c5b0 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a25000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a2019d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a25000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a2019d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53684/0 (socket says 172.21.15.120:53684) 2024-05-14T09:24:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a25000700 1 -- 172.21.15.120:0/1684049080 learned_addr learned my addr 172.21.15.120:0/1684049080 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:23.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a25a00700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a20106570 0x7f5a2019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.661+0000 7f5a26400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a2010c5b0 0x7f5a201a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.662+0000 7f5a25000700 1 -- 172.21.15.120:0/1684049080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a2010c5b0 msgr2=0x7f5a201a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.662+0000 7f5a25000700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a2010c5b0 0x7f5a201a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.662+0000 7f5a25000700 1 -- 172.21.15.120:0/1684049080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a20106570 msgr2=0x7f5a2019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.662+0000 7f5a25000700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a20106570 0x7f5a2019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.662+0000 7f5a25000700 1 -- 172.21.15.120:0/1684049080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a201a1e00 con 0x7f5a20106ec0 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.662+0000 7f5a25000700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a2019d4d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d950 tx=0x7f5a0c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.662+0000 7f5a1e000700 1 -- 172.21.15.120:0/1684049080 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c017070 con 0x7f5a20106ec0 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.663+0000 7f5a1e000700 1 -- 172.21.15.120:0/1684049080 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a0c009dc0 con 0x7f5a20106ec0 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.663+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a201a2090 con 0x7f5a20106ec0 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.663+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a201a9a10 con 0x7f5a20106ec0 2024-05-14T09:24:23.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.664+0000 7f5a1e000700 1 -- 172.21.15.120:0/1684049080 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00f3c0 con 0x7f5a20106ec0 2024-05-14T09:24:23.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.668+0000 7f5a1e000700 1 -- 172.21.15.120:0/1684049080 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5a0c01a070 con 0x7f5a20106ec0 2024-05-14T09:24:23.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.669+0000 7f5a36e6eb80 1 Processor -- start 2024-05-14T09:24:23.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.669+0000 7f5a36e6eb80 1 -- start start 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c5b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c5be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55acf4b7da20 con 0x55acf4c61830 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55acf4b1b760 con 0x55acf4c5b9f0 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55acf4b799e0 con 0x55acf4adde40 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a25a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c5b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a25a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c5b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53692/0 (socket says 172.21.15.120:53692) 2024-05-14T09:24:23.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.670+0000 7f5a25a00700 1 -- 172.21.15.120:0/1436245360 learned_addr learned my addr 172.21.15.120:0/1436245360 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:23.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a26400700 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a25000700 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c5be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a25a00700 1 -- 172.21.15.120:0/1436245360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 msgr2=0x55acf4c612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a1e000700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a080b2880 0x7f5a080b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a25a00700 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a25a00700 1 -- 172.21.15.120:0/1436245360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 msgr2=0x55acf4c5be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a25a00700 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c5be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a25a00700 1 -- 172.21.15.120:0/1436245360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf4aca8d0 con 0x55acf4c61830 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a1e000700 1 -- 172.21.15.120:0/1684049080 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5a0c0e1e40 con 0x7f5a20106ec0 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.671+0000 7f5a26400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a080b2880 0x7f5a080b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.672+0000 7f5a25a00700 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c5b4b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400bd30 tx=0x7f5a140106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1da093ffbf9807 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.672+0000 7f5a12a00700 1 -- 172.21.15.120:0/1436245360 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14004030 con 0x55acf4c61830 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.672+0000 7f5a12a00700 1 -- 172.21.15.120:0/1436245360 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a14003680 con 0x55acf4c61830 2024-05-14T09:24:23.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.672+0000 7f5a12a00700 1 -- 172.21.15.120:0/1436245360 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a140116a0 con 0x55acf4c61830 2024-05-14T09:24:23.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1436245360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 msgr2=0x55acf4c5b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a26400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a080b2880 0x7f5a080b4d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009e60 tx=0x7f5a180099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:23.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c5b4b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400bd30 tx=0x7f5a140106b0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1436245360 shutdown_connections 2024-05-14T09:24:23.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c5be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1436245360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c5b4b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.673+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1436245360 >> 172.21.15.120:0/1436245360 conn(0x55acf4b22f70 msgr2=0x55acf4c562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:23.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.674+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1436245360 shutdown_connections 2024-05-14T09:24:23.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.674+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1436245360 wait complete. 2024-05-14T09:24:23.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.675+0000 7f5a36e6eb80 1 -- start start 2024-05-14T09:24:23.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.675+0000 7f5a36e6eb80 1 Processor -- start 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c64fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c65a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55acf4c68310 con 0x55acf4c61830 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55acf4ae3b20 con 0x55acf4c5b9f0 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55acf4c68490 con 0x55acf4adde40 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a36e6eb80 10 client.0 _ll_register_callbacks cb 0x55acf4b24c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a26400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c65a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a26400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c65a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53696/0 (socket says 172.21.15.120:53696) 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a26400700 1 -- 172.21.15.120:0/2514815672 learned_addr learned my addr 172.21.15.120:0/2514815672 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:23.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.676+0000 7f5a25a00700 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c64fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.677+0000 7f5a25000700 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.677+0000 7f5a26400700 1 -- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 msgr2=0x55acf4c64fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.677+0000 7f5a26400700 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c64fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.677+0000 7f5a26400700 1 -- 172.21.15.120:0/2514815672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 msgr2=0x55acf4c654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.677+0000 7f5a26400700 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.677+0000 7f5a26400700 1 -- 172.21.15.120:0/2514815672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf4b43420 con 0x55acf4c61830 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a26400700 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c65a30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5a18015000 tx=0x7f5a1800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b5b48a5fead399 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a07400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a07400700 1 -- 172.21.15.120:0/2514815672 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18007b80 con 0x55acf4c61830 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a07400700 1 -- 172.21.15.120:0/2514815672 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5a18007d20 con 0x55acf4c61830 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a14003680 con 0x55acf4c61830 2024-05-14T09:24:23.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a07400700 1 -- 172.21.15.120:0/2514815672 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5a18005040 con 0x55acf4c61830 2024-05-14T09:24:23.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a36e6eb80 10 client.15480 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:23.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.678+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55acf4c72e70 con 0x55acf4c61830 2024-05-14T09:24:23.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a07400700 1 -- 172.21.15.120:0/2514815672 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a14003680 con 0x55acf4c61830 2024-05-14T09:24:23.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a07400700 1 -- 172.21.15.120:0/2514815672 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f5a18023030 con 0x55acf4c61830 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a36e6eb80 10 client.15480 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a36e6eb80 10 client.15480 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a36e6eb80 20 client.15480 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4c754b0 0x55acf4c778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a36e6eb80 4 client.15480 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.679+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acf4c281c0 con 0x55acf4c754b0 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.680+0000 7f5a25a00700 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4c754b0 0x55acf4c778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.681+0000 7f5a25a00700 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4c754b0 0x55acf4c778d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1977f89140e0aa56 server_cookie=b624141a1cb9e589 in_seq=0 out_seq=0 2024-05-14T09:24:23.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.681+0000 7f5a07400700 10 client.15480 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:24:23.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a07400700 1 -- 172.21.15.120:0/2514815672 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55acf4c281c0 con 0x55acf4c754b0 2024-05-14T09:24:23.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a07400700 10 client.15480 handle_command_reply: tid=0 2024-05-14T09:24:23.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 client.15480 shutdown 2024-05-14T09:24:23.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 msgr2=0x55acf4c65a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c65a30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5a18015000 tx=0x7f5a1800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 shutdown_connections 2024-05-14T09:24:23.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4c754b0 0x55acf4c778d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c61830 0x55acf4c65a30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c64fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2514815672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 >> 172.21.15.120:0/2514815672 conn(0x55acf4b22f70 msgr2=0x55acf4c5a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:23.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a07400700 0 client.15480 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:24:23.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.684+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 shutdown_connections 2024-05-14T09:24:23.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.685+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2514815672 wait complete. 2024-05-14T09:24:23.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.685+0000 7f5a36e6eb80 20 client.15480 trim_cache size 0 max 16384 2024-05-14T09:24:23.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.705+0000 7f5a36e6eb80 1 Processor -- start 2024-05-14T09:24:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.705+0000 7f5a36e6eb80 1 -- start start 2024-05-14T09:24:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4adde40 0x55acf4c5b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c63f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4c61830 0x55acf4c5f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201b25f0 con 0x55acf4adde40 2024-05-14T09:24:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201b4220 con 0x55acf4c5b9f0 2024-05-14T09:24:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201b2cc0 con 0x55acf4c61830 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a25a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4adde40 0x55acf4c5b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.706+0000 7f5a25a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4adde40 0x55acf4c5b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53706/0 (socket says 172.21.15.120:53706) 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25a00700 1 -- 172.21.15.120:0/1173869926 learned_addr learned my addr 172.21.15.120:0/1173869926 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25000700 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c63f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25a00700 1 -- 172.21.15.120:0/1173869926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4c61830 msgr2=0x55acf4c5f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25a00700 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4c61830 0x55acf4c5f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25a00700 1 -- 172.21.15.120:0/1173869926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 msgr2=0x55acf4c63f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25a00700 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c63f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25a00700 1 -- 172.21.15.120:0/1173869926 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf4c566c0 con 0x55acf4adde40 2024-05-14T09:24:23.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.707+0000 7f5a25a00700 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4adde40 0x55acf4c5b4b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a14010ab0 tx=0x7f5a14005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0662192a0b65d91 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:23.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.708+0000 7f5a12000700 1 -- 172.21.15.120:0/1173869926 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14005630 con 0x55acf4adde40 2024-05-14T09:24:23.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.708+0000 7f5a12000700 1 -- 172.21.15.120:0/1173869926 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a14003b10 con 0x55acf4adde40 2024-05-14T09:24:23.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.708+0000 7f5a12000700 1 -- 172.21.15.120:0/1173869926 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14029330 con 0x55acf4adde40 2024-05-14T09:24:23.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1173869926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4adde40 msgr2=0x55acf4c5b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4adde40 0x55acf4c5b4b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a14010ab0 tx=0x7f5a14005950 comp rx=0 tx=0).stop 2024-05-14T09:24:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1173869926 shutdown_connections 2024-05-14T09:24:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4c61830 0x55acf4c5f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4adde40 0x55acf4c5b4b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/1173869926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c5b9f0 0x55acf4c63f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1173869926 >> 172.21.15.120:0/1173869926 conn(0x55acf4b22f70 msgr2=0x55acf4c5ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.709+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1173869926 shutdown_connections 2024-05-14T09:24:23.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.710+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/1173869926 wait complete. 2024-05-14T09:24:23.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.710+0000 7f5a36e6eb80 1 -- start start 2024-05-14T09:24:23.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.711+0000 7f5a36e6eb80 1 Processor -- start 2024-05-14T09:24:23.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.711+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c6db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.711+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c5b9f0 0x55acf4c7c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.711+0000 7f5a36e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c61830 0x55acf4c7ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.711+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201b3a90 con 0x55acf4c5b9f0 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.711+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201b33c0 con 0x55acf4c61830 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.711+0000 7f5a36e6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201b05b0 con 0x55acf4adde40 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a36e6eb80 10 client.0 _ll_register_callbacks cb 0x55acf4b24c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c5b9f0 0x55acf4c7c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c5b9f0 0x55acf4c7c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53720/0 (socket says 172.21.15.120:53720) 2024-05-14T09:24:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 -- 172.21.15.120:0/2919813455 learned_addr learned my addr 172.21.15.120:0/2919813455 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25a00700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c6db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a26400700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c61830 0x55acf4c7ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 -- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 msgr2=0x55acf4c6db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c6db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 -- 172.21.15.120:0/2919813455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c61830 msgr2=0x55acf4c7ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c61830 0x55acf4c7ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25000700 1 -- 172.21.15.120:0/2919813455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf4c7cfc0 con 0x55acf4c5b9f0 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.712+0000 7f5a25a00700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c6db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a25000700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c5b9f0 0x55acf4c7c4c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0a6330 tx=0x7f5a0c0108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563c55c1cd567c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a07400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a07400700 1 -- 172.21.15.120:0/2919813455 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c021040 con 0x55acf4c5b9f0 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a07400700 1 -- 172.21.15.120:0/2919813455 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5a0c0b1ca0 con 0x55acf4c5b9f0 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a14003b10 con 0x55acf4c5b9f0 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a07400700 1 -- 172.21.15.120:0/2919813455 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5a0c0a8830 con 0x55acf4c5b9f0 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a36e6eb80 10 client.15486 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.713+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55acf4ce81c0 con 0x55acf4c5b9f0 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a07400700 1 -- 172.21.15.120:0/2919813455 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a14003b10 con 0x55acf4c5b9f0 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a07400700 1 -- 172.21.15.120:0/2919813455 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f5a0c0e3070 con 0x55acf4c5b9f0 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a36e6eb80 10 client.15486 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a36e6eb80 10 client.15486 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a36e6eb80 20 client.15486 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4ce8920 0x55acf4cead40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a36e6eb80 4 client.15486 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:24:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acf4b8b400 con 0x55acf4ce8920 2024-05-14T09:24:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.714+0000 7f5a25a00700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4ce8920 0x55acf4cead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.716+0000 7f5a25a00700 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4ce8920 0x55acf4cead40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f34a1284bae73523 server_cookie=cd2ba209228ad48b in_seq=0 out_seq=0 2024-05-14T09:24:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.716+0000 7f5a07400700 10 client.15486 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:24:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a07400700 1 -- 172.21.15.120:0/2919813455 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acf4b8b400 con 0x55acf4ce8920 2024-05-14T09:24:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a07400700 10 client.15486 handle_command_reply: tid=0 2024-05-14T09:24:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 client.15486 shutdown 2024-05-14T09:24:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c5b9f0 msgr2=0x55acf4c7c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c5b9f0 0x55acf4c7c4c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0a6330 tx=0x7f5a0c0108f0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 shutdown_connections 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55acf4ce8920 0x55acf4cead40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55acf4c61830 0x55acf4c7ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55acf4adde40 0x55acf4c6db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.719+0000 7f5a07400700 0 client.15486 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.718+0000 7f5a36e6eb80 1 --2- 172.21.15.120:0/2919813455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acf4c5b9f0 0x55acf4c7c4c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.719+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 >> 172.21.15.120:0/2919813455 conn(0x55acf4b22f70 msgr2=0x55acf4c600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.719+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 shutdown_connections 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.719+0000 7f5a36e6eb80 1 -- 172.21.15.120:0/2919813455 wait complete. 2024-05-14T09:24:23.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.719+0000 7f5a36e6eb80 20 client.15486 trim_cache size 0 max 16384 2024-05-14T09:24:23.721 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:24:23.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a080b2880 msgr2=0x7f5a080b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a080b2880 0x7f5a080b4d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009e60 tx=0x7f5a180099e0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 msgr2=0x7f5a2019d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:23.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a2019d4d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d950 tx=0x7f5a0c00dc60 comp rx=0 tx=0).stop 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 shutdown_connections 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5a080b2880 0x7f5a080b4d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a20106570 0x7f5a2019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a2010c5b0 0x7f5a201a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 --2- 172.21.15.120:0/1684049080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a20106ec0 0x7f5a2019d4d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 >> 172.21.15.120:0/1684049080 conn(0x7f5a20102050 msgr2=0x7f5a20103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 shutdown_connections 2024-05-14T09:24:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:23.720+0000 7f5a28400700 1 -- 172.21.15.120:0/1684049080 wait complete. 2024-05-14T09:24:23.932 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:23 smithi120 ceph-mon[31085]: pgmap v581: 129 pgs: 129 active+clean; 45 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.0 MiB/s wr, 193 op/s 2024-05-14T09:24:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:23 smithi152 ceph-mon[34868]: pgmap v581: 129 pgs: 129 active+clean; 45 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.0 MiB/s wr, 193 op/s 2024-05-14T09:24:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:23 smithi175 ceph-mon[35353]: pgmap v581: 129 pgs: 129 active+clean; 45 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.0 MiB/s wr, 193 op/s 2024-05-14T09:24:24.636 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T09:24:25.130 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:25.949 INFO:teuthology.orchestra.run.smithi120.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-05-14T09:24:25.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-14T09:24:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:25 smithi152 ceph-mon[34868]: pgmap v582: 129 pgs: 129 active+clean; 45 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 759 KiB/s wr, 184 op/s 2024-05-14T09:24:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:25 smithi175 ceph-mon[35353]: pgmap v582: 129 pgs: 129 active+clean; 45 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 759 KiB/s wr, 184 op/s 2024-05-14T09:24:26.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:25 smithi120 ceph-mon[31085]: pgmap v582: 129 pgs: 129 active+clean; 45 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 759 KiB/s wr, 184 op/s 2024-05-14T09:24:27.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.572+0000 7f4594a00700 1 -- 172.21.15.120:0/2737680773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f459010c5c0 msgr2=0x7f459010c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.572+0000 7f4594a00700 1 --2- 172.21.15.120:0/2737680773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f459010c5c0 0x7f459010c9d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4580009990 tx=0x7f4580009ca0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.574+0000 7f4594a00700 1 -- 172.21.15.120:0/2737680773 shutdown_connections 2024-05-14T09:24:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.574+0000 7f4594a00700 1 --2- 172.21.15.120:0/2737680773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4590106ed0 0x7f4590113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.574+0000 7f4594a00700 1 --2- 172.21.15.120:0/2737680773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f459010c5c0 0x7f459010c9d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.574+0000 7f4594a00700 1 --2- 172.21.15.120:0/2737680773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4590106580 0x7f4590106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.574+0000 7f4594a00700 1 -- 172.21.15.120:0/2737680773 >> 172.21.15.120:0/2737680773 conn(0x7f4590102080 msgr2=0x7f45901044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.574+0000 7f4594a00700 1 -- 172.21.15.120:0/2737680773 shutdown_connections 2024-05-14T09:24:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.574+0000 7f4594a00700 1 -- 172.21.15.120:0/2737680773 wait complete. 2024-05-14T09:24:27.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.575+0000 7f4594a00700 1 Processor -- start 2024-05-14T09:24:27.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f4594a00700 1 -- start start 2024-05-14T09:24:27.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f4594a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4590106580 0x7f459019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f4594a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4590106ed0 0x7f459019d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f4594a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f459010c5c0 0x7f45901a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f4594a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f45901165d0 con 0x7f4590106ed0 2024-05-14T09:24:27.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f4594a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4590116450 con 0x7f459010c5c0 2024-05-14T09:24:27.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f4594a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4590116750 con 0x7f4590106580 2024-05-14T09:24:27.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.576+0000 7f458d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4590106ed0 0x7f459019d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4590106ed0 0x7f459019d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53744/0 (socket says 172.21.15.120:53744) 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458d400700 1 -- 172.21.15.120:0/988116216 learned_addr learned my addr 172.21.15.120:0/988116216 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458de00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4590106580 0x7f459019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458e800700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f459010c5c0 0x7f45901a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458d400700 1 -- 172.21.15.120:0/988116216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4590106580 msgr2=0x7f459019cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458d400700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4590106580 0x7f459019cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458d400700 1 -- 172.21.15.120:0/988116216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f459010c5c0 msgr2=0x7f45901a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458d400700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f459010c5c0 0x7f45901a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.577+0000 7f458d400700 1 -- 172.21.15.120:0/988116216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45901a1e50 con 0x7f4590106ed0 2024-05-14T09:24:27.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.578+0000 7f458d400700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4590106ed0 0x7f459019d520 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f457800d950 tx=0x7f457800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.578+0000 7f4586a00700 1 -- 172.21.15.120:0/988116216 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578017070 con 0x7f4590106ed0 2024-05-14T09:24:27.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.578+0000 7f4586a00700 1 -- 172.21.15.120:0/988116216 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f457800de30 con 0x7f4590106ed0 2024-05-14T09:24:27.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.578+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45901a2140 con 0x7f4590106ed0 2024-05-14T09:24:27.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.578+0000 7f4586a00700 1 -- 172.21.15.120:0/988116216 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457800f3c0 con 0x7f4590106ed0 2024-05-14T09:24:27.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.578+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45901a9a60 con 0x7f4590106ed0 2024-05-14T09:24:27.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.582+0000 7f4586a00700 1 -- 172.21.15.120:0/988116216 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f457801a070 con 0x7f4590106ed0 2024-05-14T09:24:27.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.583+0000 7f45a35edb80 1 Processor -- start 2024-05-14T09:24:27.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.584+0000 7f45a35edb80 1 -- start start 2024-05-14T09:24:27.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.584+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc5943a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.584+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc59434710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.584+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc59434c50 0x55bc59435060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.584+0000 7f45a35edb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bc59356a20 con 0x55bc592b6e40 2024-05-14T09:24:27.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.584+0000 7f45a35edb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bc592f4760 con 0x55bc59434c50 2024-05-14T09:24:27.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.584+0000 7f45a35edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc593529e0 con 0x55bc5943abf0 2024-05-14T09:24:27.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f4586a00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f45740b2880 0x7f45740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f458de00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc59434710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f458e800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc5943a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f4586a00700 1 -- 172.21.15.120:0/988116216 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f45780e1f70 con 0x7f4590106ed0 2024-05-14T09:24:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f458d400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc59434c50 0x55bc59435060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f458e800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc5943a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53760/0 (socket says 172.21.15.120:53760) 2024-05-14T09:24:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f458e800700 1 -- 172.21.15.120:0/1785936467 learned_addr learned my addr 172.21.15.120:0/1785936467 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.585+0000 7f458e800700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f45740b2880 0x7f45740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458d400700 1 -- 172.21.15.120:0/1785936467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 msgr2=0x55bc59434710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458d400700 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc59434710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458d400700 1 -- 172.21.15.120:0/1785936467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 msgr2=0x55bc5943a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458d400700 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc5943a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458d400700 1 -- 172.21.15.120:0/1785936467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc592a38d0 con 0x55bc59434c50 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458de00700 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc59434710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458e800700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f45740b2880 0x7f45740b4d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4588007c30 tx=0x7f4588009900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.586+0000 7f458d400700 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc59434c50 0x55bc59435060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4578000c00 tx=0x7f45780a8ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dd708aae999cbc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.587+0000 7f457f400700 1 -- 172.21.15.120:0/1785936467 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578021030 con 0x55bc59434c50 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.587+0000 7f457f400700 1 -- 172.21.15.120:0/1785936467 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45780b1b60 con 0x55bc59434c50 2024-05-14T09:24:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.587+0000 7f457f400700 1 -- 172.21.15.120:0/1785936467 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45780dfd90 con 0x55bc59434c50 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 -- 172.21.15.120:0/1785936467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc59434c50 msgr2=0x55bc59435060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc59434c50 0x55bc59435060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4578000c00 tx=0x7f45780a8ed0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 -- 172.21.15.120:0/1785936467 shutdown_connections 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc59434c50 0x55bc59435060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc5943a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1785936467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc59434710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 -- 172.21.15.120:0/1785936467 >> 172.21.15.120:0/1785936467 conn(0x55bc592f5a80 msgr2=0x55bc5942f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 -- 172.21.15.120:0/1785936467 shutdown_connections 2024-05-14T09:24:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.588+0000 7f45a35edb80 1 -- 172.21.15.120:0/1785936467 wait complete. 2024-05-14T09:24:27.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.589+0000 7f45a35edb80 1 -- start start 2024-05-14T09:24:27.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.589+0000 7f45a35edb80 1 Processor -- start 2024-05-14T09:24:27.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc5943e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5943ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f45a35edb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bc59441600 con 0x55bc59434c50 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f45a35edb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bc592bcb20 con 0x55bc592b6e40 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f45a35edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc59441780 con 0x55bc5943abf0 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f45a35edb80 10 client.0 _ll_register_callbacks cb 0x55bc592ea380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f458d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f458d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53774/0 (socket says 172.21.15.120:53774) 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.590+0000 7f458d400700 1 -- 172.21.15.120:0/1558495807 learned_addr learned my addr 172.21.15.120:0/1558495807 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458e800700 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5943ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458de00700 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc5943e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458d400700 1 -- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 msgr2=0x55bc5943ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458d400700 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5943ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458d400700 1 -- 172.21.15.120:0/1558495807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 msgr2=0x55bc5943e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458d400700 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc5943e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458d400700 1 -- 172.21.15.120:0/1558495807 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc5931c420 con 0x55bc59434c50 2024-05-14T09:24:27.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f458d400700 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943e940 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f45780a5440 tx=0x7f45780b1f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7014d981117fed8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.591+0000 7f4573e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.592+0000 7f4573e00700 1 -- 172.21.15.120:0/1558495807 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578021070 con 0x55bc59434c50 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.592+0000 7f4573e00700 1 -- 172.21.15.120:0/1558495807 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f45780ad170 con 0x55bc59434c50 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.592+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45780b1b60 con 0x55bc59434c50 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.592+0000 7f4573e00700 1 -- 172.21.15.120:0/1558495807 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f45780ad390 con 0x55bc59434c50 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.592+0000 7f45a35edb80 10 client.15498 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.592+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bc5944c250 con 0x55bc59434c50 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f4573e00700 1 -- 172.21.15.120:0/1558495807 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45780b1b60 con 0x55bc59434c50 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f4573e00700 1 -- 172.21.15.120:0/1558495807 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f45780a3ce0 con 0x55bc59434c50 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f45a35edb80 10 client.15498 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f45a35edb80 10 client.15498 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:24:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f45a35edb80 20 client.15498 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc5944e720 0x55bc59450b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f45a35edb80 4 client.15498 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.593+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc59401070 con 0x55bc5944e720 2024-05-14T09:24:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.594+0000 7f458de00700 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc5944e720 0x55bc59450b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.595+0000 7f458de00700 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc5944e720 0x55bc59450b40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3ba0b9a0fb73cc00 server_cookie=c81f6caf6db696ff in_seq=0 out_seq=0 2024-05-14T09:24:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.595+0000 7f4573e00700 10 client.15498 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:24:27.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f4573e00700 1 -- 172.21.15.120:0/1558495807 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc59401070 con 0x55bc5944e720 2024-05-14T09:24:27.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f4573e00700 10 client.15498 handle_command_reply: tid=0 2024-05-14T09:24:27.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 client.15498 shutdown 2024-05-14T09:24:27.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 msgr2=0x55bc5943e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943e940 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f45780a5440 tx=0x7f45780b1f20 comp rx=0 tx=0).stop 2024-05-14T09:24:27.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 shutdown_connections 2024-05-14T09:24:27.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc5943e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc5944e720 0x55bc59450b40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5943ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1558495807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943e940 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f4573e00700 0 client.15498 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.597+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 >> 172.21.15.120:0/1558495807 conn(0x55bc592f5a80 msgr2=0x55bc59433700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.598+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 shutdown_connections 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.598+0000 7f45a35edb80 1 -- 172.21.15.120:0/1558495807 wait complete. 2024-05-14T09:24:27.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.598+0000 7f45a35edb80 20 client.15498 trim_cache size 0 max 16384 2024-05-14T09:24:27.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.618+0000 7f45a35edb80 1 Processor -- start 2024-05-14T09:24:27.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.618+0000 7f45a35edb80 1 -- start start 2024-05-14T09:24:27.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc59434710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5944a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f45a35edb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f45901b2560 con 0x55bc59434c50 2024-05-14T09:24:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f45a35edb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f45901b4190 con 0x55bc592b6e40 2024-05-14T09:24:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f45a35edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45901b2c30 con 0x55bc5943abf0 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f458d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f458d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53788/0 (socket says 172.21.15.120:53788) 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.619+0000 7f458d400700 1 -- 172.21.15.120:0/1786255646 learned_addr learned my addr 172.21.15.120:0/1786255646 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458e800700 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5944a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458de00700 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc59434710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458d400700 1 -- 172.21.15.120:0/1786255646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 msgr2=0x55bc5944a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458d400700 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5944a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458d400700 1 -- 172.21.15.120:0/1786255646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 msgr2=0x55bc59434710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458d400700 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc59434710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458d400700 1 -- 172.21.15.120:0/1786255646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc59440ca0 con 0x55bc59434c50 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458de00700 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc59434710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.620+0000 7f458d400700 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943d380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f45780a4ed0 tx=0x7f45780a5090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed58fb53245cc3f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.621+0000 7f457ea00700 1 -- 172.21.15.120:0/1786255646 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578021030 con 0x55bc59434c50 2024-05-14T09:24:27.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.621+0000 7f457ea00700 1 -- 172.21.15.120:0/1786255646 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45780c3070 con 0x55bc59434c50 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.621+0000 7f457ea00700 1 -- 172.21.15.120:0/1786255646 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45780a8880 con 0x55bc59434c50 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 -- 172.21.15.120:0/1786255646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 msgr2=0x55bc5943d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943d380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f45780a4ed0 tx=0x7f45780a5090 comp rx=0 tx=0).stop 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 -- 172.21.15.120:0/1786255646 shutdown_connections 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc592b6e40 0x55bc59434710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc5943abf0 0x55bc5944a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1786255646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc59434c50 0x55bc5943d380 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 -- 172.21.15.120:0/1786255646 >> 172.21.15.120:0/1786255646 conn(0x55bc592f5a80 msgr2=0x55bc594380d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 -- 172.21.15.120:0/1786255646 shutdown_connections 2024-05-14T09:24:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.622+0000 7f45a35edb80 1 -- 172.21.15.120:0/1786255646 wait complete. 2024-05-14T09:24:27.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.623+0000 7f45a35edb80 1 -- start start 2024-05-14T09:24:27.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.623+0000 7f45a35edb80 1 Processor -- start 2024-05-14T09:24:27.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.623+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc59454060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.623+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc5943abf0 0x55bc594513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.623+0000 7f45a35edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc59451920 0x55bc59451d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.623+0000 7f45a35edb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f45901b3a00 con 0x55bc592b6e40 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.623+0000 7f45a35edb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f45901b3330 con 0x55bc5943abf0 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f45a35edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45901b0520 con 0x55bc59451920 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f45a35edb80 10 client.0 _ll_register_callbacks cb 0x55bc5943e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc59454060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc59454060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53800/0 (socket says 172.21.15.120:53800) 2024-05-14T09:24:27.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 -- 172.21.15.120:0/1303240549 learned_addr learned my addr 172.21.15.120:0/1303240549 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458d400700 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc5943abf0 0x55bc594513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458e800700 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc59451920 0x55bc59451d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 -- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc59451920 msgr2=0x55bc59451d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc59451920 0x55bc59451d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 -- 172.21.15.120:0/1303240549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc5943abf0 msgr2=0x55bc594513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc5943abf0 0x55bc594513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.624+0000 7f458de00700 1 -- 172.21.15.120:0/1303240549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc594b7ca0 con 0x55bc592b6e40 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f458de00700 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc59454060 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4580003760 tx=0x7f458001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927f549a811be5f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f4573e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f4573e00700 1 -- 172.21.15.120:0/1303240549 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458002c060 con 0x55bc592b6e40 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f4573e00700 1 -- 172.21.15.120:0/1303240549 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f45800039c0 con 0x55bc592b6e40 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45780c3070 con 0x55bc592b6e40 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f4573e00700 1 -- 172.21.15.120:0/1303240549 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4580033050 con 0x55bc592b6e40 2024-05-14T09:24:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f45a35edb80 10 client.15504 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.625+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bc594b8ed0 con 0x55bc592b6e40 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f4573e00700 1 -- 172.21.15.120:0/1303240549 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45780c3070 con 0x55bc592b6e40 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f4573e00700 1 -- 172.21.15.120:0/1303240549 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f458000f460 con 0x55bc592b6e40 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f45a35edb80 10 client.15504 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f45a35edb80 10 client.15504 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f45a35edb80 20 client.15504 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc594b95e0 0x55bc594bba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f45a35edb80 4 client.15504 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:24:27.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.626+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc59364400 con 0x55bc594b95e0 2024-05-14T09:24:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.627+0000 7f458d400700 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc594b95e0 0x55bc594bba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.628+0000 7f458d400700 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc594b95e0 0x55bc594bba00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f1fb83fe2742ebc5 server_cookie=3beaa7b265a591db in_seq=0 out_seq=0 2024-05-14T09:24:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.628+0000 7f4573e00700 10 client.15504 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.628+0000 7f4573e00700 1 -- 172.21.15.120:0/1303240549 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc59364400 con 0x55bc594b95e0 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.628+0000 7f4573e00700 10 client.15504 handle_command_reply: tid=0 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.628+0000 7f45a35edb80 1 client.15504 shutdown 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.628+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 msgr2=0x55bc59454060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.628+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc59454060 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4580003760 tx=0x7f458001c040 comp rx=0 tx=0).stop 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 shutdown_connections 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55bc594b95e0 0x55bc594bba00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc59451920 0x55bc59451d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc592b6e40 0x55bc59454060 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 --2- 172.21.15.120:0/1303240549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc5943abf0 0x55bc594513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f4573e00700 0 client.15504 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 >> 172.21.15.120:0/1303240549 conn(0x55bc592f5a80 msgr2=0x55bc5942ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 shutdown_connections 2024-05-14T09:24:27.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 1 -- 172.21.15.120:0/1303240549 wait complete. 2024-05-14T09:24:27.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.629+0000 7f45a35edb80 20 client.15504 trim_cache size 0 max 16384 2024-05-14T09:24:27.631 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:24:27.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f45740b2880 msgr2=0x7f45740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f45740b2880 0x7f45740b4d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4588007c30 tx=0x7f4588009900 comp rx=0 tx=0).stop 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4590106ed0 msgr2=0x7f459019d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4590106ed0 0x7f459019d520 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f457800d950 tx=0x7f457800dd10 comp rx=0 tx=0).stop 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 shutdown_connections 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f45740b2880 0x7f45740b4d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f459010c5c0 0x7f45901a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4590106580 0x7f459019cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 --2- 172.21.15.120:0/988116216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4590106ed0 0x7f459019d520 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 >> 172.21.15.120:0/988116216 conn(0x7f4590102080 msgr2=0x7f4590104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 shutdown_connections 2024-05-14T09:24:27.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:27.630+0000 7f4594a00700 1 -- 172.21.15.120:0/988116216 wait complete. 2024-05-14T09:24:27.637 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/: 2024-05-14T09:24:27.637 INFO:teuthology.orchestra.run.smithi120.stdout:total 2 2024-05-14T09:24:27.637 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:23 . 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:23 .. 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 data 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data: 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:total 45 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 . 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:23 .. 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 09:24 base 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 May 14 09:23 global 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 log 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_commit_ts 2024-05-14T09:24:27.638 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_dynshmem 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 14 09:23 pg_hba.conf 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 14 09:23 pg_ident.conf 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:24 pg_logical 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 pg_multixact 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_notify 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_replslot 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_serial 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_snapshots 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_stat 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_stat_tmp 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 pg_subtrans 2024-05-14T09:24:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_tblspc 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_twophase 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:23 PG_VERSION 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:23 pg_wal 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 pg_xact 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 14 09:23 postgresql.auto.conf 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 14 09:23 postgresql.conf 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base: 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:total 3 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 09:24 . 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:23 1 2024-05-14T09:24:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:24 13493 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:24 13494 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:total 7778 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:23 . 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 09:24 .. 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 112 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 113 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:23 1247 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1247_fsm 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1247_vm 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 09:23 1249 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1249_fsm 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1249_vm 2024-05-14T09:24:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 09:23 1255 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1255_fsm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1255_vm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 09:24 1259 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1259_fsm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1259_vm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 09:24 13344 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13344_fsm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13344_vm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13346 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13348 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13349_fsm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349_vm 2024-05-14T09:24:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13351 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13353 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13354_fsm 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354_vm 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13356 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13358 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13359_fsm 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359_vm 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13361 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13363 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 1417 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 1418 2024-05-14T09:24:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 174 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 175 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2187 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2224 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2328 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2336 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2337 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2579 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2600 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2600_fsm 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2600_vm 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2601 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2601_fsm 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2601_vm 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:23 2602 2024-05-14T09:24:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2602_fsm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2602_vm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2603 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2603_fsm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2603_vm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2604 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2605 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2605_fsm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2605_vm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2606 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2606_fsm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2606_vm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2607 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2607_fsm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2607_vm 2024-05-14T09:24:27.645 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 09:24 2608 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2608_fsm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2608_vm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 09:24 2609 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2609_fsm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2609_vm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2610 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2610_fsm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2610_vm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2611 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2612_fsm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612_vm 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2613 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615 2024-05-14T09:24:27.646 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2615_fsm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615_vm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2616 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2616_fsm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2616_vm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 09:24 2617 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2617_fsm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2617_vm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 09:24 2618 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2618_fsm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2618_vm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 09:24 2619 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2619_fsm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2619_vm 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2620 2024-05-14T09:24:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2650 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2651 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2652 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:23 2653 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:23 2654 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2655 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2656 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2657 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 09:24 2658 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 2659 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2660 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2661 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2662 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2663 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2664 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2665 2024-05-14T09:24:27.648 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2666 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2667 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2668 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2669 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2670 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 09:24 2673 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 09:24 2674 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 09:24 2675 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2678 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2679 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2680 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2681 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2682 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2683 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2684 2024-05-14T09:24:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2685 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2686 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2687 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:23 2688 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:23 2689 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 09:24 2690 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 09:24 2691 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2692 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2693 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2696 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2699 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2701 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2702 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2703 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2704 2024-05-14T09:24:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2753 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2753_fsm 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2753_vm 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2754 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2755 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2756 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2757 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2830 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2831 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2832 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2833 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2834 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2835 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2836 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2837 2024-05-14T09:24:27.651 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 09:24 2838 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2838_fsm 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2838_vm 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2839 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840_fsm 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2840_vm 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2841 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2995 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2996 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3079_fsm 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079_vm 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3080 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3081 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3085 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3118 2024-05-14T09:24:27.652 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3119 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:24 3164 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3256 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3257 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3258 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3350 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3351 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3379 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3380 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3381 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3394 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3394_fsm 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3394_vm 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3395 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3429 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3430 2024-05-14T09:24:27.653 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3431 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3433 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3439 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3440 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3455 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 09:24 3456 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3456_fsm 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3456_vm 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3466 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3467 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3468 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3501 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3502 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3503 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3534 2024-05-14T09:24:27.654 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3541_fsm 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541_vm 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 3542 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3574 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3575 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3576 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3596 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3597 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3598 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3599 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3600_fsm 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600_vm 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3601_fsm 2024-05-14T09:24:27.655 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601_vm 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3602_fsm 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602_vm 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603_fsm 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3603_vm 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3604 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3605 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 3606 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 3607 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3608 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 3609 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3712 2024-05-14T09:24:27.656 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3764_fsm 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764_vm 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3766 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3767 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3997 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4143 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4144 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4145 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4146 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4147 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4148 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4149 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4150 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4151 2024-05-14T09:24:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4152 2024-05-14T09:24:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4153 2024-05-14T09:24:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4154 2024-05-14T09:24:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4155 2024-05-14T09:24:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4156 2024-05-14T09:24:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4157 2024-05-14T09:24:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4158 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 -- 172.21.15.120:0/2060930200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28104cc0 msgr2=0x7fda281050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 --2- 172.21.15.120:0/2060930200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28104cc0 0x7fda281050d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda14009860 tx=0x7fda1402a340 comp rx=0 tx=0).stop 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 -- 172.21.15.120:0/2060930200 shutdown_connections 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 --2- 172.21.15.120:0/2060930200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda281099c0 0x7fda2810bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 --2- 172.21.15.120:0/2060930200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28104cc0 0x7fda281050d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 --2- 172.21.15.120:0/2060930200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28103a80 0x7fda28104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 -- 172.21.15.120:0/2060930200 >> 172.21.15.120:0/2060930200 conn(0x7fda280fec70 msgr2=0x7fda28101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 -- 172.21.15.120:0/2060930200 shutdown_connections 2024-05-14T09:24:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.892+0000 7fda2e000640 1 -- 172.21.15.120:0/2060930200 wait complete. 2024-05-14T09:24:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.893+0000 7fda2e000640 1 Processor -- start 2024-05-14T09:24:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.893+0000 7fda2e000640 1 -- start start 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2e000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda28103a80 0x7fda28076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28104cc0 0x7fda28075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda281099c0 0x7fda28075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2e000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda2810f430 con 0x7fda28104cc0 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2e000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda2810f2b0 con 0x7fda28103a80 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2e000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda2810f5b0 con 0x7fda281099c0 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda27e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28104cc0 0x7fda28075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda27e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28104cc0 0x7fda28075020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53804/0 (socket says 172.21.15.120:53804) 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda27e00640 1 -- 172.21.15.120:0/459560981 learned_addr learned my addr 172.21.15.120:0/459560981 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2cc00640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda28103a80 0x7fda28076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.894+0000 7fda2d600640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda281099c0 0x7fda28075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.895+0000 7fda27e00640 1 -- 172.21.15.120:0/459560981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda281099c0 msgr2=0x7fda28075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.895+0000 7fda27e00640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda281099c0 0x7fda28075560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.895+0000 7fda27e00640 1 -- 172.21.15.120:0/459560981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda28103a80 msgr2=0x7fda28076980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.895+0000 7fda27e00640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda28103a80 0x7fda28076980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.895+0000 7fda27e00640 1 -- 172.21.15.120:0/459560981 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda28075c90 con 0x7fda28104cc0 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.895+0000 7fda2cc00640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda28103a80 0x7fda28076980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.895+0000 7fda27e00640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28104cc0 0x7fda28075020 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fda1402a930 tx=0x7fda1402ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.896+0000 7fda25600640 1 -- 172.21.15.120:0/459560981 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14040030 con 0x7fda28104cc0 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.896+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda281a4130 con 0x7fda28104cc0 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.896+0000 7fda25600640 1 -- 172.21.15.120:0/459560981 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda140305f0 con 0x7fda28104cc0 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.896+0000 7fda25600640 1 -- 172.21.15.120:0/459560981 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14037040 con 0x7fda28104cc0 2024-05-14T09:24:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.896+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda281a4590 con 0x7fda28104cc0 2024-05-14T09:24:27.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.900+0000 7fda365d2740 1 Processor -- start 2024-05-14T09:24:27.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.901+0000 7fda365d2740 1 -- start start 2024-05-14T09:24:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.901+0000 7fda365d2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87078d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.901+0000 7fda365d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.901+0000 7fda365d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d870794780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.901+0000 7fda365d2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d8706f1550 con 0x55d8703eb1b0 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.901+0000 7fda365d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d870696bc0 con 0x55d8703c22f0 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.901+0000 7fda365d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d8706ed510 con 0x55d8703ca4d0 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87078d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87078d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53808/0 (socket says 172.21.15.120:53808) 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 -- 172.21.15.120:0/181398193 learned_addr learned my addr 172.21.15.120:0/181398193 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2cc00640 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda25600640 1 -- 172.21.15.120:0/459560981 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fda14043070 con 0x7fda28104cc0 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 -- 172.21.15.120:0/181398193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 msgr2=0x55d870794780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d870794780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 -- 172.21.15.120:0/181398193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 msgr2=0x55d87078d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2d600640 1 -- 172.21.15.120:0/181398193 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d870403210 con 0x55d8703eb1b0 2024-05-14T09:24:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.902+0000 7fda2cc00640 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.903+0000 7fda2d600640 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87078d300 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fc0 tx=0x7fda20010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de258a86ecc09461 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.903+0000 7fda19c00640 1 -- 172.21.15.120:0/181398193 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20003b70 con 0x55d8703eb1b0 2024-05-14T09:24:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.903+0000 7fda19c00640 1 -- 172.21.15.120:0/181398193 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda20003d10 con 0x55d8703eb1b0 2024-05-14T09:24:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.903+0000 7fda19c00640 1 -- 172.21.15.120:0/181398193 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20011980 con 0x55d8703eb1b0 2024-05-14T09:24:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.904+0000 7fda365d2740 1 -- 172.21.15.120:0/181398193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 msgr2=0x55d87078d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.904+0000 7fda365d2740 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87078d300 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fc0 tx=0x7fda20010860 comp rx=0 tx=0).stop 2024-05-14T09:24:27.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.904+0000 7fda365d2740 1 -- 172.21.15.120:0/181398193 shutdown_connections 2024-05-14T09:24:27.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.904+0000 7fda365d2740 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d870794780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda365d2740 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda365d2740 1 --2- 172.21.15.120:0/181398193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87078d300 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda365d2740 1 -- 172.21.15.120:0/181398193 >> 172.21.15.120:0/181398193 conn(0x55d8703df300 msgr2=0x55d870788c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda365d2740 1 -- 172.21.15.120:0/181398193 shutdown_connections 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda25600640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda100b27f0 0x7fda100b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda365d2740 1 -- 172.21.15.120:0/181398193 wait complete. 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda25600640 1 -- 172.21.15.120:0/459560981 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fda14102550 con 0x7fda28104cc0 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.905+0000 7fda2cc00640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda100b27f0 0x7fda100b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 -- start start 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 Processor -- start 2024-05-14T09:24:27.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda2cc00640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda100b27f0 0x7fda100b4d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55d870789a20 tx=0x7fda1c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703c22f0 0x55d870796eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703ca4d0 0x55d8707973f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87079e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d8707951d0 con 0x55d8703ca4d0 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d8706aa660 con 0x55d8703eb1b0 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.906+0000 7fda365d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d870795350 con 0x55d8703c22f0 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda365d2740 10 client.0 _ll_register_callbacks cb 0x55d870674400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703ca4d0 0x55d8707973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703ca4d0 0x55d8707973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53812/0 (socket says 172.21.15.120:53812) 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 -- 172.21.15.120:0/1194325563 learned_addr learned my addr 172.21.15.120:0/1194325563 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda2cc00640 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703c22f0 0x55d870796eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 -- 172.21.15.120:0/1194325563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703c22f0 msgr2=0x55d870796eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703c22f0 0x55d870796eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 -- 172.21.15.120:0/1194325563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 msgr2=0x55d87079e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87079e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.907+0000 7fda27e00640 1 -- 172.21.15.120:0/1194325563 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8704cf620 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda27e00640 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703ca4d0 0x55d8707973f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fda140c6a70 tx=0x7fda140c9030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917adfc26e07967e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda0e000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda0e000640 1 -- 172.21.15.120:0/1194325563 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140ec0b0 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda0e000640 1 -- 172.21.15.120:0/1194325563 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fda140ffd60 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda20003d10 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda0e000640 1 -- 172.21.15.120:0/1194325563 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fda140c9310 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda365d2740 10 client.15516 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d8707951d0 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.908+0000 7fda0e000640 1 -- 172.21.15.120:0/1194325563 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda20003d10 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.909+0000 7fda0e000640 1 -- 172.21.15.120:0/1194325563 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fda1404d060 con 0x55d8703ca4d0 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.909+0000 7fda365d2740 10 client.15516 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:27.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.909+0000 7fda365d2740 10 client.15516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:27.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.909+0000 7fda365d2740 20 client.15516 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:27.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.909+0000 7fda365d2740 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d8703a9d80 0x55d8707a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.909+0000 7fda365d2740 4 client.15516 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:27.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.909+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8706ff160 con 0x55d8703a9d80 2024-05-14T09:24:27.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.910+0000 7fda2cc00640 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d8703a9d80 0x55d8707a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.911+0000 7fda0e000640 10 client.15516 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.911+0000 7fda2cc00640 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d8703a9d80 0x55d8707a4ab0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f860c6c351c8572 server_cookie=1693ceb2297f6fe9 in_seq=0 out_seq=0 2024-05-14T09:24:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda0e000640 1 -- 172.21.15.120:0/1194325563 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d8706ff160 con 0x55d8703a9d80 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda0e000640 10 client.15516 handle_command_reply: tid=0 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 client.15516 shutdown 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703ca4d0 msgr2=0x55d8707973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703ca4d0 0x55d8707973f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fda140c6a70 tx=0x7fda140c9030 comp rx=0 tx=0).stop 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 shutdown_connections 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d8703a9d80 0x55d8707a4ab0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87079e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703ca4d0 0x55d8707973f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 --2- 172.21.15.120:0/1194325563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703c22f0 0x55d870796eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 >> 172.21.15.120:0/1194325563 conn(0x55d8703df300 msgr2=0x55d870787c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda0e000640 0 client.15516 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 shutdown_connections 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.913+0000 7fda365d2740 1 -- 172.21.15.120:0/1194325563 wait complete. 2024-05-14T09:24:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.914+0000 7fda365d2740 20 client.15516 trim_cache size 0 max 16384 2024-05-14T09:24:27.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 Processor -- start 2024-05-14T09:24:27.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 -- start start 2024-05-14T09:24:27.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87078c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87079e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda281ae9b0 con 0x55d8703eb1b0 2024-05-14T09:24:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda281b05e0 con 0x55d8703c22f0 2024-05-14T09:24:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda365d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda281af080 con 0x55d8703ca4d0 2024-05-14T09:24:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda2d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87079e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.937+0000 7fda2d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87079e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53816/0 (socket says 172.21.15.120:53816) 2024-05-14T09:24:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2d600640 1 -- 172.21.15.120:0/650145366 learned_addr learned my addr 172.21.15.120:0/650145366 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda27e00640 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87078c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2cc00640 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2d600640 1 -- 172.21.15.120:0/650145366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 msgr2=0x55d87078c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2d600640 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87078c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2d600640 1 -- 172.21.15.120:0/650145366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 msgr2=0x55d87078c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2d600640 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2d600640 1 -- 172.21.15.120:0/650145366 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d870796cb0 con 0x55d8703eb1b0 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.938+0000 7fda2d600640 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87079e270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fda20009aa0 tx=0x7fda20010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453b9121fe7da771 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.939+0000 7fda19200640 1 -- 172.21.15.120:0/650145366 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20003970 con 0x55d8703eb1b0 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.939+0000 7fda19200640 1 -- 172.21.15.120:0/650145366 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda20005070 con 0x55d8703eb1b0 2024-05-14T09:24:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.939+0000 7fda19200640 1 -- 172.21.15.120:0/650145366 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20011740 con 0x55d8703eb1b0 2024-05-14T09:24:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 -- 172.21.15.120:0/650145366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 msgr2=0x55d87079e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87079e270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fda20009aa0 tx=0x7fda20010fd0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 -- 172.21.15.120:0/650145366 shutdown_connections 2024-05-14T09:24:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703eb1b0 0x55d87079e270 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87078c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 --2- 172.21.15.120:0/650145366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703c22f0 0x55d87078c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 -- 172.21.15.120:0/650145366 >> 172.21.15.120:0/650145366 conn(0x55d8703df300 msgr2=0x55d87078ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 -- 172.21.15.120:0/650145366 shutdown_connections 2024-05-14T09:24:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.940+0000 7fda365d2740 1 -- 172.21.15.120:0/650145366 wait complete. 2024-05-14T09:24:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 -- start start 2024-05-14T09:24:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 Processor -- start 2024-05-14T09:24:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703c22f0 0x55d87079ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87079d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87080ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda281afe50 con 0x55d8703c22f0 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda281af780 con 0x55d8703eb1b0 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda281ac9b0 con 0x55d8703ca4d0 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.941+0000 7fda365d2740 10 client.0 _ll_register_callbacks cb 0x7fda140c95d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703c22f0 0x55d87079ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703c22f0 0x55d87079ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53826/0 (socket says 172.21.15.120:53826) 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 -- 172.21.15.120:0/368429373 learned_addr learned my addr 172.21.15.120:0/368429373 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2d600640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87080ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda27e00640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87079d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 -- 172.21.15.120:0/368429373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 msgr2=0x55d87079d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87079d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 -- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 msgr2=0x55d87080ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87080ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:27.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda2cc00640 1 -- 172.21.15.120:0/368429373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d87079dbd0 con 0x55d8703c22f0 2024-05-14T09:24:27.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.942+0000 7fda27e00640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87079d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:27.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.943+0000 7fda2d600640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87080ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:27.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.943+0000 7fda2cc00640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703c22f0 0x55d87079ce40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda28104680 tx=0x7fda1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd13f98a8086ee9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:27.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.943+0000 7fda0e000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.946+0000 7fda0e000640 1 -- 172.21.15.120:0/368429373 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0285f0 con 0x55d8703c22f0 2024-05-14T09:24:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.946+0000 7fda0e000640 1 -- 172.21.15.120:0/368429373 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fda1c028790 con 0x55d8703c22f0 2024-05-14T09:24:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.946+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda20005070 con 0x55d8703c22f0 2024-05-14T09:24:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.946+0000 7fda0e000640 1 -- 172.21.15.120:0/368429373 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fda1c042050 con 0x55d8703c22f0 2024-05-14T09:24:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.946+0000 7fda365d2740 10 client.15522 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.946+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d87080c410 con 0x55d8703c22f0 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda0e000640 1 -- 172.21.15.120:0/368429373 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda20005070 con 0x55d8703c22f0 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda0e000640 1 -- 172.21.15.120:0/368429373 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fda1c019040 con 0x55d8703c22f0 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda365d2740 10 client.15522 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda365d2740 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda365d2740 20 client.15522 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda365d2740 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d87037f1c0 0x55d87080eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda365d2740 4 client.15522 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.947+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8706f8fd0 con 0x55d87037f1c0 2024-05-14T09:24:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.948+0000 7fda27e00640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d87037f1c0 0x55d87080eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.949+0000 7fda27e00640 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d87037f1c0 0x55d87080eea0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f7a0c8dcdc5fc5 server_cookie=881b36a444d60e8f in_seq=0 out_seq=0 2024-05-14T09:24:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:27.949+0000 7fda0e000640 10 client.15522 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:28.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda0e000640 1 -- 172.21.15.120:0/368429373 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8706f8fd0 con 0x55d87037f1c0 2024-05-14T09:24:28.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda0e000640 10 client.15522 handle_command_reply: tid=0 2024-05-14T09:24:28.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 client.15522 shutdown 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703c22f0 msgr2=0x55d87079ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703c22f0 0x55d87079ce40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda28104680 tx=0x7fda1c0046c0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 shutdown_connections 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d87037f1c0 0x55d87080eea0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8703eb1b0 0x55d87080ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8703ca4d0 0x55d87079d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 --2- 172.21.15.120:0/368429373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8703c22f0 0x55d87079ce40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 >> 172.21.15.120:0/368429373 conn(0x55d8703df300 msgr2=0x55d87078c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda0e000640 0 client.15522 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 shutdown_connections 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 1 -- 172.21.15.120:0/368429373 wait complete. 2024-05-14T09:24:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.019+0000 7fda365d2740 20 client.15522 trim_cache size 0 max 16384 2024-05-14T09:24:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:24:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:24:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:24:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:24:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda100b27f0 msgr2=0x7fda100b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda100b27f0 0x7fda100b4d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55d870789a20 tx=0x7fda1c009260 comp rx=0 tx=0).stop 2024-05-14T09:24:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28104cc0 msgr2=0x7fda28075020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28104cc0 0x7fda28075020 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fda1402a930 tx=0x7fda1402ad70 comp rx=0 tx=0).stop 2024-05-14T09:24:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 shutdown_connections 2024-05-14T09:24:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda100b27f0 0x7fda100b4d00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda281099c0 0x7fda28075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28104cc0 0x7fda28075020 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 --2- 172.21.15.120:0/459560981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda28103a80 0x7fda28076980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.020+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 >> 172.21.15.120:0/459560981 conn(0x7fda280fec70 msgr2=0x7fda281059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.021+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 shutdown_connections 2024-05-14T09:24:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:28.021+0000 7fda2e000640 1 -- 172.21.15.120:0/459560981 wait complete. 2024-05-14T09:24:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:27 smithi152 ceph-mon[34868]: pgmap v583: 129 pgs: 129 active+clean; 45 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 430 KiB/s wr, 196 op/s 2024-05-14T09:24:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:27 smithi175 ceph-mon[35353]: pgmap v583: 129 pgs: 129 active+clean; 45 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 430 KiB/s wr, 196 op/s 2024-05-14T09:24:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:27 smithi120 ceph-mon[31085]: pgmap v583: 129 pgs: 129 active+clean; 45 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 430 KiB/s wr, 196 op/s 2024-05-14T09:24:28.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T09:24:28.891 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4159 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4160 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4161 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4162 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4163 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4164 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4165 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4166 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4167 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4168 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4169 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4170 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4171 2024-05-14T09:24:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4172 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4173 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4174 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 5002 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 548 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 549 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6102 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6104 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6106 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6110 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6111 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6112 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6113 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6117 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 826 2024-05-14T09:24:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 827 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 828 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:23 pg_filenode.map 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:23 PG_VERSION 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:total 7778 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:24 . 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 09:24 .. 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 112 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 113 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 1247 2024-05-14T09:24:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1247_fsm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1247_vm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 09:24 1249 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1249_fsm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1249_vm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 09:24 1255 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1255_fsm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1255_vm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 09:24 1259 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1259_fsm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1259_vm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 09:24 13344 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13344_fsm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13344_vm 2024-05-14T09:24:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13346 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13348 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13349_fsm 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349_vm 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13351 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13353 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13354_fsm 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354_vm 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13356 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13358 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359 2024-05-14T09:24:28.896 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13359_fsm 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359_vm 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13361 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13363 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1417 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1418 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 174 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 175 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2187 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2224 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2328 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2336 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2337 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2579 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2600 2024-05-14T09:24:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2600_fsm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2600_vm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2601_fsm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601_vm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2602 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2602_fsm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2602_vm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2603 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2603_fsm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2603_vm 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2604 2024-05-14T09:24:28.898 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2605 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2605_fsm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2605_vm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2606 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2606_fsm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2606_vm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2607 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2607_fsm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2607_vm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 09:24 2608 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2608_fsm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2608_vm 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 09:24 2609 2024-05-14T09:24:28.899 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2609_fsm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2609_vm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2610 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2610_fsm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2610_vm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2611 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2612_fsm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612_vm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2613 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2615_fsm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615_vm 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2616 2024-05-14T09:24:28.900 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2616_fsm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2616_vm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 09:24 2617 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2617_fsm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2617_vm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 09:24 2618 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2618_fsm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2618_vm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 09:24 2619 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2619_fsm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2619_vm 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2620 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2650 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2651 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2652 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2653 2024-05-14T09:24:28.901 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2654 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2655 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2656 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2657 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 09:24 2658 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 2659 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2660 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2661 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2662 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2663 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2664 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2665 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2666 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2667 2024-05-14T09:24:28.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2668 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2669 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2670 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 09:24 2673 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 09:24 2674 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 09:24 2675 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2678 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2679 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2680 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2681 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2682 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2683 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2684 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2685 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2686 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2687 2024-05-14T09:24:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2688 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2689 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 09:24 2690 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 09:24 2691 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2692 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2693 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2696 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2699 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2701 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2702 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2703 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2704 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2753 2024-05-14T09:24:28.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2753_fsm 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2753_vm 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2754 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2755 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2756 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2757 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2830 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2831 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2832 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2833 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2834 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2835 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2836 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2837 2024-05-14T09:24:28.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 09:24 2838 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2838_fsm 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2838_vm 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2839 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840_fsm 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2840_vm 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2841 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2995 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2996 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3079_fsm 2024-05-14T09:24:28.906 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079_vm 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3080 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3081 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3085 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3118 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3119 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:24 3164 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3256 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3257 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3258 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3350 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3351 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3379 2024-05-14T09:24:28.907 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3380 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3381 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3394 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3394_fsm 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3394_vm 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3395 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3429 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3430 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3431 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3433 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3439 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3440 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3455 2024-05-14T09:24:28.908 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 09:24 3456 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3456_fsm 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3456_vm 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3466 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3467 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3468 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3501 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3502 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3503 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3534 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3541_fsm 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541_vm 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3542 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3574 2024-05-14T09:24:28.909 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3575 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3576 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3596 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3597 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3598 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3599 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3600_fsm 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600_vm 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3601_fsm 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601_vm 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602 2024-05-14T09:24:28.910 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3602_fsm 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602_vm 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603_fsm 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3603_vm 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3604 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3605 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3606 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3607 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3608 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 3609 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3712 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3764_fsm 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764_vm 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3766 2024-05-14T09:24:28.911 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3767 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3997 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4143 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4144 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4145 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4146 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4147 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4148 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4149 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4150 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4151 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4152 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4153 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4154 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4155 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4156 2024-05-14T09:24:28.912 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4157 2024-05-14T09:24:28.913 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4158 2024-05-14T09:24:28.913 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4159 2024-05-14T09:24:28.913 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4160 2024-05-14T09:24:28.913 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4161 2024-05-14T09:24:28.913 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4162 2024-05-14T09:24:29.027 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:30.200 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4163 2024-05-14T09:24:30.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4164 2024-05-14T09:24:30.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4165 2024-05-14T09:24:30.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4166 2024-05-14T09:24:30.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4167 2024-05-14T09:24:30.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4168 2024-05-14T09:24:30.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4169 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4170 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4171 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4172 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4173 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4174 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 5002 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 548 2024-05-14T09:24:30.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 549 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6102 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6104 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6106 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6110 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6111 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6112 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6113 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6117 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 826 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 827 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 828 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:24 pg_filenode.map 2024-05-14T09:24:30.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:24 PG_VERSION 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:total 7778 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:24 . 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 09:24 .. 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 112 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 113 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 1247 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1247_fsm 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1247_vm 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 09:24 1249 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1249_fsm 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1249_vm 2024-05-14T09:24:30.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 09:24 1255 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1255_fsm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1255_vm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 09:24 1259 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1259_fsm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1259_vm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 09:24 13344 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13344_fsm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13344_vm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13346 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13348 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13349_fsm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349_vm 2024-05-14T09:24:30.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13351 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13353 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13354_fsm 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354_vm 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13356 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13358 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13359_fsm 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359_vm 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13361 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13363 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1417 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1418 2024-05-14T09:24:30.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 174 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 175 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2187 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2224 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2328 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2336 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2337 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2579 2024-05-14T09:24:30.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2600 2024-05-14T09:24:30.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2600_fsm 2024-05-14T09:24:30.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2600_vm 2024-05-14T09:24:30.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601 2024-05-14T09:24:30.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2601_fsm 2024-05-14T09:24:30.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601_vm 2024-05-14T09:24:30.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2602 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2602_fsm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2602_vm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2603 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2603_fsm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2603_vm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2604 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2605 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2605_fsm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2605_vm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2606 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2606_fsm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2606_vm 2024-05-14T09:24:30.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2607 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2607_fsm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2607_vm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 09:24 2608 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2608_fsm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2608_vm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 09:24 2609 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2609_fsm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2609_vm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2610 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2610_fsm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2610_vm 2024-05-14T09:24:30.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2611 2024-05-14T09:24:30.212 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612 2024-05-14T09:24:30.212 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2612_fsm 2024-05-14T09:24:30.212 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612_vm 2024-05-14T09:24:30.212 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2613 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2615_fsm 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615_vm 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2616 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2616_fsm 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2616_vm 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 09:24 2617 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2617_fsm 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2617_vm 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 09:24 2618 2024-05-14T09:24:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2618_fsm 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2618_vm 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 09:24 2619 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2619_fsm 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2619_vm 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2620 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2650 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2651 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2652 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2653 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2654 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2655 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2656 2024-05-14T09:24:30.214 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2657 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 09:24 2658 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 2659 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2660 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2661 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2662 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2663 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2664 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2665 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2666 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2667 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2668 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2669 2024-05-14T09:24:30.215 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2670 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 09:24 2673 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 09:24 2674 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 09:24 2675 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2678 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2679 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2680 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2681 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2682 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2683 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2684 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2685 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2686 2024-05-14T09:24:30.216 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2687 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2688 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2689 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 09:24 2690 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 09:24 2691 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2692 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2693 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2696 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2699 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2701 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2702 2024-05-14T09:24:30.217 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2703 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2704 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2753 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2753_fsm 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2753_vm 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2754 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2755 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2756 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2757 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2830 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2831 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2832 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2833 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2834 2024-05-14T09:24:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2835 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2836 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2837 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 09:24 2838 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2838_fsm 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2838_vm 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2839 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840_fsm 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2840_vm 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2841 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2995 2024-05-14T09:24:30.219 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2996 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3079_fsm 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079_vm 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3080 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3081 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3085 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3118 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3119 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:24 3164 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3256 2024-05-14T09:24:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3257 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3258 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3350 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3351 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3379 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3380 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3381 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3394 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3394_fsm 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3394_vm 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3395 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3429 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3430 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3431 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3433 2024-05-14T09:24:30.221 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3439 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3440 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3455 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 09:24 3456 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3456_fsm 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3456_vm 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3466 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3467 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3468 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3501 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3502 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3503 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3534 2024-05-14T09:24:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3541_fsm 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541_vm 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3542 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3574 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3575 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3576 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3596 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3597 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3598 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3599 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3600_fsm 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600_vm 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601 2024-05-14T09:24:30.223 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3601_fsm 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601_vm 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3602_fsm 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602_vm 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603_fsm 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3603_vm 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3604 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3605 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3606 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3607 2024-05-14T09:24:30.224 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3608 2024-05-14T09:24:30.225 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 3609 2024-05-14T09:24:30.225 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3712 2024-05-14T09:24:30.225 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764 2024-05-14T09:24:30.225 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3764_fsm 2024-05-14T09:24:30.225 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764_vm 2024-05-14T09:24:30.225 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3766 2024-05-14T09:24:30.226 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3767 2024-05-14T09:24:30.226 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3997 2024-05-14T09:24:30.226 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4143 2024-05-14T09:24:30.226 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4144 2024-05-14T09:24:30.226 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4145 2024-05-14T09:24:30.226 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4146 2024-05-14T09:24:30.226 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4147 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4148 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4149 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4150 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4151 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4152 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4153 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4154 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4155 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4156 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4157 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4158 2024-05-14T09:24:30.227 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4159 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4160 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4161 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4162 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4163 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4164 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4165 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4166 2024-05-14T09:24:30.228 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4167 2024-05-14T09:24:30.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:29 smithi175 ceph-mon[35353]: pgmap v584: 129 pgs: 129 active+clean; 46 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 433 KiB/s wr, 176 op/s 2024-05-14T09:24:30.229 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:29 smithi152 ceph-mon[34868]: pgmap v584: 129 pgs: 129 active+clean; 46 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 433 KiB/s wr, 176 op/s 2024-05-14T09:24:30.245 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:29 smithi120 ceph-mon[31085]: pgmap v584: 129 pgs: 129 active+clean; 46 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 433 KiB/s wr, 176 op/s 2024-05-14T09:24:30.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4168 2024-05-14T09:24:30.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4169 2024-05-14T09:24:30.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4170 2024-05-14T09:24:30.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4171 2024-05-14T09:24:30.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4172 2024-05-14T09:24:30.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4173 2024-05-14T09:24:30.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4174 2024-05-14T09:24:30.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 5002 2024-05-14T09:24:30.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 548 2024-05-14T09:24:30.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 549 2024-05-14T09:24:30.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6102 2024-05-14T09:24:30.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6104 2024-05-14T09:24:30.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6106 2024-05-14T09:24:30.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6110 2024-05-14T09:24:30.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6111 2024-05-14T09:24:30.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6112 2024-05-14T09:24:30.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6113 2024-05-14T09:24:30.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6117 2024-05-14T09:24:30.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 826 2024-05-14T09:24:30.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 827 2024-05-14T09:24:30.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 828 2024-05-14T09:24:30.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:24 pg_filenode.map 2024-05-14T09:24:30.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:24 PG_VERSION 2024-05-14T09:24:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.485 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/global: 2024-05-14T09:24:30.485 INFO:teuthology.orchestra.run.smithi120.stdout:total 538 2024-05-14T09:24:30.486 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 May 14 09:23 . 2024-05-14T09:24:30.486 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1213 2024-05-14T09:24:30.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1213_fsm 2024-05-14T09:24:30.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1213_vm 2024-05-14T09:24:30.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1214 2024-05-14T09:24:30.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1214_fsm 2024-05-14T09:24:30.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1214_vm 2024-05-14T09:24:30.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 1232 2024-05-14T09:24:30.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 1233 2024-05-14T09:24:30.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1260 2024-05-14T09:24:30.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1260_fsm 2024-05-14T09:24:30.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1260_vm 2024-05-14T09:24:30.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1261 2024-05-14T09:24:30.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1261_fsm 2024-05-14T09:24:30.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1261_vm 2024-05-14T09:24:30.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1262 2024-05-14T09:24:30.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1262_fsm 2024-05-14T09:24:30.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1262_vm 2024-05-14T09:24:30.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2396 2024-05-14T09:24:30.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2396_fsm 2024-05-14T09:24:30.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2396_vm 2024-05-14T09:24:30.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2397 2024-05-14T09:24:30.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2671 2024-05-14T09:24:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2672 2024-05-14T09:24:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2676 2024-05-14T09:24:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2677 2024-05-14T09:24:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2694 2024-05-14T09:24:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2695 2024-05-14T09:24:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2697 2024-05-14T09:24:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2698 2024-05-14T09:24:30.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2846 2024-05-14T09:24:30.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2847 2024-05-14T09:24:30.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2964 2024-05-14T09:24:30.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2965 2024-05-14T09:24:30.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2966 2024-05-14T09:24:30.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2967 2024-05-14T09:24:30.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3592 2024-05-14T09:24:30.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3593 2024-05-14T09:24:30.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4060 2024-05-14T09:24:30.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4061 2024-05-14T09:24:30.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4175 2024-05-14T09:24:30.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4176 2024-05-14T09:24:30.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4177 2024-05-14T09:24:30.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4178 2024-05-14T09:24:30.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4181 2024-05-14T09:24:30.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4182 2024-05-14T09:24:30.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4183 2024-05-14T09:24:30.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4184 2024-05-14T09:24:30.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4185 2024-05-14T09:24:30.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4186 2024-05-14T09:24:30.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6000 2024-05-14T09:24:30.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6001 2024-05-14T09:24:30.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6002 2024-05-14T09:24:30.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6100 2024-05-14T09:24:30.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6114 2024-05-14T09:24:30.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6115 2024-05-14T09:24:30.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 pg_control 2024-05-14T09:24:30.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:23 pg_filenode.map 2024-05-14T09:24:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.499 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/log: 2024-05-14T09:24:30.499 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.499 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 . 2024-05-14T09:24:30.716 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.716 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-14T09:24:30.716 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:total 3 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:24 . 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 mappings 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:24 replorigin_checkpoint 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 snapshots 2024-05-14T09:24:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:24 .. 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:24 .. 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:total 2 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 . 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 members 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 offsets 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:total 9 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 . 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 .. 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 0000 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:total 9 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 . 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 .. 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 0000 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.719 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.720 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-14T09:24:30.722 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.722 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.722 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.722 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-14T09:24:30.794 INFO:teuthology.orchestra.run.smithi120.stdout:total 9 2024-05-14T09:24:30.794 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 . 2024-05-14T09:24:30.794 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 0000 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:total 16386 2024-05-14T09:24:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:23 . 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:24 000000010000000000000001 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 archive_status 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:23 .. 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:total 9 2024-05-14T09:24:30.796 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 . 2024-05-14T09:24:30.797 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 09:24 .. 2024-05-14T09:24:30.797 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 0000 2024-05-14T09:24:30.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-05-14T09:24:31.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-05-14T09:24:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 -- 172.21.15.120:0/3741888649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c109870 msgr2=0x7f8b0c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 --2- 172.21.15.120:0/3741888649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c109870 0x7f8b0c1111d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400b0d0 tx=0x7f8b0400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 -- 172.21.15.120:0/3741888649 shutdown_connections 2024-05-14T09:24:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 --2- 172.21.15.120:0/3741888649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c109870 0x7f8b0c1111d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 --2- 172.21.15.120:0/3741888649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b0c1045f0 0x7f8b0c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 --2- 172.21.15.120:0/3741888649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b0c108f20 0x7f8b0c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 -- 172.21.15.120:0/3741888649 >> 172.21.15.120:0/3741888649 conn(0x7f8b0c100040 msgr2=0x7f8b0c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 -- 172.21.15.120:0/3741888649 shutdown_connections 2024-05-14T09:24:31.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.392+0000 7f8b12400700 1 -- 172.21.15.120:0/3741888649 wait complete. 2024-05-14T09:24:31.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.393+0000 7f8b12400700 1 Processor -- start 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.393+0000 7f8b12400700 1 -- start start 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b12400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b0c1045f0 0x7f8b0c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b12400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c108f20 0x7f8b0c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b12400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b0c109870 0x7f8b0c19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b12400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1143a0 con 0x7f8b0c108f20 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b12400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c114220 con 0x7f8b0c109870 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b12400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c114520 con 0x7f8b0c1045f0 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c108f20 0x7f8b0c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c108f20 0x7f8b0c19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35186/0 (socket says 172.21.15.120:35186) 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.394+0000 7f8b0aa00700 1 -- 172.21.15.120:0/382936568 learned_addr learned my addr 172.21.15.120:0/382936568 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0b400700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b0c1045f0 0x7f8b0c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0be00700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b0c109870 0x7f8b0c19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0aa00700 1 -- 172.21.15.120:0/382936568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b0c1045f0 msgr2=0x7f8b0c19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b0c1045f0 0x7f8b0c19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0aa00700 1 -- 172.21.15.120:0/382936568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b0c109870 msgr2=0x7f8b0c19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b0c109870 0x7f8b0c19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0aa00700 1 -- 172.21.15.120:0/382936568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c19fc20 con 0x7f8b0c108f20 2024-05-14T09:24:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.395+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c108f20 0x7f8b0c19b2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8af800d980 tx=0x7f8af800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:31.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.396+0000 7f8b03e00700 1 -- 172.21.15.120:0/382936568 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8017070 con 0x7f8b0c108f20 2024-05-14T09:24:31.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.396+0000 7f8b03e00700 1 -- 172.21.15.120:0/382936568 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8af8009dc0 con 0x7f8b0c108f20 2024-05-14T09:24:31.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.396+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c19ff10 con 0x7f8b0c108f20 2024-05-14T09:24:31.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.396+0000 7f8b03e00700 1 -- 172.21.15.120:0/382936568 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af800f3c0 con 0x7f8b0c108f20 2024-05-14T09:24:31.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.396+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0c1a7830 con 0x7f8b0c108f20 2024-05-14T09:24:31.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.400+0000 7f8b03e00700 1 -- 172.21.15.120:0/382936568 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8af800f560 con 0x7f8b0c108f20 2024-05-14T09:24:31.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.401+0000 7f8b20fe7b80 1 Processor -- start 2024-05-14T09:24:31.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b20fe7b80 1 -- start start 2024-05-14T09:24:31.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b03e00700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8af00b2880 0x7f8af00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b03e00700 1 -- 172.21.15.120:0/382936568 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8af80e20a0 con 0x7f8b0c108f20 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34cfc4e40 0x55e34d1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d142710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d142c50 0x55e34d143060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e34d064a20 con 0x55e34cfc4e40 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e34d002760 con 0x55e34d142c50 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b0be00700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8af00b2880 0x7f8af00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.402+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e34d0609e0 con 0x55e34d148bf0 2024-05-14T09:24:31.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34cfc4e40 0x55e34d1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34cfc4e40 0x55e34d1486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35190/0 (socket says 172.21.15.120:35190) 2024-05-14T09:24:31.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 -- 172.21.15.120:0/2934684317 learned_addr learned my addr 172.21.15.120:0/2934684317 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0be00700 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d142c50 0x55e34d143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 -- 172.21.15.120:0/2934684317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 msgr2=0x55e34d142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 -- 172.21.15.120:0/2934684317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d142c50 msgr2=0x55e34d143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d142c50 0x55e34d143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.403+0000 7f8b0b400700 1 -- 172.21.15.120:0/2934684317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34cfb18d0 con 0x55e34cfc4e40 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.404+0000 7f8b0be00700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8af00b2880 0x7f8af00b4d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009fd0 tx=0x7f8b04009230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.404+0000 7f8b0b400700 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34cfc4e40 0x55e34d1486b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00bd70 tx=0x7f8afc0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589dffa6777f7b20 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.404+0000 7f8b00c00700 1 -- 172.21.15.120:0/2934684317 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc010d90 con 0x55e34cfc4e40 2024-05-14T09:24:31.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.404+0000 7f8b00c00700 1 -- 172.21.15.120:0/2934684317 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8afc01c910 con 0x55e34cfc4e40 2024-05-14T09:24:31.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.404+0000 7f8b00c00700 1 -- 172.21.15.120:0/2934684317 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc011770 con 0x55e34cfc4e40 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.405+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/2934684317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34cfc4e40 msgr2=0x55e34d1486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.405+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34cfc4e40 0x55e34d1486b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00bd70 tx=0x7f8afc0106b0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.405+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/2934684317 shutdown_connections 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.405+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d142c50 0x55e34d143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.405+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34cfc4e40 0x55e34d1486b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.405+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/2934684317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.405+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/2934684317 >> 172.21.15.120:0/2934684317 conn(0x55e34d003a80 msgr2=0x55e34d13d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.406+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/2934684317 shutdown_connections 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.406+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/2934684317 wait complete. 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.406+0000 7f8b20fe7b80 1 -- start start 2024-05-14T09:24:31.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.406+0000 7f8b20fe7b80 1 Processor -- start 2024-05-14T09:24:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34cfc4e40 0x55e34d14c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e34d153ad0 con 0x55e34d142c50 2024-05-14T09:24:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e34cfcab20 con 0x55e34cfc4e40 2024-05-14T09:24:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e34d153c50 con 0x55e34d148bf0 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b20fe7b80 10 client.0 _ll_register_callbacks cb 0x55e34cff8380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.407+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35200/0 (socket says 172.21.15.120:35200) 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0aa00700 1 -- 172.21.15.120:0/710629293 learned_addr learned my addr 172.21.15.120:0/710629293 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0b400700 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34cfc4e40 0x55e34d14c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0be00700 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0aa00700 1 -- 172.21.15.120:0/710629293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 msgr2=0x55e34d14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d14ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0aa00700 1 -- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34cfc4e40 msgr2=0x55e34d14c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34cfc4e40 0x55e34d14c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.408+0000 7f8b0aa00700 1 -- 172.21.15.120:0/710629293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34d02a420 con 0x55e34d142c50 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14c910 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8af80df800 tx=0x7f8af80108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54b2a1dbe4b025c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8af5600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:31.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8af5600700 1 -- 172.21.15.120:0/710629293 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8020040 con 0x55e34d142c50 2024-05-14T09:24:31.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8af5600700 1 -- 172.21.15.120:0/710629293 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8af80a5910 con 0x55e34d142c50 2024-05-14T09:24:31.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8afc01c910 con 0x55e34d142c50 2024-05-14T09:24:31.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8af5600700 1 -- 172.21.15.120:0/710629293 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8af80ad6d0 con 0x55e34d142c50 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8b20fe7b80 10 client.15534 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.409+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e34d15e6f0 con 0x55e34d142c50 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8af5600700 1 -- 172.21.15.120:0/710629293 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8afc01c910 con 0x55e34d142c50 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8af5600700 1 -- 172.21.15.120:0/710629293 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f8af80a4c90 con 0x55e34d142c50 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8b20fe7b80 10 client.15534 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8b20fe7b80 10 client.15534 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8b20fe7b80 20 client.15534 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d160c20 0x55e34d163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8b20fe7b80 4 client.15534 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.410+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e34d10f070 con 0x55e34d160c20 2024-05-14T09:24:31.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.411+0000 7f8b0b400700 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d160c20 0x55e34d163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.412+0000 7f8af5600700 10 client.15534 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:24:31.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.412+0000 7f8b0b400700 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d160c20 0x55e34d163060 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=467f876e232bbeb5 server_cookie=6e43ba4307e5d9b7 in_seq=0 out_seq=0 2024-05-14T09:24:31.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.414+0000 7f8af5600700 1 -- 172.21.15.120:0/710629293 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e34d10f070 con 0x55e34d160c20 2024-05-14T09:24:31.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.414+0000 7f8af5600700 10 client.15534 handle_command_reply: tid=0 2024-05-14T09:24:31.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 client.15534 shutdown 2024-05-14T09:24:31.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 msgr2=0x55e34d14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14c910 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8af80df800 tx=0x7f8af80108b0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 shutdown_connections 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34cfc4e40 0x55e34d14c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d160c20 0x55e34d163060 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34d148bf0 0x55e34d14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/710629293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14c910 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8af5600700 0 client.15534 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.415+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 >> 172.21.15.120:0/710629293 conn(0x55e34d003a80 msgr2=0x55e34d141700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.416+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 shutdown_connections 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.416+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/710629293 wait complete. 2024-05-14T09:24:31.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.416+0000 7f8b20fe7b80 20 client.15534 trim_cache size 0 max 16384 2024-05-14T09:24:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 Processor -- start 2024-05-14T09:24:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 -- start start 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d142710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d13d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1ae1f0 con 0x55e34d142c50 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1afe20 con 0x55e34d148bf0 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.433+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1ae8c0 con 0x55e34cfc4e40 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35208/0 (socket says 172.21.15.120:35208) 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 -- 172.21.15.120:0/831683971 learned_addr learned my addr 172.21.15.120:0/831683971 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0b400700 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0be00700 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d13d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 -- 172.21.15.120:0/831683971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 msgr2=0x55e34d142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 -- 172.21.15.120:0/831683971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 msgr2=0x55e34d13d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d13d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0aa00700 1 -- 172.21.15.120:0/831683971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34d148240 con 0x55e34d142c50 2024-05-14T09:24:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0be00700 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d13d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.434+0000 7f8b0b400700 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.435+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14a010 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8af80a9020 tx=0x7f8af80a9b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a171ff12011ca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.435+0000 7f8af7e00700 1 -- 172.21.15.120:0/831683971 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8020070 con 0x55e34d142c50 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.435+0000 7f8af7e00700 1 -- 172.21.15.120:0/831683971 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8af80b1f00 con 0x55e34d142c50 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.435+0000 7f8af7e00700 1 -- 172.21.15.120:0/831683971 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af80a7ff0 con 0x55e34d142c50 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/831683971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 msgr2=0x55e34d14a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14a010 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8af80a9020 tx=0x7f8af80a9b90 comp rx=0 tx=0).stop 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/831683971 shutdown_connections 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d13d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/831683971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d14a010 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/831683971 >> 172.21.15.120:0/831683971 conn(0x55e34d003a80 msgr2=0x55e34d147b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/831683971 shutdown_connections 2024-05-14T09:24:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.436+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/831683971 wait complete. 2024-05-14T09:24:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.437+0000 7f8b20fe7b80 1 -- start start 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.437+0000 7f8b20fe7b80 1 Processor -- start 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.437+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d155e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b20fe7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d1c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1af690 con 0x55e34d142c50 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1aefc0 con 0x55e34d148bf0 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b20fe7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1ac1d0 con 0x55e34cfc4e40 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b20fe7b80 10 client.0 _ll_register_callbacks cb 0x55e34cff8380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d1563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35216/0 (socket says 172.21.15.120:35216) 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 -- 172.21.15.120:0/929966156 learned_addr learned my addr 172.21.15.120:0/929966156 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0be00700 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d1c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0b400700 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 -- 172.21.15.120:0/929966156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 msgr2=0x55e34d155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 -- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 msgr2=0x55e34d1c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d1c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.438+0000 7f8b0aa00700 1 -- 172.21.15.120:0/929966156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34d156bd0 con 0x55e34d142c50 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8b0aa00700 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d1563b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8af80a6590 tx=0x7f8af80108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e622a2883f4509e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8af5600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8af5600700 1 -- 172.21.15.120:0/929966156 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8020070 con 0x55e34d142c50 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8af5600700 1 -- 172.21.15.120:0/929966156 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8af80a5910 con 0x55e34d142c50 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8af80b1f00 con 0x55e34d142c50 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8af5600700 1 -- 172.21.15.120:0/929966156 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8af80b9050 con 0x55e34d142c50 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8b20fe7b80 10 client.15540 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.439+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e34d1ca830 con 0x55e34d142c50 2024-05-14T09:24:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8af5600700 1 -- 172.21.15.120:0/929966156 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8af80b1f00 con 0x55e34d142c50 2024-05-14T09:24:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8af5600700 1 -- 172.21.15.120:0/929966156 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f8af80ad1b0 con 0x55e34d142c50 2024-05-14T09:24:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8b20fe7b80 10 client.15540 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8b20fe7b80 10 client.15540 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:24:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8b20fe7b80 20 client.15540 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d1cad50 0x55e34d1cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8b20fe7b80 4 client.15540 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:24:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.440+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e34d072400 con 0x55e34d1cad50 2024-05-14T09:24:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.441+0000 7f8b0b400700 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d1cad50 0x55e34d1cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.442+0000 7f8b0b400700 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d1cad50 0x55e34d1cd170 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=376ddd093dde7d67 server_cookie=38f1c5842df7ebd in_seq=0 out_seq=0 2024-05-14T09:24:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.442+0000 7f8af5600700 10 client.15540 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:24:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8af5600700 1 -- 172.21.15.120:0/929966156 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e34d072400 con 0x55e34d1cad50 2024-05-14T09:24:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8af5600700 10 client.15540 handle_command_reply: tid=0 2024-05-14T09:24:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 client.15540 shutdown 2024-05-14T09:24:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 msgr2=0x55e34d1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d1563b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8af80a6590 tx=0x7f8af80108b0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 shutdown_connections 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e34d148bf0 0x55e34d1c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55e34d1cad50 0x55e34d1cd170 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e34cfc4e40 0x55e34d155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 --2- 172.21.15.120:0/929966156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e34d142c50 0x55e34d1563b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.443+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 >> 172.21.15.120:0/929966156 conn(0x55e34d003a80 msgr2=0x55e34d147b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.444+0000 7f8af5600700 0 client.15540 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.444+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 shutdown_connections 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.444+0000 7f8b20fe7b80 1 -- 172.21.15.120:0/929966156 wait complete. 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.444+0000 7f8b20fe7b80 20 client.15540 trim_cache size 0 max 16384 2024-05-14T09:24:31.444 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:24:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8af00b2880 msgr2=0x7f8af00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8af00b2880 0x7f8af00b4d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009fd0 tx=0x7f8b04009230 comp rx=0 tx=0).stop 2024-05-14T09:24:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c108f20 msgr2=0x7f8b0c19b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c108f20 0x7f8b0c19b2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8af800d980 tx=0x7f8af800dc90 comp rx=0 tx=0).stop 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 shutdown_connections 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8af00b2880 0x7f8af00b4d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b0c109870 0x7f8b0c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b0c1045f0 0x7f8b0c19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 --2- 172.21.15.120:0/382936568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b0c108f20 0x7f8b0c19b2f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 >> 172.21.15.120:0/382936568 conn(0x7f8b0c100040 msgr2=0x7f8b0c108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 shutdown_connections 2024-05-14T09:24:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:31.445+0000 7f8b12400700 1 -- 172.21.15.120:0/382936568 wait complete. 2024-05-14T09:24:32.142 INFO:teuthology.orchestra.run.smithi120.stderr:dropping old tables... 2024-05-14T09:24:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-05-14T09:24:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-05-14T09:24:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-05-14T09:24:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-05-14T09:24:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:creating tables... 2024-05-14T09:24:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:31 smithi152 ceph-mon[34868]: pgmap v585: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 353 KiB/s wr, 110 op/s 2024-05-14T09:24:32.214 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:31 smithi120 ceph-mon[31085]: pgmap v585: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 353 KiB/s wr, 110 op/s 2024-05-14T09:24:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:31 smithi175 ceph-mon[35353]: pgmap v585: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 353 KiB/s wr, 110 op/s 2024-05-14T09:24:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:generating data (client-side)... 2024-05-14T09:24:32.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T09:24:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:34.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:33 smithi120 ceph-mon[31085]: pgmap v586: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 348 KiB/s wr, 102 op/s 2024-05-14T09:24:34.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:33 smithi175 ceph-mon[35353]: pgmap v586: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 348 KiB/s wr, 102 op/s 2024-05-14T09:24:34.422 INFO:teuthology.orchestra.run.smithi120.stderr:100000 of 3200000 tuples (3%) done (elapsed 1.65 s, remaining 51.08 s) 2024-05-14T09:24:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:33 smithi152 ceph-mon[34868]: pgmap v586: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 348 KiB/s wr, 102 op/s 2024-05-14T09:24:35.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.662+0000 7f98f3200700 1 -- 172.21.15.120:0/2368306833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 msgr2=0x7f98f4104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.662+0000 7f98f3200700 1 --2- 172.21.15.120:0/2368306833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f4104810 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f98e40099c0 tx=0x7f98e4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.662+0000 7f98f3200700 1 -- 172.21.15.120:0/2368306833 shutdown_connections 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.662+0000 7f98f3200700 1 --2- 172.21.15.120:0/2368306833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f4109680 0x7f98f4110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.662+0000 7f98f3200700 1 --2- 172.21.15.120:0/2368306833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f4104810 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.662+0000 7f98f3200700 1 --2- 172.21.15.120:0/2368306833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f4108d30 0x7f98f4109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.662+0000 7f98f3200700 1 -- 172.21.15.120:0/2368306833 >> 172.21.15.120:0/2368306833 conn(0x7f98f4079d10 msgr2=0x7f98f407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.663+0000 7f98f3200700 1 -- 172.21.15.120:0/2368306833 shutdown_connections 2024-05-14T09:24:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.663+0000 7f98f3200700 1 -- 172.21.15.120:0/2368306833 wait complete. 2024-05-14T09:24:35.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.664+0000 7f98f3200700 1 Processor -- start 2024-05-14T09:24:35.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.664+0000 7f98f3200700 1 -- start start 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f3200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f41a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f3200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f4108d30 0x7f98f41a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f3200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f4109680 0x7f98f419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f3200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41141b0 con 0x7f98f4104400 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f3200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98f4114030 con 0x7f98f4109680 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f3200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98f4114330 con 0x7f98f4108d30 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f1e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f41a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.665+0000 7f98f1e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f41a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35226/0 (socket says 172.21.15.120:35226) 2024-05-14T09:24:35.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1e00700 1 -- 172.21.15.120:0/3351837953 learned_addr learned my addr 172.21.15.120:0/3351837953 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:35.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1400700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f4108d30 0x7f98f41a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f2800700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f4109680 0x7f98f419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1e00700 1 -- 172.21.15.120:0/3351837953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f4108d30 msgr2=0x7f98f41a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1e00700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f4108d30 0x7f98f41a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1e00700 1 -- 172.21.15.120:0/3351837953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f4109680 msgr2=0x7f98f419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1e00700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f4109680 0x7f98f419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1e00700 1 -- 172.21.15.120:0/3351837953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f419b0c0 con 0x7f98f4104400 2024-05-14T09:24:35.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1400700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f4108d30 0x7f98f41a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:35.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.666+0000 7f98f1e00700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f41a07f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f98e4000c00 tx=0x7f98e400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:35.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.669+0000 7f98eaa00700 1 -- 172.21.15.120:0/3351837953 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4027070 con 0x7f98f4104400 2024-05-14T09:24:35.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.669+0000 7f98eaa00700 1 -- 172.21.15.120:0/3351837953 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98e400fe50 con 0x7f98f4104400 2024-05-14T09:24:35.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.669+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f419b350 con 0x7f98f4104400 2024-05-14T09:24:35.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.669+0000 7f98eaa00700 1 -- 172.21.15.120:0/3351837953 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40173f0 con 0x7f98f4104400 2024-05-14T09:24:35.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.669+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f419b830 con 0x7f98f4104400 2024-05-14T09:24:35.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.674+0000 7f98eaa00700 1 -- 172.21.15.120:0/3351837953 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f98e402a070 con 0x7f98f4104400 2024-05-14T09:24:35.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.675+0000 7f9907c3db80 1 Processor -- start 2024-05-14T09:24:35.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.675+0000 7f9907c3db80 1 -- start start 2024-05-14T09:24:35.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.675+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bec2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.675+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904bec7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f9907c3db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55904bde0a20 con 0x55904bec79a0 2024-05-14T09:24:35.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f9907c3db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55904bd7e760 con 0x55904bec3310 2024-05-14T09:24:35.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f9907c3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55904bddc9e0 con 0x55904bd40e40 2024-05-14T09:24:35.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f98f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f98f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35242/0 (socket says 172.21.15.120:35242) 2024-05-14T09:24:35.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f98f1400700 1 -- 172.21.15.120:0/3504908729 learned_addr learned my addr 172.21.15.120:0/3504908729 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:35.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f98f2800700 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bec2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f98eaa00700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f98d80b29d0 0x7f98d80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.676+0000 7f98f1e00700 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904bec7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98eaa00700 1 -- 172.21.15.120:0/3351837953 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f98e40e33e0 con 0x7f98f4104400 2024-05-14T09:24:35.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98f2800700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f98d80b29d0 0x7f98d80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98f1400700 1 -- 172.21.15.120:0/3504908729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 msgr2=0x55904bec2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98f1400700 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bec2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98f1400700 1 -- 172.21.15.120:0/3504908729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 msgr2=0x55904bec7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98f1400700 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904bec7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98f1400700 1 -- 172.21.15.120:0/3504908729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904bd2d8d0 con 0x55904bec79a0 2024-05-14T09:24:35.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.677+0000 7f98f1400700 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec7db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f98e000bd00 tx=0x7f98e000f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce426b409c186634 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:35.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.678+0000 7f98df400700 1 -- 172.21.15.120:0/3504908729 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e000fc50 con 0x55904bec79a0 2024-05-14T09:24:35.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.678+0000 7f98f2800700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f98d80b29d0 0x7f98d80b4ee0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55904bec3b90 tx=0x7f98ec004b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:35.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.678+0000 7f98df400700 1 -- 172.21.15.120:0/3504908729 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98e000fdf0 con 0x55904bec79a0 2024-05-14T09:24:35.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.678+0000 7f98df400700 1 -- 172.21.15.120:0/3504908729 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e001b670 con 0x55904bec79a0 2024-05-14T09:24:35.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 -- 172.21.15.120:0/3504908729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 msgr2=0x55904bec7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec7db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f98e000bd00 tx=0x7f98e000f640 comp rx=0 tx=0).stop 2024-05-14T09:24:35.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 -- 172.21.15.120:0/3504908729 shutdown_connections 2024-05-14T09:24:35.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec7db0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bec2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 --2- 172.21.15.120:0/3504908729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904bec7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 -- 172.21.15.120:0/3504908729 >> 172.21.15.120:0/3504908729 conn(0x55904bd85f70 msgr2=0x55904beb9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:35.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 -- 172.21.15.120:0/3504908729 shutdown_connections 2024-05-14T09:24:35.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.679+0000 7f9907c3db80 1 -- 172.21.15.120:0/3504908729 wait complete. 2024-05-14T09:24:35.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.680+0000 7f9907c3db80 1 -- start start 2024-05-14T09:24:35.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.680+0000 7f9907c3db80 1 Processor -- start 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bd40e40 0x55904becc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904beccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bec79a0 0x55904becd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f9907c3db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55904becf950 con 0x55904bec3310 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f9907c3db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55904bd46b20 con 0x55904bd40e40 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f9907c3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55904becfad0 con 0x55904bec79a0 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f9907c3db80 10 client.0 _ll_register_callbacks cb 0x55904bd87c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f98f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904beccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f98f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904beccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35258/0 (socket says 172.21.15.120:35258) 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.681+0000 7f98f1400700 1 -- 172.21.15.120:0/227954469 learned_addr learned my addr 172.21.15.120:0/227954469 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:35.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f2800700 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bec79a0 0x55904becd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f1e00700 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bd40e40 0x55904becc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f1400700 1 -- 172.21.15.120:0/227954469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bec79a0 msgr2=0x55904becd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f1400700 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bec79a0 0x55904becd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f1400700 1 -- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bd40e40 msgr2=0x55904becc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f1400700 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bd40e40 0x55904becc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f1400700 1 -- 172.21.15.120:0/227954469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904bda6420 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98f1400700 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904beccba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f98e0005c50 tx=0x7f98e000bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0790664d17013e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98d3e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98d3e00700 1 -- 172.21.15.120:0/227954469 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e00052b0 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f98d3e00700 1 -- 172.21.15.120:0/227954469 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f98e0005450 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.682+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98e000fdf0 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.683+0000 7f98d3e00700 1 -- 172.21.15.120:0/227954469 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f98e0030050 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.683+0000 7f9907c3db80 10 client.15552 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.683+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55904beda500 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.683+0000 7f98d3e00700 1 -- 172.21.15.120:0/227954469 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98e000fdf0 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.684+0000 7f98d3e00700 1 -- 172.21.15.120:0/227954469 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f98e0004c40 con 0x55904bec3310 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.684+0000 7f9907c3db80 10 client.15552 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.684+0000 7f9907c3db80 10 client.15552 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:24:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.684+0000 7f9907c3db80 20 client.15552 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.684+0000 7f9907c3db80 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bedca80 0x55904bedeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.684+0000 7f9907c3db80 4 client.15552 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.684+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55904be8b1c0 con 0x55904bedca80 2024-05-14T09:24:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.685+0000 7f98f1e00700 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bedca80 0x55904bedeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.686+0000 7f98f1e00700 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bedca80 0x55904bedeea0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab2bcc14e41a79d7 server_cookie=a366830cb0b3fbe9 in_seq=0 out_seq=0 2024-05-14T09:24:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.686+0000 7f98d3e00700 10 client.15552 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:24:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f98d3e00700 1 -- 172.21.15.120:0/227954469 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55904be8b1c0 con 0x55904bedca80 2024-05-14T09:24:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f98d3e00700 10 client.15552 handle_command_reply: tid=0 2024-05-14T09:24:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 client.15552 shutdown 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 msgr2=0x55904beccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904beccba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f98e0005c50 tx=0x7f98e000bfc0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 shutdown_connections 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bedca80 0x55904bedeea0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bd40e40 0x55904becc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bec79a0 0x55904becd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 --2- 172.21.15.120:0/227954469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904beccba0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 >> 172.21.15.120:0/227954469 conn(0x55904bd85f70 msgr2=0x55904bebd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:35.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f98d3e00700 0 client.15552 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:24:35.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.688+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 shutdown_connections 2024-05-14T09:24:35.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.689+0000 7f9907c3db80 1 -- 172.21.15.120:0/227954469 wait complete. 2024-05-14T09:24:35.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.689+0000 7f9907c3db80 20 client.15552 trim_cache size 0 max 16384 2024-05-14T09:24:35.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 Processor -- start 2024-05-14T09:24:35.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 -- start start 2024-05-14T09:24:35.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bed8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904beccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41addc0 con 0x55904bec79a0 2024-05-14T09:24:35.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41af9f0 con 0x55904bec3310 2024-05-14T09:24:35.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.709+0000 7f9907c3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41ae490 con 0x55904bd40e40 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35262/0 (socket says 172.21.15.120:35262) 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 -- 172.21.15.120:0/2516149739 learned_addr learned my addr 172.21.15.120:0/2516149739 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f1400700 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904beccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f1e00700 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bed8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 -- 172.21.15.120:0/2516149739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 msgr2=0x55904bed8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bed8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 -- 172.21.15.120:0/2516149739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 msgr2=0x55904beccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904beccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.710+0000 7f98f2800700 1 -- 172.21.15.120:0/2516149739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904beb5c40 con 0x55904bec79a0 2024-05-14T09:24:35.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.711+0000 7f98f2800700 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec6cb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f98ec01b720 tx=0x7f98ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a85fe26dbfb57c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:35.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.711+0000 7f98dea00700 1 -- 172.21.15.120:0/2516149739 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec012040 con 0x55904bec79a0 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.711+0000 7f98dea00700 1 -- 172.21.15.120:0/2516149739 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98ec004bb0 con 0x55904bec79a0 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.711+0000 7f98dea00700 1 -- 172.21.15.120:0/2516149739 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec005390 con 0x55904bec79a0 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 -- 172.21.15.120:0/2516149739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 msgr2=0x55904bec6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec6cb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f98ec01b720 tx=0x7f98ec0091d0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 -- 172.21.15.120:0/2516149739 shutdown_connections 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec79a0 0x55904bec6cb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bed8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 --2- 172.21.15.120:0/2516149739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec3310 0x55904beccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 -- 172.21.15.120:0/2516149739 >> 172.21.15.120:0/2516149739 conn(0x55904bd85f70 msgr2=0x55904becaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 -- 172.21.15.120:0/2516149739 shutdown_connections 2024-05-14T09:24:35.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.712+0000 7f9907c3db80 1 -- 172.21.15.120:0/2516149739 wait complete. 2024-05-14T09:24:35.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.713+0000 7f9907c3db80 1 -- start start 2024-05-14T09:24:35.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.713+0000 7f9907c3db80 1 Processor -- start 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bee0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904bee0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f9907c3db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec79a0 0x55904bf44fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f9907c3db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41af260 con 0x55904bec3310 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f9907c3db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41aeb90 con 0x55904bec79a0 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f9907c3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41abd80 con 0x55904bd40e40 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f9907c3db80 10 client.0 _ll_register_callbacks cb 0x55904bd87c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f98f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904bee0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f98f1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904bee0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35272/0 (socket says 172.21.15.120:35272) 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f98f1400700 1 -- 172.21.15.120:0/441570908 learned_addr learned my addr 172.21.15.120:0/441570908 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f98f1e00700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bee0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.714+0000 7f98f2800700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec79a0 0x55904bf44fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98f1400700 1 -- 172.21.15.120:0/441570908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 msgr2=0x55904bee0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98f1400700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bee0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98f1400700 1 -- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec79a0 msgr2=0x55904bf44fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98f1400700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec79a0 0x55904bf44fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98f1400700 1 -- 172.21.15.120:0/441570908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904bee16a0 con 0x55904bec3310 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98f2800700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec79a0 0x55904bf44fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98f1400700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904bee0e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001eb0 tx=0x7f98e0012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86daa58d5ded57a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.715+0000 7f98d3e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.716+0000 7f98d3e00700 1 -- 172.21.15.120:0/441570908 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e002d040 con 0x55904bec3310 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.716+0000 7f98d3e00700 1 -- 172.21.15.120:0/441570908 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f98e00052b0 con 0x55904bec3310 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.716+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98ec004bb0 con 0x55904bec3310 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.716+0000 7f98d3e00700 1 -- 172.21.15.120:0/441570908 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f98e0044050 con 0x55904bec3310 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.716+0000 7f9907c3db80 10 client.15558 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.716+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55904bf464c0 con 0x55904bec3310 2024-05-14T09:24:35.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f98d3e00700 1 -- 172.21.15.120:0/441570908 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98ec004bb0 con 0x55904bec3310 2024-05-14T09:24:35.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f98d3e00700 1 -- 172.21.15.120:0/441570908 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f98e0004ba0 con 0x55904bec3310 2024-05-14T09:24:35.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f9907c3db80 10 client.15558 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:35.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f9907c3db80 10 client.15558 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:24:35.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f9907c3db80 20 client.15558 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:35.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f9907c3db80 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bf46bd0 0x55904bf48ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f9907c3db80 4 client.15558 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:24:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.717+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55904bdee400 con 0x55904bf46bd0 2024-05-14T09:24:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.718+0000 7f98f1e00700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bf46bd0 0x55904bf48ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.719+0000 7f98d3e00700 10 client.15558 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:24:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.719+0000 7f98f1e00700 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bf46bd0 0x55904bf48ff0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30157ccbe5132b97 server_cookie=50f5c700abe22149 in_seq=0 out_seq=0 2024-05-14T09:24:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.719+0000 7f98d3e00700 1 -- 172.21.15.120:0/441570908 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55904bdee400 con 0x55904bf46bd0 2024-05-14T09:24:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.719+0000 7f98d3e00700 10 client.15558 handle_command_reply: tid=0 2024-05-14T09:24:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.719+0000 7f9907c3db80 1 client.15558 shutdown 2024-05-14T09:24:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 msgr2=0x55904bee0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904bee0e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001eb0 tx=0x7f98e0012f50 comp rx=0 tx=0).stop 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 shutdown_connections 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55904bf46bd0 0x55904bf48ff0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55904bec79a0 0x55904bf44fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55904bd40e40 0x55904bee0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 --2- 172.21.15.120:0/441570908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55904bec3310 0x55904bee0e80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 >> 172.21.15.120:0/441570908 conn(0x55904bd85f70 msgr2=0x55904bec6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f98d3e00700 0 client.15558 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 shutdown_connections 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 1 -- 172.21.15.120:0/441570908 wait complete. 2024-05-14T09:24:35.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.720+0000 7f9907c3db80 20 client.15558 trim_cache size 0 max 16384 2024-05-14T09:24:35.721 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:24:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f98d80b29d0 msgr2=0x7f98d80b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f98d80b29d0 0x7f98d80b4ee0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55904bec3b90 tx=0x7f98ec004b40 comp rx=0 tx=0).stop 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 msgr2=0x7f98f41a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f41a07f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f98e4000c00 tx=0x7f98e400f510 comp rx=0 tx=0).stop 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 shutdown_connections 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f98d80b29d0 0x7f98d80b4ee0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f4109680 0x7f98f419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98f4104400 0x7f98f41a07f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 --2- 172.21.15.120:0/3351837953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f4108d30 0x7f98f41a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.721+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 >> 172.21.15.120:0/3351837953 conn(0x7f98f4079d10 msgr2=0x7f98f4101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.722+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 shutdown_connections 2024-05-14T09:24:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:35.722+0000 7f98f3200700 1 -- 172.21.15.120:0/3351837953 wait complete. 2024-05-14T09:24:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:35 smithi175 ceph-mon[35353]: pgmap v587: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 174 KiB/s wr, 64 op/s 2024-05-14T09:24:36.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:35 smithi120 ceph-mon[31085]: pgmap v587: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 174 KiB/s wr, 64 op/s 2024-05-14T09:24:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:35 smithi152 ceph-mon[34868]: pgmap v587: 129 pgs: 129 active+clean; 46 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 174 KiB/s wr, 64 op/s 2024-05-14T09:24:36.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T09:24:37.121 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:37.897 INFO:teuthology.orchestra.run.smithi120.stderr:200000 of 3200000 tuples (6%) done (elapsed 5.12 s, remaining 76.83 s) 2024-05-14T09:24:38.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:37 smithi175 ceph-mon[35353]: pgmap v588: 129 pgs: 129 active+clean; 47 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 201 KiB/s wr, 70 op/s 2024-05-14T09:24:38.261 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:37 smithi152 ceph-mon[34868]: pgmap v588: 129 pgs: 129 active+clean; 47 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 201 KiB/s wr, 70 op/s 2024-05-14T09:24:38.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:37 smithi120 ceph-mon[31085]: pgmap v588: 129 pgs: 129 active+clean; 47 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 201 KiB/s wr, 70 op/s 2024-05-14T09:24:40.246 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:39 smithi120 ceph-mon[31085]: pgmap v589: 129 pgs: 129 active+clean; 67 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 3.1 MiB/s wr, 55 op/s 2024-05-14T09:24:40.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:39 smithi152 ceph-mon[34868]: pgmap v589: 129 pgs: 129 active+clean; 67 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 3.1 MiB/s wr, 55 op/s 2024-05-14T09:24:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:39 smithi175 ceph-mon[35353]: pgmap v589: 129 pgs: 129 active+clean; 67 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 3.1 MiB/s wr, 55 op/s 2024-05-14T09:24:40.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.671+0000 7fe30f000700 1 -- 172.21.15.120:0/2913720708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30810af50 msgr2=0x7fe30810b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.671+0000 7fe30f000700 1 --2- 172.21.15.120:0/2913720708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30810af50 0x7fe30810b360 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40099c0 tx=0x7fe2f4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.671+0000 7fe30f000700 1 -- 172.21.15.120:0/2913720708 shutdown_connections 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.671+0000 7fe30f000700 1 --2- 172.21.15.120:0/2913720708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe308106620 0x7fe308106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.671+0000 7fe30f000700 1 --2- 172.21.15.120:0/2913720708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30810b8a0 0x7fe308113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.671+0000 7fe30f000700 1 --2- 172.21.15.120:0/2913720708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30810af50 0x7fe30810b360 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.671+0000 7fe30f000700 1 -- 172.21.15.120:0/2913720708 >> 172.21.15.120:0/2913720708 conn(0x7fe308102030 msgr2=0x7fe308104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.672+0000 7fe30f000700 1 -- 172.21.15.120:0/2913720708 shutdown_connections 2024-05-14T09:24:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.672+0000 7fe30f000700 1 -- 172.21.15.120:0/2913720708 wait complete. 2024-05-14T09:24:40.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.673+0000 7fe30f000700 1 Processor -- start 2024-05-14T09:24:40.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.673+0000 7fe30f000700 1 -- start start 2024-05-14T09:24:40.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30f000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe308106620 0x7fe30819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30f000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30810af50 0x7fe30819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30f000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe30810b8a0 0x7fe3081a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30f000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe308116360 con 0x7fe308106620 2024-05-14T09:24:40.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30f000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081161e0 con 0x7fe30810b8a0 2024-05-14T09:24:40.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30f000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081164e0 con 0x7fe30810af50 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe308106620 0x7fe30819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe308106620 0x7fe30819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48338/0 (socket says 172.21.15.120:48338) 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.674+0000 7fe30dc00700 1 -- 172.21.15.120:0/711569097 learned_addr learned my addr 172.21.15.120:0/711569097 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.675+0000 7fe30d200700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30810af50 0x7fe30819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.675+0000 7fe30dc00700 1 -- 172.21.15.120:0/711569097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30810af50 msgr2=0x7fe30819d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.675+0000 7fe30dc00700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30810af50 0x7fe30819d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.675+0000 7fe30dc00700 1 -- 172.21.15.120:0/711569097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe30810b8a0 msgr2=0x7fe3081a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.675+0000 7fe30dc00700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe30810b8a0 0x7fe3081a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.675+0000 7fe30dc00700 1 -- 172.21.15.120:0/711569097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3081a1c40 con 0x7fe308106620 2024-05-14T09:24:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.675+0000 7fe30dc00700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe308106620 0x7fe30819cd70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00d950 tx=0x7fe2fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.676+0000 7fe306000700 1 -- 172.21.15.120:0/711569097 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc016070 con 0x7fe308106620 2024-05-14T09:24:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.676+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3081a1f30 con 0x7fe308106620 2024-05-14T09:24:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.676+0000 7fe306000700 1 -- 172.21.15.120:0/711569097 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2fc010460 con 0x7fe308106620 2024-05-14T09:24:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.676+0000 7fe306000700 1 -- 172.21.15.120:0/711569097 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00f620 con 0x7fe308106620 2024-05-14T09:24:40.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.676+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3081a9850 con 0x7fe308106620 2024-05-14T09:24:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.680+0000 7fe306000700 1 -- 172.21.15.120:0/711569097 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe2fc019070 con 0x7fe308106620 2024-05-14T09:24:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.682+0000 7fe31f082b80 1 Processor -- start 2024-05-14T09:24:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.682+0000 7fe31f082b80 1 -- start start 2024-05-14T09:24:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524bac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe306000700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2f00b2900 0x7fe2f00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe31f082b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a1523dca20 con 0x55a1524bb190 2024-05-14T09:24:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe31f082b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a15237a760 con 0x55a15233ce40 2024-05-14T09:24:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe31f082b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a1523d89e0 con 0x55a1524bb5a0 2024-05-14T09:24:40.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.683+0000 7fe30dc00700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2f00b2900 0x7fe2f00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30e600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48344/0 (socket says 172.21.15.120:48344) 2024-05-14T09:24:40.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30d200700 1 -- 172.21.15.120:0/1244183626 learned_addr learned my addr 172.21.15.120:0/1244183626 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:40.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30e600700 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe306000700 1 -- 172.21.15.120:0/711569097 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe2fc0e21a0 con 0x7fe308106620 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30e600700 1 -- 172.21.15.120:0/1244183626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 msgr2=0x55a1524cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30e600700 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30e600700 1 -- 172.21.15.120:0/1244183626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 msgr2=0x55a1524cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30e600700 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.684+0000 7fe30e600700 1 -- 172.21.15.120:0/1244183626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1523298d0 con 0x55a15233ce40 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.685+0000 7fe30e600700 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524bac50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe300012b30 tx=0x7fe30000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abcb12d61359b144 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:40.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.685+0000 7fe2faa00700 1 -- 172.21.15.120:0/1244183626 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300004db0 con 0x55a15233ce40 2024-05-14T09:24:40.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.686+0000 7fe2faa00700 1 -- 172.21.15.120:0/1244183626 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe300012e40 con 0x55a15233ce40 2024-05-14T09:24:40.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.686+0000 7fe2faa00700 1 -- 172.21.15.120:0/1244183626 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300014d80 con 0x55a15233ce40 2024-05-14T09:24:40.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe31f082b80 1 -- 172.21.15.120:0/1244183626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 msgr2=0x55a1524bac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524bac50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe300012b30 tx=0x7fe30000b040 comp rx=0 tx=0).stop 2024-05-14T09:24:40.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe30dc00700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2f00b2900 0x7fe2f00b4e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0a53f0 tx=0x7fe2fc0a5380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:40.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe31f082b80 1 -- 172.21.15.120:0/1244183626 shutdown_connections 2024-05-14T09:24:40.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524bac50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1244183626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.687+0000 7fe31f082b80 1 -- 172.21.15.120:0/1244183626 >> 172.21.15.120:0/1244183626 conn(0x55a15237ba80 msgr2=0x55a1524b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:40.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.688+0000 7fe31f082b80 1 -- 172.21.15.120:0/1244183626 shutdown_connections 2024-05-14T09:24:40.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.688+0000 7fe31f082b80 1 -- 172.21.15.120:0/1244183626 wait complete. 2024-05-14T09:24:40.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.689+0000 7fe31f082b80 1 -- start start 2024-05-14T09:24:40.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.689+0000 7fe31f082b80 1 Processor -- start 2024-05-14T09:24:40.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.690+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.690+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb190 0x55a1524cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.690+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb5a0 0x55a1524cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.690+0000 7fe31f082b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a1524cff70 con 0x55a1524bb5a0 2024-05-14T09:24:40.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.690+0000 7fe31f082b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a152342b20 con 0x55a15233ce40 2024-05-14T09:24:40.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.690+0000 7fe31f082b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a1524d00f0 con 0x55a1524bb190 2024-05-14T09:24:40.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.690+0000 7fe31f082b80 10 client.0 _ll_register_callbacks cb 0x55a152370380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:40.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.691+0000 7fe30d200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb190 0x55a1524cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.691+0000 7fe30e600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.691+0000 7fe30e600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:38200/0 (socket says 172.21.15.120:38200) 2024-05-14T09:24:40.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.691+0000 7fe30e600700 1 -- 172.21.15.120:0/2752765181 learned_addr learned my addr 172.21.15.120:0/2752765181 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:40.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.691+0000 7fe30d200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb190 0x55a1524cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37454/0 (socket says 172.21.15.120:37454) 2024-05-14T09:24:40.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.691+0000 7fe30e600700 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb5a0 0x55a1524cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.692+0000 7fe30d200700 1 -- 172.21.15.120:0/2752765181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 msgr2=0x55a1524ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.692+0000 7fe30d200700 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.692+0000 7fe30d200700 1 -- 172.21.15.120:0/2752765181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb5a0 msgr2=0x55a1524cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.692+0000 7fe30d200700 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb5a0 0x55a1524cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.692+0000 7fe30d200700 1 -- 172.21.15.120:0/2752765181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1523a2420 con 0x55a1524bb190 2024-05-14T09:24:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.692+0000 7fe30d200700 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb190 0x55a1524cd0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55a1524b6f90 tx=0x7fe2f40057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48fcf32f8990ebb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.692+0000 7fe2ef400700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:24:40.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.693+0000 7fe2ef400700 1 -- 172.21.15.120:0/2752765181 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4026060 con 0x55a1524bb190 2024-05-14T09:24:40.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.693+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a152487070 con 0x55a1524bb190 2024-05-14T09:24:40.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.693+0000 7fe2ef400700 1 -- 172.21.15.120:0/2752765181 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe2f400b990 con 0x55a1524bb190 2024-05-14T09:24:40.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.693+0000 7fe2ef400700 1 -- 172.21.15.120:0/2752765181 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe2f402d050 con 0x55a1524bb190 2024-05-14T09:24:40.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.693+0000 7fe31f082b80 10 client.25234 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:40.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.693+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a1524dac40 con 0x55a1524bb190 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.694+0000 7fe2ef400700 1 -- 172.21.15.120:0/2752765181 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a152487070 con 0x55a1524bb190 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.694+0000 7fe2ef400700 1 -- 172.21.15.120:0/2752765181 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fe2f400f460 con 0x55a1524bb190 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.695+0000 7fe31f082b80 10 client.25234 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.695+0000 7fe31f082b80 10 client.25234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.695+0000 7fe31f082b80 20 client.25234 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.695+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a1524dd2d0 0x55a1524df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.695+0000 7fe31f082b80 4 client.25234 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.695+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1523ea400 con 0x55a1524dd2d0 2024-05-14T09:24:40.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.695+0000 7fe30e600700 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a1524dd2d0 0x55a1524df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.696+0000 7fe30e600700 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a1524dd2d0 0x55a1524df6f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6654b9426f4c45ef server_cookie=305e15ac2049fca1 in_seq=0 out_seq=0 2024-05-14T09:24:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.696+0000 7fe2ef400700 10 client.25234 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:40.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.698+0000 7fe2ef400700 1 -- 172.21.15.120:0/2752765181 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1523ea400 con 0x55a1524dd2d0 2024-05-14T09:24:40.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.698+0000 7fe2ef400700 10 client.25234 handle_command_reply: tid=0 2024-05-14T09:24:40.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.698+0000 7fe31f082b80 1 client.25234 shutdown 2024-05-14T09:24:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb190 msgr2=0x55a1524cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb190 0x55a1524cd0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55a1524b6f90 tx=0x7fe2f40057c0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 shutdown_connections 2024-05-14T09:24:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a1524dd2d0 0x55a1524df6f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb5a0 0x55a1524cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2752765181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb190 0x55a1524cd0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 >> 172.21.15.120:0/2752765181 conn(0x55a15237ba80 msgr2=0x55a1524b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe2ef400700 0 client.25234 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 shutdown_connections 2024-05-14T09:24:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.699+0000 7fe31f082b80 1 -- 172.21.15.120:0/2752765181 wait complete. 2024-05-14T09:24:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.700+0000 7fe31f082b80 20 client.25234 trim_cache size 0 max 16384 2024-05-14T09:24:40.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 Processor -- start 2024-05-14T09:24:40.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 -- start start 2024-05-14T09:24:40.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a15233ce40 0x55a1524b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1524bb190 0x55a1524c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524d9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081add10 con 0x55a15233ce40 2024-05-14T09:24:40.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081af940 con 0x55a1524bb190 2024-05-14T09:24:40.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.721+0000 7fe31f082b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081ae3e0 con 0x55a1524bb5a0 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a15233ce40 0x55a1524b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a15233ce40 0x55a1524b9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48364/0 (socket says 172.21.15.120:48364) 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 -- 172.21.15.120:0/2111281426 learned_addr learned my addr 172.21.15.120:0/2111281426 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30d200700 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1524bb190 0x55a1524c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 -- 172.21.15.120:0/2111281426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 msgr2=0x55a1524d9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524d9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 -- 172.21.15.120:0/2111281426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1524bb190 msgr2=0x55a1524c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1524bb190 0x55a1524c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.722+0000 7fe30e600700 1 -- 172.21.15.120:0/2111281426 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1524cf130 con 0x55a15233ce40 2024-05-14T09:24:40.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.723+0000 7fe30e600700 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a15233ce40 0x55a1524b9d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe300012310 tx=0x7fe300009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fb834f66e5f794 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:40.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.723+0000 7fe2fa000700 1 -- 172.21.15.120:0/2111281426 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300004bb0 con 0x55a15233ce40 2024-05-14T09:24:40.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.723+0000 7fe2fa000700 1 -- 172.21.15.120:0/2111281426 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe300004d50 con 0x55a15233ce40 2024-05-14T09:24:40.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.723+0000 7fe2fa000700 1 -- 172.21.15.120:0/2111281426 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300014c50 con 0x55a15233ce40 2024-05-14T09:24:40.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.724+0000 7fe31f082b80 1 -- 172.21.15.120:0/2111281426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a15233ce40 msgr2=0x55a1524b9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.724+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a15233ce40 0x55a1524b9d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe300012310 tx=0x7fe300009110 comp rx=0 tx=0).stop 2024-05-14T09:24:40.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 -- 172.21.15.120:0/2111281426 shutdown_connections 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524d9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a15233ce40 0x55a1524b9d70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 --2- 172.21.15.120:0/2111281426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1524bb190 0x55a1524c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 -- 172.21.15.120:0/2111281426 >> 172.21.15.120:0/2111281426 conn(0x55a15237ba80 msgr2=0x55a1524cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 -- 172.21.15.120:0/2111281426 shutdown_connections 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 -- 172.21.15.120:0/2111281426 wait complete. 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.725+0000 7fe31f082b80 1 -- start start 2024-05-14T09:24:40.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.726+0000 7fe31f082b80 1 Processor -- start 2024-05-14T09:24:40.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.727+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524d54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.727+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.727+0000 7fe31f082b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.727+0000 7fe31f082b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081af1b0 con 0x55a1524bb190 2024-05-14T09:24:40.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.727+0000 7fe31f082b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081aeae0 con 0x55a15233ce40 2024-05-14T09:24:40.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.727+0000 7fe30d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.728+0000 7fe30d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524d5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48376/0 (socket says 172.21.15.120:48376) 2024-05-14T09:24:40.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.728+0000 7fe30d200700 1 -- 172.21.15.120:0/1868961972 learned_addr learned my addr 172.21.15.120:0/1868961972 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:40.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.728+0000 7fe30e600700 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524d54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.728+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe30807be90 con 0x55a1524bb5a0 2024-05-14T09:24:40.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.728+0000 7fe30e600700 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.729+0000 7fe31f082b80 10 client.0 _ll_register_callbacks cb 0x55a152370380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:40.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.729+0000 7fe30e600700 1 -- 172.21.15.120:0/1868961972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 msgr2=0x55a1524d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.729+0000 7fe30e600700 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.729+0000 7fe30e600700 1 -- 172.21.15.120:0/1868961972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 msgr2=0x55a1524d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:40.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.729+0000 7fe30e600700 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524d5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.729+0000 7fe30e600700 1 -- 172.21.15.120:0/1868961972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1524d1230 con 0x55a15233ce40 2024-05-14T09:24:40.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.730+0000 7fe30e600700 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524d54d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55a1524dfcd0 tx=0x7fe300012770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73163445a12c6ae2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.730+0000 7fe2ef400700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.730+0000 7fe2ef400700 1 -- 172.21.15.120:0/1868961972 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300003cd0 con 0x55a15233ce40 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.730+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe300004d50 con 0x55a15233ce40 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.731+0000 7fe2ef400700 1 -- 172.21.15.120:0/1868961972 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe300014770 con 0x55a15233ce40 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.731+0000 7fe2ef400700 1 -- 172.21.15.120:0/1868961972 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe300045050 con 0x55a15233ce40 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.731+0000 7fe31f082b80 10 client.35165 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.731+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a152547520 con 0x55a15233ce40 2024-05-14T09:24:40.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.731+0000 7fe2ef400700 1 -- 172.21.15.120:0/1868961972 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe300004d50 con 0x55a15233ce40 2024-05-14T09:24:40.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.732+0000 7fe2ef400700 1 -- 172.21.15.120:0/1868961972 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fe300007aa0 con 0x55a15233ce40 2024-05-14T09:24:40.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.732+0000 7fe31f082b80 10 client.35165 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:40.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.732+0000 7fe31f082b80 10 client.35165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:40.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.732+0000 7fe31f082b80 20 client.35165 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:40.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.732+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a152547940 0x55a152549d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:40.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.732+0000 7fe31f082b80 4 client.35165 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:24:40.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.732+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1523e44a0 con 0x55a152547940 2024-05-14T09:24:40.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.733+0000 7fe30d200700 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a152547940 0x55a152549d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:40.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.734+0000 7fe2ef400700 10 client.35165 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:40.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.734+0000 7fe30d200700 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a152547940 0x55a152549d60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e638437156ca0ff2 server_cookie=798793b701c91ccd in_seq=0 out_seq=0 2024-05-14T09:24:40.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe2ef400700 1 -- 172.21.15.120:0/1868961972 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1523e44a0 con 0x55a152547940 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe2ef400700 10 client.35165 handle_command_reply: tid=0 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 client.35165 shutdown 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 msgr2=0x55a1524d54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524d54d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55a1524dfcd0 tx=0x7fe300012770 comp rx=0 tx=0).stop 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 shutdown_connections 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a152547940 0x55a152549d60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a15233ce40 0x55a1524d54d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1524bb5a0 0x55a1524d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe2ef400700 0 client.35165 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 --2- 172.21.15.120:0/1868961972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a1524bb190 0x55a1524d5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.735+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 >> 172.21.15.120:0/1868961972 conn(0x55a15237ba80 msgr2=0x55a1524b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.736+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 shutdown_connections 2024-05-14T09:24:40.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.736+0000 7fe31f082b80 1 -- 172.21.15.120:0/1868961972 wait complete. 2024-05-14T09:24:40.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.736+0000 7fe31f082b80 20 client.35165 trim_cache size 0 max 16384 2024-05-14T09:24:40.737 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2f00b2900 msgr2=0x7fe2f00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2f00b2900 0x7fe2f00b4e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0a53f0 tx=0x7fe2fc0a5380 comp rx=0 tx=0).stop 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe308106620 msgr2=0x7fe30819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe308106620 0x7fe30819cd70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00d950 tx=0x7fe2fc00dd10 comp rx=0 tx=0).stop 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 shutdown_connections 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2f00b2900 0x7fe2f00b4e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe30810b8a0 0x7fe3081a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe308106620 0x7fe30819cd70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 --2- 172.21.15.120:0/711569097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30810af50 0x7fe30819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 >> 172.21.15.120:0/711569097 conn(0x7fe308102030 msgr2=0x7fe30810a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 shutdown_connections 2024-05-14T09:24:40.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:40.737+0000 7fe30f000700 1 -- 172.21.15.120:0/711569097 wait complete. 2024-05-14T09:24:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 -- 172.21.15.120:0/832748635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da81029b0 msgr2=0x7f6da81036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 --2- 172.21.15.120:0/832748635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da81029b0 0x7f6da81036b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009900 tx=0x7f6d9802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 -- 172.21.15.120:0/832748635 shutdown_connections 2024-05-14T09:24:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 --2- 172.21.15.120:0/832748635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da81088f0 0x7f6da810ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 --2- 172.21.15.120:0/832748635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da8103bf0 0x7f6da8104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 --2- 172.21.15.120:0/832748635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da81029b0 0x7f6da81036b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 -- 172.21.15.120:0/832748635 >> 172.21.15.120:0/832748635 conn(0x7f6da80fdbc0 msgr2=0x7f6da8100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 -- 172.21.15.120:0/832748635 shutdown_connections 2024-05-14T09:24:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.260+0000 7f6daca00640 1 -- 172.21.15.120:0/832748635 wait complete. 2024-05-14T09:24:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.261+0000 7f6daca00640 1 Processor -- start 2024-05-14T09:24:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6daca00640 1 -- start start 2024-05-14T09:24:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6daca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da81029b0 0x7f6da819c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6daca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da8103bf0 0x7f6da819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6daca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da81088f0 0x7f6da81a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6daca00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810f4f0 con 0x7f6da8103bf0 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6daca00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810f370 con 0x7f6da81029b0 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6daca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810f670 con 0x7f6da81088f0 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6da5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da8103bf0 0x7f6da819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6da5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da8103bf0 0x7f6da819c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48388/0 (socket says 172.21.15.120:48388) 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.262+0000 7f6da5e00640 1 -- 172.21.15.120:0/1790528778 learned_addr learned my addr 172.21.15.120:0/1790528778 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da7200640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da81088f0 0x7f6da81a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da6800640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da81029b0 0x7f6da819c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da5e00640 1 -- 172.21.15.120:0/1790528778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da81088f0 msgr2=0x7f6da81a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da81088f0 0x7f6da81a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da5e00640 1 -- 172.21.15.120:0/1790528778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da81029b0 msgr2=0x7f6da819c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da81029b0 0x7f6da819c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da5e00640 1 -- 172.21.15.120:0/1790528778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81a3e10 con 0x7f6da8103bf0 2024-05-14T09:24:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da8103bf0 0x7f6da819c8c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400d950 tx=0x7f6d9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.263+0000 7f6d9f400640 1 -- 172.21.15.120:0/1790528778 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94017070 con 0x7f6da8103bf0 2024-05-14T09:24:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.264+0000 7f6d9f400640 1 -- 172.21.15.120:0/1790528778 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d94009c30 con 0x7f6da8103bf0 2024-05-14T09:24:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.264+0000 7f6d9f400640 1 -- 172.21.15.120:0/1790528778 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9400f620 con 0x7f6da8103bf0 2024-05-14T09:24:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.264+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da81a4100 con 0x7f6da8103bf0 2024-05-14T09:24:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.264+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81a4600 con 0x7f6da8103bf0 2024-05-14T09:24:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.267+0000 7f6db43dd740 1 Processor -- start 2024-05-14T09:24:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.267+0000 7f6db43dd740 1 -- start start 2024-05-14T09:24:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a621b0 0x559e61e04300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a392f0 0x559e61e04880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e0b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6db43dd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e61d68550 con 0x559e61a621b0 2024-05-14T09:24:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6db43dd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559e61d0dbc0 con 0x559e61a414d0 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6db43dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559e61d64510 con 0x559e61a392f0 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6da7200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a621b0 0x559e61e04300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6da7200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a621b0 0x559e61e04300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48390/0 (socket says 172.21.15.120:48390) 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6da7200640 1 -- 172.21.15.120:0/2716892102 learned_addr learned my addr 172.21.15.120:0/2716892102 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.268+0000 7f6da6800640 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a392f0 0x559e61e04880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.269+0000 7f6da7200640 1 -- 172.21.15.120:0/2716892102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a392f0 msgr2=0x559e61e04880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.269+0000 7f6da7200640 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a392f0 0x559e61e04880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.269+0000 7f6da7200640 1 -- 172.21.15.120:0/2716892102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 msgr2=0x559e61e0b780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.269+0000 7f6da7200640 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e0b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.269+0000 7f6da7200640 1 -- 172.21.15.120:0/2716892102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e61a7a210 con 0x559e61a621b0 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.269+0000 7f6d9f400640 1 -- 172.21.15.120:0/1790528778 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6d94005020 con 0x7f6da8103bf0 2024-05-14T09:24:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.269+0000 7f6da7200640 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a621b0 0x559e61e04300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6da0007e50 tx=0x7f6da000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7c4190477ab2c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.270+0000 7f6d93400640 1 -- 172.21.15.120:0/2716892102 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0014070 con 0x559e61a621b0 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.270+0000 7f6d93400640 1 -- 172.21.15.120:0/2716892102 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6da000ee90 con 0x559e61a621b0 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.270+0000 7f6d93400640 1 -- 172.21.15.120:0/2716892102 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0005310 con 0x559e61a621b0 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 -- 172.21.15.120:0/2716892102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a621b0 msgr2=0x559e61e04300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a621b0 0x559e61e04300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6da0007e50 tx=0x7f6da000e720 comp rx=0 tx=0).stop 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 -- 172.21.15.120:0/2716892102 shutdown_connections 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e0b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a392f0 0x559e61e04880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 --2- 172.21.15.120:0/2716892102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a621b0 0x559e61e04300 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 -- 172.21.15.120:0/2716892102 >> 172.21.15.120:0/2716892102 conn(0x559e61a56300 msgr2=0x559e61dffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6d9f400640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d8c0b2860 0x7f6d8c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 -- 172.21.15.120:0/2716892102 shutdown_connections 2024-05-14T09:24:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6db43dd740 1 -- 172.21.15.120:0/2716892102 wait complete. 2024-05-14T09:24:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6d9f400640 1 -- 172.21.15.120:0/1790528778 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6d940e1bf0 con 0x7f6da8103bf0 2024-05-14T09:24:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.271+0000 7f6da7200640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d8c0b2860 0x7f6d8c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.272+0000 7f6db43dd740 1 -- start start 2024-05-14T09:24:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.272+0000 7f6db43dd740 1 Processor -- start 2024-05-14T09:24:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.272+0000 7f6da7200640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d8c0b2860 0x7f6d8c0b4d70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6da0007e20 tx=0x7f6da0000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.272+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a392f0 0x559e61e0de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a414d0 0x559e61e0e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6db43dd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e61e0c1d0 con 0x559e61a414d0 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6db43dd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559e61d21660 con 0x559e61a392f0 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6db43dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559e61e0c350 con 0x559e61a621b0 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6db43dd740 10 client.0 _ll_register_callbacks cb 0x559e61ceb400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a414d0 0x559e61e0e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a414d0 0x559e61e0e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48402/0 (socket says 172.21.15.120:48402) 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 -- 172.21.15.120:0/1646628725 learned_addr learned my addr 172.21.15.120:0/1646628725 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da6800640 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a392f0 0x559e61e0de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 -- 172.21.15.120:0/1646628725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 msgr2=0x559e61e152c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 -- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a392f0 msgr2=0x559e61e0de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a392f0 0x559e61e0de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.273+0000 7f6da5e00640 1 -- 172.21.15.120:0/1646628725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e61b46620 con 0x559e61a414d0 2024-05-14T09:24:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a414d0 0x559e61e0e360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6d940a6080 tx=0x7f6d940a89e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b530973a3d7d7af server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6d87e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6d87e00640 1 -- 172.21.15.120:0/1646628725 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94020050 con 0x559e61a414d0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6d87e00640 1 -- 172.21.15.120:0/1646628725 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6d94005310 con 0x559e61a414d0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da000ee90 con 0x559e61a414d0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6d87e00640 1 -- 172.21.15.120:0/1646628725 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6d940a8e10 con 0x559e61a414d0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6db43dd740 10 client.15588 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.274+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559e61e182c0 con 0x559e61a414d0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6d87e00640 1 -- 172.21.15.120:0/1646628725 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6da000ee90 con 0x559e61a414d0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6d87e00640 1 -- 172.21.15.120:0/1646628725 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f6d940a4980 con 0x559e61a414d0 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6db43dd740 10 client.15588 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6db43dd740 10 client.15588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6db43dd740 20 client.15588 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e61a20d80 0x559e61e1bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6db43dd740 4 client.15588 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.275+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e61d76160 con 0x559e61a20d80 2024-05-14T09:24:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.276+0000 7f6da6800640 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e61a20d80 0x559e61e1bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.277+0000 7f6da6800640 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e61a20d80 0x559e61e1bab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9397cf92d91c9c6e server_cookie=209b6cf9f5b1d15d in_seq=0 out_seq=0 2024-05-14T09:24:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.277+0000 7f6d87e00640 10 client.15588 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6d87e00640 1 -- 172.21.15.120:0/1646628725 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559e61d76160 con 0x559e61a20d80 2024-05-14T09:24:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6d87e00640 10 client.15588 handle_command_reply: tid=0 2024-05-14T09:24:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 client.15588 shutdown 2024-05-14T09:24:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a414d0 msgr2=0x559e61e0e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a414d0 0x559e61e0e360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6d940a6080 tx=0x7f6d940a89e0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 shutdown_connections 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e61a20d80 0x559e61e1bab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a414d0 0x559e61e0e360 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1646628725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a392f0 0x559e61e0de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 >> 172.21.15.120:0/1646628725 conn(0x559e61a56300 msgr2=0x559e61dfec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6d87e00640 0 client.15588 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 shutdown_connections 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.279+0000 7f6db43dd740 1 -- 172.21.15.120:0/1646628725 wait complete. 2024-05-14T09:24:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.280+0000 7f6db43dd740 20 client.15588 trim_cache size 0 max 16384 2024-05-14T09:24:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.298+0000 7f6db43dd740 1 Processor -- start 2024-05-14T09:24:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.298+0000 7f6db43dd740 1 -- start start 2024-05-14T09:24:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e0c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e0cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6db43dd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81aeb70 con 0x559e61a392f0 2024-05-14T09:24:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6db43dd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81b07a0 con 0x559e61a414d0 2024-05-14T09:24:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6db43dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81af240 con 0x559e61a621b0 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6da6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e0c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6da6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e0c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48404/0 (socket says 172.21.15.120:48404) 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.299+0000 7f6da6800640 1 -- 172.21.15.120:0/1526318117 learned_addr learned my addr 172.21.15.120:0/1526318117 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da7200640 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e0cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da6800640 1 -- 172.21.15.120:0/1526318117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 msgr2=0x559e61e0cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da6800640 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e0cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da6800640 1 -- 172.21.15.120:0/1526318117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 msgr2=0x559e61e151e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da6800640 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e151e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da6800640 1 -- 172.21.15.120:0/1526318117 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e61dfb4a0 con 0x559e61a392f0 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da7200640 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e0cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6da6800640 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e0c740 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6d980096c0 tx=0x7f6d98005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbeda68cef05278 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.300+0000 7f6d92a00640 1 -- 172.21.15.120:0/1526318117 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98035040 con 0x559e61a392f0 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.301+0000 7f6d92a00640 1 -- 172.21.15.120:0/1526318117 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d98048070 con 0x559e61a392f0 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.301+0000 7f6d92a00640 1 -- 172.21.15.120:0/1526318117 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98004920 con 0x559e61a392f0 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.301+0000 7f6db43dd740 1 -- 172.21.15.120:0/1526318117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 msgr2=0x559e61e0c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.301+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e0c740 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6d980096c0 tx=0x7f6d98005fd0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 -- 172.21.15.120:0/1526318117 shutdown_connections 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e0cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1526318117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e0c740 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 -- 172.21.15.120:0/1526318117 >> 172.21.15.120:0/1526318117 conn(0x559e61a56300 msgr2=0x559e61e08250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 -- 172.21.15.120:0/1526318117 shutdown_connections 2024-05-14T09:24:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 -- 172.21.15.120:0/1526318117 wait complete. 2024-05-14T09:24:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 -- start start 2024-05-14T09:24:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.302+0000 7f6db43dd740 1 Processor -- start 2024-05-14T09:24:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e12410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e12950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6db43dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e13880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6db43dd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81b0010 con 0x559e61a392f0 2024-05-14T09:24:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6db43dd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81af940 con 0x559e61a414d0 2024-05-14T09:24:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6db43dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81acb70 con 0x559e61a621b0 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6db43dd740 10 client.0 _ll_register_callbacks cb 0x7f6d940a8580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.303+0000 7f6da6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e12410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e12410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48416/0 (socket says 172.21.15.120:48416) 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da6800640 1 -- 172.21.15.120:0/1599944545 learned_addr learned my addr 172.21.15.120:0/1599944545 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da7200640 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e13880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e12950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da6800640 1 -- 172.21.15.120:0/1599944545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 msgr2=0x559e61e13880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da6800640 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e13880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da6800640 1 -- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 msgr2=0x559e61e12950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da6800640 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e12950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.304+0000 7f6da6800640 1 -- 172.21.15.120:0/1599944545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e61e13e40 con 0x559e61a392f0 2024-05-14T09:24:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.305+0000 7f6da6800640 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e12410 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6d980057c0 tx=0x7f6d98043bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3212dd64a0bf2336 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.305+0000 7f6d87e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.305+0000 7f6d87e00640 1 -- 172.21.15.120:0/1599944545 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98050030 con 0x559e61a392f0 2024-05-14T09:24:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.305+0000 7f6d87e00640 1 -- 172.21.15.120:0/1599944545 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6d98005510 con 0x559e61a392f0 2024-05-14T09:24:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.305+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d98048070 con 0x559e61a392f0 2024-05-14T09:24:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6d87e00640 1 -- 172.21.15.120:0/1599944545 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6d98035050 con 0x559e61a392f0 2024-05-14T09:24:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 10 client.15594 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559e61e14fe0 con 0x559e61a392f0 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6d87e00640 1 -- 172.21.15.120:0/1599944545 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d98048070 con 0x559e61a392f0 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6d87e00640 1 -- 172.21.15.120:0/1599944545 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f6d98004c50 con 0x559e61a392f0 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 10 client.15594 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 10 client.15594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 20 client.15594 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e619f61c0 0x559e61e861b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 4 client.15594 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:24:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.306+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e61d6ffd0 con 0x559e619f61c0 2024-05-14T09:24:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.307+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e619f61c0 0x559e61e861b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.309+0000 7f6da5e00640 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e619f61c0 0x559e61e861b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3340811cd2f04bf server_cookie=c0ac8a4a7ca72d83 in_seq=0 out_seq=0 2024-05-14T09:24:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.309+0000 7f6d87e00640 10 client.15594 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.365+0000 7f6d87e00640 1 -- 172.21.15.120:0/1599944545 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e61d6ffd0 con 0x559e619f61c0 2024-05-14T09:24:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.365+0000 7f6d87e00640 10 client.15594 handle_command_reply: tid=0 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.365+0000 7f6db43dd740 1 client.15594 shutdown 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.365+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 msgr2=0x559e61e12410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.365+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e12410 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6d980057c0 tx=0x7f6d98043bd0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.365+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 shutdown_connections 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.365+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559e619f61c0 0x559e61e861b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61a621b0 0x559e61e13880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61a414d0 0x559e61e12950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6db43dd740 1 --2- 172.21.15.120:0/1599944545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61a392f0 0x559e61e12410 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6d87e00640 0 client.15594 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 >> 172.21.15.120:0/1599944545 conn(0x559e61a56300 msgr2=0x559e61e0c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 shutdown_connections 2024-05-14T09:24:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6db43dd740 1 -- 172.21.15.120:0/1599944545 wait complete. 2024-05-14T09:24:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.366+0000 7f6db43dd740 20 client.15594 trim_cache size 0 max 16384 2024-05-14T09:24:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:24:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:24:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:24:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:24:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d8c0b2860 msgr2=0x7f6d8c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d8c0b2860 0x7f6d8c0b4d70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6da0007e20 tx=0x7f6da0000f40 comp rx=0 tx=0).stop 2024-05-14T09:24:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da8103bf0 msgr2=0x7f6da819c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da8103bf0 0x7f6da819c8c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400d950 tx=0x7f6d9400de10 comp rx=0 tx=0).stop 2024-05-14T09:24:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 shutdown_connections 2024-05-14T09:24:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6d8c0b2860 0x7f6d8c0b4d70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da81088f0 0x7f6da81a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da8103bf0 0x7f6da819c8c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 --2- 172.21.15.120:0/1790528778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da81029b0 0x7f6da819c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 >> 172.21.15.120:0/1790528778 conn(0x7f6da80fdbc0 msgr2=0x7f6da80fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 shutdown_connections 2024-05-14T09:24:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:41.367+0000 7f6daca00640 1 -- 172.21.15.120:0/1790528778 wait complete. 2024-05-14T09:24:41.606 INFO:teuthology.orchestra.run.smithi120.stderr:300000 of 3200000 tuples (9%) done (elapsed 8.83 s, remaining 85.37 s) 2024-05-14T09:24:42.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:41 smithi120 ceph-mon[31085]: pgmap v590: 129 pgs: 129 active+clean; 87 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-05-14T09:24:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:41 smithi152 ceph-mon[34868]: pgmap v590: 129 pgs: 129 active+clean; 87 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-05-14T09:24:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:41 smithi175 ceph-mon[35353]: pgmap v590: 129 pgs: 129 active+clean; 87 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-05-14T09:24:42.761 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T09:24:42.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T09:24:43.268 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:43 smithi120 ceph-mon[31085]: pgmap v591: 129 pgs: 129 active+clean; 87 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.2 MiB/s wr, 37 op/s 2024-05-14T09:24:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:43 smithi152 ceph-mon[34868]: pgmap v591: 129 pgs: 129 active+clean; 87 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.2 MiB/s wr, 37 op/s 2024-05-14T09:24:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:43 smithi175 ceph-mon[35353]: pgmap v591: 129 pgs: 129 active+clean; 87 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.2 MiB/s wr, 37 op/s 2024-05-14T09:24:44.522 INFO:teuthology.orchestra.run.smithi120.stderr:400000 of 3200000 tuples (12%) done (elapsed 11.75 s, remaining 82.23 s) 2024-05-14T09:24:45.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.667+0000 7efe8d200700 1 -- 172.21.15.120:0/492451049 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe88106620 msgr2=0x7efe88106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.667+0000 7efe8d200700 1 --2- 172.21.15.120:0/492451049 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe88106620 0x7efe88106a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efe780099c0 tx=0x7efe78009cd0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.668+0000 7efe8d200700 1 -- 172.21.15.120:0/492451049 shutdown_connections 2024-05-14T09:24:45.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.668+0000 7efe8d200700 1 --2- 172.21.15.120:0/492451049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe8810b8a0 0x7efe88113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.668+0000 7efe8d200700 1 --2- 172.21.15.120:0/492451049 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe88106620 0x7efe88106a30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.668+0000 7efe8d200700 1 --2- 172.21.15.120:0/492451049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe8810af50 0x7efe8810b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.668+0000 7efe8d200700 1 -- 172.21.15.120:0/492451049 >> 172.21.15.120:0/492451049 conn(0x7efe88102030 msgr2=0x7efe88104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:45.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.668+0000 7efe8d200700 1 -- 172.21.15.120:0/492451049 shutdown_connections 2024-05-14T09:24:45.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.668+0000 7efe8d200700 1 -- 172.21.15.120:0/492451049 wait complete. 2024-05-14T09:24:45.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.670+0000 7efe8d200700 1 Processor -- start 2024-05-14T09:24:45.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.670+0000 7efe8d200700 1 -- start start 2024-05-14T09:24:45.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.670+0000 7efe8d200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe88106620 0x7efe8819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.670+0000 7efe8d200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe8810af50 0x7efe8819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.670+0000 7efe8d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe8810b8a0 0x7efe881a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe8d200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe881163d0 con 0x7efe8810b8a0 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe8d200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe88116250 con 0x7efe88106620 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe8d200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe88116550 con 0x7efe8810af50 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe87e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe8810b8a0 0x7efe881a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe87e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe8810b8a0 0x7efe881a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48444/0 (socket says 172.21.15.120:48444) 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe87e00700 1 -- 172.21.15.120:0/3344880780 learned_addr learned my addr 172.21.15.120:0/3344880780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe87400700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe88106620 0x7efe8819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.671+0000 7efe86a00700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe8810af50 0x7efe8819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.672+0000 7efe87e00700 1 -- 172.21.15.120:0/3344880780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe8810af50 msgr2=0x7efe8819d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.672+0000 7efe87e00700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe8810af50 0x7efe8819d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.672+0000 7efe87e00700 1 -- 172.21.15.120:0/3344880780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe88106620 msgr2=0x7efe8819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.672+0000 7efe87e00700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe88106620 0x7efe8819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.672+0000 7efe87e00700 1 -- 172.21.15.120:0/3344880780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe881a1d30 con 0x7efe8810b8a0 2024-05-14T09:24:45.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.672+0000 7efe87e00700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe8810b8a0 0x7efe881a1690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efe80007ee0 tx=0x7efe8000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.672+0000 7efe7fe00700 1 -- 172.21.15.120:0/3344880780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80004bb0 con 0x7efe8810b8a0 2024-05-14T09:24:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.673+0000 7efe7fe00700 1 -- 172.21.15.120:0/3344880780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe80004d50 con 0x7efe8810b8a0 2024-05-14T09:24:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.673+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe881a2020 con 0x7efe8810b8a0 2024-05-14T09:24:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.673+0000 7efe7fe00700 1 -- 172.21.15.120:0/3344880780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800058b0 con 0x7efe8810b8a0 2024-05-14T09:24:45.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.674+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe881a9940 con 0x7efe8810b8a0 2024-05-14T09:24:45.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.677+0000 7efe7fe00700 1 -- 172.21.15.120:0/3344880780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7efe8001a020 con 0x7efe8810b8a0 2024-05-14T09:24:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.679+0000 7efe7fe00700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efe6c0b2900 0x7efe6c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.680+0000 7efe7fe00700 1 -- 172.21.15.120:0/3344880780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efe800e5060 con 0x7efe8810b8a0 2024-05-14T09:24:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.680+0000 7efe87400700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efe6c0b2900 0x7efe6c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.681+0000 7efe9d267b80 1 Processor -- start 2024-05-14T09:24:45.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.681+0000 7efe87400700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efe6c0b2900 0x7efe6c0b4e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe78000c00 tx=0x7efe78005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:45.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.681+0000 7efe9d267b80 1 -- start start 2024-05-14T09:24:45.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.681+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.681+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa06eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe9d267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564f6f91caa0 con 0x564f6f87cec0 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe9d267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564f6f8ba7e0 con 0x564f6f9fb300 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe9d267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f6f918a60 con 0x564f6f9fb710 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe87400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe87400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9fadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48460/0 (socket says 172.21.15.120:48460) 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe87400700 1 -- 172.21.15.120:0/2966798050 learned_addr learned my addr 172.21.15.120:0/2966798050 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe86a00700 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.682+0000 7efe87e00700 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa06eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.683+0000 7efe87400700 1 -- 172.21.15.120:0/2966798050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 msgr2=0x564f6fa06eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.683+0000 7efe87400700 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa06eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.683+0000 7efe87400700 1 -- 172.21.15.120:0/2966798050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 msgr2=0x564f6fa04960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.683+0000 7efe87400700 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.683+0000 7efe87400700 1 -- 172.21.15.120:0/2966798050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6f869950 con 0x564f6f87cec0 2024-05-14T09:24:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.683+0000 7efe87400700 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9fadc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efe780099c0 tx=0x7efe7801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58828a0862896e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:45.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.684+0000 7efe7cc00700 1 -- 172.21.15.120:0/2966798050 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7800bb70 con 0x564f6f87cec0 2024-05-14T09:24:45.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.684+0000 7efe7cc00700 1 -- 172.21.15.120:0/2966798050 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe7800bd10 con 0x564f6f87cec0 2024-05-14T09:24:45.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.684+0000 7efe7cc00700 1 -- 172.21.15.120:0/2966798050 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7800f840 con 0x564f6f87cec0 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 -- 172.21.15.120:0/2966798050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 msgr2=0x564f6f9fadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9fadc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efe780099c0 tx=0x7efe7801e000 comp rx=0 tx=0).stop 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 -- 172.21.15.120:0/2966798050 shutdown_connections 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa06eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9fadc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2966798050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 -- 172.21.15.120:0/2966798050 >> 172.21.15.120:0/2966798050 conn(0x564f6f8bbb00 msgr2=0x564f6f9f5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 -- 172.21.15.120:0/2966798050 shutdown_connections 2024-05-14T09:24:45.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.686+0000 7efe9d267b80 1 -- 172.21.15.120:0/2966798050 wait complete. 2024-05-14T09:24:45.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.687+0000 7efe9d267b80 1 -- start start 2024-05-14T09:24:45.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.687+0000 7efe9d267b80 1 Processor -- start 2024-05-14T09:24:45.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.688+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f87cec0 0x564f6fa04340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.688+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.688+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb710 0x564f6fa04dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.688+0000 7efe9d267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564f6fa07760 con 0x564f6f9fb710 2024-05-14T09:24:45.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.688+0000 7efe9d267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564f6f882ba0 con 0x564f6f9fb300 2024-05-14T09:24:45.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.688+0000 7efe9d267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f6fa078e0 con 0x564f6f87cec0 2024-05-14T09:24:45.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.688+0000 7efe9d267b80 10 client.0 _ll_register_callbacks cb 0x564f6f8b0400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:45.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb710 0x564f6fa04dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb710 0x564f6fa04dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48468/0 (socket says 172.21.15.120:48468) 2024-05-14T09:24:45.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 -- 172.21.15.120:0/2461419469 learned_addr learned my addr 172.21.15.120:0/2461419469 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:45.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe86a00700 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87400700 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f87cec0 0x564f6fa04340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 -- 172.21.15.120:0/2461419469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f87cec0 msgr2=0x564f6fa04340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f87cec0 0x564f6fa04340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 -- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 msgr2=0x564f6fa04880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.689+0000 7efe87e00700 1 -- 172.21.15.120:0/2461419469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6f8e24a0 con 0x564f6f9fb710 2024-05-14T09:24:45.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe87e00700 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb710 0x564f6fa04dc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efe80004b80 tx=0x7efe800a45d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741939eff7f24eb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe71600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe71600700 1 -- 172.21.15.120:0/2461419469 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80005110 con 0x564f6f9fb710 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe71600700 1 -- 172.21.15.120:0/2461419469 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efe800a8860 con 0x564f6f9fb710 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe7800bd10 con 0x564f6f9fb710 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe71600700 1 -- 172.21.15.120:0/2461419469 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efe800a8d00 con 0x564f6f9fb710 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe9d267b80 10 client.15606 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.690+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564f6fa12370 con 0x564f6f9fb710 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe71600700 1 -- 172.21.15.120:0/2461419469 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe7800bd10 con 0x564f6f9fb710 2024-05-14T09:24:45.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe71600700 1 -- 172.21.15.120:0/2461419469 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7efe800b0fd0 con 0x564f6f9fb710 2024-05-14T09:24:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe9d267b80 10 client.15606 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe9d267b80 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe9d267b80 20 client.15606 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa149b0 0x564f6fa16df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe9d267b80 4 client.15606 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.691+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f6f9c70f0 con 0x564f6fa149b0 2024-05-14T09:24:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.692+0000 7efe87400700 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa149b0 0x564f6fa16df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.693+0000 7efe87400700 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa149b0 0x564f6fa16df0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664201e1560eae1 server_cookie=8f3d338b391365a6 in_seq=0 out_seq=0 2024-05-14T09:24:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.693+0000 7efe71600700 10 client.15606 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:45.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe71600700 1 -- 172.21.15.120:0/2461419469 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f6f9c70f0 con 0x564f6fa149b0 2024-05-14T09:24:45.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe71600700 10 client.15606 handle_command_reply: tid=0 2024-05-14T09:24:45.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 client.15606 shutdown 2024-05-14T09:24:45.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb710 msgr2=0x564f6fa04dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb710 0x564f6fa04dc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efe80004b80 tx=0x7efe800a45d0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 shutdown_connections 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa149b0 0x564f6fa16df0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb710 0x564f6fa04dc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f87cec0 0x564f6fa04340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 --2- 172.21.15.120:0/2461419469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb300 0x564f6fa04880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.696+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 >> 172.21.15.120:0/2461419469 conn(0x564f6f8bbb00 msgr2=0x564f6f9f9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:45.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.697+0000 7efe71600700 0 client.15606 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.697+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 shutdown_connections 2024-05-14T09:24:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.697+0000 7efe9d267b80 1 -- 172.21.15.120:0/2461419469 wait complete. 2024-05-14T09:24:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.697+0000 7efe9d267b80 20 client.15606 trim_cache size 0 max 16384 2024-05-14T09:24:45.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.726+0000 7efe9d267b80 1 Processor -- start 2024-05-14T09:24:45.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.726+0000 7efe9d267b80 1 -- start start 2024-05-14T09:24:45.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb300 0x564f6fa04c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb710 0x564f6f9ff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe9d267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe881b2380 con 0x564f6f87cec0 2024-05-14T09:24:45.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe9d267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe881b3fb0 con 0x564f6f9fb710 2024-05-14T09:24:45.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe9d267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe881b2a50 con 0x564f6f9fb300 2024-05-14T09:24:45.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe87400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe87400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9f9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48482/0 (socket says 172.21.15.120:48482) 2024-05-14T09:24:45.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.727+0000 7efe87400700 1 -- 172.21.15.120:0/1613230286 learned_addr learned my addr 172.21.15.120:0/1613230286 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.728+0000 7efe87e00700 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb710 0x564f6f9ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.728+0000 7efe86a00700 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb300 0x564f6fa04c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.728+0000 7efe87400700 1 -- 172.21.15.120:0/1613230286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb300 msgr2=0x564f6fa04c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.728+0000 7efe87400700 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb300 0x564f6fa04c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.728+0000 7efe87400700 1 -- 172.21.15.120:0/1613230286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb710 msgr2=0x564f6f9ff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.728+0000 7efe87400700 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb710 0x564f6f9ff770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.728+0000 7efe87400700 1 -- 172.21.15.120:0/1613230286 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6f9ef050 con 0x564f6f87cec0 2024-05-14T09:24:45.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.729+0000 7efe87400700 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9f9df0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe780058e0 tx=0x7efe7801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1825f7b0693f22 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:45.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.729+0000 7efe73e00700 1 -- 172.21.15.120:0/1613230286 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78041070 con 0x564f6f87cec0 2024-05-14T09:24:45.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.729+0000 7efe73e00700 1 -- 172.21.15.120:0/1613230286 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe7800f8f0 con 0x564f6f87cec0 2024-05-14T09:24:45.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.729+0000 7efe73e00700 1 -- 172.21.15.120:0/1613230286 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7803c070 con 0x564f6f87cec0 2024-05-14T09:24:45.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.730+0000 7efe9d267b80 1 -- 172.21.15.120:0/1613230286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 msgr2=0x564f6f9f9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.730+0000 7efe9d267b80 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9f9df0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe780058e0 tx=0x7efe7801a040 comp rx=0 tx=0).stop 2024-05-14T09:24:45.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.730+0000 7efe9d267b80 1 -- 172.21.15.120:0/1613230286 shutdown_connections 2024-05-14T09:24:45.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.730+0000 7efe9d267b80 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6f9fb710 0x564f6f9ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.730+0000 7efe9d267b80 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f87cec0 0x564f6f9f9df0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.730+0000 7efe9d267b80 1 --2- 172.21.15.120:0/1613230286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb300 0x564f6fa04c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.730+0000 7efe9d267b80 1 -- 172.21.15.120:0/1613230286 >> 172.21.15.120:0/1613230286 conn(0x564f6f8bbb00 msgr2=0x564f6f9f5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:45.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.731+0000 7efe9d267b80 1 -- 172.21.15.120:0/1613230286 shutdown_connections 2024-05-14T09:24:45.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.731+0000 7efe9d267b80 1 -- 172.21.15.120:0/1613230286 wait complete. 2024-05-14T09:24:45.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.731+0000 7efe9d267b80 1 -- start start 2024-05-14T09:24:45.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 1 Processor -- start 2024-05-14T09:24:45.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb300 0x564f6fa08e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6fa849f0 0x564f6fa86e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe881b3820 con 0x564f6f9fb300 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe881b3150 con 0x564f6fa849f0 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe881b0340 con 0x564f6f9fb710 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.732+0000 7efe9d267b80 10 client.0 _ll_register_callbacks cb 0x564f6f8b0400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb300 0x564f6fa08e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb300 0x564f6fa08e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48496/0 (socket says 172.21.15.120:48496) 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 -- 172.21.15.120:0/3112436305 learned_addr learned my addr 172.21.15.120:0/3112436305 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe86a00700 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87e00700 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6fa849f0 0x564f6fa86e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 -- 172.21.15.120:0/3112436305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 msgr2=0x564f6fa093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 -- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6fa849f0 msgr2=0x564f6fa86e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:45.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6fa849f0 0x564f6fa86e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.733+0000 7efe87400700 1 -- 172.21.15.120:0/3112436305 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6fa87350 con 0x564f6f9fb300 2024-05-14T09:24:45.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.734+0000 7efe87400700 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb300 0x564f6fa08e70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efe78005850 tx=0x7efe7800b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f502dedb4d53bf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:45.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.734+0000 7efe71600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:45.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.735+0000 7efe71600700 1 -- 172.21.15.120:0/3112436305 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78041070 con 0x564f6f9fb300 2024-05-14T09:24:45.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.735+0000 7efe71600700 1 -- 172.21.15.120:0/3112436305 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efe7800f460 con 0x564f6f9fb300 2024-05-14T09:24:45.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.735+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe7800f8f0 con 0x564f6f9fb300 2024-05-14T09:24:45.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.735+0000 7efe71600700 1 -- 172.21.15.120:0/3112436305 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efe7803c040 con 0x564f6f9fb300 2024-05-14T09:24:45.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.735+0000 7efe9d267b80 10 client.15612 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:45.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.736+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564f6fa88520 con 0x564f6f9fb300 2024-05-14T09:24:45.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.736+0000 7efe71600700 1 -- 172.21.15.120:0/3112436305 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe7800f8f0 con 0x564f6f9fb300 2024-05-14T09:24:45.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.736+0000 7efe71600700 1 -- 172.21.15.120:0/3112436305 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7efe78022070 con 0x564f6f9fb300 2024-05-14T09:24:45.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.736+0000 7efe9d267b80 10 client.15612 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:45.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.736+0000 7efe9d267b80 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:45.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.736+0000 7efe9d267b80 20 client.15612 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:45.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.737+0000 7efe9d267b80 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa886f0 0x564f6fa8ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:45.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.737+0000 7efe9d267b80 4 client.15612 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T09:24:45.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.737+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f6f92a480 con 0x564f6fa886f0 2024-05-14T09:24:45.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.738+0000 7efe86a00700 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa886f0 0x564f6fa8ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:45.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.741+0000 7efe86a00700 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa886f0 0x564f6fa8ab10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26e4594a97b39a3a server_cookie=9d6362b75a6441 in_seq=0 out_seq=0 2024-05-14T09:24:45.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.741+0000 7efe71600700 10 client.15612 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:45.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe71600700 1 -- 172.21.15.120:0/3112436305 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f6f92a480 con 0x564f6fa886f0 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe71600700 10 client.15612 handle_command_reply: tid=0 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 client.15612 shutdown 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb300 msgr2=0x564f6fa08e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb300 0x564f6fa08e70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efe78005850 tx=0x7efe7800b600 comp rx=0 tx=0).stop 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 shutdown_connections 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f6fa886f0 0x564f6fa8ab10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f6fa849f0 0x564f6fa86e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f6f9fb300 0x564f6fa08e70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe71600700 0 client.15612 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 --2- 172.21.15.120:0/3112436305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f6f9fb710 0x564f6fa093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.745+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 >> 172.21.15.120:0/3112436305 conn(0x564f6f8bbb00 msgr2=0x564f6f9f56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:45.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.746+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 shutdown_connections 2024-05-14T09:24:45.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.746+0000 7efe9d267b80 1 -- 172.21.15.120:0/3112436305 wait complete. 2024-05-14T09:24:45.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.746+0000 7efe9d267b80 20 client.15612 trim_cache size 0 max 16384 2024-05-14T09:24:45.747 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:24:45.747 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-05-14T09:24:45.747 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "ee81895c-0591-4188-98e8-039f0dac3b58", 2024-05-14T09:24:45.747 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-05-14T09:24:45.747 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:24:45.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.747+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efe6c0b2900 msgr2=0x7efe6c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.747+0000 7efe8d200700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efe6c0b2900 0x7efe6c0b4e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe78000c00 tx=0x7efe78005fb0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.747+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe8810b8a0 msgr2=0x7efe881a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:45.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.747+0000 7efe8d200700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe8810b8a0 0x7efe881a1690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efe80007ee0 tx=0x7efe8000d3b0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 shutdown_connections 2024-05-14T09:24:45.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efe6c0b2900 0x7efe6c0b4e10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe88106620 0x7efe8819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe8810b8a0 0x7efe881a1690 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 --2- 172.21.15.120:0/3344880780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe8810af50 0x7efe8819d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:45.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 >> 172.21.15.120:0/3344880780 conn(0x7efe88102030 msgr2=0x7efe8810a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:45.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 shutdown_connections 2024-05-14T09:24:45.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:45.748+0000 7efe8d200700 1 -- 172.21.15.120:0/3344880780 wait complete. 2024-05-14T09:24:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:46 smithi152 ceph-mon[34868]: pgmap v592: 129 pgs: 129 active+clean; 107 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.2 MiB/s wr, 33 op/s 2024-05-14T09:24:46.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:46 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:46.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:24:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:24:45.773+0000 7f6fc8a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical/ auth{2=1} v696 ap=2 f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2) n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3) (inest sync->mix g=2) caps={15282=pAsLsXsFs/-@52} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e4f20db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v105>,<0x10000000003/postgres v27>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v43>,<0x10000000001/sv_0 v60>,<0x10000000000/qa v46>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v696>,<0x10000000005/data v337>,<0x10000000003/postgres v129>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v145>,<0x10000000001/sv_0 v159>,<0x10000000000/qa v145>,<0x1/volumes v146>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T09:24:11.529232+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","memory_value.dirstat":"f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T09:24:46.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:46 smithi120 ceph-mon[31085]: pgmap v592: 129 pgs: 129 active+clean; 107 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.2 MiB/s wr, 33 op/s 2024-05-14T09:24:46.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:46 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:46 smithi175 ceph-mon[35353]: pgmap v592: 129 pgs: 129 active+clean; 107 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.2 MiB/s wr, 33 op/s 2024-05-14T09:24:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:46 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:46.681 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:24:47.173 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:24:47.328 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub queued for path: / 2024-05-14T09:24:47.328 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.328 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.328 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.328 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.328 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.329 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.330 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.330 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.330 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:47 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub queued for path: / 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:47 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub queued for path: / 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:47 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:24:47.938 INFO:teuthology.orchestra.run.smithi120.stderr:500000 of 3200000 tuples (15%) done (elapsed 15.16 s, remaining 81.88 s) 2024-05-14T09:24:48.016 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:48 smithi120 ceph-mon[31085]: pgmap v593: 129 pgs: 129 active+clean; 127 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 36 op/s 2024-05-14T09:24:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:48 smithi152 ceph-mon[34868]: pgmap v593: 129 pgs: 129 active+clean; 127 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 36 op/s 2024-05-14T09:24:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:48 smithi175 ceph-mon[35353]: pgmap v593: 129 pgs: 129 active+clean; 127 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 36 op/s 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 -- 172.21.15.120:0/3770036937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 msgr2=0x7f7150110770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 --2- 172.21.15.120:0/3770036937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f7150110770 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f713c009990 tx=0x7f713c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 -- 172.21.15.120:0/3770036937 shutdown_connections 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 --2- 172.21.15.120:0/3770036937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7150110cb0 0x7f71501130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 --2- 172.21.15.120:0/3770036937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7150103100 0x7f7150103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 --2- 172.21.15.120:0/3770036937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f7150110770 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 -- 172.21.15.120:0/3770036937 >> 172.21.15.120:0/3770036937 conn(0x7f71500fedc0 msgr2=0x7f71501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:49.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.510+0000 7f7155c00700 1 -- 172.21.15.120:0/3770036937 shutdown_connections 2024-05-14T09:24:49.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.511+0000 7f7155c00700 1 -- 172.21.15.120:0/3770036937 wait complete. 2024-05-14T09:24:49.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.512+0000 7f7155c00700 1 Processor -- start 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.512+0000 7f7155c00700 1 -- start start 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f7155c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7150103100 0x7f715019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f7155c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f715019d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f7155c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7150110cb0 0x7f71501a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f7155c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7150116560 con 0x7f7150103a50 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f7155c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71501163e0 con 0x7f7150103100 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f7155c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71501166e0 con 0x7f7150110cb0 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f714e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f715019d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f714e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f715019d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57470/0 (socket says 172.21.15.120:57470) 2024-05-14T09:24:49.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f714e000700 1 -- 172.21.15.120:0/4028287838 learned_addr learned my addr 172.21.15.120:0/4028287838 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.513+0000 7f714ea00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7150103100 0x7f715019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714f400700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7150110cb0 0x7f71501a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714e000700 1 -- 172.21.15.120:0/4028287838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7150110cb0 msgr2=0x7f71501a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714e000700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7150110cb0 0x7f71501a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714e000700 1 -- 172.21.15.120:0/4028287838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7150103100 msgr2=0x7f715019cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714e000700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7150103100 0x7f715019cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714e000700 1 -- 172.21.15.120:0/4028287838 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71501a1ea0 con 0x7f7150103a50 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714ea00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7150103100 0x7f715019cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.514+0000 7f714e000700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f715019d570 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f713c000c00 tx=0x7f713c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.515+0000 7f7147400700 1 -- 172.21.15.120:0/4028287838 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c027070 con 0x7f7150103a50 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.515+0000 7f7147400700 1 -- 172.21.15.120:0/4028287838 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f713c00fb80 con 0x7f7150103a50 2024-05-14T09:24:49.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.515+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71501a2130 con 0x7f7150103a50 2024-05-14T09:24:49.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.515+0000 7f7147400700 1 -- 172.21.15.120:0/4028287838 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c022c00 con 0x7f7150103a50 2024-05-14T09:24:49.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.515+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71501a9ab0 con 0x7f7150103a50 2024-05-14T09:24:49.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.519+0000 7f7147400700 1 -- 172.21.15.120:0/4028287838 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f713c02a070 con 0x7f7150103a50 2024-05-14T09:24:49.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.520+0000 7f7164666b80 1 Processor -- start 2024-05-14T09:24:49.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.520+0000 7f7164666b80 1 -- start start 2024-05-14T09:24:49.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7147400700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71340b2900 0x7f71340b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7164666b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bc00e40 0x556a2bd846b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7164666b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7164666b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd7f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7164666b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556a2bca0a20 con 0x556a2bc00e40 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7164666b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556a2bc3e760 con 0x556a2bd84bf0 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7164666b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556a2bc9c9e0 con 0x556a2bd7ec50 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f7147400700 1 -- 172.21.15.120:0/4028287838 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f713c0e3610 con 0x7f7150103a50 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f714f400700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71340b2900 0x7f71340b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.521+0000 7f714ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bc00e40 0x556a2bd846b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bc00e40 0x556a2bd846b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57484/0 (socket says 172.21.15.120:57484) 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714e000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714ea00700 1 -- 172.21.15.120:0/2776749882 learned_addr learned my addr 172.21.15.120:0/2776749882 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:49.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714f400700 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd7f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714ea00700 1 -- 172.21.15.120:0/2776749882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 msgr2=0x556a2bd7f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714ea00700 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd7f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714ea00700 1 -- 172.21.15.120:0/2776749882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd84bf0 msgr2=0x556a2bd7e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714ea00700 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714ea00700 1 -- 172.21.15.120:0/2776749882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a2bbed8d0 con 0x556a2bc00e40 2024-05-14T09:24:49.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.522+0000 7f714f400700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71340b2900 0x7f71340b4e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7148009f80 tx=0x7f7148007890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:49.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.523+0000 7f714ea00700 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bc00e40 0x556a2bd846b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f714000bd90 tx=0x7f714000f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1098c61779879bf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:49.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.523+0000 7f713be00700 1 -- 172.21.15.120:0/2776749882 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714000fca0 con 0x556a2bc00e40 2024-05-14T09:24:49.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.523+0000 7f713be00700 1 -- 172.21.15.120:0/2776749882 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f714000fe40 con 0x556a2bc00e40 2024-05-14T09:24:49.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.523+0000 7f713be00700 1 -- 172.21.15.120:0/2776749882 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140010630 con 0x556a2bc00e40 2024-05-14T09:24:49.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 -- 172.21.15.120:0/2776749882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bc00e40 msgr2=0x556a2bd846b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bc00e40 0x556a2bd846b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f714000bd90 tx=0x7f714000f640 comp rx=0 tx=0).stop 2024-05-14T09:24:49.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 -- 172.21.15.120:0/2776749882 shutdown_connections 2024-05-14T09:24:49.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd7f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bc00e40 0x556a2bd846b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 --2- 172.21.15.120:0/2776749882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 -- 172.21.15.120:0/2776749882 >> 172.21.15.120:0/2776749882 conn(0x556a2bc3fa80 msgr2=0x556a2bd79790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:49.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.524+0000 7f7164666b80 1 -- 172.21.15.120:0/2776749882 shutdown_connections 2024-05-14T09:24:49.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.525+0000 7f7164666b80 1 -- 172.21.15.120:0/2776749882 wait complete. 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.525+0000 7f7164666b80 1 -- start start 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.525+0000 7f7164666b80 1 Processor -- start 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f7164666b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd88480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f7164666b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd7ec50 0x556a2bd889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f7164666b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd84bf0 0x556a2bd88f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f7164666b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556a2bd8b6c0 con 0x556a2bd7ec50 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f7164666b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556a2bc06b20 con 0x556a2bc00e40 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f7164666b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556a2bd8b840 con 0x556a2bd84bf0 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f7164666b80 10 client.0 _ll_register_callbacks cb 0x556a2bc34380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f714e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd7ec50 0x556a2bd889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f714e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd7ec50 0x556a2bd889c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57490/0 (socket says 172.21.15.120:57490) 2024-05-14T09:24:49.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.526+0000 7f714e000700 1 -- 172.21.15.120:0/4197027536 learned_addr learned my addr 172.21.15.120:0/4197027536 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714ea00700 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd88480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714f400700 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd84bf0 0x556a2bd88f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714e000700 1 -- 172.21.15.120:0/4197027536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd84bf0 msgr2=0x556a2bd88f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714e000700 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd84bf0 0x556a2bd88f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714e000700 1 -- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 msgr2=0x556a2bd88480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714e000700 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd88480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714e000700 1 -- 172.21.15.120:0/4197027536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a2bc66420 con 0x556a2bd7ec50 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f714e000700 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd7ec50 0x556a2bd889c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f713c0a6940 tx=0x7f713c00ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17e186a34f5062 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:49.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.527+0000 7f7138c00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.528+0000 7f7138c00700 1 -- 172.21.15.120:0/4197027536 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c00cc10 con 0x556a2bd7ec50 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.528+0000 7f7138c00700 1 -- 172.21.15.120:0/4197027536 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f713c0afe00 con 0x556a2bd7ec50 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.528+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f714000fe40 con 0x556a2bd7ec50 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.528+0000 7f7138c00700 1 -- 172.21.15.120:0/4197027536 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f713c0aa8c0 con 0x556a2bd7ec50 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.528+0000 7f7164666b80 10 client.15624 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.528+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556a2bd96340 con 0x556a2bd7ec50 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.528+0000 7f7138c00700 1 -- 172.21.15.120:0/4197027536 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f714000fe40 con 0x556a2bd7ec50 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f7138c00700 1 -- 172.21.15.120:0/4197027536 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f713c00c2d0 con 0x556a2bd7ec50 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f7164666b80 10 client.15624 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f7164666b80 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:49.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f7164666b80 20 client.15624 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:49.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f7164666b80 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2bd989e0 0x556a2bd9ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f7164666b80 4 client.15624 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:49.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a2bd4b070 con 0x556a2bd989e0 2024-05-14T09:24:49.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.529+0000 7f714ea00700 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2bd989e0 0x556a2bd9ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.531+0000 7f7138c00700 10 client.15624 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:49.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.531+0000 7f714ea00700 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2bd989e0 0x556a2bd9ae50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e4a6fbbd8b2e7a9 server_cookie=306baf4c99d58694 in_seq=0 out_seq=0 2024-05-14T09:24:49.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.532+0000 7f7138c00700 1 -- 172.21.15.120:0/4197027536 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556a2bd4b070 con 0x556a2bd989e0 2024-05-14T09:24:49.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.532+0000 7f7138c00700 10 client.15624 handle_command_reply: tid=0 2024-05-14T09:24:49.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 client.15624 shutdown 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd7ec50 msgr2=0x556a2bd889c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd7ec50 0x556a2bd889c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f713c0a6940 tx=0x7f713c00ff60 comp rx=0 tx=0).stop 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 shutdown_connections 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2bd989e0 0x556a2bd9ae50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd88480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd84bf0 0x556a2bd88f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 --2- 172.21.15.120:0/4197027536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd7ec50 0x556a2bd889c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 >> 172.21.15.120:0/4197027536 conn(0x556a2bc3fa80 msgr2=0x556a2bd7d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:49.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7138c00700 0 client.15624 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:49.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 shutdown_connections 2024-05-14T09:24:49.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 1 -- 172.21.15.120:0/4197027536 wait complete. 2024-05-14T09:24:49.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.533+0000 7f7164666b80 20 client.15624 trim_cache size 0 max 16384 2024-05-14T09:24:49.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 Processor -- start 2024-05-14T09:24:49.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 -- start start 2024-05-14T09:24:49.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd7e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd873e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd88b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f71501b2400 con 0x556a2bd84bf0 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71501b4030 con 0x556a2bc00e40 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.557+0000 7f7164666b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71501b2ad0 con 0x556a2bd7ec50 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd88b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd88b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57506/0 (socket says 172.21.15.120:57506) 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 -- 172.21.15.120:0/572576238 learned_addr learned my addr 172.21.15.120:0/572576238 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714ea00700 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd7e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714e000700 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 -- 172.21.15.120:0/572576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 msgr2=0x556a2bd873e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd873e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 -- 172.21.15.120:0/572576238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 msgr2=0x556a2bd7e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd7e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714f400700 1 -- 172.21.15.120:0/572576238 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a2bd73e70 con 0x556a2bd84bf0 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714e000700 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.558+0000 7f714ea00700 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd7e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.559+0000 7f714f400700 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd88b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f71480196c0 tx=0x7f714801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46f0430f73f0f6f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:49.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.559+0000 7f713b400700 1 -- 172.21.15.120:0/572576238 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148012040 con 0x556a2bd84bf0 2024-05-14T09:24:49.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.559+0000 7f713b400700 1 -- 172.21.15.120:0/572576238 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7148023ac0 con 0x556a2bd84bf0 2024-05-14T09:24:49.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.559+0000 7f713b400700 1 -- 172.21.15.120:0/572576238 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148018890 con 0x556a2bd84bf0 2024-05-14T09:24:49.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.560+0000 7f7164666b80 1 -- 172.21.15.120:0/572576238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 msgr2=0x556a2bd88b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.560+0000 7f7164666b80 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd88b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f71480196c0 tx=0x7f714801c000 comp rx=0 tx=0).stop 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.560+0000 7f7164666b80 1 -- 172.21.15.120:0/572576238 shutdown_connections 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.560+0000 7f7164666b80 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bc00e40 0x556a2bd7e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.561+0000 7f7164666b80 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd88b50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.561+0000 7f7164666b80 1 --2- 172.21.15.120:0/572576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bd7ec50 0x556a2bd873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.561+0000 7f7164666b80 1 -- 172.21.15.120:0/572576238 >> 172.21.15.120:0/572576238 conn(0x556a2bc3fa80 msgr2=0x556a2bd88440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.561+0000 7f7164666b80 1 -- 172.21.15.120:0/572576238 shutdown_connections 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.561+0000 7f7164666b80 1 -- 172.21.15.120:0/572576238 wait complete. 2024-05-14T09:24:49.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.561+0000 7f7164666b80 1 -- start start 2024-05-14T09:24:49.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 1 Processor -- start 2024-05-14T09:24:49.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bc00e40 0x556a2bd7d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd7ec50 0x556a2bd7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f71501b38a0 con 0x556a2bd84bf0 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71501b31d0 con 0x556a2bd7ec50 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71501b03c0 con 0x556a2bc00e40 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.562+0000 7f7164666b80 10 client.0 _ll_register_callbacks cb 0x556a2bc34380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57514/0 (socket says 172.21.15.120:57514) 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 -- 172.21.15.120:0/3719887436 learned_addr learned my addr 172.21.15.120:0/3719887436 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714e000700 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd7ec50 0x556a2bd7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714ea00700 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bc00e40 0x556a2bd7d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 -- 172.21.15.120:0/3719887436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bc00e40 msgr2=0x556a2bd7d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bc00e40 0x556a2bd7d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 -- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd7ec50 msgr2=0x556a2bd7dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd7ec50 0x556a2bd7dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.563+0000 7f714f400700 1 -- 172.21.15.120:0/3719887436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a2bd88250 con 0x556a2bd84bf0 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.564+0000 7f714f400700 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e240 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7148025040 tx=0x7f7148019520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9327d165e9e7dc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.564+0000 7f7138c00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.564+0000 7f7138c00700 1 -- 172.21.15.120:0/3719887436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148031020 con 0x556a2bd84bf0 2024-05-14T09:24:49.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.564+0000 7f7138c00700 1 -- 172.21.15.120:0/3719887436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7148023840 con 0x556a2bd84bf0 2024-05-14T09:24:49.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.564+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7148023ac0 con 0x556a2bd84bf0 2024-05-14T09:24:49.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.565+0000 7f7138c00700 1 -- 172.21.15.120:0/3719887436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f714803c050 con 0x556a2bd84bf0 2024-05-14T09:24:49.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.565+0000 7f7164666b80 10 client.15630 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:49.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.565+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556a2be031c0 con 0x556a2bd84bf0 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.565+0000 7f7138c00700 1 -- 172.21.15.120:0/3719887436 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7148023ac0 con 0x556a2bd84bf0 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.565+0000 7f7138c00700 1 -- 172.21.15.120:0/3719887436 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f7148018040 con 0x556a2bd84bf0 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.566+0000 7f7164666b80 10 client.15630 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.566+0000 7f7164666b80 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.566+0000 7f7164666b80 20 client.15630 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.566+0000 7f7164666b80 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2be038d0 0x556a2be05cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.566+0000 7f7164666b80 4 client.15630 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.566+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556a2bcae400 con 0x556a2be038d0 2024-05-14T09:24:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.566+0000 7f714ea00700 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2be038d0 0x556a2be05cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:49.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.567+0000 7f714ea00700 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2be038d0 0x556a2be05cf0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e547bb7efbb1ed08 server_cookie=aa0c697e0194b40a in_seq=0 out_seq=0 2024-05-14T09:24:49.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.567+0000 7f7138c00700 10 client.15630 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:49.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7138c00700 1 -- 172.21.15.120:0/3719887436 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556a2bcae400 con 0x556a2be038d0 2024-05-14T09:24:49.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7138c00700 10 client.15630 handle_command_reply: tid=0 2024-05-14T09:24:49.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 client.15630 shutdown 2024-05-14T09:24:49.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 msgr2=0x556a2bd7e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e240 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7148025040 tx=0x7f7148019520 comp rx=0 tx=0).stop 2024-05-14T09:24:49.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 shutdown_connections 2024-05-14T09:24:49.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556a2be038d0 0x556a2be05cf0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a2bd84bf0 0x556a2bd7e240 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a2bc00e40 0x556a2bd7d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 --2- 172.21.15.120:0/3719887436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556a2bd7ec50 0x556a2bd7dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7138c00700 0 client.15630 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:49.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.568+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 >> 172.21.15.120:0/3719887436 conn(0x556a2bc3fa80 msgr2=0x556a2bd820a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:49.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.569+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 shutdown_connections 2024-05-14T09:24:49.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.569+0000 7f7164666b80 1 -- 172.21.15.120:0/3719887436 wait complete. 2024-05-14T09:24:49.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.569+0000 7f7164666b80 20 client.15630 trim_cache size 0 max 16384 2024-05-14T09:24:49.570 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: "ee81895c-0591-4188-98e8-039f0dac3b58": { 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "ee81895c-0591-4188-98e8-039f0dac3b58", 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:24:49.571 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71340b2900 msgr2=0x7f71340b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71340b2900 0x7f71340b4e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7148009f80 tx=0x7f7148007890 comp rx=0 tx=0).stop 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 msgr2=0x7f715019d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f715019d570 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f713c000c00 tx=0x7f713c005ef0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 shutdown_connections 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f71340b2900 0x7f71340b4e10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7150103100 0x7f715019cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7150110cb0 0x7f71501a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 --2- 172.21.15.120:0/4028287838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7150103a50 0x7f715019d570 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 >> 172.21.15.120:0/4028287838 conn(0x7f71500fedc0 msgr2=0x7f7150101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 shutdown_connections 2024-05-14T09:24:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:24:49.570+0000 7f7155c00700 1 -- 172.21.15.120:0/4028287838 wait complete. 2024-05-14T09:24:50.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:50 smithi120 ceph-mon[31085]: pgmap v594: 129 pgs: 129 active+clean; 133 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 14 MiB/s wr, 67 op/s 2024-05-14T09:24:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:50 smithi152 ceph-mon[34868]: pgmap v594: 129 pgs: 129 active+clean; 133 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 14 MiB/s wr, 67 op/s 2024-05-14T09:24:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:50 smithi175 ceph-mon[35353]: pgmap v594: 129 pgs: 129 active+clean; 133 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 14 MiB/s wr, 67 op/s 2024-05-14T09:24:50.536 INFO:tasks.cephfs.filesystem:scrub status for tag:ee81895c-0591-4188-98e8-039f0dac3b58 - {'path': '/', 'tag': 'ee81895c-0591-4188-98e8-039f0dac3b58', 'options': 'recursive,force'} 2024-05-14T09:24:51.588 INFO:teuthology.orchestra.run.smithi120.stderr:600000 of 3200000 tuples (18%) done (elapsed 18.81 s, remaining 81.52 s) 2024-05-14T09:24:52.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:52 smithi120 ceph-mon[31085]: pgmap v595: 129 pgs: 129 active+clean; 157 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 15 MiB/s wr, 94 op/s 2024-05-14T09:24:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:52 smithi152 ceph-mon[34868]: pgmap v595: 129 pgs: 129 active+clean; 157 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 15 MiB/s wr, 94 op/s 2024-05-14T09:24:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:52 smithi175 ceph-mon[35353]: pgmap v595: 129 pgs: 129 active+clean; 157 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 15 MiB/s wr, 94 op/s 2024-05-14T09:24:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:53 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:24:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:53 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:24:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:53 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:24:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:53 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:24:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:53 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:24:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:53 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:24:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:53 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:24:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:53 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:24:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:53 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:24:53.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:53 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:24:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:53 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:24:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:53 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:24:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:53 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:24:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:53 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:24:53.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:53 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:24:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:54 smithi120 ceph-mon[31085]: pgmap v596: 129 pgs: 129 active+clean; 163 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 14 MiB/s wr, 95 op/s 2024-05-14T09:24:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:54 smithi152 ceph-mon[34868]: pgmap v596: 129 pgs: 129 active+clean; 163 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 14 MiB/s wr, 95 op/s 2024-05-14T09:24:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:54 smithi175 ceph-mon[35353]: pgmap v596: 129 pgs: 129 active+clean; 163 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 14 MiB/s wr, 95 op/s 2024-05-14T09:24:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 -- 172.21.15.120:0/2862154907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0104740 msgr2=0x7f68f0106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 --2- 172.21.15.120:0/2862154907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0104740 0x7f68f0106b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009900 tx=0x7f68e002a410 comp rx=0 tx=0).stop 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 -- 172.21.15.120:0/2862154907 shutdown_connections 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 --2- 172.21.15.120:0/2862154907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f0109a00 0x7f68f010be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 --2- 172.21.15.120:0/2862154907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68f01070a0 0x7f68f01094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 --2- 172.21.15.120:0/2862154907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0104740 0x7f68f0106b60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 -- 172.21.15.120:0/2862154907 >> 172.21.15.120:0/2862154907 conn(0x7f68f00fdd40 msgr2=0x7f68f01001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 -- 172.21.15.120:0/2862154907 shutdown_connections 2024-05-14T09:24:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.601+0000 7f68f7800640 1 -- 172.21.15.120:0/2862154907 wait complete. 2024-05-14T09:24:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.602+0000 7f68f7800640 1 Processor -- start 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.602+0000 7f68f7800640 1 -- start start 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f7800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f0104740 0x7f68f019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f7800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68f01070a0 0x7f68f019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f7800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0109a00 0x7f68f01a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f7800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f68f010f650 con 0x7f68f0109a00 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f7800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68f010f4d0 con 0x7f68f01070a0 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f7800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68f010f7d0 con 0x7f68f0104740 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f5800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0109a00 0x7f68f01a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f5800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0109a00 0x7f68f01a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57544/0 (socket says 172.21.15.120:57544) 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f5800640 1 -- 172.21.15.120:0/3406220905 learned_addr learned my addr 172.21.15.120:0/3406220905 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f0104740 0x7f68f019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.603+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68f01070a0 0x7f68f019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68f5800640 1 -- 172.21.15.120:0/3406220905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f0104740 msgr2=0x7f68f019c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68f5800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f0104740 0x7f68f019c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68f5800640 1 -- 172.21.15.120:0/3406220905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68f01070a0 msgr2=0x7f68f019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68f5800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68f01070a0 0x7f68f019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68f5800640 1 -- 172.21.15.120:0/3406220905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f01a4040 con 0x7f68f0109a00 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f0104740 0x7f68f019c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68f5800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0109a00 0x7f68f01a39d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e9d0 tx=0x7f68e800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.604+0000 7f68ee000640 1 -- 172.21.15.120:0/3406220905 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e800cd80 con 0x7f68f0109a00 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.605+0000 7f68ee000640 1 -- 172.21.15.120:0/3406220905 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68e8005020 con 0x7f68f0109a00 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.605+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f01a4330 con 0x7f68f0109a00 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.605+0000 7f68ee000640 1 -- 172.21.15.120:0/3406220905 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e80116d0 con 0x7f68f0109a00 2024-05-14T09:24:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.605+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f01a48d0 con 0x7f68f0109a00 2024-05-14T09:24:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.609+0000 7f68fe775740 1 Processor -- start 2024-05-14T09:24:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.609+0000 7f68ee000640 1 -- 172.21.15.120:0/3406220905 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f68e8004a40 con 0x7f68f0109a00 2024-05-14T09:24:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68fe775740 1 -- start start 2024-05-14T09:24:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68fe775740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98963100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68fe775740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985982f0 0x564f98963680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68fe775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985a04d0 0x564f9896a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68fe775740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564f988c7550 con 0x564f985c11b0 2024-05-14T09:24:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68fe775740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564f9886cbc0 con 0x564f985982f0 2024-05-14T09:24:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68fe775740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f988c3510 con 0x564f985a04d0 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68e7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98963100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68e7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98963100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57558/0 (socket says 172.21.15.120:57558) 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.610+0000 7f68e7e00640 1 -- 172.21.15.120:0/4015284949 learned_addr learned my addr 172.21.15.120:0/4015284949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68f4e00640 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985982f0 0x564f98963680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68e7e00640 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985a04d0 0x564f9896a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68e7e00640 1 -- 172.21.15.120:0/4015284949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985a04d0 msgr2=0x564f9896a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68e7e00640 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985a04d0 0x564f9896a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68e7e00640 1 -- 172.21.15.120:0/4015284949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985982f0 msgr2=0x564f98963680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68e7e00640 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985982f0 0x564f98963680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68e7e00640 1 -- 172.21.15.120:0/4015284949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f985d9210 con 0x564f985c11b0 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.611+0000 7f68e7e00640 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98963100 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b3e0 tx=0x7f68d800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7174ff87aa99042 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.612+0000 7f68ee000640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68d40b2860 0x7f68d40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.612+0000 7f68e6000640 1 -- 172.21.15.120:0/4015284949 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8005220 con 0x564f985c11b0 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.612+0000 7f68e6000640 1 -- 172.21.15.120:0/4015284949 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d8017030 con 0x564f985c11b0 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.612+0000 7f68e6000640 1 -- 172.21.15.120:0/4015284949 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8005650 con 0x564f985c11b0 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.612+0000 7f68ee000640 1 -- 172.21.15.120:0/3406220905 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f68e80e2680 con 0x7f68f0109a00 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.612+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68d40b2860 0x7f68d40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68d40b2860 0x7f68d40b4d70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f68e00057c0 tx=0x7f68e0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 -- 172.21.15.120:0/4015284949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 msgr2=0x564f98963100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98963100 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b3e0 tx=0x7f68d800b700 comp rx=0 tx=0).stop 2024-05-14T09:24:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 -- 172.21.15.120:0/4015284949 shutdown_connections 2024-05-14T09:24:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985a04d0 0x564f9896a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985982f0 0x564f98963680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 --2- 172.21.15.120:0/4015284949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98963100 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 -- 172.21.15.120:0/4015284949 >> 172.21.15.120:0/4015284949 conn(0x564f985b5300 msgr2=0x564f9895ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 -- 172.21.15.120:0/4015284949 shutdown_connections 2024-05-14T09:24:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.613+0000 7f68fe775740 1 -- 172.21.15.120:0/4015284949 wait complete. 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.614+0000 7f68fe775740 1 -- start start 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.614+0000 7f68fe775740 1 Processor -- start 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68fe775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68fe775740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985a04d0 0x564f9896d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68fe775740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98974160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68fe775740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564f9896afd0 con 0x564f985c11b0 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68fe775740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564f98880660 con 0x564f985a04d0 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68fe775740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f9896b150 con 0x564f985982f0 2024-05-14T09:24:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68fe775740 10 client.0 _ll_register_callbacks cb 0x564f9884a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68f5800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98974160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68f5800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98974160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57574/0 (socket says 172.21.15.120:57574) 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68f5800640 1 -- 172.21.15.120:0/3326817210 learned_addr learned my addr 172.21.15.120:0/3326817210 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.615+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985a04d0 0x564f9896d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68f5800640 1 -- 172.21.15.120:0/3326817210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 msgr2=0x564f9896ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68f5800640 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68f5800640 1 -- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985a04d0 msgr2=0x564f9896d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68f5800640 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985a04d0 0x564f9896d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68f5800640 1 -- 172.21.15.120:0/3326817210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f986a5620 con 0x564f985c11b0 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68f5800640 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98974160 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f68e8005ba0 tx=0x7f68e80a5190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e947c0f7267fedd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68dea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68dea00640 1 -- 172.21.15.120:0/3326817210 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e801f040 con 0x564f985c11b0 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68d8017030 con 0x564f985c11b0 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.616+0000 7f68dea00640 1 -- 172.21.15.120:0/3326817210 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f68e80a5ed0 con 0x564f985c11b0 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68dea00640 1 -- 172.21.15.120:0/3326817210 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f68e80adc90 con 0x564f985c11b0 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 10 client.15642 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564f989771b0 con 0x564f985c11b0 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68dea00640 1 -- 172.21.15.120:0/3326817210 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d8017030 con 0x564f985c11b0 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68dea00640 1 -- 172.21.15.120:0/3326817210 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f68e80e2070 con 0x564f985c11b0 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 10 client.15642 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 20 client.15642 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f9857fd80 0x564f9897a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 4 client.15642 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:24:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.617+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f988d5160 con 0x564f9857fd80 2024-05-14T09:24:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.618+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f9857fd80 0x564f9897a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.619+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f9857fd80 0x564f9897a940 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6c741cb6c7d9f9 server_cookie=67d419b10c76b2e9 in_seq=0 out_seq=0 2024-05-14T09:24:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.619+0000 7f68dea00640 10 client.15642 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68dea00640 1 -- 172.21.15.120:0/3326817210 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f988d5160 con 0x564f9857fd80 2024-05-14T09:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68dea00640 10 client.15642 handle_command_reply: tid=0 2024-05-14T09:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 client.15642 shutdown 2024-05-14T09:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 msgr2=0x564f98974160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98974160 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f68e8005ba0 tx=0x7f68e80a5190 comp rx=0 tx=0).stop 2024-05-14T09:24:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 shutdown_connections 2024-05-14T09:24:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f9857fd80 0x564f9897a940 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985c11b0 0x564f98974160 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985a04d0 0x564f9896d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 --2- 172.21.15.120:0/3326817210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68dea00640 0 client.15642 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.621+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 >> 172.21.15.120:0/3326817210 conn(0x564f985b5300 msgr2=0x564f989619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.622+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 shutdown_connections 2024-05-14T09:24:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.622+0000 7f68fe775740 1 -- 172.21.15.120:0/3326817210 wait complete. 2024-05-14T09:24:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.622+0000 7f68fe775740 20 client.15642 trim_cache size 0 max 16384 2024-05-14T09:24:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.642+0000 7f68fe775740 1 Processor -- start 2024-05-14T09:24:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.642+0000 7f68fe775740 1 -- start start 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68fe775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68fe775740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f98974080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68fe775740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f989745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68fe775740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f68f01aecc0 con 0x564f985a04d0 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68fe775740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68f01b08f0 con 0x564f985c11b0 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68fe775740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68f01af390 con 0x564f985982f0 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68e7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f98974080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68e7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f98974080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57584/0 (socket says 172.21.15.120:57584) 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68e7e00640 1 -- 172.21.15.120:0/3343190221 learned_addr learned my addr 172.21.15.120:0/3343190221 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68f5800640 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f989745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.643+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e7e00640 1 -- 172.21.15.120:0/3343190221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 msgr2=0x564f9896bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e7e00640 1 -- 172.21.15.120:0/3343190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 msgr2=0x564f989745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f989745c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e7e00640 1 -- 172.21.15.120:0/3343190221 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f9895a280 con 0x564f985a04d0 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:24:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68f5800640 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f989745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:24:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f98974080 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f68d8011ca0 tx=0x7f68d8011fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7e7409afefbf62 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e5600640 1 -- 172.21.15.120:0/3343190221 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d802a070 con 0x564f985a04d0 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e5600640 1 -- 172.21.15.120:0/3343190221 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d8017040 con 0x564f985a04d0 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.644+0000 7f68e5600640 1 -- 172.21.15.120:0/3343190221 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d801c470 con 0x564f985a04d0 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.645+0000 7f68fe775740 1 -- 172.21.15.120:0/3343190221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 msgr2=0x564f98974080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.645+0000 7f68fe775740 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f98974080 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f68d8011ca0 tx=0x7f68d8011fc0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 -- 172.21.15.120:0/3343190221 shutdown_connections 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f989745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f98974080 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 --2- 172.21.15.120:0/3343190221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f9896bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 -- 172.21.15.120:0/3343190221 >> 172.21.15.120:0/3343190221 conn(0x564f985b5300 msgr2=0x564f9896b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 -- 172.21.15.120:0/3343190221 shutdown_connections 2024-05-14T09:24:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 -- 172.21.15.120:0/3343190221 wait complete. 2024-05-14T09:24:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 -- start start 2024-05-14T09:24:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.646+0000 7f68fe775740 1 Processor -- start 2024-05-14T09:24:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68fe775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f98971f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68fe775740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f989724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68fe775740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f98973400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68fe775740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f68f01b0160 con 0x564f985a04d0 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68fe775740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68f01afa90 con 0x564f985c11b0 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68fe775740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68f01accc0 con 0x564f985982f0 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68fe775740 10 client.0 _ll_register_callbacks cb 0x7f68e8009220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68e7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f989724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68e7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f989724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57598/0 (socket says 172.21.15.120:57598) 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68e7e00640 1 -- 172.21.15.120:0/3932414878 learned_addr learned my addr 172.21.15.120:0/3932414878 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f98971f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.647+0000 7f68f5800640 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f98973400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68e7e00640 1 -- 172.21.15.120:0/3932414878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 msgr2=0x564f98971f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f98971f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68e7e00640 1 -- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 msgr2=0x564f98973400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:24:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f98973400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68e7e00640 1 -- 172.21.15.120:0/3932414878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f989739c0 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68e7e00640 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f989724d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f68d8003a70 tx=0x7f68d800b350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5495f24b2e8daf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68dea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68dea00640 1 -- 172.21.15.120:0/3932414878 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d802a040 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68dea00640 1 -- 172.21.15.120:0/3932414878 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f68d8005040 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.648+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68d8017040 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68dea00640 1 -- 172.21.15.120:0/3932414878 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f68d803b050 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 10 client.15648 fetch_fsmap learned FSMap version 34 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564f98974bc0 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68dea00640 1 -- 172.21.15.120:0/3932414878 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d8017040 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68dea00640 1 -- 172.21.15.120:0/3932414878 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f68d8036030 con 0x564f985a04d0 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 10 client.15648 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 20 client.15648 populate_metadata read hostname 'smithi120' 2024-05-14T09:24:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f985551c0 0x564f989e5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:24:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 4 client.15648 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:24:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.649+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f988cefd0 con 0x564f985551c0 2024-05-14T09:24:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.650+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f985551c0 0x564f989e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:24:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.651+0000 7f68f4e00640 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f985551c0 0x564f989e5310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d0ec9d657b6e87 server_cookie=41d2f3ddf9c6624a in_seq=0 out_seq=0 2024-05-14T09:24:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.651+0000 7f68dea00640 10 client.15648 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68dea00640 1 -- 172.21.15.120:0/3932414878 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f988cefd0 con 0x564f985551c0 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68dea00640 10 client.15648 handle_command_reply: tid=0 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 client.15648 shutdown 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 msgr2=0x564f989724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f989724d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f68d8003a70 tx=0x7f68d800b350 comp rx=0 tx=0).stop 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 shutdown_connections 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564f985551c0 0x564f989e5310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f985c11b0 0x564f98973400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564f985a04d0 0x564f989724d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 --2- 172.21.15.120:0/3932414878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f985982f0 0x564f98971f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68dea00640 0 client.15648 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:24:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.699+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 >> 172.21.15.120:0/3932414878 conn(0x564f985b5300 msgr2=0x564f98961910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.700+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 shutdown_connections 2024-05-14T09:24:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.700+0000 7f68fe775740 1 -- 172.21.15.120:0/3932414878 wait complete. 2024-05-14T09:24:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.700+0000 7f68fe775740 20 client.15648 trim_cache size 0 max 16384 2024-05-14T09:24:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:24:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:24:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:24:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:24:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68d40b2860 msgr2=0x7f68d40b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68d40b2860 0x7f68d40b4d70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f68e00057c0 tx=0x7f68e0000bc0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0109a00 msgr2=0x7f68f01a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0109a00 0x7f68f01a39d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e9d0 tx=0x7f68e800ee90 comp rx=0 tx=0).stop 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 shutdown_connections 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f68d40b2860 0x7f68d40b4d70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f0109a00 0x7f68f01a39d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68f01070a0 0x7f68f019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 --2- 172.21.15.120:0/3406220905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68f0104740 0x7f68f019c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.701+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 >> 172.21.15.120:0/3406220905 conn(0x7f68f00fdd40 msgr2=0x7f68f01022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.702+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 shutdown_connections 2024-05-14T09:24:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:24:54.702+0000 7f68f7800640 1 -- 172.21.15.120:0/3406220905 wait complete. 2024-05-14T09:24:55.330 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:55 smithi120 ceph-mon[31085]: pgmap v597: 129 pgs: 129 active+clean; 171 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 14 MiB/s wr, 90 op/s 2024-05-14T09:24:55.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:55 smithi152 ceph-mon[34868]: pgmap v597: 129 pgs: 129 active+clean; 171 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 14 MiB/s wr, 90 op/s 2024-05-14T09:24:55.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:55 smithi175 ceph-mon[35353]: pgmap v597: 129 pgs: 129 active+clean; 171 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 14 MiB/s wr, 90 op/s 2024-05-14T09:24:56.234 INFO:teuthology.orchestra.run.smithi120.stderr:700000 of 3200000 tuples (21%) done (elapsed 23.46 s, remaining 83.78 s) 2024-05-14T09:24:57.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:57 smithi120 ceph-mon[31085]: pgmap v598: 129 pgs: 129 active+clean; 183 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 13 MiB/s wr, 92 op/s 2024-05-14T09:24:57.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:57 smithi152 ceph-mon[34868]: pgmap v598: 129 pgs: 129 active+clean; 183 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 13 MiB/s wr, 92 op/s 2024-05-14T09:24:57.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:57 smithi175 ceph-mon[35353]: pgmap v598: 129 pgs: 129 active+clean; 183 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 13 MiB/s wr, 92 op/s 2024-05-14T09:24:59.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:24:59 smithi120 ceph-mon[31085]: pgmap v599: 129 pgs: 129 active+clean; 195 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 12 MiB/s wr, 92 op/s 2024-05-14T09:24:59.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:24:59 smithi152 ceph-mon[34868]: pgmap v599: 129 pgs: 129 active+clean; 195 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 12 MiB/s wr, 92 op/s 2024-05-14T09:24:59.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:24:59 smithi175 ceph-mon[35353]: pgmap v599: 129 pgs: 129 active+clean; 195 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 12 MiB/s wr, 92 op/s 2024-05-14T09:25:01.505 INFO:teuthology.orchestra.run.smithi120.stderr:800000 of 3200000 tuples (25%) done (elapsed 28.73 s, remaining 86.19 s) 2024-05-14T09:25:01.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:01 smithi120 ceph-mon[31085]: pgmap v600: 129 pgs: 129 active+clean; 203 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 57 op/s 2024-05-14T09:25:01.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:01 smithi152 ceph-mon[34868]: pgmap v600: 129 pgs: 129 active+clean; 203 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 57 op/s 2024-05-14T09:25:01.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:01 smithi175 ceph-mon[35353]: pgmap v600: 129 pgs: 129 active+clean; 203 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 57 op/s 2024-05-14T09:25:03.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:03 smithi120 ceph-mon[31085]: pgmap v601: 129 pgs: 129 active+clean; 207 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.9 MiB/s wr, 27 op/s 2024-05-14T09:25:03.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:03 smithi152 ceph-mon[34868]: pgmap v601: 129 pgs: 129 active+clean; 207 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.9 MiB/s wr, 27 op/s 2024-05-14T09:25:03.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:03 smithi175 ceph-mon[35353]: pgmap v601: 129 pgs: 129 active+clean; 207 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.9 MiB/s wr, 27 op/s 2024-05-14T09:25:05.710 INFO:teuthology.orchestra.run.smithi120.stderr:900000 of 3200000 tuples (28%) done (elapsed 32.94 s, remaining 84.17 s) 2024-05-14T09:25:05.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:05 smithi120 ceph-mon[31085]: pgmap v602: 129 pgs: 129 active+clean; 219 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 MiB/s wr, 22 op/s 2024-05-14T09:25:05.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:05 smithi152 ceph-mon[34868]: pgmap v602: 129 pgs: 129 active+clean; 219 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 MiB/s wr, 22 op/s 2024-05-14T09:25:05.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:05 smithi175 ceph-mon[35353]: pgmap v602: 129 pgs: 129 active+clean; 219 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 MiB/s wr, 22 op/s 2024-05-14T09:25:07.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:07 smithi120 ceph-mon[31085]: pgmap v603: 129 pgs: 129 active+clean; 227 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 25 op/s 2024-05-14T09:25:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.945+0000 7f4b67e00640 1 -- 172.21.15.120:0/4283653804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 msgr2=0x7f4b681092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.945+0000 7f4b67e00640 1 --2- 172.21.15.120:0/4283653804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b681092e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009900 tx=0x7f4b5002a3f0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.946+0000 7f4b67e00640 1 -- 172.21.15.120:0/4283653804 shutdown_connections 2024-05-14T09:25:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.946+0000 7f4b67e00640 1 --2- 172.21.15.120:0/4283653804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b68109820 0x7f4b6810bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.946+0000 7f4b67e00640 1 --2- 172.21.15.120:0/4283653804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b681092e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.946+0000 7f4b67e00640 1 --2- 172.21.15.120:0/4283653804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b68104560 0x7f4b68106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.946+0000 7f4b67e00640 1 -- 172.21.15.120:0/4283653804 >> 172.21.15.120:0/4283653804 conn(0x7f4b680fdb60 msgr2=0x7f4b68100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.947+0000 7f4b67e00640 1 -- 172.21.15.120:0/4283653804 shutdown_connections 2024-05-14T09:25:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.950+0000 7f4b67e00640 1 -- 172.21.15.120:0/4283653804 wait complete. 2024-05-14T09:25:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.951+0000 7f4b67e00640 1 Processor -- start 2024-05-14T09:25:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.951+0000 7f4b67e00640 1 -- start start 2024-05-14T09:25:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b67e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b68104560 0x7f4b6819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b67e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b6819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b67e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b68109820 0x7f4b681a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b67e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6810f480 con 0x7f4b68106ec0 2024-05-14T09:25:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b67e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6810f300 con 0x7f4b68109820 2024-05-14T09:25:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b67e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6810f600 con 0x7f4b68104560 2024-05-14T09:25:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b66000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b6819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b66000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b6819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38534/0 (socket says 172.21.15.120:38534) 2024-05-14T09:25:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b66000640 1 -- 172.21.15.120:0/3074640756 learned_addr learned my addr 172.21.15.120:0/3074640756 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b67400640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b68109820 0x7f4b681a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.952+0000 7f4b66a00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b68104560 0x7f4b6819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.953+0000 7f4b66000640 1 -- 172.21.15.120:0/3074640756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b68104560 msgr2=0x7f4b6819c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.953+0000 7f4b66000640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b68104560 0x7f4b6819c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.953+0000 7f4b66000640 1 -- 172.21.15.120:0/3074640756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b68109820 msgr2=0x7f4b681a37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.953+0000 7f4b66000640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b68109820 0x7f4b681a37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.953+0000 7f4b66000640 1 -- 172.21.15.120:0/3074640756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b681a3e50 con 0x7f4b68106ec0 2024-05-14T09:25:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.953+0000 7f4b66000640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b6819c850 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4b50005760 tx=0x7f4b50003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.954+0000 7f4b5f400640 1 -- 172.21.15.120:0/3074640756 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5003f070 con 0x7f4b68106ec0 2024-05-14T09:25:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.954+0000 7f4b5f400640 1 -- 172.21.15.120:0/3074640756 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b50031da0 con 0x7f4b68106ec0 2024-05-14T09:25:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.954+0000 7f4b5f400640 1 -- 172.21.15.120:0/3074640756 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50035030 con 0x7f4b68106ec0 2024-05-14T09:25:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.954+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b681a40e0 con 0x7f4b68106ec0 2024-05-14T09:25:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.954+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b681a45d0 con 0x7f4b68106ec0 2024-05-14T09:25:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:07 smithi152 ceph-mon[34868]: pgmap v603: 129 pgs: 129 active+clean; 227 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 25 op/s 2024-05-14T09:25:07.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.958+0000 7f4b745e9740 1 Processor -- start 2024-05-14T09:25:07.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.958+0000 7f4b745e9740 1 -- start start 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.959+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d90561a1b0 0x55d9059bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.959+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059bc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.959+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d9055f94d0 0x55d9059c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.959+0000 7f4b745e9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d905920550 con 0x55d9055f94d0 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.959+0000 7f4b745e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d9058c5bc0 con 0x55d9055f12f0 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b745e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d90591c510 con 0x55d90561a1b0 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b67400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d90561a1b0 0x55d9059bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b67400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d90561a1b0 0x55d9059bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36206/0 (socket says 172.21.15.120:36206) 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b67400640 1 -- 172.21.15.120:0/3295595677 learned_addr learned my addr 172.21.15.120:0/3295595677 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b66a00640 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b5f400640 1 -- 172.21.15.120:0/3074640756 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4b50042070 con 0x7f4b68106ec0 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b67400640 1 -- 172.21.15.120:0/3295595677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 msgr2=0x55d9059bc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b67400640 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059bc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.960+0000 7f4b67400640 1 -- 172.21.15.120:0/3295595677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d9055f94d0 msgr2=0x55d9059c3780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.961+0000 7f4b67400640 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d9055f94d0 0x55d9059c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.961+0000 7f4b67400640 1 -- 172.21.15.120:0/3295595677 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d905632210 con 0x55d90561a1b0 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.961+0000 7f4b67400640 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d90561a1b0 0x55d9059bc300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009fc0 tx=0x7f4b60010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74028744d3f52830 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.962+0000 7f4b57400640 1 -- 172.21.15.120:0/3295595677 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60016070 con 0x55d90561a1b0 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.962+0000 7f4b5f400640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4b4c0b27e0 0x7f4b4c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.963+0000 7f4b5f400640 1 -- 172.21.15.120:0/3074640756 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4b50102ef0 con 0x7f4b68106ec0 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.963+0000 7f4b57400640 1 -- 172.21.15.120:0/3295595677 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b60004d20 con 0x55d90561a1b0 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.963+0000 7f4b57400640 1 -- 172.21.15.120:0/3295595677 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60005280 con 0x55d90561a1b0 2024-05-14T09:25:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.963+0000 7f4b66a00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4b4c0b27e0 0x7f4b4c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 -- 172.21.15.120:0/3295595677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d90561a1b0 msgr2=0x55d9059bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b66a00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4b4c0b27e0 0x7f4b4c0b4cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d9059bd6e0 tx=0x7f4b5800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d90561a1b0 0x55d9059bc300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009fc0 tx=0x7f4b60010800 comp rx=0 tx=0).stop 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 -- 172.21.15.120:0/3295595677 shutdown_connections 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d9055f94d0 0x55d9059c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 --2- 172.21.15.120:0/3295595677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d90561a1b0 0x55d9059bc300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 -- 172.21.15.120:0/3295595677 >> 172.21.15.120:0/3295595677 conn(0x55d90560e300 msgr2=0x55d9059b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.964+0000 7f4b745e9740 1 -- 172.21.15.120:0/3295595677 shutdown_connections 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.965+0000 7f4b745e9740 1 -- 172.21.15.120:0/3295595677 wait complete. 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.965+0000 7f4b745e9740 1 -- start start 2024-05-14T09:25:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.966+0000 7f4b745e9740 1 Processor -- start 2024-05-14T09:25:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.966+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.966+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.966+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b745e9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d9059c41d0 con 0x55d90561a1b0 2024-05-14T09:25:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b745e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d9058d9660 con 0x55d9055f12f0 2024-05-14T09:25:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b745e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9059c4350 con 0x55d9055f94d0 2024-05-14T09:25:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b745e9740 10 client.0 _ll_register_callbacks cb 0x55d9058a3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b67400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b67400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38550/0 (socket says 172.21.15.120:38550) 2024-05-14T09:25:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b67400640 1 -- 172.21.15.120:0/571604597 learned_addr learned my addr 172.21.15.120:0/571604597 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.967+0000 7f4b66000640 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b67400640 1 -- 172.21.15.120:0/571604597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 msgr2=0x55d9059c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b67400640 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b67400640 1 -- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 msgr2=0x55d9059c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b66a00640 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b67400640 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b67400640 1 -- 172.21.15.120:0/571604597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9056fe620 con 0x55d90561a1b0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b67400640 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059cd470 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4b60004c70 tx=0x7f4b60004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604056d8bf0b8f0e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b4be00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b4be00640 1 -- 172.21.15.120:0/571604597 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60016070 con 0x55d90561a1b0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.968+0000 7f4b4be00640 1 -- 172.21.15.120:0/571604597 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4b60003cc0 con 0x55d90561a1b0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.969+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b60004d20 con 0x55d90561a1b0 2024-05-14T09:25:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.969+0000 7f4b4be00640 1 -- 172.21.15.120:0/571604597 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4b60012510 con 0x55d90561a1b0 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.969+0000 7f4b745e9740 10 client.15657 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.969+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d9059d03a0 con 0x55d90561a1b0 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.969+0000 7f4b4be00640 1 -- 172.21.15.120:0/571604597 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b60004d20 con 0x55d90561a1b0 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.970+0000 7f4b4be00640 1 -- 172.21.15.120:0/571604597 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f4b6000f040 con 0x55d90561a1b0 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.970+0000 7f4b745e9740 10 client.15657 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.970+0000 7f4b745e9740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.970+0000 7f4b745e9740 20 client.15657 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.970+0000 7f4b745e9740 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055d8d80 0x55d9059d3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.970+0000 7f4b745e9740 4 client.15657 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.970+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d90592e160 con 0x55d9055d8d80 2024-05-14T09:25:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.971+0000 7f4b66a00640 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055d8d80 0x55d9059d3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.972+0000 7f4b4be00640 10 client.15657 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.972+0000 7f4b66a00640 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055d8d80 0x55d9059d3810 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc71ac976430dce7 server_cookie=ce87e43dbd16d69d in_seq=0 out_seq=0 2024-05-14T09:25:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b4be00640 1 -- 172.21.15.120:0/571604597 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d90592e160 con 0x55d9055d8d80 2024-05-14T09:25:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b4be00640 10 client.15657 handle_command_reply: tid=0 2024-05-14T09:25:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 client.15657 shutdown 2024-05-14T09:25:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 msgr2=0x55d9059cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059cd470 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4b60004c70 tx=0x7f4b60004ca0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 shutdown_connections 2024-05-14T09:25:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055d8d80 0x55d9059d3810 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059cd470 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 --2- 172.21.15.120:0/571604597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 >> 172.21.15.120:0/571604597 conn(0x55d90560e300 msgr2=0x55d9059b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.974+0000 7f4b4be00640 0 client.15657 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.975+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 shutdown_connections 2024-05-14T09:25:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.975+0000 7f4b745e9740 1 -- 172.21.15.120:0/571604597 wait complete. 2024-05-14T09:25:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.975+0000 7f4b745e9740 20 client.15657 trim_cache size 0 max 16384 2024-05-14T09:25:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:07 smithi175 ceph-mon[35353]: pgmap v603: 129 pgs: 129 active+clean; 227 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 25 op/s 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.992+0000 7f4b745e9740 1 Processor -- start 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.992+0000 7f4b745e9740 1 -- start start 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.992+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f12f0 0x55d9059c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f94d0 0x55d9059cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059c5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b745e9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4b681aeaf0 con 0x55d90561a1b0 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b745e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4b681b0720 con 0x55d9055f94d0 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b745e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b681af1c0 con 0x55d9055f12f0 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38554/0 (socket says 172.21.15.120:38554) 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 -- 172.21.15.120:0/227359714 learned_addr learned my addr 172.21.15.120:0/227359714 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b66000640 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f94d0 0x55d9059cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b66a00640 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f12f0 0x55d9059c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 -- 172.21.15.120:0/227359714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f12f0 msgr2=0x55d9059c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f12f0 0x55d9059c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 -- 172.21.15.120:0/227359714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f94d0 msgr2=0x55d9059cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f94d0 0x55d9059cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b67400640 1 -- 172.21.15.120:0/227359714 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9059c37a0 con 0x55d90561a1b0 2024-05-14T09:25:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.993+0000 7f4b66000640 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f94d0 0x55d9059cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.994+0000 7f4b67400640 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059c5760 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4b60005c00 tx=0x7f4b60009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6f939bc4cb9b18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.994+0000 7f4b56a00640 1 -- 172.21.15.120:0/227359714 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60016070 con 0x55d90561a1b0 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.994+0000 7f4b56a00640 1 -- 172.21.15.120:0/227359714 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6001a4d0 con 0x55d90561a1b0 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.994+0000 7f4b56a00640 1 -- 172.21.15.120:0/227359714 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6001ac60 con 0x55d90561a1b0 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.995+0000 7f4b745e9740 1 -- 172.21.15.120:0/227359714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 msgr2=0x55d9059c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.995+0000 7f4b745e9740 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059c5760 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4b60005c00 tx=0x7f4b60009600 comp rx=0 tx=0).stop 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.995+0000 7f4b745e9740 1 -- 172.21.15.120:0/227359714 shutdown_connections 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.995+0000 7f4b745e9740 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059c5760 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.995+0000 7f4b745e9740 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f94d0 0x55d9059cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.995+0000 7f4b745e9740 1 --2- 172.21.15.120:0/227359714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f12f0 0x55d9059c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.995+0000 7f4b745e9740 1 -- 172.21.15.120:0/227359714 >> 172.21.15.120:0/227359714 conn(0x55d90560e300 msgr2=0x55d9059baa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.996+0000 7f4b745e9740 1 -- 172.21.15.120:0/227359714 shutdown_connections 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.996+0000 7f4b745e9740 1 -- 172.21.15.120:0/227359714 wait complete. 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.996+0000 7f4b745e9740 1 -- start start 2024-05-14T09:25:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.996+0000 7f4b745e9740 1 Processor -- start 2024-05-14T09:25:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b745e9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b745e9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4b681aff90 con 0x55d90561a1b0 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b745e9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4b681af8c0 con 0x55d9055f12f0 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b745e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b681acaf0 con 0x55d9055f94d0 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b745e9740 10 client.0 _ll_register_callbacks cb 0x7f4b5800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.997+0000 7f4b67400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b66000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b66a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b67400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38570/0 (socket says 172.21.15.120:38570) 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b66000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36228/0 (socket says 172.21.15.120:36228) 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b67400640 1 -- 172.21.15.120:0/2995927356 learned_addr learned my addr 172.21.15.120:0/2995927356 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b67400640 1 -- 172.21.15.120:0/2995927356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 msgr2=0x55d9059c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b67400640 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b67400640 1 -- 172.21.15.120:0/2995927356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 msgr2=0x55d9059cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b67400640 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.998+0000 7f4b67400640 1 -- 172.21.15.120:0/2995927356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d905a39b10 con 0x55d90561a1b0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.999+0000 7f4b67400640 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059ca230 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4b60010ee0 tx=0x7f4b60012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cac32e5a7f4806 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.999+0000 7f4b4be00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.999+0000 7f4b4be00640 1 -- 172.21.15.120:0/2995927356 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60016070 con 0x55d90561a1b0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.999+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b6001a4d0 con 0x55d90561a1b0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:07.999+0000 7f4b4be00640 1 -- 172.21.15.120:0/2995927356 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4b60009920 con 0x55d90561a1b0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b4be00640 1 -- 172.21.15.120:0/2995927356 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4b60048050 con 0x55d90561a1b0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 10 client.15663 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d905a3ac00 con 0x55d90561a1b0 2024-05-14T09:25:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b4be00640 1 -- 172.21.15.120:0/2995927356 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6001a4d0 con 0x55d90561a1b0 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b4be00640 1 -- 172.21.15.120:0/2995927356 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f4b60025470 con 0x55d90561a1b0 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 10 client.15663 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 20 client.15663 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055ae1c0 0x55d905a3d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 4 client.15663 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.000+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d905927fd0 con 0x55d9055ae1c0 2024-05-14T09:25:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.001+0000 7f4b66a00640 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055ae1c0 0x55d905a3d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.002+0000 7f4b4be00640 10 client.15663 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.002+0000 7f4b66a00640 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055ae1c0 0x55d905a3d5f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88801851017ad1f9 server_cookie=1624f2bdcee5bd4a in_seq=0 out_seq=0 2024-05-14T09:25:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b4be00640 1 -- 172.21.15.120:0/2995927356 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d905927fd0 con 0x55d9055ae1c0 2024-05-14T09:25:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b4be00640 10 client.15663 handle_command_reply: tid=0 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 client.15663 shutdown 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 msgr2=0x55d9059ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059ca230 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4b60010ee0 tx=0x7f4b60012960 comp rx=0 tx=0).stop 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 shutdown_connections 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d9055ae1c0 0x55d905a3d5f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d90561a1b0 0x55d9059ca230 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9055f94d0 0x55d9059c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 --2- 172.21.15.120:0/2995927356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9055f12f0 0x55d9059cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 >> 172.21.15.120:0/2995927356 conn(0x55d90560e300 msgr2=0x55d9059bb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b4be00640 0 client.15663 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 shutdown_connections 2024-05-14T09:25:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.050+0000 7f4b745e9740 1 -- 172.21.15.120:0/2995927356 wait complete. 2024-05-14T09:25:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.051+0000 7f4b745e9740 20 client.15663 trim_cache size 0 max 16384 2024-05-14T09:25:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:25:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:25:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:25:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:25:08.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.051+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4b4c0b27e0 msgr2=0x7f4b4c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:08.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.051+0000 7f4b67e00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4b4c0b27e0 0x7f4b4c0b4cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d9059bd6e0 tx=0x7f4b5800b390 comp rx=0 tx=0).stop 2024-05-14T09:25:08.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.051+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 msgr2=0x7f4b6819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:08.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.051+0000 7f4b67e00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b6819c850 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4b50005760 tx=0x7f4b50003d50 comp rx=0 tx=0).stop 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 shutdown_connections 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4b4c0b27e0 0x7f4b4c0b4cf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b68109820 0x7f4b681a37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b68106ec0 0x7f4b6819c850 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 --2- 172.21.15.120:0/3074640756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b68104560 0x7f4b6819c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 >> 172.21.15.120:0/3074640756 conn(0x7f4b680fdb60 msgr2=0x7f4b681020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 shutdown_connections 2024-05-14T09:25:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:08.052+0000 7f4b67e00640 1 -- 172.21.15.120:0/3074640756 wait complete. 2024-05-14T09:25:09.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:09 smithi120 ceph-mon[31085]: pgmap v604: 129 pgs: 129 active+clean; 239 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 23 op/s 2024-05-14T09:25:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:09 smithi152 ceph-mon[34868]: pgmap v604: 129 pgs: 129 active+clean; 239 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 23 op/s 2024-05-14T09:25:09.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:09 smithi175 ceph-mon[35353]: pgmap v604: 129 pgs: 129 active+clean; 239 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 23 op/s 2024-05-14T09:25:10.066 INFO:teuthology.orchestra.run.smithi120.stderr:1000000 of 3200000 tuples (31%) done (elapsed 37.29 s, remaining 82.04 s) 2024-05-14T09:25:11.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:11 smithi120 ceph-mon[31085]: pgmap v605: 129 pgs: 129 active+clean; 259 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:25:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:11 smithi152 ceph-mon[34868]: pgmap v605: 129 pgs: 129 active+clean; 259 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:25:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:11 smithi175 ceph-mon[35353]: pgmap v605: 129 pgs: 129 active+clean; 259 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:25:13.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:13 smithi120 ceph-mon[31085]: pgmap v606: 129 pgs: 129 active+clean; 263 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 25 op/s 2024-05-14T09:25:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:13 smithi152 ceph-mon[34868]: pgmap v606: 129 pgs: 129 active+clean; 263 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 25 op/s 2024-05-14T09:25:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:13 smithi175 ceph-mon[35353]: pgmap v606: 129 pgs: 129 active+clean; 263 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 25 op/s 2024-05-14T09:25:15.232 INFO:teuthology.orchestra.run.smithi120.stderr:1100000 of 3200000 tuples (34%) done (elapsed 42.46 s, remaining 81.06 s) 2024-05-14T09:25:15.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:15 smithi120 ceph-mon[31085]: pgmap v607: 129 pgs: 129 active+clean; 267 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:25:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:15 smithi152 ceph-mon[34868]: pgmap v607: 129 pgs: 129 active+clean; 267 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:25:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:15 smithi175 ceph-mon[35353]: pgmap v607: 129 pgs: 129 active+clean; 267 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:25:17.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:17 smithi120 ceph-mon[31085]: pgmap v608: 129 pgs: 129 active+clean; 277 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 25 op/s 2024-05-14T09:25:17.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:17 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:25:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:17 smithi152 ceph-mon[34868]: pgmap v608: 129 pgs: 129 active+clean; 277 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 25 op/s 2024-05-14T09:25:17.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:17 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:25:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:17 smithi175 ceph-mon[35353]: pgmap v608: 129 pgs: 129 active+clean; 277 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 25 op/s 2024-05-14T09:25:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:17 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:25:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:1200000 of 3200000 tuples (37%) done (elapsed 45.90 s, remaining 76.50 s) 2024-05-14T09:25:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:19 smithi120 ceph-mon[31085]: pgmap v609: 129 pgs: 129 active+clean; 301 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 25 op/s 2024-05-14T09:25:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:25:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:25:19.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:25:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:19 smithi152 ceph-mon[34868]: pgmap v609: 129 pgs: 129 active+clean; 301 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 25 op/s 2024-05-14T09:25:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:25:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:25:19.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:25:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:19 smithi175 ceph-mon[35353]: pgmap v609: 129 pgs: 129 active+clean; 301 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 25 op/s 2024-05-14T09:25:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:25:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:25:19.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:25:20.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:25:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 -- 172.21.15.120:0/1028777382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 msgr2=0x7f36a410ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 --2- 172.21.15.120:0/1028777382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a410ae30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3698009900 tx=0x7f369802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 -- 172.21.15.120:0/1028777382 shutdown_connections 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 --2- 172.21.15.120:0/1028777382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a4110070 0x7f36a4112490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 --2- 172.21.15.120:0/1028777382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36a410b370 0x7f36a410b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 --2- 172.21.15.120:0/1028777382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a410ae30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 -- 172.21.15.120:0/1028777382 >> 172.21.15.120:0/1028777382 conn(0x7f36a4078d30 msgr2=0x7f36a407b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 -- 172.21.15.120:0/1028777382 shutdown_connections 2024-05-14T09:25:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.279+0000 7f36aa800640 1 -- 172.21.15.120:0/1028777382 wait complete. 2024-05-14T09:25:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.280+0000 7f36aa800640 1 Processor -- start 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36aa800640 1 -- start start 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36aa800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a41a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36aa800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a410b370 0x7f36a41a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36aa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36a4110070 0x7f36a41a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36aa800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4115a80 con 0x7f36a410a400 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36aa800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4115900 con 0x7f36a410b370 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36aa800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4115c00 con 0x7f36a4110070 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36a9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a41a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36a9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a41a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59456/0 (socket says 172.21.15.120:59456) 2024-05-14T09:25:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.281+0000 7f36a9400640 1 -- 172.21.15.120:0/843155517 learned_addr learned my addr 172.21.15.120:0/843155517 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a9e00640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36a4110070 0x7f36a41a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a8a00640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a410b370 0x7f36a41a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a9400640 1 -- 172.21.15.120:0/843155517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36a4110070 msgr2=0x7f36a41a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a9400640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36a4110070 0x7f36a41a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a9400640 1 -- 172.21.15.120:0/843155517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a410b370 msgr2=0x7f36a41a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a9400640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a410b370 0x7f36a41a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a9400640 1 -- 172.21.15.120:0/843155517 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a41a8150 con 0x7f36a410a400 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.282+0000 7f36a9400640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a41a06c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3698005760 tx=0x7f3698003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.283+0000 7f36a2000640 1 -- 172.21.15.120:0/843155517 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369803f070 con 0x7f36a410a400 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.283+0000 7f36a2000640 1 -- 172.21.15.120:0/843155517 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3698031da0 con 0x7f36a410a400 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.283+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a41a83e0 con 0x7f36a410a400 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.283+0000 7f36a2000640 1 -- 172.21.15.120:0/843155517 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698035030 con 0x7f36a410a400 2024-05-14T09:25:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.283+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a41a88d0 con 0x7f36a410a400 2024-05-14T09:25:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 Processor -- start 2024-05-14T09:25:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 -- start start 2024-05-14T09:25:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0d81b0 0x56176a47a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a47a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0b74d0 0x56176a481780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56176a3de550 con 0x56176a0af2f0 2024-05-14T09:25:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56176a383bc0 con 0x56176a0d81b0 2024-05-14T09:25:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.287+0000 7f36b2e71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56176a3da510 con 0x56176a0b74d0 2024-05-14T09:25:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0b74d0 0x56176a481780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0d81b0 0x56176a47a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0b74d0 0x56176a481780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50530/0 (socket says 172.21.15.120:50530) 2024-05-14T09:25:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a8a00640 1 -- 172.21.15.120:0/568740080 learned_addr learned my addr 172.21.15.120:0/568740080 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a2000640 1 -- 172.21.15.120:0/843155517 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3698042070 con 0x7f36a410a400 2024-05-14T09:25:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a9400640 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a47a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a9e00640 1 -- 172.21.15.120:0/568740080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0b74d0 msgr2=0x56176a481780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.288+0000 7f36a9e00640 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0b74d0 0x56176a481780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.289+0000 7f36a9e00640 1 -- 172.21.15.120:0/568740080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 msgr2=0x56176a47a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.289+0000 7f36a9e00640 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a47a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.289+0000 7f36a9e00640 1 -- 172.21.15.120:0/568740080 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176a0f0210 con 0x56176a0d81b0 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.289+0000 7f36a9400640 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a47a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.289+0000 7f36a9e00640 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0d81b0 0x56176a47a300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f369c009e20 tx=0x7f369c010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d820b45fb5c4b1ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.290+0000 7f36a2000640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f368c0b27e0 0x7f368c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.290+0000 7f3696600640 1 -- 172.21.15.120:0/568740080 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c016070 con 0x56176a0d81b0 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.290+0000 7f3696600640 1 -- 172.21.15.120:0/568740080 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f369c004d20 con 0x56176a0d81b0 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.290+0000 7f3696600640 1 -- 172.21.15.120:0/568740080 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c0126b0 con 0x56176a0d81b0 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.290+0000 7f36a2000640 1 -- 172.21.15.120:0/843155517 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3698102fa0 con 0x7f36a410a400 2024-05-14T09:25:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.290+0000 7f36a9400640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f368c0b27e0 0x7f368c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 -- 172.21.15.120:0/568740080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0d81b0 msgr2=0x56176a47a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36a9400640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f368c0b27e0 0x7f368c0b4cf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x56176a47b6e0 tx=0x7f3698009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0d81b0 0x56176a47a300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f369c009e20 tx=0x7f369c010740 comp rx=0 tx=0).stop 2024-05-14T09:25:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 -- 172.21.15.120:0/568740080 shutdown_connections 2024-05-14T09:25:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0b74d0 0x56176a481780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a47a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 --2- 172.21.15.120:0/568740080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0d81b0 0x56176a47a300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 -- 172.21.15.120:0/568740080 >> 172.21.15.120:0/568740080 conn(0x56176a0cc300 msgr2=0x56176a475c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 -- 172.21.15.120:0/568740080 shutdown_connections 2024-05-14T09:25:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.291+0000 7f36b2e71740 1 -- 172.21.15.120:0/568740080 wait complete. 2024-05-14T09:25:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.292+0000 7f36b2e71740 1 -- start start 2024-05-14T09:25:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.292+0000 7f36b2e71740 1 Processor -- start 2024-05-14T09:25:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.293+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0af2f0 0x56176a483e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.293+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a484390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.293+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0d81b0 0x56176a48b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.293+0000 7f36b2e71740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56176a4821d0 con 0x56176a0d81b0 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.293+0000 7f36b2e71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56176a397660 con 0x56176a0b74d0 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.293+0000 7f36b2e71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56176a482350 con 0x56176a0af2f0 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.293+0000 7f36b2e71740 10 client.0 _ll_register_callbacks cb 0x56176a361400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0d81b0 0x56176a48b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0d81b0 0x56176a48b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59466/0 (socket says 172.21.15.120:59466) 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 -- 172.21.15.120:0/272328863 learned_addr learned my addr 172.21.15.120:0/272328863 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a8a00640 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a484390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0af2f0 0x56176a483e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 -- 172.21.15.120:0/272328863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0af2f0 msgr2=0x56176a483e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0af2f0 0x56176a483e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 -- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 msgr2=0x56176a484390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a484390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.294+0000 7f36a9e00640 1 -- 172.21.15.120:0/272328863 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176a1bc620 con 0x56176a0d81b0 2024-05-14T09:25:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.295+0000 7f36a9e00640 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0d81b0 0x56176a48b2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f369c011010 tx=0x7f369c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6717c04a74456707 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.295+0000 7f368aa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.295+0000 7f368aa00640 1 -- 172.21.15.120:0/272328863 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c016040 con 0x56176a0d81b0 2024-05-14T09:25:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.295+0000 7f368aa00640 1 -- 172.21.15.120:0/272328863 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f369c012b20 con 0x56176a0d81b0 2024-05-14T09:25:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.296+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f369c004d20 con 0x56176a0d81b0 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.296+0000 7f368aa00640 1 -- 172.21.15.120:0/272328863 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f369c012730 con 0x56176a0d81b0 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.296+0000 7f36b2e71740 10 client.15672 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.296+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56176a48e190 con 0x56176a0d81b0 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.296+0000 7f368aa00640 1 -- 172.21.15.120:0/272328863 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f369c004d20 con 0x56176a0d81b0 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.296+0000 7f368aa00640 1 -- 172.21.15.120:0/272328863 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f369c00f040 con 0x56176a0d81b0 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.297+0000 7f36b2e71740 10 client.15672 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.297+0000 7f36b2e71740 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.297+0000 7f36b2e71740 20 client.15672 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.297+0000 7f36b2e71740 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a096d80 0x56176a491790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.297+0000 7f36b2e71740 4 client.15672 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.297+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56176a3ec160 con 0x56176a096d80 2024-05-14T09:25:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.298+0000 7f36a8a00640 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a096d80 0x56176a491790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.299+0000 7f36a8a00640 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a096d80 0x56176a491790 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92fb4e5b95bfdb42 server_cookie=5f52be40e547aa2a in_seq=0 out_seq=0 2024-05-14T09:25:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.299+0000 7f368aa00640 10 client.15672 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.301+0000 7f368aa00640 1 -- 172.21.15.120:0/272328863 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56176a3ec160 con 0x56176a096d80 2024-05-14T09:25:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.301+0000 7f368aa00640 10 client.15672 handle_command_reply: tid=0 2024-05-14T09:25:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.302+0000 7f36b2e71740 1 client.15672 shutdown 2024-05-14T09:25:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.302+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0d81b0 msgr2=0x56176a48b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.302+0000 7f36b2e71740 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0d81b0 0x56176a48b2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f369c011010 tx=0x7f369c005c30 comp rx=0 tx=0).stop 2024-05-14T09:25:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.303+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 shutdown_connections 2024-05-14T09:25:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.303+0000 7f36b2e71740 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a096d80 0x56176a491790 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.303+0000 7f368aa00640 0 client.15672 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.303+0000 7f36b2e71740 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0d81b0 0x56176a48b2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.303+0000 7f36b2e71740 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a484390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.303+0000 7f36b2e71740 1 --2- 172.21.15.120:0/272328863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a0af2f0 0x56176a483e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.303+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 >> 172.21.15.120:0/272328863 conn(0x56176a0cc300 msgr2=0x56176a474c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.304+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 shutdown_connections 2024-05-14T09:25:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.304+0000 7f36b2e71740 1 -- 172.21.15.120:0/272328863 wait complete. 2024-05-14T09:25:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.304+0000 7f36b2e71740 20 client.15672 trim_cache size 0 max 16384 2024-05-14T09:25:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 Processor -- start 2024-05-14T09:25:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 -- start start 2024-05-14T09:25:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a482750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a482c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a48b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b2df0 con 0x56176a0af2f0 2024-05-14T09:25:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b4a20 con 0x56176a0b74d0 2024-05-14T09:25:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36b2e71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b34c0 con 0x56176a096d80 2024-05-14T09:25:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36a8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a482c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.323+0000 7f36a8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a482c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59476/0 (socket says 172.21.15.120:59476) 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a8a00640 1 -- 172.21.15.120:0/3204250589 learned_addr learned my addr 172.21.15.120:0/3204250589 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a9e00640 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a482750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a9e00640 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a48b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a8a00640 1 -- 172.21.15.120:0/3204250589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 msgr2=0x56176a482750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a8a00640 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a482750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a8a00640 1 -- 172.21.15.120:0/3204250589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 msgr2=0x56176a48b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a8a00640 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a48b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.324+0000 7f36a8a00640 1 -- 172.21.15.120:0/3204250589 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176a47b480 con 0x56176a0af2f0 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.325+0000 7f36a8a00640 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a482c90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x56176a476a20 tx=0x7f36900044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7af85b26a415e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.325+0000 7f3695c00640 1 -- 172.21.15.120:0/3204250589 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690003e20 con 0x56176a0af2f0 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.325+0000 7f3695c00640 1 -- 172.21.15.120:0/3204250589 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3690021070 con 0x56176a0af2f0 2024-05-14T09:25:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.325+0000 7f3695c00640 1 -- 172.21.15.120:0/3204250589 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690010a80 con 0x56176a0af2f0 2024-05-14T09:25:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.326+0000 7f36b2e71740 1 -- 172.21.15.120:0/3204250589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 msgr2=0x56176a482c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.326+0000 7f36b2e71740 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a482c90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x56176a476a20 tx=0x7f36900044d0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 -- 172.21.15.120:0/3204250589 shutdown_connections 2024-05-14T09:25:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0b74d0 0x56176a48b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0af2f0 0x56176a482c90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 --2- 172.21.15.120:0/3204250589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a482750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 -- 172.21.15.120:0/3204250589 >> 172.21.15.120:0/3204250589 conn(0x56176a0cc300 msgr2=0x56176a47e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 -- 172.21.15.120:0/3204250589 shutdown_connections 2024-05-14T09:25:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 -- 172.21.15.120:0/3204250589 wait complete. 2024-05-14T09:25:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.327+0000 7f36b2e71740 1 -- start start 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 1 Processor -- start 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a48b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0af2f0 0x56176a488420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0b74d0 0x56176a488960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b4290 con 0x56176a0b74d0 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b3bc0 con 0x56176a0af2f0 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b0df0 con 0x56176a096d80 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.328+0000 7f36b2e71740 10 client.0 _ll_register_callbacks cb 0x7f369000c3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0b74d0 0x56176a488960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0b74d0 0x56176a488960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59482/0 (socket says 172.21.15.120:59482) 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 -- 172.21.15.120:0/346470851 learned_addr learned my addr 172.21.15.120:0/346470851 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a8a00640 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0af2f0 0x56176a488420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a48b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 -- 172.21.15.120:0/346470851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 msgr2=0x56176a48b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a48b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 -- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0af2f0 msgr2=0x56176a488420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0af2f0 0x56176a488420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.329+0000 7f36a9e00640 1 -- 172.21.15.120:0/346470851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176a488f20 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f36a9e00640 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0b74d0 0x56176a488960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f369c01a950 tx=0x7f369c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b08589575d05c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f368aa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f368aa00640 1 -- 172.21.15.120:0/346470851 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c03b020 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3690021070 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f368aa00640 1 -- 172.21.15.120:0/346470851 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f369c012b20 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f368aa00640 1 -- 172.21.15.120:0/346470851 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f369c043050 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f36b2e71740 10 client.15678 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.330+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56176a4f8b10 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f368aa00640 1 -- 172.21.15.120:0/346470851 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3690021070 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f368aa00640 1 -- 172.21.15.120:0/346470851 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f369c034c40 con 0x56176a0b74d0 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f36b2e71740 10 client.15678 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f36b2e71740 10 client.15678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f36b2e71740 20 client.15678 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f36b2e71740 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a0d81b0 0x56176a4fb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f36b2e71740 4 client.15678 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:25:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.331+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56176a3e5fd0 con 0x56176a0d81b0 2024-05-14T09:25:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.332+0000 7f36a8a00640 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a0d81b0 0x56176a4fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.333+0000 7f368aa00640 10 client.15678 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.333+0000 7f36a8a00640 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a0d81b0 0x56176a4fb590 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42b86aa5a80f2c9 server_cookie=ee422820b9ad081 in_seq=0 out_seq=0 2024-05-14T09:25:21.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f368aa00640 1 -- 172.21.15.120:0/346470851 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56176a3e5fd0 con 0x56176a0d81b0 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f368aa00640 10 client.15678 handle_command_reply: tid=0 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 client.15678 shutdown 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0b74d0 msgr2=0x56176a488960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0b74d0 0x56176a488960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f369c01a950 tx=0x7f369c005c30 comp rx=0 tx=0).stop 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 shutdown_connections 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56176a0d81b0 0x56176a4fb590 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56176a0b74d0 0x56176a488960 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56176a0af2f0 0x56176a488420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 --2- 172.21.15.120:0/346470851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56176a096d80 0x56176a48b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f368aa00640 0 client.15678 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.378+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 >> 172.21.15.120:0/346470851 conn(0x56176a0cc300 msgr2=0x56176a482750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.379+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 shutdown_connections 2024-05-14T09:25:21.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.379+0000 7f36b2e71740 1 -- 172.21.15.120:0/346470851 wait complete. 2024-05-14T09:25:21.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.379+0000 7f36b2e71740 20 client.15678 trim_cache size 0 max 16384 2024-05-14T09:25:21.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:25:21.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:25:21.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:25:21.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:25:21.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f368c0b27e0 msgr2=0x7f368c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f368c0b27e0 0x7f368c0b4cf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x56176a47b6e0 tx=0x7f3698009260 comp rx=0 tx=0).stop 2024-05-14T09:25:21.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 msgr2=0x7f36a41a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:21.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a41a06c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3698005760 tx=0x7f3698003d50 comp rx=0 tx=0).stop 2024-05-14T09:25:21.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 shutdown_connections 2024-05-14T09:25:21.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f368c0b27e0 0x7f368c0b4cf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36a4110070 0x7f36a41a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a410b370 0x7f36a41a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 --2- 172.21.15.120:0/843155517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36a410a400 0x7f36a41a06c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:21.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 >> 172.21.15.120:0/843155517 conn(0x7f36a4078d30 msgr2=0x7f36a410c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:21.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 shutdown_connections 2024-05-14T09:25:21.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:21.380+0000 7f36aa800640 1 -- 172.21.15.120:0/843155517 wait complete. 2024-05-14T09:25:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:21 smithi120 ceph-mon[31085]: pgmap v610: 129 pgs: 129 active+clean; 312 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:25:21.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:21 smithi152 ceph-mon[34868]: pgmap v610: 129 pgs: 129 active+clean; 312 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:25:21.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:21 smithi175 ceph-mon[35353]: pgmap v610: 129 pgs: 129 active+clean; 312 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:25:22.522 INFO:teuthology.orchestra.run.smithi120.stderr:1300000 of 3200000 tuples (40%) done (elapsed 49.75 s, remaining 72.71 s) 2024-05-14T09:25:23.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.480+0000 7f0822800700 1 -- 172.21.15.120:0/1517013391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c10c5b0 msgr2=0x7f081c10c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.480+0000 7f0822800700 1 --2- 172.21.15.120:0/1517013391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c10c5b0 0x7f081c10c9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f080c009990 tx=0x7f080c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.480+0000 7f0822800700 1 -- 172.21.15.120:0/1517013391 shutdown_connections 2024-05-14T09:25:23.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.480+0000 7f0822800700 1 --2- 172.21.15.120:0/1517013391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c10c5b0 0x7f081c10c9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.480+0000 7f0822800700 1 --2- 172.21.15.120:0/1517013391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f081c106ec0 0x7f081c113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.480+0000 7f0822800700 1 --2- 172.21.15.120:0/1517013391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f081c106570 0x7f081c106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.480+0000 7f0822800700 1 -- 172.21.15.120:0/1517013391 >> 172.21.15.120:0/1517013391 conn(0x7f081c102050 msgr2=0x7f081c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:23.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.481+0000 7f0822800700 1 -- 172.21.15.120:0/1517013391 shutdown_connections 2024-05-14T09:25:23.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.482+0000 7f0822800700 1 -- 172.21.15.120:0/1517013391 wait complete. 2024-05-14T09:25:23.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.483+0000 7f0822800700 1 Processor -- start 2024-05-14T09:25:23.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.484+0000 7f0822800700 1 -- start start 2024-05-14T09:25:23.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.484+0000 7f0822800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c106570 0x7f081c19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.484+0000 7f0822800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f081c106ec0 0x7f081c19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.484+0000 7f0822800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f081c10c5b0 0x7f081c1a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.484+0000 7f0822800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f081c116660 con 0x7f081c106ec0 2024-05-14T09:25:23.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.484+0000 7f0822800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1164e0 con 0x7f081c106570 2024-05-14T09:25:23.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.484+0000 7f0822800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1167e0 con 0x7f081c10c5b0 2024-05-14T09:25:23.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.485+0000 7f081b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c106570 0x7f081c19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.485+0000 7f081b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c106570 0x7f081c19d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:53770/0 (socket says 172.21.15.120:53770) 2024-05-14T09:25:23.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.485+0000 7f081b400700 1 -- 172.21.15.120:0/601911792 learned_addr learned my addr 172.21.15.120:0/601911792 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:23.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.485+0000 7f081aa00700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f081c106ec0 0x7f081c19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.486+0000 7f081be00700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f081c10c5b0 0x7f081c1a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.486+0000 7f081aa00700 1 -- 172.21.15.120:0/601911792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f081c10c5b0 msgr2=0x7f081c1a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.486+0000 7f081aa00700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f081c10c5b0 0x7f081c1a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.486+0000 7f081aa00700 1 -- 172.21.15.120:0/601911792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c106570 msgr2=0x7f081c19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.486+0000 7f081aa00700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c106570 0x7f081c19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.486+0000 7f081aa00700 1 -- 172.21.15.120:0/601911792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081c1a1ee0 con 0x7f081c106ec0 2024-05-14T09:25:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.487+0000 7f081aa00700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f081c106ec0 0x7f081c19d5b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f081c075b80 tx=0x7f080800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:23.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.487+0000 7f0813e00700 1 -- 172.21.15.120:0/601911792 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080800ca80 con 0x7f081c106ec0 2024-05-14T09:25:23.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.487+0000 7f0813e00700 1 -- 172.21.15.120:0/601911792 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f080800cc20 con 0x7f081c106ec0 2024-05-14T09:25:23.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.487+0000 7f0813e00700 1 -- 172.21.15.120:0/601911792 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808018680 con 0x7f081c106ec0 2024-05-14T09:25:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.489+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081c1a21d0 con 0x7f081c106ec0 2024-05-14T09:25:23.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.489+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081c1a9af0 con 0x7f081c106ec0 2024-05-14T09:25:23.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.493+0000 7f0813e00700 1 -- 172.21.15.120:0/601911792 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f0808010430 con 0x7f081c106ec0 2024-05-14T09:25:23.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.495+0000 7f0813e00700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08000b2900 0x7f08000b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.495+0000 7f0813e00700 1 -- 172.21.15.120:0/601911792 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f08080e2840 con 0x7f081c106ec0 2024-05-14T09:25:23.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.496+0000 7f081b400700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08000b2900 0x7f08000b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.497+0000 7f08312a6b80 1 Processor -- start 2024-05-14T09:25:23.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.497+0000 7f08312a6b80 1 -- start start 2024-05-14T09:25:23.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.497+0000 7f081b400700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08000b2900 0x7f08000b4e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f080c00b2e0 tx=0x7f080c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:23.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.498+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a83219f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.498+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321994b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.498+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a8321999f0 0x55a832199e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.498+0000 7f08312a6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a8320bba20 con 0x55a8321999f0 2024-05-14T09:25:23.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.498+0000 7f08312a6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a832059760 con 0x55a83219f830 2024-05-14T09:25:23.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.498+0000 7f08312a6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a8320b79e0 con 0x55a83201be40 2024-05-14T09:25:23.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.499+0000 7f081b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a83219f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.499+0000 7f081aa00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.499+0000 7f081b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a83219f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50598/0 (socket says 172.21.15.120:50598) 2024-05-14T09:25:23.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.499+0000 7f081b400700 1 -- 172.21.15.120:0/3670221761 learned_addr learned my addr 172.21.15.120:0/3670221761 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:23.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.499+0000 7f081be00700 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a8321999f0 0x55a832199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.501+0000 7f081aa00700 1 -- 172.21.15.120:0/3670221761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 msgr2=0x55a83219f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.501+0000 7f081aa00700 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a83219f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.501+0000 7f081aa00700 1 -- 172.21.15.120:0/3670221761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a8321999f0 msgr2=0x55a832199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.501+0000 7f081aa00700 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a8321999f0 0x55a832199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.501+0000 7f081aa00700 1 -- 172.21.15.120:0/3670221761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8320088d0 con 0x55a83219f830 2024-05-14T09:25:23.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.501+0000 7f081be00700 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a8321999f0 0x55a832199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:25:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.502+0000 7f081aa00700 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321994b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08080a5ae0 tx=0x7f08080aa160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f7a20def820f595 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.502+0000 7f0810c00700 1 -- 172.21.15.120:0/3670221761 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080ade10 con 0x55a83219f830 2024-05-14T09:25:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.502+0000 7f0810c00700 1 -- 172.21.15.120:0/3670221761 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08080a5050 con 0x55a83219f830 2024-05-14T09:25:23.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.502+0000 7f0810c00700 1 -- 172.21.15.120:0/3670221761 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080a9cc0 con 0x55a83219f830 2024-05-14T09:25:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 -- 172.21.15.120:0/3670221761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 msgr2=0x55a8321994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321994b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08080a5ae0 tx=0x7f08080aa160 comp rx=0 tx=0).stop 2024-05-14T09:25:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 -- 172.21.15.120:0/3670221761 shutdown_connections 2024-05-14T09:25:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a8321999f0 0x55a832199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a83219f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 --2- 172.21.15.120:0/3670221761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321994b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 -- 172.21.15.120:0/3670221761 >> 172.21.15.120:0/3670221761 conn(0x55a832060f70 msgr2=0x55a8321942d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:23.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 -- 172.21.15.120:0/3670221761 shutdown_connections 2024-05-14T09:25:23.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.504+0000 7f08312a6b80 1 -- 172.21.15.120:0/3670221761 wait complete. 2024-05-14T09:25:23.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.505+0000 7f08312a6b80 1 -- start start 2024-05-14T09:25:23.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.505+0000 7f08312a6b80 1 Processor -- start 2024-05-14T09:25:23.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.506+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83201be40 0x55a8321a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321a3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f08312a6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a8321a6310 con 0x55a83201be40 2024-05-14T09:25:23.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f08312a6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a832021b20 con 0x55a83219f830 2024-05-14T09:25:23.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f081b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83201be40 0x55a8321a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f08312a6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a8321a6490 con 0x55a8321999f0 2024-05-14T09:25:23.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f081b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83201be40 0x55a8321a2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59510/0 (socket says 172.21.15.120:59510) 2024-05-14T09:25:23.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f081aa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f081aa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321a3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50614/0 (socket says 172.21.15.120:50614) 2024-05-14T09:25:23.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f081aa00700 1 -- 172.21.15.120:0/2058126822 learned_addr learned my addr 172.21.15.120:0/2058126822 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:23.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.507+0000 7f081be00700 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.508+0000 7f08312a6b80 10 client.0 _ll_register_callbacks cb 0x55a832062c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:23.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.508+0000 7f081aa00700 1 -- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 msgr2=0x55a8321a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.508+0000 7f081aa00700 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.508+0000 7f081aa00700 1 -- 172.21.15.120:0/2058126822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83201be40 msgr2=0x55a8321a2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.508+0000 7f081aa00700 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83201be40 0x55a8321a2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.508+0000 7f081aa00700 1 -- 172.21.15.120:0/2058126822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a832081420 con 0x55a8321999f0 2024-05-14T09:25:23.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.508+0000 7f081b400700 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83201be40 0x55a8321a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.509+0000 7f081aa00700 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321a3530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f08080a6cd0 tx=0x7f08080057d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a164286ce7c6790 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.509+0000 7f0805600700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.509+0000 7f0805600700 1 -- 172.21.15.120:0/2058126822 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080b28c0 con 0x55a8321999f0 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.509+0000 7f0805600700 1 -- 172.21.15.120:0/2058126822 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f08080a9ed0 con 0x55a8321999f0 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.509+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08080a5050 con 0x55a8321999f0 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.510+0000 7f0805600700 1 -- 172.21.15.120:0/2058126822 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f08080ade10 con 0x55a8321999f0 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.510+0000 7f08312a6b80 10 client.25333 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:23.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.510+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a8321a6310 con 0x55a8321999f0 2024-05-14T09:25:23.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.510+0000 7f0805600700 1 -- 172.21.15.120:0/2058126822 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08080a5050 con 0x55a8321999f0 2024-05-14T09:25:23.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.512+0000 7f0805600700 1 -- 172.21.15.120:0/2058126822 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f08080cc0b0 con 0x55a8321999f0 2024-05-14T09:25:23.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.512+0000 7f08312a6b80 10 client.25333 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:23.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.512+0000 7f08312a6b80 10 client.25333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:23.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.512+0000 7f08312a6b80 20 client.25333 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:23.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.512+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a8321b3120 0x55a8321b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.512+0000 7f08312a6b80 4 client.25333 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:23.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.512+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8321661c0 con 0x55a8321b3120 2024-05-14T09:25:23.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.513+0000 7f081b400700 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a8321b3120 0x55a8321b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.514+0000 7f081b400700 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a8321b3120 0x55a8321b5540 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a98c601757c246c0 server_cookie=b16e4ac3ba266a33 in_seq=0 out_seq=0 2024-05-14T09:25:23.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.514+0000 7f0805600700 10 client.25333 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:23.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.516+0000 7f0805600700 1 -- 172.21.15.120:0/2058126822 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a8321661c0 con 0x55a8321b3120 2024-05-14T09:25:23.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.516+0000 7f0805600700 10 client.25333 handle_command_reply: tid=0 2024-05-14T09:25:23.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 client.25333 shutdown 2024-05-14T09:25:23.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 msgr2=0x55a8321a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321a3530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f08080a6cd0 tx=0x7f08080057d0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 shutdown_connections 2024-05-14T09:25:23.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a8321b3120 0x55a8321b5540 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83219f830 0x55a8321a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83201be40 0x55a8321a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f0805600700 0 client.25333 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:23.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2058126822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321a3530 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.517+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 >> 172.21.15.120:0/2058126822 conn(0x55a832060f70 msgr2=0x55a8321984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:23.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.518+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 shutdown_connections 2024-05-14T09:25:23.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.518+0000 7f08312a6b80 1 -- 172.21.15.120:0/2058126822 wait complete. 2024-05-14T09:25:23.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.518+0000 7f08312a6b80 20 client.25333 trim_cache size 0 max 16384 2024-05-14T09:25:23.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.549+0000 7f08312a6b80 1 Processor -- start 2024-05-14T09:25:23.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.550+0000 7f08312a6b80 1 -- start start 2024-05-14T09:25:23.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.550+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a8321994b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.550+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8321999f0 0x55a83219eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.550+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.550+0000 7f08312a6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1ae1c0 con 0x55a83219f830 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.550+0000 7f08312a6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1afdf0 con 0x55a8321999f0 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.550+0000 7f08312a6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1ae890 con 0x55a83201be40 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321a1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59526/0 (socket says 172.21.15.120:59526) 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 -- 172.21.15.120:0/1931654207 learned_addr learned my addr 172.21.15.120:0/1931654207 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081b400700 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a8321994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081aa00700 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8321999f0 0x55a83219eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 -- 172.21.15.120:0/1931654207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 msgr2=0x55a8321994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a8321994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 -- 172.21.15.120:0/1931654207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8321999f0 msgr2=0x55a83219eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8321999f0 0x55a83219eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.551+0000 7f081be00700 1 -- 172.21.15.120:0/1931654207 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a832194620 con 0x55a83219f830 2024-05-14T09:25:23.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.552+0000 7f081be00700 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321a1f70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0814018c40 tx=0x7f08140097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bcb1b2057ca8e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:23.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.552+0000 7f0807e00700 1 -- 172.21.15.120:0/1931654207 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814026070 con 0x55a83219f830 2024-05-14T09:25:23.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.552+0000 7f0807e00700 1 -- 172.21.15.120:0/1931654207 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08140178d0 con 0x55a83219f830 2024-05-14T09:25:23.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.552+0000 7f0807e00700 1 -- 172.21.15.120:0/1931654207 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08140185f0 con 0x55a83219f830 2024-05-14T09:25:23.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.553+0000 7f08312a6b80 1 -- 172.21.15.120:0/1931654207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 msgr2=0x55a8321a1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.553+0000 7f08312a6b80 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321a1f70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0814018c40 tx=0x7f08140097d0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.553+0000 7f08312a6b80 1 -- 172.21.15.120:0/1931654207 shutdown_connections 2024-05-14T09:25:23.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.553+0000 7f08312a6b80 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321a1f70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.553+0000 7f08312a6b80 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a83201be40 0x55a8321994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.553+0000 7f08312a6b80 1 --2- 172.21.15.120:0/1931654207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a8321999f0 0x55a83219eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.554+0000 7f08312a6b80 1 -- 172.21.15.120:0/1931654207 >> 172.21.15.120:0/1931654207 conn(0x55a832060f70 msgr2=0x55a83219ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:23.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.554+0000 7f08312a6b80 1 -- 172.21.15.120:0/1931654207 shutdown_connections 2024-05-14T09:25:23.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.554+0000 7f08312a6b80 1 -- 172.21.15.120:0/1931654207 wait complete. 2024-05-14T09:25:23.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.554+0000 7f08312a6b80 1 -- start start 2024-05-14T09:25:23.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.555+0000 7f08312a6b80 1 Processor -- start 2024-05-14T09:25:23.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.555+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83201be40 0x55a8321ab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.555+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321abc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.555+0000 7f08312a6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f08312a6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1af660 con 0x55a83219f830 2024-05-14T09:25:23.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f08312a6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1aef90 con 0x55a83201be40 2024-05-14T09:25:23.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f08312a6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1ac1b0 con 0x55a8321999f0 2024-05-14T09:25:23.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f08312a6b80 10 client.0 _ll_register_callbacks cb 0x55a832062c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f081be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f081be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59540/0 (socket says 172.21.15.120:59540) 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f081be00700 1 -- 172.21.15.120:0/2395618029 learned_addr learned my addr 172.21.15.120:0/2395618029 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.556+0000 7f081aa00700 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f081be00700 1 -- 172.21.15.120:0/2395618029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 msgr2=0x55a8321abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f081be00700 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f081be00700 1 -- 172.21.15.120:0/2395618029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83201be40 msgr2=0x55a8321ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f081be00700 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83201be40 0x55a8321ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f081be00700 1 -- 172.21.15.120:0/2395618029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8321ba0a0 con 0x55a83219f830 2024-05-14T09:25:23.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f081aa00700 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:23.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f081be00700 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321b9b30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0814017cb0 tx=0x7f0814017d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e943c8ef9d6e6523 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:23.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f0805600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:23.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.557+0000 7f0805600700 1 -- 172.21.15.120:0/2395618029 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814031060 con 0x55a83219f830 2024-05-14T09:25:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.558+0000 7f0805600700 1 -- 172.21.15.120:0/2395618029 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0814018480 con 0x55a83219f830 2024-05-14T09:25:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.558+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08140178d0 con 0x55a83219f830 2024-05-14T09:25:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.558+0000 7f0805600700 1 -- 172.21.15.120:0/2395618029 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0814038050 con 0x55a83219f830 2024-05-14T09:25:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.558+0000 7f08312a6b80 10 client.15693 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.558+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a83221cec0 con 0x55a83219f830 2024-05-14T09:25:23.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.558+0000 7f0805600700 1 -- 172.21.15.120:0/2395618029 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08140178d0 con 0x55a83219f830 2024-05-14T09:25:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f0805600700 1 -- 172.21.15.120:0/2395618029 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f081402cc70 con 0x55a83219f830 2024-05-14T09:25:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f08312a6b80 10 client.15693 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f08312a6b80 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f08312a6b80 20 client.15693 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a83221d5b0 0x55a83221f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f08312a6b80 4 client.15693 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:25:23.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a8320c9400 con 0x55a83221d5b0 2024-05-14T09:25:23.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.559+0000 7f081b400700 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a83221d5b0 0x55a83221f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:23.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.561+0000 7f081b400700 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a83221d5b0 0x55a83221f9f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf92e9c98e22ebb server_cookie=4b694077a86b1cfe in_seq=0 out_seq=0 2024-05-14T09:25:23.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.561+0000 7f0805600700 10 client.15693 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:23.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.561+0000 7f0805600700 1 -- 172.21.15.120:0/2395618029 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a8320c9400 con 0x55a83221d5b0 2024-05-14T09:25:23.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.561+0000 7f0805600700 10 client.15693 handle_command_reply: tid=0 2024-05-14T09:25:23.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.561+0000 7f08312a6b80 1 client.15693 shutdown 2024-05-14T09:25:23.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 msgr2=0x55a8321b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321b9b30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0814017cb0 tx=0x7f0814017d90 comp rx=0 tx=0).stop 2024-05-14T09:25:23.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 shutdown_connections 2024-05-14T09:25:23.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a83221d5b0 0x55a83221f9f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a83201be40 0x55a8321ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a83219f830 0x55a8321b9b30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 --2- 172.21.15.120:0/2395618029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8321999f0 0x55a8321abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 >> 172.21.15.120:0/2395618029 conn(0x55a832060f70 msgr2=0x55a83219e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.562+0000 7f0805600700 0 client.15693 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.563+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 shutdown_connections 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.563+0000 7f08312a6b80 1 -- 172.21.15.120:0/2395618029 wait complete. 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.563+0000 7f08312a6b80 20 client.15693 trim_cache size 0 max 16384 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-05-14T09:25:23.563 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-05-14T09:25:23.564 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:25:23.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.564+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08000b2900 msgr2=0x7f08000b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.564+0000 7f0822800700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08000b2900 0x7f08000b4e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f080c00b2e0 tx=0x7f080c0058e0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f081c106ec0 msgr2=0x7f081c19d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:23.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f081c106ec0 0x7f081c19d5b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f081c075b80 tx=0x7f080800ee00 comp rx=0 tx=0).stop 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 shutdown_connections 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08000b2900 0x7f08000b4e10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f081c106570 0x7f081c19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f081c10c5b0 0x7f081c1a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 --2- 172.21.15.120:0/601911792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f081c106ec0 0x7f081c19d5b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 >> 172.21.15.120:0/601911792 conn(0x7f081c102050 msgr2=0x7f081c103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 shutdown_connections 2024-05-14T09:25:23.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:23.565+0000 7f0822800700 1 -- 172.21.15.120:0/601911792 wait complete. 2024-05-14T09:25:23.883 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:23 smithi120 ceph-mon[31085]: pgmap v611: 129 pgs: 129 active+clean; 316 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 24 op/s 2024-05-14T09:25:23.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:23 smithi152 ceph-mon[34868]: pgmap v611: 129 pgs: 129 active+clean; 316 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 24 op/s 2024-05-14T09:25:23.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:23 smithi175 ceph-mon[35353]: pgmap v611: 129 pgs: 129 active+clean; 316 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 24 op/s 2024-05-14T09:25:24.537 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T09:25:24.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:25:25.026 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:1400000 of 3200000 tuples (43%) done (elapsed 52.54 s, remaining 67.55 s) 2024-05-14T09:25:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:25 smithi120 ceph-mon[31085]: pgmap v612: 129 pgs: 129 active+clean; 332 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 21 op/s 2024-05-14T09:25:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:25 smithi152 ceph-mon[34868]: pgmap v612: 129 pgs: 129 active+clean; 332 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 21 op/s 2024-05-14T09:25:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:25 smithi175 ceph-mon[35353]: pgmap v612: 129 pgs: 129 active+clean; 332 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 21 op/s 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.485+0000 7f894fa00700 1 -- 172.21.15.120:0/833884322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89481055b0 msgr2=0x7f89481059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.485+0000 7f894fa00700 1 --2- 172.21.15.120:0/833884322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89481055b0 0x7f89481059c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f893c009990 tx=0x7f893c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.486+0000 7f894fa00700 1 -- 172.21.15.120:0/833884322 shutdown_connections 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.486+0000 7f894fa00700 1 --2- 172.21.15.120:0/833884322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f894810e990 0x7f8948110e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.486+0000 7f894fa00700 1 --2- 172.21.15.120:0/833884322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89481055b0 0x7f89481059c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.486+0000 7f894fa00700 1 --2- 172.21.15.120:0/833884322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8948105f00 0x7f894810e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.486+0000 7f894fa00700 1 -- 172.21.15.120:0/833884322 >> 172.21.15.120:0/833884322 conn(0x7f8948078e00 msgr2=0x7f8948079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:27.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.486+0000 7f894fa00700 1 -- 172.21.15.120:0/833884322 shutdown_connections 2024-05-14T09:25:27.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.486+0000 7f894fa00700 1 -- 172.21.15.120:0/833884322 wait complete. 2024-05-14T09:25:27.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.487+0000 7f894fa00700 1 Processor -- start 2024-05-14T09:25:27.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.487+0000 7f894fa00700 1 -- start start 2024-05-14T09:25:27.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894fa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89481055b0 0x7f894819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:27.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894fa00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8948105f00 0x7f894819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:27.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894fa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f894810e990 0x7f89481a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:27.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894fa00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f89481143b0 con 0x7f894810e990 2024-05-14T09:25:27.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894fa00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8948114230 con 0x7f8948105f00 2024-05-14T09:25:27.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894fa00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8948114530 con 0x7f89481055b0 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894da00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f894810e990 0x7f89481a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894da00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f894810e990 0x7f89481a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59568/0 (socket says 172.21.15.120:59568) 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894da00700 1 -- 172.21.15.120:0/1047382099 learned_addr learned my addr 172.21.15.120:0/1047382099 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f894d000700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89481055b0 0x7f894819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.488+0000 7f8947e00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8948105f00 0x7f894819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.489+0000 7f894da00700 1 -- 172.21.15.120:0/1047382099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89481055b0 msgr2=0x7f894819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.489+0000 7f894da00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89481055b0 0x7f894819d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.489+0000 7f894da00700 1 -- 172.21.15.120:0/1047382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8948105f00 msgr2=0x7f894819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.489+0000 7f894da00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8948105f00 0x7f894819d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.489+0000 7f894da00700 1 -- 172.21.15.120:0/1047382099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89481a1e40 con 0x7f894810e990 2024-05-14T09:25:27.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.489+0000 7f894da00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f894810e990 0x7f89481a1850 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f894000ada0 tx=0x7f894000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:27.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.490+0000 7f8945600700 1 -- 172.21.15.120:0/1047382099 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940017020 con 0x7f894810e990 2024-05-14T09:25:27.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.490+0000 7f8945600700 1 -- 172.21.15.120:0/1047382099 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f894000ce10 con 0x7f894810e990 2024-05-14T09:25:27.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.490+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89481a2130 con 0x7f894810e990 2024-05-14T09:25:27.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.490+0000 7f8945600700 1 -- 172.21.15.120:0/1047382099 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940005280 con 0x7f894810e990 2024-05-14T09:25:27.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.490+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89481a2620 con 0x7f894810e990 2024-05-14T09:25:27.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.491+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89480512c0 con 0x7f894810e990 2024-05-14T09:25:27.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.494+0000 7f8945600700 1 -- 172.21.15.120:0/1047382099 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f894000c980 con 0x7f894810e990 2024-05-14T09:25:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.496+0000 7f8945600700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89300b2880 0x7f89300b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.496+0000 7f8945600700 1 -- 172.21.15.120:0/1047382099 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f89400e1c00 con 0x7f894810e990 2024-05-14T09:25:27.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.496+0000 7f894d000700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89300b2880 0x7f89300b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:27.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.497+0000 7f894d000700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89300b2880 0x7f89300b4d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f893c006010 tx=0x7f893c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:27.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.502+0000 7f8945600700 1 -- 172.21.15.120:0/1047382099 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8940021020 con 0x7f894810e990 2024-05-14T09:25:27.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.819+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89481a9b60 con 0x7f894810e990 2024-05-14T09:25:27.819 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:27 smithi120 ceph-mon[31085]: pgmap v613: 129 pgs: 129 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 25 op/s 2024-05-14T09:25:27.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.821+0000 7f8945600700 1 -- 172.21.15.120:0/1047382099 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11965 (secure 0 0 0) 0x7f89400a95b0 con 0x7f894810e990 2024-05-14T09:25:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:25:27.821 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:24:05.398565+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34427,24454,34409,34388,24469]},"id":1}]} 2024-05-14T09:25:27.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.824+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89300b2880 msgr2=0x7f89300b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:27.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.824+0000 7f894fa00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89300b2880 0x7f89300b4d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f893c006010 tx=0x7f893c00b540 comp rx=0 tx=0).stop 2024-05-14T09:25:27.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.824+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f894810e990 msgr2=0x7f89481a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:27.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.824+0000 7f894fa00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f894810e990 0x7f89481a1850 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f894000ada0 tx=0x7f894000c330 comp rx=0 tx=0).stop 2024-05-14T09:25:27.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.825+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 shutdown_connections 2024-05-14T09:25:27.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.825+0000 7f894fa00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89300b2880 0x7f89300b4d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.825+0000 7f894fa00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f894810e990 0x7f89481a1850 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.825+0000 7f894fa00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89481055b0 0x7f894819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.825+0000 7f894fa00700 1 --2- 172.21.15.120:0/1047382099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8948105f00 0x7f894819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:27.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.825+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 >> 172.21.15.120:0/1047382099 conn(0x7f8948078e00 msgr2=0x7f89481010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:27.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.826+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 shutdown_connections 2024-05-14T09:25:27.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:27.826+0000 7f894fa00700 1 -- 172.21.15.120:0/1047382099 wait complete. 2024-05-14T09:25:27.827 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 34 2024-05-14T09:25:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:27 smithi152 ceph-mon[34868]: pgmap v613: 129 pgs: 129 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 25 op/s 2024-05-14T09:25:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:27 smithi175 ceph-mon[35353]: pgmap v613: 129 pgs: 129 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 25 op/s 2024-05-14T09:25:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:1500000 of 3200000 tuples (46%) done (elapsed 55.73 s, remaining 63.16 s) 2024-05-14T09:25:28.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T09:25:28.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:28 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/1047382099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:25:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:28 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/1047382099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:25:29.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:28 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/1047382099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:25:29.230 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:29 smithi152 ceph-mon[34868]: pgmap v614: 129 pgs: 129 active+clean; 372 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 25 op/s 2024-05-14T09:25:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:29 smithi175 ceph-mon[35353]: pgmap v614: 129 pgs: 129 active+clean; 372 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 25 op/s 2024-05-14T09:25:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:29 smithi120 ceph-mon[31085]: pgmap v614: 129 pgs: 129 active+clean; 372 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 25 op/s 2024-05-14T09:25:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.638+0000 7f2344400700 1 -- 172.21.15.120:0/3532791262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c105e30 msgr2=0x7f233c10e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.638+0000 7f2344400700 1 --2- 172.21.15.120:0/3532791262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c105e30 0x7f233c10e380 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2328009990 tx=0x7f2328009ca0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.638+0000 7f2344400700 1 -- 172.21.15.120:0/3532791262 shutdown_connections 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.638+0000 7f2344400700 1 --2- 172.21.15.120:0/3532791262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f233c10e910 0x7f233c110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.638+0000 7f2344400700 1 --2- 172.21.15.120:0/3532791262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c1054e0 0x7f233c1058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.638+0000 7f2344400700 1 --2- 172.21.15.120:0/3532791262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c105e30 0x7f233c10e380 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.638+0000 7f2344400700 1 -- 172.21.15.120:0/3532791262 >> 172.21.15.120:0/3532791262 conn(0x7f233c0fef30 msgr2=0x7f233c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.639+0000 7f2344400700 1 -- 172.21.15.120:0/3532791262 shutdown_connections 2024-05-14T09:25:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.639+0000 7f2344400700 1 -- 172.21.15.120:0/3532791262 wait complete. 2024-05-14T09:25:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.640+0000 7f2344400700 1 Processor -- start 2024-05-14T09:25:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.640+0000 7f2344400700 1 -- start start 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2344400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f233c1054e0 0x7f233c1031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2344400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c105e30 0x7f233c103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2344400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c10e910 0x7f233c103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2344400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f233c114370 con 0x7f233c10e910 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2344400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1141f0 con 0x7f233c1054e0 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2344400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1144f0 con 0x7f233c105e30 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2342400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c10e910 0x7f233c103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2342400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c10e910 0x7f233c103c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43952/0 (socket says 172.21.15.120:43952) 2024-05-14T09:25:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.641+0000 7f2342400700 1 -- 172.21.15.120:0/1083388502 learned_addr learned my addr 172.21.15.120:0/1083388502 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.642+0000 7f2341000700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c105e30 0x7f233c103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.642+0000 7f2341a00700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f233c1054e0 0x7f233c1031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.642+0000 7f2342400700 1 -- 172.21.15.120:0/1083388502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c105e30 msgr2=0x7f233c103710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.642+0000 7f2342400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c105e30 0x7f233c103710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.642+0000 7f2342400700 1 -- 172.21.15.120:0/1083388502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f233c1054e0 msgr2=0x7f233c1031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.642+0000 7f2342400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f233c1054e0 0x7f233c1031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.642+0000 7f2342400700 1 -- 172.21.15.120:0/1083388502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233c1a9180 con 0x7f233c10e910 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.643+0000 7f2342400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c10e910 0x7f233c103c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f233400ada0 tx=0x7f233400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.643+0000 7f233a000700 1 -- 172.21.15.120:0/1083388502 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334017020 con 0x7f233c10e910 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.643+0000 7f233a000700 1 -- 172.21.15.120:0/1083388502 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f233400ce10 con 0x7f233c10e910 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.643+0000 7f233a000700 1 -- 172.21.15.120:0/1083388502 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334005440 con 0x7f233c10e910 2024-05-14T09:25:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.644+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233c1a9470 con 0x7f233c10e910 2024-05-14T09:25:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.644+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233c1a9960 con 0x7f233c10e910 2024-05-14T09:25:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.649+0000 7f233a000700 1 -- 172.21.15.120:0/1083388502 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2334004ad0 con 0x7f233c10e910 2024-05-14T09:25:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.650+0000 7f2352f57b80 1 Processor -- start 2024-05-14T09:25:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.650+0000 7f2352f57b80 1 -- start start 2024-05-14T09:25:31.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc568e40 0x5632dc6ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6ec830 0x5632dc6e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2352f57b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5632dc608a20 con 0x5632dc6e69f0 2024-05-14T09:25:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2352f57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632dc5a6760 con 0x5632dc568e40 2024-05-14T09:25:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2352f57b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5632dc6049e0 con 0x5632dc6ec830 2024-05-14T09:25:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f233a000700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f23240b2900 0x7f23240b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f233a000700 1 -- 172.21.15.120:0/1083388502 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f23340e1d00 con 0x7f233c10e910 2024-05-14T09:25:31.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2341000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2341000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6e6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43962/0 (socket says 172.21.15.120:43962) 2024-05-14T09:25:31.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2341000700 1 -- 172.21.15.120:0/16596941 learned_addr learned my addr 172.21.15.120:0/16596941 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:31.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2341a00700 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6ec830 0x5632dc6e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.651+0000 7f2342400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f23240b2900 0x7f23240b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2341000700 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc568e40 0x5632dc6ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2341000700 1 -- 172.21.15.120:0/16596941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6ec830 msgr2=0x5632dc6e64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2341000700 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6ec830 0x5632dc6e64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2341000700 1 -- 172.21.15.120:0/16596941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc568e40 msgr2=0x5632dc6ec2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2341000700 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc568e40 0x5632dc6ec2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2341000700 1 -- 172.21.15.120:0/16596941 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632dc5558d0 con 0x5632dc6e69f0 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2342400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f23240b2900 0x7f23240b4e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23340a6260 tx=0x7f2334007e60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.652+0000 7f2341000700 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6e6e00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2328015000 tx=0x7f2328003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469b9893080ea284 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.653+0000 7f232ea00700 1 -- 172.21.15.120:0/16596941 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328005540 con 0x5632dc6e69f0 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.653+0000 7f232ea00700 1 -- 172.21.15.120:0/16596941 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2328003c50 con 0x5632dc6e69f0 2024-05-14T09:25:31.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.653+0000 7f232ea00700 1 -- 172.21.15.120:0/16596941 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232800bd00 con 0x5632dc6e69f0 2024-05-14T09:25:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 -- 172.21.15.120:0/16596941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 msgr2=0x5632dc6e6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6e6e00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2328015000 tx=0x7f2328003680 comp rx=0 tx=0).stop 2024-05-14T09:25:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 -- 172.21.15.120:0/16596941 shutdown_connections 2024-05-14T09:25:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc568e40 0x5632dc6ec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6e6e00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 --2- 172.21.15.120:0/16596941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6ec830 0x5632dc6e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 -- 172.21.15.120:0/16596941 >> 172.21.15.120:0/16596941 conn(0x5632dc5adf70 msgr2=0x5632dc6e12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:31.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 -- 172.21.15.120:0/16596941 shutdown_connections 2024-05-14T09:25:31.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.654+0000 7f2352f57b80 1 -- 172.21.15.120:0/16596941 wait complete. 2024-05-14T09:25:31.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.655+0000 7f2352f57b80 1 -- start start 2024-05-14T09:25:31.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.655+0000 7f2352f57b80 1 Processor -- start 2024-05-14T09:25:31.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.656+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6f0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.656+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6e69f0 0x5632dc6f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.656+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6ec830 0x5632dc6f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.656+0000 7f2352f57b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5632dc6f32b0 con 0x5632dc6ec830 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.656+0000 7f2352f57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632dc56eb20 con 0x5632dc6e69f0 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.656+0000 7f2352f57b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5632dc6f3430 con 0x5632dc568e40 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.656+0000 7f2352f57b80 10 client.0 _ll_register_callbacks cb 0x5632dc5afc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6ec830 0x5632dc6f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6ec830 0x5632dc6f0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43978/0 (socket says 172.21.15.120:43978) 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 -- 172.21.15.120:0/2424268029 learned_addr learned my addr 172.21.15.120:0/2424268029 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341a00700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6e69f0 0x5632dc6f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 -- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 msgr2=0x5632dc6f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 -- 172.21.15.120:0/2424268029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6e69f0 msgr2=0x5632dc6f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6e69f0 0x5632dc6f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 -- 172.21.15.120:0/2424268029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632dc5ce420 con 0x5632dc6ec830 2024-05-14T09:25:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341a00700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6e69f0 0x5632dc6f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.657+0000 7f2341000700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6ec830 0x5632dc6f0ac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f232800beb0 tx=0x7f232801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1871e7c25a85e073 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.658+0000 7f2323400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.658+0000 7f2323400700 1 -- 172.21.15.120:0/2424268029 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232802b040 con 0x5632dc6ec830 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.658+0000 7f2323400700 1 -- 172.21.15.120:0/2424268029 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2328005540 con 0x5632dc6ec830 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.658+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2328003c50 con 0x5632dc6ec830 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.658+0000 7f2323400700 1 -- 172.21.15.120:0/2424268029 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f23280037c0 con 0x5632dc6ec830 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.658+0000 7f2352f57b80 10 client.15711 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.658+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5632dc6f32b0 con 0x5632dc6ec830 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2323400700 1 -- 172.21.15.120:0/2424268029 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2328003c50 con 0x5632dc6ec830 2024-05-14T09:25:31.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2323400700 1 -- 172.21.15.120:0/2424268029 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f2328024070 con 0x5632dc6ec830 2024-05-14T09:25:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2352f57b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2352f57b80 10 client.15711 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:25:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2352f57b80 20 client.15711 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2352f57b80 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc700140 0x5632dc702560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2352f57b80 4 client.15711 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.659+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632dc6b31c0 con 0x5632dc700140 2024-05-14T09:25:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.660+0000 7f2341a00700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc700140 0x5632dc702560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.661+0000 7f2341a00700 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc700140 0x5632dc702560 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13dbc40132d3c2f5 server_cookie=e89d622fc6c070f8 in_seq=0 out_seq=0 2024-05-14T09:25:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.661+0000 7f2323400700 10 client.15711 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:25:31.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.663+0000 7f2323400700 1 -- 172.21.15.120:0/2424268029 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5632dc6b31c0 con 0x5632dc700140 2024-05-14T09:25:31.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.663+0000 7f2323400700 10 client.15711 handle_command_reply: tid=0 2024-05-14T09:25:31.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.663+0000 7f2352f57b80 1 client.15711 shutdown 2024-05-14T09:25:31.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6ec830 msgr2=0x5632dc6f0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6ec830 0x5632dc6f0ac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f232800beb0 tx=0x7f232801a040 comp rx=0 tx=0).stop 2024-05-14T09:25:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 shutdown_connections 2024-05-14T09:25:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc700140 0x5632dc702560 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6ec830 0x5632dc6f0ac0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 --2- 172.21.15.120:0/2424268029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6e69f0 0x5632dc6f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 >> 172.21.15.120:0/2424268029 conn(0x5632dc5adf70 msgr2=0x5632dc6e54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2323400700 0 client.15711 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:25:31.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.664+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 shutdown_connections 2024-05-14T09:25:31.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.665+0000 7f2352f57b80 1 -- 172.21.15.120:0/2424268029 wait complete. 2024-05-14T09:25:31.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.665+0000 7f2352f57b80 20 client.15711 trim_cache size 0 max 16384 2024-05-14T09:25:31.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.687+0000 7f2352f57b80 1 Processor -- start 2024-05-14T09:25:31.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.688+0000 7f2352f57b80 1 -- start start 2024-05-14T09:25:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.688+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.688+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6ef360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.688+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc6eb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.688+0000 7f2352f57b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b2530 con 0x5632dc6e69f0 2024-05-14T09:25:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.688+0000 7f2352f57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b4160 con 0x5632dc6ec830 2024-05-14T09:25:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.688+0000 7f2352f57b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b2c00 con 0x5632dc568e40 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6ef360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43994/0 (socket says 172.21.15.120:43994) 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 -- 172.21.15.120:0/3973759376 learned_addr learned my addr 172.21.15.120:0/3973759376 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341000700 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341000700 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc6eb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 -- 172.21.15.120:0/3973759376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 msgr2=0x5632dc6e64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6e64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 -- 172.21.15.120:0/3973759376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 msgr2=0x5632dc6eb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc6eb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341a00700 1 -- 172.21.15.120:0/3973759376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632dc6d93e0 con 0x5632dc6e69f0 2024-05-14T09:25:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.689+0000 7f2341000700 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc6eb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:25:31.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.690+0000 7f2341a00700 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6ef360 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2330000c00 tx=0x7f233000b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d35bc6530f127ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:31.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.690+0000 7f232e000700 1 -- 172.21.15.120:0/3973759376 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330014110 con 0x5632dc6e69f0 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.690+0000 7f232e000700 1 -- 172.21.15.120:0/3973759376 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23300142b0 con 0x5632dc6e69f0 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.690+0000 7f232e000700 1 -- 172.21.15.120:0/3973759376 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330003680 con 0x5632dc6e69f0 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 -- 172.21.15.120:0/3973759376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 msgr2=0x5632dc6ef360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6ef360 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2330000c00 tx=0x7f233000b580 comp rx=0 tx=0).stop 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 -- 172.21.15.120:0/3973759376 shutdown_connections 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc6eb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc568e40 0x5632dc6e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3973759376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc6e69f0 0x5632dc6ef360 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 -- 172.21.15.120:0/3973759376 >> 172.21.15.120:0/3973759376 conn(0x5632dc5adf70 msgr2=0x5632dc6db0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.691+0000 7f2352f57b80 1 -- 172.21.15.120:0/3973759376 shutdown_connections 2024-05-14T09:25:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.692+0000 7f2352f57b80 1 -- 172.21.15.120:0/3973759376 wait complete. 2024-05-14T09:25:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.692+0000 7f2352f57b80 1 -- start start 2024-05-14T09:25:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.692+0000 7f2352f57b80 1 Processor -- start 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc568e40 0x5632dc6f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6e69f0 0x5632dc707160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2352f57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc7076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2352f57b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b39d0 con 0x5632dc568e40 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2352f57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b3300 con 0x5632dc6ec830 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2352f57b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b04f0 con 0x5632dc6e69f0 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2352f57b80 10 client.0 _ll_register_callbacks cb 0x5632dc5afc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2341000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc568e40 0x5632dc6f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2341000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc568e40 0x5632dc6f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43996/0 (socket says 172.21.15.120:43996) 2024-05-14T09:25:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.693+0000 7f2341000700 1 -- 172.21.15.120:0/3303536447 learned_addr learned my addr 172.21.15.120:0/3303536447 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341a00700 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6e69f0 0x5632dc707160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341000700 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc7076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341000700 1 -- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6e69f0 msgr2=0x5632dc707160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341000700 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6e69f0 0x5632dc707160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341000700 1 -- 172.21.15.120:0/3303536447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 msgr2=0x5632dc7076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341000700 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc7076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341000700 1 -- 172.21.15.120:0/3303536447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632dc707ce0 con 0x5632dc568e40 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2341000700 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc568e40 0x5632dc6f8b90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f232800fd70 tx=0x7f232801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20455828d028d99b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2323400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2323400700 1 -- 172.21.15.120:0/3303536447 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232800b540 con 0x5632dc568e40 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2323400700 1 -- 172.21.15.120:0/3303536447 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f23280050e0 con 0x5632dc568e40 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.694+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632dc616400 con 0x5632dc568e40 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.695+0000 7f2323400700 1 -- 172.21.15.120:0/3303536447 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2328048050 con 0x5632dc568e40 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.695+0000 7f2352f57b80 10 client.15717 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.695+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5632dc772c20 con 0x5632dc568e40 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.695+0000 7f2323400700 1 -- 172.21.15.120:0/3303536447 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5632dc616400 con 0x5632dc568e40 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.695+0000 7f2323400700 1 -- 172.21.15.120:0/3303536447 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f2328024040 con 0x5632dc568e40 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.696+0000 7f2352f57b80 10 client.15717 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.696+0000 7f2352f57b80 10 client.15717 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.696+0000 7f2352f57b80 20 client.15717 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.696+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc773270 0x5632dc775690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.696+0000 7f2352f57b80 4 client.15717 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.696+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5632dc6104a0 con 0x5632dc773270 2024-05-14T09:25:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.697+0000 7f2341a00700 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc773270 0x5632dc775690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:31.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.698+0000 7f2341a00700 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc773270 0x5632dc775690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6931c3f35fa9f309 server_cookie=ef0aafaf11011ceb in_seq=0 out_seq=0 2024-05-14T09:25:31.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.698+0000 7f2323400700 10 client.15717 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:25:31.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.698+0000 7f2323400700 1 -- 172.21.15.120:0/3303536447 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5632dc6104a0 con 0x5632dc773270 2024-05-14T09:25:31.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.698+0000 7f2323400700 10 client.15717 handle_command_reply: tid=0 2024-05-14T09:25:31.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.698+0000 7f2352f57b80 1 client.15717 shutdown 2024-05-14T09:25:31.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc568e40 msgr2=0x5632dc6f8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc568e40 0x5632dc6f8b90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f232800fd70 tx=0x7f232801a040 comp rx=0 tx=0).stop 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 shutdown_connections 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5632dc773270 0x5632dc775690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632dc6ec830 0x5632dc7076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632dc568e40 0x5632dc6f8b90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 --2- 172.21.15.120:0/3303536447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632dc6e69f0 0x5632dc707160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 >> 172.21.15.120:0/3303536447 conn(0x5632dc5adf70 msgr2=0x5632dc6ef0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2323400700 0 client.15717 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 shutdown_connections 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 1 -- 172.21.15.120:0/3303536447 wait complete. 2024-05-14T09:25:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.699+0000 7f2352f57b80 20 client.15717 trim_cache size 0 max 16384 2024-05-14T09:25:31.701 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:25:31.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.700+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f23240b2900 msgr2=0x7f23240b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.700+0000 7f2344400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f23240b2900 0x7f23240b4e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23340a6260 tx=0x7f2334007e60 comp rx=0 tx=0).stop 2024-05-14T09:25:31.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.700+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c10e910 msgr2=0x7f233c103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:31.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.700+0000 7f2344400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c10e910 0x7f233c103c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f233400ada0 tx=0x7f233400c330 comp rx=0 tx=0).stop 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 shutdown_connections 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f23240b2900 0x7f23240b4e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f233c1054e0 0x7f233c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f233c10e910 0x7f233c103c50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 --2- 172.21.15.120:0/1083388502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c105e30 0x7f233c103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 >> 172.21.15.120:0/1083388502 conn(0x7f233c0fef30 msgr2=0x7f233c0ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 shutdown_connections 2024-05-14T09:25:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:31.701+0000 7f2344400700 1 -- 172.21.15.120:0/1083388502 wait complete. 2024-05-14T09:25:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:1600000 of 3200000 tuples (50%) done (elapsed 59.09 s, remaining 59.09 s) 2024-05-14T09:25:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:31 smithi152 ceph-mon[34868]: pgmap v615: 129 pgs: 129 active+clean; 385 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 24 op/s 2024-05-14T09:25:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:31 smithi175 ceph-mon[35353]: pgmap v615: 129 pgs: 129 active+clean; 385 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 24 op/s 2024-05-14T09:25:32.107 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:31 smithi120 ceph-mon[31085]: pgmap v615: 129 pgs: 129 active+clean; 385 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 24 op/s 2024-05-14T09:25:32.680 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T09:25:33.155 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:33.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:33 smithi120 ceph-mon[31085]: pgmap v616: 129 pgs: 129 active+clean; 389 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 26 op/s 2024-05-14T09:25:33.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:33 smithi152 ceph-mon[34868]: pgmap v616: 129 pgs: 129 active+clean; 389 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 26 op/s 2024-05-14T09:25:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:33 smithi175 ceph-mon[35353]: pgmap v616: 129 pgs: 129 active+clean; 389 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 26 op/s 2024-05-14T09:25:34.609 INFO:teuthology.orchestra.run.smithi120.stderr:1700000 of 3200000 tuples (53%) done (elapsed 61.83 s, remaining 54.56 s) 2024-05-14T09:25:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.657+0000 7fd8bcc00640 1 -- 172.21.15.120:0/871033395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 msgr2=0x7fd8b810be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.657+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/871033395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b810be20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009ca0 tx=0x7fd8b002a8c0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.658+0000 7fd8bcc00640 1 -- 172.21.15.120:0/871033395 shutdown_connections 2024-05-14T09:25:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.658+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/871033395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b810be20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.658+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/871033395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8b81070a0 0x7fd8b81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.658+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/871033395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b8104740 0x7fd8b8106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.658+0000 7fd8bcc00640 1 -- 172.21.15.120:0/871033395 >> 172.21.15.120:0/871033395 conn(0x7fd8b80fdd40 msgr2=0x7fd8b81001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.658+0000 7fd8bcc00640 1 -- 172.21.15.120:0/871033395 shutdown_connections 2024-05-14T09:25:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.658+0000 7fd8bcc00640 1 -- 172.21.15.120:0/871033395 wait complete. 2024-05-14T09:25:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.659+0000 7fd8bcc00640 1 Processor -- start 2024-05-14T09:25:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8bcc00640 1 -- start start 2024-05-14T09:25:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8bcc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8b8104740 0x7fd8b819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8bcc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b81070a0 0x7fd8b819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8bcc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b81a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8bcc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b810f660 con 0x7fd8b8109a00 2024-05-14T09:25:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8bcc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b810f4e0 con 0x7fd8b8104740 2024-05-14T09:25:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8bcc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b810f7e0 con 0x7fd8b81070a0 2024-05-14T09:25:34.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8b6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b81a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8b6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b81a3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44026/0 (socket says 172.21.15.120:44026) 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.660+0000 7fd8b6800640 1 -- 172.21.15.120:0/2620403357 learned_addr learned my addr 172.21.15.120:0/2620403357 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b5400640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b81070a0 0x7fd8b819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8b8104740 0x7fd8b819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b6800640 1 -- 172.21.15.120:0/2620403357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b81070a0 msgr2=0x7fd8b819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b6800640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b81070a0 0x7fd8b819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b6800640 1 -- 172.21.15.120:0/2620403357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8b8104740 msgr2=0x7fd8b819c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b6800640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8b8104740 0x7fd8b819c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b6800640 1 -- 172.21.15.120:0/2620403357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b81a3fb0 con 0x7fd8b8109a00 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b5400640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b81070a0 0x7fd8b819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.661+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8b8104740 0x7fd8b819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.662+0000 7fd8b6800640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b81a3940 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0031920 tx=0x7fd8b0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.662+0000 7fd8aea00640 1 -- 172.21.15.120:0/2620403357 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0003cb0 con 0x7fd8b8109a00 2024-05-14T09:25:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.662+0000 7fd8aea00640 1 -- 172.21.15.120:0/2620403357 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8b0003e50 con 0x7fd8b8109a00 2024-05-14T09:25:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.662+0000 7fd8aea00640 1 -- 172.21.15.120:0/2620403357 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0030b80 con 0x7fd8b8109a00 2024-05-14T09:25:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.663+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b81a4240 con 0x7fd8b8109a00 2024-05-14T09:25:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.663+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b81a4740 con 0x7fd8b8109a00 2024-05-14T09:25:34.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.668+0000 7fd8c3c42740 1 Processor -- start 2024-05-14T09:25:34.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.669+0000 7fd8aea00640 1 -- 172.21.15.120:0/2620403357 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd8b0004040 con 0x7fd8b8109a00 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8c3c42740 1 -- start start 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad909d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cca2f0 0x556ad909de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cd24d0 0x556ad90a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556ad8ff9550 con 0x556ad8cca2f0 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556ad8f9ebc0 con 0x556ad8cd24d0 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ad8ff5510 con 0x556ad8cf31b0 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.670+0000 7fd8b5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cca2f0 0x556ad909de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cca2f0 0x556ad909de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44038/0 (socket says 172.21.15.120:44038) 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5e00640 1 -- 172.21.15.120:0/2189171994 learned_addr learned my addr 172.21.15.120:0/2189171994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:34.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5400640 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad909d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5400640 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cd24d0 0x556ad90a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5e00640 1 -- 172.21.15.120:0/2189171994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 msgr2=0x556ad909d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad909d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5e00640 1 -- 172.21.15.120:0/2189171994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cd24d0 msgr2=0x556ad90a4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cd24d0 0x556ad90a4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8b5e00640 1 -- 172.21.15.120:0/2189171994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad8d0b210 con 0x556ad8cca2f0 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.671+0000 7fd8aea00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd89c0b2860 0x7fd89c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.672+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cca2f0 0x556ad909de90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009cf0 tx=0x7fd8a80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5237e0a05cabd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.672+0000 7fd8aea00640 1 -- 172.21.15.120:0/2620403357 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd8b0103b90 con 0x7fd8b8109a00 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.672+0000 7fd8b5400640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd89c0b2860 0x7fd89c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.672+0000 7fd8a3000640 1 -- 172.21.15.120:0/2189171994 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8012450 con 0x556ad8cca2f0 2024-05-14T09:25:34.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.672+0000 7fd8a3000640 1 -- 172.21.15.120:0/2189171994 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8a8012a80 con 0x556ad8cca2f0 2024-05-14T09:25:34.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.672+0000 7fd8a3000640 1 -- 172.21.15.120:0/2189171994 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800fb20 con 0x556ad8cca2f0 2024-05-14T09:25:34.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.673+0000 7fd8c3c42740 1 -- 172.21.15.120:0/2189171994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cca2f0 msgr2=0x556ad909de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.673+0000 7fd8b5400640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd89c0b2860 0x7fd89c0b4d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009fd0 tx=0x7fd8a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:34.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.673+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cca2f0 0x556ad909de90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009cf0 tx=0x7fd8a80117b0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.674+0000 7fd8c3c42740 1 -- 172.21.15.120:0/2189171994 shutdown_connections 2024-05-14T09:25:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.674+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cd24d0 0x556ad90a4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.674+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cca2f0 0x556ad909de90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.674+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/2189171994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad909d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.674+0000 7fd8c3c42740 1 -- 172.21.15.120:0/2189171994 >> 172.21.15.120:0/2189171994 conn(0x556ad8ce7300 msgr2=0x556ad90992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.674+0000 7fd8c3c42740 1 -- 172.21.15.120:0/2189171994 shutdown_connections 2024-05-14T09:25:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.674+0000 7fd8c3c42740 1 -- 172.21.15.120:0/2189171994 wait complete. 2024-05-14T09:25:34.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 -- start start 2024-05-14T09:25:34.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 Processor -- start 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad9092a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad9097900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556ad9090720 con 0x556ad8cd24d0 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556ad8fb2660 con 0x556ad8cca2f0 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ad90908a0 con 0x556ad8cf31b0 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.675+0000 7fd8c3c42740 10 client.0 _ll_register_callbacks cb 0x556ad8f7c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.676+0000 7fd8b5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad9092a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.676+0000 7fd8b5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad9092a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44054/0 (socket says 172.21.15.120:44054) 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.676+0000 7fd8b5400640 1 -- 172.21.15.120:0/3723949751 learned_addr learned my addr 172.21.15.120:0/3723949751 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.676+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.676+0000 7fd8b6800640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad9097900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.677+0000 7fd8b5400640 1 -- 172.21.15.120:0/3723949751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 msgr2=0x556ad9097900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.677+0000 7fd8b5400640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad9097900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.677+0000 7fd8b5400640 1 -- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 msgr2=0x556ad90924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.677+0000 7fd8b5400640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90924c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.677+0000 7fd8b5400640 1 -- 172.21.15.120:0/3723949751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad8dd7620 con 0x556ad8cd24d0 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.677+0000 7fd8b6800640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad9097900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.678+0000 7fd8b5400640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad9092a00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009860 tx=0x7fd8a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866889c358b8f0c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.678+0000 7fd897400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.678+0000 7fd897400640 1 -- 172.21.15.120:0/3723949751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4010c70 con 0x556ad8cd24d0 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.678+0000 7fd897400640 1 -- 172.21.15.120:0/3723949751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd8a4029470 con 0x556ad8cd24d0 2024-05-14T09:25:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.678+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a8012a80 con 0x556ad8cd24d0 2024-05-14T09:25:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.679+0000 7fd897400640 1 -- 172.21.15.120:0/3723949751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd8a4010e10 con 0x556ad8cd24d0 2024-05-14T09:25:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.679+0000 7fd8c3c42740 10 client.15729 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.679+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556ad90ba0c0 con 0x556ad8cd24d0 2024-05-14T09:25:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.679+0000 7fd897400640 1 -- 172.21.15.120:0/3723949751 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8a8012a80 con 0x556ad8cd24d0 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.680+0000 7fd897400640 1 -- 172.21.15.120:0/3723949751 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fd8a401c030 con 0x556ad8cd24d0 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.680+0000 7fd8c3c42740 10 client.15729 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.680+0000 7fd8c3c42740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.680+0000 7fd8c3c42740 20 client.15729 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.681+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8cb1d80 0x556ad90bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.681+0000 7fd8c3c42740 4 client.15729 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.681+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ad9007160 con 0x556ad8cb1d80 2024-05-14T09:25:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.681+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8cb1d80 0x556ad90bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.682+0000 7fd897400640 10 client.15729 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:34.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.682+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8cb1d80 0x556ad90bd8c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bf658c564a480fd server_cookie=835eefa40e1483b4 in_seq=0 out_seq=0 2024-05-14T09:25:34.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.684+0000 7fd897400640 1 -- 172.21.15.120:0/3723949751 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556ad9007160 con 0x556ad8cb1d80 2024-05-14T09:25:34.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.684+0000 7fd897400640 10 client.15729 handle_command_reply: tid=0 2024-05-14T09:25:34.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.684+0000 7fd8c3c42740 1 client.15729 shutdown 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 msgr2=0x556ad9092a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad9092a00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009860 tx=0x7fd8a40046c0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 shutdown_connections 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8cb1d80 0x556ad90bd8c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad9097900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad9092a00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd897400640 0 client.15729 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/3723949751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 >> 172.21.15.120:0/3723949751 conn(0x556ad8ce7300 msgr2=0x556ad909c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 shutdown_connections 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.685+0000 7fd8c3c42740 1 -- 172.21.15.120:0/3723949751 wait complete. 2024-05-14T09:25:34.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.686+0000 7fd8c3c42740 20 client.15729 trim_cache size 0 max 16384 2024-05-14T09:25:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 Processor -- start 2024-05-14T09:25:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 -- start start 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad9097f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cd24d0 0x556ad9098c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cf31b0 0x556ad90991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b81aa810 con 0x556ad8cf31b0 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b81ac440 con 0x556ad8cca2f0 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.710+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b81aaee0 con 0x556ad8cd24d0 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cf31b0 0x556ad90991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cf31b0 0x556ad90991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44066/0 (socket says 172.21.15.120:44066) 2024-05-14T09:25:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 -- 172.21.15.120:0/280912808 learned_addr learned my addr 172.21.15.120:0/280912808 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad9097f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b5400640 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cd24d0 0x556ad9098c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 -- 172.21.15.120:0/280912808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cd24d0 msgr2=0x556ad9098c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cd24d0 0x556ad9098c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 -- 172.21.15.120:0/280912808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 msgr2=0x556ad9097f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad9097f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 -- 172.21.15.120:0/280912808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad908c280 con 0x556ad8cf31b0 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.711+0000 7fd8b6800640 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cf31b0 0x556ad90991a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00c6e90 tx=0x7fd8b00c6e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1284f40b66ae66 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.712+0000 7fd8a2600640 1 -- 172.21.15.120:0/280912808 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00cae10 con 0x556ad8cf31b0 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.712+0000 7fd8a2600640 1 -- 172.21.15.120:0/280912808 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8b0036030 con 0x556ad8cf31b0 2024-05-14T09:25:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.712+0000 7fd8a2600640 1 -- 172.21.15.120:0/280912808 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00c70a0 con 0x556ad8cf31b0 2024-05-14T09:25:34.714 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 -- 172.21.15.120:0/280912808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cf31b0 msgr2=0x556ad90991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.714 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cf31b0 0x556ad90991a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00c6e90 tx=0x7fd8b00c6e00 comp rx=0 tx=0).stop 2024-05-14T09:25:34.714 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 -- 172.21.15.120:0/280912808 shutdown_connections 2024-05-14T09:25:34.714 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cf31b0 0x556ad90991a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cd24d0 0x556ad9098c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/280912808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad9097f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 -- 172.21.15.120:0/280912808 >> 172.21.15.120:0/280912808 conn(0x556ad8ce7300 msgr2=0x556ad9097820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 -- 172.21.15.120:0/280912808 shutdown_connections 2024-05-14T09:25:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.713+0000 7fd8c3c42740 1 -- 172.21.15.120:0/280912808 wait complete. 2024-05-14T09:25:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.714+0000 7fd8c3c42740 1 -- start start 2024-05-14T09:25:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.714+0000 7fd8c3c42740 1 Processor -- start 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad90ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8c3c42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad90cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b81abcb0 con 0x556ad8cd24d0 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b81ab5e0 con 0x556ad8cca2f0 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8c3c42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b81a8810 con 0x556ad8cf31b0 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8c3c42740 10 client.0 _ll_register_callbacks cb 0x7fd8a4009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8b5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad90ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8b5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad90ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44072/0 (socket says 172.21.15.120:44072) 2024-05-14T09:25:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8b5400640 1 -- 172.21.15.120:0/4030719380 learned_addr learned my addr 172.21.15.120:0/4030719380 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.715+0000 7fd8b6800640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad90cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd8b5400640 1 -- 172.21.15.120:0/4030719380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 msgr2=0x556ad90cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd8b5400640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad90cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd8b5400640 1 -- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 msgr2=0x556ad90cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd8b5400640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd8b5400640 1 -- 172.21.15.120:0/4030719380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad90ce4b0 con 0x556ad8cd24d0 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd8b6800640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad90cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd8b5400640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad90ccfc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40059f0 tx=0x7fd8a40294f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9513bcd531583aad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd897400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.716+0000 7fd897400640 1 -- 172.21.15.120:0/4030719380 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a403c440 con 0x556ad8cd24d0 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.717+0000 7fd897400640 1 -- 172.21.15.120:0/4030719380 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd8a403c5e0 con 0x556ad8cd24d0 2024-05-14T09:25:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.717+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8b0036030 con 0x556ad8cd24d0 2024-05-14T09:25:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.717+0000 7fd897400640 1 -- 172.21.15.120:0/4030719380 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd8a4045050 con 0x556ad8cd24d0 2024-05-14T09:25:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.717+0000 7fd8c3c42740 10 client.15735 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.717+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556ad9125a20 con 0x556ad8cd24d0 2024-05-14T09:25:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.717+0000 7fd897400640 1 -- 172.21.15.120:0/4030719380 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8b0036030 con 0x556ad8cd24d0 2024-05-14T09:25:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.718+0000 7fd897400640 1 -- 172.21.15.120:0/4030719380 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fd8a403a020 con 0x556ad8cd24d0 2024-05-14T09:25:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.719+0000 7fd8c3c42740 10 client.15735 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.719+0000 7fd8c3c42740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.719+0000 7fd8c3c42740 20 client.15735 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.719+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8c871c0 0x556ad91284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.719+0000 7fd8c3c42740 4 client.15735 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:25:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.719+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ad9000fd0 con 0x556ad8c871c0 2024-05-14T09:25:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.719+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8c871c0 0x556ad91284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.721+0000 7fd8b5e00640 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8c871c0 0x556ad91284a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c1a45b5b144b780 server_cookie=687de5d7a1036a38 in_seq=0 out_seq=0 2024-05-14T09:25:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.721+0000 7fd897400640 10 client.15735 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.756+0000 7fd897400640 1 -- 172.21.15.120:0/4030719380 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ad9000fd0 con 0x556ad8c871c0 2024-05-14T09:25:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.756+0000 7fd897400640 10 client.15735 handle_command_reply: tid=0 2024-05-14T09:25:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.756+0000 7fd8c3c42740 1 client.15735 shutdown 2024-05-14T09:25:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.756+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 msgr2=0x556ad90ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.756+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad90ccfc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40059f0 tx=0x7fd8a40294f0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.756+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 shutdown_connections 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.756+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556ad8c871c0 0x556ad91284a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ad8cf31b0 0x556ad90cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd897400640 0 client.15735 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ad8cd24d0 0x556ad90ccfc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd8c3c42740 1 --2- 172.21.15.120:0/4030719380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ad8cca2f0 0x556ad90cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 >> 172.21.15.120:0/4030719380 conn(0x556ad8ce7300 msgr2=0x556ad9097820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 shutdown_connections 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd8c3c42740 1 -- 172.21.15.120:0/4030719380 wait complete. 2024-05-14T09:25:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.757+0000 7fd8c3c42740 20 client.15735 trim_cache size 0 max 16384 2024-05-14T09:25:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:25:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:25:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:25:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:25:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd89c0b2860 msgr2=0x7fd89c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd89c0b2860 0x7fd89c0b4d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009fd0 tx=0x7fd8a4005f90 comp rx=0 tx=0).stop 2024-05-14T09:25:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 msgr2=0x7fd8b81a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b81a3940 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0031920 tx=0x7fd8b0009880 comp rx=0 tx=0).stop 2024-05-14T09:25:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 shutdown_connections 2024-05-14T09:25:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd89c0b2860 0x7fd89c0b4d70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b8109a00 0x7fd8b81a3940 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b81070a0 0x7fd8b819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 --2- 172.21.15.120:0/2620403357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8b8104740 0x7fd8b819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.758+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 >> 172.21.15.120:0/2620403357 conn(0x7fd8b80fdd40 msgr2=0x7fd8b81087f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.759+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 shutdown_connections 2024-05-14T09:25:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:34.759+0000 7fd8bcc00640 1 -- 172.21.15.120:0/2620403357 wait complete. 2024-05-14T09:25:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.587+0000 7f1728600700 1 -- 172.21.15.120:0/3812703760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1720107df0 msgr2=0x7f1720108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.587+0000 7f1728600700 1 --2- 172.21.15.120:0/3812703760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1720107df0 0x7f1720108200 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f17140099c0 tx=0x7f1714009cd0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.588+0000 7f1728600700 1 -- 172.21.15.120:0/3812703760 shutdown_connections 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.588+0000 7f1728600700 1 --2- 172.21.15.120:0/3812703760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1720108740 0x7f17201100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.588+0000 7f1728600700 1 --2- 172.21.15.120:0/3812703760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17201034c0 0x7f17201038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.588+0000 7f1728600700 1 --2- 172.21.15.120:0/3812703760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1720107df0 0x7f1720108200 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.588+0000 7f1728600700 1 -- 172.21.15.120:0/3812703760 >> 172.21.15.120:0/3812703760 conn(0x7f17200fedc0 msgr2=0x7f17201011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.588+0000 7f1728600700 1 -- 172.21.15.120:0/3812703760 shutdown_connections 2024-05-14T09:25:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.588+0000 7f1728600700 1 -- 172.21.15.120:0/3812703760 wait complete. 2024-05-14T09:25:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.589+0000 7f1728600700 1 Processor -- start 2024-05-14T09:25:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1728600700 1 -- start start 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1728600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17201034c0 0x7f172019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1728600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1720107df0 0x7f172019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1728600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1720108740 0x7f17201a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1728600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1720113250 con 0x7f17201034c0 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1728600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17201130d0 con 0x7f1720107df0 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1728600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17201133d0 con 0x7f1720108740 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17201034c0 0x7f172019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17201034c0 0x7f172019cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44088/0 (socket says 172.21.15.120:44088) 2024-05-14T09:25:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.590+0000 7f1725c00700 1 -- 172.21.15.120:0/1497560820 learned_addr learned my addr 172.21.15.120:0/1497560820 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:35.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1726600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1720108740 0x7f17201a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1725200700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1720107df0 0x7f172019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1725c00700 1 -- 172.21.15.120:0/1497560820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1720108740 msgr2=0x7f17201a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1725c00700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1720108740 0x7f17201a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1725c00700 1 -- 172.21.15.120:0/1497560820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1720107df0 msgr2=0x7f172019d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1725c00700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1720107df0 0x7f172019d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1725c00700 1 -- 172.21.15.120:0/1497560820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17201a1e10 con 0x7f17201034c0 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1726600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1720108740 0x7f17201a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.591+0000 7f1725200700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1720107df0 0x7f172019d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.592+0000 7f1725c00700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17201034c0 0x7f172019cf90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f171000d950 tx=0x7f171000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:35.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.592+0000 7f171e000700 1 -- 172.21.15.120:0/1497560820 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710016070 con 0x7f17201034c0 2024-05-14T09:25:35.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.592+0000 7f171e000700 1 -- 172.21.15.120:0/1497560820 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1710010460 con 0x7f17201034c0 2024-05-14T09:25:35.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.592+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17201a2100 con 0x7f17201034c0 2024-05-14T09:25:35.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.592+0000 7f171e000700 1 -- 172.21.15.120:0/1497560820 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171000f620 con 0x7f17201034c0 2024-05-14T09:25:35.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.592+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17201a9a20 con 0x7f17201034c0 2024-05-14T09:25:35.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.596+0000 7f171e000700 1 -- 172.21.15.120:0/1497560820 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1710019070 con 0x7f17201034c0 2024-05-14T09:25:35.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.597+0000 7f17370c8b80 1 Processor -- start 2024-05-14T09:25:35.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f17370c8b80 1 -- start start 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f171e000700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17080b2880 0x7f17080b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d8026de40 0x557d803f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803f1830 0x557d803eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d803eb9f0 0x557d803ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f17370c8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557d8030da20 con 0x557d803eb9f0 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f17370c8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557d802ab760 con 0x557d803f1830 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f17370c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d803099e0 con 0x557d8026de40 2024-05-14T09:25:35.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.598+0000 7f171e000700 1 -- 172.21.15.120:0/1497560820 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f17100e21f0 con 0x7f17201034c0 2024-05-14T09:25:35.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1725c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d8026de40 0x557d803f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d803eb9f0 0x557d803ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d803eb9f0 0x557d803ebe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44100/0 (socket says 172.21.15.120:44100) 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 -- 172.21.15.120:0/1086744024 learned_addr learned my addr 172.21.15.120:0/1086744024 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1725200700 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803f1830 0x557d803eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17080b2880 0x7f17080b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 -- 172.21.15.120:0/1086744024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d8026de40 msgr2=0x557d803f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d8026de40 0x557d803f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 -- 172.21.15.120:0/1086744024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803f1830 msgr2=0x557d803eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803f1830 0x557d803eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.599+0000 7f1726600700 1 -- 172.21.15.120:0/1086744024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d8025a8d0 con 0x557d803eb9f0 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.600+0000 7f1725200700 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803f1830 0x557d803eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:35.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.600+0000 7f1726600700 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d803eb9f0 0x557d803ebe00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f17180060b0 tx=0x7f1718007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c82f529a174d9b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.600+0000 7f1726600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17080b2880 0x7f17080b4d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1718007fd0 tx=0x7f171801b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.600+0000 7f170ea00700 1 -- 172.21.15.120:0/1086744024 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718019670 con 0x557d803eb9f0 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.601+0000 7f170ea00700 1 -- 172.21.15.120:0/1086744024 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f171801d070 con 0x557d803eb9f0 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.601+0000 7f170ea00700 1 -- 172.21.15.120:0/1086744024 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718023700 con 0x557d803eb9f0 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 -- 172.21.15.120:0/1086744024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d803eb9f0 msgr2=0x557d803ebe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d803eb9f0 0x557d803ebe00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f17180060b0 tx=0x7f1718007d20 comp rx=0 tx=0).stop 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 -- 172.21.15.120:0/1086744024 shutdown_connections 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d803eb9f0 0x557d803ebe00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d8026de40 0x557d803f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1086744024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803f1830 0x557d803eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 -- 172.21.15.120:0/1086744024 >> 172.21.15.120:0/1086744024 conn(0x557d802b2f70 msgr2=0x557d803e62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:35.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 -- 172.21.15.120:0/1086744024 shutdown_connections 2024-05-14T09:25:35.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.602+0000 7f17370c8b80 1 -- 172.21.15.120:0/1086744024 wait complete. 2024-05-14T09:25:35.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.603+0000 7f17370c8b80 1 -- start start 2024-05-14T09:25:35.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.603+0000 7f17370c8b80 1 Processor -- start 2024-05-14T09:25:35.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.604+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.604+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d803f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.604+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d803f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.604+0000 7f17370c8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557d803f82b0 con 0x557d8026de40 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.604+0000 7f17370c8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557d80273b20 con 0x557d803eb9f0 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.604+0000 7f17370c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d803f8430 con 0x557d803f1830 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.604+0000 7f17370c8b80 10 client.0 _ll_register_callbacks cb 0x557d802b4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44112/0 (socket says 172.21.15.120:44112) 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 -- 172.21.15.120:0/1904466411 learned_addr learned my addr 172.21.15.120:0/1904466411 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1726600700 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d803f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725200700 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d803f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 -- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 msgr2=0x557d803f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d803f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 -- 172.21.15.120:0/1904466411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 msgr2=0x557d803f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d803f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.605+0000 7f1725c00700 1 -- 172.21.15.120:0/1904466411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d802d3420 con 0x557d8026de40 2024-05-14T09:25:35.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.606+0000 7f1725c00700 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803f4fb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f17100dfcc0 tx=0x7f17100a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790701c611f0999f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:35.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.606+0000 7f1703400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.606+0000 7f1703400700 1 -- 172.21.15.120:0/1904466411 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710020040 con 0x557d8026de40 2024-05-14T09:25:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.606+0000 7f1703400700 1 -- 172.21.15.120:0/1904466411 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1710010930 con 0x557d8026de40 2024-05-14T09:25:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.606+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f171801d070 con 0x557d8026de40 2024-05-14T09:25:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.607+0000 7f1703400700 1 -- 172.21.15.120:0/1904466411 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f17100a9470 con 0x557d8026de40 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.607+0000 7f17370c8b80 10 client.15747 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.607+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557d80402db0 con 0x557d8026de40 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.607+0000 7f1703400700 1 -- 172.21.15.120:0/1904466411 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f171801d070 con 0x557d8026de40 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.608+0000 7f1703400700 1 -- 172.21.15.120:0/1904466411 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f17100a96d0 con 0x557d8026de40 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.608+0000 7f17370c8b80 10 client.15747 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.608+0000 7f17370c8b80 10 client.15747 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.608+0000 7f17370c8b80 20 client.15747 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.608+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d80405340 0x557d80407780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.608+0000 7f17370c8b80 4 client.15747 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.608+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d803b81c0 con 0x557d80405340 2024-05-14T09:25:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.609+0000 7f1725200700 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d80405340 0x557d80407780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.610+0000 7f1725200700 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d80405340 0x557d80407780 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=60c8f6fc507c045d server_cookie=112b395294d41c9c in_seq=0 out_seq=0 2024-05-14T09:25:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.610+0000 7f1703400700 10 client.15747 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:25:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f1703400700 1 -- 172.21.15.120:0/1904466411 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557d803b81c0 con 0x557d80405340 2024-05-14T09:25:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f1703400700 10 client.15747 handle_command_reply: tid=0 2024-05-14T09:25:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 client.15747 shutdown 2024-05-14T09:25:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 msgr2=0x557d803f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803f4fb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f17100dfcc0 tx=0x7f17100a9000 comp rx=0 tx=0).stop 2024-05-14T09:25:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 shutdown_connections 2024-05-14T09:25:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d80405340 0x557d80407780 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d803f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803f4fb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 --2- 172.21.15.120:0/1904466411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d803f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f1703400700 0 client.15747 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:25:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.612+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 >> 172.21.15.120:0/1904466411 conn(0x557d802b2f70 msgr2=0x557d803ea4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.613+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 shutdown_connections 2024-05-14T09:25:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.613+0000 7f17370c8b80 1 -- 172.21.15.120:0/1904466411 wait complete. 2024-05-14T09:25:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.613+0000 7f17370c8b80 20 client.15747 trim_cache size 0 max 16384 2024-05-14T09:25:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.636+0000 7f17370c8b80 1 Processor -- start 2024-05-14T09:25:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.636+0000 7f17370c8b80 1 -- start start 2024-05-14T09:25:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d803f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d80401300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f17370c8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17201b2580 con 0x557d8026de40 2024-05-14T09:25:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f17370c8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17201b41b0 con 0x557d803eb9f0 2024-05-14T09:25:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f17370c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17201b2c50 con 0x557d803f1830 2024-05-14T09:25:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803eb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44118/0 (socket says 172.21.15.120:44118) 2024-05-14T09:25:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.637+0000 7f1725c00700 1 -- 172.21.15.120:0/3874138493 learned_addr learned my addr 172.21.15.120:0/3874138493 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f1726600700 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d80401300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f1725c00700 1 -- 172.21.15.120:0/3874138493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 msgr2=0x557d80401300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f1725c00700 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d80401300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f1725c00700 1 -- 172.21.15.120:0/3874138493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 msgr2=0x557d803f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f1725c00700 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d803f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f1725c00700 1 -- 172.21.15.120:0/3874138493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d803de3e0 con 0x557d8026de40 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f1725c00700 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803eb4b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f171000b2f0 tx=0x7f17100a5440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5831253624410651 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f170e000700 1 -- 172.21.15.120:0/3874138493 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710020070 con 0x557d8026de40 2024-05-14T09:25:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f170e000700 1 -- 172.21.15.120:0/3874138493 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17100ad820 con 0x557d8026de40 2024-05-14T09:25:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.638+0000 7f170e000700 1 -- 172.21.15.120:0/3874138493 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17100b0ba0 con 0x557d8026de40 2024-05-14T09:25:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.639+0000 7f17370c8b80 1 -- 172.21.15.120:0/3874138493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 msgr2=0x557d803eb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.639+0000 7f17370c8b80 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803eb4b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f171000b2f0 tx=0x7f17100a5440 comp rx=0 tx=0).stop 2024-05-14T09:25:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.639+0000 7f17370c8b80 1 -- 172.21.15.120:0/3874138493 shutdown_connections 2024-05-14T09:25:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.639+0000 7f17370c8b80 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d80401300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.639+0000 7f17370c8b80 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803eb4b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.639+0000 7f17370c8b80 1 --2- 172.21.15.120:0/3874138493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d803f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.639+0000 7f17370c8b80 1 -- 172.21.15.120:0/3874138493 >> 172.21.15.120:0/3874138493 conn(0x557d802b2f70 msgr2=0x557d803f0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.640+0000 7f17370c8b80 1 -- 172.21.15.120:0/3874138493 shutdown_connections 2024-05-14T09:25:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.640+0000 7f17370c8b80 1 -- 172.21.15.120:0/3874138493 wait complete. 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.640+0000 7f17370c8b80 1 -- start start 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 1 Processor -- start 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d8040c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d8040c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17201b3a20 con 0x557d8026de40 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17201b3350 con 0x557d803eb9f0 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17201b0540 con 0x557d803f1830 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f17370c8b80 10 client.0 _ll_register_callbacks cb 0x557d802b4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.641+0000 7f1725c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803fdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44132/0 (socket says 172.21.15.120:44132) 2024-05-14T09:25:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725c00700 1 -- 172.21.15.120:0/293529964 learned_addr learned my addr 172.21.15.120:0/293529964 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725200700 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d8040c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1726600700 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d8040c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725c00700 1 -- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 msgr2=0x557d8040c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725c00700 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d8040c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725c00700 1 -- 172.21.15.120:0/293529964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 msgr2=0x557d8040c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725c00700 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d8040c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725c00700 1 -- 172.21.15.120:0/293529964 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d8040ce60 con 0x557d8026de40 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1725c00700 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803fdac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f17100a9630 tx=0x7f1710010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97dc6827af2f4ae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.642+0000 7f1703400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.643+0000 7f1703400700 1 -- 172.21.15.120:0/293529964 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710020070 con 0x557d8026de40 2024-05-14T09:25:35.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.643+0000 7f1703400700 1 -- 172.21.15.120:0/293529964 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f17100b0db0 con 0x557d8026de40 2024-05-14T09:25:35.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.643+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17100ad820 con 0x557d8026de40 2024-05-14T09:25:35.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.643+0000 7f1703400700 1 -- 172.21.15.120:0/293529964 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f17100b22d0 con 0x557d8026de40 2024-05-14T09:25:35.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.643+0000 7f17370c8b80 10 client.15753 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:35.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.643+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557d80478020 con 0x557d8026de40 2024-05-14T09:25:35.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.643+0000 7f1703400700 1 -- 172.21.15.120:0/293529964 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17100ad820 con 0x557d8026de40 2024-05-14T09:25:35.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.644+0000 7f1703400700 1 -- 172.21.15.120:0/293529964 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f17100a86d0 con 0x557d8026de40 2024-05-14T09:25:35.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.644+0000 7f17370c8b80 10 client.15753 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:35.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.644+0000 7f17370c8b80 10 client.15753 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:25:35.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.644+0000 7f17370c8b80 20 client.15753 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:35.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.644+0000 7f17370c8b80 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d804782a0 0x557d8047a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:35.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.644+0000 7f17370c8b80 4 client.15753 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:25:35.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.644+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d8031b400 con 0x557d804782a0 2024-05-14T09:25:35.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.645+0000 7f1725200700 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d804782a0 0x557d8047a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:35.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.646+0000 7f1703400700 10 client.15753 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:25:35.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.646+0000 7f1725200700 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d804782a0 0x557d8047a6c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=595b76fa2253f62b server_cookie=7f756950ecd6af66 in_seq=0 out_seq=0 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.646+0000 7f1703400700 1 -- 172.21.15.120:0/293529964 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d8031b400 con 0x557d804782a0 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.646+0000 7f1703400700 10 client.15753 handle_command_reply: tid=0 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.646+0000 7f17370c8b80 1 client.15753 shutdown 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.646+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 msgr2=0x557d803fdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.646+0000 7f17370c8b80 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803fdac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f17100a9630 tx=0x7f1710010c40 comp rx=0 tx=0).stop 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 shutdown_connections 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x557d804782a0 0x557d8047a6c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d803f1830 0x557d8040c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d8026de40 0x557d803fdac0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 --2- 172.21.15.120:0/293529964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d803eb9f0 0x557d8040c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 >> 172.21.15.120:0/293529964 conn(0x557d802b2f70 msgr2=0x557d803e00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:35.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f1703400700 0 client.15753 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:25:35.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 shutdown_connections 2024-05-14T09:25:35.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 1 -- 172.21.15.120:0/293529964 wait complete. 2024-05-14T09:25:35.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.647+0000 7f17370c8b80 20 client.15753 trim_cache size 0 max 16384 2024-05-14T09:25:35.649 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:25:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17080b2880 msgr2=0x7f17080b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17080b2880 0x7f17080b4d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1718007fd0 tx=0x7f171801b000 comp rx=0 tx=0).stop 2024-05-14T09:25:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17201034c0 msgr2=0x7f172019cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17201034c0 0x7f172019cf90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f171000d950 tx=0x7f171000dd10 comp rx=0 tx=0).stop 2024-05-14T09:25:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 shutdown_connections 2024-05-14T09:25:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f17080b2880 0x7f17080b4d90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1720108740 0x7f17201a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17201034c0 0x7f172019cf90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 --2- 172.21.15.120:0/1497560820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1720107df0 0x7f172019d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:35.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 >> 172.21.15.120:0/1497560820 conn(0x7f17200fedc0 msgr2=0x7f1720109880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:35.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 shutdown_connections 2024-05-14T09:25:35.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:35.648+0000 7f1728600700 1 -- 172.21.15.120:0/1497560820 wait complete. 2024-05-14T09:25:35.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:35 smithi120 ceph-mon[31085]: pgmap v617: 129 pgs: 129 active+clean; 401 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 23 op/s 2024-05-14T09:25:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:35 smithi152 ceph-mon[34868]: pgmap v617: 129 pgs: 129 active+clean; 401 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 23 op/s 2024-05-14T09:25:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:35 smithi175 ceph-mon[35353]: pgmap v617: 129 pgs: 129 active+clean; 401 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 23 op/s 2024-05-14T09:25:36.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T09:25:37.003 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:1800000 of 3200000 tuples (56%) done (elapsed 65.08 s, remaining 50.62 s) 2024-05-14T09:25:37.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:37 smithi120 ceph-mon[31085]: pgmap v618: 129 pgs: 129 active+clean; 416 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 30 op/s 2024-05-14T09:25:37.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:37 smithi152 ceph-mon[34868]: pgmap v618: 129 pgs: 129 active+clean; 416 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 30 op/s 2024-05-14T09:25:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:37 smithi175 ceph-mon[35353]: pgmap v618: 129 pgs: 129 active+clean; 416 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 30 op/s 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.513+0000 7fbf1ca00700 1 -- 172.21.15.120:0/662574362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18109870 msgr2=0x7fbf181111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.513+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/662574362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18109870 0x7fbf181111d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000b0d0 tx=0x7fbf1000b3e0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.513+0000 7fbf1ca00700 1 -- 172.21.15.120:0/662574362 shutdown_connections 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.513+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/662574362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf181045f0 0x7fbf18104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.513+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/662574362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18109870 0x7fbf181111d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.513+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/662574362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf18108f20 0x7fbf18109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.513+0000 7fbf1ca00700 1 -- 172.21.15.120:0/662574362 >> 172.21.15.120:0/662574362 conn(0x7fbf180ffec0 msgr2=0x7fbf18102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.514+0000 7fbf1ca00700 1 -- 172.21.15.120:0/662574362 shutdown_connections 2024-05-14T09:25:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.514+0000 7fbf1ca00700 1 -- 172.21.15.120:0/662574362 wait complete. 2024-05-14T09:25:39.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.515+0000 7fbf1ca00700 1 Processor -- start 2024-05-14T09:25:39.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.515+0000 7fbf1ca00700 1 -- start start 2024-05-14T09:25:39.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf1ca00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf181045f0 0x7fbf1819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf1ca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18108f20 0x7fbf1819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf1ca00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf18109870 0x7fbf181a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf1ca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18116690 con 0x7fbf18108f20 2024-05-14T09:25:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf1ca00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18116510 con 0x7fbf181045f0 2024-05-14T09:25:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf1ca00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18116810 con 0x7fbf18109870 2024-05-14T09:25:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf15400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18108f20 0x7fbf1819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf15400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18108f20 0x7fbf1819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36648/0 (socket says 172.21.15.120:36648) 2024-05-14T09:25:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.516+0000 7fbf15400700 1 -- 172.21.15.120:0/3267553696 learned_addr learned my addr 172.21.15.120:0/3267553696 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf181045f0 0x7fbf1819d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf16800700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf18109870 0x7fbf181a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf15400700 1 -- 172.21.15.120:0/3267553696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf18109870 msgr2=0x7fbf181a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf15400700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf18109870 0x7fbf181a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf15400700 1 -- 172.21.15.120:0/3267553696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf181045f0 msgr2=0x7fbf1819d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf15400700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf181045f0 0x7fbf1819d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf15400700 1 -- 172.21.15.120:0/3267553696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf181a1f90 con 0x7fbf18108f20 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.517+0000 7fbf15400700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18108f20 0x7fbf1819d660 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400b500 tx=0x7fbf0400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.518+0000 7fbf0ea00700 1 -- 172.21.15.120:0/3267553696 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf04015020 con 0x7fbf18108f20 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.518+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf181a2280 con 0x7fbf18108f20 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.518+0000 7fbf0ea00700 1 -- 172.21.15.120:0/3267553696 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf04011cc0 con 0x7fbf18108f20 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.518+0000 7fbf0ea00700 1 -- 172.21.15.120:0/3267553696 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf04010c80 con 0x7fbf18108f20 2024-05-14T09:25:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.518+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf181a9ba0 con 0x7fbf18108f20 2024-05-14T09:25:39.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.523+0000 7fbf0ea00700 1 -- 172.21.15.120:0/3267553696 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fbf04018020 con 0x7fbf18108f20 2024-05-14T09:25:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.524+0000 7fbf2b53eb80 1 Processor -- start 2024-05-14T09:25:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.524+0000 7fbf2b53eb80 1 -- start start 2024-05-14T09:25:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.524+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f7430586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.524+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f743052710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.524+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743053060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.524+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f742f74a20 con 0x55f743052c50 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.524+0000 7fbf0ea00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbefc0b2880 0x7fbefc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f742f12760 con 0x55f743058bf0 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f742f709e0 con 0x55f742ed4e40 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf0ea00700 1 -- 172.21.15.120:0/3267553696 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fbf040e1dd0 con 0x7fbf18108f20 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf15400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743053060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf15400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743053060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36660/0 (socket says 172.21.15.120:36660) 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf15400700 1 -- 172.21.15.120:0/388432318 learned_addr learned my addr 172.21.15.120:0/388432318 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf15e00700 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f743052710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf16800700 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f7430586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf16800700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbefc0b2880 0x7fbefc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf15400700 1 -- 172.21.15.120:0/388432318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 msgr2=0x55f7430586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.525+0000 7fbf15400700 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f7430586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf15400700 1 -- 172.21.15.120:0/388432318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 msgr2=0x55f743052710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf15400700 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f743052710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf15400700 1 -- 172.21.15.120:0/388432318 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f742ec18d0 con 0x55f743052c50 2024-05-14T09:25:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf15400700 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743053060 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbf040a50d0 tx=0x7fbf040a8840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60aecf256689bcd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:39.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf03400700 1 -- 172.21.15.120:0/388432318 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf040a8b60 con 0x55f743052c50 2024-05-14T09:25:39.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf16800700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbefc0b2880 0x7fbefc0b4d90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55f743053a30 tx=0x7fbf1000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:39.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf03400700 1 -- 172.21.15.120:0/388432318 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf040a9750 con 0x55f743052c50 2024-05-14T09:25:39.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.526+0000 7fbf03400700 1 -- 172.21.15.120:0/388432318 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf040a92b0 con 0x55f743052c50 2024-05-14T09:25:39.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.527+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/388432318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 msgr2=0x55f743053060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.527+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743053060 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbf040a50d0 tx=0x7fbf040a8840 comp rx=0 tx=0).stop 2024-05-14T09:25:39.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.528+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/388432318 shutdown_connections 2024-05-14T09:25:39.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.528+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743053060 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.528+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f7430586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.528+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/388432318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f743052710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.528+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/388432318 >> 172.21.15.120:0/388432318 conn(0x55f742f13a80 msgr2=0x55f74304d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:39.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.528+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/388432318 shutdown_connections 2024-05-14T09:25:39.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.528+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/388432318 wait complete. 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.529+0000 7fbf2b53eb80 1 -- start start 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.529+0000 7fbf2b53eb80 1 Processor -- start 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.529+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f74305c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743052c50 0x55f74305c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f74305cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f74305f6c0 con 0x55f742ed4e40 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f742edab20 con 0x55f743058bf0 2024-05-14T09:25:39.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f74305f840 con 0x55f743052c50 2024-05-14T09:25:39.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf2b53eb80 10 client.0 _ll_register_callbacks cb 0x55f742f08380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:39.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf15e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f74305c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf15400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743052c50 0x55f74305c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf15e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f74305c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36672/0 (socket says 172.21.15.120:36672) 2024-05-14T09:25:39.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf15e00700 1 -- 172.21.15.120:0/4231583076 learned_addr learned my addr 172.21.15.120:0/4231583076 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:39.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.530+0000 7fbf16800700 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f74305cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf15e00700 1 -- 172.21.15.120:0/4231583076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743052c50 msgr2=0x55f74305c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf15e00700 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743052c50 0x55f74305c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf15e00700 1 -- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 msgr2=0x55f74305cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf15e00700 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f74305cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf15e00700 1 -- 172.21.15.120:0/4231583076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f742f3a420 con 0x55f742ed4e40 2024-05-14T09:25:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf16800700 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f74305cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:25:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf15e00700 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f74305c370 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800f1e0 tx=0x7fbf0800f4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3fd1c608cd6006 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbef7e00700 1 -- 172.21.15.120:0/4231583076 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08018020 con 0x55f742ed4e40 2024-05-14T09:25:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.531+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf040a9750 con 0x55f742ed4e40 2024-05-14T09:25:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.532+0000 7fbef7e00700 1 -- 172.21.15.120:0/4231583076 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fbf08014460 con 0x55f742ed4e40 2024-05-14T09:25:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.532+0000 7fbef7e00700 1 -- 172.21.15.120:0/4231583076 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbf08014660 con 0x55f742ed4e40 2024-05-14T09:25:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.532+0000 7fbf2b53eb80 10 client.15765 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.532+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f74306a320 con 0x55f742ed4e40 2024-05-14T09:25:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.532+0000 7fbef7e00700 1 -- 172.21.15.120:0/4231583076 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf040a9750 con 0x55f742ed4e40 2024-05-14T09:25:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.533+0000 7fbef7e00700 1 -- 172.21.15.120:0/4231583076 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fbf08025020 con 0x55f742ed4e40 2024-05-14T09:25:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.533+0000 7fbf2b53eb80 10 client.15765 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.533+0000 7fbf2b53eb80 10 client.15765 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:25:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.533+0000 7fbf2b53eb80 20 client.15765 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.533+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f74306c960 0x55f74306edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.533+0000 7fbf2b53eb80 4 client.15765 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.533+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f74301f070 con 0x55f74306c960 2024-05-14T09:25:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.534+0000 7fbf15400700 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f74306c960 0x55f74306edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.535+0000 7fbf15400700 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f74306c960 0x55f74306edc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db51551984121753 server_cookie=214e6daec2cca567 in_seq=0 out_seq=0 2024-05-14T09:25:39.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.535+0000 7fbef7e00700 10 client.15765 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:25:39.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbef7e00700 1 -- 172.21.15.120:0/4231583076 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f74301f070 con 0x55f74306c960 2024-05-14T09:25:39.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbef7e00700 10 client.15765 handle_command_reply: tid=0 2024-05-14T09:25:39.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 client.15765 shutdown 2024-05-14T09:25:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 msgr2=0x55f74305c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f74305c370 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800f1e0 tx=0x7fbf0800f4f0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 shutdown_connections 2024-05-14T09:25:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f74305cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f74306c960 0x55f74306edc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f74305c370 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/4231583076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743052c50 0x55f74305c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 >> 172.21.15.120:0/4231583076 conn(0x55f742f13a80 msgr2=0x55f743051700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:39.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbef7e00700 0 client.15765 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:25:39.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 shutdown_connections 2024-05-14T09:25:39.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.537+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/4231583076 wait complete. 2024-05-14T09:25:39.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.538+0000 7fbf2b53eb80 20 client.15765 trim_cache size 0 max 16384 2024-05-14T09:25:39.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 Processor -- start 2024-05-14T09:25:39.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 -- start start 2024-05-14T09:25:39.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f743052710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743052c50 0x55f743057c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743058bf0 0x55f743068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181b2750 con 0x55f742ed4e40 2024-05-14T09:25:39.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181b4380 con 0x55f743052c50 2024-05-14T09:25:39.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.556+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181b2e20 con 0x55f743058bf0 2024-05-14T09:25:39.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f743052710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f743052710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36680/0 (socket says 172.21.15.120:36680) 2024-05-14T09:25:39.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 -- 172.21.15.120:0/3106001432 learned_addr learned my addr 172.21.15.120:0/3106001432 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15400700 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743052c50 0x55f743057c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf16800700 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743058bf0 0x55f743068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 -- 172.21.15.120:0/3106001432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743058bf0 msgr2=0x55f743068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743058bf0 0x55f743068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 -- 172.21.15.120:0/3106001432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743052c50 msgr2=0x55f743057c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743052c50 0x55f743057c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.557+0000 7fbf15e00700 1 -- 172.21.15.120:0/3106001432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74305d430 con 0x55f742ed4e40 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.558+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f743052710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbf0801bd60 tx=0x7fbf08000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522b839f84f0057d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.558+0000 7fbf02a00700 1 -- 172.21.15.120:0/3106001432 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08014660 con 0x55f742ed4e40 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.558+0000 7fbf02a00700 1 -- 172.21.15.120:0/3106001432 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf0800fe30 con 0x55f742ed4e40 2024-05-14T09:25:39.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.558+0000 7fbf02a00700 1 -- 172.21.15.120:0/3106001432 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08012cc0 con 0x55f742ed4e40 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3106001432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 msgr2=0x55f743052710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f743052710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbf0801bd60 tx=0x7fbf08000bc0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3106001432 shutdown_connections 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f743058bf0 0x55f743068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f742ed4e40 0x55f743052710 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3106001432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743052c50 0x55f743057c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3106001432 >> 172.21.15.120:0/3106001432 conn(0x55f742f13a80 msgr2=0x55f7430574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3106001432 shutdown_connections 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.559+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3106001432 wait complete. 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.560+0000 7fbf2b53eb80 1 -- start start 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.560+0000 7fbf2b53eb80 1 Processor -- start 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f743064a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743064fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf2b53eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f7430735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181b3bf0 con 0x55f743052c50 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181b3520 con 0x55f743058bf0 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf2b53eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181b0690 con 0x55f742ed4e40 2024-05-14T09:25:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf2b53eb80 10 client.0 _ll_register_callbacks cb 0x55f742f08380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf15400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743064fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf15400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743064fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36692/0 (socket says 172.21.15.120:36692) 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf15400700 1 -- 172.21.15.120:0/3644989970 learned_addr learned my addr 172.21.15.120:0/3644989970 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f743064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.561+0000 7fbf16800700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f7430735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf15400700 1 -- 172.21.15.120:0/3644989970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 msgr2=0x55f743064a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf15400700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f743064a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf15400700 1 -- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 msgr2=0x55f7430735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf15400700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f7430735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf15400700 1 -- 172.21.15.120:0/3644989970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f743073af0 con 0x55f743052c50 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f743064a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf15400700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743064fd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbf04011f90 tx=0x7fbf04004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec3021b2e751cd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbef7e00700 1 -- 172.21.15.120:0/3644989970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf040a9050 con 0x55f743052c50 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbef7e00700 1 -- 172.21.15.120:0/3644989970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fbf040a92b0 con 0x55f743052c50 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.562+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf0800fe30 con 0x55f743052c50 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbef7e00700 1 -- 172.21.15.120:0/3644989970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbf040b1eb0 con 0x55f743052c50 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 10 client.15771 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f7430d6760 con 0x55f743052c50 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbef7e00700 1 -- 172.21.15.120:0/3644989970 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf0800fe30 con 0x55f743052c50 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbef7e00700 1 -- 172.21.15.120:0/3644989970 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fbf040a83d0 con 0x55f743052c50 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 10 client.15771 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 10 client.15771 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 20 client.15771 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f7430d69f0 0x55f7430d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 4 client.15771 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.563+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f742f82400 con 0x55f7430d69f0 2024-05-14T09:25:39.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.564+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f7430d69f0 0x55f7430d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.565+0000 7fbf15e00700 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f7430d69f0 0x55f7430d8e10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89dc21c67eecafd5 server_cookie=3ecc01200b8cb89c in_seq=0 out_seq=0 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.565+0000 7fbef7e00700 10 client.15771 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbef7e00700 1 -- 172.21.15.120:0/3644989970 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f742f82400 con 0x55f7430d69f0 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbef7e00700 10 client.15771 handle_command_reply: tid=0 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 client.15771 shutdown 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 msgr2=0x55f743064fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743064fd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbf04011f90 tx=0x7fbf04004860 comp rx=0 tx=0).stop 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 shutdown_connections 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f743058bf0 0x55f7430735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x55f7430d69f0 0x55f7430d8e10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f742ed4e40 0x55f743064a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 --2- 172.21.15.120:0/3644989970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f743052c50 0x55f743064fd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbef7e00700 0 client.15771 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:25:39.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 >> 172.21.15.120:0/3644989970 conn(0x55f742f13a80 msgr2=0x55f7430560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:39.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 shutdown_connections 2024-05-14T09:25:39.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.566+0000 7fbf2b53eb80 1 -- 172.21.15.120:0/3644989970 wait complete. 2024-05-14T09:25:39.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf2b53eb80 20 client.15771 trim_cache size 0 max 16384 2024-05-14T09:25:39.568 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:25:39.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbefc0b2880 msgr2=0x7fbefc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbefc0b2880 0x7fbefc0b4d90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55f743053a30 tx=0x7fbf1000b040 comp rx=0 tx=0).stop 2024-05-14T09:25:39.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18108f20 msgr2=0x7fbf1819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:39.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18108f20 0x7fbf1819d660 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400b500 tx=0x7fbf0400b8c0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 shutdown_connections 2024-05-14T09:25:39.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbefc0b2880 0x7fbefc0b4d90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf181045f0 0x7fbf1819d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf18109870 0x7fbf181a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 --2- 172.21.15.120:0/3267553696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf18108f20 0x7fbf1819d660 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.567+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 >> 172.21.15.120:0/3267553696 conn(0x7fbf180ffec0 msgr2=0x7fbf181022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.568+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 shutdown_connections 2024-05-14T09:25:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:39.568+0000 7fbf1ca00700 1 -- 172.21.15.120:0/3267553696 wait complete. 2024-05-14T09:25:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:39 smithi120 ceph-mon[31085]: pgmap v619: 129 pgs: 129 active+clean; 432 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 29 op/s 2024-05-14T09:25:39.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:39 smithi152 ceph-mon[34868]: pgmap v619: 129 pgs: 129 active+clean; 432 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 29 op/s 2024-05-14T09:25:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:39 smithi175 ceph-mon[35353]: pgmap v619: 129 pgs: 129 active+clean; 432 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 29 op/s 2024-05-14T09:25:40.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T09:25:40.959 INFO:teuthology.orchestra.run.smithi120.stderr:1900000 of 3200000 tuples (59%) done (elapsed 68.18 s, remaining 46.65 s) 2024-05-14T09:25:41.031 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:41.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:41 smithi120 ceph-mon[31085]: pgmap v620: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 33 op/s 2024-05-14T09:25:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:41 smithi175 ceph-mon[35353]: pgmap v620: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 33 op/s 2024-05-14T09:25:42.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:41 smithi152 ceph-mon[34868]: pgmap v620: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 33 op/s 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.541+0000 7f4d0c600700 1 -- 172.21.15.120:0/752334436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d041054e0 msgr2=0x7f4d041058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.541+0000 7f4d0c600700 1 --2- 172.21.15.120:0/752334436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d041054e0 0x7f4d041058f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009990 tx=0x7f4cf8009ca0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.541+0000 7f4d0c600700 1 -- 172.21.15.120:0/752334436 shutdown_connections 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.541+0000 7f4d0c600700 1 --2- 172.21.15.120:0/752334436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d0410e910 0x7f4d04110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.541+0000 7f4d0c600700 1 --2- 172.21.15.120:0/752334436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d041054e0 0x7f4d041058f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.541+0000 7f4d0c600700 1 --2- 172.21.15.120:0/752334436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d04105e30 0x7f4d0410e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.541+0000 7f4d0c600700 1 -- 172.21.15.120:0/752334436 >> 172.21.15.120:0/752334436 conn(0x7f4d040fedc0 msgr2=0x7f4d041011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.542+0000 7f4d0c600700 1 -- 172.21.15.120:0/752334436 shutdown_connections 2024-05-14T09:25:43.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.542+0000 7f4d0c600700 1 -- 172.21.15.120:0/752334436 wait complete. 2024-05-14T09:25:43.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.543+0000 7f4d0c600700 1 Processor -- start 2024-05-14T09:25:43.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.543+0000 7f4d0c600700 1 -- start start 2024-05-14T09:25:43.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.544+0000 7f4d0c600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d041054e0 0x7f4d041031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.544+0000 7f4d0c600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d04105e30 0x7f4d04103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.544+0000 7f4d0c600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d0410e910 0x7f4d04103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.544+0000 7f4d0c600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4d04114330 con 0x7f4d04105e30 2024-05-14T09:25:43.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.544+0000 7f4d0c600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4d041141b0 con 0x7f4d0410e910 2024-05-14T09:25:43.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.544+0000 7f4d0c600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d041144b0 con 0x7f4d041054e0 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.544+0000 7f4d09200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d04105e30 0x7f4d04103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d04105e30 0x7f4d04103710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36712/0 (socket says 172.21.15.120:36712) 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09200700 1 -- 172.21.15.120:0/3533432324 learned_addr learned my addr 172.21.15.120:0/3533432324 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09c00700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d041054e0 0x7f4d041031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d0a600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d0410e910 0x7f4d04103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09200700 1 -- 172.21.15.120:0/3533432324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d041054e0 msgr2=0x7f4d041031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09200700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d041054e0 0x7f4d041031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09200700 1 -- 172.21.15.120:0/3533432324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d0410e910 msgr2=0x7f4d04103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09200700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d0410e910 0x7f4d04103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d09200700 1 -- 172.21.15.120:0/3533432324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d041a9030 con 0x7f4d04105e30 2024-05-14T09:25:43.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.545+0000 7f4d0a600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d0410e910 0x7f4d04103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:43.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.546+0000 7f4d09200700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d04105e30 0x7f4d04103710 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000d950 tx=0x7f4cf000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:43.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.546+0000 7f4d02000700 1 -- 172.21.15.120:0/3533432324 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0016070 con 0x7f4d04105e30 2024-05-14T09:25:43.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.546+0000 7f4d02000700 1 -- 172.21.15.120:0/3533432324 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf0009dd0 con 0x7f4d04105e30 2024-05-14T09:25:43.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.546+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d041a9320 con 0x7f4d04105e30 2024-05-14T09:25:43.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.546+0000 7f4d02000700 1 -- 172.21.15.120:0/3533432324 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf000f3c0 con 0x7f4d04105e30 2024-05-14T09:25:43.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.546+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d041a98b0 con 0x7f4d04105e30 2024-05-14T09:25:43.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.550+0000 7f4d02000700 1 -- 172.21.15.120:0/3533432324 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4cf0019070 con 0x7f4d04105e30 2024-05-14T09:25:43.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.552+0000 7f4d1b19fb80 1 Processor -- start 2024-05-14T09:25:43.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.552+0000 7f4d02000700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4cec0b2900 0x7f4cec0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.552+0000 7f4d1b19fb80 1 -- start start 2024-05-14T09:25:43.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d02000700 1 -- 172.21.15.120:0/3533432324 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4cf00e20f0 con 0x7f4d04105e30 2024-05-14T09:25:43.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d0a600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4cec0b2900 0x7f4cec0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x56449569f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5644955c1a20 con 0x5644956a5bf0 2024-05-14T09:25:43.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56449555f760 con 0x564495521e40 2024-05-14T09:25:43.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5644955bd9e0 con 0x56449569fc50 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.553+0000 7f4d09200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x56449569f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x56449569f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36718/0 (socket says 172.21.15.120:36718) 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09200700 1 -- 172.21.15.120:0/3201027227 learned_addr learned my addr 172.21.15.120:0/3201027227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09c00700 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d0a600700 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d0a600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4cec0b2900 0x7f4cec0b4e10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00e270 tx=0x7f4cfc00e630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09200700 1 -- 172.21.15.120:0/3201027227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 msgr2=0x5644956a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09200700 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09200700 1 -- 172.21.15.120:0/3201027227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 msgr2=0x5644956a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09200700 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.554+0000 7f4d09200700 1 -- 172.21.15.120:0/3201027227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449550e8d0 con 0x5644956a5bf0 2024-05-14T09:25:43.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.555+0000 7f4d09200700 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x56449569f710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009520 tx=0x7f4cf00a9a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c85ca7415483d37 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:43.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.555+0000 7f4cf6a00700 1 -- 172.21.15.120:0/3201027227 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0020070 con 0x5644956a5bf0 2024-05-14T09:25:43.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.555+0000 7f4cf6a00700 1 -- 172.21.15.120:0/3201027227 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf00ad6c0 con 0x5644956a5bf0 2024-05-14T09:25:43.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.555+0000 7f4cf6a00700 1 -- 172.21.15.120:0/3201027227 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00ad170 con 0x5644956a5bf0 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.556+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/3201027227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 msgr2=0x56449569f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.556+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x56449569f710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009520 tx=0x7f4cf00a9a10 comp rx=0 tx=0).stop 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/3201027227 shutdown_connections 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/3201027227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x56449569f710 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/3201027227 >> 172.21.15.120:0/3201027227 conn(0x564495560a80 msgr2=0x56449569a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:43.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/3201027227 shutdown_connections 2024-05-14T09:25:43.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/3201027227 wait complete. 2024-05-14T09:25:43.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.557+0000 7f4d1b19fb80 1 -- start start 2024-05-14T09:25:43.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 1 Processor -- start 2024-05-14T09:25:43.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56449569fc50 0x5644956a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 0x5644956a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5644956ac660 con 0x56449569fc50 2024-05-14T09:25:43.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564495527b20 con 0x564495521e40 2024-05-14T09:25:43.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5644956ac7e0 con 0x5644956a5bf0 2024-05-14T09:25:43.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.558+0000 7f4d1b19fb80 10 client.0 _ll_register_callbacks cb 0x564495555380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:43.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56449569fc50 0x5644956a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56449569fc50 0x5644956a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36730/0 (socket says 172.21.15.120:36730) 2024-05-14T09:25:43.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 -- 172.21.15.120:0/2459179956 learned_addr learned my addr 172.21.15.120:0/2459179956 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:43.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09c00700 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 -- 172.21.15.120:0/2459179956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 msgr2=0x5644956a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 0x5644956a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 -- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 msgr2=0x5644956a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.559+0000 7f4d09200700 1 -- 172.21.15.120:0/2459179956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564495587420 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4d09200700 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56449569fc50 0x5644956a9980 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00a9970 tx=0x7f4cf00b2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2681bb1a043f0e50 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4ceb400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4ceb400700 1 -- 172.21.15.120:0/2459179956 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0020070 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4ceb400700 1 -- 172.21.15.120:0/2459179956 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4cf00a8570 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cf00ad6c0 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4ceb400700 1 -- 172.21.15.120:0/2459179956 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4cf00a8770 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4d1b19fb80 10 client.15783 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.560+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5644956b7340 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4ceb400700 1 -- 172.21.15.120:0/2459179956 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf00ad6c0 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4ceb400700 1 -- 172.21.15.120:0/2459179956 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f4cf00a4d10 con 0x56449569fc50 2024-05-14T09:25:43.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4d1b19fb80 10 client.15783 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:43.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4d1b19fb80 10 client.15783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:25:43.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4d1b19fb80 20 client.15783 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:43.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644956b9810 0x5644956bbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4d1b19fb80 4 client.15783 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:43.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.561+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56449566c070 con 0x5644956b9810 2024-05-14T09:25:43.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.562+0000 7f4d09c00700 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644956b9810 0x5644956bbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.563+0000 7f4d09c00700 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644956b9810 0x5644956bbc30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f70ab41de3601a2 server_cookie=ff67dfecfba0d9a0 in_seq=0 out_seq=0 2024-05-14T09:25:43.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.563+0000 7f4ceb400700 10 client.15783 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:25:43.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4ceb400700 1 -- 172.21.15.120:0/2459179956 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56449566c070 con 0x5644956b9810 2024-05-14T09:25:43.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4ceb400700 10 client.15783 handle_command_reply: tid=0 2024-05-14T09:25:43.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 client.15783 shutdown 2024-05-14T09:25:43.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56449569fc50 msgr2=0x5644956a9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56449569fc50 0x5644956a9980 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00a9970 tx=0x7f4cf00b2040 comp rx=0 tx=0).stop 2024-05-14T09:25:43.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 shutdown_connections 2024-05-14T09:25:43.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644956b9810 0x5644956bbc30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 0x5644956a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2459179956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56449569fc50 0x5644956a9980 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 >> 172.21.15.120:0/2459179956 conn(0x564495560a80 msgr2=0x56449569e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.565+0000 7f4ceb400700 0 client.15783 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.566+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 shutdown_connections 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.566+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2459179956 wait complete. 2024-05-14T09:25:43.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.566+0000 7f4d1b19fb80 20 client.15783 trim_cache size 0 max 16384 2024-05-14T09:25:43.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.584+0000 7f4d1b19fb80 1 Processor -- start 2024-05-14T09:25:43.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d1b19fb80 1 -- start start 2024-05-14T09:25:43.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564495521e40 0x56449569f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56449569fc50 0x564495694aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 0x5644956a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce400eaf0 con 0x564495521e40 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4010720 con 0x56449569fc50 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce400f1c0 con 0x5644956a5bf0 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d09c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564495521e40 0x56449569f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d09c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564495521e40 0x56449569f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36740/0 (socket says 172.21.15.120:36740) 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.585+0000 7f4d09c00700 1 -- 172.21.15.120:0/2144817633 learned_addr learned my addr 172.21.15.120:0/2144817633 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d09200700 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56449569fc50 0x564495694aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d0a600700 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 0x5644956a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d09c00700 1 -- 172.21.15.120:0/2144817633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 msgr2=0x5644956a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d09c00700 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 0x5644956a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d09c00700 1 -- 172.21.15.120:0/2144817633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56449569fc50 msgr2=0x564495694aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d09c00700 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56449569fc50 0x564495694aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d09c00700 1 -- 172.21.15.120:0/2144817633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564495693fd0 con 0x564495521e40 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.586+0000 7f4d09c00700 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564495521e40 0x56449569f710 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdfbfba8dcb403f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.587+0000 7f4cf6000700 1 -- 172.21.15.120:0/2144817633 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8005670 con 0x564495521e40 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.587+0000 7f4cf6000700 1 -- 172.21.15.120:0/2144817633 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf802c070 con 0x564495521e40 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.587+0000 7f4cf6000700 1 -- 172.21.15.120:0/2144817633 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800be10 con 0x564495521e40 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2144817633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564495521e40 msgr2=0x56449569f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564495521e40 0x56449569f710 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf8009310 comp rx=0 tx=0).stop 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2144817633 shutdown_connections 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644956a5bf0 0x5644956a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564495521e40 0x56449569f710 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/2144817633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56449569fc50 0x564495694aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2144817633 >> 172.21.15.120:0/2144817633 conn(0x564495560a80 msgr2=0x5644956a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2144817633 shutdown_connections 2024-05-14T09:25:43.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.588+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/2144817633 wait complete. 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.589+0000 7f4d1b19fb80 1 -- start start 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.589+0000 7f4d1b19fb80 1 Processor -- start 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d1b19fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x5644956bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce400ff90 con 0x5644956a5bf0 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce400f8c0 con 0x564495521e40 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d1b19fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce400cab0 con 0x56449569fc50 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d1b19fb80 10 client.0 _ll_register_callbacks cb 0x564495555380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d0a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x5644956bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d0a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x5644956bbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36746/0 (socket says 172.21.15.120:36746) 2024-05-14T09:25:43.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d0a600700 1 -- 172.21.15.120:0/116133816 learned_addr learned my addr 172.21.15.120:0/116133816 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:43.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d09c00700 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.590+0000 7f4d09200700 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.591+0000 7f4d0a600700 1 -- 172.21.15.120:0/116133816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 msgr2=0x5644956bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.591+0000 7f4d0a600700 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956bb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.591+0000 7f4d0a600700 1 -- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 msgr2=0x5644956bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:43.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.591+0000 7f4d0a600700 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956bec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.591+0000 7f4d0a600700 1 -- 172.21.15.120:0/116133816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644956bc350 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.591+0000 7f4d0a600700 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x5644956bbd60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc007e90 tx=0x7f4cfc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e057d149c99e1e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.591+0000 7f4ceb400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.592+0000 7f4ceb400700 1 -- 172.21.15.120:0/116133816 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc017e20 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.592+0000 7f4ceb400700 1 -- 172.21.15.120:0/116133816 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4cfc015c80 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.592+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cf802c070 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.592+0000 7f4ceb400700 1 -- 172.21.15.120:0/116133816 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4cfc004bd0 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.592+0000 7f4d1b19fb80 10 client.15789 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.592+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564495722ad0 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4ceb400700 1 -- 172.21.15.120:0/116133816 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf802c070 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4ceb400700 1 -- 172.21.15.120:0/116133816 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f4cfc02c450 con 0x5644956a5bf0 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4d1b19fb80 10 client.15789 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4d1b19fb80 10 client.15789 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:25:43.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4d1b19fb80 20 client.15789 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:43.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644957232b0 0x5644957256d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:43.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4d1b19fb80 4 client.15789 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:25:43.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.593+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644955cf400 con 0x5644957232b0 2024-05-14T09:25:43.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.594+0000 7f4d09c00700 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644957232b0 0x5644957256d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.595+0000 7f4d09c00700 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644957232b0 0x5644957256d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=409d2db89bd5e9b5 server_cookie=352f58c69a1e387 in_seq=0 out_seq=0 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.595+0000 7f4ceb400700 10 client.15789 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.595+0000 7f4ceb400700 1 -- 172.21.15.120:0/116133816 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644955cf400 con 0x5644957232b0 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.595+0000 7f4ceb400700 10 client.15789 handle_command_reply: tid=0 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.595+0000 7f4d1b19fb80 1 client.15789 shutdown 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.595+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 msgr2=0x5644956bbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.595+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x5644956bbd60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc007e90 tx=0x7f4cfc004ad0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 shutdown_connections 2024-05-14T09:25:43.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x5644957232b0 0x5644957256d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.598 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:25:43.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564495521e40 0x5644956bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5644956a5bf0 0x5644956bbd60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 --2- 172.21.15.120:0/116133816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56449569fc50 0x5644956bb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 >> 172.21.15.120:0/116133816 conn(0x564495560a80 msgr2=0x564495699e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4ceb400700 0 client.15789 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 shutdown_connections 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 1 -- 172.21.15.120:0/116133816 wait complete. 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.596+0000 7f4d1b19fb80 20 client.15789 trim_cache size 0 max 16384 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4cec0b2900 msgr2=0x7f4cec0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4cec0b2900 0x7f4cec0b4e10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00e270 tx=0x7f4cfc00e630 comp rx=0 tx=0).stop 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d04105e30 msgr2=0x7f4d04103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d04105e30 0x7f4d04103710 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000d950 tx=0x7f4cf000dc60 comp rx=0 tx=0).stop 2024-05-14T09:25:43.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 shutdown_connections 2024-05-14T09:25:43.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4cec0b2900 0x7f4cec0b4e10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d0410e910 0x7f4d04103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d041054e0 0x7f4d041031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 --2- 172.21.15.120:0/3533432324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d04105e30 0x7f4d04103710 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:43.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 >> 172.21.15.120:0/3533432324 conn(0x7f4d040fedc0 msgr2=0x7f4d040ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:43.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 shutdown_connections 2024-05-14T09:25:43.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:43.597+0000 7f4d0c600700 1 -- 172.21.15.120:0/3533432324 wait complete. 2024-05-14T09:25:43.838 INFO:teuthology.orchestra.run.smithi120.stderr:2000000 of 3200000 tuples (62%) done (elapsed 71.06 s, remaining 42.64 s) 2024-05-14T09:25:43.887 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:43 smithi120 ceph-mon[31085]: pgmap v621: 129 pgs: 129 active+clean; 462 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 32 op/s 2024-05-14T09:25:43.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:43 smithi175 ceph-mon[35353]: pgmap v621: 129 pgs: 129 active+clean; 462 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 32 op/s 2024-05-14T09:25:44.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:43 smithi152 ceph-mon[34868]: pgmap v621: 129 pgs: 129 active+clean; 462 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 32 op/s 2024-05-14T09:25:44.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T09:25:45.039 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:45.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:45 smithi120 ceph-mon[31085]: pgmap v622: 129 pgs: 129 active+clean; 470 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 29 op/s 2024-05-14T09:25:45.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:45 smithi175 ceph-mon[35353]: pgmap v622: 129 pgs: 129 active+clean; 470 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 29 op/s 2024-05-14T09:25:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:45 smithi152 ceph-mon[34868]: pgmap v622: 129 pgs: 129 active+clean; 470 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 29 op/s 2024-05-14T09:25:47.995 INFO:teuthology.orchestra.run.smithi120.stderr:2100000 of 3200000 tuples (65%) done (elapsed 75.22 s, remaining 39.40 s) 2024-05-14T09:25:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.996+0000 7efdfae00640 1 -- 172.21.15.120:0/4055378167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 msgr2=0x7efdf410b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.996+0000 7efdfae00640 1 --2- 172.21.15.120:0/4055378167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf410b2e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7efde0009900 tx=0x7efde002a410 comp rx=0 tx=0).stop 2024-05-14T09:25:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.997+0000 7efdfae00640 1 -- 172.21.15.120:0/4055378167 shutdown_connections 2024-05-14T09:25:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.997+0000 7efdfae00640 1 --2- 172.21.15.120:0/4055378167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdf410b970 0x7efdf410de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.997+0000 7efdfae00640 1 --2- 172.21.15.120:0/4055378167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf410b2e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.997+0000 7efdfae00640 1 --2- 172.21.15.120:0/4055378167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdf4103f60 0x7efdf4104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.997+0000 7efdfae00640 1 -- 172.21.15.120:0/4055378167 >> 172.21.15.120:0/4055378167 conn(0x7efdf40fd320 msgr2=0x7efdf40ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.997+0000 7efdfae00640 1 -- 172.21.15.120:0/4055378167 shutdown_connections 2024-05-14T09:25:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.997+0000 7efdfae00640 1 -- 172.21.15.120:0/4055378167 wait complete. 2024-05-14T09:25:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 Processor -- start 2024-05-14T09:25:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 -- start start 2024-05-14T09:25:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdf4103f60 0x7efdf419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdf410b970 0x7efdf41a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4111670 con 0x7efdf4108e40 2024-05-14T09:25:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdf41114f0 con 0x7efdf410b970 2024-05-14T09:25:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.998+0000 7efdfae00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdf41117f0 con 0x7efdf4103f60 2024-05-14T09:25:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36770/0 (socket says 172.21.15.120:36770) 2024-05-14T09:25:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 -- 172.21.15.120:0/4219474612 learned_addr learned my addr 172.21.15.120:0/4219474612 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9a00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdf4103f60 0x7efdf419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdfa400640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdf410b970 0x7efdf41a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 -- 172.21.15.120:0/4219474612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdf4103f60 msgr2=0x7efdf419c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdf4103f60 0x7efdf419c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 -- 172.21.15.120:0/4219474612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdf410b970 msgr2=0x7efdf41a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdf410b970 0x7efdf41a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9000640 1 -- 172.21.15.120:0/4219474612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf41a3e00 con 0x7efdf4108e40 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdf9a00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdf4103f60 0x7efdf419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:47.999+0000 7efdfa400640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdf410b970 0x7efdf41a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.000+0000 7efdf9000640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf419c800 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7efde0009230 tx=0x7efde00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.000+0000 7efdf2000640 1 -- 172.21.15.120:0/4219474612 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde003f030 con 0x7efdf4108e40 2024-05-14T09:25:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.000+0000 7efdf2000640 1 -- 172.21.15.120:0/4219474612 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde0003c90 con 0x7efdf4108e40 2024-05-14T09:25:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.000+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf41a4090 con 0x7efdf4108e40 2024-05-14T09:25:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.001+0000 7efdf2000640 1 -- 172.21.15.120:0/4219474612 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0035070 con 0x7efdf4108e40 2024-05-14T09:25:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.001+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf41a45d0 con 0x7efdf4108e40 2024-05-14T09:25:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.005+0000 7efe0343a740 1 Processor -- start 2024-05-14T09:25:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.005+0000 7efe0343a740 1 -- start start 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efe0343a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec9471b0 0x55a9ecce9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efe0343a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec91e2f0 0x55a9ecce9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efe0343a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9264d0 0x55a9eccf0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efe0343a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a9ecc4d550 con 0x55a9ec9471b0 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efe0343a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9ecbf2bc0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efe0343a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a9ecc49510 con 0x55a9ec9264d0 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efdfa400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec9471b0 0x55a9ecce9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efdfa400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec9471b0 0x55a9ecce9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36786/0 (socket says 172.21.15.120:36786) 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efdfa400640 1 -- 172.21.15.120:0/3827532059 learned_addr learned my addr 172.21.15.120:0/3827532059 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.006+0000 7efdf9a00640 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec91e2f0 0x55a9ecce9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdf2000640 1 -- 172.21.15.120:0/4219474612 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7efde0042030 con 0x7efdf4108e40 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdfa400640 1 -- 172.21.15.120:0/3827532059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9264d0 msgr2=0x55a9eccf0780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdfa400640 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9264d0 0x55a9eccf0780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdfa400640 1 -- 172.21.15.120:0/3827532059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec91e2f0 msgr2=0x55a9ecce9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdfa400640 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec91e2f0 0x55a9ecce9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdfa400640 1 -- 172.21.15.120:0/3827532059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9ec95f210 con 0x55a9ec9471b0 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdf9a00640 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec91e2f0 0x55a9ecce9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efdfa400640 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec9471b0 0x55a9ecce9300 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efdec009e60 tx=0x7efdec0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1cc04bccb94717 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.007+0000 7efde6a00640 1 -- 172.21.15.120:0/3827532059 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec013780 con 0x55a9ec9471b0 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.008+0000 7efde6a00640 1 -- 172.21.15.120:0/3827532059 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdec019070 con 0x55a9ec9471b0 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.008+0000 7efde6a00640 1 -- 172.21.15.120:0/3827532059 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec014bc0 con 0x55a9ec9471b0 2024-05-14T09:25:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efdf2000640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efddc0b2860 0x7efddc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 -- 172.21.15.120:0/3827532059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec9471b0 msgr2=0x55a9ecce9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec9471b0 0x55a9ecce9300 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efdec009e60 tx=0x7efdec0078d0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efdf2000640 1 -- 172.21.15.120:0/4219474612 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efde0102c00 con 0x7efdf4108e40 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efdf9a00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efddc0b2860 0x7efddc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 -- 172.21.15.120:0/3827532059 shutdown_connections 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9264d0 0x55a9eccf0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec91e2f0 0x55a9ecce9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 --2- 172.21.15.120:0/3827532059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec9471b0 0x55a9ecce9300 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 -- 172.21.15.120:0/3827532059 >> 172.21.15.120:0/3827532059 conn(0x55a9ec93b300 msgr2=0x55a9ecce4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 -- 172.21.15.120:0/3827532059 shutdown_connections 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.009+0000 7efe0343a740 1 -- 172.21.15.120:0/3827532059 wait complete. 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.010+0000 7efdf9a00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efddc0b2860 0x7efddc0b4d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55a9ecce5a20 tx=0x7efde8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.010+0000 7efe0343a740 1 -- start start 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.010+0000 7efe0343a740 1 Processor -- start 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efe0343a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd0c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efe0343a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd0cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efe0343a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd13bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efe0343a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a9ecd02150 con 0x55a9ec91e2f0 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efe0343a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9ecc06660 con 0x55a9ec9264d0 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efe0343a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a9ecd022d0 con 0x55a9ec9471b0 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efe0343a740 10 client.0 _ll_register_callbacks cb 0x55a9ecbd0400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efdf9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd0c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efdf9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd0c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36790/0 (socket says 172.21.15.120:36790) 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efdf9a00640 1 -- 172.21.15.120:0/1689500634 learned_addr learned my addr 172.21.15.120:0/1689500634 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efdfa400640 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd13bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.011+0000 7efdf9000640 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd0cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efdf9a00640 1 -- 172.21.15.120:0/1689500634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 msgr2=0x55a9ecd13bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efdf9a00640 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd13bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efdf9a00640 1 -- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 msgr2=0x55a9ecd0cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efdf9a00640 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd0cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efdf9a00640 1 -- 172.21.15.120:0/1689500634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9eca2b620 con 0x55a9ec91e2f0 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efdf9a00640 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd0c710 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efdf406a370 tx=0x7efde80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a869493a0eea92b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efddb400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.012+0000 7efddb400640 1 -- 172.21.15.120:0/1689500634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde801f830 con 0x55a9ec91e2f0 2024-05-14T09:25:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.013+0000 7efddb400640 1 -- 172.21.15.120:0/1689500634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efde801f9d0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.013+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdec019070 con 0x55a9ec91e2f0 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.013+0000 7efddb400640 1 -- 172.21.15.120:0/1689500634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efde801fbd0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.013+0000 7efe0343a740 10 client.15801 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.013+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a9ecd16bb0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.013+0000 7efddb400640 1 -- 172.21.15.120:0/1689500634 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdec019070 con 0x55a9ec91e2f0 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.014+0000 7efddb400640 1 -- 172.21.15.120:0/1689500634 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7efde801d3b0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.014+0000 7efe0343a740 10 client.15801 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.014+0000 7efe0343a740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.014+0000 7efe0343a740 20 client.15801 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.014+0000 7efe0343a740 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec905d80 0x55a9ecd1a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.014+0000 7efe0343a740 4 client.15801 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.014+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9ecc5b160 con 0x55a9ec905d80 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.015+0000 7efdf9000640 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec905d80 0x55a9ecd1a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.016+0000 7efddb400640 10 client.15801 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.016+0000 7efdf9000640 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec905d80 0x55a9ecd1a3a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf18455b2884b028 server_cookie=ada306cb1d9c96fa in_seq=0 out_seq=0 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.017+0000 7efddb400640 1 -- 172.21.15.120:0/1689500634 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a9ecc5b160 con 0x55a9ec905d80 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.017+0000 7efddb400640 10 client.15801 handle_command_reply: tid=0 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 client.15801 shutdown 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 msgr2=0x55a9ecd0c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd0c710 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efdf406a370 tx=0x7efde80046c0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 shutdown_connections 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec905d80 0x55a9ecd1a3a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd13bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd0cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 --2- 172.21.15.120:0/1689500634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd0c710 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 >> 172.21.15.120:0/1689500634 conn(0x55a9ec93b300 msgr2=0x55a9ecce3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efddb400640 0 client.15801 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 shutdown_connections 2024-05-14T09:25:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 1 -- 172.21.15.120:0/1689500634 wait complete. 2024-05-14T09:25:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.018+0000 7efe0343a740 20 client.15801 trim_cache size 0 max 16384 2024-05-14T09:25:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.036+0000 7efe0343a740 1 Processor -- start 2024-05-14T09:25:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.036+0000 7efe0343a740 1 -- start start 2024-05-14T09:25:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efe0343a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd1eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efe0343a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efe0343a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd14080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efe0343a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40724c0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efe0343a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40740f0 con 0x55a9ec9264d0 2024-05-14T09:25:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efe0343a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4072b90 con 0x55a9ec9471b0 2024-05-14T09:25:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efdf9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd1eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efdf9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd1eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36806/0 (socket says 172.21.15.120:36806) 2024-05-14T09:25:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efdf9a00640 1 -- 172.21.15.120:0/2987304948 learned_addr learned my addr 172.21.15.120:0/2987304948 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efdf9000640 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.037+0000 7efdfa400640 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd14080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.038+0000 7efdf9a00640 1 -- 172.21.15.120:0/2987304948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 msgr2=0x55a9ecd14080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.038+0000 7efdf9a00640 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd14080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.038+0000 7efdf9a00640 1 -- 172.21.15.120:0/2987304948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 msgr2=0x55a9ecd13b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.038+0000 7efdf9a00640 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.038+0000 7efdf9a00640 1 -- 172.21.15.120:0/2987304948 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9ecce04a0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.038+0000 7efdf9a00640 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd1eb50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efde801d7d0 tx=0x7efde8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef4113ad7609aa5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.038+0000 7efde6000640 1 -- 172.21.15.120:0/2987304948 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8039070 con 0x55a9ec91e2f0 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.039+0000 7efde6000640 1 -- 172.21.15.120:0/2987304948 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde801d3b0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.039+0000 7efde6000640 1 -- 172.21.15.120:0/2987304948 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8005290 con 0x55a9ec91e2f0 2024-05-14T09:25:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 -- 172.21.15.120:0/2987304948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 msgr2=0x55a9ecd1eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd1eb50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efde801d7d0 tx=0x7efde8000bc0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 -- 172.21.15.120:0/2987304948 shutdown_connections 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd14080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 --2- 172.21.15.120:0/2987304948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd1eb50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 -- 172.21.15.120:0/2987304948 >> 172.21.15.120:0/2987304948 conn(0x55a9ec93b300 msgr2=0x55a9ecce84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 -- 172.21.15.120:0/2987304948 shutdown_connections 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 -- 172.21.15.120:0/2987304948 wait complete. 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.040+0000 7efe0343a740 1 -- start start 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 1 Processor -- start 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd12ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd80700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4073960 con 0x55a9ec91e2f0 2024-05-14T09:25:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4073290 con 0x55a9ec9264d0 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40704e0 con 0x55a9ec9471b0 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.041+0000 7efe0343a740 10 client.0 _ll_register_callbacks cb 0x7efde800b5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd12ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd12ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36810/0 (socket says 172.21.15.120:36810) 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 -- 172.21.15.120:0/1467836018 learned_addr learned my addr 172.21.15.120:0/1467836018 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9000640 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdfa400640 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd80700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 -- 172.21.15.120:0/1467836018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 msgr2=0x55a9ecd80700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd80700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 -- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 msgr2=0x55a9ecd13430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 -- 172.21.15.120:0/1467836018 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9ecd0d790 con 0x55a9ec91e2f0 2024-05-14T09:25:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efdf9a00640 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd12ef0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efde801d8f0 tx=0x7efde80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a198b391ddbc11 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.042+0000 7efddb400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.043+0000 7efddb400640 1 -- 172.21.15.120:0/1467836018 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8039040 con 0x55a9ec91e2f0 2024-05-14T09:25:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.043+0000 7efddb400640 1 -- 172.21.15.120:0/1467836018 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efde8004220 con 0x55a9ec91e2f0 2024-05-14T09:25:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.043+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efde801d3b0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.043+0000 7efddb400640 1 -- 172.21.15.120:0/1467836018 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efde8050050 con 0x55a9ec91e2f0 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.043+0000 7efe0343a740 10 client.15807 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.043+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a9ecd81ab0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.043+0000 7efddb400640 1 -- 172.21.15.120:0/1467836018 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde801d3b0 con 0x55a9ec91e2f0 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.044+0000 7efddb400640 1 -- 172.21.15.120:0/1467836018 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7efde8047070 con 0x55a9ec91e2f0 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.044+0000 7efe0343a740 10 client.15807 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.044+0000 7efe0343a740 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.044+0000 7efe0343a740 20 client.15807 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.044+0000 7efe0343a740 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec8db1c0 0x55a9ecd84470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.044+0000 7efe0343a740 4 client.15807 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.044+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a9ecc54fd0 con 0x55a9ec8db1c0 2024-05-14T09:25:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.045+0000 7efdf9000640 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec8db1c0 0x55a9ecd84470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.046+0000 7efdf9000640 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec8db1c0 0x55a9ecd84470 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f011d1aa837acac server_cookie=b8f0481aea5d73b2 in_seq=0 out_seq=0 2024-05-14T09:25:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.046+0000 7efddb400640 10 client.15807 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.091+0000 7efddb400640 1 -- 172.21.15.120:0/1467836018 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a9ecc54fd0 con 0x55a9ec8db1c0 2024-05-14T09:25:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.091+0000 7efddb400640 10 client.15807 handle_command_reply: tid=0 2024-05-14T09:25:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.091+0000 7efe0343a740 1 client.15807 shutdown 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 msgr2=0x55a9ecd12ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd12ef0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efde801d8f0 tx=0x7efde80119b0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 shutdown_connections 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9ec8db1c0 0x55a9ecd84470 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9ec9471b0 0x55a9ecd80700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9ec9264d0 0x55a9ecd13430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 --2- 172.21.15.120:0/1467836018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9ec91e2f0 0x55a9ecd12ef0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efddb400640 0 client.15807 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 >> 172.21.15.120:0/1467836018 conn(0x55a9ec93b300 msgr2=0x55a9ecce8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.092+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 shutdown_connections 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.093+0000 7efe0343a740 1 -- 172.21.15.120:0/1467836018 wait complete. 2024-05-14T09:25:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.093+0000 7efe0343a740 20 client.15807 trim_cache size 0 max 16384 2024-05-14T09:25:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:25:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:25:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:25:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efddc0b2860 msgr2=0x7efddc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efddc0b2860 0x7efddc0b4d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55a9ecce5a20 tx=0x7efde8005850 comp rx=0 tx=0).stop 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 msgr2=0x7efdf419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf419c800 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7efde0009230 tx=0x7efde00042f0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 shutdown_connections 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efddc0b2860 0x7efddc0b4d70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdf410b970 0x7efdf41a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdf4108e40 0x7efdf419c800 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 --2- 172.21.15.120:0/4219474612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdf4103f60 0x7efdf419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.094+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 >> 172.21.15.120:0/4219474612 conn(0x7efdf40fd320 msgr2=0x7efdf4109ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.095+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 shutdown_connections 2024-05-14T09:25:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:25:48.095+0000 7efdfae00640 1 -- 172.21.15.120:0/4219474612 wait complete. 2024-05-14T09:25:48.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:47 smithi120 ceph-mon[31085]: pgmap v623: 129 pgs: 129 active+clean; 492 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2024-05-14T09:25:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:47 smithi152 ceph-mon[34868]: pgmap v623: 129 pgs: 129 active+clean; 492 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2024-05-14T09:25:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:47 smithi175 ceph-mon[35353]: pgmap v623: 129 pgs: 129 active+clean; 492 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2024-05-14T09:25:49.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 -- 172.21.15.120:0/1999272845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 msgr2=0x7fd7001100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 --2- 172.21.15.120:0/1999272845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7001100a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800b0d0 tx=0x7fd6f800b3e0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 -- 172.21.15.120:0/1999272845 shutdown_connections 2024-05-14T09:25:49.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 --2- 172.21.15.120:0/1999272845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7001034c0 0x7fd7001038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 --2- 172.21.15.120:0/1999272845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7001100a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 --2- 172.21.15.120:0/1999272845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd700107df0 0x7fd700108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 -- 172.21.15.120:0/1999272845 >> 172.21.15.120:0/1999272845 conn(0x7fd7000fedc0 msgr2=0x7fd7001011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:49.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 -- 172.21.15.120:0/1999272845 shutdown_connections 2024-05-14T09:25:49.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.197+0000 7fd707600700 1 -- 172.21.15.120:0/1999272845 wait complete. 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.198+0000 7fd707600700 1 Processor -- start 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.199+0000 7fd707600700 1 -- start start 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.199+0000 7fd707600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7001034c0 0x7fd7000ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.199+0000 7fd707600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd700107df0 0x7fd7000ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.199+0000 7fd707600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7000ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.199+0000 7fd707600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd700113270 con 0x7fd700108740 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.199+0000 7fd707600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001130f0 con 0x7fd700107df0 2024-05-14T09:25:49.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.199+0000 7fd707600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001133f0 con 0x7fd7001034c0 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7000ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7000ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44056/0 (socket says 172.21.15.120:44056) 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 -- 172.21.15.120:0/1912006026 learned_addr learned my addr 172.21.15.120:0/1912006026 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd704c00700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7001034c0 0x7fd7000ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd700107df0 0x7fd7000ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 -- 172.21.15.120:0/1912006026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7001034c0 msgr2=0x7fd7000ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7001034c0 0x7fd7000ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 -- 172.21.15.120:0/1912006026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd700107df0 msgr2=0x7fd7000ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd700107df0 0x7fd7000ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.200+0000 7fd705600700 1 -- 172.21.15.120:0/1912006026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7001a8fc0 con 0x7fd700108740 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.201+0000 7fd705600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7000ffd20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8007d10 tx=0x7fd6f8007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.201+0000 7fd6fd600700 1 -- 172.21.15.120:0/1912006026 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f801f070 con 0x7fd700108740 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.201+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7001a9250 con 0x7fd700108740 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.201+0000 7fd6fd600700 1 -- 172.21.15.120:0/1912006026 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6f8003e10 con 0x7fd700108740 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.201+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7001a96b0 con 0x7fd700108740 2024-05-14T09:25:49.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.202+0000 7fd6fd600700 1 -- 172.21.15.120:0/1912006026 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f801b8f0 con 0x7fd700108740 2024-05-14T09:25:49.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.205+0000 7fd6fd600700 1 -- 172.21.15.120:0/1912006026 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd6f8022070 con 0x7fd700108740 2024-05-14T09:25:49.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 Processor -- start 2024-05-14T09:25:49.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 -- start start 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b6035e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e09f0 0x55b6035e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b603502a20 con 0x55b603462e40 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b6034a0760 con 0x55b6035e6830 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b6034fe9e0 con 0x55b6035e09f0 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.207+0000 7fd6fd600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd6e80b2880 0x7fd6e80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.208+0000 7fd6ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.208+0000 7fd6fd600700 1 -- 172.21.15.120:0/1912006026 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd6f800f020 con 0x7fd700108740 2024-05-14T09:25:49.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.208+0000 7fd705600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd6e80b2880 0x7fd6e80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.208+0000 7fd6ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44068/0 (socket says 172.21.15.120:44068) 2024-05-14T09:25:49.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.208+0000 7fd6ffe00700 1 -- 172.21.15.120:0/782480828 learned_addr learned my addr 172.21.15.120:0/782480828 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:49.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.208+0000 7fd704c00700 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b6035e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6ffe00700 1 -- 172.21.15.120:0/782480828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e09f0 msgr2=0x55b6035e0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e09f0 0x55b6035e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6ffe00700 1 -- 172.21.15.120:0/782480828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 msgr2=0x55b6035e04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b6035e04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6ffe00700 1 -- 172.21.15.120:0/782480828 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b60344f8d0 con 0x55b603462e40 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd705600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd6e80b2880 0x7fd6e80b4d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80aa9f0 tx=0x7fd6f80099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e62f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00ad00 tx=0x7fd6ec0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7245233c6bf647 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6f2000700 1 -- 172.21.15.120:0/782480828 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec016070 con 0x55b603462e40 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6f2000700 1 -- 172.21.15.120:0/782480828 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6ec011e20 con 0x55b603462e40 2024-05-14T09:25:49.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.209+0000 7fd6f2000700 1 -- 172.21.15.120:0/782480828 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec003af0 con 0x55b603462e40 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.210+0000 7fd7161f5b80 1 -- 172.21.15.120:0/782480828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 msgr2=0x55b6035e62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.210+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e62f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00ad00 tx=0x7fd6ec0116c0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 -- 172.21.15.120:0/782480828 shutdown_connections 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e09f0 0x55b6035e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e62f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/782480828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b6035e04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 -- 172.21.15.120:0/782480828 >> 172.21.15.120:0/782480828 conn(0x55b6034a7f70 msgr2=0x55b6035db2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:49.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 -- 172.21.15.120:0/782480828 shutdown_connections 2024-05-14T09:25:49.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 -- 172.21.15.120:0/782480828 wait complete. 2024-05-14T09:25:49.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.211+0000 7fd7161f5b80 1 -- start start 2024-05-14T09:25:49.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 1 Processor -- start 2024-05-14T09:25:49.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b603462e40 0x55b6035e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6035ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6035eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b6035ed310 con 0x55b6035e09f0 2024-05-14T09:25:49.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b603468b20 con 0x55b603462e40 2024-05-14T09:25:49.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b6035ed490 con 0x55b6035e6830 2024-05-14T09:25:49.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.212+0000 7fd7161f5b80 10 client.0 _ll_register_callbacks cb 0x55b6034a9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6035ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6035ea4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44076/0 (socket says 172.21.15.120:44076) 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 -- 172.21.15.120:0/1232444879 learned_addr learned my addr 172.21.15.120:0/1232444879 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b603462e40 0x55b6035e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6035eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 -- 172.21.15.120:0/1232444879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 msgr2=0x55b6035eaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6035eaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 -- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b603462e40 msgr2=0x55b6035e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b603462e40 0x55b6035e9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd704c00700 1 -- 172.21.15.120:0/1232444879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6034c8420 con 0x55b6035e09f0 2024-05-14T09:25:49.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.213+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b603462e40 0x55b6035e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:49.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.214+0000 7fd704c00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6035ea4f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4010a50 tx=0x7fd6f4010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a35f19d8e3cc2bf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.214+0000 7fd6e6a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.214+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1232444879 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4004260 con 0x55b6035e09f0 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.214+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1232444879 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd6f4004400 con 0x55b6035e09f0 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.214+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6ec011e20 con 0x55b6035e09f0 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.215+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1232444879 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd6f400f890 con 0x55b6035e09f0 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.215+0000 7fd7161f5b80 10 client.15819 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.215+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b6035f7e70 con 0x55b6035e09f0 2024-05-14T09:25:49.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1232444879 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6ec011e20 con 0x55b6035e09f0 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1232444879 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fd6f4003cd0 con 0x55b6035e09f0 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd7161f5b80 10 client.15819 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd7161f5b80 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd7161f5b80 20 client.15819 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b6035fa4b0 0x55b6035fc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd7161f5b80 4 client.15819 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.216+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6035ad1c0 con 0x55b6035fa4b0 2024-05-14T09:25:49.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.217+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b6035fa4b0 0x55b6035fc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.218+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b6035fa4b0 0x55b6035fc8d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aab5358692c808ac server_cookie=ae088d9daef347bb in_seq=0 out_seq=0 2024-05-14T09:25:49.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.218+0000 7fd6e6a00700 10 client.15819 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:49.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.220+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1232444879 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b6035ad1c0 con 0x55b6035fa4b0 2024-05-14T09:25:49.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.220+0000 7fd6e6a00700 10 client.15819 handle_command_reply: tid=0 2024-05-14T09:25:49.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.220+0000 7fd7161f5b80 1 client.15819 shutdown 2024-05-14T09:25:49.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.220+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 msgr2=0x55b6035ea4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.220+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6035ea4f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4010a50 tx=0x7fd6f4010e10 comp rx=0 tx=0).stop 2024-05-14T09:25:49.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 shutdown_connections 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b6035fa4b0 0x55b6035fc8d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b603462e40 0x55b6035e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6035eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1232444879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6035ea4f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd6e6a00700 0 client.15819 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 >> 172.21.15.120:0/1232444879 conn(0x55b6034a7f70 msgr2=0x55b6035df4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 shutdown_connections 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1232444879 wait complete. 2024-05-14T09:25:49.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.221+0000 7fd7161f5b80 20 client.15819 trim_cache size 0 max 16384 2024-05-14T09:25:49.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.240+0000 7fd7161f5b80 1 Processor -- start 2024-05-14T09:25:49.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.241+0000 7fd7161f5b80 1 -- start start 2024-05-14T09:25:49.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.241+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.241+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e09f0 0x55b6035f6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.241+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6036020d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.241+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001b23a0 con 0x55b603462e40 2024-05-14T09:25:49.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.241+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001b3fd0 con 0x55b6035e09f0 2024-05-14T09:25:49.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.241+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001b2a70 con 0x55b6035e6830 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44090/0 (socket says 172.21.15.120:44090) 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 -- 172.21.15.120:0/753298207 learned_addr learned my addr 172.21.15.120:0/753298207 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd704c00700 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e09f0 0x55b6035f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6036020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 -- 172.21.15.120:0/753298207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 msgr2=0x55b6036020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6036020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 -- 172.21.15.120:0/753298207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e09f0 msgr2=0x55b6035f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e09f0 0x55b6035f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.242+0000 7fd6ffe00700 1 -- 172.21.15.120:0/753298207 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6035e1690 con 0x55b603462e40 2024-05-14T09:25:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.243+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e04b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00a400 tx=0x7fd6ec00a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c98d2ad7829b31 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.243+0000 7fd6f1600700 1 -- 172.21.15.120:0/753298207 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec016040 con 0x55b603462e40 2024-05-14T09:25:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.243+0000 7fd6f1600700 1 -- 172.21.15.120:0/753298207 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6ec005560 con 0x55b603462e40 2024-05-14T09:25:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.243+0000 7fd6f1600700 1 -- 172.21.15.120:0/753298207 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec024040 con 0x55b603462e40 2024-05-14T09:25:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.244+0000 7fd7161f5b80 1 -- 172.21.15.120:0/753298207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 msgr2=0x55b6035e04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.244+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e04b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00a400 tx=0x7fd6ec00a7c0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.244+0000 7fd7161f5b80 1 -- 172.21.15.120:0/753298207 shutdown_connections 2024-05-14T09:25:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.244+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6035e6830 0x55b6036020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.244+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b603462e40 0x55b6035e04b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.244+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/753298207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e09f0 0x55b6035f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.244+0000 7fd7161f5b80 1 -- 172.21.15.120:0/753298207 >> 172.21.15.120:0/753298207 conn(0x55b6034a7f70 msgr2=0x55b6035e88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:49.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.245+0000 7fd7161f5b80 1 -- 172.21.15.120:0/753298207 shutdown_connections 2024-05-14T09:25:49.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.245+0000 7fd7161f5b80 1 -- 172.21.15.120:0/753298207 wait complete. 2024-05-14T09:25:49.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 -- start start 2024-05-14T09:25:49.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 Processor -- start 2024-05-14T09:25:49.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b603462e40 0x55b6035f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6036016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b603601be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001b3840 con 0x55b6035e09f0 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001b3170 con 0x55b6035e6830 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001b0360 con 0x55b603462e40 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.246+0000 7fd7161f5b80 10 client.0 _ll_register_callbacks cb 0x55b6034a9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6036016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6036016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44092/0 (socket says 172.21.15.120:44092) 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 -- 172.21.15.120:0/1259083936 learned_addr learned my addr 172.21.15.120:0/1259083936 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b603462e40 0x55b6035f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b603601be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 -- 172.21.15.120:0/1259083936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b603462e40 msgr2=0x55b6035f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b603462e40 0x55b6035f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 -- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 msgr2=0x55b603601be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b603601be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.247+0000 7fd704c00700 1 -- 172.21.15.120:0/1259083936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6035e1470 con 0x55b6035e09f0 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.248+0000 7fd704c00700 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6036016a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4001eb0 tx=0x7fd6f4005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54a415de6edccea server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.248+0000 7fd6e6a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.248+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1259083936 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400fdf0 con 0x55b6035e09f0 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.248+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1259083936 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd6f401a7e0 con 0x55b6035e09f0 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.248+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6ec005560 con 0x55b6035e09f0 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1259083936 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd6f401a9e0 con 0x55b6035e09f0 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 10 client.15825 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:49.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b60366d160 con 0x55b6035e09f0 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1259083936 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6ec005560 con 0x55b6035e09f0 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1259083936 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fd6f4029430 con 0x55b6035e09f0 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 20 client.15825 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b60366d9b0 0x55b60366fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 4 client.15825 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:25:49.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.249+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b603510400 con 0x55b60366d9b0 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.250+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b60366d9b0 0x55b60366fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.251+0000 7fd6ffe00700 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b60366d9b0 0x55b60366fdd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfaf03bf7784e5aa server_cookie=965b355822abd935 in_seq=0 out_seq=0 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.251+0000 7fd6e6a00700 10 client.15825 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.251+0000 7fd6e6a00700 1 -- 172.21.15.120:0/1259083936 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b603510400 con 0x55b60366d9b0 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.251+0000 7fd6e6a00700 10 client.15825 handle_command_reply: tid=0 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.251+0000 7fd7161f5b80 1 client.15825 shutdown 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 msgr2=0x55b6036016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6036016a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4001eb0 tx=0x7fd6f4005f50 comp rx=0 tx=0).stop 2024-05-14T09:25:49.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 shutdown_connections 2024-05-14T09:25:49.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55b60366d9b0 0x55b60366fdd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b6035e6830 0x55b603601be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b603462e40 0x55b6035f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 --2- 172.21.15.120:0/1259083936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6035e09f0 0x55b6036016a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd6e6a00700 0 client.15825 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:49.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 >> 172.21.15.120:0/1259083936 conn(0x55b6034a7f70 msgr2=0x55b6035e8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:49.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 shutdown_connections 2024-05-14T09:25:49.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 1 -- 172.21.15.120:0/1259083936 wait complete. 2024-05-14T09:25:49.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.252+0000 7fd7161f5b80 20 client.15825 trim_cache size 0 max 16384 2024-05-14T09:25:49.254 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:25:49.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.253+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd6e80b2880 msgr2=0x7fd6e80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.253+0000 7fd707600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd6e80b2880 0x7fd6e80b4d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80aa9f0 tx=0x7fd6f80099e0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.253+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 msgr2=0x7fd7000ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:49.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.253+0000 7fd707600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7000ffd20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8007d10 tx=0x7fd6f8007d40 comp rx=0 tx=0).stop 2024-05-14T09:25:49.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 shutdown_connections 2024-05-14T09:25:49.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd6e80b2880 0x7fd6e80b4d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd700108740 0x7fd7000ffd20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7001034c0 0x7fd7000ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 --2- 172.21.15.120:0/1912006026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd700107df0 0x7fd7000ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:49.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 >> 172.21.15.120:0/1912006026 conn(0x7fd7000fedc0 msgr2=0x7fd70006b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:49.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 shutdown_connections 2024-05-14T09:25:49.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:49.254+0000 7fd707600700 1 -- 172.21.15.120:0/1912006026 wait complete. 2024-05-14T09:25:49.983 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:49 smithi120 ceph-mon[31085]: pgmap v624: 129 pgs: 129 active+clean; 508 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 27 op/s 2024-05-14T09:25:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:49 smithi152 ceph-mon[34868]: pgmap v624: 129 pgs: 129 active+clean; 508 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 27 op/s 2024-05-14T09:25:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:49 smithi175 ceph-mon[35353]: pgmap v624: 129 pgs: 129 active+clean; 508 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 27 op/s 2024-05-14T09:25:51.043 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T09:25:51.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T09:25:51.525 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:51.624 INFO:teuthology.orchestra.run.smithi120.stderr:2200000 of 3200000 tuples (68%) done (elapsed 78.85 s, remaining 35.84 s) 2024-05-14T09:25:51.996 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:51 smithi120 ceph-mon[31085]: pgmap v625: 129 pgs: 129 active+clean; 524 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 28 op/s 2024-05-14T09:25:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:51 smithi152 ceph-mon[34868]: pgmap v625: 129 pgs: 129 active+clean; 524 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 28 op/s 2024-05-14T09:25:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:51 smithi175 ceph-mon[35353]: pgmap v625: 129 pgs: 129 active+clean; 524 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 28 op/s 2024-05-14T09:25:53.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:53 smithi120 ceph-mon[31085]: pgmap v626: 129 pgs: 129 active+clean; 528 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 25 op/s 2024-05-14T09:25:53.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 -- 172.21.15.120:0/1063617257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 msgr2=0x7f194c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 --2- 172.21.15.120:0/1063617257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c1111d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f194400b0d0 tx=0x7f194400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 -- 172.21.15.120:0/1063617257 shutdown_connections 2024-05-14T09:25:53.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 --2- 172.21.15.120:0/1063617257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f194c1045f0 0x7f194c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 --2- 172.21.15.120:0/1063617257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c1111d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 --2- 172.21.15.120:0/1063617257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f194c108f20 0x7f194c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 -- 172.21.15.120:0/1063617257 >> 172.21.15.120:0/1063617257 conn(0x7f194c100040 msgr2=0x7f194c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 -- 172.21.15.120:0/1063617257 shutdown_connections 2024-05-14T09:25:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.899+0000 7f1953e00700 1 -- 172.21.15.120:0/1063617257 wait complete. 2024-05-14T09:25:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.901+0000 7f1953e00700 1 Processor -- start 2024-05-14T09:25:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.901+0000 7f1953e00700 1 -- start start 2024-05-14T09:25:53.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1953e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f194c1045f0 0x7f194c19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1953e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f194c108f20 0x7f194c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1953e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1953e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f194c114350 con 0x7f194c109870 2024-05-14T09:25:53.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1953e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1141d0 con 0x7f194c1045f0 2024-05-14T09:25:53.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1953e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1144d0 con 0x7f194c108f20 2024-05-14T09:25:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1951e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1951e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c19f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44122/0 (socket says 172.21.15.120:44122) 2024-05-14T09:25:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1951e00700 1 -- 172.21.15.120:0/3557246147 learned_addr learned my addr 172.21.15.120:0/3557246147 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1951400700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f194c1045f0 0x7f194c19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.902+0000 7f1950a00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f194c108f20 0x7f194c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f1951e00700 1 -- 172.21.15.120:0/3557246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f194c108f20 msgr2=0x7f194c19b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f1951e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f194c108f20 0x7f194c19b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f1951e00700 1 -- 172.21.15.120:0/3557246147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f194c1045f0 msgr2=0x7f194c19ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f1951e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f194c1045f0 0x7f194c19ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f1951e00700 1 -- 172.21.15.120:0/3557246147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c19fbf0 con 0x7f194c109870 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f1951e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c19f550 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1944009850 tx=0x7f1944007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f194a000700 1 -- 172.21.15.120:0/3557246147 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194401f030 con 0x7f194c109870 2024-05-14T09:25:53.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194c19fe80 con 0x7f194c109870 2024-05-14T09:25:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f194a000700 1 -- 172.21.15.120:0/3557246147 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f194401bad0 con 0x7f194c109870 2024-05-14T09:25:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.903+0000 7f194a000700 1 -- 172.21.15.120:0/3557246147 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1944012bb0 con 0x7f194c109870 2024-05-14T09:25:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.904+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f194c1a7800 con 0x7f194c109870 2024-05-14T09:25:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.908+0000 7f194a000700 1 -- 172.21.15.120:0/3557246147 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1944022030 con 0x7f194c109870 2024-05-14T09:25:53.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.909+0000 7f196288db80 1 Processor -- start 2024-05-14T09:25:53.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.910+0000 7f196288db80 1 -- start start 2024-05-14T09:25:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.910+0000 7f196288db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc375ec0 0x55c7fc4f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.910+0000 7f196288db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc4fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.910+0000 7f196288db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4fc820 0x55c7fc4fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.910+0000 7f196288db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c7fc415aa0 con 0x55c7fc375ec0 2024-05-14T09:25:53.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.910+0000 7f196288db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c7fc3b37e0 con 0x55c7fc4f8120 2024-05-14T09:25:53.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.910+0000 7f196288db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7fc411a60 con 0x55c7fc4fc820 2024-05-14T09:25:53.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1950a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc375ec0 0x55c7fc4f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1950a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc375ec0 0x55c7fc4f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44138/0 (socket says 172.21.15.120:44138) 2024-05-14T09:25:53.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1950a00700 1 -- 172.21.15.120:0/3945133175 learned_addr learned my addr 172.21.15.120:0/3945133175 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:53.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f194a000700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f19340b2880 0x7f19340b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1951e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f19340b2880 0x7f19340b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1950a00700 1 -- 172.21.15.120:0/3945133175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4fc820 msgr2=0x55c7fc4fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1950a00700 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4fc820 0x55c7fc4fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1950a00700 1 -- 172.21.15.120:0/3945133175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 msgr2=0x55c7fc4fc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.911+0000 7f1951400700 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc4fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.912+0000 7f1950a00700 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc4fc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.912+0000 7f1950a00700 1 -- 172.21.15.120:0/3945133175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fc362950 con 0x55c7fc375ec0 2024-05-14T09:25:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.912+0000 7f1950a00700 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc375ec0 0x55c7fc4f7be0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f193800dd80 tx=0x7f193800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30214cc8f3ebc1c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:53.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.913+0000 7f193ea00700 1 -- 172.21.15.120:0/3945133175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938015070 con 0x55c7fc375ec0 2024-05-14T09:25:53.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.913+0000 7f194a000700 1 -- 172.21.15.120:0/3557246147 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f194400f020 con 0x7f194c109870 2024-05-14T09:25:53.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.913+0000 7f1951e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f19340b2880 0x7f19340b4d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19440a6be0 tx=0x7f19440a6b10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:53.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.913+0000 7f193ea00700 1 -- 172.21.15.120:0/3945133175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f193800fe50 con 0x55c7fc375ec0 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.913+0000 7f193ea00700 1 -- 172.21.15.120:0/3945133175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380116a0 con 0x55c7fc375ec0 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.914+0000 7f196288db80 1 -- 172.21.15.120:0/3945133175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc375ec0 msgr2=0x55c7fc4f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.914+0000 7f196288db80 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc375ec0 0x55c7fc4f7be0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f193800dd80 tx=0x7f193800f640 comp rx=0 tx=0).stop 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.914+0000 7f196288db80 1 -- 172.21.15.120:0/3945133175 shutdown_connections 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.914+0000 7f196288db80 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4fc820 0x55c7fc4fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.914+0000 7f196288db80 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc375ec0 0x55c7fc4f7be0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.914+0000 7f196288db80 1 --2- 172.21.15.120:0/3945133175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc4fc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.914+0000 7f196288db80 1 -- 172.21.15.120:0/3945133175 >> 172.21.15.120:0/3945133175 conn(0x55c7fc3baff0 msgr2=0x55c7fc4ee350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:53.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.915+0000 7f196288db80 1 -- 172.21.15.120:0/3945133175 shutdown_connections 2024-05-14T09:25:53.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.915+0000 7f196288db80 1 -- 172.21.15.120:0/3945133175 wait complete. 2024-05-14T09:25:53.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.915+0000 7f196288db80 1 -- start start 2024-05-14T09:25:53.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.916+0000 7f196288db80 1 Processor -- start 2024-05-14T09:25:53.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.916+0000 7f196288db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc375ec0 0x55c7fc501570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.916+0000 7f196288db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4f8120 0x55c7fc501ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f196288db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f196288db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c7fc504770 con 0x55c7fc4fc820 2024-05-14T09:25:53.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f196288db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c7fc37bba0 con 0x55c7fc375ec0 2024-05-14T09:25:53.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f196288db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7fc5048f0 con 0x55c7fc4f8120 2024-05-14T09:25:53.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f196288db80 10 client.0 _ll_register_callbacks cb 0x55c7fc3bccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:53.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f1950a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f1950a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44144/0 (socket says 172.21.15.120:44144) 2024-05-14T09:25:53.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f1950a00700 1 -- 172.21.15.120:0/1521501301 learned_addr learned my addr 172.21.15.120:0/1521501301 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:53.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f1950a00700 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc375ec0 0x55c7fc501570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.917+0000 7f1951400700 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4f8120 0x55c7fc501ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.918+0000 7f1950a00700 1 -- 172.21.15.120:0/1521501301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4f8120 msgr2=0x55c7fc501ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.918+0000 7f1950a00700 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4f8120 0x55c7fc501ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.918+0000 7f1950a00700 1 -- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc375ec0 msgr2=0x55c7fc501570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.918+0000 7f1950a00700 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc375ec0 0x55c7fc501570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.918+0000 7f1950a00700 1 -- 172.21.15.120:0/1521501301 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fc3db4a0 con 0x55c7fc4fc820 2024-05-14T09:25:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.918+0000 7f1950a00700 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501ff0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f193800df90 tx=0x7f193800d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963fff6e2e37c71b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.918+0000 7f1933400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:53.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.919+0000 7f1933400700 1 -- 172.21.15.120:0/1521501301 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938015040 con 0x55c7fc4fc820 2024-05-14T09:25:53.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.919+0000 7f1933400700 1 -- 172.21.15.120:0/1521501301 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1938004030 con 0x55c7fc4fc820 2024-05-14T09:25:53.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.919+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f193800fe50 con 0x55c7fc4fc820 2024-05-14T09:25:53.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.919+0000 7f1933400700 1 -- 172.21.15.120:0/1521501301 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1938004230 con 0x55c7fc4fc820 2024-05-14T09:25:53.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.919+0000 7f196288db80 10 client.15837 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:53.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.919+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c7fc50f3c0 con 0x55c7fc4fc820 2024-05-14T09:25:53.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f1933400700 1 -- 172.21.15.120:0/1521501301 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f193800fe50 con 0x55c7fc4fc820 2024-05-14T09:25:53.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f1933400700 1 -- 172.21.15.120:0/1521501301 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f193802c4c0 con 0x55c7fc4fc820 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f196288db80 10 client.15837 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f196288db80 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f196288db80 20 client.15837 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f196288db80 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc511890 0x55c7fc513cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f196288db80 4 client.15837 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.920+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7fc4c0240 con 0x55c7fc511890 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.921+0000 7f1951400700 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc511890 0x55c7fc513cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.922+0000 7f1951400700 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc511890 0x55c7fc513cb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=916dfe8f531164b3 server_cookie=a12e5dffd1839ce0 in_seq=0 out_seq=0 2024-05-14T09:25:53.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.922+0000 7f1933400700 10 client.15837 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.924+0000 7f1933400700 1 -- 172.21.15.120:0/1521501301 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c7fc4c0240 con 0x55c7fc511890 2024-05-14T09:25:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.924+0000 7f1933400700 10 client.15837 handle_command_reply: tid=0 2024-05-14T09:25:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.924+0000 7f196288db80 1 client.15837 shutdown 2024-05-14T09:25:53.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.924+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 msgr2=0x55c7fc501ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.924+0000 7f196288db80 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501ff0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f193800df90 tx=0x7f193800d370 comp rx=0 tx=0).stop 2024-05-14T09:25:53.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 shutdown_connections 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc511890 0x55c7fc513cb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc375ec0 0x55c7fc501570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501ff0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 --2- 172.21.15.120:0/1521501301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc4f8120 0x55c7fc501ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 >> 172.21.15.120:0/1521501301 conn(0x55c7fc3baff0 msgr2=0x55c7fc4f2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f1933400700 0 client.15837 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 shutdown_connections 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 1 -- 172.21.15.120:0/1521501301 wait complete. 2024-05-14T09:25:53.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.925+0000 7f196288db80 20 client.15837 trim_cache size 0 max 16384 2024-05-14T09:25:53.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 Processor -- start 2024-05-14T09:25:53.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 -- start start 2024-05-14T09:25:53.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc4e8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc503330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1ae100 con 0x55c7fc4fc820 2024-05-14T09:25:53.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1afd30 con 0x55c7fc4f8120 2024-05-14T09:25:53.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.952+0000 7f196288db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1ae7d0 con 0x55c7fc375ec0 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.953+0000 7f1950a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.953+0000 7f1950a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44154/0 (socket says 172.21.15.120:44154) 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.953+0000 7f1950a00700 1 -- 172.21.15.120:0/3115158444 learned_addr learned my addr 172.21.15.120:0/3115158444 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.953+0000 7f1951400700 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc503330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.953+0000 7f1950a00700 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc4e8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.954+0000 7f1950a00700 1 -- 172.21.15.120:0/3115158444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 msgr2=0x55c7fc4e8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.954+0000 7f1950a00700 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc4e8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.954+0000 7f1950a00700 1 -- 172.21.15.120:0/3115158444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 msgr2=0x55c7fc503330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.954+0000 7f1950a00700 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc503330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.954+0000 7f1950a00700 1 -- 172.21.15.120:0/3115158444 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fc4ef2e0 con 0x55c7fc4fc820 2024-05-14T09:25:53.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.954+0000 7f1950a00700 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f193801a910 tx=0x7f193800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3718b0bf8f95d1ab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:53.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.954+0000 7f193e000700 1 -- 172.21.15.120:0/3115158444 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938015070 con 0x55c7fc4fc820 2024-05-14T09:25:53.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.955+0000 7f193e000700 1 -- 172.21.15.120:0/3115158444 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f193802c560 con 0x55c7fc4fc820 2024-05-14T09:25:53.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.955+0000 7f193e000700 1 -- 172.21.15.120:0/3115158444 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193802ca80 con 0x55c7fc4fc820 2024-05-14T09:25:53.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 -- 172.21.15.120:0/3115158444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 msgr2=0x55c7fc501b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f193801a910 tx=0x7f193800f640 comp rx=0 tx=0).stop 2024-05-14T09:25:53.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 -- 172.21.15.120:0/3115158444 shutdown_connections 2024-05-14T09:25:53.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4fc820 0x55c7fc501b00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc4e8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 --2- 172.21.15.120:0/3115158444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4f8120 0x55c7fc503330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 -- 172.21.15.120:0/3115158444 >> 172.21.15.120:0/3115158444 conn(0x55c7fc3baff0 msgr2=0x55c7fc502c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:53.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 -- 172.21.15.120:0/3115158444 shutdown_connections 2024-05-14T09:25:53.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.956+0000 7f196288db80 1 -- 172.21.15.120:0/3115158444 wait complete. 2024-05-14T09:25:53.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.957+0000 7f196288db80 1 -- start start 2024-05-14T09:25:53.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.957+0000 7f196288db80 1 Processor -- start 2024-05-14T09:25:53.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.957+0000 7f196288db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc5079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.957+0000 7f196288db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4f8120 0x55c7fc507ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f196288db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4fc820 0x55c7fc508430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f196288db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1af5a0 con 0x55c7fc4f8120 2024-05-14T09:25:53.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f196288db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1aeed0 con 0x55c7fc4fc820 2024-05-14T09:25:53.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f196288db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1ac0c0 con 0x55c7fc375ec0 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f196288db80 10 client.0 _ll_register_callbacks cb 0x55c7fc3bccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4f8120 0x55c7fc507ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4f8120 0x55c7fc507ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44156/0 (socket says 172.21.15.120:44156) 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 -- 172.21.15.120:0/3125747986 learned_addr learned my addr 172.21.15.120:0/3125747986 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1950a00700 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4fc820 0x55c7fc508430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1950a00700 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc5079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 -- 172.21.15.120:0/3125747986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 msgr2=0x55c7fc5079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc5079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 -- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4fc820 msgr2=0x55c7fc508430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4fc820 0x55c7fc508430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.958+0000 7f1951400700 1 -- 172.21.15.120:0/3125747986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fc57b0f0 con 0x55c7fc4f8120 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.959+0000 7f1951400700 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4f8120 0x55c7fc507ef0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1940005810 tx=0x7f194001b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd9d10122edb159 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.959+0000 7f1933400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.959+0000 7f1933400700 1 -- 172.21.15.120:0/3125747986 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940004230 con 0x55c7fc4f8120 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.959+0000 7f1933400700 1 -- 172.21.15.120:0/3125747986 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f19400043d0 con 0x55c7fc4f8120 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.959+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f193802c560 con 0x55c7fc4f8120 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.960+0000 7f1933400700 1 -- 172.21.15.120:0/3125747986 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f194002d050 con 0x55c7fc4f8120 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.960+0000 7f196288db80 10 client.15843 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.960+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c7fc57c420 con 0x55c7fc4f8120 2024-05-14T09:25:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.960+0000 7f1933400700 1 -- 172.21.15.120:0/3125747986 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f193802c560 con 0x55c7fc4f8120 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f1933400700 1 -- 172.21.15.120:0/3125747986 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f194000f040 con 0x55c7fc4f8120 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f196288db80 10 client.15843 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f196288db80 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f196288db80 20 client.15843 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f196288db80 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc57cbd0 0x55c7fc57eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f196288db80 4 client.15843 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c7fc423480 con 0x55c7fc57cbd0 2024-05-14T09:25:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.961+0000 7f1950a00700 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc57cbd0 0x55c7fc57eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:53.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.962+0000 7f1950a00700 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc57cbd0 0x55c7fc57eff0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dec3d6ec9ba51e7 server_cookie=85c29b68bfc9ba74 in_seq=0 out_seq=0 2024-05-14T09:25:53.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.962+0000 7f1933400700 10 client.15843 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f1933400700 1 -- 172.21.15.120:0/3125747986 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c7fc423480 con 0x55c7fc57cbd0 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f1933400700 10 client.15843 handle_command_reply: tid=0 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 client.15843 shutdown 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4f8120 msgr2=0x55c7fc507ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4f8120 0x55c7fc507ef0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1940005810 tx=0x7f194001b620 comp rx=0 tx=0).stop 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 shutdown_connections 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c7fc57cbd0 0x55c7fc57eff0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c7fc4fc820 0x55c7fc508430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7fc375ec0 0x55c7fc5079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 --2- 172.21.15.120:0/3125747986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c7fc4f8120 0x55c7fc507ef0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 >> 172.21.15.120:0/3125747986 conn(0x55c7fc3baff0 msgr2=0x55c7fc4e88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.965+0000 7f1933400700 0 client.15843 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.966+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 shutdown_connections 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.966+0000 7f196288db80 1 -- 172.21.15.120:0/3125747986 wait complete. 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.966+0000 7f196288db80 20 client.15843 trim_cache size 0 max 16384 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "798d8c9d-4f3a-4e5b-9f66-12f8abf42d26", 2024-05-14T09:25:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-05-14T09:25:53.968 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:25:53.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.966+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f19340b2880 msgr2=0x7f19340b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.966+0000 7f1953e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f19340b2880 0x7f19340b4d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19440a6be0 tx=0x7f19440a6b10 comp rx=0 tx=0).stop 2024-05-14T09:25:53.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.966+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 msgr2=0x7f194c19f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:53.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.966+0000 7f1953e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c19f550 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1944009850 tx=0x7f1944007e40 comp rx=0 tx=0).stop 2024-05-14T09:25:53.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 shutdown_connections 2024-05-14T09:25:53.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f19340b2880 0x7f19340b4d90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f194c1045f0 0x7f194c19ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f194c109870 0x7f194c19f550 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 --2- 172.21.15.120:0/3557246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f194c108f20 0x7f194c19b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:53.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 >> 172.21.15.120:0/3557246147 conn(0x7f194c100040 msgr2=0x7f194c108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:53.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 shutdown_connections 2024-05-14T09:25:53.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:53.967+0000 7f1953e00700 1 -- 172.21.15.120:0/3557246147 wait complete. 2024-05-14T09:25:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:53 smithi152 ceph-mon[34868]: pgmap v626: 129 pgs: 129 active+clean; 528 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 25 op/s 2024-05-14T09:25:54.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:25:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:25:53.992+0000 7f6fc8a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical/ auth{2=1} v696 ap=2 f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2) n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3) (inest sync->mix g=2) caps={15282=pAsLsXsFs/-@52} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e4f20db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v105>,<0x10000000003/postgres v27>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v43>,<0x10000000001/sv_0 v60>,<0x10000000000/qa v46>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v696>,<0x10000000005/data v496>,<0x10000000003/postgres v190>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v210>,<0x10000000001/sv_0 v224>,<0x10000000000/qa v213>,<0x1/volumes v214>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T09:24:11.529232+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","memory_value.dirstat":"f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T09:25:54.209 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:25:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:25:53.995+0000 7f6fc8a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp/ auth{2=1,3=1} v924 ap=2 f(v10 m2024-05-14T09:25:31.794470+0000 3=3+0) n(v1 rc2024-05-14T09:25:31.794470+0000 b3816 4=3+1) (inest sync->mix g=2,3) caps={15282=pAsLsXsFs/-@40} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e4f20da580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v105>,<0x10000000003/postgres v27>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v43>,<0x10000000001/sv_0 v60>,<0x10000000000/qa v46>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v924>,<0x10000000005/data v496>,<0x10000000003/postgres v190>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v210>,<0x10000000001/sv_0 v224>,<0x10000000000/qa v213>,<0x1/volumes v214>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T09:25:31.763553+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-05-14T09:25:31.794470+0000 b3816 4=3+1)","memory_value.dirstat":"f(v10 m2024-05-14T09:25:31.794470+0000 3=3+0)","memory_value.rstat":"n(v1 rc2024-05-14T09:25:31.794470+0000 b3816 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T09:25:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:53 smithi175 ceph-mon[35353]: pgmap v626: 129 pgs: 129 active+clean; 528 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 25 op/s 2024-05-14T09:25:54.604 INFO:teuthology.orchestra.run.smithi120.stderr:2300000 of 3200000 tuples (71%) done (elapsed 81.83 s, remaining 32.02 s) 2024-05-14T09:25:54.912 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub queued for path: / 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.137 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.137 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:54 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub queued for path: / 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:54 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub queued for path: / 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:54 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:25:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:55 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:25:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:55 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:55.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:55 smithi120 ceph-mon[31085]: pgmap v627: 129 pgs: 129 active+clean; 536 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-05-14T09:25:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:55 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:25:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:55 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:55 smithi152 ceph-mon[34868]: pgmap v627: 129 pgs: 129 active+clean; 536 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-05-14T09:25:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:55 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:25:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:55 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:25:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:55 smithi175 ceph-mon[35353]: pgmap v627: 129 pgs: 129 active+clean; 536 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.758+0000 7fc608a00700 1 -- 172.21.15.120:0/4170293791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410a7c0 msgr2=0x7fc60410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.758+0000 7fc608a00700 1 --2- 172.21.15.120:0/4170293791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410a7c0 0x7fc60410abd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009990 tx=0x7fc5f0009ca0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.758+0000 7fc608a00700 1 -- 172.21.15.120:0/4170293791 shutdown_connections 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.758+0000 7fc608a00700 1 --2- 172.21.15.120:0/4170293791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc60410f6c0 0x7fc60410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.758+0000 7fc608a00700 1 --2- 172.21.15.120:0/4170293791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc60410b110 0x7fc604117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.758+0000 7fc608a00700 1 --2- 172.21.15.120:0/4170293791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410a7c0 0x7fc60410abd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.758+0000 7fc608a00700 1 -- 172.21.15.120:0/4170293791 >> 172.21.15.120:0/4170293791 conn(0x7fc604076b00 msgr2=0x7fc604076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.759+0000 7fc608a00700 1 -- 172.21.15.120:0/4170293791 shutdown_connections 2024-05-14T09:25:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.759+0000 7fc608a00700 1 -- 172.21.15.120:0/4170293791 wait complete. 2024-05-14T09:25:57.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.760+0000 7fc608a00700 1 Processor -- start 2024-05-14T09:25:57.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.761+0000 7fc608a00700 1 -- start start 2024-05-14T09:25:57.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.761+0000 7fc608a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc60410a7c0 0x7fc6041a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.761+0000 7fc608a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc60410b110 0x7fc6041a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.761+0000 7fc608a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410f6c0 0x7fc6041a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.761+0000 7fc608a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc60411a7b0 con 0x7fc60410f6c0 2024-05-14T09:25:57.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.761+0000 7fc608a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc60411a630 con 0x7fc60410a7c0 2024-05-14T09:25:57.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.761+0000 7fc608a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc60411a930 con 0x7fc60410b110 2024-05-14T09:25:57.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410f6c0 0x7fc6041a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410f6c0 0x7fc6041a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44182/0 (socket says 172.21.15.120:44182) 2024-05-14T09:25:57.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 -- 172.21.15.120:0/3380311641 learned_addr learned my addr 172.21.15.120:0/3380311641 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:57.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc602800700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc60410a7c0 0x7fc6041a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc601e00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc60410b110 0x7fc6041a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 -- 172.21.15.120:0/3380311641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc60410b110 msgr2=0x7fc6041a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc60410b110 0x7fc6041a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 -- 172.21.15.120:0/3380311641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc60410a7c0 msgr2=0x7fc6041a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc60410a7c0 0x7fc6041a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.762+0000 7fc603200700 1 -- 172.21.15.120:0/3380311641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6041a6050 con 0x7fc60410f6c0 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.763+0000 7fc601e00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc60410b110 0x7fc6041a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.763+0000 7fc603200700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410f6c0 0x7fc6041a59b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc007ee0 tx=0x7fc5fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.763+0000 7fc5fb400700 1 -- 172.21.15.120:0/3380311641 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00dbd0 con 0x7fc60410f6c0 2024-05-14T09:25:57.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.763+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6041a6340 con 0x7fc60410f6c0 2024-05-14T09:25:57.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.763+0000 7fc5fb400700 1 -- 172.21.15.120:0/3380311641 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5fc00dd70 con 0x7fc60410f6c0 2024-05-14T09:25:57.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.763+0000 7fc5fb400700 1 -- 172.21.15.120:0/3380311641 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0058d0 con 0x7fc60410f6c0 2024-05-14T09:25:57.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.765+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6041adc60 con 0x7fc60410f6c0 2024-05-14T09:25:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.767+0000 7fc5fb400700 1 -- 172.21.15.120:0/3380311641 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fc5fc01a020 con 0x7fc60410f6c0 2024-05-14T09:25:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 Processor -- start 2024-05-14T09:25:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc5fb400700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc5e80b2900 0x7fc5e80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 -- start start 2024-05-14T09:25:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc5fb400700 1 -- 172.21.15.120:0/3380311641 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc5fc0e1730 con 0x7fc60410f6c0 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc601e00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc5e80b2900 0x7fc5e80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6398e40 0x55f4e6516d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517280 0x55f4e65208e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517690 0x55f4e6522e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6438a20 con 0x55f4e6517690 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4e63d6760 con 0x55f4e6398e40 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.770+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4e64349e0 con 0x55f4e6517280 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.771+0000 7fc603200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517690 0x55f4e6522e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.771+0000 7fc603200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517690 0x55f4e6522e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44194/0 (socket says 172.21.15.120:44194) 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.771+0000 7fc603200700 1 -- 172.21.15.120:0/2316300651 learned_addr learned my addr 172.21.15.120:0/2316300651 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.771+0000 7fc601e00700 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517280 0x55f4e65208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.771+0000 7fc602800700 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6398e40 0x55f4e6516d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.772+0000 7fc601e00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc5e80b2900 0x7fc5e80b4e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0006010 tx=0x7fc5f00095f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:57.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.772+0000 7fc603200700 1 -- 172.21.15.120:0/2316300651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517280 msgr2=0x55f4e65208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.772+0000 7fc603200700 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517280 0x55f4e65208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.772+0000 7fc603200700 1 -- 172.21.15.120:0/2316300651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6398e40 msgr2=0x55f4e6516d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.772+0000 7fc603200700 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6398e40 0x55f4e6516d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.772+0000 7fc603200700 1 -- 172.21.15.120:0/2316300651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e63858d0 con 0x55f4e6517690 2024-05-14T09:25:57.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.772+0000 7fc603200700 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517690 0x55f4e6522e30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0a4a30 tx=0x7fc5fc0a4240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586169f2656118da server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:57.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.777+0000 7fc5efe00700 1 -- 172.21.15.120:0/2316300651 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0b1160 con 0x55f4e6517690 2024-05-14T09:25:57.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.777+0000 7fc5efe00700 1 -- 172.21.15.120:0/2316300651 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5fc0a89b0 con 0x55f4e6517690 2024-05-14T09:25:57.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.778+0000 7fc5efe00700 1 -- 172.21.15.120:0/2316300651 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0a8c10 con 0x55f4e6517690 2024-05-14T09:25:57.777 INFO:teuthology.orchestra.run.smithi120.stderr:2400000 of 3200000 tuples (75%) done (elapsed 85.00 s, remaining 28.33 s) 2024-05-14T09:25:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2316300651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517690 msgr2=0x55f4e6522e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517690 0x55f4e6522e30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0a4a30 tx=0x7fc5fc0a4240 comp rx=0 tx=0).stop 2024-05-14T09:25:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2316300651 shutdown_connections 2024-05-14T09:25:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6398e40 0x55f4e6516d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517690 0x55f4e6522e30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2316300651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517280 0x55f4e65208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2316300651 >> 172.21.15.120:0/2316300651 conn(0x55f4e63d7a80 msgr2=0x55f4e6511b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2316300651 shutdown_connections 2024-05-14T09:25:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.779+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2316300651 wait complete. 2024-05-14T09:25:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.780+0000 7fc617eb7b80 1 -- start start 2024-05-14T09:25:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.780+0000 7fc617eb7b80 1 Processor -- start 2024-05-14T09:25:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.781+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6398e40 0x55f4e6520380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.781+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e65208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.781+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e6520e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.781+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f4e65237a0 con 0x55f4e6398e40 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.781+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f4e639eb20 con 0x55f4e6517280 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.781+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6523920 con 0x55f4e6517690 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.781+0000 7fc617eb7b80 10 client.0 _ll_register_callbacks cb 0x55f4e63cc380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6398e40 0x55f4e6520380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6398e40 0x55f4e6520380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44202/0 (socket says 172.21.15.120:44202) 2024-05-14T09:25:57.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 -- 172.21.15.120:0/3028344844 learned_addr learned my addr 172.21.15.120:0/3028344844 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc601e00700 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e65208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc603200700 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e6520e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 -- 172.21.15.120:0/3028344844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 msgr2=0x55f4e6520e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e6520e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 -- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 msgr2=0x55f4e65208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e65208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.782+0000 7fc602800700 1 -- 172.21.15.120:0/3028344844 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e63fe420 con 0x55f4e6398e40 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.783+0000 7fc602800700 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6398e40 0x55f4e6520380 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4011440 tx=0x7fc5f4011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc2768ff0e3c0eb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.783+0000 7fc5ecc00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.783+0000 7fc5ecc00700 1 -- 172.21.15.120:0/3028344844 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4004830 con 0x55f4e6398e40 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.783+0000 7fc5ecc00700 1 -- 172.21.15.120:0/3028344844 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc5f4017070 con 0x55f4e6398e40 2024-05-14T09:25:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.783+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5fc0a89b0 con 0x55f4e6398e40 2024-05-14T09:25:57.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.784+0000 7fc5ecc00700 1 -- 172.21.15.120:0/3028344844 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc5f40049d0 con 0x55f4e6398e40 2024-05-14T09:25:57.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.784+0000 7fc617eb7b80 10 client.15855 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.784+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f4e652e4a0 con 0x55f4e6398e40 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.784+0000 7fc5ecc00700 1 -- 172.21.15.120:0/3028344844 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5fc0a89b0 con 0x55f4e6398e40 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.785+0000 7fc5ecc00700 1 -- 172.21.15.120:0/3028344844 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fc5f401a740 con 0x55f4e6398e40 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.785+0000 7fc617eb7b80 10 client.15855 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.785+0000 7fc617eb7b80 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.785+0000 7fc617eb7b80 20 client.15855 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.785+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e6530b30 0x55f4e6533000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.785+0000 7fc617eb7b80 4 client.15855 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:25:57.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.785+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4e64e3070 con 0x55f4e6530b30 2024-05-14T09:25:57.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.786+0000 7fc601e00700 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e6530b30 0x55f4e6533000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.787+0000 7fc601e00700 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e6530b30 0x55f4e6533000 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87b2efcdca71d0a3 server_cookie=21a833f74d371038 in_seq=0 out_seq=0 2024-05-14T09:25:57.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.787+0000 7fc5ecc00700 10 client.15855 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc5ecc00700 1 -- 172.21.15.120:0/3028344844 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f4e64e3070 con 0x55f4e6530b30 2024-05-14T09:25:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc5ecc00700 10 client.15855 handle_command_reply: tid=0 2024-05-14T09:25:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 client.15855 shutdown 2024-05-14T09:25:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6398e40 msgr2=0x55f4e6520380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6398e40 0x55f4e6520380 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4011440 tx=0x7fc5f4011750 comp rx=0 tx=0).stop 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 shutdown_connections 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e6530b30 0x55f4e6533000 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e6520e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6398e40 0x55f4e6520380 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/3028344844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e65208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 >> 172.21.15.120:0/3028344844 conn(0x55f4e63d7a80 msgr2=0x55f4e6515700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.789+0000 7fc5ecc00700 0 client.15855 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.790+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 shutdown_connections 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.790+0000 7fc617eb7b80 1 -- 172.21.15.120:0/3028344844 wait complete. 2024-05-14T09:25:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.790+0000 7fc617eb7b80 20 client.15855 trim_cache size 0 max 16384 2024-05-14T09:25:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.820+0000 7fc617eb7b80 1 Processor -- start 2024-05-14T09:25:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.820+0000 7fc617eb7b80 1 -- start start 2024-05-14T09:25:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e6520c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e651efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e651f520 0x55f4e651b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041b6680 con 0x55f4e651f520 2024-05-14T09:25:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041b82b0 con 0x55f4e6517280 2024-05-14T09:25:57.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041b6d50 con 0x55f4e6517690 2024-05-14T09:25:57.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc603200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e651f520 0x55f4e651b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc603200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e651f520 0x55f4e651b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44204/0 (socket says 172.21.15.120:44204) 2024-05-14T09:25:57.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc603200700 1 -- 172.21.15.120:0/4017866422 learned_addr learned my addr 172.21.15.120:0/4017866422 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:57.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc601e00700 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e651efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.821+0000 7fc602800700 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e6520c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc603200700 1 -- 172.21.15.120:0/4017866422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 msgr2=0x55f4e651efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc603200700 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e651efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc603200700 1 -- 172.21.15.120:0/4017866422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 msgr2=0x55f4e6520c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc603200700 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e6520c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc603200700 1 -- 172.21.15.120:0/4017866422 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e650afd0 con 0x55f4e651f520 2024-05-14T09:25:57.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc603200700 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e651f520 0x55f4e651b6a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0a8940 tx=0x7fc5fc090040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6a06cc2223be29 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:57.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc5ef400700 1 -- 172.21.15.120:0/4017866422 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0c3020 con 0x55f4e651f520 2024-05-14T09:25:57.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc5ef400700 1 -- 172.21.15.120:0/4017866422 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5fc0a89b0 con 0x55f4e651f520 2024-05-14T09:25:57.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.822+0000 7fc5ef400700 1 -- 172.21.15.120:0/4017866422 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0a4c40 con 0x55f4e651f520 2024-05-14T09:25:57.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.823+0000 7fc617eb7b80 1 -- 172.21.15.120:0/4017866422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e651f520 msgr2=0x55f4e651b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.823+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e651f520 0x55f4e651b6a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0a8940 tx=0x7fc5fc090040 comp rx=0 tx=0).stop 2024-05-14T09:25:57.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 -- 172.21.15.120:0/4017866422 shutdown_connections 2024-05-14T09:25:57.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517280 0x55f4e6520c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e651f520 0x55f4e651b6a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/4017866422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e6517690 0x55f4e651efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 -- 172.21.15.120:0/4017866422 >> 172.21.15.120:0/4017866422 conn(0x55f4e63d7a80 msgr2=0x55f4e65118c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:57.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 -- 172.21.15.120:0/4017866422 shutdown_connections 2024-05-14T09:25:57.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 -- 172.21.15.120:0/4017866422 wait complete. 2024-05-14T09:25:57.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.824+0000 7fc617eb7b80 1 -- start start 2024-05-14T09:25:57.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.825+0000 7fc617eb7b80 1 Processor -- start 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.825+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517280 0x55f4e6524ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.825+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517690 0x55f4e6525010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.825+0000 7fc617eb7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e651f520 0x55f4e6525550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.825+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041b7b20 con 0x55f4e6517280 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.825+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041b7450 con 0x55f4e6517690 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.825+0000 7fc617eb7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041b4640 con 0x55f4e651f520 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc617eb7b80 10 client.0 _ll_register_callbacks cb 0x55f4e63cc380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517280 0x55f4e6524ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517280 0x55f4e6524ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44210/0 (socket says 172.21.15.120:44210) 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 -- 172.21.15.120:0/2287283491 learned_addr learned my addr 172.21.15.120:0/2287283491 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc601e00700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517690 0x55f4e6525010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc603200700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e651f520 0x55f4e6525550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 -- 172.21.15.120:0/2287283491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e651f520 msgr2=0x55f4e6525550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e651f520 0x55f4e6525550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 -- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517690 msgr2=0x55f4e6525010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517690 0x55f4e6525010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc602800700 1 -- 172.21.15.120:0/2287283491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e659a5a0 con 0x55f4e6517280 2024-05-14T09:25:57.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.826+0000 7fc603200700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e651f520 0x55f4e6525550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:25:57.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.827+0000 7fc602800700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517280 0x55f4e6524ad0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4000c00 tx=0x7fc5f4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124dc4e01639dd2d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:25:57.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.827+0000 7fc5ecc00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:25:57.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.827+0000 7fc5ecc00700 1 -- 172.21.15.120:0/2287283491 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4025030 con 0x55f4e6517280 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.827+0000 7fc5ecc00700 1 -- 172.21.15.120:0/2287283491 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc5f4026070 con 0x55f4e6517280 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.827+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5fc0a89b0 con 0x55f4e6517280 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.828+0000 7fc5ecc00700 1 -- 172.21.15.120:0/2287283491 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc5f403b050 con 0x55f4e6517280 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.828+0000 7fc617eb7b80 10 client.15861 fetch_fsmap learned FSMap version 34 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.828+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f4e659b810 con 0x55f4e6517280 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.828+0000 7fc5ecc00700 1 -- 172.21.15.120:0/2287283491 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5fc0a89b0 con 0x55f4e6517280 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.828+0000 7fc5ecc00700 1 -- 172.21.15.120:0/2287283491 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fc5f4022070 con 0x55f4e6517280 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.829+0000 7fc617eb7b80 10 client.15861 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.829+0000 7fc617eb7b80 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.829+0000 7fc617eb7b80 20 client.15861 populate_metadata read hostname 'smithi120' 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.829+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e659bfe0 0x55f4e659e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.829+0000 7fc617eb7b80 4 client.15861 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:25:57.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.829+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f4e6446400 con 0x55f4e659bfe0 2024-05-14T09:25:57.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.829+0000 7fc601e00700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e659bfe0 0x55f4e659e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.830+0000 7fc601e00700 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e659bfe0 0x55f4e659e400 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9fbe10447023c1 server_cookie=a35201f22cb7215 in_seq=0 out_seq=0 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.830+0000 7fc5ecc00700 10 client.15861 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc5ecc00700 1 -- 172.21.15.120:0/2287283491 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f4e6446400 con 0x55f4e659bfe0 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc5ecc00700 10 client.15861 handle_command_reply: tid=0 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 client.15861 shutdown 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517280 msgr2=0x55f4e6524ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517280 0x55f4e6524ad0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4000c00 tx=0x7fc5f4011b70 comp rx=0 tx=0).stop 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 shutdown_connections 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f4e659bfe0 0x55f4e659e400 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4e651f520 0x55f4e6525550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f4e6517280 0x55f4e6524ad0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 --2- 172.21.15.120:0/2287283491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f4e6517690 0x55f4e6525010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc5ecc00700 0 client.15861 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:25:57.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.831+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 >> 172.21.15.120:0/2287283491 conn(0x55f4e63d7a80 msgr2=0x55f4e6511620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:57.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.832+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 shutdown_connections 2024-05-14T09:25:57.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.832+0000 7fc617eb7b80 1 -- 172.21.15.120:0/2287283491 wait complete. 2024-05-14T09:25:57.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.832+0000 7fc617eb7b80 20 client.15861 trim_cache size 0 max 16384 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "798d8c9d-4f3a-4e5b-9f66-12f8abf42d26": { 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "798d8c9d-4f3a-4e5b-9f66-12f8abf42d26", 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:25:57.833 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:25:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc5e80b2900 msgr2=0x7fc5e80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc5e80b2900 0x7fc5e80b4e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0006010 tx=0x7fc5f00095f0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410f6c0 msgr2=0x7fc6041a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:25:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410f6c0 0x7fc6041a59b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc007ee0 tx=0x7fc5fc00d3b0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 shutdown_connections 2024-05-14T09:25:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc5e80b2900 0x7fc5e80b4e10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc60410a7c0 0x7fc6041a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc60410f6c0 0x7fc6041a59b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 --2- 172.21.15.120:0/3380311641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc60410b110 0x7fc6041a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:25:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 >> 172.21.15.120:0/3380311641 conn(0x7fc604076b00 msgr2=0x7fc6041088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:25:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 shutdown_connections 2024-05-14T09:25:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:25:57.833+0000 7fc608a00700 1 -- 172.21.15.120:0/3380311641 wait complete. 2024-05-14T09:25:58.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:57 smithi120 ceph-mon[31085]: pgmap v628: 129 pgs: 129 active+clean; 552 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 14 MiB/s wr, 52 op/s 2024-05-14T09:25:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:57 smithi152 ceph-mon[34868]: pgmap v628: 129 pgs: 129 active+clean; 552 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 14 MiB/s wr, 52 op/s 2024-05-14T09:25:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:57 smithi175 ceph-mon[35353]: pgmap v628: 129 pgs: 129 active+clean; 552 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 14 MiB/s wr, 52 op/s 2024-05-14T09:25:58.801 INFO:tasks.cephfs.filesystem:scrub status for tag:798d8c9d-4f3a-4e5b-9f66-12f8abf42d26 - {'path': '/', 'tag': '798d8c9d-4f3a-4e5b-9f66-12f8abf42d26', 'options': 'recursive,force'} 2024-05-14T09:26:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:25:59 smithi120 ceph-mon[31085]: pgmap v629: 129 pgs: 129 active+clean; 572 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 14 MiB/s wr, 83 op/s 2024-05-14T09:26:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:25:59 smithi152 ceph-mon[34868]: pgmap v629: 129 pgs: 129 active+clean; 572 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 14 MiB/s wr, 83 op/s 2024-05-14T09:26:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:25:59 smithi175 ceph-mon[35353]: pgmap v629: 129 pgs: 129 active+clean; 572 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 14 MiB/s wr, 83 op/s 2024-05-14T09:26:01.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 -- 172.21.15.120:0/3108190189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 msgr2=0x7fb7c4111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/3108190189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c4111cb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009930 tx=0x7fb7ac02a420 comp rx=0 tx=0).stop 2024-05-14T09:26:01.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 -- 172.21.15.120:0/3108190189 shutdown_connections 2024-05-14T09:26:01.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/3108190189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7c41121f0 0x7fb7c4114610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/3108190189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c4111cb0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/3108190189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c410a0f0 0x7fb7c410a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 -- 172.21.15.120:0/3108190189 >> 172.21.15.120:0/3108190189 conn(0x7fb7c4070460 msgr2=0x7fb7c4072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:01.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 -- 172.21.15.120:0/3108190189 shutdown_connections 2024-05-14T09:26:01.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.353+0000 7fb7c8a00640 1 -- 172.21.15.120:0/3108190189 wait complete. 2024-05-14T09:26:01.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.354+0000 7fb7c8a00640 1 Processor -- start 2024-05-14T09:26:01.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7c8a00640 1 -- start start 2024-05-14T09:26:01.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7c8a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c410a0f0 0x7fb7c41a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7c8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c41a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7c8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7c41121f0 0x7fb7c41a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7c8a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c4117c70 con 0x7fb7c410f890 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7c8a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c4117af0 con 0x7fb7c410a0f0 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7c8a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c4117df0 con 0x7fb7c41121f0 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c41a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c41a2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39706/0 (socket says 172.21.15.120:39706) 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.355+0000 7fb7b9e00640 1 -- 172.21.15.120:0/339181407 learned_addr learned my addr 172.21.15.120:0/339181407 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7c2800640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c410a0f0 0x7fb7c41a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7c3200640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7c41121f0 0x7fb7c41a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7b9e00640 1 -- 172.21.15.120:0/339181407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7c41121f0 msgr2=0x7fb7c41a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7c41121f0 0x7fb7c41a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7b9e00640 1 -- 172.21.15.120:0/339181407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c410a0f0 msgr2=0x7fb7c41a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c410a0f0 0x7fb7c41a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7b9e00640 1 -- 172.21.15.120:0/339181407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c41aa440 con 0x7fb7c410f890 2024-05-14T09:26:01.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.356+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c41a2e40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005760 tx=0x7fb7ac003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:01.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.357+0000 7fb7bbe00640 1 -- 172.21.15.120:0/339181407 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac03f070 con 0x7fb7c410f890 2024-05-14T09:26:01.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.357+0000 7fb7bbe00640 1 -- 172.21.15.120:0/339181407 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7ac031da0 con 0x7fb7c410f890 2024-05-14T09:26:01.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.357+0000 7fb7bbe00640 1 -- 172.21.15.120:0/339181407 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac035030 con 0x7fb7c410f890 2024-05-14T09:26:01.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.357+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c41aa6d0 con 0x7fb7c410f890 2024-05-14T09:26:01.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.357+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c41aab70 con 0x7fb7c410f890 2024-05-14T09:26:01.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.360+0000 7fb7d0573740 1 Processor -- start 2024-05-14T09:26:01.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7d0573740 1 -- start start 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bfb11b0 0x56469c357710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c357c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf904d0 0x56469c35eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7d0573740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56469c2b7550 con 0x56469bfb11b0 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7d0573740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56469c25cbc0 con 0x56469bf882f0 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7d0573740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56469c2b3510 con 0x56469bf904d0 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7bbe00640 1 -- 172.21.15.120:0/339181407 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb7ac042070 con 0x7fb7c410f890 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.361+0000 7fb7c3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bfb11b0 0x56469c357710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bfb11b0 0x56469c357710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39714/0 (socket says 172.21.15.120:39714) 2024-05-14T09:26:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c3200640 1 -- 172.21.15.120:0/1286956249 learned_addr learned my addr 172.21.15.120:0/1286956249 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c2800640 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c357c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf904d0 0x56469c35eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c3200640 1 -- 172.21.15.120:0/1286956249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf904d0 msgr2=0x56469c35eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c3200640 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf904d0 0x56469c35eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c3200640 1 -- 172.21.15.120:0/1286956249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 msgr2=0x56469c357c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c3200640 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c357c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c3200640 1 -- 172.21.15.120:0/1286956249 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469bfc9210 con 0x56469bfb11b0 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.362+0000 7fb7c2800640 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c357c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.363+0000 7fb7c3200640 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bfb11b0 0x56469c357710 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00bc70 tx=0x7fb7bc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66843aea4c60770a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.363+0000 7fb7b3400640 1 -- 172.21.15.120:0/1286956249 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc015070 con 0x56469bfb11b0 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.363+0000 7fb7b3400640 1 -- 172.21.15.120:0/1286956249 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7bc0118d0 con 0x56469bfb11b0 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.363+0000 7fb7b3400640 1 -- 172.21.15.120:0/1286956249 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc010750 con 0x56469bfb11b0 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.363+0000 7fb7bbe00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb7a80b2860 0x7fb7a80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.363+0000 7fb7bbe00640 1 -- 172.21.15.120:0/339181407 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb7ac102f70 con 0x7fb7c410f890 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7c2800640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb7a80b2860 0x7fb7a80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 -- 172.21.15.120:0/1286956249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bfb11b0 msgr2=0x56469c357710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bfb11b0 0x56469c357710 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00bc70 tx=0x7fb7bc00f730 comp rx=0 tx=0).stop 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 -- 172.21.15.120:0/1286956249 shutdown_connections 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf904d0 0x56469c35eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c357c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 --2- 172.21.15.120:0/1286956249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bfb11b0 0x56469c357710 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 -- 172.21.15.120:0/1286956249 >> 172.21.15.120:0/1286956249 conn(0x56469bfa5300 msgr2=0x56469c34ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 -- 172.21.15.120:0/1286956249 shutdown_connections 2024-05-14T09:26:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7c2800640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb7a80b2860 0x7fb7a80b4d70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x56469c358af0 tx=0x7fb7b4009660 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.364+0000 7fb7d0573740 1 -- 172.21.15.120:0/1286956249 wait complete. 2024-05-14T09:26:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.365+0000 7fb7d0573740 1 -- start start 2024-05-14T09:26:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.365+0000 7fb7d0573740 1 Processor -- start 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c361300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c361840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c3687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7d0573740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56469c35f5e0 con 0x56469bf904d0 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7d0573740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56469c270660 con 0x56469bf882f0 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7d0573740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56469c35f760 con 0x56469bfb11b0 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7d0573740 10 client.0 _ll_register_callbacks cb 0x56469c23a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c361840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c361840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39722/0 (socket says 172.21.15.120:39722) 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.366+0000 7fb7b9e00640 1 -- 172.21.15.120:0/825757487 learned_addr learned my addr 172.21.15.120:0/825757487 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7c3200640 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c3687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7c2800640 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c361300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7b9e00640 1 -- 172.21.15.120:0/825757487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 msgr2=0x56469c3687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c3687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7b9e00640 1 -- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 msgr2=0x56469c361300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c361300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7b9e00640 1 -- 172.21.15.120:0/825757487 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56469c095620 con 0x56469bf904d0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c361840 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac000c00 tx=0x7fb7ac0c9900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f39be3c130a54ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7a7e00640 1 -- 172.21.15.120:0/825757487 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac049040 con 0x56469bf904d0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7bc0118d0 con 0x56469bf904d0 2024-05-14T09:26:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.367+0000 7fb7a7e00640 1 -- 172.21.15.120:0/825757487 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb7ac0c6420 con 0x56469bf904d0 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7a7e00640 1 -- 172.21.15.120:0/825757487 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac0ca190 con 0x56469bf904d0 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7d0573740 10 client.15873 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56469c36b6d0 con 0x56469bf904d0 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7a7e00640 1 -- 172.21.15.120:0/825757487 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7bc0118d0 con 0x56469bf904d0 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7a7e00640 1 -- 172.21.15.120:0/825757487 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fb7ac0ca3f0 con 0x56469bf904d0 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7d0573740 10 client.15873 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7d0573740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.368+0000 7fb7d0573740 20 client.15873 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.369+0000 7fb7d0573740 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf6fd80 0x56469c36efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.369+0000 7fb7d0573740 4 client.15873 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.369+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56469c2c5160 con 0x56469bf6fd80 2024-05-14T09:26:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.369+0000 7fb7c2800640 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf6fd80 0x56469c36efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.370+0000 7fb7a7e00640 10 client.15873 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.370+0000 7fb7c2800640 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf6fd80 0x56469c36efc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c0a12590288532 server_cookie=326884870e081b07 in_seq=0 out_seq=0 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.372+0000 7fb7a7e00640 1 -- 172.21.15.120:0/825757487 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56469c2c5160 con 0x56469bf6fd80 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.372+0000 7fb7a7e00640 10 client.15873 handle_command_reply: tid=0 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.372+0000 7fb7d0573740 1 client.15873 shutdown 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 msgr2=0x56469c361840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c361840 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac000c00 tx=0x7fb7ac0c9900 comp rx=0 tx=0).stop 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 shutdown_connections 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf6fd80 0x56469c36efc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c3687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c361840 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 --2- 172.21.15.120:0/825757487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf882f0 0x56469c361300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7a7e00640 0 client.15873 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 >> 172.21.15.120:0/825757487 conn(0x56469bfa5300 msgr2=0x56469c34dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 shutdown_connections 2024-05-14T09:26:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 1 -- 172.21.15.120:0/825757487 wait complete. 2024-05-14T09:26:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.373+0000 7fb7d0573740 20 client.15873 trim_cache size 0 max 16384 2024-05-14T09:26:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 Processor -- start 2024-05-14T09:26:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 -- start start 2024-05-14T09:26:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf882f0 0x56469c373770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf904d0 0x56469c3686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c368c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c41b2d40 con 0x56469bf882f0 2024-05-14T09:26:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c41b4970 con 0x56469bf904d0 2024-05-14T09:26:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.392+0000 7fb7d0573740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c41b3410 con 0x56469bfb11b0 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf882f0 0x56469c373770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf882f0 0x56469c373770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39734/0 (socket says 172.21.15.120:39734) 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 -- 172.21.15.120:0/518766232 learned_addr learned my addr 172.21.15.120:0/518766232 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c3200640 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c368c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf904d0 0x56469c3686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 -- 172.21.15.120:0/518766232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 msgr2=0x56469c368c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c368c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 -- 172.21.15.120:0/518766232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf904d0 msgr2=0x56469c3686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf904d0 0x56469c3686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.393+0000 7fb7c2800640 1 -- 172.21.15.120:0/518766232 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469c358910 con 0x56469bf882f0 2024-05-14T09:26:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.394+0000 7fb7c2800640 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf882f0 0x56469c373770 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x56469c36f720 tx=0x7fb7b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857d13fb17638c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.394+0000 7fb7b2a00640 1 -- 172.21.15.120:0/518766232 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4003b70 con 0x56469bf882f0 2024-05-14T09:26:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.394+0000 7fb7b2a00640 1 -- 172.21.15.120:0/518766232 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7b402e070 con 0x56469bf882f0 2024-05-14T09:26:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.394+0000 7fb7b2a00640 1 -- 172.21.15.120:0/518766232 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40296d0 con 0x56469bf882f0 2024-05-14T09:26:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 -- 172.21.15.120:0/518766232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf882f0 msgr2=0x56469c373770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf882f0 0x56469c373770 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x56469c36f720 tx=0x7fb7b4014000 comp rx=0 tx=0).stop 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 -- 172.21.15.120:0/518766232 shutdown_connections 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bfb11b0 0x56469c368c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bf904d0 0x56469c3686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 --2- 172.21.15.120:0/518766232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf882f0 0x56469c373770 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 -- 172.21.15.120:0/518766232 >> 172.21.15.120:0/518766232 conn(0x56469bfa5300 msgr2=0x56469c35b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 -- 172.21.15.120:0/518766232 shutdown_connections 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.395+0000 7fb7d0573740 1 -- 172.21.15.120:0/518766232 wait complete. 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.396+0000 7fb7d0573740 1 -- start start 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.396+0000 7fb7d0573740 1 Processor -- start 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.396+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf882f0 0x56469c366020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.396+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c366560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7d0573740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bfb11b0 0x56469c3d5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7d0573740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c41b41e0 con 0x56469bf904d0 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7d0573740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c41b3b10 con 0x56469bfb11b0 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7d0573740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c41b0d40 con 0x56469bf882f0 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7d0573740 10 client.0 _ll_register_callbacks cb 0x7fb7ac009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c366560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c366560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39736/0 (socket says 172.21.15.120:39736) 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 -- 172.21.15.120:0/472072716 learned_addr learned my addr 172.21.15.120:0/472072716 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7c3200640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bfb11b0 0x56469c3d5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7c2800640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf882f0 0x56469c366020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 -- 172.21.15.120:0/472072716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf882f0 msgr2=0x56469c366020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf882f0 0x56469c366020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 -- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bfb11b0 msgr2=0x56469c3d5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bfb11b0 0x56469c3d5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7b9e00640 1 -- 172.21.15.120:0/472072716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56469c3d5890 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.397+0000 7fb7c3200640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bfb11b0 0x56469c3d5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7b9e00640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c366560 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac02a9e0 tx=0x7fb7ac0ca620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7960df55a84b559c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7a7e00640 1 -- 172.21.15.120:0/472072716 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac049070 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7a7e00640 1 -- 172.21.15.120:0/472072716 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb7ac031910 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7b402e070 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7a7e00640 1 -- 172.21.15.120:0/472072716 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac0ab050 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7d0573740 10 client.15879 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.398+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56469c3d5890 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7a7e00640 1 -- 172.21.15.120:0/472072716 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7b402e070 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7a7e00640 1 -- 172.21.15.120:0/472072716 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fb7ac0c5b00 con 0x56469bf904d0 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7d0573740 10 client.15879 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7d0573740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7d0573740 20 client.15879 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7d0573740 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf451c0 0x56469c3d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7d0573740 4 client.15879 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:26:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.399+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56469c2befd0 con 0x56469bf451c0 2024-05-14T09:26:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.400+0000 7fb7c2800640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf451c0 0x56469c3d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.401+0000 7fb7a7e00640 10 client.15879 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.401+0000 7fb7c2800640 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf451c0 0x56469c3d91a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d03fccc8583f318f server_cookie=d6f27026b17bcd3f in_seq=0 out_seq=0 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.438+0000 7fb7a7e00640 1 -- 172.21.15.120:0/472072716 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56469c2befd0 con 0x56469bf451c0 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.438+0000 7fb7a7e00640 10 client.15879 handle_command_reply: tid=0 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 client.15879 shutdown 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 msgr2=0x56469c366560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c366560 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac02a9e0 tx=0x7fb7ac0ca620 comp rx=0 tx=0).stop 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 shutdown_connections 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56469bf451c0 0x56469c3d91a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56469bfb11b0 0x56469c3d5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56469bf904d0 0x56469c366560 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 --2- 172.21.15.120:0/472072716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56469bf882f0 0x56469c366020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7a7e00640 0 client.15879 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.439+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 >> 172.21.15.120:0/472072716 conn(0x56469bfa5300 msgr2=0x56469c351b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.440+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 shutdown_connections 2024-05-14T09:26:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.440+0000 7fb7d0573740 1 -- 172.21.15.120:0/472072716 wait complete. 2024-05-14T09:26:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.440+0000 7fb7d0573740 20 client.15879 trim_cache size 0 max 16384 2024-05-14T09:26:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:26:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:26:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:26:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:26:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb7a80b2860 msgr2=0x7fb7a80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb7a80b2860 0x7fb7a80b4d70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x56469c358af0 tx=0x7fb7b4009660 comp rx=0 tx=0).stop 2024-05-14T09:26:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 msgr2=0x7fb7c41a2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c41a2e40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005760 tx=0x7fb7ac003d50 comp rx=0 tx=0).stop 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 shutdown_connections 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb7a80b2860 0x7fb7a80b4d70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7c41121f0 0x7fb7c41a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c410f890 0x7fb7c41a2e40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 --2- 172.21.15.120:0/339181407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c410a0f0 0x7fb7c41a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 >> 172.21.15.120:0/339181407 conn(0x7fb7c4070460 msgr2=0x7fb7c4110790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 shutdown_connections 2024-05-14T09:26:01.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:01.441+0000 7fb7c8a00640 1 -- 172.21.15.120:0/339181407 wait complete. 2024-05-14T09:26:02.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:01 smithi120 ceph-mon[31085]: pgmap v630: 129 pgs: 129 active+clean; 588 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 14 MiB/s wr, 90 op/s 2024-05-14T09:26:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:01 smithi152 ceph-mon[34868]: pgmap v630: 129 pgs: 129 active+clean; 588 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 14 MiB/s wr, 90 op/s 2024-05-14T09:26:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:01 smithi175 ceph-mon[35353]: pgmap v630: 129 pgs: 129 active+clean; 588 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 14 MiB/s wr, 90 op/s 2024-05-14T09:26:02.342 INFO:teuthology.orchestra.run.smithi120.stderr:2500000 of 3200000 tuples (78%) done (elapsed 89.57 s, remaining 25.08 s) 2024-05-14T09:26:03.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:02 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:26:03.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:02 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:26:03.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:02 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:26:03.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:02 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:26:03.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:02 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:26:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:02 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:26:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:02 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:26:03.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:02 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:26:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:02 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:26:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:02 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:26:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:02 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:26:03.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:02 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:26:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:03 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:26:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:03 smithi120 ceph-mon[31085]: pgmap v631: 129 pgs: 129 active+clean; 600 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 87 op/s 2024-05-14T09:26:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:03 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:26:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:03 smithi152 ceph-mon[34868]: pgmap v631: 129 pgs: 129 active+clean; 600 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 87 op/s 2024-05-14T09:26:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:03 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:26:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:03 smithi175 ceph-mon[35353]: pgmap v631: 129 pgs: 129 active+clean; 600 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 87 op/s 2024-05-14T09:26:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:05 smithi120 ceph-mon[31085]: pgmap v632: 129 pgs: 129 active+clean; 614 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 85 op/s 2024-05-14T09:26:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:05 smithi152 ceph-mon[34868]: pgmap v632: 129 pgs: 129 active+clean; 614 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 85 op/s 2024-05-14T09:26:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:05 smithi175 ceph-mon[35353]: pgmap v632: 129 pgs: 129 active+clean; 614 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 85 op/s 2024-05-14T09:26:06.238 INFO:teuthology.orchestra.run.smithi120.stderr:2600000 of 3200000 tuples (81%) done (elapsed 93.46 s, remaining 21.57 s) 2024-05-14T09:26:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:07 smithi120 ceph-mon[31085]: pgmap v633: 129 pgs: 129 active+clean; 618 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 13 MiB/s wr, 91 op/s 2024-05-14T09:26:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:07 smithi152 ceph-mon[34868]: pgmap v633: 129 pgs: 129 active+clean; 618 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 13 MiB/s wr, 91 op/s 2024-05-14T09:26:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:07 smithi175 ceph-mon[35353]: pgmap v633: 129 pgs: 129 active+clean; 618 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 13 MiB/s wr, 91 op/s 2024-05-14T09:26:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:09 smithi120 ceph-mon[31085]: pgmap v634: 129 pgs: 129 active+clean; 628 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 63 op/s 2024-05-14T09:26:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:09 smithi152 ceph-mon[34868]: pgmap v634: 129 pgs: 129 active+clean; 628 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 63 op/s 2024-05-14T09:26:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:09 smithi175 ceph-mon[35353]: pgmap v634: 129 pgs: 129 active+clean; 628 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 63 op/s 2024-05-14T09:26:10.932 INFO:teuthology.orchestra.run.smithi120.stderr:2700000 of 3200000 tuples (84%) done (elapsed 98.16 s, remaining 18.18 s) 2024-05-14T09:26:12.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:11 smithi120 ceph-mon[31085]: pgmap v635: 129 pgs: 129 active+clean; 644 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 31 op/s 2024-05-14T09:26:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:11 smithi152 ceph-mon[34868]: pgmap v635: 129 pgs: 129 active+clean; 644 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 31 op/s 2024-05-14T09:26:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:11 smithi175 ceph-mon[35353]: pgmap v635: 129 pgs: 129 active+clean; 644 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 31 op/s 2024-05-14T09:26:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:13 smithi120 ceph-mon[31085]: pgmap v636: 129 pgs: 129 active+clean; 648 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 23 op/s 2024-05-14T09:26:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:13 smithi152 ceph-mon[34868]: pgmap v636: 129 pgs: 129 active+clean; 648 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 23 op/s 2024-05-14T09:26:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:13 smithi175 ceph-mon[35353]: pgmap v636: 129 pgs: 129 active+clean; 648 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 23 op/s 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 -- 172.21.15.120:0/1420685201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 msgr2=0x7f57dc103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 --2- 172.21.15.120:0/1420685201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc103670 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009900 tx=0x7f57cc02a400 comp rx=0 tx=0).stop 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 -- 172.21.15.120:0/1420685201 shutdown_connections 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 --2- 172.21.15.120:0/1420685201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57dc1088b0 0x7f57dc10acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 --2- 172.21.15.120:0/1420685201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc103bb0 0x7f57dc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 --2- 172.21.15.120:0/1420685201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc103670 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 -- 172.21.15.120:0/1420685201 >> 172.21.15.120:0/1420685201 conn(0x7f57dc0fdb60 msgr2=0x7f57dc100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 -- 172.21.15.120:0/1420685201 shutdown_connections 2024-05-14T09:26:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.708+0000 7f57db200640 1 -- 172.21.15.120:0/1420685201 wait complete. 2024-05-14T09:26:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.709+0000 7f57db200640 1 Processor -- start 2024-05-14T09:26:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57db200640 1 -- start start 2024-05-14T09:26:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57db200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc0ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57db200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc103bb0 0x7f57dc0fe090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57db200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57dc1088b0 0x7f57dc0fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57db200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc10e370 con 0x7f57dc102970 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57db200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc10e1f0 con 0x7f57dc1088b0 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57db200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc10e4f0 con 0x7f57dc103bb0 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57d9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc0ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57d9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc0ff9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39174/0 (socket says 172.21.15.120:39174) 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.710+0000 7f57d9e00640 1 -- 172.21.15.120:0/3281591021 learned_addr learned my addr 172.21.15.120:0/3281591021 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57d9400640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc103bb0 0x7f57dc0fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57da800640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57dc1088b0 0x7f57dc0fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57d9e00640 1 -- 172.21.15.120:0/3281591021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc103bb0 msgr2=0x7f57dc0fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc103bb0 0x7f57dc0fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57d9e00640 1 -- 172.21.15.120:0/3281591021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57dc1088b0 msgr2=0x7f57dc0fe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57dc1088b0 0x7f57dc0fe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57d9e00640 1 -- 172.21.15.120:0/3281591021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc0fec70 con 0x7f57dc102970 2024-05-14T09:26:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.711+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc0ff9f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f57cc005760 tx=0x7f57cc003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.712+0000 7f57d2a00640 1 -- 172.21.15.120:0/3281591021 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc03f070 con 0x7f57dc102970 2024-05-14T09:26:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.712+0000 7f57d2a00640 1 -- 172.21.15.120:0/3281591021 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57cc031da0 con 0x7f57dc102970 2024-05-14T09:26:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.712+0000 7f57d2a00640 1 -- 172.21.15.120:0/3281591021 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc035030 con 0x7f57dc102970 2024-05-14T09:26:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.712+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc1a41b0 con 0x7f57dc102970 2024-05-14T09:26:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.712+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc1a4560 con 0x7f57dc102970 2024-05-14T09:26:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.716+0000 7f57e7bf5740 1 Processor -- start 2024-05-14T09:26:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.716+0000 7f57d2a00640 1 -- 172.21.15.120:0/3281591021 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f57cc042070 con 0x7f57dc102970 2024-05-14T09:26:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.716+0000 7f57e7bf5740 1 -- start start 2024-05-14T09:26:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6116d1b0 0x55fe6150f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe611442f0 0x55fe6150f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe61516780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55fe61473550 con 0x55fe6114c4d0 2024-05-14T09:26:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fe61418bc0 con 0x55fe611442f0 2024-05-14T09:26:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe6146f510 con 0x55fe6116d1b0 2024-05-14T09:26:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57d9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe61516780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57d9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe61516780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39176/0 (socket says 172.21.15.120:39176) 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.717+0000 7f57d9400640 1 -- 172.21.15.120:0/1977100011 learned_addr learned my addr 172.21.15.120:0/1977100011 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57da800640 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6116d1b0 0x55fe6150f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9e00640 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe611442f0 0x55fe6150f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9400640 1 -- 172.21.15.120:0/1977100011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6116d1b0 msgr2=0x55fe6150f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9400640 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6116d1b0 0x55fe6150f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9400640 1 -- 172.21.15.120:0/1977100011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe611442f0 msgr2=0x55fe6150f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9400640 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe611442f0 0x55fe6150f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9400640 1 -- 172.21.15.120:0/1977100011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe61185210 con 0x55fe6114c4d0 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9e00640 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe611442f0 0x55fe6150f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.718+0000 7f57d9400640 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe61516780 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f57c800bc90 tx=0x7f57c800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6fa4a0a5850ad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.719+0000 7f57d2a00640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f57c00b27e0 0x7f57c00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.719+0000 7f57c7000640 1 -- 172.21.15.120:0/1977100011 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8015070 con 0x55fe6114c4d0 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.719+0000 7f57d2a00640 1 -- 172.21.15.120:0/3281591021 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f57cc102f80 con 0x7f57dc102970 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.719+0000 7f57c7000640 1 -- 172.21.15.120:0/1977100011 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57c801a8f0 con 0x55fe6114c4d0 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.719+0000 7f57c7000640 1 -- 172.21.15.120:0/1977100011 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c80117c0 con 0x55fe6114c4d0 2024-05-14T09:26:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.719+0000 7f57da800640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f57c00b27e0 0x7f57c00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 -- 172.21.15.120:0/1977100011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 msgr2=0x55fe61516780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57da800640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f57c00b27e0 0x7f57c00b4cf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55fe615104d0 tx=0x7f57d4007680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe61516780 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f57c800bc90 tx=0x7f57c800f730 comp rx=0 tx=0).stop 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 -- 172.21.15.120:0/1977100011 shutdown_connections 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe61516780 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe611442f0 0x55fe6150f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/1977100011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6116d1b0 0x55fe6150f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 -- 172.21.15.120:0/1977100011 >> 172.21.15.120:0/1977100011 conn(0x55fe61161300 msgr2=0x55fe6150ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.720+0000 7f57e7bf5740 1 -- 172.21.15.120:0/1977100011 shutdown_connections 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.721+0000 7f57e7bf5740 1 -- 172.21.15.120:0/1977100011 wait complete. 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.721+0000 7f57e7bf5740 1 -- start start 2024-05-14T09:26:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.721+0000 7f57e7bf5740 1 Processor -- start 2024-05-14T09:26:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe611442f0 0x55fe61518e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6114c4d0 0x55fe61519360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe615202c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55fe615171d0 con 0x55fe611442f0 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fe6142c660 con 0x55fe6116d1b0 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe61517350 con 0x55fe6114c4d0 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57e7bf5740 10 client.0 _ll_register_callbacks cb 0x55fe613f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57d9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe611442f0 0x55fe61518e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57d9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe611442f0 0x55fe61518e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39186/0 (socket says 172.21.15.120:39186) 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.722+0000 7f57d9e00640 1 -- 172.21.15.120:0/3198243227 learned_addr learned my addr 172.21.15.120:0/3198243227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57d9400640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6114c4d0 0x55fe61519360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57d9e00640 1 -- 172.21.15.120:0/3198243227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6114c4d0 msgr2=0x55fe61519360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6114c4d0 0x55fe61519360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57d9e00640 1 -- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 msgr2=0x55fe615202c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57da800640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe615202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe615202c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57d9e00640 1 -- 172.21.15.120:0/3198243227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe61251620 con 0x55fe611442f0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57da800640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe615202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe611442f0 0x55fe61518e20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0c9ea0 tx=0x7f57cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48ea65bf060951d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.723+0000 7f57bb400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.724+0000 7f57bb400640 1 -- 172.21.15.120:0/3198243227 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc049070 con 0x55fe611442f0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.724+0000 7f57bb400640 1 -- 172.21.15.120:0/3198243227 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f57cc0c6430 con 0x55fe611442f0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.724+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57c801a8f0 con 0x55fe611442f0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.724+0000 7f57bb400640 1 -- 172.21.15.120:0/3198243227 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f57cc0ca8a0 con 0x55fe611442f0 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.724+0000 7f57e7bf5740 10 client.15891 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.724+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fe615231f0 con 0x55fe611442f0 2024-05-14T09:26:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.724+0000 7f57bb400640 1 -- 172.21.15.120:0/3198243227 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57c801a8f0 con 0x55fe611442f0 2024-05-14T09:26:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.725+0000 7f57bb400640 1 -- 172.21.15.120:0/3198243227 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f57cc03b4f0 con 0x55fe611442f0 2024-05-14T09:26:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.725+0000 7f57e7bf5740 10 client.15891 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.725+0000 7f57e7bf5740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.725+0000 7f57e7bf5740 20 client.15891 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.725+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe6112bd80 0x55fe615269f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.725+0000 7f57e7bf5740 4 client.15891 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.725+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe61481160 con 0x55fe6112bd80 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.726+0000 7f57d9400640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe6112bd80 0x55fe615269f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.727+0000 7f57bb400640 10 client.15891 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.727+0000 7f57d9400640 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe6112bd80 0x55fe615269f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a7c752c982e30f server_cookie=e8bcea4572810975 in_seq=0 out_seq=0 2024-05-14T09:26:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.729+0000 7f57bb400640 1 -- 172.21.15.120:0/3198243227 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fe61481160 con 0x55fe6112bd80 2024-05-14T09:26:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.729+0000 7f57bb400640 10 client.15891 handle_command_reply: tid=0 2024-05-14T09:26:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.729+0000 7f57e7bf5740 1 client.15891 shutdown 2024-05-14T09:26:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.729+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe611442f0 msgr2=0x55fe61518e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.729+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe611442f0 0x55fe61518e20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0c9ea0 tx=0x7f57cc0045e0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 shutdown_connections 2024-05-14T09:26:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe6112bd80 0x55fe615269f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe615202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6114c4d0 0x55fe61519360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57bb400640 0 client.15891 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3198243227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe611442f0 0x55fe61518e20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 >> 172.21.15.120:0/3198243227 conn(0x55fe61161300 msgr2=0x55fe61509c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 shutdown_connections 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3198243227 wait complete. 2024-05-14T09:26:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.730+0000 7f57e7bf5740 20 client.15891 trim_cache size 0 max 16384 2024-05-14T09:26:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.752+0000 7f57e7bf5740 1 Processor -- start 2024-05-14T09:26:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57e7bf5740 1 -- start start 2024-05-14T09:26:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe61519100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6114c4d0 0x55fe61520250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6116d1b0 0x55fe61517720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1aa580 con 0x55fe6116d1b0 2024-05-14T09:26:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1ac1b0 con 0x55fe6114c4d0 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1aac50 con 0x55fe611442f0 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57da800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6116d1b0 0x55fe61517720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57da800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6116d1b0 0x55fe61517720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39190/0 (socket says 172.21.15.120:39190) 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.753+0000 7f57da800640 1 -- 172.21.15.120:0/3615845454 learned_addr learned my addr 172.21.15.120:0/3615845454 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe61519100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57d9400640 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6114c4d0 0x55fe61520250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57da800640 1 -- 172.21.15.120:0/3615845454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 msgr2=0x55fe61519100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57da800640 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe61519100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57da800640 1 -- 172.21.15.120:0/3615845454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6114c4d0 msgr2=0x55fe61520250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57da800640 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6114c4d0 0x55fe61520250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57da800640 1 -- 172.21.15.120:0/3615845454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe61516620 con 0x55fe6116d1b0 2024-05-14T09:26:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57d9e00640 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe61519100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.754+0000 7f57da800640 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6116d1b0 0x55fe61517720 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f57d400ee10 tx=0x7f57d401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d4ccb920462e78 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.755+0000 7f57c6600640 1 -- 172.21.15.120:0/3615845454 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4032070 con 0x55fe6116d1b0 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.755+0000 7f57c6600640 1 -- 172.21.15.120:0/3615845454 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57d4024db0 con 0x55fe6116d1b0 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.755+0000 7f57c6600640 1 -- 172.21.15.120:0/3615845454 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d402dc70 con 0x55fe6116d1b0 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3615845454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6116d1b0 msgr2=0x55fe61517720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6116d1b0 0x55fe61517720 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f57d400ee10 tx=0x7f57d401c000 comp rx=0 tx=0).stop 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3615845454 shutdown_connections 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6116d1b0 0x55fe61517720 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6114c4d0 0x55fe61520250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/3615845454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe61519100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3615845454 >> 172.21.15.120:0/3615845454 conn(0x55fe61161300 msgr2=0x55fe615189f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3615845454 shutdown_connections 2024-05-14T09:26:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.756+0000 7f57e7bf5740 1 -- 172.21.15.120:0/3615845454 wait complete. 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.757+0000 7f57e7bf5740 1 -- start start 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.757+0000 7f57e7bf5740 1 Processor -- start 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.757+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe615201e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe6151cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57e7bf5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe6151d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1aba20 con 0x55fe6114c4d0 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1ab350 con 0x55fe6116d1b0 2024-05-14T09:26:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57e7bf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1a85a0 con 0x55fe611442f0 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57e7bf5740 10 client.0 _ll_register_callbacks cb 0x7f57cc009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe6151cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe6151cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39204/0 (socket says 172.21.15.120:39204) 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 -- 172.21.15.120:0/546953149 learned_addr learned my addr 172.21.15.120:0/546953149 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9e00640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe615201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57da800640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe6151d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 -- 172.21.15.120:0/546953149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 msgr2=0x55fe615201e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe615201e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 -- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 msgr2=0x55fe6151d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe6151d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9400640 1 -- 172.21.15.120:0/546953149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6158cd80 con 0x55fe6114c4d0 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.758+0000 7f57d9e00640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe615201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.759+0000 7f57d9400640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe6151cd60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55fe6150ba20 tx=0x7f57c8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a41da1129a10eae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.759+0000 7f57bb400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.759+0000 7f57bb400640 1 -- 172.21.15.120:0/546953149 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c802a020 con 0x55fe6114c4d0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.759+0000 7f57bb400640 1 -- 172.21.15.120:0/546953149 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f57c8005450 con 0x55fe6114c4d0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.759+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57d4024db0 con 0x55fe6114c4d0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57bb400640 1 -- 172.21.15.120:0/546953149 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f57c8035050 con 0x55fe6114c4d0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57e7bf5740 10 client.15897 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fe6158e090 con 0x55fe6114c4d0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57bb400640 1 -- 172.21.15.120:0/546953149 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57d4024db0 con 0x55fe6114c4d0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57bb400640 1 -- 172.21.15.120:0/546953149 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f57c8004780 con 0x55fe6114c4d0 2024-05-14T09:26:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57e7bf5740 10 client.15897 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57e7bf5740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57e7bf5740 20 client.15897 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe611011c0 0x55fe615908d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.760+0000 7f57e7bf5740 4 client.15897 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.761+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe6147afd0 con 0x55fe611011c0 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.761+0000 7f57d9e00640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe611011c0 0x55fe615908d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.762+0000 7f57d9e00640 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe611011c0 0x55fe615908d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4a733f547ef728e server_cookie=4105a5a9af68e8ca in_seq=0 out_seq=0 2024-05-14T09:26:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.762+0000 7f57bb400640 10 client.15897 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:14.800 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.799+0000 7f57bb400640 1 -- 172.21.15.120:0/546953149 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe6147afd0 con 0x55fe611011c0 2024-05-14T09:26:14.800 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.799+0000 7f57bb400640 10 client.15897 handle_command_reply: tid=0 2024-05-14T09:26:14.800 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.799+0000 7f57e7bf5740 1 client.15897 shutdown 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 msgr2=0x55fe6151cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe6151cd60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55fe6150ba20 tx=0x7f57c8005c50 comp rx=0 tx=0).stop 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 shutdown_connections 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fe611011c0 0x55fe615908d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe6116d1b0 0x55fe6151d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fe6114c4d0 0x55fe6151cd60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 --2- 172.21.15.120:0/546953149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe611442f0 0x55fe615201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57bb400640 0 client.15897 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 >> 172.21.15.120:0/546953149 conn(0x55fe61161300 msgr2=0x55fe61519180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 shutdown_connections 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 1 -- 172.21.15.120:0/546953149 wait complete. 2024-05-14T09:26:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.800+0000 7f57e7bf5740 20 client.15897 trim_cache size 0 max 16384 2024-05-14T09:26:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:26:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:26:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:26:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f57c00b27e0 msgr2=0x7f57c00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f57c00b27e0 0x7f57c00b4cf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55fe615104d0 tx=0x7f57d4007680 comp rx=0 tx=0).stop 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 msgr2=0x7f57dc0ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc0ff9f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f57cc005760 tx=0x7f57cc003d50 comp rx=0 tx=0).stop 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 shutdown_connections 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f57c00b27e0 0x7f57c00b4cf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57dc1088b0 0x7f57dc0fe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc103bb0 0x7f57dc0fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 --2- 172.21.15.120:0/3281591021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc102970 0x7f57dc0ff9f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.801+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 >> 172.21.15.120:0/3281591021 conn(0x7f57dc0fdb60 msgr2=0x7f57dc109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.802+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 shutdown_connections 2024-05-14T09:26:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:14.802+0000 7f57db200640 1 -- 172.21.15.120:0/3281591021 wait complete. 2024-05-14T09:26:14.894 INFO:teuthology.orchestra.run.smithi120.stderr:2800000 of 3200000 tuples (87%) done (elapsed 102.12 s, remaining 14.59 s) 2024-05-14T09:26:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:15 smithi120 ceph-mon[31085]: pgmap v637: 129 pgs: 129 active+clean; 656 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:26:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:15 smithi152 ceph-mon[34868]: pgmap v637: 129 pgs: 129 active+clean; 656 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:26:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:15 smithi175 ceph-mon[35353]: pgmap v637: 129 pgs: 129 active+clean; 656 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 22 op/s 2024-05-14T09:26:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:17 smithi120 ceph-mon[31085]: pgmap v638: 129 pgs: 129 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 24 op/s 2024-05-14T09:26:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:17 smithi152 ceph-mon[34868]: pgmap v638: 129 pgs: 129 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 24 op/s 2024-05-14T09:26:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:17 smithi175 ceph-mon[35353]: pgmap v638: 129 pgs: 129 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 24 op/s 2024-05-14T09:26:19.367 INFO:teuthology.orchestra.run.smithi120.stderr:2900000 of 3200000 tuples (90%) done (elapsed 106.59 s, remaining 11.03 s) 2024-05-14T09:26:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:19 smithi120 ceph-mon[31085]: pgmap v639: 129 pgs: 129 active+clean; 688 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 MiB/s wr, 21 op/s 2024-05-14T09:26:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:19 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:26:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:19 smithi152 ceph-mon[34868]: pgmap v639: 129 pgs: 129 active+clean; 688 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 MiB/s wr, 21 op/s 2024-05-14T09:26:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:19 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:26:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:19 smithi175 ceph-mon[35353]: pgmap v639: 129 pgs: 129 active+clean; 688 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 MiB/s wr, 21 op/s 2024-05-14T09:26:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:19 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:26:21.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:26:21.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:26:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:26:21.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:26:21.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:26:21.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:26:21.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:26:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:21 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi152 to 176.4M 2024-05-14T09:26:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:21 smithi152 ceph-mon[34868]: Unable to set osd_memory_target on smithi152 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-14T09:26:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:21 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi120 to 176.4M 2024-05-14T09:26:22.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:21 smithi152 ceph-mon[34868]: Unable to set osd_memory_target on smithi120 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:26:22.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:21 smithi152 ceph-mon[34868]: pgmap v640: 129 pgs: 129 active+clean; 696 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:21 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi152 to 176.4M 2024-05-14T09:26:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:21 smithi175 ceph-mon[35353]: Unable to set osd_memory_target on smithi152 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-14T09:26:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:21 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi120 to 176.4M 2024-05-14T09:26:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:21 smithi175 ceph-mon[35353]: Unable to set osd_memory_target on smithi120 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:26:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:21 smithi175 ceph-mon[35353]: pgmap v640: 129 pgs: 129 active+clean; 696 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:21 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi152 to 176.4M 2024-05-14T09:26:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:21 smithi120 ceph-mon[31085]: Unable to set osd_memory_target on smithi152 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-14T09:26:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:21 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi120 to 176.4M 2024-05-14T09:26:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:21 smithi120 ceph-mon[31085]: Unable to set osd_memory_target on smithi120 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:26:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:21 smithi120 ceph-mon[31085]: pgmap v640: 129 pgs: 129 active+clean; 696 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:23.471 INFO:teuthology.orchestra.run.smithi120.stderr:3000000 of 3200000 tuples (93%) done (elapsed 110.70 s, remaining 7.38 s) 2024-05-14T09:26:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:23 smithi152 ceph-mon[34868]: pgmap v641: 129 pgs: 129 active+clean; 704 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 20 op/s 2024-05-14T09:26:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:23 smithi175 ceph-mon[35353]: pgmap v641: 129 pgs: 129 active+clean; 704 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 20 op/s 2024-05-14T09:26:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:23 smithi120 ceph-mon[31085]: pgmap v641: 129 pgs: 129 active+clean; 704 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 20 op/s 2024-05-14T09:26:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:25 smithi152 ceph-mon[34868]: pgmap v642: 129 pgs: 129 active+clean; 716 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T09:26:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:25 smithi175 ceph-mon[35353]: pgmap v642: 129 pgs: 129 active+clean; 716 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T09:26:26.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:25 smithi120 ceph-mon[31085]: pgmap v642: 129 pgs: 129 active+clean; 716 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T09:26:27.807 INFO:teuthology.orchestra.run.smithi120.stderr:3100000 of 3200000 tuples (96%) done (elapsed 115.03 s, remaining 3.71 s) 2024-05-14T09:26:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.060+0000 7fb26e200640 1 -- 172.21.15.120:0/2134476780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 msgr2=0x7fb2681065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.060+0000 7fb26e200640 1 --2- 172.21.15.120:0/2134476780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb2681065c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009900 tx=0x7fb25c02a410 comp rx=0 tx=0).stop 2024-05-14T09:26:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.061+0000 7fb26e200640 1 -- 172.21.15.120:0/2134476780 shutdown_connections 2024-05-14T09:26:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.061+0000 7fb26e200640 1 --2- 172.21.15.120:0/2134476780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268109700 0x7fb26810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.061+0000 7fb26e200640 1 --2- 172.21.15.120:0/2134476780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb268106b90 0x7fb268109070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.061+0000 7fb26e200640 1 --2- 172.21.15.120:0/2134476780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb2681065c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.061+0000 7fb26e200640 1 -- 172.21.15.120:0/2134476780 >> 172.21.15.120:0/2134476780 conn(0x7fb2680fdb60 msgr2=0x7fb268100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.061+0000 7fb26e200640 1 -- 172.21.15.120:0/2134476780 shutdown_connections 2024-05-14T09:26:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.061+0000 7fb26e200640 1 -- 172.21.15.120:0/2134476780 wait complete. 2024-05-14T09:26:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.062+0000 7fb26e200640 1 Processor -- start 2024-05-14T09:26:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.062+0000 7fb26e200640 1 -- start start 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb26819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb268106b90 0x7fb26819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26e200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268109700 0x7fb2681a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26e200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb26810f460 con 0x7fb2681041a0 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26e200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb26810f2e0 con 0x7fb268109700 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26e200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb26810f5e0 con 0x7fb268106b90 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb26819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb267e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb268106b90 0x7fb26819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb26819a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41800/0 (socket says 172.21.15.120:41800) 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.063+0000 7fb26ce00640 1 -- 172.21.15.120:0/1298196435 learned_addr learned my addr 172.21.15.120:0/1298196435 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26d800640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268109700 0x7fb2681a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26ce00640 1 -- 172.21.15.120:0/1298196435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb268106b90 msgr2=0x7fb26819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26ce00640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb268106b90 0x7fb26819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26ce00640 1 -- 172.21.15.120:0/1298196435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268109700 msgr2=0x7fb2681a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26ce00640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268109700 0x7fb2681a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26ce00640 1 -- 172.21.15.120:0/1298196435 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2681a1c10 con 0x7fb2681041a0 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26d800640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268109700 0x7fb2681a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.064+0000 7fb26ce00640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb26819a0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb25c005760 tx=0x7fb25c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.065+0000 7fb265600640 1 -- 172.21.15.120:0/1298196435 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c03f070 con 0x7fb2681041a0 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.065+0000 7fb265600640 1 -- 172.21.15.120:0/1298196435 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb25c031da0 con 0x7fb2681041a0 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.065+0000 7fb265600640 1 -- 172.21.15.120:0/1298196435 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c035030 con 0x7fb2681041a0 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.065+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb268101f90 con 0x7fb2681041a0 2024-05-14T09:26:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.065+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb268102480 con 0x7fb2681041a0 2024-05-14T09:26:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.069+0000 7fb276868740 1 Processor -- start 2024-05-14T09:26:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.069+0000 7fb265600640 1 -- 172.21.15.120:0/1298196435 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb25c042070 con 0x7fb2681041a0 2024-05-14T09:26:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb276868740 1 -- start start 2024-05-14T09:26:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb276868740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf80f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb276868740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf80f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb276868740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf44c4d0 0x564ecf816780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb276868740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564ecf773550 con 0x564ecf46d1b0 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb276868740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564ecf718bc0 con 0x564ecf44c4d0 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb276868740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564ecf76f510 con 0x564ecf4442f0 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb26d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf80f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb26d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf80f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41806/0 (socket says 172.21.15.120:41806) 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.070+0000 7fb26d800640 1 -- 172.21.15.120:0/3788723144 learned_addr learned my addr 172.21.15.120:0/3788723144 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb26ce00640 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf80f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb267e00640 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf44c4d0 0x564ecf816780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb26d800640 1 -- 172.21.15.120:0/3788723144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 msgr2=0x564ecf80f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb26d800640 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf80f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb26d800640 1 -- 172.21.15.120:0/3788723144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf44c4d0 msgr2=0x564ecf816780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb26d800640 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf44c4d0 0x564ecf816780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb26d800640 1 -- 172.21.15.120:0/3788723144 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecf485210 con 0x564ecf46d1b0 2024-05-14T09:26:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.071+0000 7fb26ce00640 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf80f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.072+0000 7fb265600640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb2500b27e0 0x7fb2500b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.072+0000 7fb26d800640 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf80f300 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb260009fb0 tx=0x7fb260010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107e7a93fd497d5a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.072+0000 7fb265600640 1 -- 172.21.15.120:0/1298196435 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb25c102fd0 con 0x7fb2681041a0 2024-05-14T09:26:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.072+0000 7fb25a000640 1 -- 172.21.15.120:0/3788723144 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260016070 con 0x564ecf46d1b0 2024-05-14T09:26:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.072+0000 7fb25a000640 1 -- 172.21.15.120:0/3788723144 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb260012ba0 con 0x564ecf46d1b0 2024-05-14T09:26:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.072+0000 7fb25a000640 1 -- 172.21.15.120:0/3788723144 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26001bb40 con 0x564ecf46d1b0 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.072+0000 7fb26ce00640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb2500b27e0 0x7fb2500b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.073+0000 7fb276868740 1 -- 172.21.15.120:0/3788723144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 msgr2=0x564ecf80f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.073+0000 7fb26ce00640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb2500b27e0 0x7fb2500b4cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0ca180 tx=0x7fb25c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.073+0000 7fb276868740 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf80f300 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb260009fb0 tx=0x7fb260010800 comp rx=0 tx=0).stop 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 -- 172.21.15.120:0/3788723144 shutdown_connections 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf44c4d0 0x564ecf816780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf80f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 --2- 172.21.15.120:0/3788723144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf80f300 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 -- 172.21.15.120:0/3788723144 >> 172.21.15.120:0/3788723144 conn(0x564ecf461300 msgr2=0x564ecf80ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 -- 172.21.15.120:0/3788723144 shutdown_connections 2024-05-14T09:26:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 -- 172.21.15.120:0/3788723144 wait complete. 2024-05-14T09:26:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.074+0000 7fb276868740 1 -- start start 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.075+0000 7fb276868740 1 Processor -- start 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.075+0000 7fb276868740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf821600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.075+0000 7fb276868740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf821b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.075+0000 7fb276868740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 0x564ecf828aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.075+0000 7fb276868740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564ecf8171d0 con 0x564ecf44c4d0 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.075+0000 7fb276868740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564ecf72c660 con 0x564ecf4442f0 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb276868740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564ecf817350 con 0x564ecf46d1b0 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb276868740 10 client.0 _ll_register_callbacks cb 0x564ecf6f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf821b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb26d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf821600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf821b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41822/0 (socket says 172.21.15.120:41822) 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 -- 172.21.15.120:0/4096277783 learned_addr learned my addr 172.21.15.120:0/4096277783 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb26d800640 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 0x564ecf828aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 -- 172.21.15.120:0/4096277783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 msgr2=0x564ecf828aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 0x564ecf828aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 -- 172.21.15.120:0/4096277783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 msgr2=0x564ecf821600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf821600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.076+0000 7fb267e00640 1 -- 172.21.15.120:0/4096277783 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecf551620 con 0x564ecf44c4d0 2024-05-14T09:26:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.077+0000 7fb267e00640 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf821b40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb2540042c0 tx=0x7fb2540039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b630be699e5e40 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.077+0000 7fb24ea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.077+0000 7fb24ea00640 1 -- 172.21.15.120:0/4096277783 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25400e770 con 0x564ecf44c4d0 2024-05-14T09:26:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.077+0000 7fb24ea00640 1 -- 172.21.15.120:0/4096277783 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb25400e910 con 0x564ecf44c4d0 2024-05-14T09:26:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.078+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb260012ba0 con 0x564ecf44c4d0 2024-05-14T09:26:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.078+0000 7fb24ea00640 1 -- 172.21.15.120:0/4096277783 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb254024050 con 0x564ecf44c4d0 2024-05-14T09:26:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.078+0000 7fb276868740 10 client.15909 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.078+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564ecf81b540 con 0x564ecf44c4d0 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.079+0000 7fb24ea00640 1 -- 172.21.15.120:0/4096277783 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb260012ba0 con 0x564ecf44c4d0 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.079+0000 7fb24ea00640 1 -- 172.21.15.120:0/4096277783 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fb25400f040 con 0x564ecf44c4d0 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.080+0000 7fb276868740 10 client.15909 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.080+0000 7fb276868740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.080+0000 7fb276868740 20 client.15909 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.080+0000 7fb276868740 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf42bd80 0x564ecf81edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.080+0000 7fb276868740 4 client.15909 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.080+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ecf781160 con 0x564ecf42bd80 2024-05-14T09:26:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.080+0000 7fb26d800640 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf42bd80 0x564ecf81edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.081+0000 7fb26d800640 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf42bd80 0x564ecf81edf0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e01e93906e6ec17 server_cookie=34c37afa48707555 in_seq=0 out_seq=0 2024-05-14T09:26:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.081+0000 7fb24ea00640 10 client.15909 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.083+0000 7fb24ea00640 1 -- 172.21.15.120:0/4096277783 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564ecf781160 con 0x564ecf42bd80 2024-05-14T09:26:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.083+0000 7fb24ea00640 10 client.15909 handle_command_reply: tid=0 2024-05-14T09:26:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.083+0000 7fb276868740 1 client.15909 shutdown 2024-05-14T09:26:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 msgr2=0x564ecf821b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf821b40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb2540042c0 tx=0x7fb2540039c0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 shutdown_connections 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf42bd80 0x564ecf81edf0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 0x564ecf828aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf821b40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 --2- 172.21.15.120:0/4096277783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf821600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb24ea00640 0 client.15909 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 >> 172.21.15.120:0/4096277783 conn(0x564ecf461300 msgr2=0x564ecf809c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 shutdown_connections 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 1 -- 172.21.15.120:0/4096277783 wait complete. 2024-05-14T09:26:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.084+0000 7fb276868740 20 client.15909 trim_cache size 0 max 16384 2024-05-14T09:26:28.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.107+0000 7fb276868740 1 Processor -- start 2024-05-14T09:26:28.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb276868740 1 -- start start 2024-05-14T09:26:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb276868740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf813250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb276868740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf8289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb276868740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 0x564ecf813790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb276868740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681aa710 con 0x564ecf44c4d0 2024-05-14T09:26:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb276868740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681ac340 con 0x564ecf4442f0 2024-05-14T09:26:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb276868740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681aade0 con 0x564ecf46d1b0 2024-05-14T09:26:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb267e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf8289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb267e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf8289c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41824/0 (socket says 172.21.15.120:41824) 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.108+0000 7fb267e00640 1 -- 172.21.15.120:0/4202212193 learned_addr learned my addr 172.21.15.120:0/4202212193 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb26d800640 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf813250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb267e00640 1 -- 172.21.15.120:0/4202212193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 msgr2=0x564ecf813790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb267e00640 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 0x564ecf813790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb267e00640 1 -- 172.21.15.120:0/4202212193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 msgr2=0x564ecf813250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb267e00640 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf813250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb267e00640 1 -- 172.21.15.120:0/4202212193 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecf8064a0 con 0x564ecf44c4d0 2024-05-14T09:26:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb26d800640 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf813250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:28.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.109+0000 7fb267e00640 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf8289c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb25400fa30 tx=0x7fb254003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf14858edc4a2d3d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:28.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.110+0000 7fb259600640 1 -- 172.21.15.120:0/4202212193 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254019630 con 0x564ecf44c4d0 2024-05-14T09:26:28.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.110+0000 7fb259600640 1 -- 172.21.15.120:0/4202212193 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb25402d070 con 0x564ecf44c4d0 2024-05-14T09:26:28.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.110+0000 7fb259600640 1 -- 172.21.15.120:0/4202212193 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254018e30 con 0x564ecf44c4d0 2024-05-14T09:26:28.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 -- 172.21.15.120:0/4202212193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 msgr2=0x564ecf8289c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf8289c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb25400fa30 tx=0x7fb254003ee0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 -- 172.21.15.120:0/4202212193 shutdown_connections 2024-05-14T09:26:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf46d1b0 0x564ecf813790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf44c4d0 0x564ecf8289c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 --2- 172.21.15.120:0/4202212193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4442f0 0x564ecf813250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 -- 172.21.15.120:0/4202212193 >> 172.21.15.120:0/4202212193 conn(0x564ecf461300 msgr2=0x564ecf80f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 -- 172.21.15.120:0/4202212193 shutdown_connections 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.111+0000 7fb276868740 1 -- 172.21.15.120:0/4202212193 wait complete. 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.112+0000 7fb276868740 1 -- start start 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.112+0000 7fb276868740 1 Processor -- start 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.112+0000 7fb276868740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf823c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb276868740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf8241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb276868740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4011c0 0x564ecf8270e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb276868740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681abbb0 con 0x564ecf46d1b0 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb276868740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681ab4e0 con 0x564ecf4011c0 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb276868740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681a8710 con 0x564ecf4442f0 2024-05-14T09:26:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb276868740 10 client.0 _ll_register_callbacks cb 0x7fb25400fb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf8241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf8241a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41838/0 (socket says 172.21.15.120:41838) 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 -- 172.21.15.120:0/480829445 learned_addr learned my addr 172.21.15.120:0/480829445 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb26d800640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf823c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb26d800640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4011c0 0x564ecf8270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 -- 172.21.15.120:0/480829445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 msgr2=0x564ecf823c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf823c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 -- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4011c0 msgr2=0x564ecf8270e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4011c0 0x564ecf8270e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb267e00640 1 -- 172.21.15.120:0/480829445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecf8276a0 con 0x564ecf46d1b0 2024-05-14T09:26:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.113+0000 7fb26d800640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4011c0 0x564ecf8270e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.114+0000 7fb267e00640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf8241a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb254019d20 tx=0x7fb2540039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8097f7bd6fb5a314 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.114+0000 7fb24ea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.114+0000 7fb24ea00640 1 -- 172.21.15.120:0/480829445 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25403f060 con 0x564ecf46d1b0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.114+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb25402d070 con 0x564ecf46d1b0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.114+0000 7fb24ea00640 1 -- 172.21.15.120:0/480829445 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb2540187f0 con 0x564ecf46d1b0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.115+0000 7fb24ea00640 1 -- 172.21.15.120:0/480829445 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb254046050 con 0x564ecf46d1b0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.115+0000 7fb276868740 10 client.15915 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.115+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564ecf8288a0 con 0x564ecf46d1b0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.115+0000 7fb24ea00640 1 -- 172.21.15.120:0/480829445 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb25402d070 con 0x564ecf46d1b0 2024-05-14T09:26:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.115+0000 7fb24ea00640 1 -- 172.21.15.120:0/480829445 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fb2540328c0 con 0x564ecf46d1b0 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.116+0000 7fb276868740 10 client.15915 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.116+0000 7fb276868740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.116+0000 7fb276868740 20 client.15915 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.116+0000 7fb276868740 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf89fe40 0x564ecf8a2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.116+0000 7fb276868740 4 client.15915 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.116+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ecf77afd0 con 0x564ecf89fe40 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.116+0000 7fb26d800640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf89fe40 0x564ecf8a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.117+0000 7fb26d800640 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf89fe40 0x564ecf8a2260 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c70b5fe25b79ef5 server_cookie=31fb0c24e9c92843 in_seq=0 out_seq=0 2024-05-14T09:26:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.117+0000 7fb24ea00640 10 client.15915 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.159+0000 7fb24ea00640 1 -- 172.21.15.120:0/480829445 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ecf77afd0 con 0x564ecf89fe40 2024-05-14T09:26:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.159+0000 7fb24ea00640 10 client.15915 handle_command_reply: tid=0 2024-05-14T09:26:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.159+0000 7fb276868740 1 client.15915 shutdown 2024-05-14T09:26:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.159+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 msgr2=0x564ecf8241a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.159+0000 7fb276868740 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf8241a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb254019d20 tx=0x7fb2540039c0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.159+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 shutdown_connections 2024-05-14T09:26:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.159+0000 7fb276868740 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564ecf89fe40 0x564ecf8a2260 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb276868740 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564ecf4011c0 0x564ecf8270e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb276868740 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ecf46d1b0 0x564ecf8241a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb276868740 1 --2- 172.21.15.120:0/480829445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ecf4442f0 0x564ecf823c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb24ea00640 0 client.15915 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 >> 172.21.15.120:0/480829445 conn(0x564ecf461300 msgr2=0x564ecf80f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 shutdown_connections 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb276868740 1 -- 172.21.15.120:0/480829445 wait complete. 2024-05-14T09:26:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.160+0000 7fb276868740 20 client.15915 trim_cache size 0 max 16384 2024-05-14T09:26:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:26:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:26:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:26:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb2500b27e0 msgr2=0x7fb2500b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb2500b27e0 0x7fb2500b4cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0ca180 tx=0x7fb25c009260 comp rx=0 tx=0).stop 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 msgr2=0x7fb26819a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb26819a0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb25c005760 tx=0x7fb25c003d50 comp rx=0 tx=0).stop 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 shutdown_connections 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb2500b27e0 0x7fb2500b4cf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268109700 0x7fb2681a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb268106b90 0x7fb26819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 --2- 172.21.15.120:0/1298196435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2681041a0 0x7fb26819a0d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 >> 172.21.15.120:0/1298196435 conn(0x7fb2680fdb60 msgr2=0x7fb268106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 shutdown_connections 2024-05-14T09:26:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:28.161+0000 7fb26e200640 1 -- 172.21.15.120:0/1298196435 wait complete. 2024-05-14T09:26:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:27 smithi152 ceph-mon[34868]: pgmap v643: 129 pgs: 129 active+clean; 732 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:26:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:27 smithi175 ceph-mon[35353]: pgmap v643: 129 pgs: 129 active+clean; 732 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:26:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:27 smithi120 ceph-mon[31085]: pgmap v643: 129 pgs: 129 active+clean; 732 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:26:28.802 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:26:29.275 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:29 smithi120 ceph-mon[31085]: pgmap v644: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 22 op/s 2024-05-14T09:26:30.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:29 smithi152 ceph-mon[34868]: pgmap v644: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 22 op/s 2024-05-14T09:26:30.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:29 smithi175 ceph-mon[35353]: pgmap v644: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 22 op/s 2024-05-14T09:26:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:3200000 of 3200000 tuples (100%) done (elapsed 118.89 s, remaining 0.00 s) 2024-05-14T09:26:31.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 -- 172.21.15.120:0/2606976363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106570 msgr2=0x7f3bf4106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 --2- 172.21.15.120:0/2606976363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106570 0x7f3bf4106980 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009990 tx=0x7f3bdc009ca0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 -- 172.21.15.120:0/2606976363 shutdown_connections 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 --2- 172.21.15.120:0/2606976363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf410c5b0 0x7f3bf410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 --2- 172.21.15.120:0/2606976363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bf4106ec0 0x7f3bf4113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 --2- 172.21.15.120:0/2606976363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106570 0x7f3bf4106980 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 -- 172.21.15.120:0/2606976363 >> 172.21.15.120:0/2606976363 conn(0x7f3bf41020d0 msgr2=0x7f3bf4104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 -- 172.21.15.120:0/2606976363 shutdown_connections 2024-05-14T09:26:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.807+0000 7f3bfa000700 1 -- 172.21.15.120:0/2606976363 wait complete. 2024-05-14T09:26:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.808+0000 7f3bfa000700 1 Processor -- start 2024-05-14T09:26:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.809+0000 7f3bfa000700 1 -- start start 2024-05-14T09:26:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.809+0000 7f3bfa000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bf4106570 0x7f3bf40753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.809+0000 7f3bfa000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106ec0 0x7f3bf406e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.809+0000 7f3bfa000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf410c5b0 0x7f3bf406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.809+0000 7f3bfa000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4116560 con 0x7f3bf4106ec0 2024-05-14T09:26:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.809+0000 7f3bfa000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf41163e0 con 0x7f3bf410c5b0 2024-05-14T09:26:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.809+0000 7f3bfa000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf41166e0 con 0x7f3bf4106570 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bf3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bf4106570 0x7f3bf40753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106ec0 0x7f3bf406e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106ec0 0x7f3bf406e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43326/0 (socket says 172.21.15.120:43326) 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 -- 172.21.15.120:0/3596193994 learned_addr learned my addr 172.21.15.120:0/3596193994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bf3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bf4106570 0x7f3bf40753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36980/0 (socket says 172.21.15.120:36980) 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf410c5b0 0x7f3bf406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 -- 172.21.15.120:0/3596193994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bf4106570 msgr2=0x7f3bf40753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bf4106570 0x7f3bf40753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 -- 172.21.15.120:0/3596193994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf410c5b0 msgr2=0x7f3bf406eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf410c5b0 0x7f3bf406eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.810+0000 7f3bebe00700 1 -- 172.21.15.120:0/3596193994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf4072f00 con 0x7f3bf4106ec0 2024-05-14T09:26:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.811+0000 7f3bebe00700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106ec0 0x7f3bf406e500 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006010 tx=0x7f3bdc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.811+0000 7f3bf0c00700 1 -- 172.21.15.120:0/3596193994 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc027070 con 0x7f3bf4106ec0 2024-05-14T09:26:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.811+0000 7f3bf0c00700 1 -- 172.21.15.120:0/3596193994 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bdc00fb00 con 0x7f3bf4106ec0 2024-05-14T09:26:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.811+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf4073190 con 0x7f3bf4106ec0 2024-05-14T09:26:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.812+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf4073670 con 0x7f3bf4106ec0 2024-05-14T09:26:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.812+0000 7f3bf0c00700 1 -- 172.21.15.120:0/3596193994 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0229d0 con 0x7f3bf4106ec0 2024-05-14T09:26:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.817+0000 7f3bf0c00700 1 -- 172.21.15.120:0/3596193994 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3bdc02a070 con 0x7f3bf4106ec0 2024-05-14T09:26:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 Processor -- start 2024-05-14T09:26:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 -- start start 2024-05-14T09:26:31.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 0x55d5389df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389df9f0 0x55d5389dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d538901a20 con 0x55d538861e40 2024-05-14T09:26:31.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3bf0c00700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3bd80b29d0 0x7f3bd80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d53889f760 con 0x55d5389e5830 2024-05-14T09:26:31.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.818+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d5388fd9e0 con 0x55d5389df9f0 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.819+0000 7f3bf0c00700 1 -- 172.21.15.120:0/3596193994 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3bdc0e34d0 con 0x7f3bf4106ec0 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.819+0000 7f3bf3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.819+0000 7f3bf3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389e52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43334/0 (socket says 172.21.15.120:43334) 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.819+0000 7f3bf3e00700 1 -- 172.21.15.120:0/1674475527 learned_addr learned my addr 172.21.15.120:0/1674475527 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.819+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3bd80b29d0 0x7f3bd80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.820+0000 7f3bf3e00700 1 -- 172.21.15.120:0/1674475527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389df9f0 msgr2=0x55d5389dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.820+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/1674475527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389df9f0 0x55d5389dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.820+0000 7f3bf3e00700 1 -- 172.21.15.120:0/1674475527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 msgr2=0x55d5389df4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.820+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/1674475527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 0x55d5389df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.820+0000 7f3bf3e00700 1 -- 172.21.15.120:0/1674475527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53884e8d0 con 0x55d538861e40 2024-05-14T09:26:31.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.820+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/1674475527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389e52f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3bec007830 tx=0x7f3bec007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d6191840be95cf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:31.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.821+0000 7f3be8c00700 1 -- 172.21.15.120:0/1674475527 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec01a470 con 0x55d538861e40 2024-05-14T09:26:31.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.821+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3bd80b29d0 0x7f3bd80b4ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3bec010000 tx=0x7f3bec01d000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:31.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.821+0000 7f3be8c00700 1 -- 172.21.15.120:0/1674475527 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bec01aaa0 con 0x55d538861e40 2024-05-14T09:26:31.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.821+0000 7f3be8c00700 1 -- 172.21.15.120:0/1674475527 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec022820 con 0x55d538861e40 2024-05-14T09:26:31.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/1674475527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 msgr2=0x55d5389e52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/1674475527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389e52f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3bec007830 tx=0x7f3bec007b40 comp rx=0 tx=0).stop 2024-05-14T09:26:31.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/1674475527 shutdown_connections 2024-05-14T09:26:31.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/1674475527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389df9f0 0x55d5389dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/1674475527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389e52f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/1674475527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 0x55d5389df4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/1674475527 >> 172.21.15.120:0/1674475527 conn(0x55d5388a6f70 msgr2=0x55d5389da2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:31.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.822+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/1674475527 shutdown_connections 2024-05-14T09:26:31.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.823+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/1674475527 wait complete. 2024-05-14T09:26:31.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.823+0000 7f3c08b1bb80 1 -- start start 2024-05-14T09:26:31.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.823+0000 7f3c08b1bb80 1 Processor -- start 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.824+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.824+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d5389e9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389e5830 0x55d5389e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d5389ec250 con 0x55d5389e5830 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d538867b20 con 0x55d5389df9f0 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d5389ec3d0 con 0x55d538861e40 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3c08b1bb80 10 client.0 _ll_register_callbacks cb 0x55d5388a8c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3bf3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389e5830 0x55d5389e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3bf3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389e5830 0x55d5389e9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43346/0 (socket says 172.21.15.120:43346) 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3bf3e00700 1 -- 172.21.15.120:0/3907812704 learned_addr learned my addr 172.21.15.120:0/3907812704 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:31.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3bf3400700 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.825+0000 7f3bebe00700 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d5389e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.826+0000 7f3bf3e00700 1 -- 172.21.15.120:0/3907812704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 msgr2=0x55d5389e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.826+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.826+0000 7f3bf3e00700 1 -- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 msgr2=0x55d5389e9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.826+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d5389e9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.826+0000 7f3bf3e00700 1 -- 172.21.15.120:0/3907812704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5388c7420 con 0x55d5389e5830 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.826+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389e5830 0x55d5389e9a90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009900 tx=0x7f3bec023cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8702035510cb9d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.826+0000 7f3be1600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.827+0000 7f3be1600700 1 -- 172.21.15.120:0/3907812704 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec02e030 con 0x55d5389e5830 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.827+0000 7f3be1600700 1 -- 172.21.15.120:0/3907812704 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3bec012040 con 0x55d5389e5830 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.827+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bec01aaa0 con 0x55d5389e5830 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.827+0000 7f3be1600700 1 -- 172.21.15.120:0/3907812704 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3bec03b050 con 0x55d5389e5830 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.827+0000 7f3c08b1bb80 10 client.15927 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.827+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d5389f6df0 con 0x55d5389e5830 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3be1600700 1 -- 172.21.15.120:0/3907812704 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bec01aaa0 con 0x55d5389e5830 2024-05-14T09:26:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3be1600700 1 -- 172.21.15.120:0/3907812704 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f3bec018040 con 0x55d5389e5830 2024-05-14T09:26:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3c08b1bb80 10 client.15927 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3c08b1bb80 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3c08b1bb80 20 client.15927 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d5389f9380 0x55d5389fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3c08b1bb80 4 client.15927 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.828+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5389ac1c0 con 0x55d5389f9380 2024-05-14T09:26:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.829+0000 7f3bf3400700 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d5389f9380 0x55d5389fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.830+0000 7f3bf3400700 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d5389f9380 0x55d5389fb7a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af105150f456b52d server_cookie=1d121d81ac566d0d in_seq=0 out_seq=0 2024-05-14T09:26:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.830+0000 7f3be1600700 10 client.15927 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.832+0000 7f3be1600700 1 -- 172.21.15.120:0/3907812704 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d5389ac1c0 con 0x55d5389f9380 2024-05-14T09:26:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.832+0000 7f3be1600700 10 client.15927 handle_command_reply: tid=0 2024-05-14T09:26:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.832+0000 7f3c08b1bb80 1 client.15927 shutdown 2024-05-14T09:26:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.832+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389e5830 msgr2=0x55d5389e9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.832+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389e5830 0x55d5389e9a90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009900 tx=0x7f3bec023cf0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 shutdown_connections 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d5389f9380 0x55d5389fb7a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389e5830 0x55d5389e9a90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3be1600700 0 client.15927 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/3907812704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d5389e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 >> 172.21.15.120:0/3907812704 conn(0x55d5388a6f70 msgr2=0x55d5389de4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 shutdown_connections 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/3907812704 wait complete. 2024-05-14T09:26:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.833+0000 7f3c08b1bb80 20 client.15927 trim_cache size 0 max 16384 2024-05-14T09:26:31.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.862+0000 7f3c08b1bb80 1 Processor -- start 2024-05-14T09:26:31.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.862+0000 7f3c08b1bb80 1 -- start start 2024-05-14T09:26:31.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389df9f0 0x55d5389e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 0x55d5389d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd000eba0 con 0x55d5389df9f0 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd00107d0 con 0x55d5389e5830 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd000f270 con 0x55d538861e40 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3bebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389df9f0 0x55d5389e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3bebe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389df9f0 0x55d5389e37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43354/0 (socket says 172.21.15.120:43354) 2024-05-14T09:26:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.863+0000 7f3bebe00700 1 -- 172.21.15.120:0/561229236 learned_addr learned my addr 172.21.15.120:0/561229236 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:31.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bf3400700 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 0x55d5389d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bebe00700 1 -- 172.21.15.120:0/561229236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 msgr2=0x55d5389df4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bebe00700 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389df4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bebe00700 1 -- 172.21.15.120:0/561229236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 msgr2=0x55d5389d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bebe00700 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 0x55d5389d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bebe00700 1 -- 172.21.15.120:0/561229236 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5389ebd60 con 0x55d5389df9f0 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3bebe00700 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389df9f0 0x55d5389e37b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0a76f0 tx=0x7f3bdc0ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e4f508fb942371 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.864+0000 7f3be3e00700 1 -- 172.21.15.120:0/561229236 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0cd0e0 con 0x55d5389df9f0 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.865+0000 7f3be3e00700 1 -- 172.21.15.120:0/561229236 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bdc0abd70 con 0x55d5389df9f0 2024-05-14T09:26:31.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.865+0000 7f3be3e00700 1 -- 172.21.15.120:0/561229236 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc091be0 con 0x55d5389df9f0 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/561229236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389df9f0 msgr2=0x55d5389e37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389df9f0 0x55d5389e37b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0a76f0 tx=0x7f3bdc0ab040 comp rx=0 tx=0).stop 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/561229236 shutdown_connections 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389e5830 0x55d5389d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d538861e40 0x55d5389df4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/561229236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5389df9f0 0x55d5389e37b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/561229236 >> 172.21.15.120:0/561229236 conn(0x55d5388a6f70 msgr2=0x55d5389d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/561229236 shutdown_connections 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/561229236 wait complete. 2024-05-14T09:26:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.866+0000 7f3c08b1bb80 1 -- start start 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.867+0000 7f3c08b1bb80 1 Processor -- start 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.867+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389f1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.867+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d538a00190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.867+0000 7f3c08b1bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389e5830 0x55d538a006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.867+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0010040 con 0x55d538861e40 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.867+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd000f970 con 0x55d5389df9f0 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.867+0000 7f3c08b1bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd000cb60 con 0x55d5389e5830 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3c08b1bb80 10 client.0 _ll_register_callbacks cb 0x55d5388a8c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43366/0 (socket says 172.21.15.120:43366) 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 -- 172.21.15.120:0/246054022 learned_addr learned my addr 172.21.15.120:0/246054022 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3e00700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389e5830 0x55d538a006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bebe00700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d538a00190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 -- 172.21.15.120:0/246054022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389e5830 msgr2=0x55d538a006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389e5830 0x55d538a006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 -- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 msgr2=0x55d538a00190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d538a00190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bf3400700 1 -- 172.21.15.120:0/246054022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d538a00c10 con 0x55d538861e40 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.868+0000 7f3bebe00700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d538a00190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3bf3400700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389f1990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3be4000c00 tx=0x7f3be4011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4454de2dae3ace57 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3be1600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:31.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3be1600700 1 -- 172.21.15.120:0/246054022 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4004520 con 0x55d538861e40 2024-05-14T09:26:31.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bdc0abd70 con 0x55d538861e40 2024-05-14T09:26:31.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3be1600700 1 -- 172.21.15.120:0/246054022 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3be401d3f0 con 0x55d538861e40 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3be1600700 1 -- 172.21.15.120:0/246054022 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3be402e050 con 0x55d538861e40 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3c08b1bb80 10 client.15933 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.869+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d538a63610 con 0x55d538861e40 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3be1600700 1 -- 172.21.15.120:0/246054022 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bdc0abd70 con 0x55d538861e40 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3be1600700 1 -- 172.21.15.120:0/246054022 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f3be4003cb0 con 0x55d538861e40 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3c08b1bb80 10 client.15933 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3c08b1bb80 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3c08b1bb80 20 client.15933 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d538a63e10 0x55d538a66230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3c08b1bb80 4 client.15933 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.870+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d53890f400 con 0x55d538a63e10 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.871+0000 7f3bebe00700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d538a63e10 0x55d538a66230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.872+0000 7f3be1600700 10 client.15933 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:31.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.872+0000 7f3bebe00700 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d538a63e10 0x55d538a66230 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1443ec309d7f6df5 server_cookie=6e6f7ee4fa2b96b8 in_seq=0 out_seq=0 2024-05-14T09:26:31.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3be1600700 1 -- 172.21.15.120:0/246054022 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d53890f400 con 0x55d538a63e10 2024-05-14T09:26:31.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3be1600700 10 client.15933 handle_command_reply: tid=0 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 client.15933 shutdown 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 msgr2=0x55d5389f1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389f1990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3be4000c00 tx=0x7f3be4011930 comp rx=0 tx=0).stop 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 shutdown_connections 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d538a63e10 0x55d538a66230 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5389e5830 0x55d538a006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d538861e40 0x55d5389f1990 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 --2- 172.21.15.120:0/246054022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d5389df9f0 0x55d538a00190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3be1600700 0 client.15933 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 >> 172.21.15.120:0/246054022 conn(0x55d5388a6f70 msgr2=0x55d5389e7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 shutdown_connections 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.873+0000 7f3c08b1bb80 1 -- 172.21.15.120:0/246054022 wait complete. 2024-05-14T09:26:31.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.874+0000 7f3c08b1bb80 20 client.15933 trim_cache size 0 max 16384 2024-05-14T09:26:31.876 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:26:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-05-14T09:26:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-05-14T09:26:31.876 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.874+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3bd80b29d0 msgr2=0x7f3bd80b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.874+0000 7f3bfa000700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3bd80b29d0 0x7f3bd80b4ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3bec010000 tx=0x7f3bec01d000 comp rx=0 tx=0).stop 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106ec0 msgr2=0x7f3bf406e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106ec0 0x7f3bf406e500 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006010 tx=0x7f3bdc0047b0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 shutdown_connections 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3bd80b29d0 0x7f3bd80b4ee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf410c5b0 0x7f3bf406eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bf4106570 0x7f3bf40753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 --2- 172.21.15.120:0/3596193994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bf4106ec0 0x7f3bf406e500 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 >> 172.21.15.120:0/3596193994 conn(0x7f3bf41020d0 msgr2=0x7f3bf4104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 shutdown_connections 2024-05-14T09:26:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:31.875+0000 7f3bfa000700 1 -- 172.21.15.120:0/3596193994 wait complete. 2024-05-14T09:26:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:vacuuming... 2024-05-14T09:26:32.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:31 smithi120 ceph-mon[31085]: pgmap v645: 129 pgs: 129 active+clean; 752 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:31 smithi152 ceph-mon[34868]: pgmap v645: 129 pgs: 129 active+clean; 752 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:31 smithi175 ceph-mon[35353]: pgmap v645: 129 pgs: 129 active+clean; 752 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:32.847 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T09:26:32.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:26:33.305 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:34.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:33 smithi120 ceph-mon[31085]: pgmap v646: 129 pgs: 129 active+clean; 760 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:34.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:33 smithi152 ceph-mon[34868]: pgmap v646: 129 pgs: 129 active+clean; 760 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:34.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:33 smithi175 ceph-mon[35353]: pgmap v646: 129 pgs: 129 active+clean; 760 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:26:35.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 -- 172.21.15.120:0/2899871166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc103080 msgr2=0x7fb1dc103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:35.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 --2- 172.21.15.120:0/2899871166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc103080 0x7fb1dc103490 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009990 tx=0x7fb1cc009ca0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 -- 172.21.15.120:0/2899871166 shutdown_connections 2024-05-14T09:26:35.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 --2- 172.21.15.120:0/2899871166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc110c30 0x7fb1dc113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 --2- 172.21.15.120:0/2899871166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc103080 0x7fb1dc103490 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 --2- 172.21.15.120:0/2899871166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1dc103a60 0x7fb1dc1106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 -- 172.21.15.120:0/2899871166 >> 172.21.15.120:0/2899871166 conn(0x7fb1dc0fedc0 msgr2=0x7fb1dc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:35.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 -- 172.21.15.120:0/2899871166 shutdown_connections 2024-05-14T09:26:35.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.690+0000 7fb1e3000700 1 -- 172.21.15.120:0/2899871166 wait complete. 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.692+0000 7fb1e3000700 1 Processor -- start 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.692+0000 7fb1e3000700 1 -- start start 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.692+0000 7fb1e3000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1dc103080 0x7fb1dc19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.692+0000 7fb1e3000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc103a60 0x7fb1dc19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e3000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc110c30 0x7fb1dc1a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e3000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc116580 con 0x7fb1dc110c30 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e3000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc116400 con 0x7fb1dc103080 2024-05-14T09:26:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e3000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc116700 con 0x7fb1dc103a60 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc110c30 0x7fb1dc1a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc110c30 0x7fb1dc1a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43380/0 (socket says 172.21.15.120:43380) 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 -- 172.21.15.120:0/3574860433 learned_addr learned my addr 172.21.15.120:0/3574860433 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1dbe00700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1dc103080 0x7fb1dc19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1db400700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc103a60 0x7fb1dc19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 -- 172.21.15.120:0/3574860433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc103a60 msgr2=0x7fb1dc19d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc103a60 0x7fb1dc19d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 -- 172.21.15.120:0/3574860433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1dc103080 msgr2=0x7fb1dc19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1dc103080 0x7fb1dc19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1e1000700 1 -- 172.21.15.120:0/3574860433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc1a1ee0 con 0x7fb1dc110c30 2024-05-14T09:26:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.693+0000 7fb1dbe00700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1dc103080 0x7fb1dc19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.694+0000 7fb1e1000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc110c30 0x7fb1dc1a1840 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4007ee0 tx=0x7fb1d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.694+0000 7fb1d8c00700 1 -- 172.21.15.120:0/3574860433 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400dbd0 con 0x7fb1dc110c30 2024-05-14T09:26:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.694+0000 7fb1d8c00700 1 -- 172.21.15.120:0/3574860433 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1d400dd70 con 0x7fb1dc110c30 2024-05-14T09:26:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.694+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc1a21d0 con 0x7fb1dc110c30 2024-05-14T09:26:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.694+0000 7fb1d8c00700 1 -- 172.21.15.120:0/3574860433 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40058d0 con 0x7fb1dc110c30 2024-05-14T09:26:35.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.694+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc1a9af0 con 0x7fb1dc110c30 2024-05-14T09:26:35.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.696+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1dc0512c0 con 0x7fb1dc110c30 2024-05-14T09:26:35.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.700+0000 7fb1d8c00700 1 -- 172.21.15.120:0/3574860433 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb1d401a020 con 0x7fb1dc110c30 2024-05-14T09:26:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.701+0000 7fb1d8c00700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb1c00b2900 0x7fb1c00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.702+0000 7fb1d8c00700 1 -- 172.21.15.120:0/3574860433 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb1d40e2460 con 0x7fb1dc110c30 2024-05-14T09:26:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.702+0000 7fb1dbe00700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb1c00b2900 0x7fb1c00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.702+0000 7fb1d8c00700 1 -- 172.21.15.120:0/3574860433 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb1d4010070 con 0x7fb1dc110c30 2024-05-14T09:26:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.703+0000 7fb1dbe00700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb1c00b2900 0x7fb1c00b4e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc006010 tx=0x7fb1cc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:35.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.977+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1dc02e5f0 con 0x7fb1dc110c30 2024-05-14T09:26:35.979 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:35 smithi120 ceph-mon[31085]: pgmap v647: 129 pgs: 129 active+clean; 770 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-05-14T09:26:35.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.978+0000 7fb1d8c00700 1 -- 172.21.15.120:0/3574860433 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11965 (secure 0 0 0) 0x7fb1d40a9d80 con 0x7fb1dc110c30 2024-05-14T09:26:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:26:35.980 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:24:05.398565+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34427,24454,34409,34388,24469]},"id":1}]} 2024-05-14T09:26:35.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb1c00b2900 msgr2=0x7fb1c00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:35.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb1c00b2900 0x7fb1c00b4e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc006010 tx=0x7fb1cc00b540 comp rx=0 tx=0).stop 2024-05-14T09:26:35.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc110c30 msgr2=0x7fb1dc1a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:35.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc110c30 0x7fb1dc1a1840 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4007ee0 tx=0x7fb1d400d3b0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 shutdown_connections 2024-05-14T09:26:35.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb1c00b2900 0x7fb1c00b4e10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1dc103080 0x7fb1dc19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1dc110c30 0x7fb1dc1a1840 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 --2- 172.21.15.120:0/3574860433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc103a60 0x7fb1dc19d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:35.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.981+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 >> 172.21.15.120:0/3574860433 conn(0x7fb1dc0fedc0 msgr2=0x7fb1dc1129b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:35.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.982+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 shutdown_connections 2024-05-14T09:26:35.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:35.982+0000 7fb1e3000700 1 -- 172.21.15.120:0/3574860433 wait complete. 2024-05-14T09:26:35.985 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 34 2024-05-14T09:26:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:35 smithi152 ceph-mon[34868]: pgmap v647: 129 pgs: 129 active+clean; 770 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-05-14T09:26:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:35 smithi175 ceph-mon[35353]: pgmap v647: 129 pgs: 129 active+clean; 770 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-05-14T09:26:36.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T09:26:37.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:36 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3574860433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:26:37.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:36 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3574860433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:26:37.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:36 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3574860433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:26:37.294 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:38.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:37 smithi120 ceph-mon[31085]: pgmap v648: 129 pgs: 129 active+clean; 774 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 28 op/s 2024-05-14T09:26:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:37 smithi152 ceph-mon[34868]: pgmap v648: 129 pgs: 129 active+clean; 774 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 28 op/s 2024-05-14T09:26:38.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:37 smithi175 ceph-mon[35353]: pgmap v648: 129 pgs: 129 active+clean; 774 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 28 op/s 2024-05-14T09:26:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 -- 172.21.15.120:0/3904947276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106ec0 msgr2=0x7f3b78113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 --2- 172.21.15.120:0/3904947276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106ec0 0x7f3b78113350 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000b0a0 tx=0x7f3b7000b3b0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 -- 172.21.15.120:0/3904947276 shutdown_connections 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 --2- 172.21.15.120:0/3904947276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b7810c5b0 0x7f3b7810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 --2- 172.21.15.120:0/3904947276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106ec0 0x7f3b78113350 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 --2- 172.21.15.120:0/3904947276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b78106570 0x7f3b78106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 -- 172.21.15.120:0/3904947276 >> 172.21.15.120:0/3904947276 conn(0x7f3b78102050 msgr2=0x7f3b781044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 -- 172.21.15.120:0/3904947276 shutdown_connections 2024-05-14T09:26:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.756+0000 7f3b80600700 1 -- 172.21.15.120:0/3904947276 wait complete. 2024-05-14T09:26:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.758+0000 7f3b80600700 1 Processor -- start 2024-05-14T09:26:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.758+0000 7f3b80600700 1 -- start start 2024-05-14T09:26:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.759+0000 7f3b80600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106570 0x7f3b7819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.759+0000 7f3b80600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b78106ec0 0x7f3b7819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.759+0000 7f3b80600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b7810c5b0 0x7f3b781a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.759+0000 7f3b80600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78116590 con 0x7f3b78106570 2024-05-14T09:26:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.759+0000 7f3b80600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78116410 con 0x7f3b78106ec0 2024-05-14T09:26:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.759+0000 7f3b80600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78116710 con 0x7f3b7810c5b0 2024-05-14T09:26:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.759+0000 7f3b7dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106570 0x7f3b7819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106570 0x7f3b7819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58366/0 (socket says 172.21.15.120:58366) 2024-05-14T09:26:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7dc00700 1 -- 172.21.15.120:0/3857072147 learned_addr learned my addr 172.21.15.120:0/3857072147 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7d200700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b78106ec0 0x7f3b7819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7e600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b7810c5b0 0x7f3b781a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7dc00700 1 -- 172.21.15.120:0/3857072147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b7810c5b0 msgr2=0x7f3b781a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b7810c5b0 0x7f3b781a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7dc00700 1 -- 172.21.15.120:0/3857072147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b78106ec0 msgr2=0x7f3b7819d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b78106ec0 0x7f3b7819d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.760+0000 7f3b7dc00700 1 -- 172.21.15.120:0/3857072147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b781a1d40 con 0x7f3b78106570 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.761+0000 7f3b7d200700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b78106ec0 0x7f3b7819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.761+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106570 0x7f3b7819cec0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00e970 tx=0x7f3b6c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.761+0000 7f3b76000700 1 -- 172.21.15.120:0/3857072147 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00cbd0 con 0x7f3b78106570 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.761+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b781a1fd0 con 0x7f3b78106570 2024-05-14T09:26:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.762+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b781a9950 con 0x7f3b78106570 2024-05-14T09:26:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.763+0000 7f3b76000700 1 -- 172.21.15.120:0/3857072147 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b6c00cd70 con 0x7f3b78106570 2024-05-14T09:26:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.763+0000 7f3b76000700 1 -- 172.21.15.120:0/3857072147 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c010690 con 0x7f3b78106570 2024-05-14T09:26:39.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.766+0000 7f3b76000700 1 -- 172.21.15.120:0/3857072147 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3b6c0108f0 con 0x7f3b78106570 2024-05-14T09:26:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.768+0000 7f3b8f203b80 1 Processor -- start 2024-05-14T09:26:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.768+0000 7f3b8f203b80 1 -- start start 2024-05-14T09:26:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.768+0000 7f3b76000700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3b600b2900 0x7f3b600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafa8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b76000700 1 -- 172.21.15.120:0/3857072147 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3b6c021440 con 0x7f3b78106570 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5571daecaa20 con 0x5571dafaebf0 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5571dae68760 con 0x5571dafa8c50 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5571daec69e0 con 0x5571dae2ae40 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b7e600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3b600b2900 0x7f3b600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b7d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafa8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b7d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafa8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58376/0 (socket says 172.21.15.120:58376) 2024-05-14T09:26:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b7d200700 1 -- 172.21.15.120:0/3461891525 learned_addr learned my addr 172.21.15.120:0/3461891525 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.769+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.770+0000 7f3b7e600700 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.770+0000 7f3b7dc00700 1 -- 172.21.15.120:0/3461891525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 msgr2=0x5571dafa9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.770+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.770+0000 7f3b7dc00700 1 -- 172.21.15.120:0/3461891525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 msgr2=0x5571dafa8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.770+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafa8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.770+0000 7f3b7dc00700 1 -- 172.21.15.120:0/3461891525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dae178d0 con 0x5571dae2ae40 2024-05-14T09:26:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.771+0000 7f3b7e600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3b600b2900 0x7f3b600b4e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009fd0 tx=0x7f3b70009dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.771+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafae6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0aa810 tx=0x7f3b6c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d123f4f3dd7b19 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.771+0000 7f3b6aa00700 1 -- 172.21.15.120:0/3461891525 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c021e40 con 0x5571dae2ae40 2024-05-14T09:26:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.771+0000 7f3b6aa00700 1 -- 172.21.15.120:0/3461891525 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b6c0aa390 con 0x5571dae2ae40 2024-05-14T09:26:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.771+0000 7f3b6aa00700 1 -- 172.21.15.120:0/3461891525 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0b36e0 con 0x5571dae2ae40 2024-05-14T09:26:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.772+0000 7f3b8f203b80 1 -- 172.21.15.120:0/3461891525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 msgr2=0x5571dafae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.772+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafae6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0aa810 tx=0x7f3b6c000bc0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.773+0000 7f3b8f203b80 1 -- 172.21.15.120:0/3461891525 shutdown_connections 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.773+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.773+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafae6b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.773+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/3461891525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafa8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.773+0000 7f3b8f203b80 1 -- 172.21.15.120:0/3461891525 >> 172.21.15.120:0/3461891525 conn(0x5571dae69a80 msgr2=0x5571dafa3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.773+0000 7f3b8f203b80 1 -- 172.21.15.120:0/3461891525 shutdown_connections 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.773+0000 7f3b8f203b80 1 -- 172.21.15.120:0/3461891525 wait complete. 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.774+0000 7f3b8f203b80 1 -- start start 2024-05-14T09:26:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.774+0000 7f3b8f203b80 1 Processor -- start 2024-05-14T09:26:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.775+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dae2ae40 0x5571dafb2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.775+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafa8c50 0x5571dafb2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.775+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dafaebf0 0x5571dafb2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.775+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5571dafbde70 con 0x5571dafa8c50 2024-05-14T09:26:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.775+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5571dae30b20 con 0x5571dae2ae40 2024-05-14T09:26:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.775+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5571dafbdff0 con 0x5571dafaebf0 2024-05-14T09:26:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.775+0000 7f3b8f203b80 10 client.0 _ll_register_callbacks cb 0x5571dae5e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafa8c50 0x5571dafb2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafa8c50 0x5571dafb2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58388/0 (socket says 172.21.15.120:58388) 2024-05-14T09:26:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 -- 172.21.15.120:0/229860965 learned_addr learned my addr 172.21.15.120:0/229860965 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dae2ae40 0x5571dafb2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7e600700 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dafaebf0 0x5571dafb2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 -- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dafaebf0 msgr2=0x5571dafb2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dafaebf0 0x5571dafb2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 -- 172.21.15.120:0/229860965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dae2ae40 msgr2=0x5571dafb2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dae2ae40 0x5571dafb2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.776+0000 7f3b7d200700 1 -- 172.21.15.120:0/229860965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571dae90420 con 0x5571dafa8c50 2024-05-14T09:26:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.777+0000 7f3b7d200700 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafa8c50 0x5571dafb2950 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3b64011480 tx=0x7f3b64011840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c39b6e8714899c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.777+0000 7f3b5f400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.777+0000 7f3b5f400700 1 -- 172.21.15.120:0/229860965 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64012860 con 0x5571dafa8c50 2024-05-14T09:26:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.778+0000 7f3b5f400700 1 -- 172.21.15.120:0/229860965 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3b64012a00 con 0x5571dafa8c50 2024-05-14T09:26:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.778+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b6c0aa390 con 0x5571dafa8c50 2024-05-14T09:26:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.778+0000 7f3b5f400700 1 -- 172.21.15.120:0/229860965 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b64025050 con 0x5571dafa8c50 2024-05-14T09:26:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.778+0000 7f3b8f203b80 10 client.15951 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.778+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5571dafc8b50 con 0x5571dafa8c50 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.778+0000 7f3b5f400700 1 -- 172.21.15.120:0/229860965 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b6c0aa390 con 0x5571dafa8c50 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.779+0000 7f3b5f400700 1 -- 172.21.15.120:0/229860965 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f3b6400f040 con 0x5571dafa8c50 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.779+0000 7f3b8f203b80 10 client.15951 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.779+0000 7f3b8f203b80 10 client.15951 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.779+0000 7f3b8f203b80 20 client.15951 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.779+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571dafcb190 0x5571dafcd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.779+0000 7f3b8f203b80 4 client.15951 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.779+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571daf75070 con 0x5571dafcb190 2024-05-14T09:26:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.780+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571dafcb190 0x5571dafcd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.781+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571dafcb190 0x5571dafcd5b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d3ebc65168a671ed server_cookie=19ee474c6d5d1ddd in_seq=0 out_seq=0 2024-05-14T09:26:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.781+0000 7f3b5f400700 10 client.15951 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:26:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.783+0000 7f3b5f400700 1 -- 172.21.15.120:0/229860965 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5571daf75070 con 0x5571dafcb190 2024-05-14T09:26:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.783+0000 7f3b5f400700 10 client.15951 handle_command_reply: tid=0 2024-05-14T09:26:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.784+0000 7f3b8f203b80 1 client.15951 shutdown 2024-05-14T09:26:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.784+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafa8c50 msgr2=0x5571dafb2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.784+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafa8c50 0x5571dafb2950 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3b64011480 tx=0x7f3b64011840 comp rx=0 tx=0).stop 2024-05-14T09:26:39.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.784+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 shutdown_connections 2024-05-14T09:26:39.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.784+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571dafcb190 0x5571dafcd5b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.785+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dae2ae40 0x5571dafb2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.785+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dafaebf0 0x5571dafb2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.785+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/229860965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafa8c50 0x5571dafb2950 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.785+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 >> 172.21.15.120:0/229860965 conn(0x5571dae69a80 msgr2=0x5571daf9d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:39.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.785+0000 7f3b5f400700 0 client.15951 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:26:39.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.785+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 shutdown_connections 2024-05-14T09:26:39.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.785+0000 7f3b8f203b80 1 -- 172.21.15.120:0/229860965 wait complete. 2024-05-14T09:26:39.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.786+0000 7f3b8f203b80 20 client.15951 trim_cache size 0 max 16384 2024-05-14T09:26:39.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.819+0000 7f3b8f203b80 1 Processor -- start 2024-05-14T09:26:39.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.819+0000 7f3b8f203b80 1 -- start start 2024-05-14T09:26:39.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafa8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafb2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5800eba0 con 0x5571dafaebf0 2024-05-14T09:26:39.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b580107d0 con 0x5571dafa8c50 2024-05-14T09:26:39.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5800f270 con 0x5571dae2ae40 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b7e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafb2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b7e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafb2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58392/0 (socket says 172.21.15.120:58392) 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b7e600700 1 -- 172.21.15.120:0/1542834627 learned_addr learned my addr 172.21.15.120:0/1542834627 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.820+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafa8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.821+0000 7f3b7d200700 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.821+0000 7f3b7e600700 1 -- 172.21.15.120:0/1542834627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 msgr2=0x5571dafa8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.821+0000 7f3b7e600700 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafa8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.821+0000 7f3b7e600700 1 -- 172.21.15.120:0/1542834627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 msgr2=0x5571dafa38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.821+0000 7f3b7e600700 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.821+0000 7f3b7e600700 1 -- 172.21.15.120:0/1542834627 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571daf9cfd0 con 0x5571dafaebf0 2024-05-14T09:26:39.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.822+0000 7f3b7e600700 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafb2cd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3b70004ca0 tx=0x7f3b70029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8fd470454b7798 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:39.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.822+0000 7f3b6a000700 1 -- 172.21.15.120:0/1542834627 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70006020 con 0x5571dafaebf0 2024-05-14T09:26:39.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.822+0000 7f3b6a000700 1 -- 172.21.15.120:0/1542834627 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b70031070 con 0x5571dafaebf0 2024-05-14T09:26:39.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.822+0000 7f3b6a000700 1 -- 172.21.15.120:0/1542834627 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70021e30 con 0x5571dafaebf0 2024-05-14T09:26:39.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.823+0000 7f3b8f203b80 1 -- 172.21.15.120:0/1542834627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 msgr2=0x5571dafb2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.823+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafb2cd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3b70004ca0 tx=0x7f3b70029000 comp rx=0 tx=0).stop 2024-05-14T09:26:39.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.823+0000 7f3b8f203b80 1 -- 172.21.15.120:0/1542834627 shutdown_connections 2024-05-14T09:26:39.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.823+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafb2cd0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.823+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafa8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.823+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/1542834627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafa38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.823+0000 7f3b8f203b80 1 -- 172.21.15.120:0/1542834627 >> 172.21.15.120:0/1542834627 conn(0x5571dae69a80 msgr2=0x5571daf9daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:39.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.824+0000 7f3b8f203b80 1 -- 172.21.15.120:0/1542834627 shutdown_connections 2024-05-14T09:26:39.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.824+0000 7f3b8f203b80 1 -- 172.21.15.120:0/1542834627 wait complete. 2024-05-14T09:26:39.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.824+0000 7f3b8f203b80 1 -- start start 2024-05-14T09:26:39.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.824+0000 7f3b8f203b80 1 Processor -- start 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafc3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafd21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b8f203b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafd26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3b58010040 con 0x5571dafaebf0 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5800f970 con 0x5571dafa8c50 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b8f203b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5800cb60 con 0x5571dae2ae40 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b8f203b80 10 client.0 _ll_register_callbacks cb 0x5571dae5e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b7e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafd26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b7e600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafd26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58400/0 (socket says 172.21.15.120:58400) 2024-05-14T09:26:39.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b7e600700 1 -- 172.21.15.120:0/4068100638 learned_addr learned my addr 172.21.15.120:0/4068100638 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:39.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.825+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafc3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.826+0000 7f3b7d200700 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafd21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.826+0000 7f3b7e600700 1 -- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 msgr2=0x5571dafc3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.826+0000 7f3b7e600700 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafc3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.826+0000 7f3b7e600700 1 -- 172.21.15.120:0/4068100638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 msgr2=0x5571dafd21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:39.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.826+0000 7f3b7e600700 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafd21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.826+0000 7f3b7e600700 1 -- 172.21.15.120:0/4068100638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571dafd2c20 con 0x5571dafaebf0 2024-05-14T09:26:39.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.826+0000 7f3b7e600700 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafd26e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000b7d0 tx=0x7f3b70007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2401847eaf3db04c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.827+0000 7f3b5f400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.827+0000 7f3b5f400700 1 -- 172.21.15.120:0/4068100638 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7003c060 con 0x5571dafaebf0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.827+0000 7f3b5f400700 1 -- 172.21.15.120:0/4068100638 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3b70021730 con 0x5571dafaebf0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.827+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b70031070 con 0x5571dafaebf0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.827+0000 7f3b5f400700 1 -- 172.21.15.120:0/4068100638 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b70043050 con 0x5571dafaebf0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.827+0000 7f3b8f203b80 10 client.15957 fetch_fsmap learned FSMap version 34 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.827+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5571db035540 con 0x5571dafaebf0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b5f400700 1 -- 172.21.15.120:0/4068100638 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b70031070 con 0x5571dafaebf0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b5f400700 1 -- 172.21.15.120:0/4068100638 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f3b70011070 con 0x5571dafaebf0 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b8f203b80 10 client.15957 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b8f203b80 10 client.15957 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b8f203b80 20 client.15957 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571db035b80 0x5571db037fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:39.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b8f203b80 4 client.15957 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:26:39.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.828+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5571daed8400 con 0x5571db035b80 2024-05-14T09:26:39.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.829+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571db035b80 0x5571db037fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:39.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.830+0000 7f3b7dc00700 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571db035b80 0x5571db037fa0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c768648b8fa3cfdb server_cookie=7e8517692d758b05 in_seq=0 out_seq=0 2024-05-14T09:26:39.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.830+0000 7f3b5f400700 10 client.15957 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:26:39.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.830+0000 7f3b5f400700 1 -- 172.21.15.120:0/4068100638 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5571daed8400 con 0x5571db035b80 2024-05-14T09:26:39.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.830+0000 7f3b5f400700 10 client.15957 handle_command_reply: tid=0 2024-05-14T09:26:39.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.830+0000 7f3b8f203b80 1 client.15957 shutdown 2024-05-14T09:26:39.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 msgr2=0x5571dafd26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafd26e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000b7d0 tx=0x7f3b70007ec0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 shutdown_connections 2024-05-14T09:26:39.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x5571db035b80 0x5571db037fa0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5571dafaebf0 0x5571dafd26e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571dae2ae40 0x5571dafc3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 --2- 172.21.15.120:0/4068100638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5571dafa8c50 0x5571dafd21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 >> 172.21.15.120:0/4068100638 conn(0x5571dae69a80 msgr2=0x5571dafac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:39.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b5f400700 0 client.15957 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:26:39.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 shutdown_connections 2024-05-14T09:26:39.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.831+0000 7f3b8f203b80 1 -- 172.21.15.120:0/4068100638 wait complete. 2024-05-14T09:26:39.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.832+0000 7f3b8f203b80 20 client.15957 trim_cache size 0 max 16384 2024-05-14T09:26:39.832 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.832+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3b600b2900 msgr2=0x7f3b600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.832+0000 7f3b80600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3b600b2900 0x7f3b600b4e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009fd0 tx=0x7f3b70009dc0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106570 msgr2=0x7f3b7819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106570 0x7f3b7819cec0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00e970 tx=0x7f3b6c00ec80 comp rx=0 tx=0).stop 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 shutdown_connections 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3b600b2900 0x7f3b600b4e10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b7810c5b0 0x7f3b781a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b78106570 0x7f3b7819cec0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 --2- 172.21.15.120:0/3857072147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b78106ec0 0x7f3b7819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 >> 172.21.15.120:0/3857072147 conn(0x7f3b78102050 msgr2=0x7f3b781037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:39.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 shutdown_connections 2024-05-14T09:26:39.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:39.833+0000 7f3b80600700 1 -- 172.21.15.120:0/3857072147 wait complete. 2024-05-14T09:26:40.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:39 smithi120 ceph-mon[31085]: pgmap v649: 129 pgs: 129 active+clean; 774 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 25 op/s 2024-05-14T09:26:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:39 smithi152 ceph-mon[34868]: pgmap v649: 129 pgs: 129 active+clean; 774 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 25 op/s 2024-05-14T09:26:40.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:39 smithi175 ceph-mon[35353]: pgmap v649: 129 pgs: 129 active+clean; 774 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 25 op/s 2024-05-14T09:26:40.766 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T09:26:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.411+0000 7f433fe00640 1 -- 172.21.15.120:0/1883367618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4340104cf0 msgr2=0x7f4340105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.411+0000 7f433fe00640 1 --2- 172.21.15.120:0/1883367618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4340104cf0 0x7f4340105100 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f432c009900 tx=0x7f432c02a3f0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.411+0000 7f433fe00640 1 -- 172.21.15.120:0/1883367618 shutdown_connections 2024-05-14T09:26:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.411+0000 7f433fe00640 1 --2- 172.21.15.120:0/1883367618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43401099f0 0x7f434010be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.411+0000 7f433fe00640 1 --2- 172.21.15.120:0/1883367618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4340104cf0 0x7f4340105100 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.411+0000 7f433fe00640 1 --2- 172.21.15.120:0/1883367618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4340103ab0 0x7f43401047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.411+0000 7f433fe00640 1 -- 172.21.15.120:0/1883367618 >> 172.21.15.120:0/1883367618 conn(0x7f43400fecc0 msgr2=0x7f4340101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.412+0000 7f433fe00640 1 -- 172.21.15.120:0/1883367618 shutdown_connections 2024-05-14T09:26:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.412+0000 7f433fe00640 1 -- 172.21.15.120:0/1883367618 wait complete. 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 Processor -- start 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 -- start start 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4340103ab0 0x7f434019c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4340104cf0 0x7f434019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43401099f0 0x7f43401a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f434010f480 con 0x7f43401099f0 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f434010f300 con 0x7f4340104cf0 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.413+0000 7f433fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f434010f600 con 0x7f4340103ab0 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43401099f0 0x7f43401a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43401099f0 0x7f43401a37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58416/0 (socket says 172.21.15.120:58416) 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 -- 172.21.15.120:0/4041326015 learned_addr learned my addr 172.21.15.120:0/4041326015 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433e000640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4340104cf0 0x7f434019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433ea00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4340103ab0 0x7f434019c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 -- 172.21.15.120:0/4041326015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4340103ab0 msgr2=0x7f434019c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4340103ab0 0x7f434019c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 -- 172.21.15.120:0/4041326015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4340104cf0 msgr2=0x7f434019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4340104cf0 0x7f434019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.414+0000 7f433f400640 1 -- 172.21.15.120:0/4041326015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43401a3da0 con 0x7f43401099f0 2024-05-14T09:26:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.415+0000 7f433f400640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43401099f0 0x7f43401a37e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f433800cce0 tx=0x7f433800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.415+0000 7f4337400640 1 -- 172.21.15.120:0/4041326015 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433800f450 con 0x7f43401099f0 2024-05-14T09:26:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.415+0000 7f4337400640 1 -- 172.21.15.120:0/4041326015 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f433800fa80 con 0x7f43401099f0 2024-05-14T09:26:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.415+0000 7f4337400640 1 -- 172.21.15.120:0/4041326015 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338018ad0 con 0x7f43401099f0 2024-05-14T09:26:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.415+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43401a4090 con 0x7f43401099f0 2024-05-14T09:26:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.415+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43401a4590 con 0x7f43401099f0 2024-05-14T09:26:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.419+0000 7f434cc10740 1 Processor -- start 2024-05-14T09:26:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f4337400640 1 -- 172.21.15.120:0/4041326015 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f433800f5f0 con 0x7f43401099f0 2024-05-14T09:26:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f434cc10740 1 -- start start 2024-05-14T09:26:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f434cc10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9ed3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f434cc10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ed3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f434cc10740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9eda780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f434cc10740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562bf9e37550 con 0x562bf9b104d0 2024-05-14T09:26:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f434cc10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562bf9ddcbc0 con 0x562bf9b311b0 2024-05-14T09:26:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.421+0000 7f434cc10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562bf9e33510 con 0x562bf9b082f0 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.422+0000 7f433e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9eda780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.422+0000 7f433e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9eda780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58426/0 (socket says 172.21.15.120:58426) 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.422+0000 7f433e000640 1 -- 172.21.15.120:0/3828707856 learned_addr learned my addr 172.21.15.120:0/3828707856 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.422+0000 7f433e000640 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9ed3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.422+0000 7f433ea00640 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ed3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f433e000640 1 -- 172.21.15.120:0/3828707856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 msgr2=0x562bf9ed3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f433e000640 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ed3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f433e000640 1 -- 172.21.15.120:0/3828707856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 msgr2=0x562bf9ed3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f433e000640 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9ed3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f433e000640 1 -- 172.21.15.120:0/3828707856 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf9b49210 con 0x562bf9b104d0 2024-05-14T09:26:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f4337400640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f43240b27e0 0x7f43240b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f4337400640 1 -- 172.21.15.120:0/4041326015 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f43380e2e10 con 0x7f43401099f0 2024-05-14T09:26:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f433e000640 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9eda780 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f432c0096c0 tx=0x7f432c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e007836a9ccd6e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.423+0000 7f433ea00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f43240b27e0 0x7f43240b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.424+0000 7f432be00640 1 -- 172.21.15.120:0/3828707856 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c035050 con 0x562bf9b104d0 2024-05-14T09:26:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.424+0000 7f432be00640 1 -- 172.21.15.120:0/3828707856 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f432c0044c0 con 0x562bf9b104d0 2024-05-14T09:26:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.424+0000 7f432be00640 1 -- 172.21.15.120:0/3828707856 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c003850 con 0x562bf9b104d0 2024-05-14T09:26:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.425+0000 7f434cc10740 1 -- 172.21.15.120:0/3828707856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 msgr2=0x562bf9eda780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.425+0000 7f433ea00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f43240b27e0 0x7f43240b4cf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x562bf9ed46e0 tx=0x7f433000b4d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.425+0000 7f434cc10740 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9eda780 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f432c0096c0 tx=0x7f432c000bc0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 -- 172.21.15.120:0/3828707856 shutdown_connections 2024-05-14T09:26:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9eda780 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ed3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 --2- 172.21.15.120:0/3828707856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9ed3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 -- 172.21.15.120:0/3828707856 >> 172.21.15.120:0/3828707856 conn(0x562bf9b25300 msgr2=0x562bf9ecec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 -- 172.21.15.120:0/3828707856 shutdown_connections 2024-05-14T09:26:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 -- 172.21.15.120:0/3828707856 wait complete. 2024-05-14T09:26:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.426+0000 7f434cc10740 1 -- start start 2024-05-14T09:26:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.427+0000 7f434cc10740 1 Processor -- start 2024-05-14T09:26:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.427+0000 7f434cc10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9edcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.427+0000 7f434cc10740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9edd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.427+0000 7f434cc10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b311b0 0x562bf9ee4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f434cc10740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562bf9edb170 con 0x562bf9b104d0 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f434cc10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562bf9df0660 con 0x562bf9b082f0 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f434cc10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562bf9edb2f0 con 0x562bf9b311b0 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f434cc10740 10 client.0 _ll_register_callbacks cb 0x562bf9dba400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9edd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9edd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58440/0 (socket says 172.21.15.120:58440) 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433e000640 1 -- 172.21.15.120:0/1791640519 learned_addr learned my addr 172.21.15.120:0/1791640519 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433ea00640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9edcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433e000640 1 -- 172.21.15.120:0/1791640519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b311b0 msgr2=0x562bf9ee4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433f400640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b311b0 0x562bf9ee4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433e000640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b311b0 0x562bf9ee4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433e000640 1 -- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 msgr2=0x562bf9edcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.428+0000 7f433e000640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9edcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.429+0000 7f433e000640 1 -- 172.21.15.120:0/1791640519 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf9c15620 con 0x562bf9b104d0 2024-05-14T09:26:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.429+0000 7f433ea00640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9edcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.429+0000 7f433e000640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9edd420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f432c005ab0 tx=0x7f432c03d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fcc2348071b639 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.429+0000 7f4328c00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.429+0000 7f4328c00640 1 -- 172.21.15.120:0/1791640519 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c04e070 con 0x562bf9b104d0 2024-05-14T09:26:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.429+0000 7f4328c00640 1 -- 172.21.15.120:0/1791640519 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f432c03daf0 con 0x562bf9b104d0 2024-05-14T09:26:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.429+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562bf9e45160 con 0x562bf9b104d0 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f4328c00640 1 -- 172.21.15.120:0/1791640519 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f432c05a050 con 0x562bf9b104d0 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 10 client.15969 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562bf9eefa50 con 0x562bf9b104d0 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f4328c00640 1 -- 172.21.15.120:0/1791640519 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562bf9e45160 con 0x562bf9b104d0 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f4328c00640 1 -- 172.21.15.120:0/1791640519 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f432c04aae0 con 0x562bf9b104d0 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 10 client.15969 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 20 client.15969 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9aefd80 0x562bf9ef2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 4 client.15969 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.430+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bf9e3efd0 con 0x562bf9aefd80 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.431+0000 7f433ea00640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9aefd80 0x562bf9ef2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.432+0000 7f433ea00640 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9aefd80 0x562bf9ef2db0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83bb82ec88353088 server_cookie=60b4b3ef6c50fb86 in_seq=0 out_seq=0 2024-05-14T09:26:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.432+0000 7f4328c00640 10 client.15969 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.434+0000 7f4328c00640 1 -- 172.21.15.120:0/1791640519 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562bf9e3efd0 con 0x562bf9aefd80 2024-05-14T09:26:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.434+0000 7f4328c00640 10 client.15969 handle_command_reply: tid=0 2024-05-14T09:26:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.434+0000 7f434cc10740 1 client.15969 shutdown 2024-05-14T09:26:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.434+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 msgr2=0x562bf9edd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.434+0000 7f434cc10740 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9edd420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f432c005ab0 tx=0x7f432c03d8d0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 shutdown_connections 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9aefd80 0x562bf9ef2db0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b311b0 0x562bf9ee4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9edd420 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 --2- 172.21.15.120:0/1791640519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9edcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f4328c00640 0 client.15969 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 >> 172.21.15.120:0/1791640519 conn(0x562bf9b25300 msgr2=0x562bf9ed1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 shutdown_connections 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 1 -- 172.21.15.120:0/1791640519 wait complete. 2024-05-14T09:26:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.435+0000 7f434cc10740 20 client.15969 trim_cache size 0 max 16384 2024-05-14T09:26:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.453+0000 7f434cc10740 1 Processor -- start 2024-05-14T09:26:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.453+0000 7f434cc10740 1 -- start start 2024-05-14T09:26:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f434cc10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9ece4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f434cc10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b104d0 0x562bf9ecea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f434cc10740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b311b0 0x562bf9ee4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f434cc10740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43401aa5c0 con 0x562bf9b311b0 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f434cc10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f43401ac1c0 con 0x562bf9b082f0 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f434cc10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43401aac90 con 0x562bf9b104d0 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b311b0 0x562bf9ee4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b311b0 0x562bf9ee4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58442/0 (socket says 172.21.15.120:58442) 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 -- 172.21.15.120:0/4043487229 learned_addr learned my addr 172.21.15.120:0/4043487229 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433ea00640 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9ece4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433e000640 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b104d0 0x562bf9ecea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 -- 172.21.15.120:0/4043487229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b104d0 msgr2=0x562bf9ecea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b104d0 0x562bf9ecea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 -- 172.21.15.120:0/4043487229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 msgr2=0x562bf9ece4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9ece4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.454+0000 7f433f400640 1 -- 172.21.15.120:0/4043487229 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf9eca4a0 con 0x562bf9b311b0 2024-05-14T09:26:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.455+0000 7f433e000640 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b104d0 0x562bf9ecea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.455+0000 7f433f400640 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b311b0 0x562bf9ee4230 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f43380aa020 tx=0x7f433800f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a06f1d513c34983 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.455+0000 7f432b400640 1 -- 172.21.15.120:0/4043487229 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43380aa090 con 0x562bf9b311b0 2024-05-14T09:26:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.455+0000 7f432b400640 1 -- 172.21.15.120:0/4043487229 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43380ae440 con 0x562bf9b311b0 2024-05-14T09:26:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.455+0000 7f432b400640 1 -- 172.21.15.120:0/4043487229 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43380b2a60 con 0x562bf9b311b0 2024-05-14T09:26:41.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.456+0000 7f434cc10740 1 -- 172.21.15.120:0/4043487229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b311b0 msgr2=0x562bf9ee4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.456+0000 7f434cc10740 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b311b0 0x562bf9ee4230 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f43380aa020 tx=0x7f433800f8e0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.456+0000 7f434cc10740 1 -- 172.21.15.120:0/4043487229 shutdown_connections 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.456+0000 7f434cc10740 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b311b0 0x562bf9ee4230 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.456+0000 7f434cc10740 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b104d0 0x562bf9ecea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.456+0000 7f434cc10740 1 --2- 172.21.15.120:0/4043487229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b082f0 0x562bf9ece4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.456+0000 7f434cc10740 1 -- 172.21.15.120:0/4043487229 >> 172.21.15.120:0/4043487229 conn(0x562bf9b25300 msgr2=0x562bf9ed73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.457+0000 7f434cc10740 1 -- 172.21.15.120:0/4043487229 shutdown_connections 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.457+0000 7f434cc10740 1 -- 172.21.15.120:0/4043487229 wait complete. 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.457+0000 7f434cc10740 1 -- start start 2024-05-14T09:26:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.457+0000 7f434cc10740 1 Processor -- start 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f434cc10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ee1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f434cc10740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9ee1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f434cc10740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9f59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f434cc10740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43401aba30 con 0x562bf9b104d0 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f434cc10740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f43401ab360 con 0x562bf9b311b0 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f434cc10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43401a85e0 con 0x562bf9b082f0 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f434cc10740 10 client.0 _ll_register_callbacks cb 0x7f432c031840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9ee1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9ee1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58452/0 (socket says 172.21.15.120:58452) 2024-05-14T09:26:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 -- 172.21.15.120:0/414960708 learned_addr learned my addr 172.21.15.120:0/414960708 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433ea00640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ee1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433f400640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9f59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 -- 172.21.15.120:0/414960708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 msgr2=0x562bf9ee1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ee1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 -- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 msgr2=0x562bf9f59080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9f59080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.458+0000 7f433e000640 1 -- 172.21.15.120:0/414960708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf9ee4d70 con 0x562bf9b104d0 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f433f400640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9f59080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f433e000640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9ee1e90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f432c031460 tx=0x7f432c032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d432da5b5d3c26 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f4328c00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f4328c00640 1 -- 172.21.15.120:0/414960708 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c04e040 con 0x562bf9b104d0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f4328c00640 1 -- 172.21.15.120:0/414960708 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f432c031d80 con 0x562bf9b104d0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43380ae440 con 0x562bf9b104d0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f4328c00640 1 -- 172.21.15.120:0/414960708 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f432c06b050 con 0x562bf9b104d0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.459+0000 7f434cc10740 10 client.15975 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562bf9f5a510 con 0x562bf9b104d0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f4328c00640 1 -- 172.21.15.120:0/414960708 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43380ae440 con 0x562bf9b104d0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f4328c00640 1 -- 172.21.15.120:0/414960708 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f432c066030 con 0x562bf9b104d0 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f434cc10740 10 client.15975 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f434cc10740 10 client.15975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f434cc10740 20 client.15975 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f434cc10740 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9ac51c0 0x562bf9f5cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f434cc10740 4 client.15975 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:26:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.460+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562bf9dba4b0 con 0x562bf9ac51c0 2024-05-14T09:26:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.461+0000 7f433ea00640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9ac51c0 0x562bf9f5cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.462+0000 7f433ea00640 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9ac51c0 0x562bf9f5cf80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2304e79c21f06e50 server_cookie=1cc7959a733fad55 in_seq=0 out_seq=0 2024-05-14T09:26:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.462+0000 7f4328c00640 10 client.15975 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f4328c00640 1 -- 172.21.15.120:0/414960708 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562bf9dba4b0 con 0x562bf9ac51c0 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f4328c00640 10 client.15975 handle_command_reply: tid=0 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 client.15975 shutdown 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 msgr2=0x562bf9ee1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9ee1e90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f432c031460 tx=0x7f432c032fb0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 shutdown_connections 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562bf9ac51c0 0x562bf9f5cf80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562bf9b311b0 0x562bf9f59080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562bf9b104d0 0x562bf9ee1e90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 --2- 172.21.15.120:0/414960708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bf9b082f0 0x562bf9ee1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f4328c00640 0 client.15975 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 >> 172.21.15.120:0/414960708 conn(0x562bf9b25300 msgr2=0x562bf9ed1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.505+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 shutdown_connections 2024-05-14T09:26:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.506+0000 7f434cc10740 1 -- 172.21.15.120:0/414960708 wait complete. 2024-05-14T09:26:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.506+0000 7f434cc10740 20 client.15975 trim_cache size 0 max 16384 2024-05-14T09:26:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:26:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:26:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:26:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:26:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f43240b27e0 msgr2=0x7f43240b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f43240b27e0 0x7f43240b4cf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x562bf9ed46e0 tx=0x7f433000b4d0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43401099f0 msgr2=0x7f43401a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43401099f0 0x7f43401a37e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f433800cce0 tx=0x7f433800a620 comp rx=0 tx=0).stop 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 shutdown_connections 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f43240b27e0 0x7f43240b4cf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43401099f0 0x7f43401a37e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4340104cf0 0x7f434019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 --2- 172.21.15.120:0/4041326015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4340103ab0 0x7f434019c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 >> 172.21.15.120:0/4041326015 conn(0x7f43400fecc0 msgr2=0x7f43400ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 shutdown_connections 2024-05-14T09:26:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:41.507+0000 7f433fe00640 1 -- 172.21.15.120:0/4041326015 wait complete. 2024-05-14T09:26:42.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:41 smithi120 ceph-mon[31085]: pgmap v650: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 32 op/s 2024-05-14T09:26:42.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:41 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:26:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:41 smithi175 ceph-mon[35353]: pgmap v650: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 32 op/s 2024-05-14T09:26:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:41 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:26:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:41 smithi152 ceph-mon[34868]: pgmap v650: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 32 op/s 2024-05-14T09:26:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:41 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 -- 172.21.15.120:0/912958770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c109870 msgr2=0x7fcc3c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 --2- 172.21.15.120:0/912958770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c109870 0x7fcc3c1111d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400b0d0 tx=0x7fcc3400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 -- 172.21.15.120:0/912958770 shutdown_connections 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 --2- 172.21.15.120:0/912958770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c109870 0x7fcc3c1111d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 --2- 172.21.15.120:0/912958770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc3c1045f0 0x7fcc3c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 --2- 172.21.15.120:0/912958770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc3c108f20 0x7fcc3c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 -- 172.21.15.120:0/912958770 >> 172.21.15.120:0/912958770 conn(0x7fcc3c100040 msgr2=0x7fcc3c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 -- 172.21.15.120:0/912958770 shutdown_connections 2024-05-14T09:26:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.746+0000 7fcc42600700 1 -- 172.21.15.120:0/912958770 wait complete. 2024-05-14T09:26:43.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.747+0000 7fcc42600700 1 Processor -- start 2024-05-14T09:26:43.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.748+0000 7fcc42600700 1 -- start start 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.748+0000 7fcc42600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc3c1045f0 0x7fcc3c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.748+0000 7fcc42600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c108f20 0x7fcc3c19d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.748+0000 7fcc42600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc3c109870 0x7fcc3c1a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.748+0000 7fcc42600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c114350 con 0x7fcc3c108f20 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.748+0000 7fcc42600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1141d0 con 0x7fcc3c1045f0 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.748+0000 7fcc42600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1144d0 con 0x7fcc3c109870 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c108f20 0x7fcc3c19d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c108f20 0x7fcc3c19d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58472/0 (socket says 172.21.15.120:58472) 2024-05-14T09:26:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2100575573 learned_addr learned my addr 172.21.15.120:0/2100575573 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3b400700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc3c1045f0 0x7fcc3c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3be00700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc3c109870 0x7fcc3c1a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2100575573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc3c109870 msgr2=0x7fcc3c1a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc3c109870 0x7fcc3c1a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2100575573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc3c1045f0 msgr2=0x7fcc3c19cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc3c1045f0 0x7fcc3c19cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2100575573 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3c1a1dd0 con 0x7fcc3c108f20 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.749+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c108f20 0x7fcc3c19d4a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800d980 tx=0x7fcc2800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.750+0000 7fcc33e00700 1 -- 172.21.15.120:0/2100575573 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28017070 con 0x7fcc3c108f20 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.750+0000 7fcc33e00700 1 -- 172.21.15.120:0/2100575573 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc28010460 con 0x7fcc3c108f20 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.750+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3c1a20c0 con 0x7fcc3c108f20 2024-05-14T09:26:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.750+0000 7fcc33e00700 1 -- 172.21.15.120:0/2100575573 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800de60 con 0x7fcc3c108f20 2024-05-14T09:26:43.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.750+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3c1a99e0 con 0x7fcc3c108f20 2024-05-14T09:26:43.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.754+0000 7fcc33e00700 1 -- 172.21.15.120:0/2100575573 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fcc28010610 con 0x7fcc3c108f20 2024-05-14T09:26:43.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.756+0000 7fcc510b1b80 1 Processor -- start 2024-05-14T09:26:43.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.756+0000 7fcc510b1b80 1 -- start start 2024-05-14T09:26:43.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475b1fe40 0x55c475ca32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475ca3830 0x55c475c9d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475c9d9f0 0x55c475c9de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c475bbfa20 con 0x55c475b1fe40 2024-05-14T09:26:43.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c475b5d760 con 0x55c475ca3830 2024-05-14T09:26:43.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c475bbb9e0 con 0x55c475c9d9f0 2024-05-14T09:26:43.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc33e00700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcc200b2900 0x7fcc200b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc3be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475b1fe40 0x55c475ca32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc33e00700 1 -- 172.21.15.120:0/2100575573 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fcc280e2060 con 0x7fcc3c108f20 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc3b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475ca3830 0x55c475c9d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc3be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475b1fe40 0x55c475ca32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58480/0 (socket says 172.21.15.120:58480) 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.757+0000 7fcc3be00700 1 -- 172.21.15.120:0/3431618239 learned_addr learned my addr 172.21.15.120:0/3431618239 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475c9d9f0 0x55c475c9de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3be00700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcc200b2900 0x7fcc200b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3be00700 1 -- 172.21.15.120:0/3431618239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475c9d9f0 msgr2=0x55c475c9de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3be00700 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475c9d9f0 0x55c475c9de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3be00700 1 -- 172.21.15.120:0/3431618239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475ca3830 msgr2=0x55c475c9d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3be00700 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475ca3830 0x55c475c9d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3be00700 1 -- 172.21.15.120:0/3431618239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c475b0c8d0 con 0x55c475b1fe40 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3b400700 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475ca3830 0x55c475c9d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:43.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.758+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475c9d9f0 0x55c475c9de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:43.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.759+0000 7fcc3be00700 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475b1fe40 0x55c475ca32f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcc340093e0 tx=0x7fcc34009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46115a3ca2325975 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:43.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.759+0000 7fcc30c00700 1 -- 172.21.15.120:0/3431618239 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3402e070 con 0x55c475b1fe40 2024-05-14T09:26:43.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.759+0000 7fcc30c00700 1 -- 172.21.15.120:0/3431618239 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc34007cc0 con 0x55c475b1fe40 2024-05-14T09:26:43.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.759+0000 7fcc30c00700 1 -- 172.21.15.120:0/3431618239 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34029430 con 0x55c475b1fe40 2024-05-14T09:26:43.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.759+0000 7fcc3be00700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcc200b2900 0x7fcc200b4e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc3402b000 tx=0x7fcc34027000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:43.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.760+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3431618239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475b1fe40 msgr2=0x55c475ca32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.760+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475b1fe40 0x55c475ca32f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcc340093e0 tx=0x7fcc34009410 comp rx=0 tx=0).stop 2024-05-14T09:26:43.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.760+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3431618239 shutdown_connections 2024-05-14T09:26:43.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.760+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475c9d9f0 0x55c475c9de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.760+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475b1fe40 0x55c475ca32f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.761+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3431618239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475ca3830 0x55c475c9d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.761+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3431618239 >> 172.21.15.120:0/3431618239 conn(0x55c475b64f70 msgr2=0x55c475c982d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:43.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.761+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3431618239 shutdown_connections 2024-05-14T09:26:43.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.761+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3431618239 wait complete. 2024-05-14T09:26:43.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.761+0000 7fcc510b1b80 1 -- start start 2024-05-14T09:26:43.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 1 Processor -- start 2024-05-14T09:26:43.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475ca7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475ca7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475ca7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c475caa310 con 0x55c475c9d9f0 2024-05-14T09:26:43.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c475b25b20 con 0x55c475b1fe40 2024-05-14T09:26:43.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c475caa490 con 0x55c475ca3830 2024-05-14T09:26:43.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.762+0000 7fcc510b1b80 10 client.0 _ll_register_callbacks cb 0x55c475b66c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475ca7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475ca7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475ca7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58488/0 (socket says 172.21.15.120:58488) 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 -- 172.21.15.120:0/3688454959 learned_addr learned my addr 172.21.15.120:0/3688454959 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3be00700 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475ca7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 -- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 msgr2=0x55c475ca7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475ca7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 -- 172.21.15.120:0/3688454959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 msgr2=0x55c475ca7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475ca7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.763+0000 7fcc3aa00700 1 -- 172.21.15.120:0/3688454959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c475b85420 con 0x55c475c9d9f0 2024-05-14T09:26:43.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.764+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475ca7580 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcc280a9210 tx=0x7fcc280a9a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e3efee19ad8d9b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:43.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.764+0000 7fcc25600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:43.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.764+0000 7fcc25600700 1 -- 172.21.15.120:0/3688454959 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28020040 con 0x55c475c9d9f0 2024-05-14T09:26:43.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.764+0000 7fcc25600700 1 -- 172.21.15.120:0/3688454959 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fcc280a96f0 con 0x55c475c9d9f0 2024-05-14T09:26:43.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.764+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc34007cc0 con 0x55c475c9d9f0 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.764+0000 7fcc25600700 1 -- 172.21.15.120:0/3688454959 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcc280ad630 con 0x55c475c9d9f0 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.764+0000 7fcc510b1b80 10 client.15987 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c475cb4e60 con 0x55c475c9d9f0 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc25600700 1 -- 172.21.15.120:0/3688454959 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc34007cc0 con 0x55c475c9d9f0 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc25600700 1 -- 172.21.15.120:0/3688454959 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fcc28009cb0 con 0x55c475c9d9f0 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc510b1b80 10 client.15987 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc510b1b80 10 client.15987 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc510b1b80 20 client.15987 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475cb73f0 0x55c475cb9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc510b1b80 4 client.15987 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:43.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.765+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c475c6a1c0 con 0x55c475cb73f0 2024-05-14T09:26:43.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.766+0000 7fcc3b400700 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475cb73f0 0x55c475cb9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.767+0000 7fcc3b400700 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475cb73f0 0x55c475cb9810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2482a764e96d794c server_cookie=e849d6b9ee3d002c in_seq=0 out_seq=0 2024-05-14T09:26:43.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.767+0000 7fcc25600700 10 client.15987 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:26:43.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.769+0000 7fcc25600700 1 -- 172.21.15.120:0/3688454959 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c475c6a1c0 con 0x55c475cb73f0 2024-05-14T09:26:43.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.769+0000 7fcc25600700 10 client.15987 handle_command_reply: tid=0 2024-05-14T09:26:43.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 client.15987 shutdown 2024-05-14T09:26:43.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 msgr2=0x55c475ca7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475ca7580 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcc280a9210 tx=0x7fcc280a9a00 comp rx=0 tx=0).stop 2024-05-14T09:26:43.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 shutdown_connections 2024-05-14T09:26:43.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475ca7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475cb73f0 0x55c475cb9810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475ca7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/3688454959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475ca7580 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 >> 172.21.15.120:0/3688454959 conn(0x55c475b64f70 msgr2=0x55c475c9c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:43.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc25600700 0 client.15987 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:26:43.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.770+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 shutdown_connections 2024-05-14T09:26:43.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.771+0000 7fcc510b1b80 1 -- 172.21.15.120:0/3688454959 wait complete. 2024-05-14T09:26:43.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.771+0000 7fcc510b1b80 20 client.15987 trim_cache size 0 max 16384 2024-05-14T09:26:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.792+0000 7fcc510b1b80 1 Processor -- start 2024-05-14T09:26:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.792+0000 7fcc510b1b80 1 -- start start 2024-05-14T09:26:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475b1fe40 0x55c475c9d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475c9d9f0 0x55c475ca1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475ca3830 0x55c475cb3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b24c0 con 0x55c475ca3830 2024-05-14T09:26:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b40c0 con 0x55c475c9d9f0 2024-05-14T09:26:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b2b90 con 0x55c475b1fe40 2024-05-14T09:26:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc3be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475ca3830 0x55c475cb3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc3be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475ca3830 0x55c475cb3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58502/0 (socket says 172.21.15.120:58502) 2024-05-14T09:26:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc3be00700 1 -- 172.21.15.120:0/1781207361 learned_addr learned my addr 172.21.15.120:0/1781207361 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.793+0000 7fcc3b400700 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475b1fe40 0x55c475c9d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475c9d9f0 0x55c475ca1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc3be00700 1 -- 172.21.15.120:0/1781207361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475b1fe40 msgr2=0x55c475c9d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc3be00700 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475b1fe40 0x55c475c9d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc3be00700 1 -- 172.21.15.120:0/1781207361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475c9d9f0 msgr2=0x55c475ca1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc3be00700 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475c9d9f0 0x55c475ca1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc3be00700 1 -- 172.21.15.120:0/1781207361 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c475ca98e0 con 0x55c475ca3830 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc3be00700 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475ca3830 0x55c475cb3360 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009060 tx=0x7fcc34022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7364624db953d19 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.794+0000 7fcc27e00700 1 -- 172.21.15.120:0/1781207361 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3402e040 con 0x55c475ca3830 2024-05-14T09:26:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.795+0000 7fcc27e00700 1 -- 172.21.15.120:0/1781207361 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc34029430 con 0x55c475ca3830 2024-05-14T09:26:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.795+0000 7fcc27e00700 1 -- 172.21.15.120:0/1781207361 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34029c80 con 0x55c475ca3830 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 -- 172.21.15.120:0/1781207361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475ca3830 msgr2=0x55c475cb3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475ca3830 0x55c475cb3360 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009060 tx=0x7fcc34022000 comp rx=0 tx=0).stop 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 -- 172.21.15.120:0/1781207361 shutdown_connections 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475ca3830 0x55c475cb3360 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475b1fe40 0x55c475c9d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/1781207361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475c9d9f0 0x55c475ca1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 -- 172.21.15.120:0/1781207361 >> 172.21.15.120:0/1781207361 conn(0x55c475b64f70 msgr2=0x55c475ca0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 -- 172.21.15.120:0/1781207361 shutdown_connections 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.796+0000 7fcc510b1b80 1 -- 172.21.15.120:0/1781207361 wait complete. 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.797+0000 7fcc510b1b80 1 -- start start 2024-05-14T09:26:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.797+0000 7fcc510b1b80 1 Processor -- start 2024-05-14T09:26:43.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475cbe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475cbee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc510b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475cbf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b3930 con 0x55c475c9d9f0 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b3260 con 0x55c475b1fe40 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc510b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b0480 con 0x55c475ca3830 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc510b1b80 10 client.0 _ll_register_callbacks cb 0x55c475c988c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc3aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475cbee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc3aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475cbee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58504/0 (socket says 172.21.15.120:58504) 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2944066790 learned_addr learned my addr 172.21.15.120:0/2944066790 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc3b400700 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475cbe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.798+0000 7fcc3be00700 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475cbf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 msgr2=0x55c475cbf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475cbf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2944066790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 msgr2=0x55c475cbe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475cbe8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc3aa00700 1 -- 172.21.15.120:0/2944066790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c475d29440 con 0x55c475c9d9f0 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc3aa00700 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475cbee20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcc280a8500 tx=0x7fcc280b1e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe478b729d0dff35 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc25600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc25600700 1 -- 172.21.15.120:0/2944066790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28020070 con 0x55c475c9d9f0 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc25600700 1 -- 172.21.15.120:0/2944066790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fcc280a5870 con 0x55c475c9d9f0 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc34029430 con 0x55c475c9d9f0 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.799+0000 7fcc25600700 1 -- 172.21.15.120:0/2944066790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcc280a8bd0 con 0x55c475c9d9f0 2024-05-14T09:26:43.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 10 client.15993 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c475d2a640 con 0x55c475c9d9f0 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc25600700 1 -- 172.21.15.120:0/2944066790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc34029430 con 0x55c475c9d9f0 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc25600700 1 -- 172.21.15.120:0/2944066790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fcc280a4bf0 con 0x55c475c9d9f0 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 10 client.15993 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 20 client.15993 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475d2add0 0x55c475d2d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 4 client.15993 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:26:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.800+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c475bcd400 con 0x55c475d2add0 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.801+0000 7fcc3b400700 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475d2add0 0x55c475d2d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.802+0000 7fcc3b400700 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475d2add0 0x55c475d2d1f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=105cf8adce213ebc server_cookie=548e6a25517d7e6 in_seq=0 out_seq=0 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.802+0000 7fcc25600700 10 client.15993 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc25600700 1 -- 172.21.15.120:0/2944066790 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c475bcd400 con 0x55c475d2add0 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc25600700 10 client.15993 handle_command_reply: tid=0 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 client.15993 shutdown 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 msgr2=0x55c475cbee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475cbee20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcc280a8500 tx=0x7fcc280b1e80 comp rx=0 tx=0).stop 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 shutdown_connections 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c475b1fe40 0x55c475cbe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c475d2add0 0x55c475d2d1f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c475ca3830 0x55c475cbf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 --2- 172.21.15.120:0/2944066790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c475c9d9f0 0x55c475cbee20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc25600700 0 client.15993 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.803+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 >> 172.21.15.120:0/2944066790 conn(0x55c475b64f70 msgr2=0x55c475ca1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.804+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 shutdown_connections 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.804+0000 7fcc510b1b80 1 -- 172.21.15.120:0/2944066790 wait complete. 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.804+0000 7fcc510b1b80 20 client.15993 trim_cache size 0 max 16384 2024-05-14T09:26:43.805 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcc200b2900 msgr2=0x7fcc200b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcc200b2900 0x7fcc200b4e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc3402b000 tx=0x7fcc34027000 comp rx=0 tx=0).stop 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c108f20 msgr2=0x7fcc3c19d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c108f20 0x7fcc3c19d4a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800d980 tx=0x7fcc2800dd40 comp rx=0 tx=0).stop 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 shutdown_connections 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcc200b2900 0x7fcc200b4e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc3c1045f0 0x7fcc3c19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc3c109870 0x7fcc3c1a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 --2- 172.21.15.120:0/2100575573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc3c108f20 0x7fcc3c19d4a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:43.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 >> 172.21.15.120:0/2100575573 conn(0x7fcc3c100040 msgr2=0x7fcc3c110e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:43.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 shutdown_connections 2024-05-14T09:26:43.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:43.805+0000 7fcc42600700 1 -- 172.21.15.120:0/2100575573 wait complete. 2024-05-14T09:26:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:43 smithi120 ceph-mon[31085]: pgmap v651: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 32 op/s 2024-05-14T09:26:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:43 smithi152 ceph-mon[34868]: pgmap v651: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 32 op/s 2024-05-14T09:26:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:43 smithi175 ceph-mon[35353]: pgmap v651: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 32 op/s 2024-05-14T09:26:44.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T09:26:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:46.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:45 smithi120 ceph-mon[31085]: pgmap v652: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 30 op/s 2024-05-14T09:26:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:45 smithi152 ceph-mon[34868]: pgmap v652: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 30 op/s 2024-05-14T09:26:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:45 smithi175 ceph-mon[35353]: pgmap v652: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 30 op/s 2024-05-14T09:26:47.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.760+0000 7fad13800700 1 -- 172.21.15.120:0/2902673888 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 msgr2=0x7fad0c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.760+0000 7fad13800700 1 --2- 172.21.15.120:0/2902673888 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c1111d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fad0400b0d0 tx=0x7fad0400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.760+0000 7fad13800700 1 -- 172.21.15.120:0/2902673888 shutdown_connections 2024-05-14T09:26:47.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.760+0000 7fad13800700 1 --2- 172.21.15.120:0/2902673888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c1045f0 0x7fad0c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.760+0000 7fad13800700 1 --2- 172.21.15.120:0/2902673888 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c1111d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.760+0000 7fad13800700 1 --2- 172.21.15.120:0/2902673888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad0c108f20 0x7fad0c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.760+0000 7fad13800700 1 -- 172.21.15.120:0/2902673888 >> 172.21.15.120:0/2902673888 conn(0x7fad0c100040 msgr2=0x7fad0c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:47.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.761+0000 7fad13800700 1 -- 172.21.15.120:0/2902673888 shutdown_connections 2024-05-14T09:26:47.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.761+0000 7fad13800700 1 -- 172.21.15.120:0/2902673888 wait complete. 2024-05-14T09:26:47.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.762+0000 7fad13800700 1 Processor -- start 2024-05-14T09:26:47.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.763+0000 7fad13800700 1 -- start start 2024-05-14T09:26:47.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.763+0000 7fad13800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c1045f0 0x7fad0c19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.763+0000 7fad13800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad0c108f20 0x7fad0c19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.763+0000 7fad13800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.763+0000 7fad13800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c114410 con 0x7fad0c109870 2024-05-14T09:26:47.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.763+0000 7fad13800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c114290 con 0x7fad0c1045f0 2024-05-14T09:26:47.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.763+0000 7fad13800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c114590 con 0x7fad0c108f20 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.764+0000 7fad11800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.764+0000 7fad11800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c19f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58514/0 (socket says 172.21.15.120:58514) 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.764+0000 7fad11800700 1 -- 172.21.15.120:0/2147083592 learned_addr learned my addr 172.21.15.120:0/2147083592 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.764+0000 7fad10e00700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c1045f0 0x7fad0c19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.764+0000 7fad0be00700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad0c108f20 0x7fad0c19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.764+0000 7fad11800700 1 -- 172.21.15.120:0/2147083592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad0c108f20 msgr2=0x7fad0c19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.764+0000 7fad11800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad0c108f20 0x7fad0c19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad11800700 1 -- 172.21.15.120:0/2147083592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c1045f0 msgr2=0x7fad0c19ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad11800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c1045f0 0x7fad0c19ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad11800700 1 -- 172.21.15.120:0/2147083592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c19fcb0 con 0x7fad0c109870 2024-05-14T09:26:47.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad11800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c19f610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fad04007d10 tx=0x7fad04007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:47.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad09600700 1 -- 172.21.15.120:0/2147083592 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0401f070 con 0x7fad0c109870 2024-05-14T09:26:47.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c19ff40 con 0x7fad0c109870 2024-05-14T09:26:47.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad09600700 1 -- 172.21.15.120:0/2147083592 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad04005500 con 0x7fad0c109870 2024-05-14T09:26:47.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.765+0000 7fad09600700 1 -- 172.21.15.120:0/2147083592 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0401b830 con 0x7fad0c109870 2024-05-14T09:26:47.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.766+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c1a0420 con 0x7fad0c109870 2024-05-14T09:26:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.770+0000 7fad09600700 1 -- 172.21.15.120:0/2147083592 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fad04022070 con 0x7fad0c109870 2024-05-14T09:26:47.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.771+0000 7fad223afb80 1 Processor -- start 2024-05-14T09:26:47.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.771+0000 7fad223afb80 1 -- start start 2024-05-14T09:26:47.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad223afb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc3056a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad09600700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facf40b2880 0x7facf40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad223afb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc3050b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad223afb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 0x560cc3051470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad223afb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560cc2f6ea20 con 0x560cc2ecee40 2024-05-14T09:26:47.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad223afb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560cc2f0c760 con 0x560cc3051060 2024-05-14T09:26:47.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad223afb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cc2f6a9e0 con 0x560cc3056fb0 2024-05-14T09:26:47.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad09600700 1 -- 172.21.15.120:0/2147083592 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fad0400f020 con 0x7fad0c109870 2024-05-14T09:26:47.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad0be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc3056a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad10e00700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facf40b2880 0x7facf40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad0be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc3056a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58526/0 (socket says 172.21.15.120:58526) 2024-05-14T09:26:47.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.772+0000 7fad0be00700 1 -- 172.21.15.120:0/501087675 learned_addr learned my addr 172.21.15.120:0/501087675 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:47.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.773+0000 7fad0be00700 1 -- 172.21.15.120:0/501087675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 msgr2=0x560cc3050b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.773+0000 7fad0be00700 1 --2- 172.21.15.120:0/501087675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc3050b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.773+0000 7fad0be00700 1 -- 172.21.15.120:0/501087675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 msgr2=0x560cc3051470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.773+0000 7fad0be00700 1 --2- 172.21.15.120:0/501087675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 0x560cc3051470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.773+0000 7fad0be00700 1 -- 172.21.15.120:0/501087675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc2ebb8d0 con 0x560cc2ecee40 2024-05-14T09:26:47.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.773+0000 7fad10e00700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facf40b2880 0x7facf40b4d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fad00005950 tx=0x7fad0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:47.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.773+0000 7fad0be00700 1 --2- 172.21.15.120:0/501087675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc3056a70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7facf8009b90 tx=0x7facf8009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598a9cac503ef1cf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:47.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.774+0000 7facfe000700 1 -- 172.21.15.120:0/501087675 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8017070 con 0x560cc2ecee40 2024-05-14T09:26:47.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.774+0000 7facfe000700 1 -- 172.21.15.120:0/501087675 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facf800ee80 con 0x560cc2ecee40 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 -- 172.21.15.120:0/501087675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 msgr2=0x560cc3056a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 --2- 172.21.15.120:0/501087675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc3056a70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7facf8009b90 tx=0x7facf8009ea0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 -- 172.21.15.120:0/501087675 shutdown_connections 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 --2- 172.21.15.120:0/501087675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 0x560cc3051470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 --2- 172.21.15.120:0/501087675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc3056a70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 --2- 172.21.15.120:0/501087675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc3050b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 -- 172.21.15.120:0/501087675 >> 172.21.15.120:0/501087675 conn(0x560cc2f0da80 msgr2=0x560cc3047790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 -- 172.21.15.120:0/501087675 shutdown_connections 2024-05-14T09:26:47.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.775+0000 7fad223afb80 1 -- 172.21.15.120:0/501087675 wait complete. 2024-05-14T09:26:47.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.776+0000 7fad223afb80 1 -- start start 2024-05-14T09:26:47.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.776+0000 7fad223afb80 1 Processor -- start 2024-05-14T09:26:47.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.777+0000 7fad223afb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc305a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.777+0000 7fad223afb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 0x560cc305add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.777+0000 7fad223afb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc305b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.777+0000 7fad223afb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560cc305db00 con 0x560cc2ecee40 2024-05-14T09:26:47.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.777+0000 7fad223afb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560cc2ed4b20 con 0x560cc3051060 2024-05-14T09:26:47.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.777+0000 7fad223afb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cc305dc80 con 0x560cc3056fb0 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.777+0000 7fad223afb80 10 client.0 _ll_register_callbacks cb 0x560cc2f02380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc305a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc305a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58538/0 (socket says 172.21.15.120:58538) 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 -- 172.21.15.120:0/3398829168 learned_addr learned my addr 172.21.15.120:0/3398829168 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad11800700 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc305b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad0be00700 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 0x560cc305add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 -- 172.21.15.120:0/3398829168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 msgr2=0x560cc305b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc305b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 -- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 msgr2=0x560cc305add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 0x560cc305add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.778+0000 7fad10e00700 1 -- 172.21.15.120:0/3398829168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc2f34420 con 0x560cc2ecee40 2024-05-14T09:26:47.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.779+0000 7fad10e00700 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc305a890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fad000116f0 tx=0x7fad000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395b3e81c55d55b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:47.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.779+0000 7facf2a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:47.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.779+0000 7facf2a00700 1 -- 172.21.15.120:0/3398829168 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000be60 con 0x560cc2ecee40 2024-05-14T09:26:47.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.779+0000 7facf2a00700 1 -- 172.21.15.120:0/3398829168 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fad0001e830 con 0x560cc2ecee40 2024-05-14T09:26:47.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.780+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cc3019070 con 0x560cc2ecee40 2024-05-14T09:26:47.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.780+0000 7facf2a00700 1 -- 172.21.15.120:0/3398829168 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fad0002e050 con 0x560cc2ecee40 2024-05-14T09:26:47.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.781+0000 7fad223afb80 10 client.16005 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:47.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.781+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560cc3068880 con 0x560cc2ecee40 2024-05-14T09:26:47.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.781+0000 7facf2a00700 1 -- 172.21.15.120:0/3398829168 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560cc3019070 con 0x560cc2ecee40 2024-05-14T09:26:47.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.781+0000 7facf2a00700 1 -- 172.21.15.120:0/3398829168 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fad00026a80 con 0x560cc2ecee40 2024-05-14T09:26:47.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.782+0000 7fad223afb80 10 client.16005 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:47.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.782+0000 7fad223afb80 10 client.16005 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:26:47.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.782+0000 7fad223afb80 20 client.16005 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:47.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.782+0000 7fad223afb80 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc306ae60 0x560cc306d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.782+0000 7fad223afb80 4 client.16005 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:47.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.782+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cc2f7c400 con 0x560cc306ae60 2024-05-14T09:26:47.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.783+0000 7fad0be00700 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc306ae60 0x560cc306d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.784+0000 7fad0be00700 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc306ae60 0x560cc306d280 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc2a007e6267ae44 server_cookie=da1514ae53b0b621 in_seq=0 out_seq=0 2024-05-14T09:26:47.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.784+0000 7facf2a00700 10 client.16005 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:26:47.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7facf2a00700 1 -- 172.21.15.120:0/3398829168 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560cc2f7c400 con 0x560cc306ae60 2024-05-14T09:26:47.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7facf2a00700 10 client.16005 handle_command_reply: tid=0 2024-05-14T09:26:47.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 client.16005 shutdown 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 msgr2=0x560cc305a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc305a890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fad000116f0 tx=0x7fad000047c0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 shutdown_connections 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc306ae60 0x560cc306d280 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc305b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc2ecee40 0x560cc305a890 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 --2- 172.21.15.120:0/3398829168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc3051060 0x560cc305add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.786+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 >> 172.21.15.120:0/3398829168 conn(0x560cc2f0da80 msgr2=0x560cc304b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:47.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.787+0000 7facf2a00700 0 client.16005 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:26:47.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.787+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 shutdown_connections 2024-05-14T09:26:47.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.787+0000 7fad223afb80 1 -- 172.21.15.120:0/3398829168 wait complete. 2024-05-14T09:26:47.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.788+0000 7fad223afb80 20 client.16005 trim_cache size 0 max 16384 2024-05-14T09:26:47.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.809+0000 7fad223afb80 1 Processor -- start 2024-05-14T09:26:47.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.810+0000 7fad223afb80 1 -- start start 2024-05-14T09:26:47.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.810+0000 7fad223afb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3041aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.810+0000 7fad223afb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3051060 0x560cc305b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.810+0000 7fad223afb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3056fb0 0x560cc3059890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.810+0000 7fad223afb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1adfa0 con 0x560cc3056fb0 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.810+0000 7fad223afb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1afba0 con 0x560cc2ecee40 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.810+0000 7fad223afb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1ae670 con 0x560cc3051060 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3056fb0 0x560cc3059890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3056fb0 0x560cc3059890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58546/0 (socket says 172.21.15.120:58546) 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 -- 172.21.15.120:0/2755821666 learned_addr learned my addr 172.21.15.120:0/2755821666 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad0be00700 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3051060 0x560cc305b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad10e00700 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3041aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 -- 172.21.15.120:0/2755821666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3051060 msgr2=0x560cc305b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3051060 0x560cc305b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 -- 172.21.15.120:0/2755821666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 msgr2=0x560cc3041aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3041aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.811+0000 7fad11800700 1 -- 172.21.15.120:0/2755821666 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc30420e0 con 0x560cc3056fb0 2024-05-14T09:26:47.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.812+0000 7fad11800700 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3056fb0 0x560cc3059890 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fad04009a20 tx=0x7fad04009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbdedfb49b1f124 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:47.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.812+0000 7facfd600700 1 -- 172.21.15.120:0/2755821666 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040b3380 con 0x560cc3056fb0 2024-05-14T09:26:47.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.812+0000 7facfd600700 1 -- 172.21.15.120:0/2755821666 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad040c4070 con 0x560cc3056fb0 2024-05-14T09:26:47.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.812+0000 7facfd600700 1 -- 172.21.15.120:0/2755821666 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040b3a40 con 0x560cc3056fb0 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 -- 172.21.15.120:0/2755821666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3056fb0 msgr2=0x560cc3059890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3056fb0 0x560cc3059890 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fad04009a20 tx=0x7fad04009530 comp rx=0 tx=0).stop 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 -- 172.21.15.120:0/2755821666 shutdown_connections 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3041aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3056fb0 0x560cc3059890 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 --2- 172.21.15.120:0/2755821666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3051060 0x560cc305b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 -- 172.21.15.120:0/2755821666 >> 172.21.15.120:0/2755821666 conn(0x560cc2f0da80 msgr2=0x560cc3059180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 -- 172.21.15.120:0/2755821666 shutdown_connections 2024-05-14T09:26:47.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.813+0000 7fad223afb80 1 -- 172.21.15.120:0/2755821666 wait complete. 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.814+0000 7fad223afb80 1 -- start start 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.814+0000 7fad223afb80 1 Processor -- start 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad223afb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3073070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad223afb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3051060 0x560cc3062f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad223afb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc3063560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad223afb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1af410 con 0x560cc3051060 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad223afb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1aed40 con 0x560cc2ecee40 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad223afb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1abf60 con 0x560cc3056fb0 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad223afb80 10 client.0 _ll_register_callbacks cb 0x560cc2f02380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:47.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad0be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3051060 0x560cc3062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad0be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3051060 0x560cc3062f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58562/0 (socket says 172.21.15.120:58562) 2024-05-14T09:26:47.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad0be00700 1 -- 172.21.15.120:0/1204192845 learned_addr learned my addr 172.21.15.120:0/1204192845 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:47.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.815+0000 7fad10e00700 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7fad0be00700 1 -- 172.21.15.120:0/1204192845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 msgr2=0x560cc3063560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7fad0be00700 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc3063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7fad0be00700 1 -- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 msgr2=0x560cc3073070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:47.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7fad0be00700 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3073070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7fad0be00700 1 -- 172.21.15.120:0/1204192845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc3071b60 con 0x560cc3051060 2024-05-14T09:26:47.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7fad10e00700 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:47.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7fad0be00700 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3051060 0x560cc3062f60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7facf8008010 tx=0x7facf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72a822132e491da server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:47.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.816+0000 7facf2a00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:47.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.817+0000 7facf2a00700 1 -- 172.21.15.120:0/1204192845 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf802d070 con 0x560cc3051060 2024-05-14T09:26:47.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.817+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad040c4070 con 0x560cc3051060 2024-05-14T09:26:47.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.817+0000 7facf2a00700 1 -- 172.21.15.120:0/1204192845 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7facf80263f0 con 0x560cc3051060 2024-05-14T09:26:47.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.817+0000 7facf2a00700 1 -- 172.21.15.120:0/1204192845 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7facf8039050 con 0x560cc3051060 2024-05-14T09:26:47.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.817+0000 7fad223afb80 10 client.16011 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:47.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.817+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560cc30d4950 con 0x560cc3051060 2024-05-14T09:26:47.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.819+0000 7facf2a00700 1 -- 172.21.15.120:0/1204192845 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad040c4070 con 0x560cc3051060 2024-05-14T09:26:47.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.819+0000 7facf2a00700 1 -- 172.21.15.120:0/1204192845 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7facf801c5f0 con 0x560cc3051060 2024-05-14T09:26:47.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.820+0000 7fad223afb80 10 client.16011 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:47.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.820+0000 7fad223afb80 10 client.16011 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:26:47.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.820+0000 7fad223afb80 20 client.16011 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:47.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.820+0000 7fad223afb80 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc30d4ed0 0x560cc30d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:47.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.820+0000 7fad223afb80 4 client.16011 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:26:47.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.820+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560cc2f764a0 con 0x560cc30d4ed0 2024-05-14T09:26:47.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.821+0000 7fad10e00700 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc30d4ed0 0x560cc30d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:47.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.822+0000 7facf2a00700 10 client.16011 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:26:47.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.822+0000 7fad10e00700 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc30d4ed0 0x560cc30d72f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a753bdcfb858c54e server_cookie=9a08fd99a0618610 in_seq=0 out_seq=0 2024-05-14T09:26:47.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7facf2a00700 1 -- 172.21.15.120:0/1204192845 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560cc2f764a0 con 0x560cc30d4ed0 2024-05-14T09:26:47.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7facf2a00700 10 client.16011 handle_command_reply: tid=0 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 client.16011 shutdown 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3051060 msgr2=0x560cc3062f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3051060 0x560cc3062f60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7facf8008010 tx=0x7facf8004750 comp rx=0 tx=0).stop 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 shutdown_connections 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cc2ecee40 0x560cc3073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x560cc30d4ed0 0x560cc30d72f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc3056fb0 0x560cc3063560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 --2- 172.21.15.120:0/1204192845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cc3051060 0x560cc3062f60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 >> 172.21.15.120:0/1204192845 conn(0x560cc2f0da80 msgr2=0x560cc3054c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.823+0000 7facf2a00700 0 client.16011 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.824+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 shutdown_connections 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.824+0000 7fad223afb80 1 -- 172.21.15.120:0/1204192845 wait complete. 2024-05-14T09:26:47.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.824+0000 7fad223afb80 20 client.16011 trim_cache size 0 max 16384 2024-05-14T09:26:47.825 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:26:47.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facf40b2880 msgr2=0x7facf40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facf40b2880 0x7facf40b4d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fad00005950 tx=0x7fad0000b410 comp rx=0 tx=0).stop 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 msgr2=0x7fad0c19f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c19f610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fad04007d10 tx=0x7fad04007d40 comp rx=0 tx=0).stop 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 shutdown_connections 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7facf40b2880 0x7facf40b4d90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c1045f0 0x7fad0c19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad0c109870 0x7fad0c19f610 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 --2- 172.21.15.120:0/2147083592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad0c108f20 0x7fad0c19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.825+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 >> 172.21.15.120:0/2147083592 conn(0x7fad0c100040 msgr2=0x7fad0c10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.826+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 shutdown_connections 2024-05-14T09:26:47.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:47.826+0000 7fad13800700 1 -- 172.21.15.120:0/2147083592 wait complete. 2024-05-14T09:26:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:47 smithi120 ceph-mon[31085]: pgmap v653: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 36 op/s 2024-05-14T09:26:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:47 smithi152 ceph-mon[34868]: pgmap v653: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 36 op/s 2024-05-14T09:26:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:47 smithi175 ceph-mon[35353]: pgmap v653: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 36 op/s 2024-05-14T09:26:48.834 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T09:26:49.323 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:50.060 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:49 smithi120 ceph-mon[31085]: pgmap v654: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 33 op/s 2024-05-14T09:26:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:49 smithi152 ceph-mon[34868]: pgmap v654: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 33 op/s 2024-05-14T09:26:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:49 smithi175 ceph-mon[35353]: pgmap v654: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 33 op/s 2024-05-14T09:26:52.241 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:52 smithi120 ceph-mon[31085]: pgmap v655: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 34 op/s 2024-05-14T09:26:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:52 smithi152 ceph-mon[34868]: pgmap v655: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 34 op/s 2024-05-14T09:26:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:52 smithi175 ceph-mon[35353]: pgmap v655: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 34 op/s 2024-05-14T09:26:52.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 -- 172.21.15.120:0/372932620 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c10b870 msgr2=0x7f4c2c1131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 --2- 172.21.15.120:0/372932620 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c10b870 0x7f4c2c1131d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400b0d0 tx=0x7f4c2400b3e0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 -- 172.21.15.120:0/372932620 shutdown_connections 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 --2- 172.21.15.120:0/372932620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c106640 0x7f4c2c106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 --2- 172.21.15.120:0/372932620 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c10b870 0x7f4c2c1131d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 --2- 172.21.15.120:0/372932620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c2c10af20 0x7f4c2c10b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 -- 172.21.15.120:0/372932620 >> 172.21.15.120:0/372932620 conn(0x7f4c2c102030 msgr2=0x7f4c2c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 -- 172.21.15.120:0/372932620 shutdown_connections 2024-05-14T09:26:52.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.887+0000 7f4c2b200700 1 -- 172.21.15.120:0/372932620 wait complete. 2024-05-14T09:26:52.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.888+0000 7f4c2b200700 1 Processor -- start 2024-05-14T09:26:52.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.888+0000 7f4c2b200700 1 -- start start 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c2b200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c106640 0x7f4c2c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c2b200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c2c10af20 0x7f4c2c19d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c2b200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c10b870 0x7f4c2c1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c2b200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c1163a0 con 0x7f4c2c106640 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c2b200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c116220 con 0x7f4c2c10b870 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c2b200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c116520 con 0x7f4c2c10af20 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c29e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c106640 0x7f4c2c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c29e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c106640 0x7f4c2c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47486/0 (socket says 172.21.15.120:47486) 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.889+0000 7f4c29e00700 1 -- 172.21.15.120:0/4205859536 learned_addr learned my addr 172.21.15.120:0/4205859536 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c29400700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c2c10af20 0x7f4c2c19d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c2a800700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c10b870 0x7f4c2c1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c29e00700 1 -- 172.21.15.120:0/4205859536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c2c10af20 msgr2=0x7f4c2c19d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c29e00700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c2c10af20 0x7f4c2c19d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c29e00700 1 -- 172.21.15.120:0/4205859536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c10b870 msgr2=0x7f4c2c1a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c29e00700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c10b870 0x7f4c2c1a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c29e00700 1 -- 172.21.15.120:0/4205859536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c1a1c00 con 0x7f4c2c106640 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.890+0000 7f4c2a800700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c10b870 0x7f4c2c1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.891+0000 7f4c29e00700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c106640 0x7f4c2c19cd30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00d950 tx=0x7f4c1c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.891+0000 7f4c22a00700 1 -- 172.21.15.120:0/4205859536 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c016070 con 0x7f4c2c106640 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.891+0000 7f4c22a00700 1 -- 172.21.15.120:0/4205859536 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1c009dd0 con 0x7f4c2c106640 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.891+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2c1a1ef0 con 0x7f4c2c106640 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.891+0000 7f4c22a00700 1 -- 172.21.15.120:0/4205859536 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00f3c0 con 0x7f4c2c106640 2024-05-14T09:26:52.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.891+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2c1a9810 con 0x7f4c2c106640 2024-05-14T09:26:52.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.895+0000 7f4c22a00700 1 -- 172.21.15.120:0/4205859536 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4c1c019070 con 0x7f4c2c106640 2024-05-14T09:26:52.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.897+0000 7f4c3f901b80 1 Processor -- start 2024-05-14T09:26:52.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.897+0000 7f4c3f901b80 1 -- start start 2024-05-14T09:26:52.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.897+0000 7f4c22a00700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c100b2900 0x7f4c100b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.897+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b604e40 0x557a3b782d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.897+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b78c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.897+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783690 0x557a3b78ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.897+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557a3b6a4a20 con 0x557a3b783690 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557a3b642760 con 0x557a3b783280 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557a3b6a09e0 con 0x557a3b604e40 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c22a00700 1 -- 172.21.15.120:0/4205859536 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4c1c0e2210 con 0x7f4c2c106640 2024-05-14T09:26:52.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c2a800700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c100b2900 0x7f4c100b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c2a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783690 0x557a3b78ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c29e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b604e40 0x557a3b782d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c2a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783690 0x557a3b78ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47496/0 (socket says 172.21.15.120:47496) 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.898+0000 7f4c2a800700 1 -- 172.21.15.120:0/1714164057 learned_addr learned my addr 172.21.15.120:0/1714164057 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c29400700 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b78c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c29e00700 1 -- 172.21.15.120:0/1714164057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 msgr2=0x557a3b78c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c29e00700 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b78c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c29e00700 1 -- 172.21.15.120:0/1714164057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783690 msgr2=0x557a3b78ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c29e00700 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783690 0x557a3b78ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c29e00700 1 -- 172.21.15.120:0/1714164057 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b5f18d0 con 0x557a3b604e40 2024-05-14T09:26:52.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c2a800700 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783690 0x557a3b78ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:26:52.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c2a800700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c100b2900 0x7f4c100b4e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4c24015000 tx=0x7f4c24009c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:52.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.899+0000 7f4c29e00700 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b604e40 0x557a3b782d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0df910 tx=0x7f4c1c0a8ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd373b48b550f181 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:52.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.900+0000 7f4c17400700 1 -- 172.21.15.120:0/1714164057 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c06f110 con 0x557a3b604e40 2024-05-14T09:26:52.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.900+0000 7f4c17400700 1 -- 172.21.15.120:0/1714164057 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1c06fce0 con 0x557a3b604e40 2024-05-14T09:26:52.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.900+0000 7f4c17400700 1 -- 172.21.15.120:0/1714164057 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0106a0 con 0x557a3b604e40 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.901+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1714164057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b604e40 msgr2=0x557a3b782d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.901+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b604e40 0x557a3b782d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0df910 tx=0x7f4c1c0a8ff0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.901+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1714164057 shutdown_connections 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.901+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783690 0x557a3b78ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.901+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b604e40 0x557a3b782d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.901+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1714164057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b78c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.901+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1714164057 >> 172.21.15.120:0/1714164057 conn(0x557a3b643a80 msgr2=0x557a3b77db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.902+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1714164057 shutdown_connections 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.902+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1714164057 wait complete. 2024-05-14T09:26:52.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.902+0000 7f4c3f901b80 1 -- start start 2024-05-14T09:26:52.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.902+0000 7f4c3f901b80 1 Processor -- start 2024-05-14T09:26:52.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.903+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b604e40 0x557a3b78c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.903+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783280 0x557a3b78c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.903+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.903+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557a3b78f740 con 0x557a3b783280 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.903+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557a3b60ab20 con 0x557a3b604e40 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.903+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557a3b78f8c0 con 0x557a3b783690 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.903+0000 7f4c3f901b80 10 client.0 _ll_register_callbacks cb 0x557a3b638380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783280 0x557a3b78c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783280 0x557a3b78c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47506/0 (socket says 172.21.15.120:47506) 2024-05-14T09:26:52.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 -- 172.21.15.120:0/586202400 learned_addr learned my addr 172.21.15.120:0/586202400 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29e00700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b604e40 0x557a3b78c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c2a800700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 -- 172.21.15.120:0/586202400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 msgr2=0x557a3b78cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 -- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b604e40 msgr2=0x557a3b78c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b604e40 0x557a3b78c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c29400700 1 -- 172.21.15.120:0/586202400 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3b66a420 con 0x557a3b783280 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.904+0000 7f4c2a800700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:52.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c29400700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783280 0x557a3b78c830 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4c180116f0 tx=0x7f4c18011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bcf5f5b87e1144 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:52.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c0be00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:52.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c0be00700 1 -- 172.21.15.120:0/586202400 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1801f060 con 0x557a3b783280 2024-05-14T09:26:52.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c06fce0 con 0x557a3b783280 2024-05-14T09:26:52.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c0be00700 1 -- 172.21.15.120:0/586202400 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4c18004320 con 0x557a3b783280 2024-05-14T09:26:52.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c0be00700 1 -- 172.21.15.120:0/586202400 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4c18026050 con 0x557a3b783280 2024-05-14T09:26:52.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c3f901b80 10 client.16023 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:52.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.905+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557a3b79a3b0 con 0x557a3b783280 2024-05-14T09:26:52.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c0be00700 1 -- 172.21.15.120:0/586202400 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1c06fce0 con 0x557a3b783280 2024-05-14T09:26:52.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c0be00700 1 -- 172.21.15.120:0/586202400 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f4c1800f670 con 0x557a3b783280 2024-05-14T09:26:52.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c3f901b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:52.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c3f901b80 10 client.16023 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:26:52.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c3f901b80 20 client.16023 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:52.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b79ca40 0x557a3b79ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c3f901b80 4 client.16023 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:52.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.906+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a3b74f070 con 0x557a3b79ca40 2024-05-14T09:26:52.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.907+0000 7f4c29e00700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b79ca40 0x557a3b79ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.908+0000 7f4c29e00700 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b79ca40 0x557a3b79ee60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b928946949c7877 server_cookie=9151fdccf695a4dd in_seq=0 out_seq=0 2024-05-14T09:26:52.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.908+0000 7f4c0be00700 10 client.16023 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.910+0000 7f4c0be00700 1 -- 172.21.15.120:0/586202400 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557a3b74f070 con 0x557a3b79ca40 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.910+0000 7f4c0be00700 10 client.16023 handle_command_reply: tid=0 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.910+0000 7f4c3f901b80 1 client.16023 shutdown 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.910+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783280 msgr2=0x557a3b78c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.910+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783280 0x557a3b78c830 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4c180116f0 tx=0x7f4c18011ab0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 shutdown_connections 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b79ca40 0x557a3b79ee60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b604e40 0x557a3b78c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/586202400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b783280 0x557a3b78c830 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 >> 172.21.15.120:0/586202400 conn(0x557a3b643a80 msgr2=0x557a3b781700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:52.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c0be00700 0 client.16023 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:26:52.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 shutdown_connections 2024-05-14T09:26:52.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 1 -- 172.21.15.120:0/586202400 wait complete. 2024-05-14T09:26:52.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.911+0000 7f4c3f901b80 20 client.16023 trim_cache size 0 max 16384 2024-05-14T09:26:52.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.930+0000 7f4c3f901b80 1 Processor -- start 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.930+0000 7f4c3f901b80 1 -- start start 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b7877f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b798830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c1adf90 con 0x557a3b604e40 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c1afb90 con 0x557a3b783280 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c1ae660 con 0x557a3b783690 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c29e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b7877f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c29e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b7877f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47514/0 (socket says 172.21.15.120:47514) 2024-05-14T09:26:52.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.931+0000 7f4c29e00700 1 -- 172.21.15.120:0/1599933818 learned_addr learned my addr 172.21.15.120:0/1599933818 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29400700 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b798830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c2a800700 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29e00700 1 -- 172.21.15.120:0/1599933818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 msgr2=0x557a3b78e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29e00700 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29e00700 1 -- 172.21.15.120:0/1599933818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 msgr2=0x557a3b798830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29e00700 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b798830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29e00700 1 -- 172.21.15.120:0/1599933818 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b77f050 con 0x557a3b604e40 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29400700 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b798830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c29e00700 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b7877f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0a9130 tx=0x7f4c1c0ad7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea73bcb6ff0cc6b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:52.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c16a00700 1 -- 172.21.15.120:0/1599933818 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0106a0 con 0x557a3b604e40 2024-05-14T09:26:52.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c16a00700 1 -- 172.21.15.120:0/1599933818 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1c0df990 con 0x557a3b604e40 2024-05-14T09:26:52.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.932+0000 7f4c16a00700 1 -- 172.21.15.120:0/1599933818 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0a98f0 con 0x557a3b604e40 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1599933818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 msgr2=0x557a3b7877f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b7877f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0a9130 tx=0x7f4c1c0ad7e0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1599933818 shutdown_connections 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b78e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b7877f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/1599933818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b798830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1599933818 >> 172.21.15.120:0/1599933818 conn(0x557a3b643a80 msgr2=0x557a3b78d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1599933818 shutdown_connections 2024-05-14T09:26:52.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 -- 172.21.15.120:0/1599933818 wait complete. 2024-05-14T09:26:52.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.934+0000 7f4c3f901b80 1 -- start start 2024-05-14T09:26:52.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 1 Processor -- start 2024-05-14T09:26:52.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b78fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b7900b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b7905f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c1af400 con 0x557a3b604e40 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c1aed30 con 0x557a3b783280 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c1abf70 con 0x557a3b783690 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.935+0000 7f4c3f901b80 10 client.0 _ll_register_callbacks cb 0x557a3b638380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b78fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b78fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47526/0 (socket says 172.21.15.120:47526) 2024-05-14T09:26:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 -- 172.21.15.120:0/3139932786 learned_addr learned my addr 172.21.15.120:0/3139932786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29400700 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b7900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c2a800700 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b7905f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 -- 172.21.15.120:0/3139932786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 msgr2=0x557a3b7905f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b7905f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 -- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 msgr2=0x557a3b7900b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b7900b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 -- 172.21.15.120:0/3139932786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3b805270 con 0x557a3b604e40 2024-05-14T09:26:52.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c29e00700 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b78fb70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0720b0 tx=0x7f4c1c0108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6552b6279d208e18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.936+0000 7f4c0be00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.937+0000 7f4c0be00700 1 -- 172.21.15.120:0/3139932786 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c014030 con 0x557a3b604e40 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.937+0000 7f4c0be00700 1 -- 172.21.15.120:0/3139932786 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4c1c0a9690 con 0x557a3b604e40 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.937+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c0df990 con 0x557a3b604e40 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.937+0000 7f4c0be00700 1 -- 172.21.15.120:0/3139932786 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4c1c0a9890 con 0x557a3b604e40 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.937+0000 7f4c3f901b80 10 client.16029 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.937+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557a3b8064f0 con 0x557a3b604e40 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c0be00700 1 -- 172.21.15.120:0/3139932786 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1c0df990 con 0x557a3b604e40 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c0be00700 1 -- 172.21.15.120:0/3139932786 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f4c1c06fce0 con 0x557a3b604e40 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c3f901b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:52.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c3f901b80 10 client.16029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:26:52.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c3f901b80 20 client.16029 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:52.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b8067d0 0x557a3b808bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:52.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c3f901b80 4 client.16029 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:26:52.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.938+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a3b6b2400 con 0x557a3b8067d0 2024-05-14T09:26:52.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.939+0000 7f4c29400700 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b8067d0 0x557a3b808bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:52.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.940+0000 7f4c29400700 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b8067d0 0x557a3b808bf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39c0bb5851952f9f server_cookie=d2e1c1887b4e33c2 in_seq=0 out_seq=0 2024-05-14T09:26:52.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.940+0000 7f4c0be00700 10 client.16029 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:26:52.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c0be00700 1 -- 172.21.15.120:0/3139932786 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a3b6b2400 con 0x557a3b8067d0 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c0be00700 10 client.16029 handle_command_reply: tid=0 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 client.16029 shutdown 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 msgr2=0x557a3b78fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b78fb70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0720b0 tx=0x7f4c1c0108d0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 shutdown_connections 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557a3b8067d0 0x557a3b808bf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3b783690 0x557a3b7905f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557a3b604e40 0x557a3b78fb70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 --2- 172.21.15.120:0/3139932786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a3b783280 0x557a3b7900b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c0be00700 0 client.16029 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:26:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 >> 172.21.15.120:0/3139932786 conn(0x557a3b643a80 msgr2=0x557a3b77d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 shutdown_connections 2024-05-14T09:26:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 1 -- 172.21.15.120:0/3139932786 wait complete. 2024-05-14T09:26:52.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.941+0000 7f4c3f901b80 20 client.16029 trim_cache size 0 max 16384 2024-05-14T09:26:52.943 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:26:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c100b2900 msgr2=0x7f4c100b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c100b2900 0x7f4c100b4e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4c24015000 tx=0x7f4c24009c40 comp rx=0 tx=0).stop 2024-05-14T09:26:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c106640 msgr2=0x7f4c2c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c106640 0x7f4c2c19cd30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00d950 tx=0x7f4c1c00dc60 comp rx=0 tx=0).stop 2024-05-14T09:26:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 shutdown_connections 2024-05-14T09:26:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c100b2900 0x7f4c100b4e10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c10b870 0x7f4c2c1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c106640 0x7f4c2c19cd30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 --2- 172.21.15.120:0/4205859536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c2c10af20 0x7f4c2c19d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 >> 172.21.15.120:0/4205859536 conn(0x7f4c2c102030 msgr2=0x7f4c2c10a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.942+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 shutdown_connections 2024-05-14T09:26:52.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:52.943+0000 7f4c2b200700 1 -- 172.21.15.120:0/4205859536 wait complete. 2024-05-14T09:26:53.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T09:26:54.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:54 smithi120 ceph-mon[31085]: pgmap v656: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-14T09:26:54.313 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:54 smithi152 ceph-mon[34868]: pgmap v656: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-14T09:26:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:54 smithi175 ceph-mon[35353]: pgmap v656: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-14T09:26:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8be000640 1 -- 172.21.15.120:0/4276557045 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8031d80 con 0x7fa8c01099c0 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 -- 172.21.15.120:0/4276557045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 msgr2=0x7fa8c010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/4276557045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c010bde0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009ca0 tx=0x7fa8b802a8c0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 -- 172.21.15.120:0/4276557045 shutdown_connections 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/4276557045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c010bde0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/4276557045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8c0104cc0 0x7fa8c01050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/4276557045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c0103a80 0x7fa8c0104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 -- 172.21.15.120:0/4276557045 >> 172.21.15.120:0/4276557045 conn(0x7fa8c00fec70 msgr2=0x7fa8c0101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 -- 172.21.15.120:0/4276557045 shutdown_connections 2024-05-14T09:26:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.741+0000 7fa8c4c00640 1 -- 172.21.15.120:0/4276557045 wait complete. 2024-05-14T09:26:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 Processor -- start 2024-05-14T09:26:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 -- start start 2024-05-14T09:26:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8c0103a80 0x7fa8c0076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c0104cc0 0x7fa8c0075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c0075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c010f4b0 con 0x7fa8c01099c0 2024-05-14T09:26:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c010f330 con 0x7fa8c0104cc0 2024-05-14T09:26:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.743+0000 7fa8c4c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c010f630 con 0x7fa8c0103a80 2024-05-14T09:26:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c0075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c0075560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47548/0 (socket says 172.21.15.120:47548) 2024-05-14T09:26:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 -- 172.21.15.120:0/1825882780 learned_addr learned my addr 172.21.15.120:0/1825882780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bea00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c0104cc0 0x7fa8c0075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bf400640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8c0103a80 0x7fa8c0076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 -- 172.21.15.120:0/1825882780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8c0103a80 msgr2=0x7fa8c0076980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8c0103a80 0x7fa8c0076980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 -- 172.21.15.120:0/1825882780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c0104cc0 msgr2=0x7fa8c0075020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c0104cc0 0x7fa8c0075020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bfe00640 1 -- 172.21.15.120:0/1825882780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c0075c90 con 0x7fa8c01099c0 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.744+0000 7fa8bf400640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8c0103a80 0x7fa8c0076980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.745+0000 7fa8bfe00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c0075560 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8031040 tx=0x7fa8b8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.745+0000 7fa8b7e00640 1 -- 172.21.15.120:0/1825882780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8004040 con 0x7fa8c01099c0 2024-05-14T09:26:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.745+0000 7fa8b7e00640 1 -- 172.21.15.120:0/1825882780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b8004670 con 0x7fa8c01099c0 2024-05-14T09:26:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.745+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c01a40f0 con 0x7fa8c01099c0 2024-05-14T09:26:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.745+0000 7fa8b7e00640 1 -- 172.21.15.120:0/1825882780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8030d50 con 0x7fa8c01099c0 2024-05-14T09:26:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.745+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c01a4550 con 0x7fa8c01099c0 2024-05-14T09:26:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.749+0000 7fa8b7e00640 1 -- 172.21.15.120:0/1825882780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa8b80305c0 con 0x7fa8c01099c0 2024-05-14T09:26:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.749+0000 7fa8cd1fb740 1 Processor -- start 2024-05-14T09:26:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8cd1fb740 1 -- start start 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e7011b0 0x55ff5eaa3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaa3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaaa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff5ea07550 con 0x55ff5e6e04d0 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ff5e9acbc0 con 0x55ff5e7011b0 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ff5ea03510 con 0x55ff5e6d82f0 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.750+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaaa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaaa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47550/0 (socket says 172.21.15.120:47550) 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 -- 172.21.15.120:0/1220859516 learned_addr learned my addr 172.21.15.120:0/1220859516 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bf400640 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaa3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e7011b0 0x55ff5eaa3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 -- 172.21.15.120:0/1220859516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6d82f0 msgr2=0x55ff5eaa3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaa3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 -- 172.21.15.120:0/1220859516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e7011b0 msgr2=0x55ff5eaa3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e7011b0 0x55ff5eaa3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 -- 172.21.15.120:0/1220859516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff5e719210 con 0x55ff5e6e04d0 2024-05-14T09:26:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bf400640 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaa3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.751+0000 7fa8bea00640 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaaa780 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac012770 tx=0x7fa8ac00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ae7ac4cd440ce7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.752+0000 7fa8b7e00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8a40b27e0 0x7fa8a40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.752+0000 7fa8abe00640 1 -- 172.21.15.120:0/1220859516 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac012cf0 con 0x55ff5e6e04d0 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.752+0000 7fa8b7e00640 1 -- 172.21.15.120:0/1825882780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa8b8103d60 con 0x7fa8c01099c0 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.752+0000 7fa8abe00640 1 -- 172.21.15.120:0/1220859516 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8ac0044c0 con 0x55ff5e6e04d0 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.752+0000 7fa8abe00640 1 -- 172.21.15.120:0/1220859516 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac004a00 con 0x55ff5e6e04d0 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.752+0000 7fa8bf400640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8a40b27e0 0x7fa8a40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/1220859516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 msgr2=0x55ff5eaaa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8bf400640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8a40b27e0 0x7fa8a40b4cf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00058c0 tx=0x7fa8b0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaaa780 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac012770 tx=0x7fa8ac00b7c0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/1220859516 shutdown_connections 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaaa780 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaa3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/1220859516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e7011b0 0x55ff5eaa3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/1220859516 >> 172.21.15.120:0/1220859516 conn(0x55ff5e6f5300 msgr2=0x55ff5ea9ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/1220859516 shutdown_connections 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.753+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/1220859516 wait complete. 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.754+0000 7fa8cd1fb740 1 -- start start 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.754+0000 7fa8cd1fb740 1 Processor -- start 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaacee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff5eaab1d0 con 0x55ff5e6d82f0 2024-05-14T09:26:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ff5e9c0660 con 0x55ff5e6e04d0 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ff5eaab350 con 0x55ff5e7011b0 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8cd1fb740 10 client.0 _ll_register_callbacks cb 0x55ff5e98a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8bf400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaacee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8bf400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaacee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47562/0 (socket says 172.21.15.120:47562) 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8bf400640 1 -- 172.21.15.120:0/3030259594 learned_addr learned my addr 172.21.15.120:0/3030259594 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8bea00640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.755+0000 7fa8bfe00640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8bf400640 1 -- 172.21.15.120:0/3030259594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 msgr2=0x55ff5eab4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8bf400640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8bf400640 1 -- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6e04d0 msgr2=0x55ff5eaad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8bf400640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8bf400640 1 -- 172.21.15.120:0/3030259594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff5e7e5620 con 0x55ff5e6d82f0 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8bea00640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:26:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8bf400640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaacee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00127a0 tx=0x7fa8b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed73e248f04e89ce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8a8c00640 1 -- 172.21.15.120:0/3030259594 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000fad0 con 0x55ff5e6d82f0 2024-05-14T09:26:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8a8c00640 1 -- 172.21.15.120:0/3030259594 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa8b000fc70 con 0x55ff5e6d82f0 2024-05-14T09:26:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.756+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff5ea15160 con 0x55ff5e6d82f0 2024-05-14T09:26:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8a8c00640 1 -- 172.21.15.120:0/3030259594 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa8b002f050 con 0x55ff5e6d82f0 2024-05-14T09:26:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8cd1fb740 10 client.16041 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ff5eab7380 con 0x55ff5e6d82f0 2024-05-14T09:26:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8a8c00640 1 -- 172.21.15.120:0/3030259594 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ff5ea15160 con 0x55ff5e6d82f0 2024-05-14T09:26:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8a8c00640 1 -- 172.21.15.120:0/3030259594 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fa8b0027400 con 0x55ff5e6d82f0 2024-05-14T09:26:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8cd1fb740 10 client.16041 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8cd1fb740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8cd1fb740 20 client.16041 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.757+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5e6bfd80 0x55ff5eabac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.758+0000 7fa8cd1fb740 4 client.16041 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.758+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff5ea0efd0 con 0x55ff5e6bfd80 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.758+0000 7fa8bea00640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5e6bfd80 0x55ff5eabac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.759+0000 7fa8bea00640 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5e6bfd80 0x55ff5eabac20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc10b36ee8c19ac server_cookie=653df0c8f6202532 in_seq=0 out_seq=0 2024-05-14T09:26:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.759+0000 7fa8a8c00640 10 client.16041 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.761+0000 7fa8a8c00640 1 -- 172.21.15.120:0/3030259594 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ff5ea0efd0 con 0x55ff5e6bfd80 2024-05-14T09:26:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.761+0000 7fa8a8c00640 10 client.16041 handle_command_reply: tid=0 2024-05-14T09:26:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.761+0000 7fa8cd1fb740 1 client.16041 shutdown 2024-05-14T09:26:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.761+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6d82f0 msgr2=0x55ff5eaacee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.761+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaacee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00127a0 tx=0x7fa8b00046c0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 shutdown_connections 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5e6bfd80 0x55ff5eabac20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3030259594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6d82f0 0x55ff5eaacee0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 >> 172.21.15.120:0/3030259594 conn(0x55ff5e6f5300 msgr2=0x55ff5eaa1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8a8c00640 0 client.16041 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 shutdown_connections 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3030259594 wait complete. 2024-05-14T09:26:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.762+0000 7fa8cd1fb740 20 client.16041 trim_cache size 0 max 16384 2024-05-14T09:26:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.779+0000 7fa8cd1fb740 1 Processor -- start 2024-05-14T09:26:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.779+0000 7fa8cd1fb740 1 -- start start 2024-05-14T09:26:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaabe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 0x55ff5eaacab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01aea70 con 0x55ff5e7011b0 2024-05-14T09:26:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01b0670 con 0x55ff5e6951c0 2024-05-14T09:26:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01af140 con 0x55ff5e6e04d0 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47566/0 (socket says 172.21.15.120:47566) 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8bea00640 1 -- 172.21.15.120:0/3419104515 learned_addr learned my addr 172.21.15.120:0/3419104515 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.780+0000 7fa8bf400640 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaabe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8bea00640 1 -- 172.21.15.120:0/3419104515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6e04d0 msgr2=0x55ff5eaabe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8bea00640 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaabe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8bea00640 1 -- 172.21.15.120:0/3419104515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 msgr2=0x55ff5eaacab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8bea00640 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 0x55ff5eaacab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8bea00640 1 -- 172.21.15.120:0/3419104515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff5ea9a4a0 con 0x55ff5e7011b0 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8bf400640 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaabe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8bea00640 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4310 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000c00 tx=0x7fa8ac00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57842bdceea82540 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8ab400640 1 -- 172.21.15.120:0/3419104515 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac030070 con 0x55ff5e7011b0 2024-05-14T09:26:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8ab400640 1 -- 172.21.15.120:0/3419104515 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8ac02be50 con 0x55ff5e7011b0 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.781+0000 7fa8ab400640 1 -- 172.21.15.120:0/3419104515 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac010bb0 con 0x55ff5e7011b0 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.782+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3419104515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e7011b0 msgr2=0x55ff5eab4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.782+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4310 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000c00 tx=0x7fa8ac00b5b0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3419104515 shutdown_connections 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 0x55ff5eaacab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e7011b0 0x55ff5eab4310 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/3419104515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e6e04d0 0x55ff5eaabe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3419104515 >> 172.21.15.120:0/3419104515 conn(0x55ff5e6f5300 msgr2=0x55ff5eaab720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3419104515 shutdown_connections 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/3419104515 wait complete. 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 -- start start 2024-05-14T09:26:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.783+0000 7fa8cd1fb740 1 Processor -- start 2024-05-14T09:26:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 0x55ff5eab42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eab0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8cd1fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01afee0 con 0x55ff5e6e04d0 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01af810 con 0x55ff5e6951c0 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8cd1fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01aca70 con 0x55ff5e7011b0 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8cd1fb740 10 client.0 _ll_register_callbacks cb 0x7fa8b000bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eab0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eab0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47582/0 (socket says 172.21.15.120:47582) 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.784+0000 7fa8bea00640 1 -- 172.21.15.120:0/2752479155 learned_addr learned my addr 172.21.15.120:0/2752479155 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bf400640 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 0x55ff5eab42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bfe00640 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bea00640 1 -- 172.21.15.120:0/2752479155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 msgr2=0x55ff5eab14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bea00640 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bea00640 1 -- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 msgr2=0x55ff5eab42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bea00640 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 0x55ff5eab42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bea00640 1 -- 172.21.15.120:0/2752479155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff5eb20ff0 con 0x55ff5e6e04d0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8bea00640 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eab0e60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac012740 tx=0x7fa8ac00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e92c506f13fea09 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.785+0000 7fa8a8c00640 1 -- 172.21.15.120:0/2752479155 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac03b060 con 0x55ff5e6e04d0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.786+0000 7fa8a8c00640 1 -- 172.21.15.120:0/2752479155 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa8ac02b7c0 con 0x55ff5e6e04d0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.786+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8ac02be50 con 0x55ff5e6e04d0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.786+0000 7fa8a8c00640 1 -- 172.21.15.120:0/2752479155 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa8ac030040 con 0x55ff5e6e04d0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.786+0000 7fa8cd1fb740 10 client.16047 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.786+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ff5eb221b0 con 0x55ff5e6e04d0 2024-05-14T09:26:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.786+0000 7fa8a8c00640 1 -- 172.21.15.120:0/2752479155 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8ac02be50 con 0x55ff5e6e04d0 2024-05-14T09:26:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.787+0000 7fa8a8c00640 1 -- 172.21.15.120:0/2752479155 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fa8ac01e780 con 0x55ff5e6e04d0 2024-05-14T09:26:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.787+0000 7fa8cd1fb740 10 client.16047 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.787+0000 7fa8cd1fb740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.787+0000 7fa8cd1fb740 20 client.16047 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.787+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5eb229a0 0x55ff5eb24dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.787+0000 7fa8cd1fb740 4 client.16047 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:26:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.787+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff5e98a4b0 con 0x55ff5eb229a0 2024-05-14T09:26:54.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.788+0000 7fa8bf400640 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5eb229a0 0x55ff5eb24dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:54.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.789+0000 7fa8a8c00640 10 client.16047 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:54.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.789+0000 7fa8bf400640 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5eb229a0 0x55ff5eb24dc0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0b89a02cc7950 server_cookie=ed421256647f5602 in_seq=0 out_seq=0 2024-05-14T09:26:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.826+0000 7fa8a8c00640 1 -- 172.21.15.120:0/2752479155 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff5e98a4b0 con 0x55ff5eb229a0 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.826+0000 7fa8a8c00640 10 client.16047 handle_command_reply: tid=0 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.826+0000 7fa8cd1fb740 1 client.16047 shutdown 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 msgr2=0x55ff5eab0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eab0e60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac012740 tx=0x7fa8ac00bb10 comp rx=0 tx=0).stop 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 shutdown_connections 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ff5eb229a0 0x55ff5eb24dc0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff5e7011b0 0x55ff5eab14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff5e6e04d0 0x55ff5eab0e60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 --2- 172.21.15.120:0/2752479155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ff5e6951c0 0x55ff5eab42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8a8c00640 0 client.16047 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 >> 172.21.15.120:0/2752479155 conn(0x55ff5e6f5300 msgr2=0x55ff5eaa1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 shutdown_connections 2024-05-14T09:26:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 1 -- 172.21.15.120:0/2752479155 wait complete. 2024-05-14T09:26:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.827+0000 7fa8cd1fb740 20 client.16047 trim_cache size 0 max 16384 2024-05-14T09:26:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:26:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:26:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:26:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8a40b27e0 msgr2=0x7fa8a40b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8a40b27e0 0x7fa8a40b4cf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00058c0 tx=0x7fa8b0005850 comp rx=0 tx=0).stop 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 msgr2=0x7fa8c0075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c0075560 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8031040 tx=0x7fa8b8003ba0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 shutdown_connections 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8a40b27e0 0x7fa8a40b4cf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8c01099c0 0x7fa8c0075560 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c0104cc0 0x7fa8c0075020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 --2- 172.21.15.120:0/1825882780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8c0103a80 0x7fa8c0076980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:54.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.828+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 >> 172.21.15.120:0/1825882780 conn(0x7fa8c00fec70 msgr2=0x7fa8c01059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:54.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.829+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 shutdown_connections 2024-05-14T09:26:54.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:26:54.829+0000 7fa8c4c00640 1 -- 172.21.15.120:0/1825882780 wait complete. 2024-05-14T09:26:56.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:56 smithi120 ceph-mon[31085]: pgmap v657: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 23 op/s 2024-05-14T09:26:56.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:56 smithi152 ceph-mon[34868]: pgmap v657: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 23 op/s 2024-05-14T09:26:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:56 smithi175 ceph-mon[35353]: pgmap v657: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 23 op/s 2024-05-14T09:26:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 -- 172.21.15.120:0/2639705559 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a010e700 msgr2=0x7f72a0110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 --2- 172.21.15.120:0/2639705559 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a010e700 0x7f72a0110be0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f729800b0a0 tx=0x7f729800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 -- 172.21.15.120:0/2639705559 shutdown_connections 2024-05-14T09:26:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 --2- 172.21.15.120:0/2639705559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a0105290 0x7f72a01056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 --2- 172.21.15.120:0/2639705559 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a010e700 0x7f72a0110be0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 --2- 172.21.15.120:0/2639705559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a0105be0 0x7f72a010e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 -- 172.21.15.120:0/2639705559 >> 172.21.15.120:0/2639705559 conn(0x7f72a0078ac0 msgr2=0x7f72a0078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 -- 172.21.15.120:0/2639705559 shutdown_connections 2024-05-14T09:26:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.777+0000 7f72a4a00700 1 -- 172.21.15.120:0/2639705559 wait complete. 2024-05-14T09:26:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 Processor -- start 2024-05-14T09:26:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 -- start start 2024-05-14T09:26:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a0105290 0x7f72a01a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0105be0 0x7f72a01a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a010e700 0x7f72a019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0114110 con 0x7f72a0105be0 2024-05-14T09:26:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0113f90 con 0x7f72a010e700 2024-05-14T09:26:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.779+0000 7f72a4a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0114290 con 0x7f72a0105290 2024-05-14T09:26:56.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.780+0000 7f729fe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a010e700 0x7f72a019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.780+0000 7f729fe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a010e700 0x7f72a019a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:49550/0 (socket says 172.21.15.120:49550) 2024-05-14T09:26:56.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.780+0000 7f729fe00700 1 -- 172.21.15.120:0/3929338418 learned_addr learned my addr 172.21.15.120:0/3929338418 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:56.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.780+0000 7f729f400700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a0105290 0x7f72a01a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.781+0000 7f729ea00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0105be0 0x7f72a01a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.781+0000 7f729fe00700 1 -- 172.21.15.120:0/3929338418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a0105290 msgr2=0x7f72a01a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.781+0000 7f729fe00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a0105290 0x7f72a01a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.781+0000 7f729fe00700 1 -- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0105be0 msgr2=0x7f72a01a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.781+0000 7f729fe00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0105be0 0x7f72a01a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.781+0000 7f729fe00700 1 -- 172.21.15.120:0/3929338418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a019af50 con 0x7f72a010e700 2024-05-14T09:26:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.781+0000 7f729ea00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0105be0 0x7f72a01a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:26:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.782+0000 7f729fe00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a010e700 0x7f72a019a910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f729800b830 tx=0x7f7298004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.783+0000 7f7297e00700 1 -- 172.21.15.120:0/3929338418 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298021070 con 0x7f72a010e700 2024-05-14T09:26:56.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.783+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a019b1e0 con 0x7f72a010e700 2024-05-14T09:26:56.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.783+0000 7f7297e00700 1 -- 172.21.15.120:0/3929338418 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7298007b80 con 0x7f72a010e700 2024-05-14T09:26:56.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.783+0000 7f7297e00700 1 -- 172.21.15.120:0/3929338418 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72980052a0 con 0x7f72a010e700 2024-05-14T09:26:56.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.783+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a019b710 con 0x7f72a010e700 2024-05-14T09:26:56.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.789+0000 7f72b4b50b80 1 Processor -- start 2024-05-14T09:26:56.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f7297e00700 1 -- 172.21.15.120:0/3929338418 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7298024070 con 0x7f72a010e700 2024-05-14T09:26:56.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f72b4b50b80 1 -- start start 2024-05-14T09:26:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 0x5628cbe9fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0690 0x5628cbeabe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628cbdc1a20 con 0x5628cbea0690 2024-05-14T09:26:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628cbd5f760 con 0x5628cbea0280 2024-05-14T09:26:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.790+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5628cbdbd9e0 con 0x5628cbd21e40 2024-05-14T09:26:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.791+0000 7f729ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0690 0x5628cbeabe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.791+0000 7f729ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0690 0x5628cbeabe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47612/0 (socket says 172.21.15.120:47612) 2024-05-14T09:26:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.791+0000 7f729ea00700 1 -- 172.21.15.120:0/1234449328 learned_addr learned my addr 172.21.15.120:0/1234449328 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.791+0000 7f729f400700 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.791+0000 7f729ea00700 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 0x5628cbe9fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.792+0000 7f729ea00700 1 -- 172.21.15.120:0/1234449328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 msgr2=0x5628cbe9fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:56.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.792+0000 7f7297e00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72840b2980 0x7f72840b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.792+0000 7f729ea00700 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 0x5628cbe9fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.792+0000 7f729ea00700 1 -- 172.21.15.120:0/1234449328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 msgr2=0x5628cbea98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:56.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.792+0000 7f729ea00700 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.792+0000 7f729ea00700 1 -- 172.21.15.120:0/1234449328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628cbd0e8d0 con 0x5628cbea0690 2024-05-14T09:26:56.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.792+0000 7f7297e00700 1 -- 172.21.15.120:0/3929338418 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f729800f020 con 0x7f72a010e700 2024-05-14T09:26:56.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.793+0000 7f729fe00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72840b2980 0x7f72840b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.793+0000 7f729ea00700 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0690 0x5628cbeabe30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f728c00afd0 tx=0x7f728c00aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9744950fd245f6c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:56.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.793+0000 7f7294c00700 1 -- 172.21.15.120:0/1234449328 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c011e50 con 0x5628cbea0690 2024-05-14T09:26:56.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.793+0000 7f7294c00700 1 -- 172.21.15.120:0/1234449328 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f728c0044b0 con 0x5628cbea0690 2024-05-14T09:26:56.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.793+0000 7f7294c00700 1 -- 172.21.15.120:0/1234449328 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c004a30 con 0x5628cbea0690 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 -- 172.21.15.120:0/1234449328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0690 msgr2=0x5628cbeabe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f729fe00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72840b2980 0x7f72840b4e90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f72980a6e40 tx=0x7f7298009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0690 0x5628cbeabe30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f728c00afd0 tx=0x7f728c00aae0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 -- 172.21.15.120:0/1234449328 shutdown_connections 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0690 0x5628cbeabe30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 0x5628cbe9fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/1234449328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 -- 172.21.15.120:0/1234449328 >> 172.21.15.120:0/1234449328 conn(0x5628cbd60a80 msgr2=0x5628cbe9ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:56.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 -- 172.21.15.120:0/1234449328 shutdown_connections 2024-05-14T09:26:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.794+0000 7f72b4b50b80 1 -- 172.21.15.120:0/1234449328 wait complete. 2024-05-14T09:26:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.795+0000 7f72b4b50b80 1 -- start start 2024-05-14T09:26:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 1 Processor -- start 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbd21e40 0x5628cbea93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea9e20 0x5628cbebe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628cbeac7a0 con 0x5628cbea0280 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628cbd27b20 con 0x5628cbd21e40 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5628cbeac920 con 0x5628cbea9e20 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.796+0000 7f72b4b50b80 10 client.0 _ll_register_callbacks cb 0x5628cbd55380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47624/0 (socket says 172.21.15.120:47624) 2024-05-14T09:26:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 -- 172.21.15.120:0/3662901893 learned_addr learned my addr 172.21.15.120:0/3662901893 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729ea00700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea9e20 0x5628cbebe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729ea00700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbd21e40 0x5628cbea93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 -- 172.21.15.120:0/3662901893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea9e20 msgr2=0x5628cbebe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea9e20 0x5628cbebe4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 -- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbd21e40 msgr2=0x5628cbea93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbd21e40 0x5628cbea93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729f400700 1 -- 172.21.15.120:0/3662901893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628cbd87420 con 0x5628cbea0280 2024-05-14T09:26:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.797+0000 7f729ea00700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbd21e40 0x5628cbea93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.798+0000 7f729f400700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f729000bb70 tx=0x7f729000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45e4f7245ed02be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.798+0000 7f7289600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.798+0000 7f7289600700 1 -- 172.21.15.120:0/3662901893 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290003ca0 con 0x5628cbea0280 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.798+0000 7f7289600700 1 -- 172.21.15.120:0/3662901893 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7290004830 con 0x5628cbea0280 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.798+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f728c0044b0 con 0x5628cbea0280 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.799+0000 7f7289600700 1 -- 172.21.15.120:0/3662901893 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7290003e40 con 0x5628cbea0280 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.799+0000 7f72b4b50b80 10 client.16059 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:56.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.799+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5628cbec01d0 con 0x5628cbea0280 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.799+0000 7f7289600700 1 -- 172.21.15.120:0/3662901893 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f728c0044b0 con 0x5628cbea0280 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.799+0000 7f7289600700 1 -- 172.21.15.120:0/3662901893 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f7290011650 con 0x5628cbea0280 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.799+0000 7f72b4b50b80 10 client.16059 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.799+0000 7f72b4b50b80 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.800+0000 7f72b4b50b80 20 client.16059 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.800+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbec2800 0x5628cbec4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.800+0000 7f72b4b50b80 4 client.16059 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:26:56.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.800+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628cbe6c070 con 0x5628cbec2800 2024-05-14T09:26:56.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.801+0000 7f729ea00700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbec2800 0x5628cbec4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.802+0000 7f729ea00700 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbec2800 0x5628cbec4c60 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a4a51f901832ec server_cookie=1461629ab99c285d in_seq=0 out_seq=0 2024-05-14T09:26:56.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.802+0000 7f7289600700 10 client.16059 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:56.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.804+0000 7f7289600700 1 -- 172.21.15.120:0/3662901893 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5628cbe6c070 con 0x5628cbec2800 2024-05-14T09:26:56.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.804+0000 7f7289600700 10 client.16059 handle_command_reply: tid=0 2024-05-14T09:26:56.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.804+0000 7f72b4b50b80 1 client.16059 shutdown 2024-05-14T09:26:56.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0280 msgr2=0x5628cbea98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f729000bb70 tx=0x7f729000bf30 comp rx=0 tx=0).stop 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 shutdown_connections 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbec2800 0x5628cbec4c60 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbd21e40 0x5628cbea93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea9e20 0x5628cbebe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/3662901893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea0280 0x5628cbea98e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 >> 172.21.15.120:0/3662901893 conn(0x5628cbd60a80 msgr2=0x5628cbe9e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f7289600700 0 client.16059 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 shutdown_connections 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 1 -- 172.21.15.120:0/3662901893 wait complete. 2024-05-14T09:26:56.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.805+0000 7f72b4b50b80 20 client.16059 trim_cache size 0 max 16384 2024-05-14T09:26:56.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 Processor -- start 2024-05-14T09:26:56.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 -- start start 2024-05-14T09:26:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 0x5628cbeab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbe9ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea9e20 0x5628cbeca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01addc0 con 0x5628cbea9e20 2024-05-14T09:26:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01af9c0 con 0x5628cbea0280 2024-05-14T09:26:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.826+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01ae490 con 0x5628cbd21e40 2024-05-14T09:26:56.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea9e20 0x5628cbeca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea9e20 0x5628cbeca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47626/0 (socket says 172.21.15.120:47626) 2024-05-14T09:26:56.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 -- 172.21.15.120:0/2113595386 learned_addr learned my addr 172.21.15.120:0/2113595386 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 -- 172.21.15.120:0/2113595386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 msgr2=0x5628cbeab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 0x5628cbeab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729f400700 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbe9ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 -- 172.21.15.120:0/2113595386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 msgr2=0x5628cbe9ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbe9ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.827+0000 7f729ea00700 1 -- 172.21.15.120:0/2113595386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628cbe93fd0 con 0x5628cbea9e20 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.828+0000 7f729ea00700 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea9e20 0x5628cbeca460 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f728c00afd0 tx=0x7f728c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb0ded70b29c77d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.828+0000 7f728be00700 1 -- 172.21.15.120:0/2113595386 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c02d030 con 0x5628cbea9e20 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.828+0000 7f728be00700 1 -- 172.21.15.120:0/2113595386 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f728c00fa70 con 0x5628cbea9e20 2024-05-14T09:26:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.828+0000 7f728be00700 1 -- 172.21.15.120:0/2113595386 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c012e60 con 0x5628cbea9e20 2024-05-14T09:26:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 -- 172.21.15.120:0/2113595386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea9e20 msgr2=0x5628cbeca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea9e20 0x5628cbeca460 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f728c00afd0 tx=0x7f728c00af40 comp rx=0 tx=0).stop 2024-05-14T09:26:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 -- 172.21.15.120:0/2113595386 shutdown_connections 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbea9e20 0x5628cbeca460 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbd21e40 0x5628cbeab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/2113595386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea0280 0x5628cbe9ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 -- 172.21.15.120:0/2113595386 >> 172.21.15.120:0/2113595386 conn(0x5628cbd60a80 msgr2=0x5628cbe99e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 -- 172.21.15.120:0/2113595386 shutdown_connections 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.829+0000 7f72b4b50b80 1 -- 172.21.15.120:0/2113595386 wait complete. 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.830+0000 7f72b4b50b80 1 -- start start 2024-05-14T09:26:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.830+0000 7f72b4b50b80 1 Processor -- start 2024-05-14T09:26:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbd21e40 0x5628cbeb5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea0280 0x5628cbeb59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f72b4b50b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea9e20 0x5628cbf2b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01af230 con 0x5628cbd21e40 2024-05-14T09:26:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01aeb60 con 0x5628cbea9e20 2024-05-14T09:26:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f72b4b50b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01abd80 con 0x5628cbea0280 2024-05-14T09:26:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f72b4b50b80 10 client.0 _ll_register_callbacks cb 0x5628cbd55380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:26:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f729f400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea0280 0x5628cbeb59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.831+0000 7f729ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbd21e40 0x5628cbeb5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.832+0000 7f729f400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea0280 0x5628cbeb59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54404/0 (socket says 172.21.15.120:54404) 2024-05-14T09:26:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.832+0000 7f729f400700 1 -- 172.21.15.120:0/728487377 learned_addr learned my addr 172.21.15.120:0/728487377 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.832+0000 7f729ea00700 1 -- 172.21.15.120:0/728487377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea0280 msgr2=0x5628cbeb59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.832+0000 7f729ea00700 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea0280 0x5628cbeb59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.832+0000 7f729ea00700 1 -- 172.21.15.120:0/728487377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea9e20 msgr2=0x5628cbf2b000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.832+0000 7f729ea00700 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea9e20 0x5628cbf2b000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.832+0000 7f729ea00700 1 -- 172.21.15.120:0/728487377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628cbeb61d0 con 0x5628cbd21e40 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f729ea00700 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbd21e40 0x5628cbeb5460 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f728c00afd0 tx=0x7f728c00ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67565d7510f7f24 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f7289600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f7289600700 1 -- 172.21.15.120:0/728487377 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c02d040 con 0x5628cbd21e40 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f7289600700 1 -- 172.21.15.120:0/728487377 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f728c011030 con 0x5628cbd21e40 2024-05-14T09:26:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f728c00fa70 con 0x5628cbd21e40 2024-05-14T09:26:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f7289600700 1 -- 172.21.15.120:0/728487377 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f728c03f050 con 0x5628cbd21e40 2024-05-14T09:26:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f72b4b50b80 10 client.16065 fetch_fsmap learned FSMap version 35 2024-05-14T09:26:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.833+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5628cbf2c4a0 con 0x5628cbd21e40 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f7289600700 1 -- 172.21.15.120:0/728487377 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f728c00fa70 con 0x5628cbd21e40 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f7289600700 1 -- 172.21.15.120:0/728487377 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f728c03a030 con 0x5628cbd21e40 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f72b4b50b80 10 client.16065 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f72b4b50b80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f72b4b50b80 20 client.16065 populate_metadata read hostname 'smithi120' 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbf2c9e0 0x5628cbf2ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f72b4b50b80 4 client.16065 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.834+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628cbdcf400 con 0x5628cbf2c9e0 2024-05-14T09:26:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.835+0000 7f729f400700 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbf2c9e0 0x5628cbf2ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:26:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.836+0000 7f729f400700 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbf2c9e0 0x5628cbf2ee00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e81780471d855ed server_cookie=d15bd87e045875a9 in_seq=0 out_seq=0 2024-05-14T09:26:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.836+0000 7f7289600700 10 client.16065 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.836+0000 7f7289600700 1 -- 172.21.15.120:0/728487377 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628cbdcf400 con 0x5628cbf2c9e0 2024-05-14T09:26:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.836+0000 7f7289600700 10 client.16065 handle_command_reply: tid=0 2024-05-14T09:26:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 client.16065 shutdown 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbd21e40 msgr2=0x5628cbeb5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbd21e40 0x5628cbeb5460 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f728c00afd0 tx=0x7f728c00ae70 comp rx=0 tx=0).stop 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 shutdown_connections 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628cbf2c9e0 0x5628cbf2ee00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628cbea9e20 0x5628cbf2b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628cbd21e40 0x5628cbeb5460 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 --2- 172.21.15.120:0/728487377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628cbea0280 0x5628cbeb59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 >> 172.21.15.120:0/728487377 conn(0x5628cbd60a80 msgr2=0x5628cbe9ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f7289600700 0 client.16065 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:26:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 shutdown_connections 2024-05-14T09:26:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 1 -- 172.21.15.120:0/728487377 wait complete. 2024-05-14T09:26:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.837+0000 7f72b4b50b80 20 client.16065 trim_cache size 0 max 16384 2024-05-14T09:26:56.838 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72840b2980 msgr2=0x7f72840b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72840b2980 0x7f72840b4e90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f72980a6e40 tx=0x7f7298009040 comp rx=0 tx=0).stop 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a010e700 msgr2=0x7f72a019a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a010e700 0x7f72a019a910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f729800b830 tx=0x7f7298004d00 comp rx=0 tx=0).stop 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 shutdown_connections 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72840b2980 0x7f72840b4e90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72a010e700 0x7f72a019a910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a0105290 0x7f72a01a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 --2- 172.21.15.120:0/3929338418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0105be0 0x7f72a01a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.838+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 >> 172.21.15.120:0/3929338418 conn(0x7f72a0078ac0 msgr2=0x7f72a00fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.839+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 shutdown_connections 2024-05-14T09:26:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:26:56.839+0000 7f72a4a00700 1 -- 172.21.15.120:0/3929338418 wait complete. 2024-05-14T09:26:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:58 smithi120 ceph-mon[31085]: pgmap v658: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 26 op/s 2024-05-14T09:26:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:58 smithi152 ceph-mon[34868]: pgmap v658: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 26 op/s 2024-05-14T09:26:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:58 smithi175 ceph-mon[35353]: pgmap v658: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 26 op/s 2024-05-14T09:26:58.817 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T09:26:58.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T09:26:59.326 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:26:59.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:26:59 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:26:59.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:26:59 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:26:59.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:26:59 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:00 smithi120 ceph-mon[31085]: pgmap v659: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 13 MiB/s wr, 21 op/s 2024-05-14T09:27:00.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:00 smithi152 ceph-mon[34868]: pgmap v659: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 13 MiB/s wr, 21 op/s 2024-05-14T09:27:00.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:00 smithi175 ceph-mon[35353]: pgmap v659: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 13 MiB/s wr, 21 op/s 2024-05-14T09:27:01.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.960+0000 7f95d6a00700 1 -- 172.21.15.120:0/1217455439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106ec0 msgr2=0x7f95d0113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:01.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.960+0000 7f95d6a00700 1 --2- 172.21.15.120:0/1217455439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106ec0 0x7f95d0113350 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f95c800b0a0 tx=0x7f95c800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.961+0000 7f95d6a00700 1 -- 172.21.15.120:0/1217455439 shutdown_connections 2024-05-14T09:27:01.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.961+0000 7f95d6a00700 1 --2- 172.21.15.120:0/1217455439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106ec0 0x7f95d0113350 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.961+0000 7f95d6a00700 1 --2- 172.21.15.120:0/1217455439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95d010c5b0 0x7f95d010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.961+0000 7f95d6a00700 1 --2- 172.21.15.120:0/1217455439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95d0106570 0x7f95d0106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.961+0000 7f95d6a00700 1 -- 172.21.15.120:0/1217455439 >> 172.21.15.120:0/1217455439 conn(0x7f95d0102050 msgr2=0x7f95d01044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:01.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.961+0000 7f95d6a00700 1 -- 172.21.15.120:0/1217455439 shutdown_connections 2024-05-14T09:27:01.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.961+0000 7f95d6a00700 1 -- 172.21.15.120:0/1217455439 wait complete. 2024-05-14T09:27:01.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.963+0000 7f95d6a00700 1 Processor -- start 2024-05-14T09:27:01.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.963+0000 7f95d6a00700 1 -- start start 2024-05-14T09:27:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95d6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106570 0x7f95d019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95d6a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95d0106ec0 0x7f95d019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95d6a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95d010c5b0 0x7f95d01a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95d6a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f95d0116590 con 0x7f95d0106570 2024-05-14T09:27:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95d6a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f95d0116410 con 0x7f95d010c5b0 2024-05-14T09:27:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95d6a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95d0116710 con 0x7f95d0106ec0 2024-05-14T09:27:01.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95cfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106570 0x7f95d019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95cfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106570 0x7f95d019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35002/0 (socket says 172.21.15.120:35002) 2024-05-14T09:27:01.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95cfe00700 1 -- 172.21.15.120:0/3720472434 learned_addr learned my addr 172.21.15.120:0/3720472434 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:01.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95cf400700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95d0106ec0 0x7f95d019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.964+0000 7f95d4a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95d010c5b0 0x7f95d01a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.965+0000 7f95cfe00700 1 -- 172.21.15.120:0/3720472434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95d0106ec0 msgr2=0x7f95d019d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.965+0000 7f95cfe00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95d0106ec0 0x7f95d019d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.965+0000 7f95cfe00700 1 -- 172.21.15.120:0/3720472434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95d010c5b0 msgr2=0x7f95d01a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.965+0000 7f95cfe00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95d010c5b0 0x7f95d01a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.965+0000 7f95cfe00700 1 -- 172.21.15.120:0/3720472434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d01a1cc0 con 0x7f95d0106570 2024-05-14T09:27:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.965+0000 7f95cfe00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106570 0x7f95d019cea0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f95c000c9e0 tx=0x7f95c000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.966+0000 7f95ccc00700 1 -- 172.21.15.120:0/3720472434 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0007aa0 con 0x7f95d0106570 2024-05-14T09:27:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.966+0000 7f95ccc00700 1 -- 172.21.15.120:0/3720472434 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95c0007c40 con 0x7f95d0106570 2024-05-14T09:27:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.966+0000 7f95ccc00700 1 -- 172.21.15.120:0/3720472434 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0018400 con 0x7f95d0106570 2024-05-14T09:27:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.966+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d01a1f50 con 0x7f95d0106570 2024-05-14T09:27:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.966+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d01a2440 con 0x7f95d0106570 2024-05-14T09:27:01.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.972+0000 7f95ccc00700 1 -- 172.21.15.120:0/3720472434 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f95c000f450 con 0x7f95d0106570 2024-05-14T09:27:01.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 Processor -- start 2024-05-14T09:27:01.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 -- start start 2024-05-14T09:27:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89701370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896fb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd896fba70 0x55bd896fbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bd8961daa0 con 0x55bd896fba70 2024-05-14T09:27:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bd895bb7e0 con 0x55bd897018b0 2024-05-14T09:27:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.973+0000 7f95e5594b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bd89619a60 con 0x55bd8957dec0 2024-05-14T09:27:01.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.974+0000 7f95cf400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd896fba70 0x55bd896fbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.974+0000 7f95cf400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd896fba70 0x55bd896fbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35014/0 (socket says 172.21.15.120:35014) 2024-05-14T09:27:01.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.974+0000 7f95cf400700 1 -- 172.21.15.120:0/3378210213 learned_addr learned my addr 172.21.15.120:0/3378210213 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:01.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.974+0000 7f95d4a00700 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89701370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.974+0000 7f95cfe00700 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.974+0000 7f95cf400700 1 -- 172.21.15.120:0/3378210213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 msgr2=0x55bd89701370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95cf400700 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89701370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95cf400700 1 -- 172.21.15.120:0/3378210213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 msgr2=0x55bd896fb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95cf400700 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896fb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95cf400700 1 -- 172.21.15.120:0/3378210213 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd8956a950 con 0x55bd896fba70 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95d4a00700 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89701370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95cfe00700 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95cf400700 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd896fba70 0x55bd896fbe80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00bcb0 tx=0x7f95bc0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd63f735867c74d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.975+0000 7f95ccc00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f95b40b2880 0x7f95b40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.976+0000 7f95c5600700 1 -- 172.21.15.120:0/3378210213 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc010dc0 con 0x55bd896fba70 2024-05-14T09:27:01.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.976+0000 7f95c5600700 1 -- 172.21.15.120:0/3378210213 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95bc0044c0 con 0x55bd896fba70 2024-05-14T09:27:01.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.976+0000 7f95c5600700 1 -- 172.21.15.120:0/3378210213 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc005280 con 0x55bd896fba70 2024-05-14T09:27:01.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.976+0000 7f95d4a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f95b40b2880 0x7f95b40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.976+0000 7f95ccc00700 1 -- 172.21.15.120:0/3720472434 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f95c00e2500 con 0x7f95d0106570 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 -- 172.21.15.120:0/3378210213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd896fba70 msgr2=0x55bd896fbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95d4a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f95b40b2880 0x7f95b40b4d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009900 tx=0x7f95c800b7d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd896fba70 0x55bd896fbe80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00bcb0 tx=0x7f95bc0103d0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 -- 172.21.15.120:0/3378210213 shutdown_connections 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd896fba70 0x55bd896fbe80 secure :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00bcb0 tx=0x7f95bc0103d0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89701370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 --2- 172.21.15.120:0/3378210213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 -- 172.21.15.120:0/3378210213 >> 172.21.15.120:0/3378210213 conn(0x55bd895c2ff0 msgr2=0x55bd896f6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 -- 172.21.15.120:0/3378210213 shutdown_connections 2024-05-14T09:27:01.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.977+0000 7f95e5594b80 1 -- 172.21.15.120:0/3378210213 wait complete. 2024-05-14T09:27:01.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.978+0000 7f95e5594b80 1 -- start start 2024-05-14T09:27:01.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.979+0000 7f95e5594b80 1 Processor -- start 2024-05-14T09:27:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.979+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd897050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.979+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89705630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.979+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd8971a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.979+0000 7f95e5594b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bd89708390 con 0x55bd89705b70 2024-05-14T09:27:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.979+0000 7f95e5594b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bd89583ba0 con 0x55bd897018b0 2024-05-14T09:27:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.979+0000 7f95e5594b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bd89708510 con 0x55bd8957dec0 2024-05-14T09:27:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.980+0000 7f95e5594b80 10 client.0 _ll_register_callbacks cb 0x55bd895c4cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:01.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.980+0000 7f95d4a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd8971a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.980+0000 7f95d4a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd8971a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35030/0 (socket says 172.21.15.120:35030) 2024-05-14T09:27:01.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.980+0000 7f95d4a00700 1 -- 172.21.15.120:0/2261965914 learned_addr learned my addr 172.21.15.120:0/2261965914 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:01.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.980+0000 7f95cfe00700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd897050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.981+0000 7f95cf400700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89705630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.981+0000 7f95d4a00700 1 -- 172.21.15.120:0/2261965914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 msgr2=0x55bd897050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.981+0000 7f95d4a00700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd897050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.981+0000 7f95d4a00700 1 -- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 msgr2=0x55bd89705630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.981+0000 7f95d4a00700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89705630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.981+0000 7f95d4a00700 1 -- 172.21.15.120:0/2261965914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd895e34a0 con 0x55bd89705b70 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.981+0000 7f95cf400700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89705630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.982+0000 7f95d4a00700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd8971a040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009cb0 tx=0x7f95c80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37127d9461c96a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.982+0000 7f95ba000700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:01.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.982+0000 7f95ba000700 1 -- 172.21.15.120:0/2261965914 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c802d070 con 0x55bd89705b70 2024-05-14T09:27:01.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.982+0000 7f95ba000700 1 -- 172.21.15.120:0/2261965914 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f95c8029850 con 0x55bd89705b70 2024-05-14T09:27:01.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.982+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95bc0044c0 con 0x55bd89705b70 2024-05-14T09:27:01.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.983+0000 7f95ba000700 1 -- 172.21.15.120:0/2261965914 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f95c8037050 con 0x55bd89705b70 2024-05-14T09:27:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.983+0000 7f95e5594b80 10 client.16077 fetch_fsmap learned FSMap version 36 2024-05-14T09:27:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.983+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bd8971bc60 con 0x55bd89705b70 2024-05-14T09:27:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.983+0000 7f95ba000700 1 -- 172.21.15.120:0/2261965914 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95bc0044c0 con 0x55bd89705b70 2024-05-14T09:27:01.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.985+0000 7f95ba000700 1 -- 172.21.15.120:0/2261965914 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 36) ==== 8374+0+0 (secure 0 0 0) 0x7f95c8011070 con 0x55bd89705b70 2024-05-14T09:27:01.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.985+0000 7f95e5594b80 10 client.16077 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T09:27:01.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.985+0000 7f95e5594b80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.985+0000 7f95e5594b80 20 client.16077 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.985+0000 7f95e5594b80 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd8971e2f0 0x55bd89720770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.985+0000 7f95e5594b80 4 client.16077 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.985+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd896c8240 con 0x55bd8971e2f0 2024-05-14T09:27:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.986+0000 7f95cfe00700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd8971e2f0 0x55bd89720770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:01.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.987+0000 7f95cfe00700 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd8971e2f0 0x55bd89720770 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93685ba80313d94f server_cookie=f028d96cd31568fd in_seq=0 out_seq=0 2024-05-14T09:27:01.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.987+0000 7f95ba000700 10 client.16077 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.989+0000 7f95ba000700 1 -- 172.21.15.120:0/2261965914 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bd896c8240 con 0x55bd8971e2f0 2024-05-14T09:27:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.989+0000 7f95ba000700 10 client.16077 handle_command_reply: tid=0 2024-05-14T09:27:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.989+0000 7f95e5594b80 1 client.16077 shutdown 2024-05-14T09:27:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.989+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 msgr2=0x55bd8971a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.989+0000 7f95e5594b80 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd8971a040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009cb0 tx=0x7f95c80099e0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.989+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 shutdown_connections 2024-05-14T09:27:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd8971e2f0 0x55bd89720770 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd8971a040 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd897050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 1 --2- 172.21.15.120:0/2261965914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89705630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 >> 172.21.15.120:0/2261965914 conn(0x55bd895c2ff0 msgr2=0x55bd896fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95ba000700 0 client.16077 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 shutdown_connections 2024-05-14T09:27:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 1 -- 172.21.15.120:0/2261965914 wait complete. 2024-05-14T09:27:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:01.990+0000 7f95e5594b80 20 client.16077 trim_cache size 0 max 16384 2024-05-14T09:27:02.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.014+0000 7f95e5594b80 1 Processor -- start 2024-05-14T09:27:02.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.014+0000 7f95e5594b80 1 -- start start 2024-05-14T09:27:02.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd8957dec0 0x55bd896fb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:02.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:02.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd89705b70 0x55bd896ff440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:02.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95e5594b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01adf30 con 0x55bd8957dec0 2024-05-14T09:27:02.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95e5594b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01afb00 con 0x55bd897018b0 2024-05-14T09:27:02.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95e5594b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01ae600 con 0x55bd89705b70 2024-05-14T09:27:02.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95cfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd8957dec0 0x55bd896fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:02.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95cfe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd8957dec0 0x55bd896fb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35034/0 (socket says 172.21.15.120:35034) 2024-05-14T09:27:02.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95cfe00700 1 -- 172.21.15.120:0/4097555548 learned_addr learned my addr 172.21.15.120:0/4097555548 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.015+0000 7f95d4a00700 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd89705b70 0x55bd896ff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cfe00700 1 -- 172.21.15.120:0/4097555548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd89705b70 msgr2=0x55bd896ff440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cfe00700 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd89705b70 0x55bd896ff440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cf400700 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cfe00700 1 -- 172.21.15.120:0/4097555548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 msgr2=0x55bd896f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cfe00700 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cfe00700 1 -- 172.21.15.120:0/4097555548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd896f72e0 con 0x55bd8957dec0 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cf400700 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.016+0000 7f95cfe00700 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd8957dec0 0x55bd896fb530 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f95c00a96b0 tx=0x7f95c00dfad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe361dd72d101aa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:02.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.017+0000 7f95c4c00700 1 -- 172.21.15.120:0/4097555548 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0007df0 con 0x55bd8957dec0 2024-05-14T09:27:02.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.017+0000 7f95c4c00700 1 -- 172.21.15.120:0/4097555548 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95c00b0e50 con 0x55bd8957dec0 2024-05-14T09:27:02.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.017+0000 7f95c4c00700 1 -- 172.21.15.120:0/4097555548 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c00e21e0 con 0x55bd8957dec0 2024-05-14T09:27:02.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 -- 172.21.15.120:0/4097555548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd8957dec0 msgr2=0x55bd896fb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:02.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd8957dec0 0x55bd896fb530 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f95c00a96b0 tx=0x7f95c00dfad0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 -- 172.21.15.120:0/4097555548 shutdown_connections 2024-05-14T09:27:02.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd89705b70 0x55bd896ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd8957dec0 0x55bd896fb530 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 --2- 172.21.15.120:0/4097555548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd896f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 -- 172.21.15.120:0/4097555548 >> 172.21.15.120:0/4097555548 conn(0x55bd895c2ff0 msgr2=0x55bd896fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:02.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 -- 172.21.15.120:0/4097555548 shutdown_connections 2024-05-14T09:27:02.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.018+0000 7f95e5594b80 1 -- 172.21.15.120:0/4097555548 wait complete. 2024-05-14T09:27:02.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.019+0000 7f95e5594b80 1 -- start start 2024-05-14T09:27:02.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.019+0000 7f95e5594b80 1 Processor -- start 2024-05-14T09:27:02.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89716020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:02.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89716560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:02.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95e5594b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd89712ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:02.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95e5594b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01af3a0 con 0x55bd89705b70 2024-05-14T09:27:02.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95e5594b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01aecd0 con 0x55bd897018b0 2024-05-14T09:27:02.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95e5594b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01abef0 con 0x55bd8957dec0 2024-05-14T09:27:02.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95e5594b80 10 client.0 _ll_register_callbacks cb 0x55bd895c4cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.020+0000 7f95d4a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd89712ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.021+0000 7f95d4a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd89712ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35050/0 (socket says 172.21.15.120:35050) 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.021+0000 7f95d4a00700 1 -- 172.21.15.120:0/1604014371 learned_addr learned my addr 172.21.15.120:0/1604014371 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.021+0000 7f95cf400700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89716560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.021+0000 7f95cfe00700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89716020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95d4a00700 1 -- 172.21.15.120:0/1604014371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 msgr2=0x55bd89716020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95d4a00700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89716020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95d4a00700 1 -- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 msgr2=0x55bd89716560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95d4a00700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89716560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95d4a00700 1 -- 172.21.15.120:0/1604014371 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd897135e0 con 0x55bd89705b70 2024-05-14T09:27:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95cf400700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89716560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:27:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95ba000700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.022+0000 7f95d4a00700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd89712ff0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f95c800b3f0 tx=0x7f95c8006150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd520c2e561adc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.023+0000 7f95ba000700 1 -- 172.21.15.120:0/1604014371 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8041060 con 0x55bd89705b70 2024-05-14T09:27:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.023+0000 7f95ba000700 1 -- 172.21.15.120:0/1604014371 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f95c8032640 con 0x55bd89705b70 2024-05-14T09:27:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.023+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c00b0e50 con 0x55bd89705b70 2024-05-14T09:27:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.023+0000 7f95ba000700 1 -- 172.21.15.120:0/1604014371 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f95c8048050 con 0x55bd89705b70 2024-05-14T09:27:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.023+0000 7f95e5594b80 10 client.16083 fetch_fsmap learned FSMap version 36 2024-05-14T09:27:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.023+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bd897892e0 con 0x55bd89705b70 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.024+0000 7f95ba000700 1 -- 172.21.15.120:0/1604014371 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95c00b0e50 con 0x55bd89705b70 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.024+0000 7f95ba000700 1 -- 172.21.15.120:0/1604014371 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 36) ==== 8374+0+0 (secure 0 0 0) 0x7f95c8011070 con 0x55bd89705b70 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.024+0000 7f95e5594b80 10 client.16083 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.024+0000 7f95e5594b80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.024+0000 7f95e5594b80 20 client.16083 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.024+0000 7f95e5594b80 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd897899b0 0x55bd8978bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.024+0000 7f95e5594b80 4 client.16083 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T09:27:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.025+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bd8962b480 con 0x55bd897899b0 2024-05-14T09:27:02.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.025+0000 7f95cfe00700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd897899b0 0x55bd8978bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:02.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.027+0000 7f95ba000700 10 client.16083 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:02.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.027+0000 7f95cfe00700 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd897899b0 0x55bd8978bdd0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c211267fdfabb6e8 server_cookie=9b0a01d5efd7746f in_seq=0 out_seq=0 2024-05-14T09:27:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.029+0000 7f95ba000700 1 -- 172.21.15.120:0/1604014371 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bd8962b480 con 0x55bd897899b0 2024-05-14T09:27:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.029+0000 7f95ba000700 10 client.16083 handle_command_reply: tid=0 2024-05-14T09:27:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.029+0000 7f95e5594b80 1 client.16083 shutdown 2024-05-14T09:27:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 msgr2=0x55bd89712ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd89712ff0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f95c800b3f0 tx=0x7f95c8006150 comp rx=0 tx=0).stop 2024-05-14T09:27:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 shutdown_connections 2024-05-14T09:27:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bd897899b0 0x55bd8978bdd0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd89705b70 0x55bd89712ff0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd8957dec0 0x55bd89716020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95ba000700 0 client.16083 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 --2- 172.21.15.120:0/1604014371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bd897018b0 0x55bd89716560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 >> 172.21.15.120:0/1604014371 conn(0x55bd895c2ff0 msgr2=0x55bd896f08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.030+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 shutdown_connections 2024-05-14T09:27:02.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.031+0000 7f95e5594b80 1 -- 172.21.15.120:0/1604014371 wait complete. 2024-05-14T09:27:02.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.031+0000 7f95e5594b80 20 client.16083 trim_cache size 0 max 16384 2024-05-14T09:27:02.032 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:27:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-05-14T09:27:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "19895a37-c2e0-482d-8dca-aaec60c4b060", 2024-05-14T09:27:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-05-14T09:27:02.032 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f95b40b2880 msgr2=0x7f95b40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f95b40b2880 0x7f95b40b4d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009900 tx=0x7f95c800b7d0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106570 msgr2=0x7f95d019cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106570 0x7f95d019cea0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f95c000c9e0 tx=0x7f95c000ccf0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 shutdown_connections 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f95b40b2880 0x7f95b40b4d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95d010c5b0 0x7f95d01a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95d0106570 0x7f95d019cea0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 --2- 172.21.15.120:0/3720472434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95d0106ec0 0x7f95d019d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 >> 172.21.15.120:0/3720472434 conn(0x7f95d0102050 msgr2=0x7f95d01037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 shutdown_connections 2024-05-14T09:27:02.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:02.032+0000 7f95d6a00700 1 -- 172.21.15.120:0/3720472434 wait complete. 2024-05-14T09:27:02.056 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:02 smithi120 ceph-mon[31085]: pgmap v660: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-05-14T09:27:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:02 smithi152 ceph-mon[34868]: pgmap v660: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-05-14T09:27:02.458 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:27:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:27:02.051+0000 7f6fc8a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical/ auth{2=1} v696 ap=2 f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2) n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3) (inest sync->mix g=2) caps={15282=pAsLsXsFs/-@52} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e4f20db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v105>,<0x10000000003/postgres v27>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v43>,<0x10000000001/sv_0 v60>,<0x10000000000/qa v46>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v696>,<0x10000000005/data v625>,<0x10000000003/postgres v245>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v272>,<0x10000000001/sv_0 v279>,<0x10000000000/qa v272>,<0x1/volumes v261>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T09:24:11.529232+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","memory_value.dirstat":"f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T09:27:02.459 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:27:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:27:02.054+0000 7f6fc8a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp/ auth{2=1,3=1} v1071 ap=2 f(v32 m2024-05-14T09:26:37.970329+0000 3=3+0) n(v2 rc2024-05-14T09:26:37.970329+0000 b9657 4=3+1) (inest sync->mix g=2,3) caps={15282=pAsLsXsFs/-@103} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e4f20da580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v105>,<0x10000000003/postgres v27>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v43>,<0x10000000001/sv_0 v60>,<0x10000000000/qa v46>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v1071>,<0x10000000005/data v625>,<0x10000000003/postgres v245>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v272>,<0x10000000001/sv_0 v279>,<0x10000000000/qa v272>,<0x1/volumes v261>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T09:26:37.934890+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-05-14T09:26:37.970329+0000 b9657 4=3+1)","memory_value.dirstat":"f(v32 m2024-05-14T09:26:37.970329+0000 3=3+0)","memory_value.rstat":"n(v2 rc2024-05-14T09:26:37.970329+0000 b9657 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T09:27:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:02 smithi175 ceph-mon[35353]: pgmap v660: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-05-14T09:27:02.986 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub queued for path: / 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:03 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub queued for path: / 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:03 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub queued for path: / 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:03 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:27:03.500 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:27:04.087 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:04 smithi120 ceph-mon[31085]: pgmap v661: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 29 op/s 2024-05-14T09:27:04.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:04 smithi152 ceph-mon[34868]: pgmap v661: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 29 op/s 2024-05-14T09:27:04.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:04 smithi175 ceph-mon[35353]: pgmap v661: 129 pgs: 129 active+clean; 775 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 29 op/s 2024-05-14T09:27:05.324 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:05 smithi120 ceph-mon[31085]: pgmap v662: 129 pgs: 129 active+clean; 779 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 51 op/s 2024-05-14T09:27:05.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:05 smithi152 ceph-mon[34868]: pgmap v662: 129 pgs: 129 active+clean; 779 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 51 op/s 2024-05-14T09:27:05.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:05 smithi175 ceph-mon[35353]: pgmap v662: 129 pgs: 129 active+clean; 779 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 51 op/s 2024-05-14T09:27:05.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 -- 172.21.15.120:0/255833765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694107df0 msgr2=0x7fe694108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:05.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 --2- 172.21.15.120:0/255833765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694107df0 0x7fe694108200 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe6800099c0 tx=0x7fe680009cd0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 -- 172.21.15.120:0/255833765 shutdown_connections 2024-05-14T09:27:05.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 --2- 172.21.15.120:0/255833765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe694108740 0x7fe6941100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 --2- 172.21.15.120:0/255833765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6941034c0 0x7fe6941038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 --2- 172.21.15.120:0/255833765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694107df0 0x7fe694108200 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 -- 172.21.15.120:0/255833765 >> 172.21.15.120:0/255833765 conn(0x7fe6940fedc0 msgr2=0x7fe6941011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:05.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 -- 172.21.15.120:0/255833765 shutdown_connections 2024-05-14T09:27:05.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.962+0000 7fe69c400700 1 -- 172.21.15.120:0/255833765 wait complete. 2024-05-14T09:27:05.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.963+0000 7fe69c400700 1 Processor -- start 2024-05-14T09:27:05.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.964+0000 7fe69c400700 1 -- start start 2024-05-14T09:27:05.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.964+0000 7fe69c400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6941034c0 0x7fe69419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.964+0000 7fe69c400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe694107df0 0x7fe69419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.964+0000 7fe69c400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694108740 0x7fe69419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.964+0000 7fe69c400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe694113250 con 0x7fe694108740 2024-05-14T09:27:05.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.964+0000 7fe69c400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941130d0 con 0x7fe694107df0 2024-05-14T09:27:05.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.964+0000 7fe69c400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941133d0 con 0x7fe6941034c0 2024-05-14T09:27:05.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694108740 0x7fe69419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694108740 0x7fe69419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35066/0 (socket says 172.21.15.120:35066) 2024-05-14T09:27:05.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 -- 172.21.15.120:0/4123131609 learned_addr learned my addr 172.21.15.120:0/4123131609 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:05.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe699a00700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6941034c0 0x7fe69419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe699000700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe694107df0 0x7fe69419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 -- 172.21.15.120:0/4123131609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6941034c0 msgr2=0x7fe69419ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:05.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6941034c0 0x7fe69419ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 -- 172.21.15.120:0/4123131609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe694107df0 msgr2=0x7fe69419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:05.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe694107df0 0x7fe69419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe69a400700 1 -- 172.21.15.120:0/4123131609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69419fb70 con 0x7fe694108740 2024-05-14T09:27:05.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.965+0000 7fe699000700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe694107df0 0x7fe69419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:05.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.966+0000 7fe69a400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694108740 0x7fe69419f580 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe68c007d70 tx=0x7fe68c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:05.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.966+0000 7fe692000700 1 -- 172.21.15.120:0/4123131609 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c016020 con 0x7fe694108740 2024-05-14T09:27:05.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.966+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69419fe60 con 0x7fe694108740 2024-05-14T09:27:05.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.966+0000 7fe692000700 1 -- 172.21.15.120:0/4123131609 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe68c00ad40 con 0x7fe694108740 2024-05-14T09:27:05.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.966+0000 7fe692000700 1 -- 172.21.15.120:0/4123131609 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0115e0 con 0x7fe694108740 2024-05-14T09:27:05.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.966+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6941a0370 con 0x7fe694108740 2024-05-14T09:27:05.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.971+0000 7fe692000700 1 -- 172.21.15.120:0/4123131609 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe68c019020 con 0x7fe694108740 2024-05-14T09:27:05.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.971+0000 7fe6aaf15b80 1 Processor -- start 2024-05-14T09:27:05.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.971+0000 7fe6aaf15b80 1 -- start start 2024-05-14T09:27:05.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55aa7c5eca20 con 0x55aa7c6d0830 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aa7c58a760 con 0x55aa7c6ca9f0 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aa7c5e89e0 con 0x55aa7c54ce40 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe699a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe699a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35078/0 (socket says 172.21.15.120:35078) 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.972+0000 7fe699a00700 1 -- 172.21.15.120:0/1428838966 learned_addr learned my addr 172.21.15.120:0/1428838966 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe699000700 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe699000700 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe699a00700 1 -- 172.21.15.120:0/1428838966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 msgr2=0x55aa7c6d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:05.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe699a00700 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe699a00700 1 -- 172.21.15.120:0/1428838966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 msgr2=0x55aa7c6cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:05.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe699a00700 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe699a00700 1 -- 172.21.15.120:0/1428838966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7c5398d0 con 0x55aa7c6d0830 2024-05-14T09:27:05.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.973+0000 7fe692000700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe67c0b2900 0x7fe67c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.974+0000 7fe699a00700 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6ca4b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe68800ad70 tx=0x7fe68800f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd00206032c06cb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:05.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.974+0000 7fe692000700 1 -- 172.21.15.120:0/4123131609 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe68c0e24c0 con 0x7fe694108740 2024-05-14T09:27:05.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.974+0000 7fe686a00700 1 -- 172.21.15.120:0/1428838966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688004220 con 0x55aa7c6d0830 2024-05-14T09:27:05.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.974+0000 7fe686a00700 1 -- 172.21.15.120:0/1428838966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6880043c0 con 0x55aa7c6d0830 2024-05-14T09:27:05.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.974+0000 7fe686a00700 1 -- 172.21.15.120:0/1428838966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6880186a0 con 0x55aa7c6d0830 2024-05-14T09:27:05.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.974+0000 7fe699000700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe67c0b2900 0x7fe67c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.975+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1428838966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 msgr2=0x55aa7c6ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.975+0000 7fe699000700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe67c0b2900 0x7fe67c0b4e10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe680009990 tx=0x7fe680005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.975+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6ca4b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe68800ad70 tx=0x7fe68800f6a0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.976+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1428838966 shutdown_connections 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.976+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.976+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.976+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1428838966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6ca4b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.976+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1428838966 >> 172.21.15.120:0/1428838966 conn(0x55aa7c591f70 msgr2=0x55aa7c6c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.976+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1428838966 shutdown_connections 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.976+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1428838966 wait complete. 2024-05-14T09:27:05.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.977+0000 7fe6aaf15b80 1 -- start start 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.977+0000 7fe6aaf15b80 1 Processor -- start 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6d3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55aa7c6d7360 con 0x55aa7c6d0830 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aa7c552b20 con 0x55aa7c6ca9f0 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aa7c6d74e0 con 0x55aa7c54ce40 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe6aaf15b80 10 client.0 _ll_register_callbacks cb 0x55aa7c593c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:05.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe69a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe69a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35090/0 (socket says 172.21.15.120:35090) 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe69a400700 1 -- 172.21.15.120:0/1531574408 learned_addr learned my addr 172.21.15.120:0/1531574408 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.978+0000 7fe699000700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6d3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe699a00700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe69a400700 1 -- 172.21.15.120:0/1531574408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 msgr2=0x55aa7c6d6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe69a400700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe69a400700 1 -- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 msgr2=0x55aa7c6d3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe69a400700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6d3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe69a400700 1 -- 172.21.15.120:0/1531574408 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa7c5b2420 con 0x55aa7c6d0830 2024-05-14T09:27:05.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe699000700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6d3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe69a400700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d4590 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0a5760 tx=0x7fe68c0a8ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cf326782b34127 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.979+0000 7fe67b400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.980+0000 7fe67b400700 1 -- 172.21.15.120:0/1531574408 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0a9de0 con 0x55aa7c6d0830 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.980+0000 7fe67b400700 1 -- 172.21.15.120:0/1531574408 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe68c0a5cd0 con 0x55aa7c6d0830 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.980+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6880043c0 con 0x55aa7c6d0830 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.980+0000 7fe67b400700 1 -- 172.21.15.120:0/1531574408 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe68c0a96e0 con 0x55aa7c6d0830 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.980+0000 7fe6aaf15b80 10 client.16095 fetch_fsmap learned FSMap version 36 2024-05-14T09:27:05.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.980+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55aa7c6e1e00 con 0x55aa7c6d0830 2024-05-14T09:27:05.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.980+0000 7fe67b400700 1 -- 172.21.15.120:0/1531574408 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6880043c0 con 0x55aa7c6d0830 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.981+0000 7fe67b400700 1 -- 172.21.15.120:0/1531574408 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 36) ==== 8374+0+0 (secure 0 0 0) 0x7fe68c0b20b0 con 0x55aa7c6d0830 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.981+0000 7fe6aaf15b80 10 client.16095 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.981+0000 7fe6aaf15b80 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.981+0000 7fe6aaf15b80 20 client.16095 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.981+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c6e4490 0x55aa7c6e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.981+0000 7fe6aaf15b80 4 client.16095 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.981+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa7c6971c0 con 0x55aa7c6e4490 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.982+0000 7fe699a00700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c6e4490 0x55aa7c6e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.983+0000 7fe67b400700 10 client.16095 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:05.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.983+0000 7fe699a00700 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c6e4490 0x55aa7c6e68f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1f3e265bd5d6dce server_cookie=fc5a2e6497d2ed2f in_seq=0 out_seq=0 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe67b400700 1 -- 172.21.15.120:0/1531574408 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa7c6971c0 con 0x55aa7c6e4490 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe67b400700 10 client.16095 handle_command_reply: tid=0 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 client.16095 shutdown 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 msgr2=0x55aa7c6d4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d4590 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0a5760 tx=0x7fe68c0a8ed0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 shutdown_connections 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c6e4490 0x55aa7c6e68f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d4590 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c54ce40 0x55aa7c6d6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/1531574408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6d3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:05.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.985+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 >> 172.21.15.120:0/1531574408 conn(0x55aa7c591f70 msgr2=0x55aa7c6cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:05.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.986+0000 7fe67b400700 0 client.16095 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:05.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.986+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 shutdown_connections 2024-05-14T09:27:05.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.986+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/1531574408 wait complete. 2024-05-14T09:27:05.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:05.986+0000 7fe6aaf15b80 20 client.16095 trim_cache size 0 max 16384 2024-05-14T09:27:06.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.011+0000 7fe6aaf15b80 1 Processor -- start 2024-05-14T09:27:06.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe6aaf15b80 1 -- start start 2024-05-14T09:27:06.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:06.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6e0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:06.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:06.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941ae060 con 0x55aa7c54ce40 2024-05-14T09:27:06.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941afc30 con 0x55aa7c6d0830 2024-05-14T09:27:06.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941ae730 con 0x55aa7c6ca9f0 2024-05-14T09:27:06.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.012+0000 7fe699a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35100/0 (socket says 172.21.15.120:35100) 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 -- 172.21.15.120:0/2576203184 learned_addr learned my addr 172.21.15.120:0/2576203184 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe69a400700 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699000700 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 -- 172.21.15.120:0/2576203184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 msgr2=0x55aa7c6e0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6e0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 -- 172.21.15.120:0/2576203184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 msgr2=0x55aa7c6d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 -- 172.21.15.120:0/2576203184 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7c6c5ff0 con 0x55aa7c54ce40 2024-05-14T09:27:06.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699000700 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6e0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:27:06.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.013+0000 7fe699a00700 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6ca4b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe68800acc0 tx=0x7fe688000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad7bd7a685541c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:06.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.014+0000 7fe686000700 1 -- 172.21.15.120:0/2576203184 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688003920 con 0x55aa7c54ce40 2024-05-14T09:27:06.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.014+0000 7fe686000700 1 -- 172.21.15.120:0/2576203184 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe688003ac0 con 0x55aa7c54ce40 2024-05-14T09:27:06.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.014+0000 7fe686000700 1 -- 172.21.15.120:0/2576203184 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688004af0 con 0x55aa7c54ce40 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/2576203184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 msgr2=0x55aa7c6ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6ca4b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe68800acc0 tx=0x7fe688000bc0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/2576203184 shutdown_connections 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6ca4b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/2576203184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6e0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/2576203184 >> 172.21.15.120:0/2576203184 conn(0x55aa7c591f70 msgr2=0x55aa7c6d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:06.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/2576203184 shutdown_connections 2024-05-14T09:27:06.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.015+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/2576203184 wait complete. 2024-05-14T09:27:06.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.016+0000 7fe6aaf15b80 1 -- start start 2024-05-14T09:27:06.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.016+0000 7fe6aaf15b80 1 Processor -- start 2024-05-14T09:27:06.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6dc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:06.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe6aaf15b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941af4d0 con 0x55aa7c54ce40 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941aee00 con 0x55aa7c6d0830 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe6aaf15b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941ac040 con 0x55aa7c6ca9f0 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe6aaf15b80 10 client.0 _ll_register_callbacks cb 0x55aa7c593c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.017+0000 7fe699a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6dc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35102/0 (socket says 172.21.15.120:35102) 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699a00700 1 -- 172.21.15.120:0/708964353 learned_addr learned my addr 172.21.15.120:0/708964353 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe69a400700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699000700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:06.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699a00700 1 -- 172.21.15.120:0/708964353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 msgr2=0x55aa7c6dccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699a00700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6dccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699a00700 1 -- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 msgr2=0x55aa7c6eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699a00700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe699a00700 1 -- 172.21.15.120:0/708964353 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa7c6eb7d0 con 0x55aa7c54ce40 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.018+0000 7fe69a400700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe699a00700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6dc790 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe6880039b0 tx=0x7fe688005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc9f6bb09a5b426 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe67b400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe67b400700 1 -- 172.21.15.120:0/708964353 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688036020 con 0x55aa7c54ce40 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe67b400700 1 -- 172.21.15.120:0/708964353 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe688005520 con 0x55aa7c54ce40 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe688003ac0 con 0x55aa7c54ce40 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe67b400700 1 -- 172.21.15.120:0/708964353 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe688004770 con 0x55aa7c54ce40 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe6aaf15b80 10 client.16101 fetch_fsmap learned FSMap version 36 2024-05-14T09:27:06.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.019+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55aa7c747520 con 0x55aa7c54ce40 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe67b400700 1 -- 172.21.15.120:0/708964353 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe688003ac0 con 0x55aa7c54ce40 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe67b400700 1 -- 172.21.15.120:0/708964353 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 36) ==== 8374+0+0 (secure 0 0 0) 0x7fe688004220 con 0x55aa7c54ce40 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe6aaf15b80 10 client.16101 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe6aaf15b80 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe6aaf15b80 20 client.16101 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c747ac0 0x55aa7c749ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe6aaf15b80 4 client.16101 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.020+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aa7c5fa400 con 0x55aa7c747ac0 2024-05-14T09:27:06.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.021+0000 7fe699000700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c747ac0 0x55aa7c749ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:06.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.022+0000 7fe699000700 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c747ac0 0x55aa7c749ee0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13450bd2670277c4 server_cookie=5c7026c81c4534e0 in_seq=0 out_seq=0 2024-05-14T09:27:06.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.022+0000 7fe67b400700 10 client.16101 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:06.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe67b400700 1 -- 172.21.15.120:0/708964353 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55aa7c5fa400 con 0x55aa7c747ac0 2024-05-14T09:27:06.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe67b400700 10 client.16101 handle_command_reply: tid=0 2024-05-14T09:27:06.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 client.16101 shutdown 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 msgr2=0x55aa7c6dc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6dc790 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe6880039b0 tx=0x7fe688005040 comp rx=0 tx=0).stop 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 shutdown_connections 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55aa7c747ac0 0x55aa7c749ee0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa7c6d0830 0x55aa7c6eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55aa7c54ce40 0x55aa7c6dc790 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 --2- 172.21.15.120:0/708964353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa7c6ca9f0 0x55aa7c6dccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 >> 172.21.15.120:0/708964353 conn(0x55aa7c591f70 msgr2=0x55aa7c6ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe67b400700 0 client.16101 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 shutdown_connections 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.023+0000 7fe6aaf15b80 1 -- 172.21.15.120:0/708964353 wait complete. 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.024+0000 7fe6aaf15b80 20 client.16101 trim_cache size 0 max 16384 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stdout: "19895a37-c2e0-482d-8dca-aaec60c4b060": { 2024-05-14T09:27:06.026 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-05-14T09:27:06.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "19895a37-c2e0-482d-8dca-aaec60c4b060", 2024-05-14T09:27:06.027 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-05-14T09:27:06.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:27:06.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:27:06.027 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:27:06.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe67c0b2900 msgr2=0x7fe67c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe67c0b2900 0x7fe67c0b4e10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe680009990 tx=0x7fe680005040 comp rx=0 tx=0).stop 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694108740 msgr2=0x7fe69419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694108740 0x7fe69419f580 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe68c007d70 tx=0x7fe68c00a340 comp rx=0 tx=0).stop 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 shutdown_connections 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe67c0b2900 0x7fe67c0b4e10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe694108740 0x7fe69419f580 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6941034c0 0x7fe69419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 --2- 172.21.15.120:0/4123131609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe694107df0 0x7fe69419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 >> 172.21.15.120:0/4123131609 conn(0x7fe6940fedc0 msgr2=0x7fe69406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 shutdown_connections 2024-05-14T09:27:06.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:06.025+0000 7fe69c400700 1 -- 172.21.15.120:0/4123131609 wait complete. 2024-05-14T09:27:07.037 INFO:tasks.cephfs.filesystem:scrub status for tag:19895a37-c2e0-482d-8dca-aaec60c4b060 - {'path': '/', 'tag': '19895a37-c2e0-482d-8dca-aaec60c4b060', 'options': 'recursive,force'} 2024-05-14T09:27:07.505 INFO:teuthology.orchestra.run.smithi120.stderr:creating primary keys... 2024-05-14T09:27:07.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:07 smithi152 ceph-mon[34868]: pgmap v663: 129 pgs: 129 active+clean; 787 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 13 MiB/s wr, 81 op/s 2024-05-14T09:27:07.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:07 smithi175 ceph-mon[35353]: pgmap v663: 129 pgs: 129 active+clean; 787 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 13 MiB/s wr, 81 op/s 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 -- 172.21.15.120:0/2454524748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c01099c0 msgr2=0x7fb8c010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/2454524748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c01099c0 0x7fb8c010bde0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009ca0 tx=0x7fb8b802a8c0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 -- 172.21.15.120:0/2454524748 shutdown_connections 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/2454524748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c01099c0 0x7fb8c010bde0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/2454524748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0104cc0 0x7fb8c01050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/2454524748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c0103a80 0x7fb8c0104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 -- 172.21.15.120:0/2454524748 >> 172.21.15.120:0/2454524748 conn(0x7fb8c00fec70 msgr2=0x7fb8c0101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 -- 172.21.15.120:0/2454524748 shutdown_connections 2024-05-14T09:27:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.071+0000 7fb8c4e00640 1 -- 172.21.15.120:0/2454524748 wait complete. 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.072+0000 7fb8c4e00640 1 Processor -- start 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.072+0000 7fb8c4e00640 1 -- start start 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8c4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0103a80 0x7fb8c019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8c4e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c0104cc0 0x7fb8c019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8c4e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c01099c0 0x7fb8c01a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8c4e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c010f4b0 con 0x7fb8c0104cc0 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8c4e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c010f330 con 0x7fb8c0103a80 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8c4e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c010f630 con 0x7fb8c01099c0 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c0104cc0 0x7fb8c019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c0104cc0 0x7fb8c019c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35120/0 (socket says 172.21.15.120:35120) 2024-05-14T09:27:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8bea00640 1 -- 172.21.15.120:0/517817351 learned_addr learned my addr 172.21.15.120:0/517817351 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.073+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c01099c0 0x7fb8c01a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bf400640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0103a80 0x7fb8c019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bea00640 1 -- 172.21.15.120:0/517817351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c01099c0 msgr2=0x7fb8c01a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bea00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c01099c0 0x7fb8c01a3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bea00640 1 -- 172.21.15.120:0/517817351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0103a80 msgr2=0x7fb8c019c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bea00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0103a80 0x7fb8c019c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bea00640 1 -- 172.21.15.120:0/517817351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c01a3dc0 con 0x7fb8c0104cc0 2024-05-14T09:27:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c01099c0 0x7fb8c01a3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bf400640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0103a80 0x7fb8c019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.074+0000 7fb8bea00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c0104cc0 0x7fb8c019c7c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00d950 tx=0x7fb8ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.075+0000 7fb8b7e00640 1 -- 172.21.15.120:0/517817351 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac017070 con 0x7fb8c0104cc0 2024-05-14T09:27:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.075+0000 7fb8b7e00640 1 -- 172.21.15.120:0/517817351 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8ac009c30 con 0x7fb8c0104cc0 2024-05-14T09:27:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.075+0000 7fb8b7e00640 1 -- 172.21.15.120:0/517817351 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00f620 con 0x7fb8c0104cc0 2024-05-14T09:27:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.075+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c01a40b0 con 0x7fb8c0104cc0 2024-05-14T09:27:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.075+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c01a45b0 con 0x7fb8c0104cc0 2024-05-14T09:27:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 Processor -- start 2024-05-14T09:27:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 -- start start 2024-05-14T09:27:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49af2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49af2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49af9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564b49a56550 con 0x564b4972f4d0 2024-05-14T09:27:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b499fbbc0 con 0x564b497501b0 2024-05-14T09:27:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.079+0000 7fb8cd481740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564b49a52510 con 0x564b497272f0 2024-05-14T09:27:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.080+0000 7fb8b7e00640 1 -- 172.21.15.120:0/517817351 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb8ac010460 con 0x7fb8c0104cc0 2024-05-14T09:27:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.080+0000 7fb8bfe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49af2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.080+0000 7fb8bfe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49af2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37652/0 (socket says 172.21.15.120:37652) 2024-05-14T09:27:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.080+0000 7fb8bfe00640 1 -- 172.21.15.120:0/2321499776 learned_addr learned my addr 172.21.15.120:0/2321499776 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.080+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49af9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.080+0000 7fb8bf400640 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49af2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.081+0000 7fb8bea00640 1 -- 172.21.15.120:0/2321499776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 msgr2=0x564b49af2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.081+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49af2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.081+0000 7fb8bea00640 1 -- 172.21.15.120:0/2321499776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 msgr2=0x564b49af2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.081+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49af2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.081+0000 7fb8bea00640 1 -- 172.21.15.120:0/2321499776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b49768210 con 0x564b4972f4d0 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.081+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49af9780 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0df990 tx=0x7fb8ac0ea910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76242e292a1655ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.081+0000 7fb8b4c00640 1 -- 172.21.15.120:0/2321499776 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0f5070 con 0x564b4972f4d0 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.082+0000 7fb8b4c00640 1 -- 172.21.15.120:0/2321499776 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8ac0e44e0 con 0x564b4972f4d0 2024-05-14T09:27:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.082+0000 7fb8b4c00640 1 -- 172.21.15.120:0/2321499776 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0f0920 con 0x564b4972f4d0 2024-05-14T09:27:08.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.082+0000 7fb8b7e00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb8a40b27e0 0x7fb8a40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.082+0000 7fb8b7e00640 1 -- 172.21.15.120:0/517817351 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb8ac0e22f0 con 0x7fb8c0104cc0 2024-05-14T09:27:08.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb8a40b27e0 0x7fb8a40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 -- 172.21.15.120:0/2321499776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 msgr2=0x564b49af9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49af9780 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0df990 tx=0x7fb8ac0ea910 comp rx=0 tx=0).stop 2024-05-14T09:27:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 -- 172.21.15.120:0/2321499776 shutdown_connections 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49af9780 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49af2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2321499776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49af2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 -- 172.21.15.120:0/2321499776 >> 172.21.15.120:0/2321499776 conn(0x564b49744300 msgr2=0x564b49aedc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 -- 172.21.15.120:0/2321499776 shutdown_connections 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.083+0000 7fb8cd481740 1 -- 172.21.15.120:0/2321499776 wait complete. 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.084+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb8a40b27e0 0x7fb8a40b4cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8031920 tx=0x7fb8b8031980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.084+0000 7fb8cd481740 1 -- start start 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.084+0000 7fb8cd481740 1 Processor -- start 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49afbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49afc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49b032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8cd481740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564b49afa1d0 con 0x564b4972f4d0 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8cd481740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b49a0f660 con 0x564b497501b0 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8cd481740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564b49afa350 con 0x564b497272f0 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8cd481740 10 client.0 _ll_register_callbacks cb 0x564b499d9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49afc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8bea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49afc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35134/0 (socket says 172.21.15.120:35134) 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8bea00640 1 -- 172.21.15.120:0/2396347460 learned_addr learned my addr 172.21.15.120:0/2396347460 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8bf400640 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49afbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.085+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49b032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8bea00640 1 -- 172.21.15.120:0/2396347460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 msgr2=0x564b49afbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49afbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8bea00640 1 -- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 msgr2=0x564b49b032c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49b032c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8bea00640 1 -- 172.21.15.120:0/2396347460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b49834620 con 0x564b4972f4d0 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49afc360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0058c0 tx=0x7fb8ac009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7bc8157f2d40b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8a9600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8a9600640 1 -- 172.21.15.120:0/2396347460 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac020030 con 0x564b4972f4d0 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8ac0e44e0 con 0x564b4972f4d0 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.086+0000 7fb8a9600640 1 -- 172.21.15.120:0/2396347460 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb8ac0e42e0 con 0x564b4972f4d0 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8a9600640 1 -- 172.21.15.120:0/2396347460 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb8ac0a53d0 con 0x564b4972f4d0 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 10 client.16113 fetch_fsmap learned FSMap version 37 2024-05-14T09:27:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564b49afa1d0 con 0x564b4972f4d0 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8a9600640 1 -- 172.21.15.120:0/2396347460 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8ac0e44e0 con 0x564b4972f4d0 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8a9600640 1 -- 172.21.15.120:0/2396347460 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 37) ==== 8370+0+0 (secure 0 0 0) 0x7fb8ac0a9770 con 0x564b4972f4d0 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 10 client.16113 fetch_fsmap finished waiting for FSMap version 37 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 20 client.16113 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b4970ed80 0x564b49b09380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 4 client.16113 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.087+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b49a64160 con 0x564b4970ed80 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.088+0000 7fb8bf400640 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b4970ed80 0x564b49b09380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.089+0000 7fb8a9600640 10 client.16113 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.089+0000 7fb8bf400640 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b4970ed80 0x564b49b09380 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe931b6addb83e2 server_cookie=65bb31e6b2a710b9 in_seq=0 out_seq=0 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.091+0000 7fb8a9600640 1 -- 172.21.15.120:0/2396347460 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564b49a64160 con 0x564b4970ed80 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.091+0000 7fb8a9600640 10 client.16113 handle_command_reply: tid=0 2024-05-14T09:27:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.091+0000 7fb8cd481740 1 client.16113 shutdown 2024-05-14T09:27:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 msgr2=0x564b49afc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49afc360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0058c0 tx=0x7fb8ac009740 comp rx=0 tx=0).stop 2024-05-14T09:27:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 shutdown_connections 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b4970ed80 0x564b49b09380 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b497501b0 0x564b49b032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b4972f4d0 0x564b49afc360 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2396347460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49afbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8a9600640 0 client.16113 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 >> 172.21.15.120:0/2396347460 conn(0x564b49744300 msgr2=0x564b49aecc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 shutdown_connections 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 1 -- 172.21.15.120:0/2396347460 wait complete. 2024-05-14T09:27:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.092+0000 7fb8cd481740 20 client.16113 trim_cache size 0 max 16384 2024-05-14T09:27:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.111+0000 7fb8cd481740 1 Processor -- start 2024-05-14T09:27:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.111+0000 7fb8cd481740 1 -- start start 2024-05-14T09:27:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497272f0 0x564b49afae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497501b0 0x564b49b0dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8cd481740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01aeaf0 con 0x564b497272f0 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8cd481740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01b0690 con 0x564b4972f4d0 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8cd481740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01af1c0 con 0x564b497501b0 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8bf400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497272f0 0x564b49afae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8bf400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497272f0 0x564b49afae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35136/0 (socket says 172.21.15.120:35136) 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8bf400640 1 -- 172.21.15.120:0/2299777965 learned_addr learned my addr 172.21.15.120:0/2299777965 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497501b0 0x564b49b0dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.112+0000 7fb8bea00640 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8bf400640 1 -- 172.21.15.120:0/2299777965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497501b0 msgr2=0x564b49b0dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8bf400640 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497501b0 0x564b49b0dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8bf400640 1 -- 172.21.15.120:0/2299777965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 msgr2=0x564b49b031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8bf400640 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8bf400640 1 -- 172.21.15.120:0/2299777965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b49afca20 con 0x564b497272f0 2024-05-14T09:27:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497501b0 0x564b49b0dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8bf400640 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497272f0 0x564b49afae30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0104680 tx=0x7fb8b00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965ed7deffe3e93f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8abe00640 1 -- 172.21.15.120:0/2299777965 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00042f0 con 0x564b497272f0 2024-05-14T09:27:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.113+0000 7fb8abe00640 1 -- 172.21.15.120:0/2299777965 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8b0022070 con 0x564b497272f0 2024-05-14T09:27:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.114+0000 7fb8abe00640 1 -- 172.21.15.120:0/2299777965 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0003c10 con 0x564b497272f0 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 -- 172.21.15.120:0/2299777965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497272f0 msgr2=0x564b49afae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497272f0 0x564b49afae30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0104680 tx=0x7fb8b00118d0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 -- 172.21.15.120:0/2299777965 shutdown_connections 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497501b0 0x564b49b0dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 --2- 172.21.15.120:0/2299777965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497272f0 0x564b49afae30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 -- 172.21.15.120:0/2299777965 >> 172.21.15.120:0/2299777965 conn(0x564b49744300 msgr2=0x564b49afa720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 -- 172.21.15.120:0/2299777965 shutdown_connections 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 -- 172.21.15.120:0/2299777965 wait complete. 2024-05-14T09:27:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.115+0000 7fb8cd481740 1 -- start start 2024-05-14T09:27:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 1 Processor -- start 2024-05-14T09:27:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49b00990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b00ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497501b0 0x564b49b01d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01aff60 con 0x564b497501b0 2024-05-14T09:27:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01af890 con 0x564b4972f4d0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01acaf0 con 0x564b497272f0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.116+0000 7fb8cd481740 10 client.0 _ll_register_callbacks cb 0x7fb8ac0f3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497501b0 0x564b49b01d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497501b0 0x564b49b01d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35150/0 (socket says 172.21.15.120:35150) 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 -- 172.21.15.120:0/1475817153 learned_addr learned my addr 172.21.15.120:0/1475817153 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bf400640 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49b00990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bea00640 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b00ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 -- 172.21.15.120:0/1475817153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 msgr2=0x564b49b00990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49b00990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 -- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 msgr2=0x564b49b00ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b00ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.117+0000 7fb8bfe00640 1 -- 172.21.15.120:0/1475817153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b49b02320 con 0x564b497501b0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8bfe00640 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497501b0 0x564b49b01d60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x564b49af34d0 tx=0x7fb8b802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b93cf0b7baf168a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8a9600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8a9600640 1 -- 172.21.15.120:0/1475817153 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8058060 con 0x564b497501b0 2024-05-14T09:27:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8a9600640 1 -- 172.21.15.120:0/1475817153 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb8b8042030 con 0x564b497501b0 2024-05-14T09:27:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b0022070 con 0x564b497501b0 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8a9600640 1 -- 172.21.15.120:0/1475817153 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb8b805f050 con 0x564b497501b0 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8cd481740 10 client.16119 fetch_fsmap learned FSMap version 37 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.118+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564b49b71780 con 0x564b497501b0 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8a9600640 1 -- 172.21.15.120:0/1475817153 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8b0022070 con 0x564b497501b0 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8a9600640 1 -- 172.21.15.120:0/1475817153 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 37) ==== 8370+0+0 (secure 0 0 0) 0x7fb8b8030970 con 0x564b497501b0 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8cd481740 10 client.16119 fetch_fsmap finished waiting for FSMap version 37 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8cd481740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8cd481740 20 client.16119 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8cd481740 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b496e41c0 0x564b49b740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8cd481740 4 client.16119 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:27:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.119+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564b49a5dfd0 con 0x564b496e41c0 2024-05-14T09:27:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.120+0000 7fb8bf400640 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b496e41c0 0x564b49b740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.121+0000 7fb8bf400640 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b496e41c0 0x564b49b740b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f3d515948758ec server_cookie=1ba33af10458baaa in_seq=0 out_seq=0 2024-05-14T09:27:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.121+0000 7fb8a9600640 10 client.16119 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:07 smithi120 ceph-mon[31085]: pgmap v663: 129 pgs: 129 active+clean; 787 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 13 MiB/s wr, 81 op/s 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.205+0000 7fb8a9600640 1 -- 172.21.15.120:0/1475817153 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b49a5dfd0 con 0x564b496e41c0 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.205+0000 7fb8a9600640 10 client.16119 handle_command_reply: tid=0 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.205+0000 7fb8cd481740 1 client.16119 shutdown 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.205+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497501b0 msgr2=0x564b49b01d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.205+0000 7fb8cd481740 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497501b0 0x564b49b01d60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x564b49af34d0 tx=0x7fb8b802a8c0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 shutdown_connections 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564b496e41c0 0x564b49b740b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564b497501b0 0x564b49b01d60 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b4972f4d0 0x564b49b00ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8a9600640 0 client.16119 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 --2- 172.21.15.120:0/1475817153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b497272f0 0x564b49b00990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 >> 172.21.15.120:0/1475817153 conn(0x564b49744300 msgr2=0x564b49af0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 shutdown_connections 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 1 -- 172.21.15.120:0/1475817153 wait complete. 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.206+0000 7fb8cd481740 20 client.16119 trim_cache size 0 max 16384 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.207+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb8a40b27e0 msgr2=0x7fb8a40b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.207+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb8a40b27e0 0x7fb8a40b4cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8031920 tx=0x7fb8b8031980 comp rx=0 tx=0).stop 2024-05-14T09:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.207+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c0104cc0 msgr2=0x7fb8c019c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.207+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c0104cc0 0x7fb8c019c7c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00d950 tx=0x7fb8ac00de10 comp rx=0 tx=0).stop 2024-05-14T09:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 shutdown_connections 2024-05-14T09:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb8a40b27e0 0x7fb8a40b4cf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c01099c0 0x7fb8c01a3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c0104cc0 0x7fb8c019c7c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 --2- 172.21.15.120:0/517817351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0103a80 0x7fb8c019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 >> 172.21.15.120:0/517817351 conn(0x7fb8c00fec70 msgr2=0x7fb8c00ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 shutdown_connections 2024-05-14T09:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:08.208+0000 7fb8c4e00640 1 -- 172.21.15.120:0/517817351 wait complete. 2024-05-14T09:27:08.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:08 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:08.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:08 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:09.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:08 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:09 smithi152 ceph-mon[34868]: pgmap v664: 129 pgs: 129 active+clean; 791 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 86 op/s 2024-05-14T09:27:09.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:09 smithi175 ceph-mon[35353]: pgmap v664: 129 pgs: 129 active+clean; 791 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 86 op/s 2024-05-14T09:27:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:09 smithi120 ceph-mon[31085]: pgmap v664: 129 pgs: 129 active+clean; 791 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 86 op/s 2024-05-14T09:27:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:11 smithi152 ceph-mon[34868]: pgmap v665: 129 pgs: 129 active+clean; 799 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 93 op/s 2024-05-14T09:27:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:11 smithi175 ceph-mon[35353]: pgmap v665: 129 pgs: 129 active+clean; 799 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 93 op/s 2024-05-14T09:27:12.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:11 smithi120 ceph-mon[31085]: pgmap v665: 129 pgs: 129 active+clean; 799 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 93 op/s 2024-05-14T09:27:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:12 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:27:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:12 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:27:12.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:12 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:27:12.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:12 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:27:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:12 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:27:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:12 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:27:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:12 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:27:12.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:12 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:27:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:12 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:27:13.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:12 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:27:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:12 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:27:13.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:12 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:27:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:13 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:27:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:13 smithi152 ceph-mon[34868]: pgmap v666: 129 pgs: 129 active+clean; 807 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 92 op/s 2024-05-14T09:27:13.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:13 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:13 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:27:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:13 smithi175 ceph-mon[35353]: pgmap v666: 129 pgs: 129 active+clean; 807 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 92 op/s 2024-05-14T09:27:13.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:13 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:13 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:27:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:13 smithi120 ceph-mon[31085]: pgmap v666: 129 pgs: 129 active+clean; 807 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 92 op/s 2024-05-14T09:27:14.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:13 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:15.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:15 smithi152 ceph-mon[34868]: pgmap v667: 129 pgs: 129 active+clean; 840 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 15 MiB/s wr, 85 op/s 2024-05-14T09:27:15.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:15 smithi175 ceph-mon[35353]: pgmap v667: 129 pgs: 129 active+clean; 840 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 15 MiB/s wr, 85 op/s 2024-05-14T09:27:16.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:15 smithi120 ceph-mon[31085]: pgmap v667: 129 pgs: 129 active+clean; 840 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 15 MiB/s wr, 85 op/s 2024-05-14T09:27:17.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:17 smithi175 ceph-mon[35353]: pgmap v668: 129 pgs: 129 active+clean; 848 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 65 op/s 2024-05-14T09:27:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:17 smithi120 ceph-mon[31085]: pgmap v668: 129 pgs: 129 active+clean; 848 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 65 op/s 2024-05-14T09:27:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:17 smithi152 ceph-mon[34868]: pgmap v668: 129 pgs: 129 active+clean; 848 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 65 op/s 2024-05-14T09:27:19.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:18 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:18 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:19.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:18 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:27:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:19 smithi120 ceph-mon[31085]: pgmap v669: 129 pgs: 129 active+clean; 852 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 14 MiB/s wr, 37 op/s 2024-05-14T09:27:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:19 smithi152 ceph-mon[34868]: pgmap v669: 129 pgs: 129 active+clean; 852 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 14 MiB/s wr, 37 op/s 2024-05-14T09:27:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:19 smithi175 ceph-mon[35353]: pgmap v669: 129 pgs: 129 active+clean; 852 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 14 MiB/s wr, 37 op/s 2024-05-14T09:27:21.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 -- 172.21.15.120:0/888144510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c41098e0 msgr2=0x7fe1c410bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/888144510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c41098e0 0x7fe1c410bdf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ca0 tx=0x7fe1bc02a8c0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 -- 172.21.15.120:0/888144510 shutdown_connections 2024-05-14T09:27:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/888144510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c41098e0 0x7fe1c410bdf0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/888144510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1c4106d70 0x7fe1c4109250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/888144510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c4104380 0x7fe1c41067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 -- 172.21.15.120:0/888144510 >> 172.21.15.120:0/888144510 conn(0x7fe1c40fdd40 msgr2=0x7fe1c41001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 -- 172.21.15.120:0/888144510 shutdown_connections 2024-05-14T09:27:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.450+0000 7fe1c8a00640 1 -- 172.21.15.120:0/888144510 wait complete. 2024-05-14T09:27:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.451+0000 7fe1c8a00640 1 Processor -- start 2024-05-14T09:27:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.451+0000 7fe1c8a00640 1 -- start start 2024-05-14T09:27:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1c4104380 0x7fe1c419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c4106d70 0x7fe1c419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c8a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c41098e0 0x7fe1c41a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c8a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c410f650 con 0x7fe1c4106d70 2024-05-14T09:27:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c8a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c410f4d0 con 0x7fe1c41098e0 2024-05-14T09:27:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c8a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c410f7d0 con 0x7fe1c4104380 2024-05-14T09:27:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c4106d70 0x7fe1c419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c4106d70 0x7fe1c419c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58862/0 (socket says 172.21.15.120:58862) 2024-05-14T09:27:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c1400640 1 -- 172.21.15.120:0/2888500066 learned_addr learned my addr 172.21.15.120:0/2888500066 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.452+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1c4104380 0x7fe1c419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c1400640 1 -- 172.21.15.120:0/2888500066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1c4104380 msgr2=0x7fe1c419c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c1400640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1c4104380 0x7fe1c419c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c1400640 1 -- 172.21.15.120:0/2888500066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c41098e0 msgr2=0x7fe1c41a3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c1400640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c41098e0 0x7fe1c41a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c1400640 1 -- 172.21.15.120:0/2888500066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c41a3f80 con 0x7fe1c4106d70 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1c4104380 0x7fe1c419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c1400640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c4106d70 0x7fe1c419c980 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000e9f0 tx=0x7fe1b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1baa00640 1 -- 172.21.15.120:0/2888500066 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000cd80 con 0x7fe1c4106d70 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.453+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c41a4270 con 0x7fe1c4106d70 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.454+0000 7fe1baa00640 1 -- 172.21.15.120:0/2888500066 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1b00054b0 con 0x7fe1c4106d70 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.454+0000 7fe1baa00640 1 -- 172.21.15.120:0/2888500066 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0010430 con 0x7fe1c4106d70 2024-05-14T09:27:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.454+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c41a47c0 con 0x7fe1c4106d70 2024-05-14T09:27:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.458+0000 7fe1cfa40740 1 Processor -- start 2024-05-14T09:27:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1cfa40740 1 -- start start 2024-05-14T09:27:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1baa00640 1 -- 172.21.15.120:0/2888500066 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe1b00046c0 con 0x7fe1c4106d70 2024-05-14T09:27:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0961b0 0x55bc6f438100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f438680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0754d0 0x55bc6f43f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bc6f39c550 con 0x55bc6f06d2f0 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bc6f341bc0 con 0x55bc6f0961b0 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.459+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc6f398510 con 0x55bc6f0754d0 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.460+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f438680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.460+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f438680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58866/0 (socket says 172.21.15.120:58866) 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.460+0000 7fe1c1e00640 1 -- 172.21.15.120:0/471547630 learned_addr learned my addr 172.21.15.120:0/471547630 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.460+0000 7fe1c2800640 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0961b0 0x55bc6f438100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.460+0000 7fe1c1400640 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0754d0 0x55bc6f43f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c1e00640 1 -- 172.21.15.120:0/471547630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0754d0 msgr2=0x55bc6f43f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0754d0 0x55bc6f43f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c1e00640 1 -- 172.21.15.120:0/471547630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0961b0 msgr2=0x55bc6f438100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0961b0 0x55bc6f438100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c1e00640 1 -- 172.21.15.120:0/471547630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc6f0ae210 con 0x55bc6f06d2f0 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c1400640 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0754d0 0x55bc6f43f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c2800640 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0961b0 0x55bc6f438100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f438680 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400bd30 tx=0x7fe1b400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76519e6bf7d7b15 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.461+0000 7fe1baa00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe1a80b27e0 0x7fe1a80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.462+0000 7fe1af000640 1 -- 172.21.15.120:0/471547630 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4015070 con 0x55bc6f06d2f0 2024-05-14T09:27:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.462+0000 7fe1baa00640 1 -- 172.21.15.120:0/2888500066 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe1b00e2a80 con 0x7fe1c4106d70 2024-05-14T09:27:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.462+0000 7fe1af000640 1 -- 172.21.15.120:0/471547630 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1b400be20 con 0x55bc6f06d2f0 2024-05-14T09:27:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.462+0000 7fe1af000640 1 -- 172.21.15.120:0/471547630 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4010630 con 0x55bc6f06d2f0 2024-05-14T09:27:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.462+0000 7fe1c2800640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe1a80b27e0 0x7fe1a80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 -- 172.21.15.120:0/471547630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 msgr2=0x55bc6f438680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f438680 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400bd30 tx=0x7fe1b400f730 comp rx=0 tx=0).stop 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1c2800640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe1a80b27e0 0x7fe1a80b4cf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0319e0 tx=0x7fe1bc0318e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 -- 172.21.15.120:0/471547630 shutdown_connections 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0754d0 0x55bc6f43f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f438680 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/471547630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0961b0 0x55bc6f438100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 -- 172.21.15.120:0/471547630 >> 172.21.15.120:0/471547630 conn(0x55bc6f08a300 msgr2=0x55bc6f433a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 -- 172.21.15.120:0/471547630 shutdown_connections 2024-05-14T09:27:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.463+0000 7fe1cfa40740 1 -- 172.21.15.120:0/471547630 wait complete. 2024-05-14T09:27:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.464+0000 7fe1cfa40740 1 -- start start 2024-05-14T09:27:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.465+0000 7fe1cfa40740 1 Processor -- start 2024-05-14T09:27:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.465+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f441bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.465+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f442100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.465+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0961b0 0x55bc6f449060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.465+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bc6f43ffd0 con 0x55bc6f06d2f0 2024-05-14T09:27:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.465+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bc6f355660 con 0x55bc6f0754d0 2024-05-14T09:27:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.465+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc6f440150 con 0x55bc6f0961b0 2024-05-14T09:27:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1cfa40740 10 client.0 _ll_register_callbacks cb 0x55bc6f31f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f441bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f441bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58878/0 (socket says 172.21.15.120:58878) 2024-05-14T09:27:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 -- 172.21.15.120:0/206172215 learned_addr learned my addr 172.21.15.120:0/206172215 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1400640 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f442100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c2800640 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0961b0 0x55bc6f449060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 -- 172.21.15.120:0/206172215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0961b0 msgr2=0x55bc6f449060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0961b0 0x55bc6f449060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 -- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 msgr2=0x55bc6f442100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f442100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.466+0000 7fe1c1e00640 1 -- 172.21.15.120:0/206172215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6f17a620 con 0x55bc6f06d2f0 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.467+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f441bc0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400bac0 tx=0x7fe1b4010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b84d70e0eaa267 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.467+0000 7fe1a3400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.467+0000 7fe1a3400640 1 -- 172.21.15.120:0/206172215 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4015070 con 0x55bc6f06d2f0 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.467+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b400be20 con 0x55bc6f06d2f0 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.467+0000 7fe1a3400640 1 -- 172.21.15.120:0/206172215 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe1b40103d0 con 0x55bc6f06d2f0 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.468+0000 7fe1a3400640 1 -- 172.21.15.120:0/206172215 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe1b4010630 con 0x55bc6f06d2f0 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.468+0000 7fe1cfa40740 10 client.16131 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.468+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bc6f44bf90 con 0x55bc6f06d2f0 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.468+0000 7fe1a3400640 1 -- 172.21.15.120:0/206172215 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1b400be20 con 0x55bc6f06d2f0 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.468+0000 7fe1a3400640 1 -- 172.21.15.120:0/206172215 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fe1b4004c10 con 0x55bc6f06d2f0 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.469+0000 7fe1cfa40740 10 client.16131 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.469+0000 7fe1cfa40740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.469+0000 7fe1cfa40740 20 client.16131 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.469+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f054d80 0x55bc6f44f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.469+0000 7fe1cfa40740 4 client.16131 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.469+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc6f3aa160 con 0x55bc6f054d80 2024-05-14T09:27:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.469+0000 7fe1c1400640 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f054d80 0x55bc6f44f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.470+0000 7fe1c1400640 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f054d80 0x55bc6f44f4d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd5bbdfd4ec106ea server_cookie=a07bcd963dffe12a in_seq=0 out_seq=0 2024-05-14T09:27:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.470+0000 7fe1a3400640 10 client.16131 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.472+0000 7fe1a3400640 1 -- 172.21.15.120:0/206172215 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc6f3aa160 con 0x55bc6f054d80 2024-05-14T09:27:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.472+0000 7fe1a3400640 10 client.16131 handle_command_reply: tid=0 2024-05-14T09:27:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.472+0000 7fe1cfa40740 1 client.16131 shutdown 2024-05-14T09:27:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 msgr2=0x55bc6f441bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f441bc0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400bac0 tx=0x7fe1b4010a00 comp rx=0 tx=0).stop 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 shutdown_connections 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f054d80 0x55bc6f44f4d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f0961b0 0x55bc6f449060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f442100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/206172215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f06d2f0 0x55bc6f441bc0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1a3400640 0 client.16131 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 >> 172.21.15.120:0/206172215 conn(0x55bc6f08a300 msgr2=0x55bc6f4369a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 shutdown_connections 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.473+0000 7fe1cfa40740 1 -- 172.21.15.120:0/206172215 wait complete. 2024-05-14T09:27:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.474+0000 7fe1cfa40740 20 client.16131 trim_cache size 0 max 16384 2024-05-14T09:27:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.507+0000 7fe1cfa40740 1 Processor -- start 2024-05-14T09:27:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1cfa40740 1 -- start start 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f4386f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f448f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f441ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41aecb0 con 0x55bc6f054d80 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41b07f0 con 0x55bc6f0754d0 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41af380 con 0x55bc6f06d2f0 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.508+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f4386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f4386f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58884/0 (socket says 172.21.15.120:58884) 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2620132715 learned_addr learned my addr 172.21.15.120:0/2620132715 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1400640 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f448f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c2800640 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f441ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2620132715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 msgr2=0x55bc6f448f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f448f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2620132715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 msgr2=0x55bc6f441ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f441ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2620132715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc6f44faa0 con 0x55bc6f054d80 2024-05-14T09:27:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.509+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f4386f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4005c30 tx=0x7fe1b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bad0c088d648f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.510+0000 7fe1ae600640 1 -- 172.21.15.120:0/2620132715 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4015070 con 0x55bc6f054d80 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.510+0000 7fe1ae600640 1 -- 172.21.15.120:0/2620132715 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1b400be20 con 0x55bc6f054d80 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.510+0000 7fe1ae600640 1 -- 172.21.15.120:0/2620132715 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4011910 con 0x55bc6f054d80 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.511+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2620132715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 msgr2=0x55bc6f4386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.511+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f4386f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4005c30 tx=0x7fe1b400b960 comp rx=0 tx=0).stop 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2620132715 shutdown_connections 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f441ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f448f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2620132715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f4386f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2620132715 >> 172.21.15.120:0/2620132715 conn(0x55bc6f08a300 msgr2=0x55bc6f441790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2620132715 shutdown_connections 2024-05-14T09:27:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2620132715 wait complete. 2024-05-14T09:27:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.512+0000 7fe1cfa40740 1 -- start start 2024-05-14T09:27:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 1 Processor -- start 2024-05-14T09:27:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f448d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f445880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f445dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41b0120 con 0x55bc6f054d80 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41afa50 con 0x55bc6f0754d0 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41accb0 con 0x55bc6f06d2f0 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1cfa40740 10 client.0 _ll_register_callbacks cb 0x7fe1b400bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.513+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f448d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f448d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58896/0 (socket says 172.21.15.120:58896) 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2767893574 learned_addr learned my addr 172.21.15.120:0/2767893574 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1400640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f445880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c2800640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f445dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2767893574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 msgr2=0x55bc6f445880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f445880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 msgr2=0x55bc6f445dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f445dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 -- 172.21.15.120:0/2767893574 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6f4463b0 con 0x55bc6f054d80 2024-05-14T09:27:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c2800640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f445dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1c1e00640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f448d00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400bc50 tx=0x7fe1b4005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462cb2f1287e5b3e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.514+0000 7fe1a3400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.515+0000 7fe1a3400640 1 -- 172.21.15.120:0/2767893574 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4040060 con 0x55bc6f054d80 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.515+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b400be20 con 0x55bc6f054d80 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.515+0000 7fe1a3400640 1 -- 172.21.15.120:0/2767893574 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe1b4004860 con 0x55bc6f054d80 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.515+0000 7fe1a3400640 1 -- 172.21.15.120:0/2767893574 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe1b4015070 con 0x55bc6f054d80 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.515+0000 7fe1cfa40740 10 client.16137 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.515+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bc6f4b68c0 con 0x55bc6f054d80 2024-05-14T09:27:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1a3400640 1 -- 172.21.15.120:0/2767893574 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1b400be20 con 0x55bc6f054d80 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1a3400640 1 -- 172.21.15.120:0/2767893574 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fe1b40116b0 con 0x55bc6f054d80 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1cfa40740 10 client.16137 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1cfa40740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1cfa40740 20 client.16137 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f0961b0 0x55bc6f4b9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1cfa40740 4 client.16137 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.516+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc6f3a3fd0 con 0x55bc6f0961b0 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.517+0000 7fe1c1400640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f0961b0 0x55bc6f4b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.517+0000 7fe1c1400640 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f0961b0 0x55bc6f4b9070 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c15e221110b431e server_cookie=d6d198e059d47f3c in_seq=0 out_seq=0 2024-05-14T09:27:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.517+0000 7fe1a3400640 10 client.16137 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1a3400640 1 -- 172.21.15.120:0/2767893574 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc6f3a3fd0 con 0x55bc6f0961b0 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1a3400640 10 client.16137 handle_command_reply: tid=0 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 client.16137 shutdown 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 msgr2=0x55bc6f448d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f448d00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400bc50 tx=0x7fe1b4005700 comp rx=0 tx=0).stop 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 shutdown_connections 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bc6f0961b0 0x55bc6f4b9070 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bc6f0754d0 0x55bc6f445dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc6f06d2f0 0x55bc6f445880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 --2- 172.21.15.120:0/2767893574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bc6f054d80 0x55bc6f448d00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 >> 172.21.15.120:0/2767893574 conn(0x55bc6f08a300 msgr2=0x55bc6f436890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1a3400640 0 client.16137 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.561+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 shutdown_connections 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.562+0000 7fe1cfa40740 1 -- 172.21.15.120:0/2767893574 wait complete. 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.562+0000 7fe1cfa40740 20 client.16137 trim_cache size 0 max 16384 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.562+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe1a80b27e0 msgr2=0x7fe1a80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.562+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe1a80b27e0 0x7fe1a80b4cf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0319e0 tx=0x7fe1bc0318e0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.562+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c4106d70 msgr2=0x7fe1c419c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.562+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c4106d70 0x7fe1c419c980 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000e9f0 tx=0x7fe1b000edf0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.562+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 shutdown_connections 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.563+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe1a80b27e0 0x7fe1a80b4cf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.563+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1c41098e0 0x7fe1c41a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.563+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c4106d70 0x7fe1c419c980 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.563+0000 7fe1c8a00640 1 --2- 172.21.15.120:0/2888500066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1c4104380 0x7fe1c419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.563+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 >> 172.21.15.120:0/2888500066 conn(0x7fe1c40fdd40 msgr2=0x7fe1c4102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.563+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 shutdown_connections 2024-05-14T09:27:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:21.563+0000 7fe1c8a00640 1 -- 172.21.15.120:0/2888500066 wait complete. 2024-05-14T09:27:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:21 smithi120 ceph-mon[31085]: pgmap v670: 129 pgs: 129 active+clean; 856 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 30 op/s 2024-05-14T09:27:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:27:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:21 smithi152 ceph-mon[34868]: pgmap v670: 129 pgs: 129 active+clean; 856 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 30 op/s 2024-05-14T09:27:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:27:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:21 smithi175 ceph-mon[35353]: pgmap v670: 129 pgs: 129 active+clean; 856 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 30 op/s 2024-05-14T09:27:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:27:23.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:27:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:27:23.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:27:23.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:27:23.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:27:23.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:27:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:27:23.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:27:23.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:27:23.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:27:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:23 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi175 to 176.4M 2024-05-14T09:27:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:23 smithi120 ceph-mon[31085]: Unable to set osd_memory_target on smithi175 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:27:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:23 smithi120 ceph-mon[31085]: pgmap v671: 129 pgs: 129 active+clean; 868 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:27:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:23 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi175 to 176.4M 2024-05-14T09:27:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:23 smithi152 ceph-mon[34868]: Unable to set osd_memory_target on smithi175 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:27:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:23 smithi152 ceph-mon[34868]: pgmap v671: 129 pgs: 129 active+clean; 868 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:27:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:23 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi175 to 176.4M 2024-05-14T09:27:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:23 smithi175 ceph-mon[35353]: Unable to set osd_memory_target on smithi175 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:27:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:23 smithi175 ceph-mon[35353]: pgmap v671: 129 pgs: 129 active+clean; 868 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:27:26.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:25 smithi120 ceph-mon[31085]: pgmap v672: 129 pgs: 129 active+clean; 876 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 22 op/s 2024-05-14T09:27:26.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:25 smithi152 ceph-mon[34868]: pgmap v672: 129 pgs: 129 active+clean; 876 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 22 op/s 2024-05-14T09:27:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:25 smithi175 ceph-mon[35353]: pgmap v672: 129 pgs: 129 active+clean; 876 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 22 op/s 2024-05-14T09:27:28.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:27 smithi120 ceph-mon[31085]: pgmap v673: 129 pgs: 129 active+clean; 880 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 26 op/s 2024-05-14T09:27:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:27 smithi152 ceph-mon[34868]: pgmap v673: 129 pgs: 129 active+clean; 880 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 26 op/s 2024-05-14T09:27:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:27 smithi175 ceph-mon[35353]: pgmap v673: 129 pgs: 129 active+clean; 880 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 26 op/s 2024-05-14T09:27:30.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:29 smithi120 ceph-mon[31085]: pgmap v674: 129 pgs: 129 active+clean; 900 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:27:30.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:29 smithi152 ceph-mon[34868]: pgmap v674: 129 pgs: 129 active+clean; 900 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:27:30.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:29 smithi175 ceph-mon[35353]: pgmap v674: 129 pgs: 129 active+clean; 900 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 24 op/s 2024-05-14T09:27:32.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:31 smithi120 ceph-mon[31085]: pgmap v675: 129 pgs: 129 active+clean; 921 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 26 op/s 2024-05-14T09:27:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:31 smithi152 ceph-mon[34868]: pgmap v675: 129 pgs: 129 active+clean; 921 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 26 op/s 2024-05-14T09:27:32.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:31 smithi175 ceph-mon[35353]: pgmap v675: 129 pgs: 129 active+clean; 921 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 26 op/s 2024-05-14T09:27:33.603 INFO:teuthology.orchestra.run.smithi120.stderr:done in 181.46 s (drop tables 0.04 s, create tables 0.32 s, client-side generate 119.51 s, vacuum 35.49 s, primary keys 26.10 s). 2024-05-14T09:27:33.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-05-14T09:27:33.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:33 smithi120 ceph-mon[31085]: pgmap v676: 129 pgs: 129 active+clean; 941 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 26 op/s 2024-05-14T09:27:34.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:33 smithi152 ceph-mon[34868]: pgmap v676: 129 pgs: 129 active+clean; 941 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 26 op/s 2024-05-14T09:27:34.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:33 smithi175 ceph-mon[35353]: pgmap v676: 129 pgs: 129 active+clean; 941 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 26 op/s 2024-05-14T09:27:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:starting vacuum...end. 2024-05-14T09:27:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.852+0000 7f7296200640 1 -- 172.21.15.120:0/3345461359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288097c90 msgr2=0x7f72880980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.852+0000 7f7296200640 1 --2- 172.21.15.120:0/3345461359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288097c90 0x7f72880980a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f727c009900 tx=0x7f727c02a400 comp rx=0 tx=0).stop 2024-05-14T09:27:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.853+0000 7f7296200640 1 -- 172.21.15.120:0/3345461359 shutdown_connections 2024-05-14T09:27:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.853+0000 7f7296200640 1 --2- 172.21.15.120:0/3345461359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 0x7f728809edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.853+0000 7f7296200640 1 --2- 172.21.15.120:0/3345461359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288097c90 0x7f72880980a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.853+0000 7f7296200640 1 --2- 172.21.15.120:0/3345461359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7288096a50 0x7f7288097750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.853+0000 7f7296200640 1 -- 172.21.15.120:0/3345461359 >> 172.21.15.120:0/3345461359 conn(0x7f7288091c20 msgr2=0x7f72880940f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.855+0000 7f7296200640 1 -- 172.21.15.120:0/3345461359 shutdown_connections 2024-05-14T09:27:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.855+0000 7f7296200640 1 -- 172.21.15.120:0/3345461359 wait complete. 2024-05-14T09:27:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.857+0000 7f7296200640 1 Processor -- start 2024-05-14T09:27:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.857+0000 7f7296200640 1 -- start start 2024-05-14T09:27:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.857+0000 7f7296200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288096a50 0x7f7288008ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.857+0000 7f7296200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7288097c90 0x7f7288007180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.857+0000 7f7296200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 0x7f72880076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f7296200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f72880a23e0 con 0x7f728809c990 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f7296200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f72880a2260 con 0x7f7288097c90 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f7296200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72880a2560 con 0x7f7288096a50 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f7295800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 0x7f72880076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f7295800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 0x7f72880076c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39734/0 (socket says 172.21.15.120:39734) 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f7295800640 1 -- 172.21.15.120:0/1555097910 learned_addr learned my addr 172.21.15.120:0/1555097910 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f7294e00640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288096a50 0x7f7288008ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.858+0000 7f728fe00640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7288097c90 0x7f7288007180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f7295800640 1 -- 172.21.15.120:0/1555097910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288096a50 msgr2=0x7f7288008ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f7295800640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288096a50 0x7f7288008ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f7295800640 1 -- 172.21.15.120:0/1555097910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7288097c90 msgr2=0x7f7288007180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f7295800640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7288097c90 0x7f7288007180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f7295800640 1 -- 172.21.15.120:0/1555097910 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7288007df0 con 0x7f728809c990 2024-05-14T09:27:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f728fe00640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7288097c90 0x7f7288007180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f7294e00640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288096a50 0x7f7288008ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.859+0000 7f7295800640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 0x7f72880076c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f72900686c0 tx=0x7f729007b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.860+0000 7f728d600640 1 -- 172.21.15.120:0/1555097910 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290083070 con 0x7f728809c990 2024-05-14T09:27:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.860+0000 7f728d600640 1 -- 172.21.15.120:0/1555097910 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f729007be40 con 0x7f728809c990 2024-05-14T09:27:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.860+0000 7f728d600640 1 -- 172.21.15.120:0/1555097910 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729007f720 con 0x7f728809c990 2024-05-14T09:27:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.860+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72881370d0 con 0x7f728809c990 2024-05-14T09:27:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.860+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7288137540 con 0x7f728809c990 2024-05-14T09:27:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.868+0000 7f729e867740 1 Processor -- start 2024-05-14T09:27:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.870+0000 7f728d600640 1 -- 172.21.15.120:0/1555097910 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7290069810 con 0x7f728809c990 2024-05-14T09:27:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.870+0000 7f729e867740 1 -- start start 2024-05-14T09:27:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.871+0000 7f729e867740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3f31b0 0x55f63a79db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.871+0000 7f729e867740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3ca2f0 0x55f63a79e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.872+0000 7f729e867740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.872+0000 7f729e867740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f63a6f9550 con 0x55f63a3f31b0 2024-05-14T09:27:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.872+0000 7f729e867740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f63a69ebc0 con 0x55f63a3ca2f0 2024-05-14T09:27:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.872+0000 7f729e867740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f63a6f5510 con 0x55f63a3d24d0 2024-05-14T09:27:34.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.873+0000 7f728fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3f31b0 0x55f63a79db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.873+0000 7f728fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3f31b0 0x55f63a79db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39746/0 (socket says 172.21.15.120:39746) 2024-05-14T09:27:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.873+0000 7f728fe00640 1 -- 172.21.15.120:0/1744087189 learned_addr learned my addr 172.21.15.120:0/1744087189 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.873+0000 7f7294e00640 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3ca2f0 0x55f63a79e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.874+0000 7f728fe00640 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.875+0000 7f7294e00640 1 -- 172.21.15.120:0/1744087189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 msgr2=0x55f63a7a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.876+0000 7f7294e00640 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7a4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.876+0000 7f7294e00640 1 -- 172.21.15.120:0/1744087189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3f31b0 msgr2=0x55f63a79db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.876+0000 7f7294e00640 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3f31b0 0x55f63a79db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.876+0000 7f7294e00640 1 -- 172.21.15.120:0/1744087189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f63a40b210 con 0x55f63a3ca2f0 2024-05-14T09:27:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.876+0000 7f728fe00640 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3f31b0 0x55f63a79db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:27:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.876+0000 7f728d600640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72780b28b0 0x7f72780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.877+0000 7f728fe00640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72780b28b0 0x7f72780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.877+0000 7f728d600640 1 -- 172.21.15.120:0/1555097910 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f729014f5d0 con 0x7f728809c990 2024-05-14T09:27:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.878+0000 7f7294e00640 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3ca2f0 0x55f63a79e080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7288096320 tx=0x7f728400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e895199d87427f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.878+0000 7f728fe00640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72780b28b0 0x7f72780b4dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f727c005ab0 tx=0x7f727c005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.878+0000 7f7282000640 1 -- 172.21.15.120:0/1744087189 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7284005220 con 0x55f63a3ca2f0 2024-05-14T09:27:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.878+0000 7f7282000640 1 -- 172.21.15.120:0/1744087189 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7284004c30 con 0x55f63a3ca2f0 2024-05-14T09:27:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.879+0000 7f7282000640 1 -- 172.21.15.120:0/1744087189 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7284010650 con 0x55f63a3ca2f0 2024-05-14T09:27:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.879+0000 7f729e867740 1 -- 172.21.15.120:0/1744087189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3ca2f0 msgr2=0x55f63a79e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.879+0000 7f729e867740 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3ca2f0 0x55f63a79e080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7288096320 tx=0x7f728400e720 comp rx=0 tx=0).stop 2024-05-14T09:27:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.880+0000 7f729e867740 1 -- 172.21.15.120:0/1744087189 shutdown_connections 2024-05-14T09:27:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.880+0000 7f729e867740 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.880+0000 7f729e867740 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3ca2f0 0x55f63a79e080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.880+0000 7f729e867740 1 --2- 172.21.15.120:0/1744087189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3f31b0 0x55f63a79db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.880+0000 7f729e867740 1 -- 172.21.15.120:0/1744087189 >> 172.21.15.120:0/1744087189 conn(0x55f63a3e7300 msgr2=0x55f63a790c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.880+0000 7f729e867740 1 -- 172.21.15.120:0/1744087189 shutdown_connections 2024-05-14T09:27:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.880+0000 7f729e867740 1 -- 172.21.15.120:0/1744087189 wait complete. 2024-05-14T09:27:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.881+0000 7f729e867740 1 -- start start 2024-05-14T09:27:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.881+0000 7f729e867740 1 Processor -- start 2024-05-14T09:27:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f729e867740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f729e867740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3d24d0 0x55f63a7a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f729e867740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f729e867740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f63a7a5a20 con 0x55f63a3d24d0 2024-05-14T09:27:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f729e867740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f63a6b2660 con 0x55f63a3f31b0 2024-05-14T09:27:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f729e867740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f63a7a5ba0 con 0x55f63a3ca2f0 2024-05-14T09:27:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f729e867740 10 client.0 _ll_register_callbacks cb 0x55f63a67c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.882+0000 7f728fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3d24d0 0x55f63a7a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f7294e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f7294e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54916/0 (socket says 172.21.15.120:54916) 2024-05-14T09:27:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f7294e00640 1 -- 172.21.15.120:0/3918130283 learned_addr learned my addr 172.21.15.120:0/3918130283 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f728fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3d24d0 0x55f63a7a7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39754/0 (socket says 172.21.15.120:39754) 2024-05-14T09:27:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f7295800640 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f728fe00640 1 -- 172.21.15.120:0/3918130283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3ca2f0 msgr2=0x55f63a7a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f728fe00640 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f728fe00640 1 -- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 msgr2=0x55f63a7aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f728fe00640 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.883+0000 7f728fe00640 1 -- 172.21.15.120:0/3918130283 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f63a4d7620 con 0x55f63a3d24d0 2024-05-14T09:27:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.884+0000 7f728fe00640 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3d24d0 0x55f63a7a7ac0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f727c006010 tx=0x7f727c02a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3fec9e3e90e99e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.885+0000 7f7276a00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.885+0000 7f7276a00640 1 -- 172.21.15.120:0/3918130283 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c035040 con 0x55f63a3d24d0 2024-05-14T09:27:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.885+0000 7f7276a00640 1 -- 172.21.15.120:0/3918130283 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f727c031850 con 0x55f63a3d24d0 2024-05-14T09:27:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.886+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7284004c30 con 0x55f63a3d24d0 2024-05-14T09:27:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.886+0000 7f7276a00640 1 -- 172.21.15.120:0/3918130283 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f727c031a50 con 0x55f63a3d24d0 2024-05-14T09:27:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.886+0000 7f729e867740 10 client.16149 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.886+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f63a7b19c0 con 0x55f63a3d24d0 2024-05-14T09:27:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f7276a00640 1 -- 172.21.15.120:0/3918130283 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7284004c30 con 0x55f63a3d24d0 2024-05-14T09:27:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f7276a00640 1 -- 172.21.15.120:0/3918130283 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f727c03bc60 con 0x55f63a3d24d0 2024-05-14T09:27:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f729e867740 10 client.16149 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f729e867740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f729e867740 20 client.16149 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f729e867740 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3b1d80 0x55f63a7b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f729e867740 4 client.16149 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.887+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f63a707160 con 0x55f63a3b1d80 2024-05-14T09:27:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.888+0000 7f7294e00640 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3b1d80 0x55f63a7b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.889+0000 7f7276a00640 10 client.16149 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.889+0000 7f7294e00640 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3b1d80 0x55f63a7b5180 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea480a5596207faa server_cookie=571bfc79804a8792 in_seq=0 out_seq=0 2024-05-14T09:27:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.891+0000 7f7276a00640 1 -- 172.21.15.120:0/3918130283 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f63a707160 con 0x55f63a3b1d80 2024-05-14T09:27:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.891+0000 7f7276a00640 10 client.16149 handle_command_reply: tid=0 2024-05-14T09:27:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.891+0000 7f729e867740 1 client.16149 shutdown 2024-05-14T09:27:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3d24d0 msgr2=0x55f63a7a7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3d24d0 0x55f63a7a7ac0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f727c006010 tx=0x7f727c02a400 comp rx=0 tx=0).stop 2024-05-14T09:27:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 shutdown_connections 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3b1d80 0x55f63a7b5180 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3d24d0 0x55f63a7a7ac0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 --2- 172.21.15.120:0/3918130283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f7276a00640 0 client.16149 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 >> 172.21.15.120:0/3918130283 conn(0x55f63a3e7300 msgr2=0x55f63a793b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 shutdown_connections 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.892+0000 7f729e867740 1 -- 172.21.15.120:0/3918130283 wait complete. 2024-05-14T09:27:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.893+0000 7f729e867740 20 client.16149 trim_cache size 0 max 16384 2024-05-14T09:27:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.928+0000 7f729e867740 1 Processor -- start 2024-05-14T09:27:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.929+0000 7f729e867740 1 -- start start 2024-05-14T09:27:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f729e867740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f729e867740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f729e867740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f729e867740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f728813d590 con 0x55f63a3ca2f0 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f729e867740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f728813f0d0 con 0x55f63a3f31b0 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f729e867740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f728813dc60 con 0x55f63a3d24d0 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f7294e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f728fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f728fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54928/0 (socket says 172.21.15.120:54928) 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f7294e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39764/0 (socket says 172.21.15.120:39764) 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.930+0000 7f728fe00640 1 -- 172.21.15.120:0/3434029220 learned_addr learned my addr 172.21.15.120:0/3434029220 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f7295800640 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f728fe00640 1 -- 172.21.15.120:0/3434029220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 msgr2=0x55f63a7944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f728fe00640 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7944b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f728fe00640 1 -- 172.21.15.120:0/3434029220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 msgr2=0x55f63a7a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f728fe00640 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f728fe00640 1 -- 172.21.15.120:0/3434029220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f63a78c470 con 0x55f63a3d24d0 2024-05-14T09:27:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f7294e00640 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:27:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.931+0000 7f7295800640 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.932+0000 7f728fe00640 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f727c04b440 tx=0x7f727c005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80f9fedd35e20da server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.932+0000 7f7281600640 1 -- 172.21.15.120:0/3434029220 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c035070 con 0x55f63a3d24d0 2024-05-14T09:27:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.933+0000 7f7281600640 1 -- 172.21.15.120:0/3434029220 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f727c004280 con 0x55f63a3d24d0 2024-05-14T09:27:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.933+0000 7f7281600640 1 -- 172.21.15.120:0/3434029220 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c04c520 con 0x55f63a3d24d0 2024-05-14T09:27:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.934+0000 7f729e867740 1 -- 172.21.15.120:0/3434029220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 msgr2=0x55f63a7ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.934+0000 7f729e867740 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f727c04b440 tx=0x7f727c005720 comp rx=0 tx=0).stop 2024-05-14T09:27:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.934+0000 7f729e867740 1 -- 172.21.15.120:0/3434029220 shutdown_connections 2024-05-14T09:27:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.934+0000 7f729e867740 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a7944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.934+0000 7f729e867740 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.934+0000 7f729e867740 1 --2- 172.21.15.120:0/3434029220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.934+0000 7f729e867740 1 -- 172.21.15.120:0/3434029220 >> 172.21.15.120:0/3434029220 conn(0x55f63a3e7300 msgr2=0x55f63a7a5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.935+0000 7f729e867740 1 -- 172.21.15.120:0/3434029220 shutdown_connections 2024-05-14T09:27:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.935+0000 7f729e867740 1 -- 172.21.15.120:0/3434029220 wait complete. 2024-05-14T09:27:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.935+0000 7f729e867740 1 -- start start 2024-05-14T09:27:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.935+0000 7f729e867740 1 Processor -- start 2024-05-14T09:27:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.936+0000 7f729e867740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.936+0000 7f729e867740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.936+0000 7f729e867740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a81b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.936+0000 7f729e867740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f728813ea00 con 0x55f63a3ca2f0 2024-05-14T09:27:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.936+0000 7f729e867740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f728813e330 con 0x55f63a3f31b0 2024-05-14T09:27:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.936+0000 7f729e867740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f728813b590 con 0x55f63a3d24d0 2024-05-14T09:27:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.936+0000 7f729e867740 10 client.0 _ll_register_callbacks cb 0x7f727c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7294e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7294e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39772/0 (socket says 172.21.15.120:39772) 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7294e00640 1 -- 172.21.15.120:0/2491974527 learned_addr learned my addr 172.21.15.120:0/2491974527 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f728fe00640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7295800640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a81b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7294e00640 1 -- 172.21.15.120:0/2491974527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 msgr2=0x55f63a7ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7294e00640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7294e00640 1 -- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 msgr2=0x55f63a81b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.937+0000 7f7294e00640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a81b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.938+0000 7f7294e00640 1 -- 172.21.15.120:0/2491974527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f63a81bd90 con 0x55f63a3ca2f0 2024-05-14T09:27:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.938+0000 7f7295800640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a81b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.938+0000 7f7294e00640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7adcc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f728400f010 tx=0x7f728400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d047ed058317ba39 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.938+0000 7f7276a00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.938+0000 7f7276a00640 1 -- 172.21.15.120:0/2491974527 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728402b070 con 0x55f63a3ca2f0 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.939+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f727c004280 con 0x55f63a3ca2f0 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.939+0000 7f7276a00640 1 -- 172.21.15.120:0/2491974527 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7284027540 con 0x55f63a3ca2f0 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.939+0000 7f7276a00640 1 -- 172.21.15.120:0/2491974527 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7284035050 con 0x55f63a3ca2f0 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.939+0000 7f729e867740 10 client.16155 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.939+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f63a81d080 con 0x55f63a3ca2f0 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.940+0000 7f7276a00640 1 -- 172.21.15.120:0/2491974527 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f727c004280 con 0x55f63a3ca2f0 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.940+0000 7f7276a00640 1 -- 172.21.15.120:0/2491974527 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f7284030b30 con 0x55f63a3ca2f0 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.941+0000 7f729e867740 10 client.16155 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.941+0000 7f729e867740 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.941+0000 7f729e867740 20 client.16155 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.941+0000 7f729e867740 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3871c0 0x55f63a81f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.941+0000 7f729e867740 4 client.16155 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:27:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.941+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f63a700fd0 con 0x55f63a3871c0 2024-05-14T09:27:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.941+0000 7f728fe00640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3871c0 0x55f63a81f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.942+0000 7f728fe00640 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3871c0 0x55f63a81f760 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7239cf0119a516b3 server_cookie=f2767ba9378b4657 in_seq=0 out_seq=0 2024-05-14T09:27:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.942+0000 7f7276a00640 10 client.16155 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.993+0000 7f7276a00640 1 -- 172.21.15.120:0/2491974527 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f63a700fd0 con 0x55f63a3871c0 2024-05-14T09:27:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.993+0000 7f7276a00640 10 client.16155 handle_command_reply: tid=0 2024-05-14T09:27:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.994+0000 7f729e867740 1 client.16155 shutdown 2024-05-14T09:27:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.994+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 msgr2=0x55f63a7adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.994+0000 7f729e867740 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7adcc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f728400f010 tx=0x7f728400ce80 comp rx=0 tx=0).stop 2024-05-14T09:27:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 shutdown_connections 2024-05-14T09:27:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f63a3871c0 0x55f63a81f760 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f63a3f31b0 0x55f63a81b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f63a3d24d0 0x55f63a7ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 --2- 172.21.15.120:0/2491974527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f63a3ca2f0 0x55f63a7adcc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f7276a00640 0 client.16155 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 >> 172.21.15.120:0/2491974527 conn(0x55f63a3e7300 msgr2=0x55f63a7a69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 shutdown_connections 2024-05-14T09:27:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 1 -- 172.21.15.120:0/2491974527 wait complete. 2024-05-14T09:27:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.995+0000 7f729e867740 20 client.16155 trim_cache size 0 max 16384 2024-05-14T09:27:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:27:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:27:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:27:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72780b28b0 msgr2=0x7f72780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72780b28b0 0x7f72780b4dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f727c005ab0 tx=0x7f727c005d50 comp rx=0 tx=0).stop 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 msgr2=0x7f72880076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 0x7f72880076c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f72900686c0 tx=0x7f729007b6a0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 shutdown_connections 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f72780b28b0 0x7f72780b4dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728809c990 0x7f72880076c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7288097c90 0x7f7288007180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 --2- 172.21.15.120:0/1555097910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7288096a50 0x7f7288008ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 >> 172.21.15.120:0/1555097910 conn(0x7f7288091c20 msgr2=0x7f7288098970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.997+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 shutdown_connections 2024-05-14T09:27:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:34.998+0000 7f7296200640 1 -- 172.21.15.120:0/1555097910 wait complete. 2024-05-14T09:27:36.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:35 smithi120 ceph-mon[31085]: pgmap v677: 129 pgs: 129 active+clean; 949 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:27:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:35 smithi152 ceph-mon[34868]: pgmap v677: 129 pgs: 129 active+clean; 949 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:27:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:35 smithi175 ceph-mon[35353]: pgmap v677: 129 pgs: 129 active+clean; 949 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T09:27:37.039 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:27:37.485 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:27:37.980 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:37 smithi120 ceph-mon[31085]: pgmap v678: 129 pgs: 129 active+clean; 961 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 33 op/s 2024-05-14T09:27:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:37 smithi152 ceph-mon[34868]: pgmap v678: 129 pgs: 129 active+clean; 961 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 33 op/s 2024-05-14T09:27:38.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:37 smithi175 ceph-mon[35353]: pgmap v678: 129 pgs: 129 active+clean; 961 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 33 op/s 2024-05-14T09:27:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 5.0 s, 574.4 tps, lat 153.897 ms stddev 251.231 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.055+0000 7fa2ae600700 1 -- 172.21.15.120:0/1175450816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 msgr2=0x7fa2a81058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.055+0000 7fa2ae600700 1 --2- 172.21.15.120:0/1175450816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 0x7fa2a81058b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa29800fb60 tx=0x7fa29800fe70 comp rx=0 tx=0).stop 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.055+0000 7fa2ae600700 1 -- 172.21.15.120:0/1175450816 shutdown_connections 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.055+0000 7fa2ae600700 1 --2- 172.21.15.120:0/1175450816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 0x7fa2a8110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.055+0000 7fa2ae600700 1 --2- 172.21.15.120:0/1175450816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 0x7fa2a81058b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.055+0000 7fa2ae600700 1 --2- 172.21.15.120:0/1175450816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2a8105df0 0x7fa2a810e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.055+0000 7fa2ae600700 1 -- 172.21.15.120:0/1175450816 >> 172.21.15.120:0/1175450816 conn(0x7fa2a80fedc0 msgr2=0x7fa2a81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:40.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.056+0000 7fa2ae600700 1 -- 172.21.15.120:0/1175450816 shutdown_connections 2024-05-14T09:27:40.057 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:39 smithi120 ceph-mon[31085]: pgmap v679: 129 pgs: 129 active+clean; 945 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 35 op/s 2024-05-14T09:27:40.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.056+0000 7fa2ae600700 1 -- 172.21.15.120:0/1175450816 wait complete. 2024-05-14T09:27:40.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.058+0000 7fa2ae600700 1 Processor -- start 2024-05-14T09:27:40.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.058+0000 7fa2ae600700 1 -- start start 2024-05-14T09:27:40.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.059+0000 7fa2ae600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 0x7fa2a819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.059+0000 7fa2ae600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2a8105df0 0x7fa2a819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.059+0000 7fa2ae600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 0x7fa2a81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.059+0000 7fa2ae600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a81121f0 con 0x7fa2a81054a0 2024-05-14T09:27:40.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.060+0000 7fa2a7400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 0x7fa2a819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.060+0000 7fa2a7e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 0x7fa2a81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.060+0000 7fa2a7e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 0x7fa2a81989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:39524/0 (socket says 172.21.15.120:39524) 2024-05-14T09:27:40.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.060+0000 7fa2a7e00700 1 -- 172.21.15.120:0/2082243553 learned_addr learned my addr 172.21.15.120:0/2082243553 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:40.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.061+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2a8105df0 0x7fa2a819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.061+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a8112070 con 0x7fa2a8105df0 2024-05-14T09:27:40.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.061+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a8112370 con 0x7fa2a810e910 2024-05-14T09:27:40.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.062+0000 7fa2a7e00700 1 -- 172.21.15.120:0/2082243553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2a8105df0 msgr2=0x7fa2a819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.062+0000 7fa2a7e00700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2a8105df0 0x7fa2a819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.062+0000 7fa2a7e00700 1 -- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 msgr2=0x7fa2a819e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.062+0000 7fa2a7e00700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 0x7fa2a819e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.062+0000 7fa2a7e00700 1 -- 172.21.15.120:0/2082243553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a81990a0 con 0x7fa2a810e910 2024-05-14T09:27:40.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.063+0000 7fa2a7e00700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 0x7fa2a81989f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c110 tx=0x7fa2a000c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:40.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.064+0000 7fa29fe00700 1 -- 172.21.15.120:0/2082243553 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00092e0 con 0x7fa2a810e910 2024-05-14T09:27:40.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.064+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a8199330 con 0x7fa2a810e910 2024-05-14T09:27:40.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.064+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a81a5660 con 0x7fa2a810e910 2024-05-14T09:27:40.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.064+0000 7fa29fe00700 1 -- 172.21.15.120:0/2082243553 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2a0004bb0 con 0x7fa2a810e910 2024-05-14T09:27:40.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.064+0000 7fa29fe00700 1 -- 172.21.15.120:0/2082243553 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0007ac0 con 0x7fa2a810e910 2024-05-14T09:27:40.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.070+0000 7fa2bd06db80 1 Processor -- start 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.072+0000 7fa29fe00700 1 -- 172.21.15.120:0/2082243553 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa2a001a020 con 0x7fa2a810e910 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.072+0000 7fa2bd06db80 1 -- start start 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.073+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f85af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.073+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85b4a0 0x55f17f85f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.073+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85fba0 0x55f17f85ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.073+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f17f774a20 con 0x55f17f6d4e40 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.073+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f17f712760 con 0x55f17f85b4a0 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.073+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f17f7709e0 con 0x55f17f85fba0 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.074+0000 7fa2a6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f85af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.075+0000 7fa2a6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f85af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46482/0 (socket says 172.21.15.120:46482) 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.075+0000 7fa2a6a00700 1 -- 172.21.15.120:0/2078433140 learned_addr learned my addr 172.21.15.120:0/2078433140 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.075+0000 7fa2a7400700 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85b4a0 0x55f17f85f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.075+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85fba0 0x55f17f85ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.075+0000 7fa29fe00700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa28c0b2980 0x7fa28c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.076+0000 7fa2a6a00700 1 -- 172.21.15.120:0/2078433140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85fba0 msgr2=0x55f17f85ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.076+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85fba0 0x55f17f85ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.076+0000 7fa2a6a00700 1 -- 172.21.15.120:0/2078433140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85b4a0 msgr2=0x55f17f85f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.076+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85b4a0 0x55f17f85f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.076+0000 7fa2a6a00700 1 -- 172.21.15.120:0/2078433140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17f6c18d0 con 0x55f17f6d4e40 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.076+0000 7fa29fe00700 1 -- 172.21.15.120:0/2082243553 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa2a00e1f70 con 0x7fa2a810e910 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.076+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f85af60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa294005950 tx=0x7fa2940058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deffa76e489766ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:40.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.077+0000 7fa29cc00700 1 -- 172.21.15.120:0/2078433140 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294013120 con 0x55f17f6d4e40 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.077+0000 7fa29cc00700 1 -- 172.21.15.120:0/2078433140 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa294013e50 con 0x55f17f6d4e40 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.077+0000 7fa29cc00700 1 -- 172.21.15.120:0/2078433140 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294010e60 con 0x55f17f6d4e40 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.078+0000 7fa2a7e00700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa28c0b2980 0x7fa28c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.078+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2078433140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 msgr2=0x55f17f85af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.078+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f85af60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa294005950 tx=0x7fa2940058e0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.079+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2078433140 shutdown_connections 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.079+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85fba0 0x55f17f85ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.079+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f85af60 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.079+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2078433140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85b4a0 0x55f17f85f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.079+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2078433140 >> 172.21.15.120:0/2078433140 conn(0x55f17f719f70 msgr2=0x55f17f84d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:40.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.080+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2078433140 shutdown_connections 2024-05-14T09:27:40.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.080+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2078433140 wait complete. 2024-05-14T09:27:40.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.081+0000 7fa2a7e00700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa28c0b2980 0x7fa28c0b4e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00a8e90 tx=0x7fa2a0009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.081+0000 7fa2bd06db80 1 -- start start 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.082+0000 7fa2bd06db80 1 Processor -- start 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.083+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.083+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f864740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.083+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f864e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.083+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f17f852690 con 0x55f17f6d4e40 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.083+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f17f6dab20 con 0x55f17f85fba0 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.083+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f17f852810 con 0x55f17f85b4a0 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.084+0000 7fa2a6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.084+0000 7fa2bd06db80 10 client.0 _ll_register_callbacks cb 0x55f17f71bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.084+0000 7fa2a7400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f864740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.084+0000 7fa2a7400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f864740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:39544/0 (socket says 172.21.15.120:39544) 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.084+0000 7fa2a7400700 1 -- 172.21.15.120:0/2407967732 learned_addr learned my addr 172.21.15.120:0/2407967732 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.085+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f864e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.085+0000 7fa2a6a00700 1 -- 172.21.15.120:0/2407967732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 msgr2=0x55f17f864740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.085+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f864740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.085+0000 7fa2a6a00700 1 -- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 msgr2=0x55f17f864e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.085+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f864e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.085+0000 7fa2a6a00700 1 -- 172.21.15.120:0/2407967732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17f73a420 con 0x55f17f6d4e40 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.086+0000 7fa291600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.086+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8673c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa294009410 tx=0x7fa294009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdc0afa473cde55 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.087+0000 7fa291600700 1 -- 172.21.15.120:0/2407967732 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294005020 con 0x55f17f6d4e40 2024-05-14T09:27:40.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.087+0000 7fa291600700 1 -- 172.21.15.120:0/2407967732 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa2940051c0 con 0x55f17f6d4e40 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.087+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa294013e50 con 0x55f17f6d4e40 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.088+0000 7fa291600700 1 -- 172.21.15.120:0/2407967732 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa2940053e0 con 0x55f17f6d4e40 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.088+0000 7fa2bd06db80 10 client.16167 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.088+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f17f85aa90 con 0x55f17f6d4e40 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.088+0000 7fa291600700 1 -- 172.21.15.120:0/2407967732 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa294013e50 con 0x55f17f6d4e40 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.088+0000 7fa291600700 1 -- 172.21.15.120:0/2407967732 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fa29402c030 con 0x55f17f6d4e40 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.089+0000 7fa2bd06db80 10 client.16167 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.089+0000 7fa2bd06db80 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.089+0000 7fa2bd06db80 20 client.16167 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.089+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f87d120 0x55f17f87f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.089+0000 7fa2bd06db80 4 client.16167 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.089+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f17f81f1c0 con 0x55f17f87d120 2024-05-14T09:27:40.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.090+0000 7fa2a7400700 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f87d120 0x55f17f87f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.091+0000 7fa2a7400700 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f87d120 0x55f17f87f540 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ea16a887475db server_cookie=62d634e7aeff6f0b in_seq=0 out_seq=0 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.091+0000 7fa291600700 10 client.16167 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.093+0000 7fa291600700 1 -- 172.21.15.120:0/2407967732 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f17f81f1c0 con 0x55f17f87d120 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.093+0000 7fa291600700 10 client.16167 handle_command_reply: tid=0 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.094+0000 7fa2bd06db80 1 client.16167 shutdown 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.094+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 msgr2=0x55f17f8673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.094+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8673c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa294009410 tx=0x7fa294009cb0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 shutdown_connections 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f87d120 0x55f17f87f540 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f864e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8673c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/2407967732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f864740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 >> 172.21.15.120:0/2407967732 conn(0x55f17f719f70 msgr2=0x55f17f8514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:40.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa291600700 0 client.16167 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:40.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 shutdown_connections 2024-05-14T09:27:40.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.096+0000 7fa2bd06db80 1 -- 172.21.15.120:0/2407967732 wait complete. 2024-05-14T09:27:40.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.097+0000 7fa2bd06db80 20 client.16167 trim_cache size 0 max 16384 2024-05-14T09:27:40.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.134+0000 7fa2bd06db80 1 Processor -- start 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.134+0000 7fa2bd06db80 1 -- start start 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.135+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.135+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f851bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.135+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f860fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.135+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa28800ec70 con 0x55f17f6d4e40 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.135+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa2880107b0 con 0x55f17f85fba0 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.135+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa28800f340 con 0x55f17f85b4a0 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.136+0000 7fa2a7400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f851bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.136+0000 7fa2a7400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f851bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:39550/0 (socket says 172.21.15.120:39550) 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.136+0000 7fa2a7400700 1 -- 172.21.15.120:0/1372292709 learned_addr learned my addr 172.21.15.120:0/1372292709 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:40.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.137+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f860fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.137+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.137+0000 7fa2a6a00700 1 -- 172.21.15.120:0/1372292709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 msgr2=0x55f17f851bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.137+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f851bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.137+0000 7fa2a6a00700 1 -- 172.21.15.120:0/1372292709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 msgr2=0x55f17f860fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.137+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f860fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.137+0000 7fa2a6a00700 1 -- 172.21.15.120:0/1372292709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17f8453e0 con 0x55f17f6d4e40 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.138+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8646c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa294009930 tx=0x7fa294009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7ee776a1263ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.138+0000 7fa293e00700 1 -- 172.21.15.120:0/1372292709 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294010640 con 0x55f17f6d4e40 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.138+0000 7fa293e00700 1 -- 172.21.15.120:0/1372292709 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa294005580 con 0x55f17f6d4e40 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.138+0000 7fa293e00700 1 -- 172.21.15.120:0/1372292709 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294010640 con 0x55f17f6d4e40 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.139+0000 7fa2bd06db80 1 -- 172.21.15.120:0/1372292709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 msgr2=0x55f17f8646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.139+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8646c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa294009930 tx=0x7fa294009780 comp rx=0 tx=0).stop 2024-05-14T09:27:40.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.140+0000 7fa2bd06db80 1 -- 172.21.15.120:0/1372292709 shutdown_connections 2024-05-14T09:27:40.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.140+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f860fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.140+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f6d4e40 0x55f17f8646c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.140+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/1372292709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f85b4a0 0x55f17f851bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.140+0000 7fa2bd06db80 1 -- 172.21.15.120:0/1372292709 >> 172.21.15.120:0/1372292709 conn(0x55f17f719f70 msgr2=0x55f17f8514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:40.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.140+0000 7fa2bd06db80 1 -- 172.21.15.120:0/1372292709 shutdown_connections 2024-05-14T09:27:40.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.140+0000 7fa2bd06db80 1 -- 172.21.15.120:0/1372292709 wait complete. 2024-05-14T09:27:40.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.141+0000 7fa2bd06db80 1 -- start start 2024-05-14T09:27:40.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.141+0000 7fa2bd06db80 1 Processor -- start 2024-05-14T09:27:40.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.142+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f85b4a0 0x55f17f859690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.142+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f859bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.142+0000 7fa2bd06db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f854ab0 0x55f17f854f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.142+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa2880100e0 con 0x55f17f85b4a0 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.142+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa28800fa10 con 0x55f17f85fba0 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.142+0000 7fa2bd06db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa28800cc30 con 0x55f17f854ab0 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.142+0000 7fa2bd06db80 10 client.0 _ll_register_callbacks cb 0x55f17f71bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.143+0000 7fa2a6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f85b4a0 0x55f17f859690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.143+0000 7fa2a6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f85b4a0 0x55f17f859690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46512/0 (socket says 172.21.15.120:46512) 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.143+0000 7fa2a6a00700 1 -- 172.21.15.120:0/40006182 learned_addr learned my addr 172.21.15.120:0/40006182 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.143+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f854ab0 0x55f17f854f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.144+0000 7fa2a7400700 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f859bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.144+0000 7fa2a6a00700 1 -- 172.21.15.120:0/40006182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f854ab0 msgr2=0x55f17f854f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.144+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f854ab0 0x55f17f854f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.144+0000 7fa2a6a00700 1 -- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 msgr2=0x55f17f859bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.144+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f859bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.144+0000 7fa2a6a00700 1 -- 172.21.15.120:0/40006182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17f855720 con 0x55f17f85b4a0 2024-05-14T09:27:40.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.145+0000 7fa2a6a00700 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f85b4a0 0x55f17f859690 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa294005950 tx=0x7fa294011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa27caae0c3a5c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:40.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.145+0000 7fa291600700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:40.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.145+0000 7fa291600700 1 -- 172.21.15.120:0/40006182 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294020e20 con 0x55f17f85b4a0 2024-05-14T09:27:40.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.145+0000 7fa291600700 1 -- 172.21.15.120:0/40006182 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa2940109f0 con 0x55f17f85b4a0 2024-05-14T09:27:40.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.146+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa294005580 con 0x55f17f85b4a0 2024-05-14T09:27:40.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.146+0000 7fa291600700 1 -- 172.21.15.120:0/40006182 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa29404d050 con 0x55f17f85b4a0 2024-05-14T09:27:40.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.146+0000 7fa2bd06db80 10 client.16173 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:40.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.147+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f17f8e75f0 con 0x55f17f85b4a0 2024-05-14T09:27:40.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa291600700 1 -- 172.21.15.120:0/40006182 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa294005580 con 0x55f17f85b4a0 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa291600700 1 -- 172.21.15.120:0/40006182 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fa29402c070 con 0x55f17f85b4a0 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa2bd06db80 10 client.16173 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa2bd06db80 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa2bd06db80 20 client.16173 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f8e7a90 0x55f17f8e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa2bd06db80 4 client.16173 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.148+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f17f782400 con 0x55f17f8e7a90 2024-05-14T09:27:40.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.149+0000 7fa2a7400700 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f8e7a90 0x55f17f8e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:40.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.151+0000 7fa2a7400700 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f8e7a90 0x55f17f8e9eb0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8708c2e4846c943 server_cookie=8e0c549edee03036 in_seq=0 out_seq=0 2024-05-14T09:27:40.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.151+0000 7fa291600700 10 client.16173 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:40.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.151+0000 7fa291600700 1 -- 172.21.15.120:0/40006182 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f17f782400 con 0x55f17f8e7a90 2024-05-14T09:27:40.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.151+0000 7fa291600700 10 client.16173 handle_command_reply: tid=0 2024-05-14T09:27:40.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.151+0000 7fa2bd06db80 1 client.16173 shutdown 2024-05-14T09:27:40.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f85b4a0 msgr2=0x55f17f859690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f85b4a0 0x55f17f859690 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa294005950 tx=0x7fa294011f20 comp rx=0 tx=0).stop 2024-05-14T09:27:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 shutdown_connections 2024-05-14T09:27:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f17f8e7a90 0x55f17f8e9eb0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f17f854ab0 0x55f17f854f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f17f85b4a0 0x55f17f859690 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 --2- 172.21.15.120:0/40006182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f17f85fba0 0x55f17f859bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 >> 172.21.15.120:0/40006182 conn(0x55f17f719f70 msgr2=0x55f17f85f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.152+0000 7fa291600700 0 client.16173 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:40.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.153+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 shutdown_connections 2024-05-14T09:27:40.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.153+0000 7fa2bd06db80 1 -- 172.21.15.120:0/40006182 wait complete. 2024-05-14T09:27:40.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.153+0000 7fa2bd06db80 20 client.16173 trim_cache size 0 max 16384 2024-05-14T09:27:40.153 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:27:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-05-14T09:27:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-05-14T09:27:40.153 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:27:40.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.154+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa28c0b2980 msgr2=0x7fa28c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.154+0000 7fa2ae600700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa28c0b2980 0x7fa28c0b4e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00a8e90 tx=0x7fa2a0009040 comp rx=0 tx=0).stop 2024-05-14T09:27:40.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.154+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 msgr2=0x7fa2a81989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:40.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.154+0000 7fa2ae600700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 0x7fa2a81989f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c110 tx=0x7fa2a000c420 comp rx=0 tx=0).stop 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.155+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 shutdown_connections 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.155+0000 7fa2ae600700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa28c0b2980 0x7fa28c0b4e90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.155+0000 7fa2ae600700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a810e910 0x7fa2a81989f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.155+0000 7fa2ae600700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2a81054a0 0x7fa2a819e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.155+0000 7fa2ae600700 1 --2- 172.21.15.120:0/2082243553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2a8105df0 0x7fa2a819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.155+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 >> 172.21.15.120:0/2082243553 conn(0x7fa2a80fedc0 msgr2=0x7fa2a80ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.156+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 shutdown_connections 2024-05-14T09:27:40.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:40.156+0000 7fa2ae600700 1 -- 172.21.15.120:0/2082243553 wait complete. 2024-05-14T09:27:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:39 smithi152 ceph-mon[34868]: pgmap v679: 129 pgs: 129 active+clean; 945 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 35 op/s 2024-05-14T09:27:40.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:39 smithi175 ceph-mon[35353]: pgmap v679: 129 pgs: 129 active+clean; 945 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 35 op/s 2024-05-14T09:27:41.387 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T09:27:41.388 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:27:42.027 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:27:42.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:41 smithi120 ceph-mon[31085]: pgmap v680: 129 pgs: 129 active+clean; 926 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 61 op/s 2024-05-14T09:27:42.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:41 smithi152 ceph-mon[34868]: pgmap v680: 129 pgs: 129 active+clean; 926 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 61 op/s 2024-05-14T09:27:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:41 smithi175 ceph-mon[35353]: pgmap v680: 129 pgs: 129 active+clean; 926 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 61 op/s 2024-05-14T09:27:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:43 smithi120 ceph-mon[31085]: pgmap v681: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.2 MiB/s wr, 99 op/s 2024-05-14T09:27:44.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:43 smithi152 ceph-mon[34868]: pgmap v681: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.2 MiB/s wr, 99 op/s 2024-05-14T09:27:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:43 smithi175 ceph-mon[35353]: pgmap v681: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.2 MiB/s wr, 99 op/s 2024-05-14T09:27:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 10.0 s, 1138.2 tps, lat 87.905 ms stddev 30.395 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 -- 172.21.15.120:0/436456576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0107c10 msgr2=0x7ff8e0108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 --2- 172.21.15.120:0/436456576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0107c10 0x7ff8e0108020 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009920 tx=0x7ff8cc009c30 comp rx=0 tx=0).stop 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 -- 172.21.15.120:0/436456576 shutdown_connections 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 --2- 172.21.15.120:0/436456576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 0x7ff8e01036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 --2- 172.21.15.120:0/436456576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e0108560 0x7ff8e010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 --2- 172.21.15.120:0/436456576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0107c10 0x7ff8e0108020 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 -- 172.21.15.120:0/436456576 >> 172.21.15.120:0/436456576 conn(0x7ff8e0078ac0 msgr2=0x7ff8e0078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 -- 172.21.15.120:0/436456576 shutdown_connections 2024-05-14T09:27:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.670+0000 7ff8df200700 1 -- 172.21.15.120:0/436456576 wait complete. 2024-05-14T09:27:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.671+0000 7ff8df200700 1 Processor -- start 2024-05-14T09:27:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.672+0000 7ff8df200700 1 -- start start 2024-05-14T09:27:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.672+0000 7ff8df200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 0x7ff8e019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8df200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e0107c10 0x7ff8e019d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8df200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0108560 0x7ff8e01a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8df200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0113070 con 0x7ff8e0108560 2024-05-14T09:27:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8df200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0112ef0 con 0x7ff8e01032e0 2024-05-14T09:27:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8df200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e01131f0 con 0x7ff8e0107c10 2024-05-14T09:27:44.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8dde00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 0x7ff8e019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:44.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8dde00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 0x7ff8e019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:36244/0 (socket says 172.21.15.120:36244) 2024-05-14T09:27:44.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8dde00700 1 -- 172.21.15.120:0/3115975886 learned_addr learned my addr 172.21.15.120:0/3115975886 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.673+0000 7ff8dd400700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e0107c10 0x7ff8e019d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.674+0000 7ff8de800700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0108560 0x7ff8e01a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.675+0000 7ff8dde00700 1 -- 172.21.15.120:0/3115975886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e0107c10 msgr2=0x7ff8e019d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.675+0000 7ff8dde00700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e0107c10 0x7ff8e019d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.675+0000 7ff8dde00700 1 -- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0108560 msgr2=0x7ff8e01a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.675+0000 7ff8dde00700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0108560 0x7ff8e01a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.675+0000 7ff8dde00700 1 -- 172.21.15.120:0/3115975886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e01a1d90 con 0x7ff8e01032e0 2024-05-14T09:27:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.675+0000 7ff8dd400700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e0107c10 0x7ff8e019d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.675+0000 7ff8dde00700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 0x7ff8e019cec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d980 tx=0x7ff8d000dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.676+0000 7ff8d6a00700 1 -- 172.21.15.120:0/3115975886 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0016070 con 0x7ff8e01032e0 2024-05-14T09:27:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.676+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e01a2080 con 0x7ff8e01032e0 2024-05-14T09:27:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.676+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e01a99a0 con 0x7ff8e01032e0 2024-05-14T09:27:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.676+0000 7ff8d6a00700 1 -- 172.21.15.120:0/3115975886 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8d000de60 con 0x7ff8e01032e0 2024-05-14T09:27:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.676+0000 7ff8d6a00700 1 -- 172.21.15.120:0/3115975886 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000f3c0 con 0x7ff8e01032e0 2024-05-14T09:27:44.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.678+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c0005330 con 0x7ff8e01032e0 2024-05-14T09:27:44.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.682+0000 7ff8d6a00700 1 -- 172.21.15.120:0/3115975886 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff8d0019070 con 0x7ff8e01032e0 2024-05-14T09:27:44.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.684+0000 7ff8d6a00700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff8c40b2900 0x7ff8c40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:44.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.684+0000 7ff8d6a00700 1 -- 172.21.15.120:0/3115975886 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff8d00e20b0 con 0x7ff8e01032e0 2024-05-14T09:27:44.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.684+0000 7ff8dd400700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff8c40b2900 0x7ff8c40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:44.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.685+0000 7ff8dd400700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff8c40b2900 0x7ff8c40b4e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff8e01096b0 tx=0x7ff8cc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:44.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:44.690+0000 7ff8d6a00700 1 -- 172.21.15.120:0/3115975886 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff8d00a99d0 con 0x7ff8e01032e0 2024-05-14T09:27:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.129+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8c0005620 con 0x7ff8e01032e0 2024-05-14T09:27:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.131+0000 7ff8d6a00700 1 -- 172.21.15.120:0/3115975886 <== mon.2 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11957 (secure 0 0 0) 0x7ff8d00a92d0 con 0x7ff8e01032e0 2024-05-14T09:27:45.133 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:27:45.133 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:27:17.097227+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[24469,34388,34409,34427,24454]},"id":1}]} 2024-05-14T09:27:45.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.135+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff8c40b2900 msgr2=0x7ff8c40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:45.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.135+0000 7ff8df200700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff8c40b2900 0x7ff8c40b4e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff8e01096b0 tx=0x7ff8cc019040 comp rx=0 tx=0).stop 2024-05-14T09:27:45.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.135+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 msgr2=0x7ff8e019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.135+0000 7ff8df200700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 0x7ff8e019cec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d980 tx=0x7ff8d000dd40 comp rx=0 tx=0).stop 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.136+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 shutdown_connections 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.136+0000 7ff8df200700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff8c40b2900 0x7ff8c40b4e10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.136+0000 7ff8df200700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8e01032e0 0x7ff8e019cec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.136+0000 7ff8df200700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8e0108560 0x7ff8e01a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.136+0000 7ff8df200700 1 --2- 172.21.15.120:0/3115975886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e0107c10 0x7ff8e019d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.136+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 >> 172.21.15.120:0/3115975886 conn(0x7ff8e0078ac0 msgr2=0x7ff8e00ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.137+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 shutdown_connections 2024-05-14T09:27:45.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:45.137+0000 7ff8df200700 1 -- 172.21.15.120:0/3115975886 wait complete. 2024-05-14T09:27:45.139 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 39 2024-05-14T09:27:46.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T09:27:46.130 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:45 smithi120 ceph-mon[31085]: pgmap v682: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.6 MiB/s wr, 97 op/s 2024-05-14T09:27:46.130 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:45 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3115975886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:27:46.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:45 smithi152 ceph-mon[34868]: pgmap v682: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.6 MiB/s wr, 97 op/s 2024-05-14T09:27:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:45 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3115975886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:27:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:45 smithi175 ceph-mon[35353]: pgmap v682: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.6 MiB/s wr, 97 op/s 2024-05-14T09:27:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:45 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3115975886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:27:46.629 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:27:48.073 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:47 smithi120 ceph-mon[31085]: pgmap v683: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 106 op/s 2024-05-14T09:27:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:47 smithi152 ceph-mon[34868]: pgmap v683: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 106 op/s 2024-05-14T09:27:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:47 smithi175 ceph-mon[35353]: pgmap v683: 129 pgs: 129 active+clean; 934 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 106 op/s 2024-05-14T09:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 -- 172.21.15.120:0/3861132494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264104ea0 msgr2=0x7f82641052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 --2- 172.21.15.120:0/3861132494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264104ea0 0x7f82641052b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8250009900 tx=0x7f825002a400 comp rx=0 tx=0).stop 2024-05-14T09:27:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 -- 172.21.15.120:0/3861132494 shutdown_connections 2024-05-14T09:27:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 --2- 172.21.15.120:0/3861132494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8264109ba0 0x7f826410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 --2- 172.21.15.120:0/3861132494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264104ea0 0x7f82641052b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 --2- 172.21.15.120:0/3861132494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8264103c60 0x7f8264104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 -- 172.21.15.120:0/3861132494 >> 172.21.15.120:0/3861132494 conn(0x7f82640fee50 msgr2=0x7f8264101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.336+0000 7f8269c00640 1 -- 172.21.15.120:0/3861132494 shutdown_connections 2024-05-14T09:27:48.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.337+0000 7f8269c00640 1 -- 172.21.15.120:0/3861132494 wait complete. 2024-05-14T09:27:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.339+0000 7f8269c00640 1 Processor -- start 2024-05-14T09:27:48.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.341+0000 7f8269c00640 1 -- start start 2024-05-14T09:27:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.341+0000 7f8269c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264103c60 0x7f8264198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.341+0000 7f8269c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8264104ea0 0x7f82641985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.341+0000 7f8269c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8264109ba0 0x7f826419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.341+0000 7f8269c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f826410f610 con 0x7f8264109ba0 2024-05-14T09:27:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.341+0000 7f8269c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f826410f490 con 0x7f8264103c60 2024-05-14T09:27:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.341+0000 7f8269c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f826410f790 con 0x7f8264104ea0 2024-05-14T09:27:48.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.342+0000 7f8263400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8264109ba0 0x7f826419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.342+0000 7f8263400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8264109ba0 0x7f826419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52228/0 (socket says 172.21.15.120:52228) 2024-05-14T09:27:48.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.342+0000 7f8263400640 1 -- 172.21.15.120:0/3983418231 learned_addr learned my addr 172.21.15.120:0/3983418231 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:48.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.342+0000 7f8262a00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264103c60 0x7f8264198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.343+0000 7f8262a00640 1 -- 172.21.15.120:0/3983418231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8264104ea0 msgr2=0x7f82641985d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T09:27:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.343+0000 7f8262a00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8264104ea0 0x7f82641985d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.343+0000 7f8262a00640 1 -- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8264109ba0 msgr2=0x7f826419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.343+0000 7f8262a00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8264109ba0 0x7f826419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.343+0000 7f8262a00640 1 -- 172.21.15.120:0/3983418231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826419fbd0 con 0x7f8264103c60 2024-05-14T09:27:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.343+0000 7f8262a00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264103c60 0x7f8264198090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8264103530 tx=0x7f825400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.344+0000 7f825b400640 1 -- 172.21.15.120:0/3983418231 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825400cc40 con 0x7f8264103c60 2024-05-14T09:27:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.344+0000 7f825b400640 1 -- 172.21.15.120:0/3983418231 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f825400cde0 con 0x7f8264103c60 2024-05-14T09:27:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.344+0000 7f825b400640 1 -- 172.21.15.120:0/3983418231 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254003e10 con 0x7f8264103c60 2024-05-14T09:27:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.344+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826419fec0 con 0x7f8264103c60 2024-05-14T09:27:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.344+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82641a03c0 con 0x7f8264103c60 2024-05-14T09:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.354+0000 7f825b400640 1 -- 172.21.15.120:0/3983418231 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8254018430 con 0x7f8264103c60 2024-05-14T09:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.355+0000 7f8270b94740 1 Processor -- start 2024-05-14T09:27:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.356+0000 7f8270b94740 1 -- start start 2024-05-14T09:27:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.357+0000 7f8270b94740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd904100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.357+0000 7f8270b94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5392f0 0x563dcd904680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.358+0000 7f8270b94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5414d0 0x563dcd90b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.358+0000 7f8270b94740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563dcd868550 con 0x563dcd5621b0 2024-05-14T09:27:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.358+0000 7f8270b94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563dcd80dbc0 con 0x563dcd5414d0 2024-05-14T09:27:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.358+0000 7f8270b94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563dcd864510 con 0x563dcd5392f0 2024-05-14T09:27:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.358+0000 7f8263400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd904100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.359+0000 7f825b400640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82480b2860 0x7f82480b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.359+0000 7f8262000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5414d0 0x563dcd90b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.359+0000 7f8262000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5414d0 0x563dcd90b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37528/0 (socket says 172.21.15.120:37528) 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.359+0000 7f8262000640 1 -- 172.21.15.120:0/1702669195 learned_addr learned my addr 172.21.15.120:0/1702669195 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.359+0000 7f825b400640 1 -- 172.21.15.120:0/3983418231 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f82540e29d0 con 0x7f8264103c60 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.360+0000 7f8262a00640 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5392f0 0x563dcd904680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.360+0000 7f8262000640 1 -- 172.21.15.120:0/1702669195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5392f0 msgr2=0x563dcd904680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.360+0000 7f8262000640 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5392f0 0x563dcd904680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.360+0000 7f8262000640 1 -- 172.21.15.120:0/1702669195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 msgr2=0x563dcd904100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.361+0000 7f8262000640 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd904100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.361+0000 7f8262000640 1 -- 172.21.15.120:0/1702669195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dcd57a210 con 0x563dcd5414d0 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.361+0000 7f8263400640 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd904100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.361+0000 7f8263400640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82480b2860 0x7f82480b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.361+0000 7f8262000640 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5414d0 0x563dcd90b580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8250005ab0 tx=0x7f8250031500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac4990e3f26b4bd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.362+0000 7f824fe00640 1 -- 172.21.15.120:0/1702669195 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825003f070 con 0x563dcd5414d0 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.362+0000 7f8263400640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82480b2860 0x7f82480b4d70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f825c009fd0 tx=0x7f825c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.362+0000 7f824fe00640 1 -- 172.21.15.120:0/1702669195 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8250004040 con 0x563dcd5414d0 2024-05-14T09:27:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.362+0000 7f824fe00640 1 -- 172.21.15.120:0/1702669195 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250035030 con 0x563dcd5414d0 2024-05-14T09:27:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.363+0000 7f8270b94740 1 -- 172.21.15.120:0/1702669195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5414d0 msgr2=0x563dcd90b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.363+0000 7f8270b94740 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5414d0 0x563dcd90b580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8250005ab0 tx=0x7f8250031500 comp rx=0 tx=0).stop 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.363+0000 7f8270b94740 1 -- 172.21.15.120:0/1702669195 shutdown_connections 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.363+0000 7f8270b94740 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5414d0 0x563dcd90b580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.363+0000 7f8270b94740 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5392f0 0x563dcd904680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.363+0000 7f8270b94740 1 --2- 172.21.15.120:0/1702669195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd904100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.363+0000 7f8270b94740 1 -- 172.21.15.120:0/1702669195 >> 172.21.15.120:0/1702669195 conn(0x563dcd556300 msgr2=0x563dcd8ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.364+0000 7f8270b94740 1 -- 172.21.15.120:0/1702669195 shutdown_connections 2024-05-14T09:27:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.364+0000 7f8270b94740 1 -- 172.21.15.120:0/1702669195 wait complete. 2024-05-14T09:27:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.364+0000 7f8270b94740 1 -- start start 2024-05-14T09:27:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.365+0000 7f8270b94740 1 Processor -- start 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.365+0000 7f8270b94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5392f0 0x563dcd90db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.365+0000 7f8270b94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd90e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.365+0000 7f8270b94740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd915010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.366+0000 7f8262a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5392f0 0x563dcd90db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.366+0000 7f8262a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5392f0 0x563dcd90db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37530/0 (socket says 172.21.15.120:37530) 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.366+0000 7f8262a00640 1 -- 172.21.15.120:0/2889338384 learned_addr learned my addr 172.21.15.120:0/2889338384 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.366+0000 7f8263400640 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd915010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.366+0000 7f8262000640 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd90e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.366+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563dcd90bf70 con 0x563dcd5621b0 2024-05-14T09:27:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.367+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563dcd821660 con 0x563dcd5392f0 2024-05-14T09:27:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.367+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563dcd90c0f0 con 0x563dcd5414d0 2024-05-14T09:27:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.367+0000 7f8270b94740 10 client.0 _ll_register_callbacks cb 0x563dcd7eb400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f8262a00640 1 -- 172.21.15.120:0/2889338384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 msgr2=0x563dcd90e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f8262a00640 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd90e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f8262a00640 1 -- 172.21.15.120:0/2889338384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 msgr2=0x563dcd915010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f8262a00640 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd915010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f8262a00640 1 -- 172.21.15.120:0/2889338384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dcd646620 con 0x563dcd5392f0 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8250004040 con 0x563dcd5392f0 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f8262a00640 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5392f0 0x563dcd90db70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82540a6ec0 tx=0x7f82540a9820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4301432503ec62e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f824cc00640 10 client.35663 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f824cc00640 1 -- 172.21.15.120:0/2889338384 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82540ae000 con 0x563dcd5392f0 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.368+0000 7f824cc00640 1 -- 172.21.15.120:0/2889338384 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f82540a90c0 con 0x563dcd5392f0 2024-05-14T09:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.369+0000 7f824cc00640 1 -- 172.21.15.120:0/2889338384 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f82540b2ab0 con 0x563dcd5392f0 2024-05-14T09:27:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.369+0000 7f8270b94740 10 client.35663 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.369+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({fsmap=39}) -- 0x563dcd917f30 con 0x563dcd5392f0 2024-05-14T09:27:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.369+0000 7f824cc00640 1 -- 172.21.15.120:0/2889338384 <== mon.2 v2:172.21.15.152:3300/0 4 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f82540a55c0 con 0x563dcd5392f0 2024-05-14T09:27:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.369+0000 7f8270b94740 10 client.35663 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.370+0000 7f8270b94740 10 client.35663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.370+0000 7f8270b94740 20 client.35663 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.370+0000 7f8270b94740 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd520d80 0x563dcd91b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.370+0000 7f8270b94740 4 client.35663 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.370+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dcd876160 con 0x563dcd520d80 2024-05-14T09:27:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.371+0000 7f8262000640 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd520d80 0x563dcd91b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.373+0000 7f824cc00640 10 client.35663 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.373+0000 7f8262000640 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd520d80 0x563dcd91b4d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0816df4a0b67df server_cookie=1b8b5d59470e2647 in_seq=0 out_seq=0 2024-05-14T09:27:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.374+0000 7f824cc00640 1 -- 172.21.15.120:0/2889338384 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563dcd876160 con 0x563dcd520d80 2024-05-14T09:27:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.374+0000 7f824cc00640 10 client.35663 handle_command_reply: tid=0 2024-05-14T09:27:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.374+0000 7f8270b94740 1 client.35663 shutdown 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5392f0 msgr2=0x563dcd90db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5392f0 0x563dcd90db70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82540a6ec0 tx=0x7f82540a9820 comp rx=0 tx=0).stop 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 shutdown_connections 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd520d80 0x563dcd91b4d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5621b0 0x563dcd915010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f824cc00640 0 client.35663 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd90e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 --2- 172.21.15.120:0/2889338384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5392f0 0x563dcd90db70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.375+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 >> 172.21.15.120:0/2889338384 conn(0x563dcd556300 msgr2=0x563dcd9029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.376+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 shutdown_connections 2024-05-14T09:27:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.376+0000 7f8270b94740 1 -- 172.21.15.120:0/2889338384 wait complete. 2024-05-14T09:27:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.376+0000 7f8270b94740 20 client.35663 trim_cache size 0 max 16384 2024-05-14T09:27:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.415+0000 7f8270b94740 1 Processor -- start 2024-05-14T09:27:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.415+0000 7f8270b94740 1 -- start start 2024-05-14T09:27:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.415+0000 7f8270b94740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd90de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8270b94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd902890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8270b94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd902dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8270b94740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f82641bb8f0 con 0x563dcd5392f0 2024-05-14T09:27:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8270b94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82641bd430 con 0x563dcd5621b0 2024-05-14T09:27:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8270b94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82641bbfc0 con 0x563dcd5414d0 2024-05-14T09:27:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8263400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd902dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8263400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd902dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37536/0 (socket says 172.21.15.120:37536) 2024-05-14T09:27:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8263400640 1 -- 172.21.15.120:0/2660124088 learned_addr learned my addr 172.21.15.120:0/2660124088 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.416+0000 7f8262a00640 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd90de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.417+0000 7f8262000640 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd902890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.417+0000 7f8262a00640 1 -- 172.21.15.120:0/2660124088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 msgr2=0x563dcd902890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.417+0000 7f8262a00640 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd902890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.417+0000 7f8262a00640 1 -- 172.21.15.120:0/2660124088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 msgr2=0x563dcd902dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.417+0000 7f8262a00640 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd902dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.417+0000 7f8262a00640 1 -- 172.21.15.120:0/2660124088 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dcd8fb280 con 0x563dcd5392f0 2024-05-14T09:27:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.418+0000 7f8262a00640 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd90de50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f82540a9950 tx=0x7f82540cc070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f05a6f4dc14107b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.418+0000 7f824f400640 1 -- 172.21.15.120:0/2660124088 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82540ae000 con 0x563dcd5392f0 2024-05-14T09:27:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.419+0000 7f824f400640 1 -- 172.21.15.120:0/2660124088 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8250004040 con 0x563dcd5392f0 2024-05-14T09:27:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.419+0000 7f824f400640 1 -- 172.21.15.120:0/2660124088 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82540a5b10 con 0x563dcd5392f0 2024-05-14T09:27:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.420+0000 7f8270b94740 1 -- 172.21.15.120:0/2660124088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 msgr2=0x563dcd90de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.420+0000 7f8270b94740 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd90de50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f82540a9950 tx=0x7f82540cc070 comp rx=0 tx=0).stop 2024-05-14T09:27:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.421+0000 7f8270b94740 1 -- 172.21.15.120:0/2660124088 shutdown_connections 2024-05-14T09:27:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.421+0000 7f8270b94740 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd902dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.421+0000 7f8270b94740 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd902890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.421+0000 7f8270b94740 1 --2- 172.21.15.120:0/2660124088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd90de50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.421+0000 7f8270b94740 1 -- 172.21.15.120:0/2660124088 >> 172.21.15.120:0/2660124088 conn(0x563dcd556300 msgr2=0x563dcd90d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.422+0000 7f8270b94740 1 -- 172.21.15.120:0/2660124088 shutdown_connections 2024-05-14T09:27:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.422+0000 7f8270b94740 1 -- 172.21.15.120:0/2660124088 wait complete. 2024-05-14T09:27:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.422+0000 7f8270b94740 1 -- start start 2024-05-14T09:27:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.422+0000 7f8270b94740 1 Processor -- start 2024-05-14T09:27:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.423+0000 7f8270b94740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd9811c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.423+0000 7f8270b94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd912ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.423+0000 7f8270b94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd913100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.423+0000 7f8270b94740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f82641bcd60 con 0x563dcd5392f0 2024-05-14T09:27:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.423+0000 7f8270b94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82641bc690 con 0x563dcd5621b0 2024-05-14T09:27:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.423+0000 7f8270b94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82641b98f0 con 0x563dcd5414d0 2024-05-14T09:27:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.424+0000 7f8262a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd9811c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.424+0000 7f8263400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd913100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.424+0000 7f8263400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd913100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37542/0 (socket says 172.21.15.120:37542) 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.424+0000 7f8263400640 1 -- 172.21.15.120:0/1735071156 learned_addr learned my addr 172.21.15.120:0/1735071156 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.424+0000 7f8270b94740 10 client.0 _ll_register_callbacks cb 0x7f82540a9aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.425+0000 7f8262000640 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd912ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.425+0000 7f8263400640 1 -- 172.21.15.120:0/1735071156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 msgr2=0x563dcd912ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.425+0000 7f8263400640 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd912ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.425+0000 7f8263400640 1 -- 172.21.15.120:0/1735071156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 msgr2=0x563dcd9811c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.425+0000 7f8263400640 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd9811c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.425+0000 7f8263400640 1 -- 172.21.15.120:0/1735071156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dcd90c230 con 0x563dcd5621b0 2024-05-14T09:27:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.425+0000 7f8263400640 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd913100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f825c0123a0 tx=0x7f825c009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd36b5b130cd2916 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.426+0000 7f824cc00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:27:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.426+0000 7f824cc00640 1 -- 172.21.15.120:0/1735071156 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c02f060 con 0x563dcd5621b0 2024-05-14T09:27:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.426+0000 7f824cc00640 1 -- 172.21.15.120:0/1735071156 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f825c010430 con 0x563dcd5621b0 2024-05-14T09:27:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.426+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8250004040 con 0x563dcd5621b0 2024-05-14T09:27:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.427+0000 7f824cc00640 1 -- 172.21.15.120:0/1735071156 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f825c010630 con 0x563dcd5621b0 2024-05-14T09:27:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.427+0000 7f8270b94740 10 client.35669 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.427+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563dcd914960 con 0x563dcd5621b0 2024-05-14T09:27:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.427+0000 7f824cc00640 1 -- 172.21.15.120:0/1735071156 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8250004040 con 0x563dcd5621b0 2024-05-14T09:27:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f824cc00640 1 -- 172.21.15.120:0/1735071156 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f825c029070 con 0x563dcd5621b0 2024-05-14T09:27:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f8270b94740 10 client.35669 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f8270b94740 10 client.35669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:27:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f8270b94740 20 client.35669 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f8270b94740 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd4f61c0 0x563dcd996f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f8270b94740 4 client.35669 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:27:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563dcd86ffd0 con 0x563dcd4f61c0 2024-05-14T09:27:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.429+0000 7f8262a00640 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd4f61c0 0x563dcd996f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.430+0000 7f824cc00640 10 client.35669 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.430+0000 7f8262a00640 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd4f61c0 0x563dcd996f10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473ecfba3c758971 server_cookie=cc00a5b8cd00b293 in_seq=0 out_seq=0 2024-05-14T09:27:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.455+0000 7f824cc00640 1 -- 172.21.15.120:0/1735071156 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563dcd86ffd0 con 0x563dcd4f61c0 2024-05-14T09:27:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.455+0000 7f824cc00640 10 client.35669 handle_command_reply: tid=0 2024-05-14T09:27:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.455+0000 7f8270b94740 1 client.35669 shutdown 2024-05-14T09:27:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.456+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 msgr2=0x563dcd913100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.456+0000 7f8270b94740 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd913100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f825c0123a0 tx=0x7f825c009500 comp rx=0 tx=0).stop 2024-05-14T09:27:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 shutdown_connections 2024-05-14T09:27:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563dcd4f61c0 0x563dcd996f10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563dcd5621b0 0x563dcd913100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563dcd5414d0 0x563dcd912ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 --2- 172.21.15.120:0/1735071156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563dcd5392f0 0x563dcd9811c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 >> 172.21.15.120:0/1735071156 conn(0x563dcd556300 msgr2=0x563dcd902890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f824cc00640 0 client.35669 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 shutdown_connections 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 1 -- 172.21.15.120:0/1735071156 wait complete. 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.457+0000 7f8270b94740 20 client.35669 trim_cache size 0 max 16384 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:27:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:27:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:27:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:27:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.458+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82480b2860 msgr2=0x7f82480b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.458+0000 7f8269c00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82480b2860 0x7f82480b4d70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f825c009fd0 tx=0x7f825c004a40 comp rx=0 tx=0).stop 2024-05-14T09:27:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.458+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264103c60 msgr2=0x7f8264198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.458+0000 7f8269c00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264103c60 0x7f8264198090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8264103530 tx=0x7f825400ee50 comp rx=0 tx=0).stop 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 shutdown_connections 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82480b2860 0x7f82480b4d70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8264109ba0 0x7f826419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8264104ea0 0x7f82641985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 --2- 172.21.15.120:0/3983418231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8264103c60 0x7f8264198090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 >> 172.21.15.120:0/3983418231 conn(0x7f82640fee50 msgr2=0x7f8264101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 shutdown_connections 2024-05-14T09:27:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:27:48.459+0000 7f8269c00640 1 -- 172.21.15.120:0/3983418231 wait complete. 2024-05-14T09:27:49.333 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 15.0 s, 856.0 tps, lat 115.944 ms stddev 42.527 2024-05-14T09:27:49.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.582+0000 7f5b18600700 1 -- 172.21.15.120:0/4224644289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 msgr2=0x7f5b10109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.582+0000 7f5b18600700 1 --2- 172.21.15.120:0/4224644289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 0x7f5b10109330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0098f0 tx=0x7f5afc009c00 comp rx=0 tx=0).stop 2024-05-14T09:27:49.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.584+0000 7f5b18600700 1 -- 172.21.15.120:0/4224644289 shutdown_connections 2024-05-14T09:27:49.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.584+0000 7f5b18600700 1 --2- 172.21.15.120:0/4224644289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b10109870 0x7f5b101111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.584+0000 7f5b18600700 1 --2- 172.21.15.120:0/4224644289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b101045f0 0x7f5b10104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.584+0000 7f5b18600700 1 --2- 172.21.15.120:0/4224644289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 0x7f5b10109330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.584+0000 7f5b18600700 1 -- 172.21.15.120:0/4224644289 >> 172.21.15.120:0/4224644289 conn(0x7f5b10100040 msgr2=0x7f5b10102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:49.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.585+0000 7f5b18600700 1 -- 172.21.15.120:0/4224644289 shutdown_connections 2024-05-14T09:27:49.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.585+0000 7f5b18600700 1 -- 172.21.15.120:0/4224644289 wait complete. 2024-05-14T09:27:49.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.589+0000 7f5b18600700 1 Processor -- start 2024-05-14T09:27:49.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.590+0000 7f5b18600700 1 -- start start 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b18600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b101045f0 0x7f5b101a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b18600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 0x7f5b101a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b18600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b10109870 0x7f5b101ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b18600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10114330 con 0x7f5b10109870 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b18600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101141b0 con 0x7f5b10108f20 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b18600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101144b0 con 0x7f5b101045f0 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b101045f0 0x7f5b101a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b101045f0 0x7f5b101a2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43400/0 (socket says 172.21.15.120:43400) 2024-05-14T09:27:49.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.591+0000 7f5b15c00700 1 -- 172.21.15.120:0/1750569053 learned_addr learned my addr 172.21.15.120:0/1750569053 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:49.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b15200700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 0x7f5b101a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b16600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b10109870 0x7f5b101ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b15c00700 1 -- 172.21.15.120:0/1750569053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 msgr2=0x7f5b101a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b15c00700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 0x7f5b101a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b15c00700 1 -- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b10109870 msgr2=0x7f5b101ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b15c00700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b10109870 0x7f5b101ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b15c00700 1 -- 172.21.15.120:0/1750569053 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1006d1e0 con 0x7f5b101045f0 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.592+0000 7f5b16600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b10109870 0x7f5b101ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.593+0000 7f5b15c00700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b101045f0 0x7f5b101a2010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e9c0 tx=0x7f5b0400ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.593+0000 7f5b0e000700 1 -- 172.21.15.120:0/1750569053 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400cbd0 con 0x7f5b101045f0 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.593+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1006d4d0 con 0x7f5b101045f0 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.593+0000 7f5b0e000700 1 -- 172.21.15.120:0/1750569053 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b0400cd70 con 0x7f5b101045f0 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.593+0000 7f5b0e000700 1 -- 172.21.15.120:0/1750569053 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04005590 con 0x7f5b101045f0 2024-05-14T09:27:49.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.593+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1006da30 con 0x7f5b101045f0 2024-05-14T09:27:49.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.598+0000 7f5b0e000700 1 -- 172.21.15.120:0/1750569053 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5b04021440 con 0x7f5b101045f0 2024-05-14T09:27:49.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.600+0000 7f5b0e000700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5af80b2a80 0x7f5af80b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.601+0000 7f5b0e000700 1 -- 172.21.15.120:0/1750569053 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5b04005330 con 0x7f5b101045f0 2024-05-14T09:27:49.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.601+0000 7f5b15200700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5af80b2a80 0x7f5af80b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.603+0000 7f5b15200700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5af80b2a80 0x7f5af80b4f90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009810 tx=0x7f5afc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:49.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.607+0000 7f5b27140b80 1 Processor -- start 2024-05-14T09:27:49.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.608+0000 7f5b27140b80 1 -- start start 2024-05-14T09:27:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.609+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.609+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b4824b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.609+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b482e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.609+0000 7f5b27140b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55df7b3a4a20 con 0x55df7b4829f0 2024-05-14T09:27:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.609+0000 7f5b27140b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df7b342760 con 0x55df7b304e40 2024-05-14T09:27:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.609+0000 7f5b27140b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df7b3a09e0 con 0x55df7b488830 2024-05-14T09:27:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.610+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.610+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4882f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37566/0 (socket says 172.21.15.120:37566) 2024-05-14T09:27:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.610+0000 7f5b15c00700 1 -- 172.21.15.120:0/4022076640 learned_addr learned my addr 172.21.15.120:0/4022076640 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.610+0000 7f5b15c00700 1 -- 172.21.15.120:0/4022076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 msgr2=0x55df7b4824b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:27:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.610+0000 7f5b15c00700 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b4824b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.610+0000 7f5b15c00700 1 -- 172.21.15.120:0/4022076640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 msgr2=0x55df7b482e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.611+0000 7f5b16600700 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b482e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.611+0000 7f5b15c00700 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b482e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.611+0000 7f5b15c00700 1 -- 172.21.15.120:0/4022076640 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7b2f18d0 con 0x55df7b304e40 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.611+0000 7f5b15c00700 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4882f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b040a6b50 tx=0x7f5b040a9050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d03efc3e6d4c4baa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.612+0000 7f5b02a00700 1 -- 172.21.15.120:0/4022076640 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b040a9fe0 con 0x55df7b304e40 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.612+0000 7f5b02a00700 1 -- 172.21.15.120:0/4022076640 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b0408fe50 con 0x55df7b304e40 2024-05-14T09:27:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.612+0000 7f5b02a00700 1 -- 172.21.15.120:0/4022076640 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b040cc0e0 con 0x55df7b304e40 2024-05-14T09:27:49.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.613+0000 7f5b27140b80 1 -- 172.21.15.120:0/4022076640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 msgr2=0x55df7b4882f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.613+0000 7f5b27140b80 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4882f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b040a6b50 tx=0x7f5b040a9050 comp rx=0 tx=0).stop 2024-05-14T09:27:49.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.614+0000 7f5b27140b80 1 -- 172.21.15.120:0/4022076640 shutdown_connections 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.614+0000 7f5b27140b80 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4882f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.614+0000 7f5b27140b80 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b482e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.614+0000 7f5b27140b80 1 --2- 172.21.15.120:0/4022076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b4824b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.614+0000 7f5b27140b80 1 -- 172.21.15.120:0/4022076640 >> 172.21.15.120:0/4022076640 conn(0x55df7b349f70 msgr2=0x55df7b47d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.615+0000 7f5b27140b80 1 -- 172.21.15.120:0/4022076640 shutdown_connections 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.615+0000 7f5b27140b80 1 -- 172.21.15.120:0/4022076640 wait complete. 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.616+0000 7f5b27140b80 1 -- start start 2024-05-14T09:27:49.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.616+0000 7f5b27140b80 1 Processor -- start 2024-05-14T09:27:49.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.617+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b48bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.617+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b4829f0 0x55df7b48c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.617+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b48ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.617+0000 7f5b27140b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55df7b48f310 con 0x55df7b304e40 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.617+0000 7f5b27140b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df7b30ab20 con 0x55df7b4829f0 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.617+0000 7f5b27140b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df7b48f490 con 0x55df7b488830 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.617+0000 7f5b27140b80 10 client.0 _ll_register_callbacks cb 0x55df7b34bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.618+0000 7f5b15200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b4829f0 0x55df7b48c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.618+0000 7f5b15200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b4829f0 0x55df7b48c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37578/0 (socket says 172.21.15.120:37578) 2024-05-14T09:27:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.618+0000 7f5b15200700 1 -- 172.21.15.120:0/319240893 learned_addr learned my addr 172.21.15.120:0/319240893 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.619+0000 7f5b15c00700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b48bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.619+0000 7f5b16600700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b48ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.619+0000 7f5b15200700 1 -- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 msgr2=0x55df7b48ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.619+0000 7f5b15200700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b48ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.619+0000 7f5b15200700 1 -- 172.21.15.120:0/319240893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 msgr2=0x55df7b48bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.619+0000 7f5b15200700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b48bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.619+0000 7f5b15200700 1 -- 172.21.15.120:0/319240893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7b36a420 con 0x55df7b4829f0 2024-05-14T09:27:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.620+0000 7f5b15c00700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b48bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:49.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.620+0000 7f5b15200700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b4829f0 0x55df7b48c510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009680 tx=0x7f5afc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c25fdc0dbd53dc45 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:49.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.620+0000 7f5af7400700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:27:49.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.621+0000 7f5af7400700 1 -- 172.21.15.120:0/319240893 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc032060 con 0x55df7b4829f0 2024-05-14T09:27:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.622+0000 7f5af7400700 1 -- 172.21.15.120:0/319240893 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5afc0048e0 con 0x55df7b4829f0 2024-05-14T09:27:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.622+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b0408fe50 con 0x55df7b4829f0 2024-05-14T09:27:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.622+0000 7f5af7400700 1 -- 172.21.15.120:0/319240893 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5afc00fe90 con 0x55df7b4829f0 2024-05-14T09:27:49.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.622+0000 7f5b27140b80 10 client.35681 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:49.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.622+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55df7b499e40 con 0x55df7b4829f0 2024-05-14T09:27:49.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.624+0000 7f5af7400700 1 -- 172.21.15.120:0/319240893 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b0408fe50 con 0x55df7b4829f0 2024-05-14T09:27:49.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.624+0000 7f5af7400700 1 -- 172.21.15.120:0/319240893 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5afc00bb40 con 0x55df7b4829f0 2024-05-14T09:27:49.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.625+0000 7f5b27140b80 10 client.35681 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:49.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.625+0000 7f5b27140b80 10 client.35681 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:27:49.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.625+0000 7f5b27140b80 20 client.35681 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:49.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.625+0000 7f5b27140b80 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b49c3d0 0x55df7b49e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.625+0000 7f5b27140b80 4 client.35681 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:49.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.625+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df7b44f1c0 con 0x55df7b49c3d0 2024-05-14T09:27:49.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.626+0000 7f5b15c00700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b49c3d0 0x55df7b49e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.628+0000 7f5b15c00700 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b49c3d0 0x55df7b49e7f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=187bbface6db49c6 server_cookie=c85ac937df393031 in_seq=0 out_seq=0 2024-05-14T09:27:49.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.628+0000 7f5af7400700 10 client.35681 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:27:49.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.629+0000 7f5af7400700 1 -- 172.21.15.120:0/319240893 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55df7b44f1c0 con 0x55df7b49c3d0 2024-05-14T09:27:49.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.629+0000 7f5af7400700 10 client.35681 handle_command_reply: tid=0 2024-05-14T09:27:49.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.630+0000 7f5b27140b80 1 client.35681 shutdown 2024-05-14T09:27:49.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b4829f0 msgr2=0x55df7b48c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b4829f0 0x55df7b48c510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009680 tx=0x7f5afc009260 comp rx=0 tx=0).stop 2024-05-14T09:27:49.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 shutdown_connections 2024-05-14T09:27:49.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b49c3d0 0x55df7b49e7f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b48ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b48bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 --2- 172.21.15.120:0/319240893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b4829f0 0x55df7b48c510 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.632+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 >> 172.21.15.120:0/319240893 conn(0x55df7b349f70 msgr2=0x55df7b4814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:49.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.633+0000 7f5af7400700 0 client.35681 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:27:49.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.633+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 shutdown_connections 2024-05-14T09:27:49.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.633+0000 7f5b27140b80 1 -- 172.21.15.120:0/319240893 wait complete. 2024-05-14T09:27:49.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.633+0000 7f5b27140b80 20 client.35681 trim_cache size 0 max 16384 2024-05-14T09:27:49.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.662+0000 7f5b27140b80 1 Processor -- start 2024-05-14T09:27:49.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.662+0000 7f5b27140b80 1 -- start start 2024-05-14T09:27:49.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.663+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4824b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.663+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b47d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b486490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b27140b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101bf270 con 0x55df7b4829f0 2024-05-14T09:27:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4824b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4824b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37592/0 (socket says 172.21.15.120:37592) 2024-05-14T09:27:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b15c00700 1 -- 172.21.15.120:0/75309072 learned_addr learned my addr 172.21.15.120:0/75309072 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b16600700 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b486490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b27140b80 1 -- 172.21.15.120:0/75309072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101c0db0 con 0x55df7b304e40 2024-05-14T09:27:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.664+0000 7f5b27140b80 1 -- 172.21.15.120:0/75309072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101bf940 con 0x55df7b488830 2024-05-14T09:27:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.665+0000 7f5b15200700 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b47d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.666+0000 7f5b16600700 1 -- 172.21.15.120:0/75309072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 msgr2=0x55df7b4824b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.666+0000 7f5b16600700 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4824b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.666+0000 7f5b16600700 1 -- 172.21.15.120:0/75309072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 msgr2=0x55df7b47d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.666+0000 7f5b16600700 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b47d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.666+0000 7f5b16600700 1 -- 172.21.15.120:0/75309072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7b4753e0 con 0x55df7b488830 2024-05-14T09:27:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.666+0000 7f5b15c00700 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4824b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:27:49.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.667+0000 7f5b16600700 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b486490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009710 tx=0x7f5b08009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6059df97d766d35e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:49.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.668+0000 7f5b02000700 1 -- 172.21.15.120:0/75309072 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0801a030 con 0x55df7b488830 2024-05-14T09:27:49.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.668+0000 7f5b02000700 1 -- 172.21.15.120:0/75309072 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b08004bb0 con 0x55df7b488830 2024-05-14T09:27:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.669+0000 7f5b27140b80 1 -- 172.21.15.120:0/75309072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 msgr2=0x55df7b486490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.669+0000 7f5b27140b80 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b486490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009710 tx=0x7f5b08009040 comp rx=0 tx=0).stop 2024-05-14T09:27:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.670+0000 7f5b27140b80 1 -- 172.21.15.120:0/75309072 shutdown_connections 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.670+0000 7f5b27140b80 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b304e40 0x55df7b4824b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.670+0000 7f5b27140b80 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b488830 0x55df7b486490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.670+0000 7f5b27140b80 1 --2- 172.21.15.120:0/75309072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b4829f0 0x55df7b47d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.670+0000 7f5b27140b80 1 -- 172.21.15.120:0/75309072 >> 172.21.15.120:0/75309072 conn(0x55df7b349f70 msgr2=0x55df7b485d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.670+0000 7f5b27140b80 1 -- 172.21.15.120:0/75309072 shutdown_connections 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.670+0000 7f5b27140b80 1 -- 172.21.15.120:0/75309072 wait complete. 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.671+0000 7f5b27140b80 1 -- start start 2024-05-14T09:27:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.671+0000 7f5b27140b80 1 Processor -- start 2024-05-14T09:27:49.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.672+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b4949d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.672+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b4829f0 0x55df7b4a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.672+0000 7f5b27140b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b488830 0x55df7b4a3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.672+0000 7f5b27140b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101c06e0 con 0x55df7b304e40 2024-05-14T09:27:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.672+0000 7f5b27140b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101c0010 con 0x55df7b488830 2024-05-14T09:27:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.672+0000 7f5b27140b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10074640 con 0x55df7b4829f0 2024-05-14T09:27:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.672+0000 7f5b27140b80 10 client.0 _ll_register_callbacks cb 0x55df7b34bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.673+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b4949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.673+0000 7f5b15200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b4829f0 0x55df7b4a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.673+0000 7f5b16600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b488830 0x55df7b4a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.673+0000 7f5b15c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b4949d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52296/0 (socket says 172.21.15.120:52296) 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.673+0000 7f5b15c00700 1 -- 172.21.15.120:0/169945474 learned_addr learned my addr 172.21.15.120:0/169945474 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5b15c00700 1 -- 172.21.15.120:0/169945474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b4829f0 msgr2=0x55df7b4a32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5b15c00700 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b4829f0 0x55df7b4a32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5b15c00700 1 -- 172.21.15.120:0/169945474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b488830 msgr2=0x55df7b4a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5b15c00700 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b488830 0x55df7b4a3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5b15c00700 1 -- 172.21.15.120:0/169945474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7b4a3d70 con 0x55df7b304e40 2024-05-14T09:27:49.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5b15c00700 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b4949d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5b040a9870 tx=0x7f5b04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1584d59733ae5c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:49.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5af7400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5af7400700 1 -- 172.21.15.120:0/169945474 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b040a5ed0 con 0x55df7b304e40 2024-05-14T09:27:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.674+0000 7f5af7400700 1 -- 172.21.15.120:0/169945474 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5b040700d0 con 0x55df7b304e40 2024-05-14T09:27:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.675+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b08004bb0 con 0x55df7b304e40 2024-05-14T09:27:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.675+0000 7f5af7400700 1 -- 172.21.15.120:0/169945474 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5b040e23c0 con 0x55df7b304e40 2024-05-14T09:27:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.675+0000 7f5b27140b80 10 client.16212 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.675+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55df7b506690 con 0x55df7b304e40 2024-05-14T09:27:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.676+0000 7f5af7400700 1 -- 172.21.15.120:0/169945474 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b08004bb0 con 0x55df7b304e40 2024-05-14T09:27:49.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.677+0000 7f5af7400700 1 -- 172.21.15.120:0/169945474 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5b040a9b40 con 0x55df7b304e40 2024-05-14T09:27:49.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.677+0000 7f5b27140b80 10 client.16212 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:49.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.677+0000 7f5b27140b80 10 client.16212 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:27:49.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.677+0000 7f5b27140b80 20 client.16212 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:49.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.677+0000 7f5b27140b80 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b506860 0x55df7b508c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:49.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.677+0000 7f5b27140b80 4 client.16212 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:27:49.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.677+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df7b3b2400 con 0x55df7b506860 2024-05-14T09:27:49.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.678+0000 7f5b15200700 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b506860 0x55df7b508c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:49.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.679+0000 7f5af7400700 10 client.16212 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:27:49.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.679+0000 7f5b15200700 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b506860 0x55df7b508c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d54a104b0dc281f3 server_cookie=662827fa14122d4c in_seq=0 out_seq=0 2024-05-14T09:27:49.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.680+0000 7f5af7400700 1 -- 172.21.15.120:0/169945474 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df7b3b2400 con 0x55df7b506860 2024-05-14T09:27:49.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.680+0000 7f5af7400700 10 client.16212 handle_command_reply: tid=0 2024-05-14T09:27:49.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.680+0000 7f5b27140b80 1 client.16212 shutdown 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 msgr2=0x55df7b4949d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b4949d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5b040a9870 tx=0x7f5b04000bc0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 shutdown_connections 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55df7b506860 0x55df7b508c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df7b488830 0x55df7b4a3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df7b304e40 0x55df7b4949d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 --2- 172.21.15.120:0/169945474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df7b4829f0 0x55df7b4a32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 >> 172.21.15.120:0/169945474 conn(0x55df7b349f70 msgr2=0x55df7b4878c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:49.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.681+0000 7f5af7400700 0 client.16212 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:27:49.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.682+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 shutdown_connections 2024-05-14T09:27:49.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.683+0000 7f5b27140b80 1 -- 172.21.15.120:0/169945474 wait complete. 2024-05-14T09:27:49.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.683+0000 7f5b27140b80 20 client.16212 trim_cache size 0 max 16384 2024-05-14T09:27:49.683 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:27:49.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5af80b2a80 msgr2=0x7f5af80b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5af80b2a80 0x7f5af80b4f90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009810 tx=0x7f5afc019040 comp rx=0 tx=0).stop 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b101045f0 msgr2=0x7f5b101a2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b101045f0 0x7f5b101a2010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e9c0 tx=0x7f5b0400ed80 comp rx=0 tx=0).stop 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 shutdown_connections 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5af80b2a80 0x7f5af80b4f90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b10109870 0x7f5b101ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b101045f0 0x7f5b101a2010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 --2- 172.21.15.120:0/1750569053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10108f20 0x7f5b101a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 >> 172.21.15.120:0/1750569053 conn(0x7f5b10100040 msgr2=0x7f5b1010a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:49.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.684+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 shutdown_connections 2024-05-14T09:27:49.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:49.685+0000 7f5b18600700 1 -- 172.21.15.120:0/1750569053 wait complete. 2024-05-14T09:27:50.094 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:49 smithi120 ceph-mon[31085]: pgmap v684: 129 pgs: 129 active+clean; 934 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.9 MiB/s wr, 152 op/s 2024-05-14T09:27:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:49 smithi152 ceph-mon[34868]: pgmap v684: 129 pgs: 129 active+clean; 934 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.9 MiB/s wr, 152 op/s 2024-05-14T09:27:50.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:49 smithi175 ceph-mon[35353]: pgmap v684: 129 pgs: 129 active+clean; 934 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.9 MiB/s wr, 152 op/s 2024-05-14T09:27:50.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T09:27:51.326 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:27:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:51 smithi120 ceph-mon[31085]: pgmap v685: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.8 MiB/s wr, 332 op/s 2024-05-14T09:27:52.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:51 smithi152 ceph-mon[34868]: pgmap v685: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.8 MiB/s wr, 332 op/s 2024-05-14T09:27:52.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:51 smithi175 ceph-mon[35353]: pgmap v685: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.8 MiB/s wr, 332 op/s 2024-05-14T09:27:54.032 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:53 smithi120 ceph-mon[31085]: pgmap v686: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 403 op/s 2024-05-14T09:27:54.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:53 smithi152 ceph-mon[34868]: pgmap v686: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 403 op/s 2024-05-14T09:27:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:53 smithi175 ceph-mon[35353]: pgmap v686: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 403 op/s 2024-05-14T09:27:54.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 20.0 s, 681.0 tps, lat 147.126 ms stddev 36.907 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.356+0000 7efc61a00700 1 -- 172.21.15.120:0/645150247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c0764b0 msgr2=0x7efc5c114e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.356+0000 7efc61a00700 1 --2- 172.21.15.120:0/645150247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c0764b0 0x7efc5c114e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc48009990 tx=0x7efc48009ca0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.357+0000 7efc61a00700 1 -- 172.21.15.120:0/645150247 shutdown_connections 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.357+0000 7efc61a00700 1 --2- 172.21.15.120:0/645150247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5c115370 0x7efc5c117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.357+0000 7efc61a00700 1 --2- 172.21.15.120:0/645150247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 0x7efc5c075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.357+0000 7efc61a00700 1 --2- 172.21.15.120:0/645150247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c0764b0 0x7efc5c114e30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.357+0000 7efc61a00700 1 -- 172.21.15.120:0/645150247 >> 172.21.15.120:0/645150247 conn(0x7efc5c100040 msgr2=0x7efc5c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:54.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.358+0000 7efc61a00700 1 -- 172.21.15.120:0/645150247 shutdown_connections 2024-05-14T09:27:54.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.358+0000 7efc61a00700 1 -- 172.21.15.120:0/645150247 wait complete. 2024-05-14T09:27:54.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.360+0000 7efc61a00700 1 Processor -- start 2024-05-14T09:27:54.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.360+0000 7efc61a00700 1 -- start start 2024-05-14T09:27:54.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.361+0000 7efc61a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 0x7efc5c1a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc61a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5c0764b0 0x7efc5c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc61a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c115370 0x7efc5c1a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc61a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c11a970 con 0x7efc5c075b60 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc61a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c11a7f0 con 0x7efc5c0764b0 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc5aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 0x7efc5c1a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc61a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c11aaf0 con 0x7efc5c115370 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc5aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 0x7efc5c1a13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52316/0 (socket says 172.21.15.120:52316) 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc5aa00700 1 -- 172.21.15.120:0/914336433 learned_addr learned my addr 172.21.15.120:0/914336433 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:54.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.362+0000 7efc5a000700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5c0764b0 0x7efc5c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.363+0000 7efc5b400700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c115370 0x7efc5c1a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.364+0000 7efc5aa00700 1 -- 172.21.15.120:0/914336433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c115370 msgr2=0x7efc5c1a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.364+0000 7efc5aa00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c115370 0x7efc5c1a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.364+0000 7efc5aa00700 1 -- 172.21.15.120:0/914336433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5c0764b0 msgr2=0x7efc5c1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.364+0000 7efc5aa00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5c0764b0 0x7efc5c1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.364+0000 7efc5aa00700 1 -- 172.21.15.120:0/914336433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c1a6270 con 0x7efc5c075b60 2024-05-14T09:27:54.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.364+0000 7efc5b400700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c115370 0x7efc5c1a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:27:54.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.365+0000 7efc5aa00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 0x7efc5c1a13a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00d950 tx=0x7efc4c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:54.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.365+0000 7efc53400700 1 -- 172.21.15.120:0/914336433 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c016070 con 0x7efc5c075b60 2024-05-14T09:27:54.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.366+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5c1a6560 con 0x7efc5c075b60 2024-05-14T09:27:54.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.366+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5c1ade80 con 0x7efc5c075b60 2024-05-14T09:27:54.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.366+0000 7efc53400700 1 -- 172.21.15.120:0/914336433 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc4c010460 con 0x7efc5c075b60 2024-05-14T09:27:54.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.366+0000 7efc53400700 1 -- 172.21.15.120:0/914336433 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c016070 con 0x7efc5c075b60 2024-05-14T09:27:54.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.375+0000 7efc53400700 1 -- 172.21.15.120:0/914336433 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7efc4c019070 con 0x7efc5c075b60 2024-05-14T09:27:54.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.377+0000 7efc70462b80 1 Processor -- start 2024-05-14T09:27:54.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.377+0000 7efc70462b80 1 -- start start 2024-05-14T09:27:54.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.377+0000 7efc70462b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f68a2e40 0x5632f6a262f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.377+0000 7efc70462b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a204b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.377+0000 7efc70462b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a209f0 0x5632f6a20e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.378+0000 7efc70462b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5632f6942a20 con 0x5632f6a209f0 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.378+0000 7efc70462b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632f68e0760 con 0x5632f68a2e40 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.378+0000 7efc70462b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5632f693e9e0 con 0x5632f6a26830 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.378+0000 7efc5b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f68a2e40 0x5632f6a262f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.378+0000 7efc5b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f68a2e40 0x5632f6a262f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37626/0 (socket says 172.21.15.120:37626) 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.378+0000 7efc5b400700 1 -- 172.21.15.120:0/2887744614 learned_addr learned my addr 172.21.15.120:0/2887744614 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:54.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.378+0000 7efc5aa00700 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.379+0000 7efc5b400700 1 -- 172.21.15.120:0/2887744614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 msgr2=0x5632f6a204b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:54.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.379+0000 7efc5b400700 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a204b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.379+0000 7efc5b400700 1 -- 172.21.15.120:0/2887744614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a209f0 msgr2=0x5632f6a20e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:54.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.379+0000 7efc5b400700 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a209f0 0x5632f6a20e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.379+0000 7efc5b400700 1 -- 172.21.15.120:0/2887744614 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f688f8d0 con 0x5632f68a2e40 2024-05-14T09:27:54.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.380+0000 7efc5b400700 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f68a2e40 0x5632f6a262f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc54009440 tx=0x7efc54009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec76b7f99a799f4f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:54.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.380+0000 7efc47e00700 1 -- 172.21.15.120:0/2887744614 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54013750 con 0x5632f68a2e40 2024-05-14T09:27:54.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.381+0000 7efc47e00700 1 -- 172.21.15.120:0/2887744614 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc54013d80 con 0x5632f68a2e40 2024-05-14T09:27:54.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.381+0000 7efc47e00700 1 -- 172.21.15.120:0/2887744614 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc540143e0 con 0x5632f68a2e40 2024-05-14T09:27:54.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.382+0000 7efc53400700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efc400b2b00 0x7efc400b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.383+0000 7efc70462b80 1 -- 172.21.15.120:0/2887744614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f68a2e40 msgr2=0x5632f6a262f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.383+0000 7efc70462b80 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f68a2e40 0x5632f6a262f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc54009440 tx=0x7efc54009920 comp rx=0 tx=0).stop 2024-05-14T09:27:54.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.384+0000 7efc70462b80 1 -- 172.21.15.120:0/2887744614 shutdown_connections 2024-05-14T09:27:54.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.384+0000 7efc70462b80 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f68a2e40 0x5632f6a262f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.384+0000 7efc70462b80 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a209f0 0x5632f6a20e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.384+0000 7efc70462b80 1 --2- 172.21.15.120:0/2887744614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a204b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.384+0000 7efc70462b80 1 -- 172.21.15.120:0/2887744614 >> 172.21.15.120:0/2887744614 conn(0x5632f68e7f70 msgr2=0x5632f6a1b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:54.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.384+0000 7efc5aa00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efc400b2b00 0x7efc400b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.385+0000 7efc53400700 1 -- 172.21.15.120:0/914336433 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efc4c0e20c0 con 0x7efc5c075b60 2024-05-14T09:27:54.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.386+0000 7efc5aa00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efc400b2b00 0x7efc400b5010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5632f6a1cd40 tx=0x7efc4c0e5ba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:54.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.386+0000 7efc70462b80 1 -- 172.21.15.120:0/2887744614 shutdown_connections 2024-05-14T09:27:54.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.387+0000 7efc70462b80 1 -- 172.21.15.120:0/2887744614 wait complete. 2024-05-14T09:27:54.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.389+0000 7efc70462b80 1 -- start start 2024-05-14T09:27:54.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.391+0000 7efc70462b80 1 Processor -- start 2024-05-14T09:27:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.395+0000 7efc70462b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a2a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.396+0000 7efc70462b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a209f0 0x5632f6a2a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.396+0000 7efc70462b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a26830 0x5632f6a2aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.396+0000 7efc70462b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5632f6a3e320 con 0x5632f68a2e40 2024-05-14T09:27:54.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.396+0000 7efc70462b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632f68a8b20 con 0x5632f6a26830 2024-05-14T09:27:54.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.396+0000 7efc70462b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5632f6a3e4a0 con 0x5632f6a209f0 2024-05-14T09:27:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.396+0000 7efc70462b80 10 client.0 _ll_register_callbacks cb 0x5632f68e9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.396+0000 7efc5b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a2a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.397+0000 7efc5b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a2a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52334/0 (socket says 172.21.15.120:52334) 2024-05-14T09:27:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.397+0000 7efc5b400700 1 -- 172.21.15.120:0/310015100 learned_addr learned my addr 172.21.15.120:0/310015100 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.398+0000 7efc5a000700 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a209f0 0x5632f6a2a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.398+0000 7efc5b400700 1 -- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a209f0 msgr2=0x5632f6a2a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.398+0000 7efc5b400700 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a209f0 0x5632f6a2a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.398+0000 7efc5b400700 1 -- 172.21.15.120:0/310015100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a26830 msgr2=0x5632f6a2aaa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:27:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.398+0000 7efc5b400700 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a26830 0x5632f6a2aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.398+0000 7efc5b400700 1 -- 172.21.15.120:0/310015100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f6908420 con 0x5632f68a2e40 2024-05-14T09:27:54.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.399+0000 7efc5b400700 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a2a020 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7efc54000f80 tx=0x7efc54015720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2f872f01ecefd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:54.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.400+0000 7efc44c00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:27:54.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.401+0000 7efc44c00700 1 -- 172.21.15.120:0/310015100 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54013750 con 0x5632f68a2e40 2024-05-14T09:27:54.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.401+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc54013d80 con 0x5632f68a2e40 2024-05-14T09:27:54.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.401+0000 7efc44c00700 1 -- 172.21.15.120:0/310015100 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efc540138f0 con 0x5632f68a2e40 2024-05-14T09:27:54.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.402+0000 7efc44c00700 1 -- 172.21.15.120:0/310015100 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7efc54030050 con 0x5632f68a2e40 2024-05-14T09:27:54.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.402+0000 7efc70462b80 10 client.16221 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:54.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.402+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5632f6a48ee0 con 0x5632f68a2e40 2024-05-14T09:27:54.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.403+0000 7efc44c00700 1 -- 172.21.15.120:0/310015100 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc54013d80 con 0x5632f68a2e40 2024-05-14T09:27:54.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.403+0000 7efc44c00700 1 -- 172.21.15.120:0/310015100 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7efc5401f410 con 0x5632f68a2e40 2024-05-14T09:27:54.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.404+0000 7efc70462b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:54.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.404+0000 7efc70462b80 10 client.16221 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:27:54.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.404+0000 7efc70462b80 20 client.16221 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:54.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.404+0000 7efc70462b80 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6a4b3b0 0x5632f6a4d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.404+0000 7efc70462b80 4 client.16221 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:27:54.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.404+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632f69ed1c0 con 0x5632f6a4b3b0 2024-05-14T09:27:54.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.405+0000 7efc5a000700 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6a4b3b0 0x5632f6a4d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.407+0000 7efc5a000700 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6a4b3b0 0x5632f6a4d7d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4351f0a2e3d4021f server_cookie=c7e8700eba8b2d3c in_seq=0 out_seq=0 2024-05-14T09:27:54.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.407+0000 7efc44c00700 10 client.16221 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:27:54.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.408+0000 7efc44c00700 1 -- 172.21.15.120:0/310015100 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5632f69ed1c0 con 0x5632f6a4b3b0 2024-05-14T09:27:54.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.408+0000 7efc44c00700 10 client.16221 handle_command_reply: tid=0 2024-05-14T09:27:54.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 client.16221 shutdown 2024-05-14T09:27:54.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 msgr2=0x5632f6a2a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a2a020 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7efc54000f80 tx=0x7efc54015720 comp rx=0 tx=0).stop 2024-05-14T09:27:54.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 shutdown_connections 2024-05-14T09:27:54.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a26830 0x5632f6a2aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6a4b3b0 0x5632f6a4d7d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc44c00700 0 client.16221 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a2a020 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 --2- 172.21.15.120:0/310015100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a209f0 0x5632f6a2a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.409+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 >> 172.21.15.120:0/310015100 conn(0x5632f68e7f70 msgr2=0x5632f6a1f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.410+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 shutdown_connections 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.410+0000 7efc70462b80 1 -- 172.21.15.120:0/310015100 wait complete. 2024-05-14T09:27:54.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.410+0000 7efc70462b80 20 client.16221 trim_cache size 0 max 16384 2024-05-14T09:27:54.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.431+0000 7efc70462b80 1 Processor -- start 2024-05-14T09:27:54.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.432+0000 7efc70462b80 1 -- start start 2024-05-14T09:27:54.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.432+0000 7efc70462b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a204b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.432+0000 7efc70462b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a47750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.432+0000 7efc70462b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a2a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.432+0000 7efc70462b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1ae260 con 0x5632f68a2e40 2024-05-14T09:27:54.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.432+0000 7efc70462b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1afda0 con 0x5632f6a209f0 2024-05-14T09:27:54.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.432+0000 7efc70462b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1ae930 con 0x5632f6a26830 2024-05-14T09:27:54.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.433+0000 7efc5b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.433+0000 7efc5a000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a47750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.433+0000 7efc5a000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a47750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37644/0 (socket says 172.21.15.120:37644) 2024-05-14T09:27:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.433+0000 7efc5a000700 1 -- 172.21.15.120:0/1546999001 learned_addr learned my addr 172.21.15.120:0/1546999001 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.433+0000 7efc5b400700 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a2a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc5a000700 1 -- 172.21.15.120:0/1546999001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 msgr2=0x5632f6a2a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc5a000700 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a2a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc5a000700 1 -- 172.21.15.120:0/1546999001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 msgr2=0x5632f6a204b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc5a000700 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a204b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc5a000700 1 -- 172.21.15.120:0/1546999001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f6a2ae20 con 0x5632f6a209f0 2024-05-14T09:27:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc5b400700 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a204b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:27:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc5a000700 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a47750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc480098e0 tx=0x7efc48005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf889d0965dca69d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.434+0000 7efc47400700 1 -- 172.21.15.120:0/1546999001 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4802a020 con 0x5632f6a209f0 2024-05-14T09:27:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.435+0000 7efc47400700 1 -- 172.21.15.120:0/1546999001 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc48026ac0 con 0x5632f6a209f0 2024-05-14T09:27:54.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.435+0000 7efc47400700 1 -- 172.21.15.120:0/1546999001 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48003cd0 con 0x5632f6a209f0 2024-05-14T09:27:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.436+0000 7efc70462b80 1 -- 172.21.15.120:0/1546999001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 msgr2=0x5632f6a47750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.436+0000 7efc70462b80 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a47750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc480098e0 tx=0x7efc48005a90 comp rx=0 tx=0).stop 2024-05-14T09:27:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.437+0000 7efc70462b80 1 -- 172.21.15.120:0/1546999001 shutdown_connections 2024-05-14T09:27:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.437+0000 7efc70462b80 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f6a26830 0x5632f6a2a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.437+0000 7efc70462b80 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f68a2e40 0x5632f6a204b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.437+0000 7efc70462b80 1 --2- 172.21.15.120:0/1546999001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a47750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.437+0000 7efc70462b80 1 -- 172.21.15.120:0/1546999001 >> 172.21.15.120:0/1546999001 conn(0x5632f68e7f70 msgr2=0x5632f6a23d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.438+0000 7efc70462b80 1 -- 172.21.15.120:0/1546999001 shutdown_connections 2024-05-14T09:27:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.438+0000 7efc70462b80 1 -- 172.21.15.120:0/1546999001 wait complete. 2024-05-14T09:27:54.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.438+0000 7efc70462b80 1 -- start start 2024-05-14T09:27:54.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.439+0000 7efc70462b80 1 Processor -- start 2024-05-14T09:27:54.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.440+0000 7efc70462b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f68a2e40 0x5632f6a4edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.440+0000 7efc70462b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a4f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.440+0000 7efc70462b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a26830 0x5632f6a4f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.440+0000 7efc70462b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1af6d0 con 0x5632f6a26830 2024-05-14T09:27:54.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.440+0000 7efc70462b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1af000 con 0x5632f6a209f0 2024-05-14T09:27:54.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.440+0000 7efc70462b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c073bc0 con 0x5632f68a2e40 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.440+0000 7efc5b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f68a2e40 0x5632f6a4edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.441+0000 7efc5b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f68a2e40 0x5632f6a4edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43486/0 (socket says 172.21.15.120:43486) 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.441+0000 7efc5b400700 1 -- 172.21.15.120:0/2308091561 learned_addr learned my addr 172.21.15.120:0/2308091561 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.441+0000 7efc5b400700 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a26830 0x5632f6a4f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.441+0000 7efc70462b80 10 client.0 _ll_register_callbacks cb 0x5632f68e9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.441+0000 7efc5a000700 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a4f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.444+0000 7efc5b400700 1 -- 172.21.15.120:0/2308091561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 msgr2=0x5632f6a4f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.444+0000 7efc5b400700 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a4f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.444+0000 7efc5b400700 1 -- 172.21.15.120:0/2308091561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a26830 msgr2=0x5632f6a4f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:27:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.444+0000 7efc5b400700 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a26830 0x5632f6a4f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.444+0000 7efc5b400700 1 -- 172.21.15.120:0/2308091561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f6ab4900 con 0x5632f68a2e40 2024-05-14T09:27:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.445+0000 7efc5b400700 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f68a2e40 0x5632f6a4edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc5401f7e0 tx=0x7efc54009d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8904addd0085abe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:27:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.445+0000 7efc44c00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:27:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.445+0000 7efc44c00700 1 -- 172.21.15.120:0/2308091561 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5402d040 con 0x5632f68a2e40 2024-05-14T09:27:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.446+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc48026ac0 con 0x5632f68a2e40 2024-05-14T09:27:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.446+0000 7efc44c00700 1 -- 172.21.15.120:0/2308091561 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efc5403f030 con 0x5632f68a2e40 2024-05-14T09:27:54.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.446+0000 7efc44c00700 1 -- 172.21.15.120:0/2308091561 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7efc54049050 con 0x5632f68a2e40 2024-05-14T09:27:54.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.446+0000 7efc70462b80 10 client.25771 fetch_fsmap learned FSMap version 39 2024-05-14T09:27:54.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.446+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5632f6ab59c0 con 0x5632f68a2e40 2024-05-14T09:27:54.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.447+0000 7efc44c00700 1 -- 172.21.15.120:0/2308091561 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc48026ac0 con 0x5632f68a2e40 2024-05-14T09:27:54.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc44c00700 1 -- 172.21.15.120:0/2308091561 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7efc54004290 con 0x5632f68a2e40 2024-05-14T09:27:54.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc70462b80 10 client.25771 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T09:27:54.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc70462b80 10 client.25771 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:27:54.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc70462b80 20 client.25771 populate_metadata read hostname 'smithi120' 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc70462b80 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6ab5f50 0x5632f6ab8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc70462b80 4 client.25771 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5632f6950400 con 0x5632f6ab5f50 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.448+0000 7efc5a000700 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6ab5f50 0x5632f6ab8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.449+0000 7efc5a000700 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6ab5f50 0x5632f6ab8370 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa410bca7fd8c3dd server_cookie=a451cad5da7297f4 in_seq=0 out_seq=0 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.449+0000 7efc44c00700 10 client.25771 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.450+0000 7efc44c00700 1 -- 172.21.15.120:0/2308091561 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5632f6950400 con 0x5632f6ab5f50 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.450+0000 7efc44c00700 10 client.25771 handle_command_reply: tid=0 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.450+0000 7efc70462b80 1 client.25771 shutdown 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.450+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f68a2e40 msgr2=0x5632f6a4edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.450+0000 7efc70462b80 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f68a2e40 0x5632f6a4edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc5401f7e0 tx=0x7efc54009d50 comp rx=0 tx=0).stop 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 shutdown_connections 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5632f6ab5f50 0x5632f6ab8370 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5632f6a26830 0x5632f6a4f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5632f68a2e40 0x5632f6a4edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc44c00700 0 client.25771 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 --2- 172.21.15.120:0/2308091561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632f6a209f0 0x5632f6a4f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 >> 172.21.15.120:0/2308091561 conn(0x5632f68e7f70 msgr2=0x5632f6a25930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 shutdown_connections 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 1 -- 172.21.15.120:0/2308091561 wait complete. 2024-05-14T09:27:54.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.451+0000 7efc70462b80 20 client.25771 trim_cache size 0 max 16384 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efc400b2b00 msgr2=0x7efc400b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efc400b2b00 0x7efc400b5010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5632f6a1cd40 tx=0x7efc4c0e5ba0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 msgr2=0x7efc5c1a13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 0x7efc5c1a13a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00d950 tx=0x7efc4c00dd10 comp rx=0 tx=0).stop 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 shutdown_connections 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efc400b2b00 0x7efc400b5010 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc5c115370 0x7efc5c1a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc5c075b60 0x7efc5c1a13a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 --2- 172.21.15.120:0/914336433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5c0764b0 0x7efc5c1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 >> 172.21.15.120:0/914336433 conn(0x7efc5c100040 msgr2=0x7efc5c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 shutdown_connections 2024-05-14T09:27:54.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:27:54.453+0000 7efc61a00700 1 -- 172.21.15.120:0/914336433 wait complete. 2024-05-14T09:27:56.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:55 smithi120 ceph-mon[31085]: pgmap v687: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-05-14T09:27:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:55 smithi152 ceph-mon[34868]: pgmap v687: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-05-14T09:27:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:55 smithi175 ceph-mon[35353]: pgmap v687: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2024-05-14T09:27:57.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T09:27:58.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:57 smithi120 ceph-mon[31085]: pgmap v688: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 691 op/s 2024-05-14T09:27:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:57 smithi152 ceph-mon[34868]: pgmap v688: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 691 op/s 2024-05-14T09:27:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:57 smithi175 ceph-mon[35353]: pgmap v688: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 691 op/s 2024-05-14T09:27:58.581 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:27:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 25.0 s, 653.2 tps, lat 153.054 ms stddev 48.313 2024-05-14T09:28:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:27:59 smithi120 ceph-mon[31085]: pgmap v689: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 851 op/s 2024-05-14T09:28:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:27:59 smithi152 ceph-mon[34868]: pgmap v689: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 851 op/s 2024-05-14T09:28:00.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:27:59 smithi175 ceph-mon[35353]: pgmap v689: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 851 op/s 2024-05-14T09:28:01.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.100+0000 7f8cd0800700 1 -- 172.21.15.120:0/3917978238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 msgr2=0x7f8cc8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.100+0000 7f8cd0800700 1 --2- 172.21.15.120:0/3917978238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 0x7f8cc8104a00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0099c0 tx=0x7f8cbc009cd0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.101+0000 7f8cd0800700 1 -- 172.21.15.120:0/3917978238 shutdown_connections 2024-05-14T09:28:01.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.101+0000 7f8cd0800700 1 --2- 172.21.15.120:0/3917978238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8109870 0x7f8cc81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.101+0000 7f8cd0800700 1 --2- 172.21.15.120:0/3917978238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 0x7f8cc8104a00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.101+0000 7f8cd0800700 1 --2- 172.21.15.120:0/3917978238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc8108f20 0x7f8cc8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.101+0000 7f8cd0800700 1 -- 172.21.15.120:0/3917978238 >> 172.21.15.120:0/3917978238 conn(0x7f8cc8100040 msgr2=0x7f8cc8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.101+0000 7f8cd0800700 1 -- 172.21.15.120:0/3917978238 shutdown_connections 2024-05-14T09:28:01.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.102+0000 7f8cd0800700 1 -- 172.21.15.120:0/3917978238 wait complete. 2024-05-14T09:28:01.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.103+0000 7f8cd0800700 1 Processor -- start 2024-05-14T09:28:01.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.103+0000 7f8cd0800700 1 -- start start 2024-05-14T09:28:01.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.104+0000 7f8cd0800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 0x7f8cc819aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.104+0000 7f8cd0800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8108f20 0x7f8cc819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.104+0000 7f8cd0800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc8109870 0x7f8cc819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.104+0000 7f8cd0800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc8114410 con 0x7f8cc81045f0 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.104+0000 7f8cd0800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc8114290 con 0x7f8cc8109870 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.104+0000 7f8cd0800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc8114590 con 0x7f8cc8108f20 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.105+0000 7f8ccd400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8108f20 0x7f8cc819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.105+0000 7f8ccd400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8108f20 0x7f8cc819b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45344/0 (socket says 172.21.15.120:45344) 2024-05-14T09:28:01.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.105+0000 7f8ccd400700 1 -- 172.21.15.120:0/1166166822 learned_addr learned my addr 172.21.15.120:0/1166166822 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.105+0000 7f8ccde00700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 0x7f8cc819aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.106+0000 7f8ccd400700 1 -- 172.21.15.120:0/1166166822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc8109870 msgr2=0x7f8cc819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.106+0000 7f8ccd400700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc8109870 0x7f8cc819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.106+0000 7f8ccd400700 1 -- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 msgr2=0x7f8cc819aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.107+0000 7f8ccd400700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 0x7f8cc819aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.107+0000 7f8ccd400700 1 -- 172.21.15.120:0/1166166822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc819fd00 con 0x7f8cc8108f20 2024-05-14T09:28:01.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.107+0000 7f8ccde00700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 0x7f8cc819aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:01.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.108+0000 7f8ccd400700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8108f20 0x7f8cc819b480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800b500 tx=0x7f8cb800b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.109+0000 7f8cc2a00700 1 -- 172.21.15.120:0/1166166822 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8015020 con 0x7f8cc8108f20 2024-05-14T09:28:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.109+0000 7f8cc2a00700 1 -- 172.21.15.120:0/1166166822 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cb8011cc0 con 0x7f8cc8108f20 2024-05-14T09:28:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.109+0000 7f8cc2a00700 1 -- 172.21.15.120:0/1166166822 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8010c80 con 0x7f8cc8108f20 2024-05-14T09:28:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.109+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc819fff0 con 0x7f8cc8108f20 2024-05-14T09:28:01.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.109+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc81a04e0 con 0x7f8cc8108f20 2024-05-14T09:28:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.120+0000 7f8cc2a00700 1 -- 172.21.15.120:0/1166166822 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8cb8018020 con 0x7f8cc8108f20 2024-05-14T09:28:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.122+0000 7f8cc2a00700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cb00b2980 0x7f8cb00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.123+0000 7f8cc2a00700 1 -- 172.21.15.120:0/1166166822 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8cb80e1dc0 con 0x7f8cc8108f20 2024-05-14T09:28:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.123+0000 7f8cdf3d4b80 1 Processor -- start 2024-05-14T09:28:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.124+0000 7f8cdf3d4b80 1 -- start start 2024-05-14T09:28:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.124+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce80fe40 0x5564ce9936b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.124+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce993bf0 0x5564ce98d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce98e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5564ce8afa20 con 0x5564ce80fe40 2024-05-14T09:28:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5564ce84d760 con 0x5564ce98dc50 2024-05-14T09:28:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564ce8ab9e0 con 0x5564ce993bf0 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8ccd400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce993bf0 0x5564ce98d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8ccd400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce993bf0 0x5564ce98d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45350/0 (socket says 172.21.15.120:45350) 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8ccd400700 1 -- 172.21.15.120:0/2336307828 learned_addr learned my addr 172.21.15.120:0/2336307828 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.125+0000 7f8cce800700 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce98e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.126+0000 7f8ccde00700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cb00b2980 0x7f8cb00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.127+0000 7f8cce800700 1 -- 172.21.15.120:0/2336307828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce993bf0 msgr2=0x5564ce98d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.127+0000 7f8cce800700 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce993bf0 0x5564ce98d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.127+0000 7f8cce800700 1 -- 172.21.15.120:0/2336307828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce80fe40 msgr2=0x5564ce9936b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:28:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.127+0000 7f8cce800700 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce80fe40 0x5564ce9936b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.127+0000 7f8cce800700 1 -- 172.21.15.120:0/2336307828 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ce7fc8d0 con 0x5564ce98dc50 2024-05-14T09:28:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.127+0000 7f8cce800700 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce98e060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4008fa0 tx=0x7f8cc400d3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d5b749c292e4f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.128+0000 7f8cb7400700 1 -- 172.21.15.120:0/2336307828 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4016960 con 0x5564ce98dc50 2024-05-14T09:28:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.128+0000 7f8cb7400700 1 -- 172.21.15.120:0/2336307828 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc401e3f0 con 0x5564ce98dc50 2024-05-14T09:28:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.128+0000 7f8cb7400700 1 -- 172.21.15.120:0/2336307828 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc401d600 con 0x5564ce98dc50 2024-05-14T09:28:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.130+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/2336307828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 msgr2=0x5564ce98e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.130+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce98e060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4008fa0 tx=0x7f8cc400d3c0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.130+0000 7f8ccde00700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cb00b2980 0x7f8cb00b4e90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005850 tx=0x7f8cbc0056a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.131+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/2336307828 shutdown_connections 2024-05-14T09:28:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.131+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce98e060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.131+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce80fe40 0x5564ce9936b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.131+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/2336307828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce993bf0 0x5564ce98d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.131+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/2336307828 >> 172.21.15.120:0/2336307828 conn(0x5564ce84ea80 msgr2=0x5564ce988790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.131+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/2336307828 shutdown_connections 2024-05-14T09:28:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.131+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/2336307828 wait complete. 2024-05-14T09:28:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.132+0000 7f8cdf3d4b80 1 -- start start 2024-05-14T09:28:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.132+0000 7f8cdf3d4b80 1 Processor -- start 2024-05-14T09:28:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce997370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce9978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce997df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5564ce99a6c0 con 0x5564ce993bf0 2024-05-14T09:28:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5564ce815b20 con 0x5564ce98dc50 2024-05-14T09:28:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564ce99a840 con 0x5564ce80fe40 2024-05-14T09:28:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8cdf3d4b80 10 client.0 _ll_register_callbacks cb 0x5564ce843380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce997370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce997370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45364/0 (socket says 172.21.15.120:45364) 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.133+0000 7f8ccde00700 1 -- 172.21.15.120:0/875197958 learned_addr learned my addr 172.21.15.120:0/875197958 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.134+0000 7f8cce800700 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce997df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.134+0000 7f8ccd400700 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce9978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.134+0000 7f8cce800700 1 -- 172.21.15.120:0/875197958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 msgr2=0x5564ce997370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.134+0000 7f8cce800700 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce997370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.134+0000 7f8cce800700 1 -- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 msgr2=0x5564ce9978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.134+0000 7f8cce800700 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce9978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.134+0000 7f8cce800700 1 -- 172.21.15.120:0/875197958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ce875420 con 0x5564ce993bf0 2024-05-14T09:28:01.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.135+0000 7f8cce800700 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce997df0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4020040 tx=0x7f8cc401eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e4edbff1d65deb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.135+0000 7f8cabe00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:28:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.135+0000 7f8cabe00700 1 -- 172.21.15.120:0/875197958 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4003c00 con 0x5564ce993bf0 2024-05-14T09:28:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.136+0000 7f8cabe00700 1 -- 172.21.15.120:0/875197958 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8cc4003da0 con 0x5564ce993bf0 2024-05-14T09:28:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.136+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cc401e3f0 con 0x5564ce993bf0 2024-05-14T09:28:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.136+0000 7f8cabe00700 1 -- 172.21.15.120:0/875197958 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8cc4034050 con 0x5564ce993bf0 2024-05-14T09:28:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.136+0000 7f8cdf3d4b80 10 client.16233 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.136+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5564ce9a5270 con 0x5564ce993bf0 2024-05-14T09:28:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.136+0000 7f8cabe00700 1 -- 172.21.15.120:0/875197958 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc401e3f0 con 0x5564ce993bf0 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.137+0000 7f8cabe00700 1 -- 172.21.15.120:0/875197958 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f8cc40044c0 con 0x5564ce993bf0 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.137+0000 7f8cdf3d4b80 10 client.16233 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.137+0000 7f8cdf3d4b80 10 client.16233 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.137+0000 7f8cdf3d4b80 20 client.16233 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.137+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564ce9a77f0 0x5564ce9a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.137+0000 7f8cdf3d4b80 4 client.16233 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.137+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564ce95a070 con 0x5564ce9a77f0 2024-05-14T09:28:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.138+0000 7f8ccde00700 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564ce9a77f0 0x5564ce9a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.140+0000 7f8ccde00700 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564ce9a77f0 0x5564ce9a9c10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe64ad1c8db3b877 server_cookie=2095f606283ed475 in_seq=0 out_seq=0 2024-05-14T09:28:01.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.140+0000 7f8cabe00700 10 client.16233 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:28:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.143+0000 7f8cabe00700 1 -- 172.21.15.120:0/875197958 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5564ce95a070 con 0x5564ce9a77f0 2024-05-14T09:28:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.143+0000 7f8cabe00700 10 client.16233 handle_command_reply: tid=0 2024-05-14T09:28:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.144+0000 7f8cdf3d4b80 1 client.16233 shutdown 2024-05-14T09:28:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.144+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 msgr2=0x5564ce997df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.144+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce997df0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4020040 tx=0x7f8cc401eef0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.145+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 shutdown_connections 2024-05-14T09:28:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.145+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564ce9a77f0 0x5564ce9a9c10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.145+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce997df0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.145+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce997370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.145+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/875197958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce98dc50 0x5564ce9978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.145+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 >> 172.21.15.120:0/875197958 conn(0x5564ce84ea80 msgr2=0x5564ce98c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.145+0000 7f8cabe00700 0 client.16233 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:28:01.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.146+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 shutdown_connections 2024-05-14T09:28:01.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.146+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/875197958 wait complete. 2024-05-14T09:28:01.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.146+0000 7f8cdf3d4b80 20 client.16233 trim_cache size 0 max 16384 2024-05-14T09:28:01.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.170+0000 7f8cdf3d4b80 1 Processor -- start 2024-05-14T09:28:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.170+0000 7f8cdf3d4b80 1 -- start start 2024-05-14T09:28:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.171+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce98d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.171+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce98dc50 0x5564ce992c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.171+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce993bf0 0x5564ce998a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.171+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc81ae190 con 0x5564ce98dc50 2024-05-14T09:28:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.171+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc81afd00 con 0x5564ce993bf0 2024-05-14T09:28:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.171+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc81ae860 con 0x5564ce80fe40 2024-05-14T09:28:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.172+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce98d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.172+0000 7f8ccd400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce98dc50 0x5564ce992c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.172+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce98d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45380/0 (socket says 172.21.15.120:45380) 2024-05-14T09:28:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.172+0000 7f8ccde00700 1 -- 172.21.15.120:0/603277866 learned_addr learned my addr 172.21.15.120:0/603277866 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8cce800700 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce993bf0 0x5564ce998a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8ccde00700 1 -- 172.21.15.120:0/603277866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce993bf0 msgr2=0x5564ce998a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8ccde00700 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce993bf0 0x5564ce998a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8ccde00700 1 -- 172.21.15.120:0/603277866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce98dc50 msgr2=0x5564ce992c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8ccde00700 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce98dc50 0x5564ce992c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8ccde00700 1 -- 172.21.15.120:0/603277866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ce996690 con 0x5564ce80fe40 2024-05-14T09:28:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8ccd400700 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce98dc50 0x5564ce992c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.173+0000 7f8cce800700 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce993bf0 0x5564ce998a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.174+0000 7f8ccde00700 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce98d710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009990 tx=0x7f8cbc019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f85e2fdafdbab734 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.174+0000 7f8cb6a00700 1 -- 172.21.15.120:0/603277866 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc034030 con 0x5564ce80fe40 2024-05-14T09:28:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.174+0000 7f8cb6a00700 1 -- 172.21.15.120:0/603277866 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cbc01b040 con 0x5564ce80fe40 2024-05-14T09:28:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.174+0000 7f8cb6a00700 1 -- 172.21.15.120:0/603277866 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc030870 con 0x5564ce80fe40 2024-05-14T09:28:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.175+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/603277866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 msgr2=0x5564ce98d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.175+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce98d710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009990 tx=0x7f8cbc019000 comp rx=0 tx=0).stop 2024-05-14T09:28:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/603277866 shutdown_connections 2024-05-14T09:28:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce993bf0 0x5564ce998a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce80fe40 0x5564ce98d710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/603277866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce98dc50 0x5564ce992c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/603277866 >> 172.21.15.120:0/603277866 conn(0x5564ce84ea80 msgr2=0x5564ce9924f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/603277866 shutdown_connections 2024-05-14T09:28:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/603277866 wait complete. 2024-05-14T09:28:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.176+0000 7f8cdf3d4b80 1 -- start start 2024-05-14T09:28:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 1 Processor -- start 2024-05-14T09:28:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce80fe40 0x5564ce9af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce98dc50 0x5564ce99fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce9a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc81af630 con 0x5564ce993bf0 2024-05-14T09:28:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc81aef60 con 0x5564ce80fe40 2024-05-14T09:28:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc81ac150 con 0x5564ce98dc50 2024-05-14T09:28:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.177+0000 7f8cdf3d4b80 10 client.0 _ll_register_callbacks cb 0x5564ce843380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.178+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce80fe40 0x5564ce9af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.178+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce80fe40 0x5564ce9af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40716/0 (socket says 172.21.15.120:40716) 2024-05-14T09:28:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.178+0000 7f8ccde00700 1 -- 172.21.15.120:0/4003178793 learned_addr learned my addr 172.21.15.120:0/4003178793 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8ccd400700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce98dc50 0x5564ce99fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8cce800700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce9a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8ccde00700 1 -- 172.21.15.120:0/4003178793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce98dc50 msgr2=0x5564ce99fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8ccde00700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce98dc50 0x5564ce99fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8ccde00700 1 -- 172.21.15.120:0/4003178793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 msgr2=0x5564ce9a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8ccde00700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce9a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8ccde00700 1 -- 172.21.15.120:0/4003178793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ce9ae420 con 0x5564ce80fe40 2024-05-14T09:28:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.179+0000 7f8cce800700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce9a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.180+0000 7f8ccde00700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce80fe40 0x5564ce9af9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005d40 tx=0x7f8cbc00b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21ff7bcb10334fda server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.180+0000 7f8cabe00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:28:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.180+0000 7f8cabe00700 1 -- 172.21.15.120:0/4003178793 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc034040 con 0x5564ce80fe40 2024-05-14T09:28:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.181+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cbc01b040 con 0x5564ce80fe40 2024-05-14T09:28:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.181+0000 7f8cabe00700 1 -- 172.21.15.120:0/4003178793 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8cbc030450 con 0x5564ce80fe40 2024-05-14T09:28:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.181+0000 7f8cabe00700 1 -- 172.21.15.120:0/4003178793 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8cbc048050 con 0x5564ce80fe40 2024-05-14T09:28:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.181+0000 7f8cdf3d4b80 10 client.35714 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.181+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5564cea11250 con 0x5564ce80fe40 2024-05-14T09:28:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cabe00700 1 -- 172.21.15.120:0/4003178793 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cbc01b040 con 0x5564ce80fe40 2024-05-14T09:28:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cabe00700 1 -- 172.21.15.120:0/4003178793 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f8cbc030ce0 con 0x5564ce80fe40 2024-05-14T09:28:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cdf3d4b80 10 client.35714 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cdf3d4b80 10 client.35714 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:28:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cdf3d4b80 20 client.35714 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564cea11970 0x5564cea13d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cdf3d4b80 4 client.35714 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:28:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.182+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564ce8bd400 con 0x5564cea11970 2024-05-14T09:28:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.183+0000 7f8ccd400700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564cea11970 0x5564cea13d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.183+0000 7f8ccd400700 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564cea11970 0x5564cea13d90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43de096dbd030e5d server_cookie=380a7ad98fe58c27 in_seq=0 out_seq=0 2024-05-14T09:28:01.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.183+0000 7f8cabe00700 10 client.35714 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cabe00700 1 -- 172.21.15.120:0/4003178793 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564ce8bd400 con 0x5564cea11970 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cabe00700 10 client.35714 handle_command_reply: tid=0 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 client.35714 shutdown 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce80fe40 msgr2=0x5564ce9af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce80fe40 0x5564ce9af9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005d40 tx=0x7f8cbc00b9c0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 shutdown_connections 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564ce80fe40 0x5564ce9af9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5564cea11970 0x5564cea13d90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564ce993bf0 0x5564ce9a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cabe00700 0 client.35714 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:28:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 --2- 172.21.15.120:0/4003178793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ce98dc50 0x5564ce99fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 >> 172.21.15.120:0/4003178793 conn(0x5564ce84ea80 msgr2=0x5564ce987e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 shutdown_connections 2024-05-14T09:28:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.184+0000 7f8cdf3d4b80 1 -- 172.21.15.120:0/4003178793 wait complete. 2024-05-14T09:28:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.185+0000 7f8cdf3d4b80 20 client.35714 trim_cache size 0 max 16384 2024-05-14T09:28:01.186 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.185+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cb00b2980 msgr2=0x7f8cb00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.185+0000 7f8cd0800700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cb00b2980 0x7f8cb00b4e90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005850 tx=0x7f8cbc0056a0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.185+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8108f20 msgr2=0x7f8cc819b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.185+0000 7f8cd0800700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8108f20 0x7f8cc819b480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800b500 tx=0x7f8cb800b8c0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 shutdown_connections 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cb00b2980 0x7f8cb00b4e90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc8109870 0x7f8cc819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cc81045f0 0x7f8cc819aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 --2- 172.21.15.120:0/1166166822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8108f20 0x7f8cc819b480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 >> 172.21.15.120:0/1166166822 conn(0x7f8cc8100040 msgr2=0x7f8cc8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 shutdown_connections 2024-05-14T09:28:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:01.186+0000 7f8cd0800700 1 -- 172.21.15.120:0/1166166822 wait complete. 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 -- 172.21.15.120:0/1561880804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe41099c0 msgr2=0x7effe410bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 --2- 172.21.15.120:0/1561880804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe41099c0 0x7effe410bde0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effdc009be0 tx=0x7effdc02a6c0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 -- 172.21.15.120:0/1561880804 shutdown_connections 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 --2- 172.21.15.120:0/1561880804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe41099c0 0x7effe410bde0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 --2- 172.21.15.120:0/1561880804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4104cc0 0x7effe41050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 --2- 172.21.15.120:0/1561880804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effe4103a80 0x7effe4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 -- 172.21.15.120:0/1561880804 >> 172.21.15.120:0/1561880804 conn(0x7effe40fec70 msgr2=0x7effe4101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 -- 172.21.15.120:0/1561880804 shutdown_connections 2024-05-14T09:28:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.884+0000 7effe8c00640 1 -- 172.21.15.120:0/1561880804 wait complete. 2024-05-14T09:28:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.886+0000 7effe8c00640 1 Processor -- start 2024-05-14T09:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.887+0000 7effe8c00640 1 -- start start 2024-05-14T09:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.887+0000 7effe8c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4103a80 0x7effe4197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.887+0000 7effe8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe4104cc0 0x7effe41981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.887+0000 7effe3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4103a80 0x7effe4197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.888+0000 7effe3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4103a80 0x7effe4197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59458/0 (socket says 172.21.15.120:59458) 2024-05-14T09:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.888+0000 7effe3400640 1 -- 172.21.15.120:0/1867970569 learned_addr learned my addr 172.21.15.120:0/1867970569 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.888+0000 7effe2a00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe4104cc0 0x7effe41981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.888+0000 7effe8c00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effe41099c0 0x7effe41a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.888+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7effe410f440 con 0x7effe4103a80 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.889+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7effe410f2c0 con 0x7effe41099c0 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.889+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effe410f5c0 con 0x7effe4104cc0 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.889+0000 7effe3e00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effe41099c0 0x7effe41a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.889+0000 7effe3400640 1 -- 172.21.15.120:0/1867970569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe4104cc0 msgr2=0x7effe41981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.889+0000 7effe3400640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe4104cc0 0x7effe41981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.889+0000 7effe3400640 1 -- 172.21.15.120:0/1867970569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effe41099c0 msgr2=0x7effe41a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.890+0000 7effe3400640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effe41099c0 0x7effe41a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.890+0000 7effe3400640 1 -- 172.21.15.120:0/1867970569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe41a7f40 con 0x7effe4103a80 2024-05-14T09:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.890+0000 7effe2a00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe4104cc0 0x7effe41981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.890+0000 7effe3400640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4103a80 0x7effe4197c80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7effd400e9c0 tx=0x7effd400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.893+0000 7effdbe00640 1 -- 172.21.15.120:0/1867970569 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd400ccc0 con 0x7effe4103a80 2024-05-14T09:28:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.893+0000 7effdbe00640 1 -- 172.21.15.120:0/1867970569 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd40035f0 con 0x7effe4103a80 2024-05-14T09:28:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.893+0000 7effdbe00640 1 -- 172.21.15.120:0/1867970569 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd400ce60 con 0x7effe4103a80 2024-05-14T09:28:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.894+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe41a8230 con 0x7effe4103a80 2024-05-14T09:28:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.895+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe41a8730 con 0x7effe4103a80 2024-05-14T09:28:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.899+0000 7efff11a0740 1 Processor -- start 2024-05-14T09:28:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.902+0000 7efff11a0740 1 -- start start 2024-05-14T09:28:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.903+0000 7efff11a0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed0c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.903+0000 7efff11a0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9412f0 0x559b7ed0c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.903+0000 7efff11a0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9494d0 0x559b7ed137b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.903+0000 7effe3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed0c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.903+0000 7effe3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed0c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40738/0 (socket says 172.21.15.120:40738) 2024-05-14T09:28:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.904+0000 7efff11a0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559b7ec70550 con 0x559b7e9494d0 2024-05-14T09:28:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.904+0000 7efff11a0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559b7ec15bc0 con 0x559b7e96a1b0 2024-05-14T09:28:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.904+0000 7efff11a0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b7ec6c510 con 0x559b7e9412f0 2024-05-14T09:28:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.904+0000 7effe3e00640 1 -- 172.21.15.120:0/81460333 learned_addr learned my addr 172.21.15.120:0/81460333 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.905+0000 7effe2a00640 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9494d0 0x559b7ed137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.905+0000 7effdbe00640 1 -- 172.21.15.120:0/1867970569 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7effd4004000 con 0x7effe4103a80 2024-05-14T09:28:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.906+0000 7effe3400640 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9412f0 0x559b7ed0c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.907+0000 7effe2a00640 1 -- 172.21.15.120:0/81460333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9412f0 msgr2=0x559b7ed0c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.907+0000 7effe2a00640 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9412f0 0x559b7ed0c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.907+0000 7effe2a00640 1 -- 172.21.15.120:0/81460333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 msgr2=0x559b7ed0c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.907+0000 7effe2a00640 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed0c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.907+0000 7effe2a00640 1 -- 172.21.15.120:0/81460333 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7e982210 con 0x559b7e9494d0 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.908+0000 7effe2a00640 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9494d0 0x559b7ed137b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7effd0009fa0 tx=0x7effd00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35be1235cc80a86 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.908+0000 7effcfe00640 1 -- 172.21.15.120:0/81460333 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0004030 con 0x559b7e9494d0 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.908+0000 7effcfe00640 1 -- 172.21.15.120:0/81460333 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd0005020 con 0x559b7e9494d0 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.909+0000 7effdbe00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7effc80b2930 0x7effc80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7efff11a0740 1 -- 172.21.15.120:0/81460333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9494d0 msgr2=0x559b7ed137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7efff11a0740 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9494d0 0x559b7ed137b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7effd0009fa0 tx=0x7effd00118d0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7effe3e00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7effc80b2930 0x7effc80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7efff11a0740 1 -- 172.21.15.120:0/81460333 shutdown_connections 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7efff11a0740 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9494d0 0x559b7ed137b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7efff11a0740 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9412f0 0x559b7ed0c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7efff11a0740 1 --2- 172.21.15.120:0/81460333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed0c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.910+0000 7efff11a0740 1 -- 172.21.15.120:0/81460333 >> 172.21.15.120:0/81460333 conn(0x559b7e95e300 msgr2=0x559b7ed07cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.911+0000 7efff11a0740 1 -- 172.21.15.120:0/81460333 shutdown_connections 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.911+0000 7effdbe00640 1 -- 172.21.15.120:0/1867970569 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7effd40e2730 con 0x7effe4103a80 2024-05-14T09:28:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.911+0000 7efff11a0740 1 -- 172.21.15.120:0/81460333 wait complete. 2024-05-14T09:28:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.912+0000 7effe3e00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7effc80b2930 0x7effc80b4e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7effdc0099a0 tx=0x7effdc004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.914+0000 7efff11a0740 1 -- start start 2024-05-14T09:28:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.915+0000 7efff11a0740 1 Processor -- start 2024-05-14T09:28:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.915+0000 7efff11a0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.915+0000 7efff11a0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed16380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.915+0000 7efff11a0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.915+0000 7efff11a0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559b7ed14250 con 0x559b7e9412f0 2024-05-14T09:28:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.915+0000 7efff11a0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559b7ec29660 con 0x559b7e9494d0 2024-05-14T09:28:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.915+0000 7efff11a0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b7ed143d0 con 0x559b7e96a1b0 2024-05-14T09:28:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.916+0000 7efff11a0740 10 client.0 _ll_register_callbacks cb 0x559b7ebf3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.916+0000 7effe3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.916+0000 7effe3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59474/0 (socket says 172.21.15.120:59474) 2024-05-14T09:28:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.916+0000 7effe3400640 1 -- 172.21.15.120:0/1948302771 learned_addr learned my addr 172.21.15.120:0/1948302771 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.916+0000 7effe3e00640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.917+0000 7effe2a00640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed16380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.917+0000 7effe3400640 1 -- 172.21.15.120:0/1948302771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 msgr2=0x559b7ed1d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.917+0000 7effe3400640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.917+0000 7effe3400640 1 -- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 msgr2=0x559b7ed16380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.917+0000 7effe3400640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed16380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.917+0000 7effe3400640 1 -- 172.21.15.120:0/1948302771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b7ea4e620 con 0x559b7e9412f0 2024-05-14T09:28:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.918+0000 7effe3e00640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.919+0000 7effccc00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:28:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.919+0000 7effe3400640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15e40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7effd40a96b0 tx=0x7effd40a5870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c2bcf5aeff9de2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.920+0000 7effccc00640 1 -- 172.21.15.120:0/1948302771 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40a9120 con 0x559b7e9412f0 2024-05-14T09:28:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.920+0000 7effccc00640 1 -- 172.21.15.120:0/1948302771 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7effd4003aa0 con 0x559b7e9412f0 2024-05-14T09:28:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.920+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd0005020 con 0x559b7e9412f0 2024-05-14T09:28:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.920+0000 7effccc00640 1 -- 172.21.15.120:0/1948302771 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7effd40042f0 con 0x559b7e9412f0 2024-05-14T09:28:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.921+0000 7efff11a0740 10 client.16248 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.921+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559b7ed20330 con 0x559b7e9412f0 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.921+0000 7effccc00640 1 -- 172.21.15.120:0/1948302771 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd0005020 con 0x559b7e9412f0 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.923+0000 7effccc00640 1 -- 172.21.15.120:0/1948302771 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7effd40aace0 con 0x559b7e9412f0 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.923+0000 7efff11a0740 10 client.16248 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.923+0000 7efff11a0740 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.923+0000 7efff11a0740 20 client.16248 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.923+0000 7efff11a0740 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e928d80 0x559b7ed23a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.923+0000 7efff11a0740 4 client.16248 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.923+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b7ec7e160 con 0x559b7e928d80 2024-05-14T09:28:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.924+0000 7effe2a00640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e928d80 0x559b7ed23a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.925+0000 7effe2a00640 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e928d80 0x559b7ed23a40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=505a869a8d0d512e server_cookie=c083885274cab3a9 in_seq=0 out_seq=0 2024-05-14T09:28:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.925+0000 7effccc00640 10 client.16248 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.928+0000 7effccc00640 1 -- 172.21.15.120:0/1948302771 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559b7ec7e160 con 0x559b7e928d80 2024-05-14T09:28:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.928+0000 7effccc00640 10 client.16248 handle_command_reply: tid=0 2024-05-14T09:28:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.928+0000 7efff11a0740 1 client.16248 shutdown 2024-05-14T09:28:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.929+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 msgr2=0x559b7ed15e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.929+0000 7efff11a0740 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15e40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7effd40a96b0 tx=0x7effd40a5870 comp rx=0 tx=0).stop 2024-05-14T09:28:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.930+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 shutdown_connections 2024-05-14T09:28:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.930+0000 7efff11a0740 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e928d80 0x559b7ed23a40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.930+0000 7efff11a0740 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.930+0000 7efff11a0740 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed16380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.930+0000 7efff11a0740 1 --2- 172.21.15.120:0/1948302771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15e40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.930+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 >> 172.21.15.120:0/1948302771 conn(0x559b7e95e300 msgr2=0x559b7ed06c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.930+0000 7effccc00640 0 client.16248 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.931+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 shutdown_connections 2024-05-14T09:28:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.931+0000 7efff11a0740 1 -- 172.21.15.120:0/1948302771 wait complete. 2024-05-14T09:28:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.931+0000 7efff11a0740 20 client.16248 trim_cache size 0 max 16384 2024-05-14T09:28:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 Processor -- start 2024-05-14T09:28:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 -- start start 2024-05-14T09:28:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9494d0 0x559b7ed1d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed15f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b2b80 con 0x559b7e9412f0 2024-05-14T09:28:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b46f0 con 0x559b7e96a1b0 2024-05-14T09:28:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.967+0000 7efff11a0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b3250 con 0x559b7e9494d0 2024-05-14T09:28:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.968+0000 7effe2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9494d0 0x559b7ed1d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.968+0000 7effe3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.969+0000 7effe2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9494d0 0x559b7ed1d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45448/0 (socket says 172.21.15.120:45448) 2024-05-14T09:28:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.969+0000 7effe2a00640 1 -- 172.21.15.120:0/3229214972 learned_addr learned my addr 172.21.15.120:0/3229214972 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.969+0000 7effe3e00640 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed15f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.970+0000 7effe3400640 1 -- 172.21.15.120:0/3229214972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9494d0 msgr2=0x559b7ed1d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.970+0000 7effe3400640 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9494d0 0x559b7ed1d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.970+0000 7effe3400640 1 -- 172.21.15.120:0/3229214972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 msgr2=0x559b7ed15f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.970+0000 7effe3400640 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed15f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.970+0000 7effe3400640 1 -- 172.21.15.120:0/3229214972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7ed034a0 con 0x559b7e9412f0 2024-05-14T09:28:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.971+0000 7effe2a00640 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9494d0 0x559b7ed1d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:01.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.971+0000 7effe3400640 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15a10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7effd40a9940 tx=0x7effd40a59a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce54e4fd15c447a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.972+0000 7effcf400640 1 -- 172.21.15.120:0/3229214972 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40a9120 con 0x559b7e9412f0 2024-05-14T09:28:01.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.973+0000 7effcf400640 1 -- 172.21.15.120:0/3229214972 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd40e2430 con 0x559b7e9412f0 2024-05-14T09:28:01.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.973+0000 7effcf400640 1 -- 172.21.15.120:0/3229214972 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40a9780 con 0x559b7e9412f0 2024-05-14T09:28:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.974+0000 7efff11a0740 1 -- 172.21.15.120:0/3229214972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 msgr2=0x559b7ed15a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.974+0000 7efff11a0740 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15a10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7effd40a9940 tx=0x7effd40a59a0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.975+0000 7efff11a0740 1 -- 172.21.15.120:0/3229214972 shutdown_connections 2024-05-14T09:28:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.975+0000 7efff11a0740 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e96a1b0 0x559b7ed15f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.975+0000 7efff11a0740 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e9494d0 0x559b7ed1d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.975+0000 7efff11a0740 1 --2- 172.21.15.120:0/3229214972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed15a10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.975+0000 7efff11a0740 1 -- 172.21.15.120:0/3229214972 >> 172.21.15.120:0/3229214972 conn(0x559b7e95e300 msgr2=0x559b7ed0c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.975+0000 7efff11a0740 1 -- 172.21.15.120:0/3229214972 shutdown_connections 2024-05-14T09:28:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.975+0000 7efff11a0740 1 -- 172.21.15.120:0/3229214972 wait complete. 2024-05-14T09:28:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.976+0000 7efff11a0740 1 -- start start 2024-05-14T09:28:01.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.976+0000 7efff11a0740 1 Processor -- start 2024-05-14T09:28:01.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7efff11a0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed1bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7efff11a0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed1c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7efff11a0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7efff11a0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b4020 con 0x559b7e9412f0 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7efff11a0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b3950 con 0x559b7e9494d0 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7efff11a0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b0b80 con 0x559b7e96a1b0 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7efff11a0740 10 client.0 _ll_register_callbacks cb 0x7effd40e8240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7effe3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed1bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7effe2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed1c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.977+0000 7effe3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed1c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40760/0 (socket says 172.21.15.120:40760) 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe2a00640 1 -- 172.21.15.120:0/2192592338 learned_addr learned my addr 172.21.15.120:0/2192592338 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe3e00640 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45458/0 (socket says 172.21.15.120:45458) 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe3e00640 1 -- 172.21.15.120:0/2192592338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 msgr2=0x559b7ed1c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe3e00640 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed1c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe3e00640 1 -- 172.21.15.120:0/2192592338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 msgr2=0x559b7ed1bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe3e00640 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed1bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe3e00640 1 -- 172.21.15.120:0/2192592338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b7ed08260 con 0x559b7e96a1b0 2024-05-14T09:28:01.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.978+0000 7effe3400640 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed1bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.979+0000 7effe3e00640 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1c630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effdc009b30 tx=0x7effdc02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f7b7542a6e611e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.980+0000 7effccc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.980+0000 7effccc00640 1 -- 172.21.15.120:0/2192592338 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc036050 con 0x559b7e96a1b0 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.980+0000 7effccc00640 1 -- 172.21.15.120:0/2192592338 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7effdc004510 con 0x559b7e96a1b0 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.981+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b7ec77fd0 con 0x559b7e96a1b0 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.981+0000 7effccc00640 1 -- 172.21.15.120:0/2192592338 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7effdc004710 con 0x559b7e96a1b0 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.981+0000 7efff11a0740 10 client.25801 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.981+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559b7ed8af30 con 0x559b7e96a1b0 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.982+0000 7effccc00640 1 -- 172.21.15.120:0/2192592338 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559b7ec77fd0 con 0x559b7e96a1b0 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.983+0000 7effccc00640 1 -- 172.21.15.120:0/2192592338 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7effdc03e440 con 0x559b7e96a1b0 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.983+0000 7efff11a0740 10 client.25801 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.983+0000 7efff11a0740 10 client.25801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.983+0000 7efff11a0740 20 client.25801 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.983+0000 7efff11a0740 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e8fe1c0 0x559b7ed8d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.983+0000 7efff11a0740 4 client.25801 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:28:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.983+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b7ebf34b0 con 0x559b7e8fe1c0 2024-05-14T09:28:01.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.985+0000 7effe3400640 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e8fe1c0 0x559b7ed8d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.986+0000 7effe3400640 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e8fe1c0 0x559b7ed8d950 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cd135db63094329 server_cookie=36c0ec040c8b009e in_seq=0 out_seq=0 2024-05-14T09:28:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:01.986+0000 7effccc00640 10 client.25801 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7effccc00640 1 -- 172.21.15.120:0/2192592338 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b7ebf34b0 con 0x559b7e8fe1c0 2024-05-14T09:28:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7effccc00640 10 client.25801 handle_command_reply: tid=0 2024-05-14T09:28:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 client.25801 shutdown 2024-05-14T09:28:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 msgr2=0x559b7ed1c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1c630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effdc009b30 tx=0x7effdc02a6c0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 shutdown_connections 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559b7e8fe1c0 0x559b7ed8d950 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b7e96a1b0 0x559b7ed1c630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559b7e9494d0 0x559b7ed1c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 --2- 172.21.15.120:0/2192592338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b7e9412f0 0x559b7ed1bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 >> 172.21.15.120:0/2192592338 conn(0x559b7e95e300 msgr2=0x559b7ed15a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.020+0000 7effccc00640 0 client.25801 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.021+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 shutdown_connections 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.021+0000 7efff11a0740 1 -- 172.21.15.120:0/2192592338 wait complete. 2024-05-14T09:28:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.022+0000 7efff11a0740 20 client.25801 trim_cache size 0 max 16384 2024-05-14T09:28:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:28:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:28:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:28:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.024+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7effc80b2930 msgr2=0x7effc80b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.024+0000 7effe8c00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7effc80b2930 0x7effc80b4e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7effdc0099a0 tx=0x7effdc004a40 comp rx=0 tx=0).stop 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.024+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4103a80 msgr2=0x7effe4197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.024+0000 7effe8c00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4103a80 0x7effe4197c80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7effd400e9c0 tx=0x7effd400ee80 comp rx=0 tx=0).stop 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.025+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 shutdown_connections 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.025+0000 7effe8c00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7effc80b2930 0x7effc80b4e40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.025+0000 7effe8c00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effe41099c0 0x7effe41a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.025+0000 7effe8c00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effe4104cc0 0x7effe41981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.025+0000 7effe8c00640 1 --2- 172.21.15.120:0/1867970569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effe4103a80 0x7effe4197c80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.025+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 >> 172.21.15.120:0/1867970569 conn(0x7effe40fec70 msgr2=0x7effe40ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.026+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 shutdown_connections 2024-05-14T09:28:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:02.027+0000 7effe8c00640 1 -- 172.21.15.120:0/1867970569 wait complete. 2024-05-14T09:28:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:01 smithi152 ceph-mon[34868]: pgmap v690: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 917 op/s 2024-05-14T09:28:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:01 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:28:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:01 smithi175 ceph-mon[35353]: pgmap v690: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 917 op/s 2024-05-14T09:28:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:01 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:28:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:01 smithi120 ceph-mon[31085]: pgmap v690: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 917 op/s 2024-05-14T09:28:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:01 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:28:03.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T09:28:04.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:03 smithi120 ceph-mon[31085]: pgmap v691: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 853 op/s 2024-05-14T09:28:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:03 smithi152 ceph-mon[34868]: pgmap v691: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 853 op/s 2024-05-14T09:28:04.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:03 smithi175 ceph-mon[35353]: pgmap v691: 129 pgs: 129 active+clean; 935 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 853 op/s 2024-05-14T09:28:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 30.0 s, 625.0 tps, lat 159.591 ms stddev 55.713 2024-05-14T09:28:04.629 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:28:06.131 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:05 smithi120 ceph-mon[31085]: pgmap v692: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.0 MiB/s wr, 839 op/s 2024-05-14T09:28:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:05 smithi152 ceph-mon[34868]: pgmap v692: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.0 MiB/s wr, 839 op/s 2024-05-14T09:28:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:05 smithi175 ceph-mon[35353]: pgmap v692: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.0 MiB/s wr, 839 op/s 2024-05-14T09:28:07.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.204+0000 7fe17cc00700 1 -- 172.21.15.120:0/3264198490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1781034c0 msgr2=0x7fe1781038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.204+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3264198490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1781034c0 0x7fe1781038d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe168014a30 tx=0x7fe168014d40 comp rx=0 tx=0).stop 2024-05-14T09:28:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.205+0000 7fe17cc00700 1 -- 172.21.15.120:0/3264198490 shutdown_connections 2024-05-14T09:28:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.205+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3264198490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1781034c0 0x7fe1781038d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.205+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3264198490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe178108740 0x7fe17806b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.205+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3264198490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe178107df0 0x7fe178108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.205+0000 7fe17cc00700 1 -- 172.21.15.120:0/3264198490 >> 172.21.15.120:0/3264198490 conn(0x7fe1780fedc0 msgr2=0x7fe1781011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:07.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.206+0000 7fe17cc00700 1 -- 172.21.15.120:0/3264198490 shutdown_connections 2024-05-14T09:28:07.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.206+0000 7fe17cc00700 1 -- 172.21.15.120:0/3264198490 wait complete. 2024-05-14T09:28:07.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.208+0000 7fe17cc00700 1 Processor -- start 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.208+0000 7fe17cc00700 1 -- start start 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.208+0000 7fe17cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1781034c0 0x7fe1781af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe17cc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe178107df0 0x7fe1781afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe17cc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178108740 0x7fe1781a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe17cc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1781122b0 con 0x7fe1781034c0 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe17cc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe17810bff0 con 0x7fe178108740 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe17cc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe178112430 con 0x7fe178107df0 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe175e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1781034c0 0x7fe1781af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe16d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe178107df0 0x7fe1781afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe175e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1781034c0 0x7fe1781af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59500/0 (socket says 172.21.15.120:59500) 2024-05-14T09:28:07.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.209+0000 7fe175e00700 1 -- 172.21.15.120:0/3029908557 learned_addr learned my addr 172.21.15.120:0/3029908557 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:07.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.210+0000 7fe16d400700 1 -- 172.21.15.120:0/3029908557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178108740 msgr2=0x7fe1781a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.210+0000 7fe16d400700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178108740 0x7fe1781a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.210+0000 7fe16d400700 1 -- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1781034c0 msgr2=0x7fe1781af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.210+0000 7fe16d400700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1781034c0 0x7fe1781af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.210+0000 7fe16d400700 1 -- 172.21.15.120:0/3029908557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1781aa260 con 0x7fe178107df0 2024-05-14T09:28:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.210+0000 7fe16d400700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe178107df0 0x7fe1781afee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe16000e9c0 tx=0x7fe16000ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.211+0000 7fe16f400700 1 -- 172.21.15.120:0/3029908557 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16000cbd0 con 0x7fe178107df0 2024-05-14T09:28:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.211+0000 7fe175e00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1781034c0 0x7fe1781af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.211+0000 7fe16f400700 1 -- 172.21.15.120:0/3029908557 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe16000cd70 con 0x7fe178107df0 2024-05-14T09:28:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.211+0000 7fe16f400700 1 -- 172.21.15.120:0/3029908557 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160018680 con 0x7fe178107df0 2024-05-14T09:28:07.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.211+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1781aa550 con 0x7fe178107df0 2024-05-14T09:28:07.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.212+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17806d1e0 con 0x7fe178107df0 2024-05-14T09:28:07.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.220+0000 7fe16f400700 1 -- 172.21.15.120:0/3029908557 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe160010430 con 0x7fe178107df0 2024-05-14T09:28:07.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.223+0000 7fe16f400700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe15c0b2980 0x7fe15c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.223+0000 7fe16f400700 1 -- 172.21.15.120:0/3029908557 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe1600e27f0 con 0x7fe178107df0 2024-05-14T09:28:07.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.224+0000 7fe175e00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe15c0b2980 0x7fe15c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.224+0000 7fe18b7b8b80 1 Processor -- start 2024-05-14T09:28:07.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.224+0000 7fe18b7b8b80 1 -- start start 2024-05-14T09:28:07.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.224+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.224+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7a830 0x557bd1e744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.224+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e74e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.224+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557bd1d96a20 con 0x557bd1cf6e40 2024-05-14T09:28:07.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.225+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557bd1d34760 con 0x557bd1e749f0 2024-05-14T09:28:07.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.225+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557bd1d929e0 con 0x557bd1e7a830 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.225+0000 7fe16d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7a830 0x557bd1e744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.225+0000 7fe16d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7a830 0x557bd1e744b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45480/0 (socket says 172.21.15.120:45480) 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.225+0000 7fe16d400700 1 -- 172.21.15.120:0/3734477810 learned_addr learned my addr 172.21.15.120:0/3734477810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.225+0000 7fe176800700 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e74e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.225+0000 7fe175e00700 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.226+0000 7fe16d400700 1 -- 172.21.15.120:0/3734477810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 msgr2=0x557bd1e74e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.226+0000 7fe16d400700 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e74e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.226+0000 7fe16d400700 1 -- 172.21.15.120:0/3734477810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 msgr2=0x557bd1e7a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.226+0000 7fe16d400700 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.226+0000 7fe16d400700 1 -- 172.21.15.120:0/3734477810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd1ce38d0 con 0x557bd1e7a830 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.226+0000 7fe16d400700 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7a830 0x557bd1e744b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1600a6c80 tx=0x7fe1600a9180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53c742bf2ec264be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:07.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.226+0000 7fe175e00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe15c0b2980 0x7fe15c0b4e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe1680062a0 tx=0x7fe168006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:07.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.229+0000 7fe167400700 1 -- 172.21.15.120:0/3734477810 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1600a9520 con 0x557bd1e7a830 2024-05-14T09:28:07.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.229+0000 7fe167400700 1 -- 172.21.15.120:0/3734477810 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1600aa110 con 0x557bd1e7a830 2024-05-14T09:28:07.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.229+0000 7fe167400700 1 -- 172.21.15.120:0/3734477810 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160010950 con 0x557bd1e7a830 2024-05-14T09:28:07.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.230+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3734477810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7a830 msgr2=0x557bd1e744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.230+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7a830 0x557bd1e744b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1600a6c80 tx=0x7fe1600a9180 comp rx=0 tx=0).stop 2024-05-14T09:28:07.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.230+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3734477810 shutdown_connections 2024-05-14T09:28:07.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.230+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e74e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.230+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.230+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3734477810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7a830 0x557bd1e744b0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1600a6c80 tx=0x7fe1600a9180 comp rx=0 tx=0).stop 2024-05-14T09:28:07.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.230+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3734477810 >> 172.21.15.120:0/3734477810 conn(0x557bd1d3bf70 msgr2=0x557bd1e6f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:07.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.232+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3734477810 shutdown_connections 2024-05-14T09:28:07.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.232+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3734477810 wait complete. 2024-05-14T09:28:07.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.233+0000 7fe18b7b8b80 1 -- start start 2024-05-14T09:28:07.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.234+0000 7fe18b7b8b80 1 Processor -- start 2024-05-14T09:28:07.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.235+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.235+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e7e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.235+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e8a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.235+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557bd1e81310 con 0x557bd1cf6e40 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.235+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557bd1cfcb20 con 0x557bd1e749f0 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.235+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557bd1e81490 con 0x557bd1e7eac0 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e8a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e8a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45492/0 (socket says 172.21.15.120:45492) 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 -- 172.21.15.120:0/1119208882 learned_addr learned my addr 172.21.15.120:0/1119208882 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe175e00700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe18b7b8b80 10 client.0 _ll_register_callbacks cb 0x557bd1d3dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 -- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 msgr2=0x557bd1e7e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe16d400700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e7e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e7e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 -- 172.21.15.120:0/1119208882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 msgr2=0x557bd1e7e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe176800700 1 -- 172.21.15.120:0/1119208882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd1d5c420 con 0x557bd1e7eac0 2024-05-14T09:28:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.236+0000 7fe175e00700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.237+0000 7fe16d400700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e7e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.237+0000 7fe176800700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e8a780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe170003930 tx=0x7fe170003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac023de0de65bdb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.237+0000 7fe15be00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.237+0000 7fe15be00700 1 -- 172.21.15.120:0/1119208882 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170003e10 con 0x557bd1e7eac0 2024-05-14T09:28:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.237+0000 7fe15be00700 1 -- 172.21.15.120:0/1119208882 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe170004830 con 0x557bd1e7eac0 2024-05-14T09:28:07.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.238+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1600aa110 con 0x557bd1e7eac0 2024-05-14T09:28:07.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.238+0000 7fe15be00700 1 -- 172.21.15.120:0/1119208882 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe170004a30 con 0x557bd1e7eac0 2024-05-14T09:28:07.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.239+0000 7fe18b7b8b80 10 client.25813 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:07.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.239+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x557bd1e8c3c0 con 0x557bd1e7eac0 2024-05-14T09:28:07.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe15be00700 1 -- 172.21.15.120:0/1119208882 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1600aa110 con 0x557bd1e7eac0 2024-05-14T09:28:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe15be00700 1 -- 172.21.15.120:0/1119208882 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7fe170019620 con 0x557bd1e7eac0 2024-05-14T09:28:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe18b7b8b80 10 client.25813 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe18b7b8b80 10 client.25813 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:28:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe18b7b8b80 20 client.25813 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1e8ea00 0x557bd1e90e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe18b7b8b80 4 client.25813 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.240+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bd1e411c0 con 0x557bd1e8ea00 2024-05-14T09:28:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.241+0000 7fe175e00700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1e8ea00 0x557bd1e90e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.243+0000 7fe15be00700 10 client.25813 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:28:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.245+0000 7fe175e00700 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1e8ea00 0x557bd1e90e20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c5770d07003b9ae server_cookie=fae68f9d0226ade1 in_seq=0 out_seq=0 2024-05-14T09:28:07.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.247+0000 7fe15be00700 1 -- 172.21.15.120:0/1119208882 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557bd1e411c0 con 0x557bd1e8ea00 2024-05-14T09:28:07.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.247+0000 7fe15be00700 10 client.25813 handle_command_reply: tid=0 2024-05-14T09:28:07.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.247+0000 7fe18b7b8b80 1 client.25813 shutdown 2024-05-14T09:28:07.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 msgr2=0x557bd1e8a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e8a780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe170003930 tx=0x7fe170003cf0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 shutdown_connections 2024-05-14T09:28:07.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1e8ea00 0x557bd1e90e20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e8a780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e7e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/1119208882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e7e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 >> 172.21.15.120:0/1119208882 conn(0x557bd1d3bf70 msgr2=0x557bd1e734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:07.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe15be00700 0 client.25813 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:28:07.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 shutdown_connections 2024-05-14T09:28:07.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.248+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/1119208882 wait complete. 2024-05-14T09:28:07.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.249+0000 7fe18b7b8b80 20 client.25813 trim_cache size 0 max 16384 2024-05-14T09:28:07.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.279+0000 7fe18b7b8b80 1 Processor -- start 2024-05-14T09:28:07.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.280+0000 7fe18b7b8b80 1 -- start start 2024-05-14T09:28:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.280+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.280+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e798b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.280+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.280+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1781c7a60 con 0x557bd1cf6e40 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.280+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1781c95d0 con 0x557bd1e749f0 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.280+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1781c8130 con 0x557bd1e7eac0 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.281+0000 7fe176800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.281+0000 7fe176800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45506/0 (socket says 172.21.15.120:45506) 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.281+0000 7fe176800700 1 -- 172.21.15.120:0/2906664209 learned_addr learned my addr 172.21.15.120:0/2906664209 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.281+0000 7fe16d400700 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.282+0000 7fe176800700 1 -- 172.21.15.120:0/2906664209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 msgr2=0x557bd1e798b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.282+0000 7fe176800700 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e798b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.282+0000 7fe176800700 1 -- 172.21.15.120:0/2906664209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 msgr2=0x557bd1e744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.282+0000 7fe176800700 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.282+0000 7fe176800700 1 -- 172.21.15.120:0/2906664209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd1e808e0 con 0x557bd1e7eac0 2024-05-14T09:28:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.283+0000 7fe176800700 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e965e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe170005e90 tx=0x7fe170003e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e1f32ba0c23f4a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.283+0000 7fe166a00700 1 -- 172.21.15.120:0/2906664209 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17000bd30 con 0x557bd1e7eac0 2024-05-14T09:28:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.283+0000 7fe166a00700 1 -- 172.21.15.120:0/2906664209 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe17002b030 con 0x557bd1e7eac0 2024-05-14T09:28:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.283+0000 7fe166a00700 1 -- 172.21.15.120:0/2906664209 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170011ac0 con 0x557bd1e7eac0 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/2906664209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 msgr2=0x557bd1e965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e965e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe170005e90 tx=0x7fe170003e10 comp rx=0 tx=0).stop 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/2906664209 shutdown_connections 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e7eac0 0x557bd1e965e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1cf6e40 0x557bd1e744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/2906664209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1e749f0 0x557bd1e798b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/2906664209 >> 172.21.15.120:0/2906664209 conn(0x557bd1d3bf70 msgr2=0x557bd1e791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/2906664209 shutdown_connections 2024-05-14T09:28:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.285+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/2906664209 wait complete. 2024-05-14T09:28:07.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.286+0000 7fe18b7b8b80 1 -- start start 2024-05-14T09:28:07.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.286+0000 7fe18b7b8b80 1 Processor -- start 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.287+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1cf6e40 0x557bd1e866e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.287+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e749f0 0x557bd1e86c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.287+0000 7fe18b7b8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1e7eac0 0x557bd1e89350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.287+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1781c8f00 con 0x557bd1e7eac0 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.287+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1781c8830 con 0x557bd1cf6e40 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.287+0000 7fe18b7b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe178073cb0 con 0x557bd1e749f0 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.287+0000 7fe18b7b8b80 10 client.0 _ll_register_callbacks cb 0x557bd1d3dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.288+0000 7fe176800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1e7eac0 0x557bd1e89350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.288+0000 7fe16d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e749f0 0x557bd1e86c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.288+0000 7fe16d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e749f0 0x557bd1e86c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45508/0 (socket says 172.21.15.120:45508) 2024-05-14T09:28:07.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.288+0000 7fe16d400700 1 -- 172.21.15.120:0/3908713514 learned_addr learned my addr 172.21.15.120:0/3908713514 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:07.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.288+0000 7fe175e00700 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1cf6e40 0x557bd1e866e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.289+0000 7fe16d400700 1 -- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1cf6e40 msgr2=0x557bd1e866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.289+0000 7fe16d400700 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1cf6e40 0x557bd1e866e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.289+0000 7fe16d400700 1 -- 172.21.15.120:0/3908713514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1e7eac0 msgr2=0x557bd1e89350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:07.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.289+0000 7fe16d400700 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1e7eac0 0x557bd1e89350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.289+0000 7fe16d400700 1 -- 172.21.15.120:0/3908713514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd1e8b0d0 con 0x557bd1e749f0 2024-05-14T09:28:07.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.290+0000 7fe16d400700 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e749f0 0x557bd1e86c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1600a99a0 tx=0x7fe1600a9480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba94c42a0f7b8fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:07.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.290+0000 7fe15be00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:07.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.290+0000 7fe15be00700 1 -- 172.21.15.120:0/3908713514 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1600bee60 con 0x557bd1e749f0 2024-05-14T09:28:07.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.291+0000 7fe15be00700 1 -- 172.21.15.120:0/3908713514 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe1600cc0b0 con 0x557bd1e749f0 2024-05-14T09:28:07.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.291+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe17002b030 con 0x557bd1e749f0 2024-05-14T09:28:07.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.291+0000 7fe15be00700 1 -- 172.21.15.120:0/3908713514 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe1600a9520 con 0x557bd1e749f0 2024-05-14T09:28:07.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.292+0000 7fe18b7b8b80 10 client.25819 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:07.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.292+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x557bd1ef86e0 con 0x557bd1e749f0 2024-05-14T09:28:07.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.292+0000 7fe15be00700 1 -- 172.21.15.120:0/3908713514 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe17002b030 con 0x557bd1e749f0 2024-05-14T09:28:07.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.292+0000 7fe15be00700 1 -- 172.21.15.120:0/3908713514 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7fe160089020 con 0x557bd1e749f0 2024-05-14T09:28:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.293+0000 7fe18b7b8b80 10 client.25819 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.293+0000 7fe18b7b8b80 10 client.25819 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:28:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.293+0000 7fe18b7b8b80 20 client.25819 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.293+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1ef8910 0x557bd1efad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.293+0000 7fe18b7b8b80 4 client.25819 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:28:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.293+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557bd1da4400 con 0x557bd1ef8910 2024-05-14T09:28:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.293+0000 7fe175e00700 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1ef8910 0x557bd1efad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.294+0000 7fe15be00700 10 client.25819 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:28:07.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.296+0000 7fe175e00700 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1ef8910 0x557bd1efad30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a39b00709c0a6707 server_cookie=30af62e8d2508797 in_seq=0 out_seq=0 2024-05-14T09:28:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.297+0000 7fe15be00700 1 -- 172.21.15.120:0/3908713514 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557bd1da4400 con 0x557bd1ef8910 2024-05-14T09:28:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.297+0000 7fe15be00700 10 client.25819 handle_command_reply: tid=0 2024-05-14T09:28:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.297+0000 7fe18b7b8b80 1 client.25819 shutdown 2024-05-14T09:28:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.297+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e749f0 msgr2=0x557bd1e86c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.297+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e749f0 0x557bd1e86c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1600a99a0 tx=0x7fe1600a9480 comp rx=0 tx=0).stop 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 shutdown_connections 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x557bd1ef8910 0x557bd1efad30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557bd1cf6e40 0x557bd1e866e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557bd1e7eac0 0x557bd1e89350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 --2- 172.21.15.120:0/3908713514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bd1e749f0 0x557bd1e86c20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 >> 172.21.15.120:0/3908713514 conn(0x557bd1d3bf70 msgr2=0x557bd1e791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe15be00700 0 client.25819 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 shutdown_connections 2024-05-14T09:28:07.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.298+0000 7fe18b7b8b80 1 -- 172.21.15.120:0/3908713514 wait complete. 2024-05-14T09:28:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.299+0000 7fe18b7b8b80 20 client.25819 trim_cache size 0 max 16384 2024-05-14T09:28:07.299 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:28:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.300+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe15c0b2980 msgr2=0x7fe15c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.300+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe15c0b2980 0x7fe15c0b4e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe1680062a0 tx=0x7fe168006230 comp rx=0 tx=0).stop 2024-05-14T09:28:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.300+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe178107df0 msgr2=0x7fe1781afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.300+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe178107df0 0x7fe1781afee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe16000e9c0 tx=0x7fe16000ed80 comp rx=0 tx=0).stop 2024-05-14T09:28:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 shutdown_connections 2024-05-14T09:28:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe15c0b2980 0x7fe15c0b4e90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178108740 0x7fe1781a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1781034c0 0x7fe1781af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 --2- 172.21.15.120:0/3029908557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe178107df0 0x7fe1781afee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:07.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 >> 172.21.15.120:0/3029908557 conn(0x7fe1780fedc0 msgr2=0x7fe178105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:07.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 shutdown_connections 2024-05-14T09:28:07.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:07.301+0000 7fe17cc00700 1 -- 172.21.15.120:0/3029908557 wait complete. 2024-05-14T09:28:08.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:07 smithi120 ceph-mon[31085]: pgmap v693: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 800 op/s 2024-05-14T09:28:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:07 smithi152 ceph-mon[34868]: pgmap v693: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 800 op/s 2024-05-14T09:28:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:07 smithi175 ceph-mon[35353]: pgmap v693: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 800 op/s 2024-05-14T09:28:08.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T09:28:09.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 35.0 s, 558.8 tps, lat 178.297 ms stddev 92.410 2024-05-14T09:28:09.534 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:28:10.195 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:09 smithi120 ceph-mon[31085]: pgmap v694: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 764 op/s 2024-05-14T09:28:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:09 smithi152 ceph-mon[34868]: pgmap v694: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 764 op/s 2024-05-14T09:28:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:09 smithi175 ceph-mon[35353]: pgmap v694: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 764 op/s 2024-05-14T09:28:12.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.104+0000 7fba90a00700 1 -- 172.21.15.120:0/3726360161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c104400 msgr2=0x7fba8c104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.104+0000 7fba90a00700 1 --2- 172.21.15.120:0/3726360161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c104400 0x7fba8c104810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009990 tx=0x7fba7c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.105+0000 7fba90a00700 1 -- 172.21.15.120:0/3726360161 shutdown_connections 2024-05-14T09:28:12.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.105+0000 7fba90a00700 1 --2- 172.21.15.120:0/3726360161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c104400 0x7fba8c104810 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.105+0000 7fba90a00700 1 --2- 172.21.15.120:0/3726360161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c109680 0x7fba8c110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.105+0000 7fba90a00700 1 --2- 172.21.15.120:0/3726360161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8c108d30 0x7fba8c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.105+0000 7fba90a00700 1 -- 172.21.15.120:0/3726360161 >> 172.21.15.120:0/3726360161 conn(0x7fba8c079d10 msgr2=0x7fba8c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:12.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.106+0000 7fba90a00700 1 -- 172.21.15.120:0/3726360161 shutdown_connections 2024-05-14T09:28:12.106 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:11 smithi120 ceph-mon[31085]: pgmap v695: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 746 op/s 2024-05-14T09:28:12.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.106+0000 7fba90a00700 1 -- 172.21.15.120:0/3726360161 wait complete. 2024-05-14T09:28:12.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.108+0000 7fba90a00700 1 Processor -- start 2024-05-14T09:28:12.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.108+0000 7fba90a00700 1 -- start start 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.109+0000 7fba90a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c104400 0x7fba8c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba90a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8c108d30 0x7fba8c19d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba90a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c109680 0x7fba8c1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba90a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c0762f0 con 0x7fba8c108d30 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba90a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c076170 con 0x7fba8c109680 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba90a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c076470 con 0x7fba8c104400 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba8b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c104400 0x7fba8c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba8b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c104400 0x7fba8c19ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50324/0 (socket says 172.21.15.120:50324) 2024-05-14T09:28:12.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba8b400700 1 -- 172.21.15.120:0/2243518262 learned_addr learned my addr 172.21.15.120:0/2243518262 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:12.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.110+0000 7fba8be00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c109680 0x7fba8c1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.111+0000 7fba8b400700 1 -- 172.21.15.120:0/2243518262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c109680 msgr2=0x7fba8c1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.111+0000 7fba8b400700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c109680 0x7fba8c1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.111+0000 7fba8b400700 1 -- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8c108d30 msgr2=0x7fba8c19d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.111+0000 7fba8b400700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8c108d30 0x7fba8c19d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.111+0000 7fba8b400700 1 -- 172.21.15.120:0/2243518262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c1a1cb0 con 0x7fba8c104400 2024-05-14T09:28:12.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.111+0000 7fba8be00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c109680 0x7fba8c1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:12.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.112+0000 7fba8b400700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c104400 0x7fba8c19ce30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006010 tx=0x7fba7c003a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:12.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.113+0000 7fba83e00700 1 -- 172.21.15.120:0/2243518262 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c027070 con 0x7fba8c104400 2024-05-14T09:28:12.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.113+0000 7fba83e00700 1 -- 172.21.15.120:0/2243518262 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba7c00bdd0 con 0x7fba8c104400 2024-05-14T09:28:12.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.113+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8c1a1f40 con 0x7fba8c104400 2024-05-14T09:28:12.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.113+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8c1a98c0 con 0x7fba8c104400 2024-05-14T09:28:12.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.114+0000 7fba83e00700 1 -- 172.21.15.120:0/2243518262 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c00f460 con 0x7fba8c104400 2024-05-14T09:28:12.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.120+0000 7fbaa0a79b80 1 Processor -- start 2024-05-14T09:28:12.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.120+0000 7fbaa0a79b80 1 -- start start 2024-05-14T09:28:12.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.120+0000 7fba83e00700 1 -- 172.21.15.120:0/2243518262 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fba7c009d10 con 0x7fba8c104400 2024-05-14T09:28:12.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.121+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e2cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e2d290 0x55dc73e26f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e27860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dc73d40a20 con 0x55dc73e27450 2024-05-14T09:28:12.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc73cde760 con 0x55dc73ca0e40 2024-05-14T09:28:12.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dc73d3c9e0 con 0x55dc73e2d290 2024-05-14T09:28:12.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fba8be00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e2cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fba8be00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e2cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55370/0 (socket says 172.21.15.120:55370) 2024-05-14T09:28:12.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.122+0000 7fba8be00700 1 -- 172.21.15.120:0/1909026694 learned_addr learned my addr 172.21.15.120:0/1909026694 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:12.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba8aa00700 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e27860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba83e00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba700b2980 0x7fba700b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba8be00700 1 -- 172.21.15.120:0/1909026694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e2d290 msgr2=0x55dc73e26f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:28:12.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba83e00700 1 -- 172.21.15.120:0/2243518262 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fba7c0e3810 con 0x7fba8c104400 2024-05-14T09:28:12.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba8be00700 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e2d290 0x55dc73e26f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba8be00700 1 -- 172.21.15.120:0/1909026694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 msgr2=0x55dc73e27860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:12.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba8be00700 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e27860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.123+0000 7fba8be00700 1 -- 172.21.15.120:0/1909026694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc73c8d8d0 con 0x55dc73ca0e40 2024-05-14T09:28:12.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.124+0000 7fba8be00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba700b2980 0x7fba700b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.124+0000 7fba8be00700 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e2cd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba84009550 tx=0x7fba840079f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48f307fb735752a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:12.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.124+0000 7fba80c00700 1 -- 172.21.15.120:0/1909026694 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84012970 con 0x55dc73ca0e40 2024-05-14T09:28:12.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.124+0000 7fba80c00700 1 -- 172.21.15.120:0/1909026694 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba84012df0 con 0x55dc73ca0e40 2024-05-14T09:28:12.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.124+0000 7fba80c00700 1 -- 172.21.15.120:0/1909026694 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8401f990 con 0x55dc73ca0e40 2024-05-14T09:28:12.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.126+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1909026694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 msgr2=0x55dc73e2cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.126+0000 7fba8be00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba700b2980 0x7fba700b4e90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba8401c000 tx=0x7fba84014680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:12.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.126+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e2cd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba84009550 tx=0x7fba840079f0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.126+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1909026694 shutdown_connections 2024-05-14T09:28:12.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.126+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e2cd50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.126+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e27860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.126+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1909026694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e2d290 0x55dc73e26f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.127+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1909026694 >> 172.21.15.120:0/1909026694 conn(0x55dc73ce5f70 msgr2=0x55dc73e19400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:12.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.127+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1909026694 shutdown_connections 2024-05-14T09:28:12.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.127+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1909026694 wait complete. 2024-05-14T09:28:12.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.128+0000 7fbaa0a79b80 1 -- start start 2024-05-14T09:28:12.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.128+0000 7fbaa0a79b80 1 Processor -- start 2024-05-14T09:28:12.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e30a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e27450 0x55dc73e30f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dc73e33ca0 con 0x55dc73e2d290 2024-05-14T09:28:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc73ca6b20 con 0x55dc73e27450 2024-05-14T09:28:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dc73e33e20 con 0x55dc73ca0e40 2024-05-14T09:28:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fbaa0a79b80 10 client.0 _ll_register_callbacks cb 0x55dc73ce7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.131+0000 7fba8aa00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e27450 0x55dc73e30f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8aa00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e27450 0x55dc73e30f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55374/0 (socket says 172.21.15.120:55374) 2024-05-14T09:28:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8aa00700 1 -- 172.21.15.120:0/3002914885 learned_addr learned my addr 172.21.15.120:0/3002914885 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8b400700 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e30a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8be00700 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8b400700 1 -- 172.21.15.120:0/3002914885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e27450 msgr2=0x55dc73e30f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8b400700 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e27450 0x55dc73e30f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8b400700 1 -- 172.21.15.120:0/3002914885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 msgr2=0x55dc73e314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8b400700 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.132+0000 7fba8b400700 1 -- 172.21.15.120:0/3002914885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc73d06420 con 0x55dc73ca0e40 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.134+0000 7fba8b400700 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e30a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55dc73e2c820 tx=0x7fba7c0aa960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4eacbcfd235454 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:12.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.134+0000 7fba79600700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:12.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.134+0000 7fba79600700 1 -- 172.21.15.120:0/3002914885 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0aa5d0 con 0x55dc73ca0e40 2024-05-14T09:28:12.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.135+0000 7fba79600700 1 -- 172.21.15.120:0/3002914885 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fba7c0b3400 con 0x55dc73ca0e40 2024-05-14T09:28:12.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.135+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba84012df0 con 0x55dc73ca0e40 2024-05-14T09:28:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.135+0000 7fba79600700 1 -- 172.21.15.120:0/3002914885 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fba7c0ab1c0 con 0x55dc73ca0e40 2024-05-14T09:28:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.136+0000 7fbaa0a79b80 10 client.25828 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.136+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55dc73e33d00 con 0x55dc73ca0e40 2024-05-14T09:28:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.137+0000 7fba79600700 1 -- 172.21.15.120:0/3002914885 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba84012df0 con 0x55dc73ca0e40 2024-05-14T09:28:12.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.137+0000 7fba79600700 1 -- 172.21.15.120:0/3002914885 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7fba7c0cbce0 con 0x55dc73ca0e40 2024-05-14T09:28:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.138+0000 7fbaa0a79b80 10 client.25828 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.138+0000 7fbaa0a79b80 10 client.25828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.138+0000 7fbaa0a79b80 20 client.25828 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.138+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73e1dd80 0x55dc73e201a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.138+0000 7fbaa0a79b80 4 client.25828 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.138+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc73deb1c0 con 0x55dc73e1dd80 2024-05-14T09:28:12.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.139+0000 7fba8aa00700 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73e1dd80 0x55dc73e201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.139+0000 7fba79600700 10 client.25828 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:12.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.139+0000 7fba8aa00700 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73e1dd80 0x55dc73e201a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8545ffe958328899 server_cookie=890daefe1e82e78c in_seq=0 out_seq=0 2024-05-14T09:28:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.141+0000 7fba79600700 1 -- 172.21.15.120:0/3002914885 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dc73deb1c0 con 0x55dc73e1dd80 2024-05-14T09:28:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.141+0000 7fba79600700 10 client.25828 handle_command_reply: tid=0 2024-05-14T09:28:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.141+0000 7fbaa0a79b80 1 client.25828 shutdown 2024-05-14T09:28:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 msgr2=0x55dc73e30a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e30a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55dc73e2c820 tx=0x7fba7c0aa960 comp rx=0 tx=0).stop 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 shutdown_connections 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73e1dd80 0x55dc73e201a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e30a40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3002914885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e27450 0x55dc73e30f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 >> 172.21.15.120:0/3002914885 conn(0x55dc73ce5f70 msgr2=0x55dc73e25f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fba79600700 0 client.25828 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:12.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.142+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 shutdown_connections 2024-05-14T09:28:12.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.143+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3002914885 wait complete. 2024-05-14T09:28:12.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.143+0000 7fbaa0a79b80 20 client.25828 trim_cache size 0 max 16384 2024-05-14T09:28:12.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 Processor -- start 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 -- start start 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e2f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e2c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e2d290 0x55dc73e3d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fba6800eb10 con 0x55dc73e27450 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fba68010680 con 0x55dc73e2d290 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.167+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba6800f1e0 con 0x55dc73ca0e40 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.168+0000 7fba8be00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e2d290 0x55dc73e3d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.168+0000 7fba8be00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e2d290 0x55dc73e3d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55376/0 (socket says 172.21.15.120:55376) 2024-05-14T09:28:12.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.168+0000 7fba8be00700 1 -- 172.21.15.120:0/3492262911 learned_addr learned my addr 172.21.15.120:0/3492262911 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.168+0000 7fba8b400700 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e2f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8aa00700 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e2c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8be00700 1 -- 172.21.15.120:0/3492262911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 msgr2=0x55dc73e2f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8be00700 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e2f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8be00700 1 -- 172.21.15.120:0/3492262911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 msgr2=0x55dc73e2c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8be00700 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e2c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8be00700 1 -- 172.21.15.120:0/3492262911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc73e15c40 con 0x55dc73e2d290 2024-05-14T09:28:12.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8aa00700 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e2c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:12.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.169+0000 7fba8be00700 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e2d290 0x55dc73e3d150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba84007df0 tx=0x7fba84027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c962edebd6618d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:12.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.170+0000 7fba7be00700 1 -- 172.21.15.120:0/3492262911 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8401fd50 con 0x55dc73e2d290 2024-05-14T09:28:12.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.170+0000 7fba7be00700 1 -- 172.21.15.120:0/3492262911 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba84012650 con 0x55dc73e2d290 2024-05-14T09:28:12.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.170+0000 7fba7be00700 1 -- 172.21.15.120:0/3492262911 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84004d00 con 0x55dc73e2d290 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.171+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3492262911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e2d290 msgr2=0x55dc73e3d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.171+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e2d290 0x55dc73e3d150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba84007df0 tx=0x7fba84027000 comp rx=0 tx=0).stop 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.171+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3492262911 shutdown_connections 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.171+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73e2d290 0x55dc73e3d150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.171+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73ca0e40 0x55dc73e2f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.171+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/3492262911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e27450 0x55dc73e2c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.171+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3492262911 >> 172.21.15.120:0/3492262911 conn(0x55dc73ce5f70 msgr2=0x55dc73e2bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:12.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.172+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3492262911 shutdown_connections 2024-05-14T09:28:12.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.172+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/3492262911 wait complete. 2024-05-14T09:28:12.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.172+0000 7fbaa0a79b80 1 -- start start 2024-05-14T09:28:12.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.173+0000 7fbaa0a79b80 1 Processor -- start 2024-05-14T09:28:12.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.174+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.174+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e27450 0x55dc73e419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.174+0000 7fbaa0a79b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e41f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.174+0000 7fba8b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.174+0000 7fba8b400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55382/0 (socket says 172.21.15.120:55382) 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.175+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fba6800ffb0 con 0x55dc73e2d290 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.175+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fba6800f8e0 con 0x55dc73ca0e40 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.175+0000 7fbaa0a79b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba6800cad0 con 0x55dc73e27450 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.175+0000 7fbaa0a79b80 10 client.0 _ll_register_callbacks cb 0x55dc73ce7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:12.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.175+0000 7fba8b400700 1 -- 172.21.15.120:0/1646437902 learned_addr learned my addr 172.21.15.120:0/1646437902 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:12.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.175+0000 7fba8be00700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e41f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.175+0000 7fba8aa00700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e27450 0x55dc73e419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.176+0000 7fba8aa00700 1 -- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 msgr2=0x55dc73e414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:12.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.176+0000 7fba8aa00700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.176+0000 7fba8aa00700 1 -- 172.21.15.120:0/1646437902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 msgr2=0x55dc73e41f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:12.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.176+0000 7fba8aa00700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e41f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.176+0000 7fba8aa00700 1 -- 172.21.15.120:0/1646437902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc73ea1550 con 0x55dc73e27450 2024-05-14T09:28:12.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.176+0000 7fba8be00700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e41f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:12.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.176+0000 7fba8b400700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:12.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.177+0000 7fba8aa00700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e27450 0x55dc73e419f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55dc73e30230 tx=0x7fba74012730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3558c8d1da6e3cb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:12.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.177+0000 7fba79600700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:12.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.177+0000 7fba79600700 1 -- 172.21.15.120:0/1646437902 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74004230 con 0x55dc73e27450 2024-05-14T09:28:12.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.178+0000 7fba79600700 1 -- 172.21.15.120:0/1646437902 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fba740043d0 con 0x55dc73e27450 2024-05-14T09:28:12.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.178+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba84012650 con 0x55dc73e27450 2024-05-14T09:28:12.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.178+0000 7fba79600700 1 -- 172.21.15.120:0/1646437902 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fba7402b050 con 0x55dc73e27450 2024-05-14T09:28:12.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.178+0000 7fbaa0a79b80 10 client.25834 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:12.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.178+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55dc73ea2650 con 0x55dc73e27450 2024-05-14T09:28:12.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.179+0000 7fba79600700 1 -- 172.21.15.120:0/1646437902 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba74022070 con 0x55dc73e27450 2024-05-14T09:28:12.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fba79600700 1 -- 172.21.15.120:0/1646437902 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7fba74003890 con 0x55dc73e27450 2024-05-14T09:28:12.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fbaa0a79b80 10 client.25834 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:12.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fbaa0a79b80 10 client.25834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:12.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fbaa0a79b80 20 client.25834 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:12.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73ea2d30 0x55dc73ea5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:12.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fbaa0a79b80 4 client.25834 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:28:12.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fba84012650 con 0x55dc73ea2d30 2024-05-14T09:28:12.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.180+0000 7fba8b400700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73ea2d30 0x55dc73ea5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:12.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.182+0000 7fba79600700 10 client.25834 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:12.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.182+0000 7fba8b400700 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73ea2d30 0x55dc73ea5150 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bd4f6e385e72d0e server_cookie=6fcfc827257d8b35 in_seq=0 out_seq=0 2024-05-14T09:28:12.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.182+0000 7fba79600700 1 -- 172.21.15.120:0/1646437902 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fba84012650 con 0x55dc73ea2d30 2024-05-14T09:28:12.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.182+0000 7fba79600700 10 client.25834 handle_command_reply: tid=0 2024-05-14T09:28:12.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.182+0000 7fbaa0a79b80 1 client.25834 shutdown 2024-05-14T09:28:12.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e27450 msgr2=0x55dc73e419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e27450 0x55dc73e419f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55dc73e30230 tx=0x7fba74012730 comp rx=0 tx=0).stop 2024-05-14T09:28:12.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 shutdown_connections 2024-05-14T09:28:12.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dc73ea2d30 0x55dc73ea5150 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc73ca0e40 0x55dc73e414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc73e2d290 0x55dc73e41f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fba79600700 0 client.25834 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:12.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 --2- 172.21.15.120:0/1646437902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73e27450 0x55dc73e419f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.183+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 >> 172.21.15.120:0/1646437902 conn(0x55dc73ce5f70 msgr2=0x55dc73e2a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:12.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.184+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 shutdown_connections 2024-05-14T09:28:12.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.185+0000 7fbaa0a79b80 1 -- 172.21.15.120:0/1646437902 wait complete. 2024-05-14T09:28:12.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.185+0000 7fbaa0a79b80 20 client.25834 trim_cache size 0 max 16384 2024-05-14T09:28:12.185 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:28:12.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.186+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba700b2980 msgr2=0x7fba700b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.186+0000 7fba90a00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba700b2980 0x7fba700b4e90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba8401c000 tx=0x7fba84014680 comp rx=0 tx=0).stop 2024-05-14T09:28:12.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.186+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c104400 msgr2=0x7fba8c19ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:12.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.186+0000 7fba90a00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c104400 0x7fba8c19ce30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006010 tx=0x7fba7c003a10 comp rx=0 tx=0).stop 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 shutdown_connections 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fba700b2980 0x7fba700b4e90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba8c109680 0x7fba8c1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c104400 0x7fba8c19ce30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 --2- 172.21.15.120:0/2243518262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8c108d30 0x7fba8c19d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 >> 172.21.15.120:0/2243518262 conn(0x7fba8c079d10 msgr2=0x7fba8c101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 shutdown_connections 2024-05-14T09:28:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:12.187+0000 7fba90a00700 1 -- 172.21.15.120:0/2243518262 wait complete. 2024-05-14T09:28:12.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:11 smithi152 ceph-mon[34868]: pgmap v695: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 746 op/s 2024-05-14T09:28:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:11 smithi175 ceph-mon[35353]: pgmap v695: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 746 op/s 2024-05-14T09:28:14.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:13 smithi152 ceph-mon[34868]: pgmap v696: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 703 op/s 2024-05-14T09:28:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:13 smithi175 ceph-mon[35353]: pgmap v696: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 703 op/s 2024-05-14T09:28:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 40.0 s, 695.8 tps, lat 145.096 ms stddev 38.763 2024-05-14T09:28:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:13 smithi120 ceph-mon[31085]: pgmap v696: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 703 op/s 2024-05-14T09:28:15.119 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T09:28:15.120 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T09:28:15.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.413+0000 7fe2c3200640 1 -- 172.21.15.120:0/480719815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc096b20 msgr2=0x7fe2bc096f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.413+0000 7fe2c3200640 1 --2- 172.21.15.120:0/480719815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc096b20 0x7fe2bc096f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009900 tx=0x7fe2b002a400 comp rx=0 tx=0).stop 2024-05-14T09:28:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.413+0000 7fe2c3200640 1 -- 172.21.15.120:0/480719815 shutdown_connections 2024-05-14T09:28:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.413+0000 7fe2c3200640 1 --2- 172.21.15.120:0/480719815 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2bc09b820 0x7fe2bc09dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.413+0000 7fe2c3200640 1 --2- 172.21.15.120:0/480719815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc096b20 0x7fe2bc096f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.413+0000 7fe2c3200640 1 --2- 172.21.15.120:0/480719815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 0x7fe2bc0965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.413+0000 7fe2c3200640 1 -- 172.21.15.120:0/480719815 >> 172.21.15.120:0/480719815 conn(0x7fe2bc090ab0 msgr2=0x7fe2bc092f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.414+0000 7fe2c3200640 1 -- 172.21.15.120:0/480719815 shutdown_connections 2024-05-14T09:28:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.414+0000 7fe2c3200640 1 -- 172.21.15.120:0/480719815 wait complete. 2024-05-14T09:28:15.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.415+0000 7fe2c3200640 1 Processor -- start 2024-05-14T09:28:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.415+0000 7fe2c3200640 1 -- start start 2024-05-14T09:28:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.416+0000 7fe2c3200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 0x7fe2bc0a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.416+0000 7fe2c3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2bc096b20 0x7fe2bc0a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.416+0000 7fe2c3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc09b820 0x7fe2bc0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2bc096b20 0x7fe2bc0a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2bc096b20 0x7fe2bc0a4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37852/0 (socket says 172.21.15.120:37852) 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 0x7fe2bc0a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 0x7fe2bc0a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55402/0 (socket says 172.21.15.120:55402) 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c3200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc0a8a20 con 0x7fe2bc096b20 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c3200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc0a88a0 con 0x7fe2bc0958e0 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc0a8ba0 con 0x7fe2bc09b820 2024-05-14T09:28:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c1400640 1 -- 172.21.15.120:0/2549924495 learned_addr learned my addr 172.21.15.120:0/2549924495 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.417+0000 7fe2c2800640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc09b820 0x7fe2bc0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.418+0000 7fe2c2800640 1 -- 172.21.15.120:0/2549924495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 msgr2=0x7fe2bc0a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.418+0000 7fe2c2800640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 0x7fe2bc0a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.419+0000 7fe2c2800640 1 -- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2bc096b20 msgr2=0x7fe2bc0a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.419+0000 7fe2c2800640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2bc096b20 0x7fe2bc0a4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.419+0000 7fe2c2800640 1 -- 172.21.15.120:0/2549924495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc0a5860 con 0x7fe2bc09b820 2024-05-14T09:28:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.419+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 0x7fe2bc0a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.420+0000 7fe2c2800640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc09b820 0x7fe2bc0a51f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4069180 tx=0x7fe2c4069f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.421+0000 7fe2baa00640 1 -- 172.21.15.120:0/2549924495 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4082070 con 0x7fe2bc09b820 2024-05-14T09:28:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.421+0000 7fe2baa00640 1 -- 172.21.15.120:0/2549924495 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2c407e8e0 con 0x7fe2bc09b820 2024-05-14T09:28:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.421+0000 7fe2baa00640 1 -- 172.21.15.120:0/2549924495 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c407d770 con 0x7fe2bc09b820 2024-05-14T09:28:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.421+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc0a5b50 con 0x7fe2bc09b820 2024-05-14T09:28:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.421+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc0a6020 con 0x7fe2bc09b820 2024-05-14T09:28:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.429+0000 7fe2baa00640 1 -- 172.21.15.120:0/2549924495 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe2c4085070 con 0x7fe2bc09b820 2024-05-14T09:28:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.430+0000 7fe2cfe55740 1 Processor -- start 2024-05-14T09:28:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.430+0000 7fe2cfe55740 1 -- start start 2024-05-14T09:28:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2bca1b0 0x5574e2f6c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f6c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f73770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2c1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f73770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2c1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f73770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55406/0 (socket says 172.21.15.120:55406) 2024-05-14T09:28:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2c1400640 1 -- 172.21.15.120:0/2682774679 learned_addr learned my addr 172.21.15.120:0/2682774679 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5574e2ed0550 con 0x5574e2ba12f0 2024-05-14T09:28:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5574e2e75bc0 con 0x5574e2ba94d0 2024-05-14T09:28:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.431+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5574e2ecc510 con 0x5574e2bca1b0 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2c1400640 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2bca1b0 0x5574e2f6c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f6c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2c1400640 1 -- 172.21.15.120:0/2682774679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2bca1b0 msgr2=0x5574e2f6c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2c1400640 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2bca1b0 0x5574e2f6c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2c1400640 1 -- 172.21.15.120:0/2682774679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 msgr2=0x5574e2f6c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2c1400640 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f6c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2c1400640 1 -- 172.21.15.120:0/2682774679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574e2be2210 con 0x5574e2ba94d0 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.432+0000 7fe2baa00640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2a80b2950 0x7fe2a80b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.433+0000 7fe2baa00640 1 -- 172.21.15.120:0/2549924495 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe2c414f4e0 con 0x7fe2bc09b820 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.433+0000 7fe2c1400640 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f73770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0005f70 tx=0x7fe2b0005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d550e59a102e67 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.433+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2a80b2950 0x7fe2a80b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.433+0000 7fe2af400640 1 -- 172.21.15.120:0/2682774679 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0035040 con 0x5574e2ba94d0 2024-05-14T09:28:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.434+0000 7fe2af400640 1 -- 172.21.15.120:0/2682774679 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2b0003bc0 con 0x5574e2ba94d0 2024-05-14T09:28:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.434+0000 7fe2af400640 1 -- 172.21.15.120:0/2682774679 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b003d9c0 con 0x5574e2ba94d0 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.434+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 msgr2=0x5574e2f73770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.434+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f73770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0005f70 tx=0x7fe2b0005d70 comp rx=0 tx=0).stop 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.434+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2a80b2950 0x7fe2a80b4e60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5574e2f6d6d0 tx=0x7fe2b400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.435+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 shutdown_connections 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.435+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f73770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.435+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f6c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.435+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/2682774679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2bca1b0 0x5574e2f6c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.435+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 >> 172.21.15.120:0/2682774679 conn(0x5574e2bbe300 msgr2=0x5574e2f67c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.435+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 shutdown_connections 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.435+0000 7fe2cfe55740 1 -- 172.21.15.120:0/2682774679 wait complete. 2024-05-14T09:28:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.436+0000 7fe2cfe55740 1 -- start start 2024-05-14T09:28:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.436+0000 7fe2cfe55740 1 Processor -- start 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.436+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f75e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.436+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba94d0 0x5574e2f76380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.437+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2bca1b0 0x5574e2f7d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.437+0000 7fe2cfe55740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5574e2f74160 con 0x5574e2ba12f0 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.437+0000 7fe2cfe55740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5574e2e89660 con 0x5574e2bca1b0 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.437+0000 7fe2cfe55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5574e2f742e0 con 0x5574e2ba94d0 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.437+0000 7fe2cfe55740 10 client.0 _ll_register_callbacks cb 0x5574e2e53400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.437+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f75e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.437+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f75e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37862/0 (socket says 172.21.15.120:37862) 2024-05-14T09:28:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.438+0000 7fe2c1e00640 1 -- 172.21.15.120:0/839265174 learned_addr learned my addr 172.21.15.120:0/839265174 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.439+0000 7fe2c1e00640 1 -- 172.21.15.120:0/839265174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba94d0 msgr2=0x5574e2f76380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:28:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.439+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba94d0 0x5574e2f76380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.439+0000 7fe2c1e00640 1 -- 172.21.15.120:0/839265174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2bca1b0 msgr2=0x5574e2f7d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.439+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2bca1b0 0x5574e2f7d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.439+0000 7fe2c1e00640 1 -- 172.21.15.120:0/839265174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574e2cae620 con 0x5574e2ba12f0 2024-05-14T09:28:15.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.440+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f75e40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4010870 tx=0x7fe2b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199b1d4ac6d43499 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:15.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.440+0000 7fe2a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:28:15.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.441+0000 7fe2a3e00640 1 -- 172.21.15.120:0/839265174 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4004020 con 0x5574e2ba12f0 2024-05-14T09:28:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.441+0000 7fe2a3e00640 1 -- 172.21.15.120:0/839265174 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe2b4017030 con 0x5574e2ba12f0 2024-05-14T09:28:15.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.441+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b0003bc0 con 0x5574e2ba12f0 2024-05-14T09:28:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.443+0000 7fe2a3e00640 1 -- 172.21.15.120:0/839265174 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe2b40041c0 con 0x5574e2ba12f0 2024-05-14T09:28:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.444+0000 7fe2cfe55740 10 client.16290 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.444+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5574e2f80330 con 0x5574e2ba12f0 2024-05-14T09:28:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.444+0000 7fe2a3e00640 1 -- 172.21.15.120:0/839265174 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2b0003bc0 con 0x5574e2ba12f0 2024-05-14T09:28:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.445+0000 7fe2a3e00640 1 -- 172.21.15.120:0/839265174 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7fe2b4003910 con 0x5574e2ba12f0 2024-05-14T09:28:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.445+0000 7fe2cfe55740 10 client.16290 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.445+0000 7fe2cfe55740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:15.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.445+0000 7fe2cfe55740 20 client.16290 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:15.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.445+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2b88d80 0x5574e2f83b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.445+0000 7fe2cfe55740 4 client.16290 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:15.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.445+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574e2ede160 con 0x5574e2b88d80 2024-05-14T09:28:15.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.446+0000 7fe2c1400640 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2b88d80 0x5574e2f83b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.448+0000 7fe2c1400640 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2b88d80 0x5574e2f83b00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b399916effd29c80 server_cookie=5bc355577b23d684 in_seq=0 out_seq=0 2024-05-14T09:28:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.448+0000 7fe2a3e00640 10 client.16290 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.449+0000 7fe2a3e00640 1 -- 172.21.15.120:0/839265174 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5574e2ede160 con 0x5574e2b88d80 2024-05-14T09:28:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.449+0000 7fe2a3e00640 10 client.16290 handle_command_reply: tid=0 2024-05-14T09:28:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.449+0000 7fe2cfe55740 1 client.16290 shutdown 2024-05-14T09:28:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.451+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 msgr2=0x5574e2f75e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.451+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f75e40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4010870 tx=0x7fe2b4004730 comp rx=0 tx=0).stop 2024-05-14T09:28:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.451+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 shutdown_connections 2024-05-14T09:28:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.451+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2b88d80 0x5574e2f83b00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.451+0000 7fe2a3e00640 0 client.16290 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.451+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2bca1b0 0x5574e2f7d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.452+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba94d0 0x5574e2f76380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.452+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/839265174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba12f0 0x5574e2f75e40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.452+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 >> 172.21.15.120:0/839265174 conn(0x5574e2bbe300 msgr2=0x5574e2f6ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.452+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 shutdown_connections 2024-05-14T09:28:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.452+0000 7fe2cfe55740 1 -- 172.21.15.120:0/839265174 wait complete. 2024-05-14T09:28:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.453+0000 7fe2cfe55740 20 client.16290 trim_cache size 0 max 16384 2024-05-14T09:28:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.486+0000 7fe2cfe55740 1 Processor -- start 2024-05-14T09:28:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.487+0000 7fe2cfe55740 1 -- start start 2024-05-14T09:28:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.487+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2b88d80 0x5574e2f67640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba12f0 0x5574e2f67b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f7d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2cfe55740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc13d6e0 con 0x5574e2b88d80 2024-05-14T09:28:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2cfe55740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc161270 con 0x5574e2ba94d0 2024-05-14T09:28:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2cfe55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc13ddb0 con 0x5574e2ba12f0 2024-05-14T09:28:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2b88d80 0x5574e2f67640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2b88d80 0x5574e2f67640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37872/0 (socket says 172.21.15.120:37872) 2024-05-14T09:28:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2c1e00640 1 -- 172.21.15.120:0/3021279125 learned_addr learned my addr 172.21.15.120:0/3021279125 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.488+0000 7fe2c2800640 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f7d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.489+0000 7fe2c1400640 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba12f0 0x5574e2f67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.489+0000 7fe2c1e00640 1 -- 172.21.15.120:0/3021279125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba12f0 msgr2=0x5574e2f67b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.489+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba12f0 0x5574e2f67b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.489+0000 7fe2c1e00640 1 -- 172.21.15.120:0/3021279125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 msgr2=0x5574e2f7d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.489+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f7d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.489+0000 7fe2c1e00640 1 -- 172.21.15.120:0/3021279125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574e2f63470 con 0x5574e2b88d80 2024-05-14T09:28:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.489+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2b88d80 0x5574e2f67640 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4003f20 tx=0x7fe2b4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ea0284caf23455 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.490+0000 7fe2aea00640 1 -- 172.21.15.120:0/3021279125 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b401f100 con 0x5574e2b88d80 2024-05-14T09:28:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.490+0000 7fe2aea00640 1 -- 172.21.15.120:0/3021279125 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2b4003a80 con 0x5574e2b88d80 2024-05-14T09:28:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.491+0000 7fe2aea00640 1 -- 172.21.15.120:0/3021279125 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b401fd40 con 0x5574e2b88d80 2024-05-14T09:28:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 -- 172.21.15.120:0/3021279125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2b88d80 msgr2=0x5574e2f67640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2b88d80 0x5574e2f67640 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4003f20 tx=0x7fe2b4004410 comp rx=0 tx=0).stop 2024-05-14T09:28:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 -- 172.21.15.120:0/3021279125 shutdown_connections 2024-05-14T09:28:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba94d0 0x5574e2f7d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2ba12f0 0x5574e2f67b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/3021279125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2b88d80 0x5574e2f67640 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 -- 172.21.15.120:0/3021279125 >> 172.21.15.120:0/3021279125 conn(0x5574e2bbe300 msgr2=0x5574e2f6c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 -- 172.21.15.120:0/3021279125 shutdown_connections 2024-05-14T09:28:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.492+0000 7fe2cfe55740 1 -- 172.21.15.120:0/3021279125 wait complete. 2024-05-14T09:28:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.493+0000 7fe2cfe55740 1 -- start start 2024-05-14T09:28:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.494+0000 7fe2cfe55740 1 Processor -- start 2024-05-14T09:28:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.496+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2b88d80 0x5574e2f7b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.497+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2b88d80 0x5574e2f7b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.497+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2b88d80 0x5574e2f7b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50432/0 (socket says 172.21.15.120:50432) 2024-05-14T09:28:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.497+0000 7fe2cfe55740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba12f0 0x5574e2f7b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.497+0000 7fe2c1e00640 1 -- 172.21.15.120:0/1378492291 learned_addr learned my addr 172.21.15.120:0/1378492291 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.498+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba94d0 0x5574e2f7c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.498+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc13eb80 con 0x5574e2ba94d0 2024-05-14T09:28:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.498+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc13e4b0 con 0x5574e2ba12f0 2024-05-14T09:28:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.498+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc13b6e0 con 0x5574e2b88d80 2024-05-14T09:28:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.498+0000 7fe2cfe55740 10 client.0 _ll_register_callbacks cb 0x7fe2b4010700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.498+0000 7fe2c1400640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba12f0 0x5574e2f7b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.498+0000 7fe2c2800640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba94d0 0x5574e2f7c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.499+0000 7fe2c1400640 1 -- 172.21.15.120:0/1378492291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2b88d80 msgr2=0x5574e2f7b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.499+0000 7fe2c1400640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2b88d80 0x5574e2f7b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.499+0000 7fe2c1400640 1 -- 172.21.15.120:0/1378492291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba94d0 msgr2=0x5574e2f7c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.500+0000 7fe2c1400640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba94d0 0x5574e2f7c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.500+0000 7fe2c1400640 1 -- 172.21.15.120:0/1378492291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574e2f7cda0 con 0x5574e2ba12f0 2024-05-14T09:28:15.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.500+0000 7fe2c2800640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba94d0 0x5574e2f7c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:15.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.501+0000 7fe2c1400640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba12f0 0x5574e2f7b8b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0001eb0 tx=0x7fe2b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1046e796fd0188ff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.501+0000 7fe2a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:28:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.502+0000 7fe2a3e00640 1 -- 172.21.15.120:0/1378492291 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0035040 con 0x5574e2ba12f0 2024-05-14T09:28:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.502+0000 7fe2a3e00640 1 -- 172.21.15.120:0/1378492291 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe2b0003940 con 0x5574e2ba12f0 2024-05-14T09:28:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.502+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b4003a80 con 0x5574e2ba12f0 2024-05-14T09:28:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.503+0000 7fe2a3e00640 1 -- 172.21.15.120:0/1378492291 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe2b0003b40 con 0x5574e2ba12f0 2024-05-14T09:28:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.504+0000 7fe2cfe55740 10 client.35774 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.504+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5574e2febf10 con 0x5574e2ba12f0 2024-05-14T09:28:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2a3e00640 1 -- 172.21.15.120:0/1378492291 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2b4003a80 con 0x5574e2ba12f0 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2a3e00640 1 -- 172.21.15.120:0/1378492291 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7fe2b0031b70 con 0x5574e2ba12f0 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2cfe55740 10 client.35774 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2cfe55740 10 client.35774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2cfe55740 20 client.35774 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2bca1b0 0x5574e2fee870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2cfe55740 4 client.35774 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.505+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5574e2ed7fd0 con 0x5574e2bca1b0 2024-05-14T09:28:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.506+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2bca1b0 0x5574e2fee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:15.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.507+0000 7fe2a3e00640 10 client.35774 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.507+0000 7fe2c1e00640 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2bca1b0 0x5574e2fee870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c4193e7d9a529c2 server_cookie=9e3c280a85e36063 in_seq=0 out_seq=0 2024-05-14T09:28:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2a3e00640 1 -- 172.21.15.120:0/1378492291 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5574e2ed7fd0 con 0x5574e2bca1b0 2024-05-14T09:28:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2a3e00640 10 client.35774 handle_command_reply: tid=0 2024-05-14T09:28:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 client.35774 shutdown 2024-05-14T09:28:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba12f0 msgr2=0x5574e2f7b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba12f0 0x5574e2f7b8b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0001eb0 tx=0x7fe2b00046c0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 shutdown_connections 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5574e2bca1b0 0x5574e2fee870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5574e2ba94d0 0x5574e2f7c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574e2ba12f0 0x5574e2f7b8b0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0001eb0 tx=0x7fe2b00046c0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 --2- 172.21.15.120:0/1378492291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e2b88d80 0x5574e2f7b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.534+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 >> 172.21.15.120:0/1378492291 conn(0x5574e2bbe300 msgr2=0x5574e2f67640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.535+0000 7fe2a3e00640 0 client.35774 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.535+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 shutdown_connections 2024-05-14T09:28:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.535+0000 7fe2cfe55740 1 -- 172.21.15.120:0/1378492291 wait complete. 2024-05-14T09:28:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.538+0000 7fe2cfe55740 20 client.35774 trim_cache size 0 max 16384 2024-05-14T09:28:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:28:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:28:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:28:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:28:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.539+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2a80b2950 msgr2=0x7fe2a80b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.539+0000 7fe2c3200640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2a80b2950 0x7fe2a80b4e60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5574e2f6d6d0 tx=0x7fe2b400b390 comp rx=0 tx=0).stop 2024-05-14T09:28:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.539+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc09b820 msgr2=0x7fe2bc0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.539+0000 7fe2c3200640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc09b820 0x7fe2bc0a51f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4069180 tx=0x7fe2c4069f50 comp rx=0 tx=0).stop 2024-05-14T09:28:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 shutdown_connections 2024-05-14T09:28:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe2a80b2950 0x7fe2a80b4e60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc09b820 0x7fe2bc0a51f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2bc096b20 0x7fe2bc0a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 --2- 172.21.15.120:0/2549924495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2bc0958e0 0x7fe2bc0a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 >> 172.21.15.120:0/2549924495 conn(0x7fe2bc090ab0 msgr2=0x7fe2bc097800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 shutdown_connections 2024-05-14T09:28:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:15.540+0000 7fe2c3200640 1 -- 172.21.15.120:0/2549924495 wait complete. 2024-05-14T09:28:15.855 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:28:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:15 smithi152 ceph-mon[34868]: pgmap v697: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T09:28:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:15 smithi175 ceph-mon[35353]: pgmap v697: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T09:28:16.383 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:15 smithi120 ceph-mon[31085]: pgmap v697: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T09:28:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:17 smithi175 ceph-mon[35353]: pgmap v698: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.4 MiB/s wr, 770 op/s 2024-05-14T09:28:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:17 smithi120 ceph-mon[31085]: pgmap v698: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.4 MiB/s wr, 770 op/s 2024-05-14T09:28:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:17 smithi152 ceph-mon[34868]: pgmap v698: 129 pgs: 129 active+clean; 935 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.4 MiB/s wr, 770 op/s 2024-05-14T09:28:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 45.0 s, 618.8 tps, lat 161.061 ms stddev 71.822 2024-05-14T09:28:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:19 smithi175 ceph-mon[35353]: pgmap v699: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 825 op/s 2024-05-14T09:28:20.316 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:19 smithi120 ceph-mon[31085]: pgmap v699: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 825 op/s 2024-05-14T09:28:20.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:19 smithi152 ceph-mon[34868]: pgmap v699: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 825 op/s 2024-05-14T09:28:20.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.659+0000 7f642ae00700 1 -- 172.21.15.120:0/3327421609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410a7c0 msgr2=0x7f642410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.659+0000 7f642ae00700 1 --2- 172.21.15.120:0/3327421609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410a7c0 0x7f642410abd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6418009990 tx=0x7f6418009ca0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.660+0000 7f642ae00700 1 -- 172.21.15.120:0/3327421609 shutdown_connections 2024-05-14T09:28:20.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.660+0000 7f642ae00700 1 --2- 172.21.15.120:0/3327421609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f642411d930 0x7f642411fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.660+0000 7f642ae00700 1 --2- 172.21.15.120:0/3327421609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410a7c0 0x7f642410abd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.660+0000 7f642ae00700 1 --2- 172.21.15.120:0/3327421609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f642410b110 0x7f642411d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.660+0000 7f642ae00700 1 -- 172.21.15.120:0/3327421609 >> 172.21.15.120:0/3327421609 conn(0x7f642406f290 msgr2=0x7f642406f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:20.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.660+0000 7f642ae00700 1 -- 172.21.15.120:0/3327421609 shutdown_connections 2024-05-14T09:28:20.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.660+0000 7f642ae00700 1 -- 172.21.15.120:0/3327421609 wait complete. 2024-05-14T09:28:20.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.663+0000 7f642ae00700 1 Processor -- start 2024-05-14T09:28:20.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.663+0000 7f642ae00700 1 -- start start 2024-05-14T09:28:20.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.664+0000 7f642ae00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f642410a7c0 0x7f64241af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.664+0000 7f642ae00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410b110 0x7f64241afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.664+0000 7f642ae00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f642411d930 0x7f64241a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f642ae00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6424122f50 con 0x7f642410a7c0 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f642ae00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6424122dd0 con 0x7f642411d930 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f642ae00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64241230d0 con 0x7f642410b110 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f6429000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410b110 0x7f64241afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f6429000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410b110 0x7f64241afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56272/0 (socket says 172.21.15.120:56272) 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f6429000700 1 -- 172.21.15.120:0/1412880212 learned_addr learned my addr 172.21.15.120:0/1412880212 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f642a400700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f642411d930 0x7f64241a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.665+0000 7f6429a00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f642410a7c0 0x7f64241af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.666+0000 7f642a400700 1 -- 172.21.15.120:0/1412880212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410b110 msgr2=0x7f64241afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.666+0000 7f642a400700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410b110 0x7f64241afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.666+0000 7f642a400700 1 -- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f642410a7c0 msgr2=0x7f64241af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.666+0000 7f642a400700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f642410a7c0 0x7f64241af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.666+0000 7f642a400700 1 -- 172.21.15.120:0/1412880212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64241a9f80 con 0x7f642411d930 2024-05-14T09:28:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.666+0000 7f6429a00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f642410a7c0 0x7f64241af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.667+0000 7f642a400700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f642411d930 0x7f64241a9850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f641c00efb0 tx=0x7f641c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.667+0000 7f6422000700 1 -- 172.21.15.120:0/1412880212 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c00ca50 con 0x7f642411d930 2024-05-14T09:28:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.668+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64241aa270 con 0x7f642411d930 2024-05-14T09:28:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.668+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64241b6470 con 0x7f642411d930 2024-05-14T09:28:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.668+0000 7f6422000700 1 -- 172.21.15.120:0/1412880212 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f641c00cbf0 con 0x7f642411d930 2024-05-14T09:28:20.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.668+0000 7f6422000700 1 -- 172.21.15.120:0/1412880212 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c0047d0 con 0x7f642411d930 2024-05-14T09:28:20.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.673+0000 7f6422000700 1 -- 172.21.15.120:0/1412880212 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f641c012050 con 0x7f642411d930 2024-05-14T09:28:20.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.675+0000 7f643af75b80 1 Processor -- start 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.675+0000 7f643af75b80 1 -- start start 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.675+0000 7f6422000700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f640c0b2980 0x7f640c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.675+0000 7f643af75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef69dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.675+0000 7f643af75b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef73960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.675+0000 7f643af75b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43ef75eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.676+0000 7f643af75b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e43ee8baa0 con 0x55e43ef6a300 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.676+0000 7f643af75b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e43ee297e0 con 0x55e43ef6a710 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.676+0000 7f643af75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e43ee87a60 con 0x55e43edebec0 2024-05-14T09:28:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.676+0000 7f6422000700 1 -- 172.21.15.120:0/1412880212 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f641c0e2d50 con 0x7f642411d930 2024-05-14T09:28:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef69dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef69dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56276/0 (socket says 172.21.15.120:56276) 2024-05-14T09:28:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 -- 172.21.15.120:0/1486000459 learned_addr learned my addr 172.21.15.120:0/1486000459 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f642a400700 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43ef75eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 -- 172.21.15.120:0/1486000459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 msgr2=0x55e43ef75eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43ef75eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 -- 172.21.15.120:0/1486000459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 msgr2=0x55e43ef73960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef73960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f6429a00700 1 -- 172.21.15.120:0/1486000459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e43edd8950 con 0x55e43edebec0 2024-05-14T09:28:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.677+0000 7f642a400700 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43ef75eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.678+0000 7f6429000700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f640c0b2980 0x7f640c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.678+0000 7f6429a00700 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef69dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6418005b40 tx=0x7f6418005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b3d8c619eb05b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.678+0000 7f6416a00700 1 -- 172.21.15.120:0/1486000459 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180054a0 con 0x55e43edebec0 2024-05-14T09:28:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.678+0000 7f6416a00700 1 -- 172.21.15.120:0/1486000459 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6418005640 con 0x55e43edebec0 2024-05-14T09:28:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.678+0000 7f6416a00700 1 -- 172.21.15.120:0/1486000459 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641800ba60 con 0x55e43edebec0 2024-05-14T09:28:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 -- 172.21.15.120:0/1486000459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 msgr2=0x55e43ef69dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef69dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6418005b40 tx=0x7f6418005de0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f6429000700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f640c0b2980 0x7f640c0b4e90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55e43ef65ef0 tx=0x7f6410009900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:20.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 -- 172.21.15.120:0/1486000459 shutdown_connections 2024-05-14T09:28:20.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43ef75eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef69dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 --2- 172.21.15.120:0/1486000459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef73960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 -- 172.21.15.120:0/1486000459 >> 172.21.15.120:0/1486000459 conn(0x55e43ee2ab00 msgr2=0x55e43ef64bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:20.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 -- 172.21.15.120:0/1486000459 shutdown_connections 2024-05-14T09:28:20.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.680+0000 7f643af75b80 1 -- 172.21.15.120:0/1486000459 wait complete. 2024-05-14T09:28:20.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.681+0000 7f643af75b80 1 -- start start 2024-05-14T09:28:20.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.681+0000 7f643af75b80 1 Processor -- start 2024-05-14T09:28:20.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.682+0000 7f643af75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef73410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.682+0000 7f643af75b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 0x55e43ef73950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.682+0000 7f643af75b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a710 0x55e43ef73e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.682+0000 7f643af75b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e43ef87770 con 0x55e43ef6a710 2024-05-14T09:28:20.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.682+0000 7f643af75b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e43edf1ba0 con 0x55e43ef6a300 2024-05-14T09:28:20.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.682+0000 7f643af75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e43ef878f0 con 0x55e43edebec0 2024-05-14T09:28:20.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.682+0000 7f643af75b80 10 client.0 _ll_register_callbacks cb 0x55e43ee1f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:20.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.683+0000 7f642a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a710 0x55e43ef73e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.683+0000 7f642a400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a710 0x55e43ef73e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56680/0 (socket says 172.21.15.120:56680) 2024-05-14T09:28:20.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.683+0000 7f642a400700 1 -- 172.21.15.120:0/2348169485 learned_addr learned my addr 172.21.15.120:0/2348169485 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:20.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.683+0000 7f642a400700 1 -- 172.21.15.120:0/2348169485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 msgr2=0x55e43ef73410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:28:20.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.683+0000 7f642a400700 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef73410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.684+0000 7f642a400700 1 -- 172.21.15.120:0/2348169485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 msgr2=0x55e43ef73950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:28:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.684+0000 7f642a400700 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 0x55e43ef73950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.684+0000 7f642a400700 1 -- 172.21.15.120:0/2348169485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e43ee514a0 con 0x55e43ef6a710 2024-05-14T09:28:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.684+0000 7f642a400700 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a710 0x55e43ef73e90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f641c0090a0 tx=0x7f641c0a9a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb9e83fef974836 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.684+0000 7f640b400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:28:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.684+0000 7f640b400700 1 -- 172.21.15.120:0/2348169485 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c0aa000 con 0x55e43ef6a710 2024-05-14T09:28:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.684+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6418005640 con 0x55e43ef6a710 2024-05-14T09:28:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.685+0000 7f640b400700 1 -- 172.21.15.120:0/2348169485 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f641c01bdd0 con 0x55e43ef6a710 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.685+0000 7f640b400700 1 -- 172.21.15.120:0/2348169485 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f641c0ae3b0 con 0x55e43ef6a710 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.685+0000 7f643af75b80 10 client.16305 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.685+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e43ef92500 con 0x55e43ef6a710 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f640b400700 1 -- 172.21.15.120:0/2348169485 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6418005640 con 0x55e43ef6a710 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f640b400700 1 -- 172.21.15.120:0/2348169485 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f641c0a5970 con 0x55e43ef6a710 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f643af75b80 10 client.16305 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f643af75b80 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f643af75b80 20 client.16305 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:20.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f643af75b80 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43ef94a90 0x55e43ef96f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f643af75b80 4 client.16305 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:20.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.686+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e43ef360f0 con 0x55e43ef94a90 2024-05-14T09:28:20.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.687+0000 7f6429a00700 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43ef94a90 0x55e43ef96f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.689+0000 7f6429a00700 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43ef94a90 0x55e43ef96f60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af2dd53e97616072 server_cookie=25798996868a72be in_seq=0 out_seq=0 2024-05-14T09:28:20.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.689+0000 7f640b400700 10 client.16305 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:20.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.690+0000 7f640b400700 1 -- 172.21.15.120:0/2348169485 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e43ef360f0 con 0x55e43ef94a90 2024-05-14T09:28:20.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.690+0000 7f640b400700 10 client.16305 handle_command_reply: tid=0 2024-05-14T09:28:20.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.690+0000 7f643af75b80 1 client.16305 shutdown 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a710 msgr2=0x55e43ef73e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a710 0x55e43ef73e90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f641c0090a0 tx=0x7f641c0a9a80 comp rx=0 tx=0).stop 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 shutdown_connections 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43ef94a90 0x55e43ef96f60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a710 0x55e43ef73e90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef73410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 --2- 172.21.15.120:0/2348169485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 0x55e43ef73950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 >> 172.21.15.120:0/2348169485 conn(0x55e43ee2ab00 msgr2=0x55e43ef68780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.691+0000 7f640b400700 0 client.16305 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:20.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.692+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 shutdown_connections 2024-05-14T09:28:20.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.692+0000 7f643af75b80 1 -- 172.21.15.120:0/2348169485 wait complete. 2024-05-14T09:28:20.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.692+0000 7f643af75b80 20 client.16305 trim_cache size 0 max 16384 2024-05-14T09:28:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.715+0000 7f643af75b80 1 Processor -- start 2024-05-14T09:28:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.715+0000 7f643af75b80 1 -- start start 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f643af75b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43edebec0 0x55e43ef754f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f643af75b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 0x55e43ef6e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f643af75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43ef6a710 0x55e43ef6ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f643af75b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f640400ea70 con 0x55e43edebec0 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f643af75b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f64040105e0 con 0x55e43ef6a300 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f643af75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f640400f140 con 0x55e43ef6a710 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f6429a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43edebec0 0x55e43ef754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f6429a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43edebec0 0x55e43ef754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56692/0 (socket says 172.21.15.120:56692) 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f6429a00700 1 -- 172.21.15.120:0/3237326383 learned_addr learned my addr 172.21.15.120:0/3237326383 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f642a400700 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43ef6a710 0x55e43ef6ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.716+0000 7f6429000700 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 0x55e43ef6e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f6429a00700 1 -- 172.21.15.120:0/3237326383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43ef6a710 msgr2=0x55e43ef6ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:20.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f6429a00700 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43ef6a710 0x55e43ef6ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f6429a00700 1 -- 172.21.15.120:0/3237326383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 msgr2=0x55e43ef6e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:20.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f6429a00700 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 0x55e43ef6e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f6429a00700 1 -- 172.21.15.120:0/3237326383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e43ef74420 con 0x55e43edebec0 2024-05-14T09:28:20.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f642a400700 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43ef6a710 0x55e43ef6ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:20.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f6429a00700 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43edebec0 0x55e43ef754f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f64180098e0 tx=0x7f6418005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f53a52a3bb3941b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:20.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.717+0000 7f6416000700 1 -- 172.21.15.120:0/3237326383 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180037a0 con 0x55e43edebec0 2024-05-14T09:28:20.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.718+0000 7f6416000700 1 -- 172.21.15.120:0/3237326383 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6418032070 con 0x55e43edebec0 2024-05-14T09:28:20.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.718+0000 7f6416000700 1 -- 172.21.15.120:0/3237326383 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641800bd60 con 0x55e43edebec0 2024-05-14T09:28:20.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 -- 172.21.15.120:0/3237326383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43edebec0 msgr2=0x55e43ef754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43edebec0 0x55e43ef754f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f64180098e0 tx=0x7f6418005de0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 -- 172.21.15.120:0/3237326383 shutdown_connections 2024-05-14T09:28:20.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43ef6a710 0x55e43ef6ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43edebec0 0x55e43ef754f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 --2- 172.21.15.120:0/3237326383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a300 0x55e43ef6e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 -- 172.21.15.120:0/3237326383 >> 172.21.15.120:0/3237326383 conn(0x55e43ee2ab00 msgr2=0x55e43ef63f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.719+0000 7f643af75b80 1 -- 172.21.15.120:0/3237326383 shutdown_connections 2024-05-14T09:28:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.720+0000 7f643af75b80 1 -- 172.21.15.120:0/3237326383 wait complete. 2024-05-14T09:28:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.720+0000 7f643af75b80 1 -- start start 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.720+0000 7f643af75b80 1 Processor -- start 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f643af75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef88bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f643af75b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef89100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f643af75b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43effe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f643af75b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f640400ff10 con 0x55e43ef6a300 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f643af75b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f640400f840 con 0x55e43ef6a710 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f643af75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f640400ca30 con 0x55e43edebec0 2024-05-14T09:28:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f643af75b80 10 client.0 _ll_register_callbacks cb 0x55e43ee1f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:20.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f6429000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef89100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.721+0000 7f6429a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef88bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef88bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56298/0 (socket says 172.21.15.120:56298) 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429a00700 1 -- 172.21.15.120:0/3122549820 learned_addr learned my addr 172.21.15.120:0/3122549820 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f642a400700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43effe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429a00700 1 -- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 msgr2=0x55e43effe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429a00700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43effe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429a00700 1 -- 172.21.15.120:0/3122549820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 msgr2=0x55e43ef89100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429a00700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef89100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429a00700 1 -- 172.21.15.120:0/3122549820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e43effe850 con 0x55e43edebec0 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f6429000700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef89100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.722+0000 7f642a400700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43effe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.723+0000 7f6429a00700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef88bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f64180036f0 tx=0x7f64180049e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4029273b9b2254f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.723+0000 7f640b400700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.723+0000 7f640b400700 1 -- 172.21.15.120:0/3122549820 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418005490 con 0x55e43edebec0 2024-05-14T09:28:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.723+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6418032070 con 0x55e43edebec0 2024-05-14T09:28:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.723+0000 7f640b400700 1 -- 172.21.15.120:0/3122549820 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f641800b6b0 con 0x55e43edebec0 2024-05-14T09:28:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.724+0000 7f640b400700 1 -- 172.21.15.120:0/3122549820 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6418045050 con 0x55e43edebec0 2024-05-14T09:28:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.724+0000 7f643af75b80 10 client.25861 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.724+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e43efff8d0 con 0x55e43edebec0 2024-05-14T09:28:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.724+0000 7f640b400700 1 -- 172.21.15.120:0/3122549820 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6418032070 con 0x55e43edebec0 2024-05-14T09:28:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f640b400700 1 -- 172.21.15.120:0/3122549820 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f641802d5a0 con 0x55e43edebec0 2024-05-14T09:28:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f643af75b80 10 client.25861 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f643af75b80 10 client.25861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f643af75b80 20 client.25861 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f643af75b80 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43efffaa0 0x55e43f001ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f643af75b80 4 client.25861 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T09:28:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e43ee99480 con 0x55e43efffaa0 2024-05-14T09:28:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.725+0000 7f6429000700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43efffaa0 0x55e43f001ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.726+0000 7f6429000700 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43efffaa0 0x55e43f001ec0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0893d84222a0c9c server_cookie=7414d8f7390f1d5c in_seq=0 out_seq=0 2024-05-14T09:28:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.726+0000 7f640b400700 10 client.25861 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f640b400700 1 -- 172.21.15.120:0/3122549820 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e43ee99480 con 0x55e43efffaa0 2024-05-14T09:28:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f640b400700 10 client.25861 handle_command_reply: tid=0 2024-05-14T09:28:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 client.25861 shutdown 2024-05-14T09:28:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 msgr2=0x55e43ef88bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef88bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f64180036f0 tx=0x7f64180049e0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 shutdown_connections 2024-05-14T09:28:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e43efffaa0 0x55e43f001ec0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e43ef6a710 0x55e43effe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e43edebec0 0x55e43ef88bc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f640b400700 0 client.25861 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.729+0000 7f643af75b80 1 --2- 172.21.15.120:0/3122549820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e43ef6a300 0x55e43ef89100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.730+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 >> 172.21.15.120:0/3122549820 conn(0x55e43ee2ab00 msgr2=0x55e43ef751e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.730+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 shutdown_connections 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.730+0000 7f643af75b80 1 -- 172.21.15.120:0/3122549820 wait complete. 2024-05-14T09:28:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.730+0000 7f643af75b80 20 client.25861 trim_cache size 0 max 16384 2024-05-14T09:28:20.731 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:28:20.731 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-05-14T09:28:20.731 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "548a2d26-467d-4b33-a345-0d9f69c7cf73", 2024-05-14T09:28:20.731 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-05-14T09:28:20.731 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f640c0b2980 msgr2=0x7f640c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f640c0b2980 0x7f640c0b4e90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55e43ef65ef0 tx=0x7f6410009900 comp rx=0 tx=0).stop 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f642411d930 msgr2=0x7f64241a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f642411d930 0x7f64241a9850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f641c00efb0 tx=0x7f641c00c3a0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 shutdown_connections 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f640c0b2980 0x7f640c0b4e90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f642411d930 0x7f64241a9850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f642410a7c0 0x7f64241af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 --2- 172.21.15.120:0/1412880212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f642410b110 0x7f64241afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.731+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 >> 172.21.15.120:0/1412880212 conn(0x7f642406f290 msgr2=0x7f642411b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.732+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 shutdown_connections 2024-05-14T09:28:20.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:20.732+0000 7f642ae00700 1 -- 172.21.15.120:0/1412880212 wait complete. 2024-05-14T09:28:21.208 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:28:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:28:20.742+0000 7f6fc8a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical/ auth{2=1} v696 ap=2 f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2) n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3) (inest sync->mix g=2) caps={15282=pAsLsXsFs/-@52} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e4f20db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v105>,<0x10000000003/postgres v27>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v43>,<0x10000000001/sv_0 v60>,<0x10000000000/qa v46>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v696>,<0x10000000005/data v780>,<0x10000000003/postgres v319>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v347>,<0x10000000001/sv_0 v355>,<0x10000000000/qa v353>,<0x1/volumes v343>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T09:24:11.529232+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","memory_value.dirstat":"f(v8 m2024-05-14T09:24:11.567916+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T09:24:11.567916+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T09:28:21.208 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:28:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:28:20.744+0000 7f6fc8a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp/ auth{2=1,3=1} v1229 ap=2 f(v54 m2024-05-14T09:27:34.121126+0000 3=3+0) n(v4 rc2024-05-14T09:27:34.121126+0000 b11604 4=3+1) (inest sync->mix g=2,3) caps={15282=pAsLsXsFs/-@165} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e4f20da580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v105>,<0x10000000003/postgres v27>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v43>,<0x10000000001/sv_0 v60>,<0x10000000000/qa v46>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v1229>,<0x10000000005/data v780>,<0x10000000003/postgres v319>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v347>,<0x10000000001/sv_0 v355>,<0x10000000000/qa v353>,<0x1/volumes v343>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T09:27:34.090314+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-05-14T09:27:34.121126+0000 b11604 4=3+1)","memory_value.dirstat":"f(v54 m2024-05-14T09:27:34.121126+0000 3=3+0)","memory_value.rstat":"n(v4 rc2024-05-14T09:27:34.121126+0000 b11604 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T09:28:21.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:20 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:21.383 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:20 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:21.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:20 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: pgmap v700: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 MiB/s wr, 844 op/s 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub queued for path: / 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:21 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: pgmap v700: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 MiB/s wr, 844 op/s 2024-05-14T09:28:22.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub queued for path: / 2024-05-14T09:28:22.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:21 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: pgmap v700: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 MiB/s wr, 844 op/s 2024-05-14T09:28:22.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub queued for path: / 2024-05-14T09:28:22.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_stat_tmp) see mds.h log and `damage ls` output for details 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:28:22.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:21 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:28:22.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:28:23.367 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:28:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:23 smithi120 ceph-mon[31085]: pgmap v701: 129 pgs: 129 active+clean; 939 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.9 MiB/s wr, 798 op/s 2024-05-14T09:28:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:23 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:28:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:23 smithi152 ceph-mon[34868]: pgmap v701: 129 pgs: 129 active+clean; 939 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.9 MiB/s wr, 798 op/s 2024-05-14T09:28:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:23 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:28:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:23 smithi175 ceph-mon[35353]: pgmap v701: 129 pgs: 129 active+clean; 939 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.9 MiB/s wr, 798 op/s 2024-05-14T09:28:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:23 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:28:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 50.0 s, 520.6 tps, lat 191.761 ms stddev 251.754 2024-05-14T09:28:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:25 smithi120 ceph-mon[31085]: pgmap v702: 129 pgs: 129 active+clean; 947 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-05-14T09:28:25.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:25.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:25 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:25 smithi152 ceph-mon[34868]: pgmap v702: 129 pgs: 129 active+clean; 947 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-05-14T09:28:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:25.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:25 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:25 smithi175 ceph-mon[35353]: pgmap v702: 129 pgs: 129 active+clean; 947 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-05-14T09:28:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:25.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:25 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.963+0000 7f2f16400700 1 -- 172.21.15.120:0/136164281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103100 msgr2=0x7f2f10103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.963+0000 7f2f16400700 1 --2- 172.21.15.120:0/136164281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103100 0x7f2f10103510 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009990 tx=0x7f2f00009ca0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.968+0000 7f2f16400700 1 -- 172.21.15.120:0/136164281 shutdown_connections 2024-05-14T09:28:26.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.968+0000 7f2f16400700 1 --2- 172.21.15.120:0/136164281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f10110cb0 0x7f2f101130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.968+0000 7f2f16400700 1 --2- 172.21.15.120:0/136164281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103100 0x7f2f10103510 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.968+0000 7f2f16400700 1 --2- 172.21.15.120:0/136164281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f10103a50 0x7f2f10110770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.968+0000 7f2f16400700 1 -- 172.21.15.120:0/136164281 >> 172.21.15.120:0/136164281 conn(0x7f2f100fedc0 msgr2=0x7f2f101011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:26.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.969+0000 7f2f16400700 1 -- 172.21.15.120:0/136164281 shutdown_connections 2024-05-14T09:28:26.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.969+0000 7f2f16400700 1 -- 172.21.15.120:0/136164281 wait complete. 2024-05-14T09:28:26.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.973+0000 7f2f16400700 1 Processor -- start 2024-05-14T09:28:26.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.973+0000 7f2f16400700 1 -- start start 2024-05-14T09:28:26.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.974+0000 7f2f16400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f10103100 0x7f2f1019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:26.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.974+0000 7f2f16400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103a50 0x7f2f1019d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:26.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.974+0000 7f2f16400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f10110cb0 0x7f2f101a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.974+0000 7f2f16400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10116560 con 0x7f2f10103a50 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.974+0000 7f2f16400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101163e0 con 0x7f2f10110cb0 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.974+0000 7f2f16400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101166e0 con 0x7f2f10103100 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.975+0000 7f2f0ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103a50 0x7f2f1019d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.975+0000 7f2f0ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103a50 0x7f2f1019d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56742/0 (socket says 172.21.15.120:56742) 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.975+0000 7f2f0ea00700 1 -- 172.21.15.120:0/2769861105 learned_addr learned my addr 172.21.15.120:0/2769861105 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.975+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f10110cb0 0x7f2f101a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:26.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.975+0000 7f2f0f400700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f10103100 0x7f2f1019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:26.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.977+0000 7f2f0ea00700 1 -- 172.21.15.120:0/2769861105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f10103100 msgr2=0x7f2f1019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:26.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.977+0000 7f2f0ea00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f10103100 0x7f2f1019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.977+0000 7f2f0ea00700 1 -- 172.21.15.120:0/2769861105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f10110cb0 msgr2=0x7f2f101a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:26.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.977+0000 7f2f0ea00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f10110cb0 0x7f2f101a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.977+0000 7f2f0ea00700 1 -- 172.21.15.120:0/2769861105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f101a1d70 con 0x7f2f10103a50 2024-05-14T09:28:26.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.977+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f10110cb0 0x7f2f101a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:26.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.978+0000 7f2f0ea00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103a50 0x7f2f1019d4f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c990 tx=0x7f2efc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:26.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.979+0000 7f2f07e00700 1 -- 172.21.15.120:0/2769861105 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc007940 con 0x7f2f10103a50 2024-05-14T09:28:26.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.979+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f101a2060 con 0x7f2f10103a50 2024-05-14T09:28:26.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.980+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10105310 con 0x7f2f10103a50 2024-05-14T09:28:26.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.981+0000 7f2f07e00700 1 -- 172.21.15.120:0/2769861105 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2efc00f450 con 0x7f2f10103a50 2024-05-14T09:28:26.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.981+0000 7f2f07e00700 1 -- 172.21.15.120:0/2769861105 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc018660 con 0x7f2f10103a50 2024-05-14T09:28:26.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.989+0000 7f2f07e00700 1 -- 172.21.15.120:0/2769861105 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2efc018800 con 0x7f2f10103a50 2024-05-14T09:28:26.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.991+0000 7f2f24e6eb80 1 Processor -- start 2024-05-14T09:28:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.991+0000 7f2f24e6eb80 1 -- start start 2024-05-14T09:28:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f07e00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ef40b2900 0x7f2ef40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d7a8e40 0x55808d92c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d926710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d927060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f24e6eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55808d848a20 con 0x55808d7a8e40 2024-05-14T09:28:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f24e6eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55808d7e6760 con 0x55808d926c50 2024-05-14T09:28:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f24e6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55808d8449e0 con 0x55808d92cbf0 2024-05-14T09:28:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.993+0000 7f2f07e00700 1 -- 172.21.15.120:0/2769861105 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2efc0e2380 con 0x7f2f10103a50 2024-05-14T09:28:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.994+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d7a8e40 0x55808d92c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.994+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d7a8e40 0x55808d92c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56744/0 (socket says 172.21.15.120:56744) 2024-05-14T09:28:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.994+0000 7f2f0f400700 1 -- 172.21.15.120:0/3865125039 learned_addr learned my addr 172.21.15.120:0/3865125039 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.994+0000 7f2f0ea00700 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d926710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.994+0000 7f2f0f400700 1 -- 172.21.15.120:0/3865125039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 msgr2=0x55808d926710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.994+0000 7f2f0f400700 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d926710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.994+0000 7f2f0f400700 1 -- 172.21.15.120:0/3865125039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 msgr2=0x55808d927060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:28:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.995+0000 7f2f0f400700 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d927060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.995+0000 7f2f0f400700 1 -- 172.21.15.120:0/3865125039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808d7958d0 con 0x55808d7a8e40 2024-05-14T09:28:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.995+0000 7f2f0f400700 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d7a8e40 0x55808d92c6b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2f000096e0 tx=0x7f2f00009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8e59d3a51ee72e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.995+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ef40b2900 0x7f2ef40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.996+0000 7f2f04c00700 1 -- 172.21.15.120:0/3865125039 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00027070 con 0x55808d7a8e40 2024-05-14T09:28:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.996+0000 7f2f04c00700 1 -- 172.21.15.120:0/3865125039 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f00003c50 con 0x55808d7a8e40 2024-05-14T09:28:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.996+0000 7f2f04c00700 1 -- 172.21.15.120:0/3865125039 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000bbd0 con 0x55808d7a8e40 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ef40b2900 0x7f2ef40b4e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2f080076f0 tx=0x7f2f08009130 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3865125039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d7a8e40 msgr2=0x55808d92c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d7a8e40 0x55808d92c6b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2f000096e0 tx=0x7f2f00009710 comp rx=0 tx=0).stop 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3865125039 shutdown_connections 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d927060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d7a8e40 0x55808d92c6b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3865125039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d926710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.998+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3865125039 >> 172.21.15.120:0/3865125039 conn(0x55808d7e7a80 msgr2=0x55808d921790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:27.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.999+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3865125039 shutdown_connections 2024-05-14T09:28:27.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:26.999+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3865125039 wait complete. 2024-05-14T09:28:27.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.000+0000 7f2f24e6eb80 1 -- start start 2024-05-14T09:28:27.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.000+0000 7f2f24e6eb80 1 Processor -- start 2024-05-14T09:28:27.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.001+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d7a8e40 0x55808d930320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.001+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d930860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.002+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d930da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.002+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d7a8e40 0x55808d930320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.002+0000 7f2f0fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d930da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.003+0000 7f2f0fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d930da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56760/0 (socket says 172.21.15.120:56760) 2024-05-14T09:28:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.003+0000 7f2f0ea00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d930860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.003+0000 7f2f0ea00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d930860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40948/0 (socket says 172.21.15.120:40948) 2024-05-14T09:28:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.002+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d7a8e40 0x55808d930320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56330/0 (socket says 172.21.15.120:56330) 2024-05-14T09:28:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.003+0000 7f2f0fe00700 1 -- 172.21.15.120:0/704375107 learned_addr learned my addr 172.21.15.120:0/704375107 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.003+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55808d933660 con 0x55808d92cbf0 2024-05-14T09:28:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.004+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55808d7aeb20 con 0x55808d926c50 2024-05-14T09:28:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.004+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55808d9337e0 con 0x55808d7a8e40 2024-05-14T09:28:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.005+0000 7f2f24e6eb80 10 client.0 _ll_register_callbacks cb 0x55808d7dc380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.005+0000 7f2f0fe00700 1 -- 172.21.15.120:0/704375107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d7a8e40 msgr2=0x55808d930320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.006+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d7a8e40 0x55808d930320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.006+0000 7f2f0fe00700 1 -- 172.21.15.120:0/704375107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 msgr2=0x55808d930860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.006+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d930860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.007+0000 7f2f0fe00700 1 -- 172.21.15.120:0/704375107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808d80e420 con 0x55808d92cbf0 2024-05-14T09:28:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.007+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f00003c50 con 0x55808d92cbf0 2024-05-14T09:28:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.007+0000 7f2f0f400700 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d7a8e40 0x55808d930320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.008+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d930da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2f08015f10 tx=0x7f2f08004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b368d552829dbd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.008+0000 7f2ef9600700 10 client.16323 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:28:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.009+0000 7f2ef9600700 1 -- 172.21.15.120:0/704375107 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0801c050 con 0x55808d92cbf0 2024-05-14T09:28:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.010+0000 7f2ef9600700 1 -- 172.21.15.120:0/704375107 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2f08016d70 con 0x55808d92cbf0 2024-05-14T09:28:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.010+0000 7f2ef9600700 1 -- 172.21.15.120:0/704375107 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2f08003a00 con 0x55808d92cbf0 2024-05-14T09:28:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.010+0000 7f2f24e6eb80 10 client.16323 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.010+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55808d93e1b0 con 0x55808d92cbf0 2024-05-14T09:28:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.012+0000 7f2ef9600700 1 -- 172.21.15.120:0/704375107 <== mon.0 v2:172.21.15.120:3300/0 4 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f2f08003ba0 con 0x55808d92cbf0 2024-05-14T09:28:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.013+0000 7f2f24e6eb80 10 client.16323 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.013+0000 7f2f24e6eb80 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.013+0000 7f2f24e6eb80 20 client.16323 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.013+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d942b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.013+0000 7f2f24e6eb80 4 client.16323 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.013+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55808d8f3070 con 0x55808d9406e0 2024-05-14T09:28:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.014+0000 7f2f0f400700 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d942b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.018+0000 7f2ef9600700 10 client.16323 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.018+0000 7f2f0f400700 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d942b70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=920f439f88068bf8 server_cookie=59e0193227ad82e3 in_seq=0 out_seq=0 2024-05-14T09:28:27.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.022+0000 7f2ef9600700 1 -- 172.21.15.120:0/704375107 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55808d8f3070 con 0x55808d9406e0 2024-05-14T09:28:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.022+0000 7f2ef9600700 10 client.16323 handle_command_reply: tid=0 2024-05-14T09:28:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.022+0000 7f2f24e6eb80 1 client.16323 shutdown 2024-05-14T09:28:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.024+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 msgr2=0x55808d930da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.024+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d930da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2f08015f10 tx=0x7f2f08004b40 comp rx=0 tx=0).stop 2024-05-14T09:28:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.025+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 shutdown_connections 2024-05-14T09:28:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.025+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d942b70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.025+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d930da0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.025+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d7a8e40 0x55808d930320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.025+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/704375107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d926c50 0x55808d930860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.025+0000 7f2ef9600700 0 client.16323 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.025+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 >> 172.21.15.120:0/704375107 conn(0x55808d7e7a80 msgr2=0x55808d91b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.026+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 shutdown_connections 2024-05-14T09:28:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.026+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/704375107 wait complete. 2024-05-14T09:28:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.026+0000 7f2f24e6eb80 20 client.16323 trim_cache size 0 max 16384 2024-05-14T09:28:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.064+0000 7f2f24e6eb80 1 Processor -- start 2024-05-14T09:28:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.065+0000 7f2f24e6eb80 1 -- start start 2024-05-14T09:28:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.066+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d926710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.066+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d926c50 0x55808d9215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.066+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d93c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.066+0000 7f2f24e6eb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef000eac0 con 0x55808d92cbf0 2024-05-14T09:28:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.066+0000 7f2f24e6eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0010630 con 0x55808d7a8e40 2024-05-14T09:28:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.066+0000 7f2f24e6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef000f190 con 0x55808d926c50 2024-05-14T09:28:27.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.066+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d926710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.067+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d926710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40954/0 (socket says 172.21.15.120:40954) 2024-05-14T09:28:27.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.067+0000 7f2f0f400700 1 -- 172.21.15.120:0/2345957307 learned_addr learned my addr 172.21.15.120:0/2345957307 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:27.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.067+0000 7f2f0ea00700 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d926c50 0x55808d9215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.067+0000 7f2f0f400700 1 -- 172.21.15.120:0/2345957307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d926c50 msgr2=0x55808d9215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:27.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.067+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d93c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.068+0000 7f2f0f400700 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d926c50 0x55808d9215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.068+0000 7f2f0f400700 1 -- 172.21.15.120:0/2345957307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 msgr2=0x55808d93c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.068+0000 7f2f0f400700 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d93c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.068+0000 7f2f0f400700 1 -- 172.21.15.120:0/2345957307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808d9300f0 con 0x55808d7a8e40 2024-05-14T09:28:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.068+0000 7f2f0ea00700 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d926c50 0x55808d9215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.068+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d93c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.069+0000 7f2f0f400700 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d926710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f00025040 tx=0x7f2f0000b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a552ce7c299bda9d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.069+0000 7f2efbe00700 1 -- 172.21.15.120:0/2345957307 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00027040 con 0x55808d7a8e40 2024-05-14T09:28:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.069+0000 7f2efbe00700 1 -- 172.21.15.120:0/2345957307 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f00033070 con 0x55808d7a8e40 2024-05-14T09:28:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.069+0000 7f2efbe00700 1 -- 172.21.15.120:0/2345957307 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000334f0 con 0x55808d7a8e40 2024-05-14T09:28:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.070+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/2345957307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 msgr2=0x55808d926710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d926710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f00025040 tx=0x7f2f0000b540 comp rx=0 tx=0).stop 2024-05-14T09:28:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/2345957307 shutdown_connections 2024-05-14T09:28:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d926710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d92cbf0 0x55808d93c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/2345957307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d926c50 0x55808d9215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/2345957307 >> 172.21.15.120:0/2345957307 conn(0x55808d7e7a80 msgr2=0x55808d920e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/2345957307 shutdown_connections 2024-05-14T09:28:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.071+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/2345957307 wait complete. 2024-05-14T09:28:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.072+0000 7f2f24e6eb80 1 -- start start 2024-05-14T09:28:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.072+0000 7f2f24e6eb80 1 Processor -- start 2024-05-14T09:28:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.073+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d9a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.073+0000 7f2f24e6eb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d926c50 0x55808d938ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.074+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d9a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.074+0000 7f2f0f400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d9a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40970/0 (socket says 172.21.15.120:40970) 2024-05-14T09:28:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.074+0000 7f2f0f400700 1 -- 172.21.15.120:0/3367226305 learned_addr learned my addr 172.21.15.120:0/3367226305 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.074+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d939010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.075+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef000ff60 con 0x55808d926c50 2024-05-14T09:28:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.075+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef000f890 con 0x55808d7a8e40 2024-05-14T09:28:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.075+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef000ca80 con 0x55808d92cbf0 2024-05-14T09:28:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.075+0000 7f2f0ea00700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d926c50 0x55808d938ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.075+0000 7f2f24e6eb80 10 client.0 _ll_register_callbacks cb 0x55808d7dc380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.075+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d939010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.076+0000 7f2f0fe00700 1 -- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 msgr2=0x55808d9a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.076+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d9a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.076+0000 7f2f0fe00700 1 -- 172.21.15.120:0/3367226305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d926c50 msgr2=0x55808d938ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.076+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d926c50 0x55808d938ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.077+0000 7f2f0fe00700 1 -- 172.21.15.120:0/3367226305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808d9a6bd0 con 0x55808d92cbf0 2024-05-14T09:28:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.077+0000 7f2f0f400700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d9a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.078+0000 7f2ef9600700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.078+0000 7f2f0fe00700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d939010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000f80 tx=0x7f2f08017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca49d86cc31b74d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.079+0000 7f2ef9600700 1 -- 172.21.15.120:0/3367226305 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0801c070 con 0x55808d92cbf0 2024-05-14T09:28:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.079+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f00033070 con 0x55808d92cbf0 2024-05-14T09:28:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.079+0000 7f2ef9600700 1 -- 172.21.15.120:0/3367226305 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2f08039060 con 0x55808d92cbf0 2024-05-14T09:28:27.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.080+0000 7f2ef9600700 1 -- 172.21.15.120:0/3367226305 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2f08040050 con 0x55808d92cbf0 2024-05-14T09:28:27.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.080+0000 7f2f24e6eb80 10 client.25876 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:27.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.080+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55808d9bbef0 con 0x55808d92cbf0 2024-05-14T09:28:27.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.080+0000 7f2ef9600700 1 -- 172.21.15.120:0/3367226305 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f00033070 con 0x55808d92cbf0 2024-05-14T09:28:27.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.081+0000 7f2ef9600700 1 -- 172.21.15.120:0/3367226305 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f2f08021440 con 0x55808d92cbf0 2024-05-14T09:28:27.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.081+0000 7f2f24e6eb80 10 client.25876 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:27.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.081+0000 7f2f24e6eb80 10 client.25876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:27.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.081+0000 7f2f24e6eb80 20 client.25876 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:27.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.081+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d9be460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:27.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.081+0000 7f2f24e6eb80 4 client.25876 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:28:27.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.081+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55808d856400 con 0x55808d9406e0 2024-05-14T09:28:27.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.082+0000 7f2f0f400700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d9be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:27.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.083+0000 7f2f0f400700 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d9be460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27bd4ba05a6b684f server_cookie=38552e285f3ece4a in_seq=0 out_seq=0 2024-05-14T09:28:27.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.083+0000 7f2ef9600700 10 client.25876 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:27.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.083+0000 7f2ef9600700 1 -- 172.21.15.120:0/3367226305 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55808d856400 con 0x55808d9406e0 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.083+0000 7f2ef9600700 10 client.25876 handle_command_reply: tid=0 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.083+0000 7f2f24e6eb80 1 client.25876 shutdown 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.083+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 msgr2=0x55808d939010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.083+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d939010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000f80 tx=0x7f2f08017000 comp rx=0 tx=0).stop 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 shutdown_connections 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55808d9406e0 0x55808d9be460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55808d7a8e40 0x55808d9a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55808d92cbf0 0x55808d939010 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 --2- 172.21.15.120:0/3367226305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55808d926c50 0x55808d938ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 >> 172.21.15.120:0/3367226305 conn(0x55808d7e7a80 msgr2=0x55808d92e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2ef9600700 0 client.25876 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 shutdown_connections 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 1 -- 172.21.15.120:0/3367226305 wait complete. 2024-05-14T09:28:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.084+0000 7f2f24e6eb80 20 client.25876 trim_cache size 0 max 16384 2024-05-14T09:28:27.086 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:28:27.086 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T09:28:27.086 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-05-14T09:28:27.086 INFO:teuthology.orchestra.run.smithi120.stdout: "548a2d26-467d-4b33-a345-0d9f69c7cf73": { 2024-05-14T09:28:27.086 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-05-14T09:28:27.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "548a2d26-467d-4b33-a345-0d9f69c7cf73", 2024-05-14T09:28:27.087 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-05-14T09:28:27.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:28:27.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:28:27.087 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.085+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ef40b2900 msgr2=0x7f2ef40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.085+0000 7f2f16400700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ef40b2900 0x7f2ef40b4e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2f080076f0 tx=0x7f2f08009130 comp rx=0 tx=0).stop 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.085+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103a50 msgr2=0x7f2f1019d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.085+0000 7f2f16400700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103a50 0x7f2f1019d4f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c990 tx=0x7f2efc00cca0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 shutdown_connections 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2ef40b2900 0x7f2ef40b4e10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f10110cb0 0x7f2f101a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f10103100 0x7f2f1019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 --2- 172.21.15.120:0/2769861105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f10103a50 0x7f2f1019d4f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 >> 172.21.15.120:0/2769861105 conn(0x7f2f100fedc0 msgr2=0x7f2f10101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 shutdown_connections 2024-05-14T09:28:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:28:27.086+0000 7f2f16400700 1 -- 172.21.15.120:0/2769861105 wait complete. 2024-05-14T09:28:27.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: pgmap v703: 129 pgs: 129 active+clean; 951 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.8 MiB/s wr, 830 op/s 2024-05-14T09:28:27.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:28:27.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:28:27.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:27.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:28:27.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:28:27.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:28:27.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:27 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: pgmap v703: 129 pgs: 129 active+clean; 951 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.8 MiB/s wr, 830 op/s 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:28:27.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:27 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:28:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: pgmap v703: 129 pgs: 129 active+clean; 951 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.8 MiB/s wr, 830 op/s 2024-05-14T09:28:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:28:27.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:28:27.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:28:27.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:28:27.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:28:27.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:28:27.978 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:27 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:28:28.058 INFO:tasks.cephfs.filesystem:scrub status for tag:548a2d26-467d-4b33-a345-0d9f69c7cf73 - {'path': '/', 'tag': '548a2d26-467d-4b33-a345-0d9f69c7cf73', 'options': 'recursive,force'} 2024-05-14T09:28:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.869+0000 7f4892e00640 1 -- 172.21.15.120:0/1735629138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10e660 msgr2=0x7f488c10f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.869+0000 7f4892e00640 1 --2- 172.21.15.120:0/1735629138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10e660 0x7f488c10f360 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4884009be0 tx=0x7f488402a6c0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.870+0000 7f4892e00640 1 -- 172.21.15.120:0/1735629138 shutdown_connections 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.870+0000 7f4892e00640 1 --2- 172.21.15.120:0/1735629138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f488c1145a0 0x7f488c1169c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.870+0000 7f4892e00640 1 --2- 172.21.15.120:0/1735629138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f488c10f8a0 0x7f488c10fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.870+0000 7f4892e00640 1 --2- 172.21.15.120:0/1735629138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10e660 0x7f488c10f360 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.870+0000 7f4892e00640 1 -- 172.21.15.120:0/1735629138 >> 172.21.15.120:0/1735629138 conn(0x7f488c06e6e0 msgr2=0x7f488c10bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.870+0000 7f4892e00640 1 -- 172.21.15.120:0/1735629138 shutdown_connections 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.870+0000 7f4892e00640 1 -- 172.21.15.120:0/1735629138 wait complete. 2024-05-14T09:28:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.871+0000 7f4892e00640 1 Processor -- start 2024-05-14T09:28:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.872+0000 7f4892e00640 1 -- start start 2024-05-14T09:28:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.872+0000 7f4892e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f488c10e660 0x7f488c1a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.872+0000 7f4892e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10f8a0 0x7f488c1a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f4892e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f488c1145a0 0x7f488c1b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10f8a0 0x7f488c1a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f4892e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f488c06f630 con 0x7f488c10f8a0 2024-05-14T09:28:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f4892e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f488c06f4b0 con 0x7f488c1145a0 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f4892e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f488c06f7b0 con 0x7f488c10e660 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10f8a0 0x7f488c1a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46520/0 (socket says 172.21.15.120:46520) 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 -- 172.21.15.120:0/3260668627 learned_addr learned my addr 172.21.15.120:0/3260668627 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488be00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f488c10e660 0x7f488c1a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f4890e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f488c1145a0 0x7f488c1b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 -- 172.21.15.120:0/3260668627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f488c10e660 msgr2=0x7f488c1a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f488c10e660 0x7f488c1a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 -- 172.21.15.120:0/3260668627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f488c1145a0 msgr2=0x7f488c1b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f488c1145a0 0x7f488c1b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.873+0000 7f488b400640 1 -- 172.21.15.120:0/3260668627 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c1b0c10 con 0x7f488c10f8a0 2024-05-14T09:28:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.874+0000 7f488b400640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10f8a0 0x7f488c1a9610 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f487c00e9f0 tx=0x7f487c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.875+0000 7f4888c00640 1 -- 172.21.15.120:0/3260668627 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c00ccc0 con 0x7f488c10f8a0 2024-05-14T09:28:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.875+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c1b0f00 con 0x7f488c10f8a0 2024-05-14T09:28:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.875+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1b1360 con 0x7f488c10f8a0 2024-05-14T09:28:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.875+0000 7f4888c00640 1 -- 172.21.15.120:0/3260668627 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f487c0054b0 con 0x7f488c10f8a0 2024-05-14T09:28:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.875+0000 7f4888c00640 1 -- 172.21.15.120:0/3260668627 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c010430 con 0x7f488c10f8a0 2024-05-14T09:28:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.882+0000 7f4888c00640 1 -- 172.21.15.120:0/3260668627 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f487c0105d0 con 0x7f488c10f8a0 2024-05-14T09:28:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.883+0000 7f4899e26740 1 Processor -- start 2024-05-14T09:28:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.884+0000 7f4888c00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48700b27e0 0x7f48700b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.884+0000 7f4888c00640 1 -- 172.21.15.120:0/3260668627 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f487c0e28f0 con 0x7f488c10f8a0 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4899e26740 1 -- start start 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4899e26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4899e26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093c04680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4899e26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938414d0 0x561093c0b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4899e26740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561093b68550 con 0x5610938414d0 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4899e26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561093b0dbc0 con 0x5610938621b0 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4899e26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561093b64510 con 0x5610938392f0 2024-05-14T09:28:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.885+0000 7f4890e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48700b27e0 0x7f48700b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.886+0000 7f488b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093c04680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.886+0000 7f488be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.886+0000 7f488be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c04100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:57068/0 (socket says 172.21.15.120:57068) 2024-05-14T09:28:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.887+0000 7f488be00640 1 -- 172.21.15.120:0/2097780318 learned_addr learned my addr 172.21.15.120:0/2097780318 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.887+0000 7f488b400640 1 -- 172.21.15.120:0/2097780318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 msgr2=0x561093c04100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.887+0000 7f488b400640 1 --2- 172.21.15.120:0/2097780318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c04100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.887+0000 7f488b400640 1 -- 172.21.15.120:0/2097780318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938414d0 msgr2=0x561093c0b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.887+0000 7f488b400640 1 --2- 172.21.15.120:0/2097780318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938414d0 0x561093c0b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.887+0000 7f488b400640 1 -- 172.21.15.120:0/2097780318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109387a210 con 0x5610938392f0 2024-05-14T09:28:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.888+0000 7f488b400640 1 --2- 172.21.15.120:0/2097780318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093c04680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f487c0e00a0 tx=0x7f487c009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48ef862226e17d3d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.889+0000 7f4881600640 1 -- 172.21.15.120:0/2097780318 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0b32d0 con 0x5610938392f0 2024-05-14T09:28:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.889+0000 7f4881600640 1 -- 172.21.15.120:0/2097780318 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f487c0abe50 con 0x5610938392f0 2024-05-14T09:28:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.889+0000 7f4881600640 1 -- 172.21.15.120:0/2097780318 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0a6db0 con 0x5610938392f0 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4890e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48700b27e0 0x7f48700b4cf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4878005fd0 tx=0x7f487800b580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4899e26740 1 -- 172.21.15.120:0/2097780318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 msgr2=0x561093c04680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4899e26740 1 --2- 172.21.15.120:0/2097780318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093c04680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f487c0e00a0 tx=0x7f487c009f50 comp rx=0 tx=0).stop 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4899e26740 1 -- 172.21.15.120:0/2097780318 shutdown_connections 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4899e26740 1 --2- 172.21.15.120:0/2097780318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938414d0 0x561093c0b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4899e26740 1 --2- 172.21.15.120:0/2097780318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093c04680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4899e26740 1 --2- 172.21.15.120:0/2097780318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c04100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.892+0000 7f4899e26740 1 -- 172.21.15.120:0/2097780318 >> 172.21.15.120:0/2097780318 conn(0x561093856300 msgr2=0x561093bffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.893+0000 7f4899e26740 1 -- 172.21.15.120:0/2097780318 shutdown_connections 2024-05-14T09:28:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.893+0000 7f4899e26740 1 -- 172.21.15.120:0/2097780318 wait complete. 2024-05-14T09:28:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.893+0000 7f4899e26740 1 -- start start 2024-05-14T09:28:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.894+0000 7f4899e26740 1 Processor -- start 2024-05-14T09:28:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.896+0000 7f4899e26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c1eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.896+0000 7f4899e26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c1f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f4899e26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c26020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f488be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c1eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f488be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c1eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46530/0 (socket says 172.21.15.120:46530) 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561093c1cf80 con 0x5610938392f0 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561093b21660 con 0x5610938621b0 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561093c1d100 con 0x5610938414d0 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f488b400640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c1f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f4899e26740 10 client.0 _ll_register_callbacks cb 0x561093aeb400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.898+0000 7f4890e00640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c26020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.897+0000 7f488be00640 1 -- 172.21.15.120:0/3265755791 learned_addr learned my addr 172.21.15.120:0/3265755791 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.898+0000 7f488b400640 1 -- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 msgr2=0x561093c26020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.898+0000 7f488b400640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c26020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.898+0000 7f488b400640 1 -- 172.21.15.120:0/3265755791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 msgr2=0x561093c1eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.898+0000 7f488b400640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c1eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.898+0000 7f488b400640 1 -- 172.21.15.120:0/3265755791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561093946620 con 0x5610938414d0 2024-05-14T09:28:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.898+0000 7f488be00640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c1eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.899+0000 7f488b400640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c1f0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f487c0e03c0 tx=0x7f487c0a6fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982bc1576098116d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.899+0000 7f4876000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.900+0000 7f4876000640 1 -- 172.21.15.120:0/3265755791 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0b32d0 con 0x5610938414d0 2024-05-14T09:28:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.900+0000 7f4876000640 1 -- 172.21.15.120:0/3265755791 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f487c0a7110 con 0x5610938414d0 2024-05-14T09:28:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.901+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f487c0abe50 con 0x5610938414d0 2024-05-14T09:28:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.903+0000 7f4876000640 1 -- 172.21.15.120:0/3265755791 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f487c0aab20 con 0x5610938414d0 2024-05-14T09:28:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.903+0000 7f4899e26740 10 client.25888 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.903+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561093c1cf80 con 0x5610938414d0 2024-05-14T09:28:28.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.904+0000 7f4876000640 1 -- 172.21.15.120:0/3265755791 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f487c0abe50 con 0x5610938414d0 2024-05-14T09:28:28.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.905+0000 7f4876000640 1 -- 172.21.15.120:0/3265755791 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f487c0a65f0 con 0x5610938414d0 2024-05-14T09:28:28.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.905+0000 7f4899e26740 10 client.25888 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:28.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.905+0000 7f4899e26740 10 client.25888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:28.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.905+0000 7f4899e26740 20 client.25888 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:28.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.905+0000 7f4899e26740 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561093820d80 0x561093c2c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.906+0000 7f4899e26740 4 client.25888 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:28.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.906+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561093b76160 con 0x561093820d80 2024-05-14T09:28:28.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.906+0000 7f488be00640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561093820d80 0x561093c2c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.908+0000 7f488be00640 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561093820d80 0x561093c2c120 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6b44b24d295146b server_cookie=35733ba56ad5a877 in_seq=0 out_seq=0 2024-05-14T09:28:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.908+0000 7f4876000640 10 client.25888 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.909+0000 7f4876000640 1 -- 172.21.15.120:0/3265755791 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561093b76160 con 0x561093820d80 2024-05-14T09:28:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.909+0000 7f4876000640 10 client.25888 handle_command_reply: tid=0 2024-05-14T09:28:28.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.909+0000 7f4899e26740 1 client.25888 shutdown 2024-05-14T09:28:28.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 msgr2=0x561093c1f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c1f0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f487c0e03c0 tx=0x7f487c0a6fe0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 shutdown_connections 2024-05-14T09:28:28.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561093820d80 0x561093c2c120 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c26020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c1f0c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 --2- 172.21.15.120:0/3265755791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c1eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 >> 172.21.15.120:0/3265755791 conn(0x561093856300 msgr2=0x561093c029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:28.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.910+0000 7f4876000640 0 client.25888 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.911+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 shutdown_connections 2024-05-14T09:28:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.912+0000 7f4899e26740 1 -- 172.21.15.120:0/3265755791 wait complete. 2024-05-14T09:28:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.912+0000 7f4899e26740 20 client.25888 trim_cache size 0 max 16384 2024-05-14T09:28:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.940+0000 7f4899e26740 1 Processor -- start 2024-05-14T09:28:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.940+0000 7f4899e26740 1 -- start start 2024-05-14T09:28:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.941+0000 7f4899e26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093bff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.941+0000 7f4899e26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938414d0 0x561093c25f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.941+0000 7f4899e26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938621b0 0x561093c02890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.941+0000 7f4899e26740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f486c00fbb0 con 0x5610938621b0 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.941+0000 7f4899e26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f486c011720 con 0x5610938414d0 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.941+0000 7f4899e26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f486c010280 con 0x5610938392f0 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.942+0000 7f488b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938414d0 0x561093c25f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.942+0000 7f488be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093bff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.942+0000 7f488b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938414d0 0x561093c25f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:57090/0 (socket says 172.21.15.120:57090) 2024-05-14T09:28:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.942+0000 7f488be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093bff8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:47284/0 (socket says 172.21.15.120:47284) 2024-05-14T09:28:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.942+0000 7f488b400640 1 -- 172.21.15.120:0/2866398383 learned_addr learned my addr 172.21.15.120:0/2866398383 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.943+0000 7f488be00640 1 -- 172.21.15.120:0/2866398383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938414d0 msgr2=0x561093c25f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.943+0000 7f488be00640 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938414d0 0x561093c25f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.943+0000 7f488be00640 1 -- 172.21.15.120:0/2866398383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938621b0 msgr2=0x561093c02890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.943+0000 7f488be00640 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938621b0 0x561093c02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.943+0000 7f488be00640 1 -- 172.21.15.120:0/2866398383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561093bfb280 con 0x5610938392f0 2024-05-14T09:28:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.943+0000 7f488b400640 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938414d0 0x561093c25f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.943+0000 7f488be00640 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093bff8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4884000f80 tx=0x7f48840308d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cedb6ca9140b4886 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.944+0000 7f4880c00640 1 -- 172.21.15.120:0/2866398383 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884036040 con 0x5610938392f0 2024-05-14T09:28:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.944+0000 7f4880c00640 1 -- 172.21.15.120:0/2866398383 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4884003e00 con 0x5610938392f0 2024-05-14T09:28:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.945+0000 7f4880c00640 1 -- 172.21.15.120:0/2866398383 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884045530 con 0x5610938392f0 2024-05-14T09:28:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 -- 172.21.15.120:0/2866398383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 msgr2=0x561093bff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093bff8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4884000f80 tx=0x7f48840308d0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 -- 172.21.15.120:0/2866398383 shutdown_connections 2024-05-14T09:28:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938621b0 0x561093c02890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938414d0 0x561093c25f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 --2- 172.21.15.120:0/2866398383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938392f0 0x561093bff8c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 -- 172.21.15.120:0/2866398383 >> 172.21.15.120:0/2866398383 conn(0x561093856300 msgr2=0x561093bff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 -- 172.21.15.120:0/2866398383 shutdown_connections 2024-05-14T09:28:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.948+0000 7f4899e26740 1 -- 172.21.15.120:0/2866398383 wait complete. 2024-05-14T09:28:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.949+0000 7f4899e26740 1 -- start start 2024-05-14T09:28:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.949+0000 7f4899e26740 1 Processor -- start 2024-05-14T09:28:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.950+0000 7f4899e26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c23910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.950+0000 7f4899e26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.950+0000 7f4899e26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c24d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.950+0000 7f4899e26740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f486c011050 con 0x5610938392f0 2024-05-14T09:28:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.950+0000 7f4899e26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f486c010980 con 0x5610938621b0 2024-05-14T09:28:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.950+0000 7f4899e26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f486c00dbb0 con 0x5610938414d0 2024-05-14T09:28:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.950+0000 7f4899e26740 10 client.0 _ll_register_callbacks cb 0x7f4884034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.951+0000 7f488be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c23910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.951+0000 7f4890e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c24d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.951+0000 7f4890e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c24d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:57100/0 (socket says 172.21.15.120:57100) 2024-05-14T09:28:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.951+0000 7f4890e00640 1 -- 172.21.15.120:0/2652823599 learned_addr learned my addr 172.21.15.120:0/2652823599 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.951+0000 7f488b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.951+0000 7f488be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c23910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46544/0 (socket says 172.21.15.120:46544) 2024-05-14T09:28:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.953+0000 7f488be00640 1 -- 172.21.15.120:0/2652823599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 msgr2=0x561093c23e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.953+0000 7f488be00640 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c23e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.953+0000 7f488be00640 1 -- 172.21.15.120:0/2652823599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 msgr2=0x561093c24d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.953+0000 7f488be00640 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c24d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.953+0000 7f488be00640 1 -- 172.21.15.120:0/2652823599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561093c25340 con 0x5610938392f0 2024-05-14T09:28:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.953+0000 7f488be00640 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c23910 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x561093b64660 tx=0x7f4884030ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b758278b1bba586f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.953+0000 7f4876000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:28:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.954+0000 7f4876000640 1 -- 172.21.15.120:0/2652823599 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884052020 con 0x5610938392f0 2024-05-14T09:28:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.955+0000 7f4876000640 1 -- 172.21.15.120:0/2652823599 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4884003970 con 0x5610938392f0 2024-05-14T09:28:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.955+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4884003e00 con 0x5610938392f0 2024-05-14T09:28:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.955+0000 7f4876000640 1 -- 172.21.15.120:0/2652823599 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f4884036070 con 0x5610938392f0 2024-05-14T09:28:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.955+0000 7f4899e26740 10 client.16338 fetch_fsmap learned FSMap version 40 2024-05-14T09:28:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.955+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561093c94670 con 0x5610938392f0 2024-05-14T09:28:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4876000640 1 -- 172.21.15.120:0/2652823599 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4884003e00 con 0x5610938392f0 2024-05-14T09:28:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4876000640 1 -- 172.21.15.120:0/2652823599 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f4884045ce0 con 0x5610938392f0 2024-05-14T09:28:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4899e26740 10 client.16338 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T09:28:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4899e26740 10 client.16338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4899e26740 20 client.16338 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4899e26740 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5610937f61c0 0x561093c96fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4899e26740 4 client.16338 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:28:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.956+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561093b6ffd0 con 0x5610937f61c0 2024-05-14T09:28:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.957+0000 7f488b400640 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5610937f61c0 0x561093c96fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:28.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:28 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:28:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.958+0000 7f488b400640 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5610937f61c0 0x561093c96fd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f672f48a13c630 server_cookie=c580ca74fed7bfe6 in_seq=0 out_seq=0 2024-05-14T09:28:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.958+0000 7f4876000640 10 client.16338 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:28.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:28 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:28:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.985+0000 7f4876000640 1 -- 172.21.15.120:0/2652823599 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561093b6ffd0 con 0x5610937f61c0 2024-05-14T09:28:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.985+0000 7f4876000640 10 client.16338 handle_command_reply: tid=0 2024-05-14T09:28:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.985+0000 7f4899e26740 1 client.16338 shutdown 2024-05-14T09:28:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 msgr2=0x561093c23910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c23910 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x561093b64660 tx=0x7f4884030ae0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 shutdown_connections 2024-05-14T09:28:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5610937f61c0 0x561093c96fd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5610938621b0 0x561093c24d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610938414d0 0x561093c23e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 --2- 172.21.15.120:0/2652823599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5610938392f0 0x561093c23910 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.986+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 >> 172.21.15.120:0/2652823599 conn(0x561093856300 msgr2=0x561093bff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.987+0000 7f4876000640 0 client.16338 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.987+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 shutdown_connections 2024-05-14T09:28:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.987+0000 7f4899e26740 1 -- 172.21.15.120:0/2652823599 wait complete. 2024-05-14T09:28:28.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.988+0000 7f4899e26740 20 client.16338 trim_cache size 0 max 16384 2024-05-14T09:28:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:28:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:28:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:28:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:28:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48700b27e0 msgr2=0x7f48700b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48700b27e0 0x7f48700b4cf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4878005fd0 tx=0x7f487800b580 comp rx=0 tx=0).stop 2024-05-14T09:28:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10f8a0 msgr2=0x7f488c1a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10f8a0 0x7f488c1a9610 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f487c00e9f0 tx=0x7f487c00eeb0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 shutdown_connections 2024-05-14T09:28:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48700b27e0 0x7f48700b4cf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f488c1145a0 0x7f488c1b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f488c10f8a0 0x7f488c1a9610 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 --2- 172.21.15.120:0/3260668627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f488c10e660 0x7f488c1a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:28.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 >> 172.21.15.120:0/3260668627 conn(0x7f488c06e6e0 msgr2=0x7f488c070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:28.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.990+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 shutdown_connections 2024-05-14T09:28:28.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:28.991+0000 7f4892e00640 1 -- 172.21.15.120:0/3260668627 wait complete. 2024-05-14T09:28:29.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:28 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:28:29.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 55.0 s, 594.2 tps, lat 167.157 ms stddev 47.413 2024-05-14T09:28:29.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:29 smithi152 ceph-mon[34868]: pgmap v704: 129 pgs: 129 active+clean; 951 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.5 MiB/s wr, 803 op/s 2024-05-14T09:28:29.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:29 smithi175 ceph-mon[35353]: pgmap v704: 129 pgs: 129 active+clean; 951 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.5 MiB/s wr, 803 op/s 2024-05-14T09:28:30.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:29 smithi120 ceph-mon[31085]: pgmap v704: 129 pgs: 129 active+clean; 951 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.5 MiB/s wr, 803 op/s 2024-05-14T09:28:31.957 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:31 smithi152 ceph-mon[34868]: pgmap v705: 129 pgs: 129 active+clean; 951 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.3 MiB/s wr, 776 op/s 2024-05-14T09:28:31.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:31 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:28:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:31 smithi175 ceph-mon[35353]: pgmap v705: 129 pgs: 129 active+clean; 951 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.3 MiB/s wr, 776 op/s 2024-05-14T09:28:31.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:31 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:28:32.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:31 smithi120 ceph-mon[31085]: pgmap v705: 129 pgs: 129 active+clean; 951 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.3 MiB/s wr, 776 op/s 2024-05-14T09:28:32.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:31 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:28:33.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:33 smithi152 ceph-mon[34868]: pgmap v706: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.8 MiB/s wr, 715 op/s 2024-05-14T09:28:33.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:33 smithi175 ceph-mon[35353]: pgmap v706: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.8 MiB/s wr, 715 op/s 2024-05-14T09:28:34.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:33 smithi120 ceph-mon[31085]: pgmap v706: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.8 MiB/s wr, 715 op/s 2024-05-14T09:28:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 60.0 s, 626.4 tps, lat 160.003 ms stddev 42.581 2024-05-14T09:28:35.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:35 smithi152 ceph-mon[34868]: pgmap v707: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-05-14T09:28:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:35 smithi175 ceph-mon[35353]: pgmap v707: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-05-14T09:28:36.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:35 smithi120 ceph-mon[31085]: pgmap v707: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-05-14T09:28:37.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:37 smithi175 ceph-mon[35353]: pgmap v708: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 707 op/s 2024-05-14T09:28:38.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:37 smithi120 ceph-mon[31085]: pgmap v708: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 707 op/s 2024-05-14T09:28:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:37 smithi152 ceph-mon[34868]: pgmap v708: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 707 op/s 2024-05-14T09:28:39.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 65.0 s, 531.4 tps, lat 188.922 ms stddev 62.490 2024-05-14T09:28:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:39 smithi120 ceph-mon[31085]: pgmap v709: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.6 MiB/s wr, 794 op/s 2024-05-14T09:28:39.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:39 smithi175 ceph-mon[35353]: pgmap v709: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.6 MiB/s wr, 794 op/s 2024-05-14T09:28:40.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:39 smithi152 ceph-mon[34868]: pgmap v709: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.6 MiB/s wr, 794 op/s 2024-05-14T09:28:42.011 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:41 smithi152 ceph-mon[34868]: pgmap v710: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.3 MiB/s wr, 764 op/s 2024-05-14T09:28:42.137 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:41 smithi120 ceph-mon[31085]: pgmap v710: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.3 MiB/s wr, 764 op/s 2024-05-14T09:28:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:41 smithi175 ceph-mon[35353]: pgmap v710: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.3 MiB/s wr, 764 op/s 2024-05-14T09:28:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.334+0000 7f425b000640 1 -- 172.21.15.120:0/3579717422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f425410b480 msgr2=0x7f425410b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.334+0000 7f425b000640 1 --2- 172.21.15.120:0/3579717422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f425410b480 0x7f425410b890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4240009900 tx=0x7f424002a3f0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.335+0000 7f425b000640 1 -- 172.21.15.120:0/3579717422 shutdown_connections 2024-05-14T09:28:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.335+0000 7f425b000640 1 --2- 172.21.15.120:0/3579717422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42541101a0 0x7f42541105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.335+0000 7f425b000640 1 --2- 172.21.15.120:0/3579717422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f425410b480 0x7f425410b890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.335+0000 7f425b000640 1 --2- 172.21.15.120:0/3579717422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425410a550 0x7f425410af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.335+0000 7f425b000640 1 -- 172.21.15.120:0/3579717422 >> 172.21.15.120:0/3579717422 conn(0x7f4254070670 msgr2=0x7f4254072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.335+0000 7f425b000640 1 -- 172.21.15.120:0/3579717422 shutdown_connections 2024-05-14T09:28:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.335+0000 7f425b000640 1 -- 172.21.15.120:0/3579717422 wait complete. 2024-05-14T09:28:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.337+0000 7f425b000640 1 Processor -- start 2024-05-14T09:28:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.338+0000 7f425b000640 1 -- start start 2024-05-14T09:28:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.338+0000 7f425b000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f425410a550 0x7f42541a9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.338+0000 7f425b000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425410b480 0x7f42541a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.338+0000 7f425b000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42541101a0 0x7f42541b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.338+0000 7f425b000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f425411e500 con 0x7f425410a550 2024-05-14T09:28:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.338+0000 7f425b000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f425411e380 con 0x7f42541101a0 2024-05-14T09:28:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.338+0000 7f425b000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f425411e680 con 0x7f425410b480 2024-05-14T09:28:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.339+0000 7f4253e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f425410a550 0x7f42541a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.339+0000 7f4253e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f425410a550 0x7f42541a9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45754/0 (socket says 172.21.15.120:45754) 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.339+0000 7f4253e00640 1 -- 172.21.15.120:0/1467598694 learned_addr learned my addr 172.21.15.120:0/1467598694 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.339+0000 7f4259000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42541101a0 0x7f42541b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.339+0000 7f4253400640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425410b480 0x7f42541a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.340+0000 7f4253e00640 1 -- 172.21.15.120:0/1467598694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425410b480 msgr2=0x7f42541a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.340+0000 7f4253e00640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425410b480 0x7f42541a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.340+0000 7f4253e00640 1 -- 172.21.15.120:0/1467598694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42541101a0 msgr2=0x7f42541b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.340+0000 7f4253e00640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42541101a0 0x7f42541b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.340+0000 7f4253e00640 1 -- 172.21.15.120:0/1467598694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42541b0c90 con 0x7f425410a550 2024-05-14T09:28:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.341+0000 7f4253e00640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f425410a550 0x7f42541a9150 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f424400d770 tx=0x7f424400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.342+0000 7f4250c00640 1 -- 172.21.15.120:0/1467598694 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244017070 con 0x7f425410a550 2024-05-14T09:28:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.343+0000 7f4250c00640 1 -- 172.21.15.120:0/1467598694 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4244009c30 con 0x7f425410a550 2024-05-14T09:28:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.343+0000 7f4250c00640 1 -- 172.21.15.120:0/1467598694 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424400f3c0 con 0x7f425410a550 2024-05-14T09:28:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.343+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42541b0f80 con 0x7f425410a550 2024-05-14T09:28:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.343+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42541b1390 con 0x7f425410a550 2024-05-14T09:28:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.351+0000 7f4262031740 1 Processor -- start 2024-05-14T09:28:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.351+0000 7f4262031740 1 -- start start 2024-05-14T09:28:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.352+0000 7f4250c00640 1 -- 172.21.15.120:0/1467598694 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f424401a070 con 0x7f425410a550 2024-05-14T09:28:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.352+0000 7f4262031740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be661b0 0x557e4c208100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.352+0000 7f4262031740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c208680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.352+0000 7f4262031740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c20f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.352+0000 7f4262031740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557e4c16c550 con 0x557e4be661b0 2024-05-14T09:28:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.352+0000 7f4262031740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557e4c111bc0 con 0x557e4be3d2f0 2024-05-14T09:28:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.352+0000 7f4262031740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557e4c168510 con 0x557e4be454d0 2024-05-14T09:28:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.354+0000 7f4253400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c20f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.355+0000 7f4259000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be661b0 0x557e4c208100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.355+0000 7f4253e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c208680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.355+0000 7f4253e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c208680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:36724/0 (socket says 172.21.15.120:36724) 2024-05-14T09:28:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.355+0000 7f4253e00640 1 -- 172.21.15.120:0/926076089 learned_addr learned my addr 172.21.15.120:0/926076089 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.356+0000 7f4259000640 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be661b0 0x557e4c208100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45760/0 (socket says 172.21.15.120:45760) 2024-05-14T09:28:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.356+0000 7f4250c00640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42380b29b0 0x7f42380b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.356+0000 7f4250c00640 1 -- 172.21.15.120:0/1467598694 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f42440e2060 con 0x7f425410a550 2024-05-14T09:28:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.356+0000 7f4259000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42380b29b0 0x7f42380b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.356+0000 7f4253400640 1 -- 172.21.15.120:0/926076089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 msgr2=0x557e4c208680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.357+0000 7f4253400640 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c208680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.357+0000 7f4253400640 1 -- 172.21.15.120:0/926076089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be661b0 msgr2=0x557e4c208100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.357+0000 7f4253400640 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be661b0 0x557e4c208100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.357+0000 7f4253400640 1 -- 172.21.15.120:0/926076089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4be7e210 con 0x557e4be454d0 2024-05-14T09:28:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.357+0000 7f4253e00640 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c208680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:28:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.357+0000 7f4253400640 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c20f580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f424002a910 tx=0x7f4240004170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=964b1d72e1cac1f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.358+0000 7f4249600640 1 -- 172.21.15.120:0/926076089 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240035030 con 0x557e4be454d0 2024-05-14T09:28:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.358+0000 7f4249600640 1 -- 172.21.15.120:0/926076089 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4240003a80 con 0x557e4be454d0 2024-05-14T09:28:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.358+0000 7f4249600640 1 -- 172.21.15.120:0/926076089 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240031a40 con 0x557e4be454d0 2024-05-14T09:28:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.358+0000 7f4259000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42380b29b0 0x7f42380b4ec0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x557e4c2092d0 tx=0x7f424c004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.360+0000 7f4262031740 1 -- 172.21.15.120:0/926076089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 msgr2=0x557e4c20f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.360+0000 7f4262031740 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c20f580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f424002a910 tx=0x7f4240004170 comp rx=0 tx=0).stop 2024-05-14T09:28:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.361+0000 7f4262031740 1 -- 172.21.15.120:0/926076089 shutdown_connections 2024-05-14T09:28:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.361+0000 7f4262031740 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c20f580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.361+0000 7f4262031740 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c208680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.361+0000 7f4262031740 1 --2- 172.21.15.120:0/926076089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be661b0 0x557e4c208100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.361+0000 7f4262031740 1 -- 172.21.15.120:0/926076089 >> 172.21.15.120:0/926076089 conn(0x557e4be5a300 msgr2=0x557e4c203a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.361+0000 7f4262031740 1 -- 172.21.15.120:0/926076089 shutdown_connections 2024-05-14T09:28:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.361+0000 7f4262031740 1 -- 172.21.15.120:0/926076089 wait complete. 2024-05-14T09:28:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.362+0000 7f4262031740 1 -- start start 2024-05-14T09:28:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.363+0000 7f4262031740 1 Processor -- start 2024-05-14T09:28:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.364+0000 7f4262031740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c211ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.364+0000 7f4262031740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be454d0 0x557e4c2120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.364+0000 7f4262031740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be661b0 0x557e4c219040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.364+0000 7f4253e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c211ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4253e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c211ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45762/0 (socket says 172.21.15.120:45762) 2024-05-14T09:28:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4253e00640 1 -- 172.21.15.120:0/107176718 learned_addr learned my addr 172.21.15.120:0/107176718 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557e4c20ff70 con 0x557e4be3d2f0 2024-05-14T09:28:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557e4c125660 con 0x557e4be454d0 2024-05-14T09:28:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557e4c2100f0 con 0x557e4be661b0 2024-05-14T09:28:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4259000640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be661b0 0x557e4c219040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4253e00640 1 -- 172.21.15.120:0/107176718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be661b0 msgr2=0x557e4c219040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4253e00640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be661b0 0x557e4c219040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4253e00640 1 -- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be454d0 msgr2=0x557e4c2120e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4262031740 10 client.0 _ll_register_callbacks cb 0x557e4c0ef400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.365+0000 7f4253400640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be454d0 0x557e4c2120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.366+0000 7f4253e00640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be454d0 0x557e4c2120e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.366+0000 7f4253e00640 1 -- 172.21.15.120:0/107176718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4bf4a620 con 0x557e4be3d2f0 2024-05-14T09:28:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.366+0000 7f4253400640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be454d0 0x557e4c2120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.366+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4240003a80 con 0x557e4be3d2f0 2024-05-14T09:28:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.367+0000 7f423e000640 10 client.16350 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:28:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.367+0000 7f4253e00640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c211ba0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f42440a64f0 tx=0x7f42440a8bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f94c3b08125ada1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.367+0000 7f423e000640 1 -- 172.21.15.120:0/107176718 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42440a9980 con 0x557e4be3d2f0 2024-05-14T09:28:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.368+0000 7f423e000640 1 -- 172.21.15.120:0/107176718 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f42440e40d0 con 0x557e4be3d2f0 2024-05-14T09:28:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.368+0000 7f423e000640 1 -- 172.21.15.120:0/107176718 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f42440a9280 con 0x557e4be3d2f0 2024-05-14T09:28:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.368+0000 7f4262031740 10 client.16350 fetch_fsmap learned FSMap version 41 2024-05-14T09:28:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.368+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({fsmap=41}) -- 0x557e4c21be90 con 0x557e4be3d2f0 2024-05-14T09:28:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.369+0000 7f423e000640 1 -- 172.21.15.120:0/107176718 <== mon.0 v2:172.21.15.120:3300/0 4 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f42440ad110 con 0x557e4be3d2f0 2024-05-14T09:28:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.369+0000 7f4262031740 10 client.16350 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:28:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.369+0000 7f4262031740 10 client.16350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.369+0000 7f4262031740 20 client.16350 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.369+0000 7f4262031740 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be24d80 0x557e4c21f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.369+0000 7f4262031740 4 client.16350 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.369+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e4c17a160 con 0x557e4be24d80 2024-05-14T09:28:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.370+0000 7f4253400640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be24d80 0x557e4c21f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.371+0000 7f4253400640 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be24d80 0x557e4c21f5a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ebd17df85e2a310 server_cookie=44a79a199c4ee4e4 in_seq=0 out_seq=0 2024-05-14T09:28:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.371+0000 7f423e000640 10 client.16350 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.373+0000 7f423e000640 1 -- 172.21.15.120:0/107176718 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e4c17a160 con 0x557e4be24d80 2024-05-14T09:28:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.373+0000 7f423e000640 10 client.16350 handle_command_reply: tid=0 2024-05-14T09:28:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.373+0000 7f4262031740 1 client.16350 shutdown 2024-05-14T09:28:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.374+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 msgr2=0x557e4c211ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.374+0000 7f4262031740 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c211ba0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f42440a64f0 tx=0x7f42440a8bd0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.374+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 shutdown_connections 2024-05-14T09:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.374+0000 7f4262031740 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be24d80 0x557e4c21f5a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.374+0000 7f4262031740 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be661b0 0x557e4c219040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.374+0000 7f4262031740 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be454d0 0x557e4c2120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.374+0000 7f4262031740 1 --2- 172.21.15.120:0/107176718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c211ba0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.375+0000 7f423e000640 0 client.16350 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.375+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 >> 172.21.15.120:0/107176718 conn(0x557e4be5a300 msgr2=0x557e4c202a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.375+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 shutdown_connections 2024-05-14T09:28:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.375+0000 7f4262031740 1 -- 172.21.15.120:0/107176718 wait complete. 2024-05-14T09:28:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.375+0000 7f4262031740 20 client.16350 trim_cache size 0 max 16384 2024-05-14T09:28:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.416+0000 7f4262031740 1 Processor -- start 2024-05-14T09:28:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.416+0000 7f4262031740 1 -- start start 2024-05-14T09:28:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.418+0000 7f4262031740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be24d80 0x557e4c207050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.418+0000 7f4262031740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c218fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.418+0000 7f4262031740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c219510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.418+0000 7f4262031740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f42541bb7e0 con 0x557e4be3d2f0 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.418+0000 7f4262031740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f42541bd380 con 0x557e4be24d80 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.418+0000 7f4262031740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42541bbeb0 con 0x557e4be454d0 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.419+0000 7f4253e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be24d80 0x557e4c207050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.419+0000 7f4259000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c219510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.419+0000 7f4259000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c219510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:41274/0 (socket says 172.21.15.120:41274) 2024-05-14T09:28:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.419+0000 7f4259000640 1 -- 172.21.15.120:0/2452505064 learned_addr learned my addr 172.21.15.120:0/2452505064 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.420+0000 7f4253400640 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c218fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.420+0000 7f4259000640 1 -- 172.21.15.120:0/2452505064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be24d80 msgr2=0x557e4c207050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.420+0000 7f4259000640 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be24d80 0x557e4c207050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.421+0000 7f4259000640 1 -- 172.21.15.120:0/2452505064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 msgr2=0x557e4c218fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.421+0000 7f4259000640 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c218fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.421+0000 7f4259000640 1 -- 172.21.15.120:0/2452505064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4c1ff280 con 0x557e4be454d0 2024-05-14T09:28:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.422+0000 7f4259000640 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c219510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f424c003c40 tx=0x7f424c0098e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a276116b61238b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.423+0000 7f4248c00640 1 -- 172.21.15.120:0/2452505064 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c019040 con 0x557e4be454d0 2024-05-14T09:28:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.423+0000 7f4248c00640 1 -- 172.21.15.120:0/2452505064 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f424c01a040 con 0x557e4be454d0 2024-05-14T09:28:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.423+0000 7f4248c00640 1 -- 172.21.15.120:0/2452505064 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c0108e0 con 0x557e4be454d0 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.425+0000 7f4262031740 1 -- 172.21.15.120:0/2452505064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 msgr2=0x557e4c219510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.425+0000 7f4262031740 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c219510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f424c003c40 tx=0x7f424c0098e0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.425+0000 7f4262031740 1 -- 172.21.15.120:0/2452505064 shutdown_connections 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.425+0000 7f4262031740 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be454d0 0x557e4c219510 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.425+0000 7f4262031740 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be3d2f0 0x557e4c218fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.425+0000 7f4262031740 1 --2- 172.21.15.120:0/2452505064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be24d80 0x557e4c207050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.425+0000 7f4262031740 1 -- 172.21.15.120:0/2452505064 >> 172.21.15.120:0/2452505064 conn(0x557e4be5a300 msgr2=0x557e4c206940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.426+0000 7f4262031740 1 -- 172.21.15.120:0/2452505064 shutdown_connections 2024-05-14T09:28:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.426+0000 7f4262031740 1 -- 172.21.15.120:0/2452505064 wait complete. 2024-05-14T09:28:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.427+0000 7f4262031740 1 -- start start 2024-05-14T09:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.427+0000 7f4262031740 1 Processor -- start 2024-05-14T09:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4262031740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be24d80 0x557e4c218810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4262031740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c218d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4262031740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be454d0 0x557e4c285b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4262031740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f42541bccb0 con 0x557e4be454d0 2024-05-14T09:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4262031740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f42541bc5e0 con 0x557e4be3d2f0 2024-05-14T09:28:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4262031740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42541b97e0 con 0x557e4be24d80 2024-05-14T09:28:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4262031740 10 client.0 _ll_register_callbacks cb 0x7f424400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4253e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be24d80 0x557e4c218810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.428+0000 7f4253400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c218d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4253e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be24d80 0x557e4c218810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:41282/0 (socket says 172.21.15.120:41282) 2024-05-14T09:28:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4253e00640 1 -- 172.21.15.120:0/3248321060 learned_addr learned my addr 172.21.15.120:0/3248321060 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4259000640 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be454d0 0x557e4c285b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4253e00640 1 -- 172.21.15.120:0/3248321060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 msgr2=0x557e4c218d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4253e00640 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c218d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4253e00640 1 -- 172.21.15.120:0/3248321060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be454d0 msgr2=0x557e4c285b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4253e00640 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be454d0 0x557e4c285b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.429+0000 7f4253e00640 1 -- 172.21.15.120:0/3248321060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4c286100 con 0x557e4be24d80 2024-05-14T09:28:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.431+0000 7f4253e00640 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be24d80 0x557e4c218810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42440a8f30 tx=0x7f42440df630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e100b1aa65211212 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.431+0000 7f423e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.432+0000 7f423e000640 1 -- 172.21.15.120:0/3248321060 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42440c8060 con 0x557e4be24d80 2024-05-14T09:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.432+0000 7f423e000640 1 -- 172.21.15.120:0/3248321060 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f42440e5d20 con 0x557e4be24d80 2024-05-14T09:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.432+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f424c01a040 con 0x557e4be24d80 2024-05-14T09:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.433+0000 7f423e000640 1 -- 172.21.15.120:0/3248321060 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f42440c3060 con 0x557e4be24d80 2024-05-14T09:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.433+0000 7f4262031740 10 client.25912 fetch_fsmap learned FSMap version 41 2024-05-14T09:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.433+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x557e4c2873e0 con 0x557e4be24d80 2024-05-14T09:28:42.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.435+0000 7f423e000640 1 -- 172.21.15.120:0/3248321060 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f424c01a040 con 0x557e4be24d80 2024-05-14T09:28:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.436+0000 7f423e000640 1 -- 172.21.15.120:0/3248321060 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f42440a4bf0 con 0x557e4be24d80 2024-05-14T09:28:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.436+0000 7f4262031740 10 client.25912 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:28:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.436+0000 7f4262031740 10 client.25912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.436+0000 7f4262031740 20 client.25912 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.436+0000 7f4262031740 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be661b0 0x557e4c289d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.437+0000 7f4262031740 4 client.25912 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:28:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.437+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e4c210c60 con 0x557e4be661b0 2024-05-14T09:28:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.437+0000 7f4253400640 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be661b0 0x557e4c289d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:42.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.439+0000 7f4253400640 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be661b0 0x557e4c289d70 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97568671060a461 server_cookie=fb24d330f0baf2e9 in_seq=0 out_seq=0 2024-05-14T09:28:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.439+0000 7f423e000640 10 client.25912 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.613+0000 7f423e000640 1 -- 172.21.15.120:0/3248321060 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e4c210c60 con 0x557e4be661b0 2024-05-14T09:28:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.613+0000 7f423e000640 10 client.25912 handle_command_reply: tid=0 2024-05-14T09:28:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.613+0000 7f4262031740 1 client.25912 shutdown 2024-05-14T09:28:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be24d80 msgr2=0x557e4c218810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be24d80 0x557e4c218810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42440a8f30 tx=0x7f42440df630 comp rx=0 tx=0).stop 2024-05-14T09:28:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 shutdown_connections 2024-05-14T09:28:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e4be661b0 0x557e4c289d70 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e4be454d0 0x557e4c285b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e4be3d2f0 0x557e4c218d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 --2- 172.21.15.120:0/3248321060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e4be24d80 0x557e4c218810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 >> 172.21.15.120:0/3248321060 conn(0x557e4be5a300 msgr2=0x557e4c223d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.615+0000 7f423e000640 0 client.25912 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.616+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 shutdown_connections 2024-05-14T09:28:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.616+0000 7f4262031740 1 -- 172.21.15.120:0/3248321060 wait complete. 2024-05-14T09:28:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.617+0000 7f4262031740 20 client.25912 trim_cache size 0 max 16384 2024-05-14T09:28:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:28:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:28:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:28:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:28:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.618+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42380b29b0 msgr2=0x7f42380b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.618+0000 7f425b000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42380b29b0 0x7f42380b4ec0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x557e4c2092d0 tx=0x7f424c004ab0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.618+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f425410a550 msgr2=0x7f42541a9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.618+0000 7f425b000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f425410a550 0x7f42541a9150 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f424400d770 tx=0x7f424400dc30 comp rx=0 tx=0).stop 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.619+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 shutdown_connections 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.619+0000 7f425b000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f42380b29b0 0x7f42380b4ec0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.619+0000 7f425b000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42541101a0 0x7f42541b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.619+0000 7f425b000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425410b480 0x7f42541a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.619+0000 7f425b000640 1 --2- 172.21.15.120:0/1467598694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f425410a550 0x7f42541a9150 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.619+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 >> 172.21.15.120:0/1467598694 conn(0x7f4254070670 msgr2=0x7f425410c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.621+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 shutdown_connections 2024-05-14T09:28:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:42.621+0000 7f425b000640 1 -- 172.21.15.120:0/1467598694 wait complete. 2024-05-14T09:28:44.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:43 smithi120 ceph-mon[31085]: pgmap v711: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 717 op/s 2024-05-14T09:28:44.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:43 smithi152 ceph-mon[34868]: pgmap v711: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 717 op/s 2024-05-14T09:28:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:43 smithi175 ceph-mon[35353]: pgmap v711: 129 pgs: 129 active+clean; 951 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 717 op/s 2024-05-14T09:28:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 70.0 s, 611.4 tps, lat 163.368 ms stddev 53.263 2024-05-14T09:28:46.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:45 smithi120 ceph-mon[31085]: pgmap v712: 129 pgs: 129 active+clean; 951 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.9 MiB/s wr, 722 op/s 2024-05-14T09:28:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:45 smithi152 ceph-mon[34868]: pgmap v712: 129 pgs: 129 active+clean; 951 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.9 MiB/s wr, 722 op/s 2024-05-14T09:28:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:45 smithi175 ceph-mon[35353]: pgmap v712: 129 pgs: 129 active+clean; 951 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.9 MiB/s wr, 722 op/s 2024-05-14T09:28:48.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:47 smithi120 ceph-mon[31085]: pgmap v713: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 729 op/s 2024-05-14T09:28:48.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:47 smithi152 ceph-mon[34868]: pgmap v713: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 729 op/s 2024-05-14T09:28:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:47 smithi175 ceph-mon[35353]: pgmap v713: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 729 op/s 2024-05-14T09:28:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 75.0 s, 625.6 tps, lat 123.049 ms stddev 36.138 2024-05-14T09:28:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:49 smithi120 ceph-mon[31085]: pgmap v714: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 800 op/s 2024-05-14T09:28:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:49 smithi152 ceph-mon[34868]: pgmap v714: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 800 op/s 2024-05-14T09:28:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:49 smithi175 ceph-mon[35353]: pgmap v714: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 800 op/s 2024-05-14T09:28:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:51 smithi120 ceph-mon[31085]: pgmap v715: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 735 op/s 2024-05-14T09:28:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:51 smithi152 ceph-mon[34868]: pgmap v715: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 735 op/s 2024-05-14T09:28:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:51 smithi175 ceph-mon[35353]: pgmap v715: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 735 op/s 2024-05-14T09:28:54.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:53 smithi120 ceph-mon[31085]: pgmap v716: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 682 op/s 2024-05-14T09:28:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:53 smithi152 ceph-mon[34868]: pgmap v716: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 682 op/s 2024-05-14T09:28:54.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:53 smithi175 ceph-mon[35353]: pgmap v716: 129 pgs: 129 active+clean; 952 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 682 op/s 2024-05-14T09:28:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 80.0 s, 611.0 tps, lat 116.261 ms stddev 29.346 2024-05-14T09:28:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.974+0000 7fda39000640 1 -- 172.21.15.120:0/3492836484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 msgr2=0x7fda341129f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.974+0000 7fda39000640 1 --2- 172.21.15.120:0/3492836484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 0x7fda341129f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda2c005fd0 tx=0x7fda2c02a550 comp rx=0 tx=0).stop 2024-05-14T09:28:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.975+0000 7fda39000640 1 -- 172.21.15.120:0/3492836484 shutdown_connections 2024-05-14T09:28:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.975+0000 7fda39000640 1 --2- 172.21.15.120:0/3492836484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 0x7fda341129f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.975+0000 7fda39000640 1 --2- 172.21.15.120:0/3492836484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3410b8d0 0x7fda3410bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.975+0000 7fda39000640 1 --2- 172.21.15.120:0/3492836484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3410a690 0x7fda3410b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.975+0000 7fda39000640 1 -- 172.21.15.120:0/3492836484 >> 172.21.15.120:0/3492836484 conn(0x7fda34070670 msgr2=0x7fda34072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.975+0000 7fda39000640 1 -- 172.21.15.120:0/3492836484 shutdown_connections 2024-05-14T09:28:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.976+0000 7fda39000640 1 -- 172.21.15.120:0/3492836484 wait complete. 2024-05-14T09:28:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.977+0000 7fda39000640 1 Processor -- start 2024-05-14T09:28:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.978+0000 7fda39000640 1 -- start start 2024-05-14T09:28:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.979+0000 7fda39000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3410a690 0x7fda341a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.979+0000 7fda31e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3410a690 0x7fda341a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.979+0000 7fda39000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3410b8d0 0x7fda341a9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.980+0000 7fda31e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3410a690 0x7fda341a9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52730/0 (socket says 172.21.15.120:52730) 2024-05-14T09:28:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.980+0000 7fda31e00640 1 -- 172.21.15.120:0/3437200177 learned_addr learned my addr 172.21.15.120:0/3437200177 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.980+0000 7fda39000640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 0x7fda341b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.980+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda34115c20 con 0x7fda3410a690 2024-05-14T09:28:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.980+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda34115aa0 con 0x7fda341105d0 2024-05-14T09:28:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.980+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda34115da0 con 0x7fda3410b8d0 2024-05-14T09:28:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.980+0000 7fda31400640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3410b8d0 0x7fda341a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.981+0000 7fda32800640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 0x7fda341b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.981+0000 7fda31400640 1 -- 172.21.15.120:0/3437200177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 msgr2=0x7fda341b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.981+0000 7fda31400640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 0x7fda341b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.981+0000 7fda31400640 1 -- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3410a690 msgr2=0x7fda341a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.981+0000 7fda31400640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3410a690 0x7fda341a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.981+0000 7fda31400640 1 -- 172.21.15.120:0/3437200177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda341b0b90 con 0x7fda3410b8d0 2024-05-14T09:28:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.983+0000 7fda31400640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3410b8d0 0x7fda341a9590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda24009790 tx=0x7fda24009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.983+0000 7fda2aa00640 1 -- 172.21.15.120:0/3437200177 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2401c070 con 0x7fda3410b8d0 2024-05-14T09:28:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.983+0000 7fda2aa00640 1 -- 172.21.15.120:0/3437200177 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda2400cc60 con 0x7fda3410b8d0 2024-05-14T09:28:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.983+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda341b0e80 con 0x7fda3410b8d0 2024-05-14T09:28:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.983+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda341b1340 con 0x7fda3410b8d0 2024-05-14T09:28:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.983+0000 7fda2aa00640 1 -- 172.21.15.120:0/3437200177 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240165c0 con 0x7fda3410b8d0 2024-05-14T09:28:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.992+0000 7fda2aa00640 1 -- 172.21.15.120:0/3437200177 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fda2401f070 con 0x7fda3410b8d0 2024-05-14T09:28:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.992+0000 7fda4006b740 1 Processor -- start 2024-05-14T09:28:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.992+0000 7fda4006b740 1 -- start start 2024-05-14T09:28:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda4006b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x559755342100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda4006b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f772f0 0x559755342680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda4006b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f7f4d0 0x559755349580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda4006b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5597552a6550 con 0x559754f7f4d0 2024-05-14T09:28:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda4006b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55975524bbc0 con 0x559754f772f0 2024-05-14T09:28:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda4006b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5597552a2510 con 0x559754fa01b0 2024-05-14T09:28:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda32800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x559755342100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda32800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x559755342100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:34276/0 (socket says 172.21.15.120:34276) 2024-05-14T09:28:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda32800640 1 -- 172.21.15.120:0/3914091321 learned_addr learned my addr 172.21.15.120:0/3914091321 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.993+0000 7fda31e00640 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f772f0 0x559755342680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.994+0000 7fda31400640 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f7f4d0 0x559755349580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.996+0000 7fda2aa00640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda180b2860 0x7fda180b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.996+0000 7fda2aa00640 1 -- 172.21.15.120:0/3437200177 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fda240e2120 con 0x7fda3410b8d0 2024-05-14T09:28:55.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.997+0000 7fda32800640 1 -- 172.21.15.120:0/3914091321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f772f0 msgr2=0x559755342680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:55.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.997+0000 7fda32800640 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f772f0 0x559755342680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:55.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.997+0000 7fda32800640 1 -- 172.21.15.120:0/3914091321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f7f4d0 msgr2=0x559755349580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:55.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.997+0000 7fda32800640 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f7f4d0 0x559755349580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.997+0000 7fda32800640 1 -- 172.21.15.120:0/3914091321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559754fb8210 con 0x559754fa01b0 2024-05-14T09:28:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.997+0000 7fda31400640 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f7f4d0 0x559755349580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:28:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.998+0000 7fda32800640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda180b2860 0x7fda180b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.998+0000 7fda32800640 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x559755342100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda2c005fd0 tx=0x7fda2c00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d87b88094a559dcb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:55.999+0000 7fda32800640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda180b2860 0x7fda180b4d70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fda2c040000 tx=0x7fda2c042000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.000+0000 7fda1f400640 1 -- 172.21.15.120:0/3914091321 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c04c020 con 0x559754fa01b0 2024-05-14T09:28:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.000+0000 7fda1f400640 1 -- 172.21.15.120:0/3914091321 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda2c042070 con 0x559754fa01b0 2024-05-14T09:28:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.000+0000 7fda1f400640 1 -- 172.21.15.120:0/3914091321 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c036040 con 0x559754fa01b0 2024-05-14T09:28:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.001+0000 7fda4006b740 1 -- 172.21.15.120:0/3914091321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 msgr2=0x559755342100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.001+0000 7fda4006b740 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x559755342100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda2c005fd0 tx=0x7fda2c00acf0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.002+0000 7fda4006b740 1 -- 172.21.15.120:0/3914091321 shutdown_connections 2024-05-14T09:28:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.002+0000 7fda4006b740 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f7f4d0 0x559755349580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.002+0000 7fda4006b740 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f772f0 0x559755342680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.002+0000 7fda4006b740 1 --2- 172.21.15.120:0/3914091321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x559755342100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.002+0000 7fda4006b740 1 -- 172.21.15.120:0/3914091321 >> 172.21.15.120:0/3914091321 conn(0x559754f94300 msgr2=0x55975533da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.003+0000 7fda4006b740 1 -- 172.21.15.120:0/3914091321 shutdown_connections 2024-05-14T09:28:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.004+0000 7fda4006b740 1 -- 172.21.15.120:0/3914091321 wait complete. 2024-05-14T09:28:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.005+0000 7fda4006b740 1 -- start start 2024-05-14T09:28:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.005+0000 7fda4006b740 1 Processor -- start 2024-05-14T09:28:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.007+0000 7fda4006b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975534bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda4006b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x55975534c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda4006b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x5597553530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda4006b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559755349f70 con 0x559754f772f0 2024-05-14T09:28:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda4006b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55975525f660 con 0x559754f7f4d0 2024-05-14T09:28:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda4006b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55975534a0f0 con 0x559754fa01b0 2024-05-14T09:28:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda32800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x5597553530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda32800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x5597553530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:34282/0 (socket says 172.21.15.120:34282) 2024-05-14T09:28:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.008+0000 7fda32800640 1 -- 172.21.15.120:0/3088451415 learned_addr learned my addr 172.21.15.120:0/3088451415 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.009+0000 7fda32800640 1 -- 172.21.15.120:0/3088451415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 msgr2=0x55975534c190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:28:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.009+0000 7fda32800640 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x55975534c190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.009+0000 7fda32800640 1 -- 172.21.15.120:0/3088451415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 msgr2=0x55975534bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.009+0000 7fda31e00640 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975534bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.010+0000 7fda32800640 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975534bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.010+0000 7fda32800640 1 -- 172.21.15.120:0/3088451415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559755084620 con 0x559754fa01b0 2024-05-14T09:28:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.010+0000 7fda4006b740 10 client.0 _ll_register_callbacks cb 0x559755229400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.010+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda2c042070 con 0x559754fa01b0 2024-05-14T09:28:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.010+0000 7fda32800640 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x5597553530f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda2c034040 tx=0x7fda2c004710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481c41e44de40878 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.010+0000 7fda13e00640 10 client.25924 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.011+0000 7fda31e00640 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975534bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:28:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.011+0000 7fda13e00640 1 -- 172.21.15.120:0/3088451415 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c04c040 con 0x559754fa01b0 2024-05-14T09:28:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.012+0000 7fda13e00640 1 -- 172.21.15.120:0/3088451415 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fda2c00a790 con 0x559754fa01b0 2024-05-14T09:28:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.012+0000 7fda13e00640 1 -- 172.21.15.120:0/3088451415 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fda2c05a470 con 0x559754fa01b0 2024-05-14T09:28:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.012+0000 7fda4006b740 10 client.25924 fetch_fsmap learned FSMap version 41 2024-05-14T09:28:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.012+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=41}) -- 0x559755355b80 con 0x559754fa01b0 2024-05-14T09:28:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.013+0000 7fda13e00640 1 -- 172.21.15.120:0/3088451415 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fda2c03c450 con 0x559754fa01b0 2024-05-14T09:28:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.013+0000 7fda4006b740 10 client.25924 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:28:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.013+0000 7fda4006b740 10 client.25924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.013+0000 7fda4006b740 20 client.25924 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.014+0000 7fda4006b740 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f5ed80 0x5597553594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.014+0000 7fda4006b740 4 client.25924 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:28:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.014+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597552b4160 con 0x559754f5ed80 2024-05-14T09:28:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.014+0000 7fda31e00640 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f5ed80 0x5597553594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.016+0000 7fda31e00640 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f5ed80 0x5597553594d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aecab6de4254241 server_cookie=89d9276177ee9fa0 in_seq=0 out_seq=0 2024-05-14T09:28:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.016+0000 7fda13e00640 10 client.25924 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.018+0000 7fda13e00640 1 -- 172.21.15.120:0/3088451415 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5597552b4160 con 0x559754f5ed80 2024-05-14T09:28:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.018+0000 7fda13e00640 10 client.25924 handle_command_reply: tid=0 2024-05-14T09:28:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.018+0000 7fda4006b740 1 client.25924 shutdown 2024-05-14T09:28:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 msgr2=0x5597553530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x5597553530f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda2c034040 tx=0x7fda2c004710 comp rx=0 tx=0).stop 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 shutdown_connections 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f5ed80 0x5597553594d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x5597553530f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x55975534c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 --2- 172.21.15.120:0/3088451415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975534bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 >> 172.21.15.120:0/3088451415 conn(0x559754f94300 msgr2=0x5597553409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda13e00640 0 client.25924 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 shutdown_connections 2024-05-14T09:28:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.019+0000 7fda4006b740 1 -- 172.21.15.120:0/3088451415 wait complete. 2024-05-14T09:28:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.020+0000 7fda4006b740 20 client.25924 trim_cache size 0 max 16384 2024-05-14T09:28:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.057+0000 7fda4006b740 1 Processor -- start 2024-05-14T09:28:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.057+0000 7fda4006b740 1 -- start start 2024-05-14T09:28:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.058+0000 7fda4006b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975533d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.058+0000 7fda4006b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x55975533d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.058+0000 7fda4006b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x55975533dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda4006b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda341bb9e0 con 0x559754f772f0 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda4006b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda341bd580 con 0x559754f7f4d0 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda31e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975533d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda4006b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda341bc0b0 con 0x559754fa01b0 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda31400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x55975533d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda31e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975533d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52768/0 (socket says 172.21.15.120:52768) 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda31e00640 1 -- 172.21.15.120:0/436202748 learned_addr learned my addr 172.21.15.120:0/436202748 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.059+0000 7fda32800640 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x55975533dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.060+0000 7fda31e00640 1 -- 172.21.15.120:0/436202748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 msgr2=0x55975533dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.060+0000 7fda31e00640 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x55975533dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.060+0000 7fda31e00640 1 -- 172.21.15.120:0/436202748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 msgr2=0x55975533d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.060+0000 7fda31e00640 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x55975533d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.060+0000 7fda31e00640 1 -- 172.21.15.120:0/436202748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559755339280 con 0x559754f772f0 2024-05-14T09:28:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.061+0000 7fda31e00640 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975533d210 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fda20000c00 tx=0x7fda20012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e1e2f71670b8ea server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.062+0000 7fda1ea00640 1 -- 172.21.15.120:0/436202748 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20004050 con 0x559754f772f0 2024-05-14T09:28:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.062+0000 7fda1ea00640 1 -- 172.21.15.120:0/436202748 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda200035f0 con 0x559754f772f0 2024-05-14T09:28:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.062+0000 7fda1ea00640 1 -- 172.21.15.120:0/436202748 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2001f370 con 0x559754f772f0 2024-05-14T09:28:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.064+0000 7fda4006b740 1 -- 172.21.15.120:0/436202748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 msgr2=0x55975533d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.064+0000 7fda4006b740 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975533d210 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fda20000c00 tx=0x7fda20012820 comp rx=0 tx=0).stop 2024-05-14T09:28:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.064+0000 7fda4006b740 1 -- 172.21.15.120:0/436202748 shutdown_connections 2024-05-14T09:28:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.064+0000 7fda4006b740 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754fa01b0 0x55975533dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.064+0000 7fda4006b740 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x55975533d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.064+0000 7fda4006b740 1 --2- 172.21.15.120:0/436202748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754f772f0 0x55975533d210 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.065+0000 7fda4006b740 1 -- 172.21.15.120:0/436202748 >> 172.21.15.120:0/436202748 conn(0x559754f94300 msgr2=0x5597553460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.065+0000 7fda4006b740 1 -- 172.21.15.120:0/436202748 shutdown_connections 2024-05-14T09:28:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.066+0000 7fda4006b740 1 -- 172.21.15.120:0/436202748 wait complete. 2024-05-14T09:28:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.066+0000 7fda4006b740 1 -- start start 2024-05-14T09:28:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.066+0000 7fda4006b740 1 Processor -- start 2024-05-14T09:28:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.067+0000 7fda4006b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754f772f0 0x5597553504d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.067+0000 7fda4006b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x559755350a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.067+0000 7fda4006b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754fa01b0 0x5597553bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.067+0000 7fda4006b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda341bceb0 con 0x559754fa01b0 2024-05-14T09:28:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.067+0000 7fda4006b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda341bc7e0 con 0x559754f7f4d0 2024-05-14T09:28:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.067+0000 7fda4006b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda341b99e0 con 0x559754f772f0 2024-05-14T09:28:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.067+0000 7fda4006b740 10 client.0 _ll_register_callbacks cb 0x7fda2c040030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:28:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.068+0000 7fda31e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754f772f0 0x5597553504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.068+0000 7fda32800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754fa01b0 0x5597553bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.068+0000 7fda31e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754f772f0 0x5597553504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:34296/0 (socket says 172.21.15.120:34296) 2024-05-14T09:28:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.068+0000 7fda31e00640 1 -- 172.21.15.120:0/931338408 learned_addr learned my addr 172.21.15.120:0/931338408 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:28:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.069+0000 7fda31e00640 1 -- 172.21.15.120:0/931338408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 msgr2=0x559755350a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.069+0000 7fda31e00640 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x559755350a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.069+0000 7fda31e00640 1 -- 172.21.15.120:0/931338408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754fa01b0 msgr2=0x5597553bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:28:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.069+0000 7fda31e00640 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754fa01b0 0x5597553bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.069+0000 7fda31e00640 1 -- 172.21.15.120:0/931338408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559755345bb0 con 0x559754f772f0 2024-05-14T09:28:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.070+0000 7fda31e00640 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754f772f0 0x5597553504d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda20005e00 tx=0x7fda200123b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=662a84b8ca3677df server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:28:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.070+0000 7fda13e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:28:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.070+0000 7fda13e00640 1 -- 172.21.15.120:0/931338408 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200037a0 con 0x559754f772f0 2024-05-14T09:28:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.070+0000 7fda13e00640 1 -- 172.21.15.120:0/931338408 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fda20003940 con 0x559754f772f0 2024-05-14T09:28:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.070+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda200035f0 con 0x559754f772f0 2024-05-14T09:28:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.071+0000 7fda13e00640 1 -- 172.21.15.120:0/931338408 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fda20038050 con 0x559754f772f0 2024-05-14T09:28:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.071+0000 7fda4006b740 10 client.25930 fetch_fsmap learned FSMap version 41 2024-05-14T09:28:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.071+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5597553c0ae0 con 0x559754f772f0 2024-05-14T09:28:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.072+0000 7fda13e00640 1 -- 172.21.15.120:0/931338408 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda200035f0 con 0x559754f772f0 2024-05-14T09:28:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.072+0000 7fda13e00640 1 -- 172.21.15.120:0/931338408 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fda2c031970 con 0x559754f772f0 2024-05-14T09:28:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.073+0000 7fda4006b740 10 client.25930 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:28:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.073+0000 7fda4006b740 10 client.25930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:28:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.073+0000 7fda4006b740 20 client.25930 populate_metadata read hostname 'smithi120' 2024-05-14T09:28:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.073+0000 7fda4006b740 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f341c0 0x5597553c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:28:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.073+0000 7fda4006b740 4 client.25930 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:28:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.073+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597552adfd0 con 0x559754f341c0 2024-05-14T09:28:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.074+0000 7fda31400640 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f341c0 0x5597553c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:28:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.075+0000 7fda31400640 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f341c0 0x5597553c33e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb213070939287e server_cookie=30e5ecc3ca9f721d in_seq=0 out_seq=0 2024-05-14T09:28:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.075+0000 7fda13e00640 10 client.25930 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.100+0000 7fda13e00640 1 -- 172.21.15.120:0/931338408 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597552adfd0 con 0x559754f341c0 2024-05-14T09:28:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.100+0000 7fda13e00640 10 client.25930 handle_command_reply: tid=0 2024-05-14T09:28:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.100+0000 7fda4006b740 1 client.25930 shutdown 2024-05-14T09:28:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.100+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754f772f0 msgr2=0x5597553504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.100+0000 7fda4006b740 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754f772f0 0x5597553504d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda20005e00 tx=0x7fda200123b0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 shutdown_connections 2024-05-14T09:28:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda4006b740 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559754f341c0 0x5597553c33e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda4006b740 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559754fa01b0 0x5597553bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda13e00640 0 client.25930 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:28:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda4006b740 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559754f7f4d0 0x559755350a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda4006b740 1 --2- 172.21.15.120:0/931338408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559754f772f0 0x5597553504d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 >> 172.21.15.120:0/931338408 conn(0x559754f94300 msgr2=0x559755340890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.101+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 shutdown_connections 2024-05-14T09:28:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.102+0000 7fda4006b740 1 -- 172.21.15.120:0/931338408 wait complete. 2024-05-14T09:28:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.102+0000 7fda4006b740 20 client.25930 trim_cache size 0 max 16384 2024-05-14T09:28:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:28:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:28:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:28:56.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:28:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.104+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda180b2860 msgr2=0x7fda180b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda180b2860 0x7fda180b4d70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fda2c040000 tx=0x7fda2c042000 comp rx=0 tx=0).stop 2024-05-14T09:28:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3410b8d0 msgr2=0x7fda341a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:28:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3410b8d0 0x7fda341a9590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda24009790 tx=0x7fda24009c50 comp rx=0 tx=0).stop 2024-05-14T09:28:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 shutdown_connections 2024-05-14T09:28:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fda180b2860 0x7fda180b4d70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda341105d0 0x7fda341b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3410b8d0 0x7fda341a9590 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 --2- 172.21.15.120:0/3437200177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3410a690 0x7fda341a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:28:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.105+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 >> 172.21.15.120:0/3437200177 conn(0x7fda34070670 msgr2=0x7fda3410c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:28:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.106+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 shutdown_connections 2024-05-14T09:28:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:28:56.106+0000 7fda39000640 1 -- 172.21.15.120:0/3437200177 wait complete. 2024-05-14T09:28:56.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:55 smithi120 ceph-mon[31085]: pgmap v717: 129 pgs: 129 active+clean; 953 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 765 op/s 2024-05-14T09:28:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:55 smithi152 ceph-mon[34868]: pgmap v717: 129 pgs: 129 active+clean; 953 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 765 op/s 2024-05-14T09:28:56.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:55 smithi175 ceph-mon[35353]: pgmap v717: 129 pgs: 129 active+clean; 953 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 765 op/s 2024-05-14T09:28:58.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:28:58.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:57 smithi120 ceph-mon[31085]: pgmap v718: 129 pgs: 129 active+clean; 953 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 733 op/s 2024-05-14T09:28:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:57 smithi152 ceph-mon[34868]: pgmap v718: 129 pgs: 129 active+clean; 953 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 733 op/s 2024-05-14T09:28:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:57 smithi175 ceph-mon[35353]: pgmap v718: 129 pgs: 129 active+clean; 953 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 733 op/s 2024-05-14T09:28:58.547 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:28:59.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 85.0 s, 538.0 tps, lat 132.300 ms stddev 68.177 2024-05-14T09:28:59.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:28:59 smithi120 ceph-mon[31085]: pgmap v719: 129 pgs: 129 active+clean; 953 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.5 MiB/s wr, 771 op/s 2024-05-14T09:29:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:28:59 smithi152 ceph-mon[34868]: pgmap v719: 129 pgs: 129 active+clean; 953 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.5 MiB/s wr, 771 op/s 2024-05-14T09:29:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:28:59 smithi175 ceph-mon[35353]: pgmap v719: 129 pgs: 129 active+clean; 953 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.5 MiB/s wr, 771 op/s 2024-05-14T09:29:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.022+0000 7f3aca000700 1 -- 172.21.15.120:0/3344366247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4075b60 msgr2=0x7f3ac4075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.022+0000 7f3aca000700 1 --2- 172.21.15.120:0/3344366247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4075b60 0x7f3ac4075f70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009f90 tx=0x7f3ab400b330 comp rx=0 tx=0).stop 2024-05-14T09:29:02.023 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:01 smithi120 ceph-mon[31085]: pgmap v720: 129 pgs: 129 active+clean; 953 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 759 op/s 2024-05-14T09:29:02.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.023+0000 7f3aca000700 1 -- 172.21.15.120:0/3344366247 shutdown_connections 2024-05-14T09:29:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.023+0000 7f3aca000700 1 --2- 172.21.15.120:0/3344366247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac4115370 0x7f3ac4117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.023+0000 7f3aca000700 1 --2- 172.21.15.120:0/3344366247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4075b60 0x7f3ac4075f70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.023+0000 7f3aca000700 1 --2- 172.21.15.120:0/3344366247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40764b0 0x7f3ac4114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.023+0000 7f3aca000700 1 -- 172.21.15.120:0/3344366247 >> 172.21.15.120:0/3344366247 conn(0x7f3ac4100040 msgr2=0x7f3ac4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.024+0000 7f3aca000700 1 -- 172.21.15.120:0/3344366247 shutdown_connections 2024-05-14T09:29:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.025+0000 7f3aca000700 1 -- 172.21.15.120:0/3344366247 wait complete. 2024-05-14T09:29:02.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.027+0000 7f3aca000700 1 Processor -- start 2024-05-14T09:29:02.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.027+0000 7f3aca000700 1 -- start start 2024-05-14T09:29:02.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.027+0000 7f3aca000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac4075b60 0x7f3ac41a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.027+0000 7f3aca000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40764b0 0x7f3ac41a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3aca000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4115370 0x7f3ac41a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3aca000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac411a980 con 0x7f3ac4115370 2024-05-14T09:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3aca000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac411a800 con 0x7f3ac40764b0 2024-05-14T09:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3aca000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac411ab00 con 0x7f3ac4075b60 2024-05-14T09:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4115370 0x7f3ac41a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4115370 0x7f3ac41a5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35778/0 (socket says 172.21.15.120:35778) 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3ac3e00700 1 -- 172.21.15.120:0/624854466 learned_addr learned my addr 172.21.15.120:0/624854466 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.028+0000 7f3abbe00700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40764b0 0x7f3ac41a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.029+0000 7f3ac3400700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac4075b60 0x7f3ac41a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.029+0000 7f3abbe00700 1 -- 172.21.15.120:0/624854466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac4075b60 msgr2=0x7f3ac41a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.029+0000 7f3abbe00700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac4075b60 0x7f3ac41a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.029+0000 7f3abbe00700 1 -- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4115370 msgr2=0x7f3ac41a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.029+0000 7f3abbe00700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4115370 0x7f3ac41a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.029+0000 7f3abbe00700 1 -- 172.21.15.120:0/624854466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac41a6280 con 0x7f3ac40764b0 2024-05-14T09:29:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.031+0000 7f3abbe00700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40764b0 0x7f3ac41a1950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00e9f0 tx=0x7f3aac00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.032+0000 7f3ac0c00700 1 -- 172.21.15.120:0/624854466 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00cbd0 con 0x7f3ac40764b0 2024-05-14T09:29:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.032+0000 7f3ac0c00700 1 -- 172.21.15.120:0/624854466 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3aac00cd70 con 0x7f3ac40764b0 2024-05-14T09:29:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.032+0000 7f3ac0c00700 1 -- 172.21.15.120:0/624854466 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac018680 con 0x7f3ac40764b0 2024-05-14T09:29:02.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.032+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac41a6570 con 0x7f3ac40764b0 2024-05-14T09:29:02.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.032+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac41ade90 con 0x7f3ac40764b0 2024-05-14T09:29:02.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.038+0000 7f3ad8a73b80 1 Processor -- start 2024-05-14T09:29:02.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.038+0000 7f3ad8a73b80 1 -- start start 2024-05-14T09:29:02.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.039+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c3b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.039+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.039+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 0x55c286c35e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.039+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c286b57a20 con 0x55c286ab7e40 2024-05-14T09:29:02.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.039+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c286af5760 con 0x55c286c359f0 2024-05-14T09:29:02.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.039+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c286b539e0 con 0x55c286c3b830 2024-05-14T09:29:02.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.040+0000 7f3ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c3b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.040+0000 7f3ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c3b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35790/0 (socket says 172.21.15.120:35790) 2024-05-14T09:29:02.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.040+0000 7f3ac3e00700 1 -- 172.21.15.120:0/2669565967 learned_addr learned my addr 172.21.15.120:0/2669565967 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:02.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.040+0000 7f3ac3400700 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.041+0000 7f3ac3400700 1 -- 172.21.15.120:0/2669565967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 msgr2=0x55c286c35e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:29:02.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.041+0000 7f3ac3400700 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 0x55c286c35e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.041+0000 7f3ac3400700 1 -- 172.21.15.120:0/2669565967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 msgr2=0x55c286c3b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:02.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.041+0000 7f3ac3400700 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c3b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.041+0000 7f3ac3400700 1 -- 172.21.15.120:0/2669565967 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c286aa48d0 con 0x55c286c3b830 2024-05-14T09:29:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.042+0000 7f3ac3400700 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c354b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009f90 tx=0x7f3ab4009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec16fa7800fbd5d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.042+0000 7f3ab8c00700 1 -- 172.21.15.120:0/2669565967 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4021070 con 0x55c286c3b830 2024-05-14T09:29:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.043+0000 7f3ab8c00700 1 -- 172.21.15.120:0/2669565967 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ab4004c50 con 0x55c286c3b830 2024-05-14T09:29:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.043+0000 7f3ab8c00700 1 -- 172.21.15.120:0/2669565967 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4007bf0 con 0x55c286c3b830 2024-05-14T09:29:02.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.045+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2669565967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 msgr2=0x55c286c354b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.045+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c354b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009f90 tx=0x7f3ab4009ac0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.046+0000 7f3ac0c00700 1 -- 172.21.15.120:0/624854466 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3aac010430 con 0x7f3ac40764b0 2024-05-14T09:29:02.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.048+0000 7f3ac0c00700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3aa80b2980 0x7f3aa80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ac0c00700 1 -- 172.21.15.120:0/624854466 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3aac0e28a0 con 0x7f3ac40764b0 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2669565967 shutdown_connections 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 0x55c286c35e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c3b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2669565967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c354b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2669565967 >> 172.21.15.120:0/2669565967 conn(0x55c286afcf70 msgr2=0x55c286c302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2669565967 shutdown_connections 2024-05-14T09:29:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.049+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2669565967 wait complete. 2024-05-14T09:29:02.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.050+0000 7f3ac3e00700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3aa80b2980 0x7f3aa80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.051+0000 7f3ad8a73b80 1 -- start start 2024-05-14T09:29:02.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.051+0000 7f3ac3e00700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3aa80b2980 0x7f3aa80b4e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3abc005d10 tx=0x7f3abc009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:02.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.052+0000 7f3ad8a73b80 1 Processor -- start 2024-05-14T09:29:02.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.053+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286ab7e40 0x55c286c3f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.053+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c359f0 0x55c286c3f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.054+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c3fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.054+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c286c532c0 con 0x55c286c359f0 2024-05-14T09:29:02.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.054+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c286abdb20 con 0x55c286c3b830 2024-05-14T09:29:02.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.054+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c286c53440 con 0x55c286ab7e40 2024-05-14T09:29:02.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.054+0000 7f3ad8a73b80 10 client.0 _ll_register_callbacks cb 0x55c286afec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.054+0000 7f3abbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c359f0 0x55c286c3f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.054+0000 7f3ac3e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c3fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.055+0000 7f3ac3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286ab7e40 0x55c286c3f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.055+0000 7f3ac3e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c3fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:60488/0 (socket says 172.21.15.120:60488) 2024-05-14T09:29:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.055+0000 7f3ac3e00700 1 -- 172.21.15.120:0/3689685951 learned_addr learned my addr 172.21.15.120:0/3689685951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.055+0000 7f3ac3e00700 1 -- 172.21.15.120:0/3689685951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286ab7e40 msgr2=0x55c286c3f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.055+0000 7f3ac3e00700 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286ab7e40 0x55c286c3f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.056+0000 7f3ac3e00700 1 -- 172.21.15.120:0/3689685951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c359f0 msgr2=0x55c286c3f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.056+0000 7f3ac3e00700 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c359f0 0x55c286c3f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.056+0000 7f3ac3e00700 1 -- 172.21.15.120:0/3689685951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c286b1d420 con 0x55c286c3b830 2024-05-14T09:29:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.057+0000 7f3ac3e00700 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c3fac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009aa0 tx=0x7f3abc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d90d1f5ef4dc1d97 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.057+0000 7f3ab1600700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:29:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.057+0000 7f3ab1600700 1 -- 172.21.15.120:0/3689685951 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc01ee60 con 0x55c286c3b830 2024-05-14T09:29:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.058+0000 7f3ab1600700 1 -- 172.21.15.120:0/3689685951 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3abc018030 con 0x55c286c3b830 2024-05-14T09:29:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.058+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ab4004c50 con 0x55c286c3b830 2024-05-14T09:29:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.059+0000 7f3ab1600700 1 -- 172.21.15.120:0/3689685951 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3abc004020 con 0x55c286c3b830 2024-05-14T09:29:02.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.059+0000 7f3ad8a73b80 10 client.35858 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:02.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.059+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c286c5dfc0 con 0x55c286c3b830 2024-05-14T09:29:02.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.061+0000 7f3ab1600700 1 -- 172.21.15.120:0/3689685951 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3abc003680 con 0x55c286c3b830 2024-05-14T09:29:02.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.061+0000 7f3ab1600700 1 -- 172.21.15.120:0/3689685951 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f3abc0294b0 con 0x55c286c3b830 2024-05-14T09:29:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.061+0000 7f3ad8a73b80 10 client.35858 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.061+0000 7f3ad8a73b80 10 client.35858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.061+0000 7f3ad8a73b80 20 client.35858 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.061+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286c606a0 0x55c286c62b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.062+0000 7f3ad8a73b80 4 client.35858 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.062+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3ab4004c50 con 0x55c286c606a0 2024-05-14T09:29:02.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.062+0000 7f3ac3400700 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286c606a0 0x55c286c62b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.064+0000 7f3ab1600700 10 client.35858 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:02.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.064+0000 7f3ac3400700 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286c606a0 0x55c286c62b40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ba3081aaa47efdf server_cookie=b3bfab4c0a122d89 in_seq=0 out_seq=0 2024-05-14T09:29:02.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.067+0000 7f3ab1600700 1 -- 172.21.15.120:0/3689685951 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f3ab4004c50 con 0x55c286c606a0 2024-05-14T09:29:02.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.067+0000 7f3ab1600700 10 client.35858 handle_command_reply: tid=0 2024-05-14T09:29:02.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.067+0000 7f3ad8a73b80 1 client.35858 shutdown 2024-05-14T09:29:02.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 msgr2=0x55c286c3fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c3fac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009aa0 tx=0x7f3abc0047c0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 shutdown_connections 2024-05-14T09:29:02.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286c606a0 0x55c286c62b40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c3fac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286ab7e40 0x55c286c3f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/3689685951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c359f0 0x55c286c3f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 >> 172.21.15.120:0/3689685951 conn(0x55c286afcf70 msgr2=0x55c286c344a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:02.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.069+0000 7f3ab1600700 0 client.35858 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:02.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.070+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 shutdown_connections 2024-05-14T09:29:02.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.071+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/3689685951 wait complete. 2024-05-14T09:29:02.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.071+0000 7f3ad8a73b80 20 client.35858 trim_cache size 0 max 16384 2024-05-14T09:29:02.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.111+0000 7f3ad8a73b80 1 Processor -- start 2024-05-14T09:29:02.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.111+0000 7f3ad8a73b80 1 -- start start 2024-05-14T09:29:02.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.112+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.112+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 0x55c286c2aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.113+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c30400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.113+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41ae180 con 0x55c286ab7e40 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.113+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41afd20 con 0x55c286c359f0 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.113+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41ae850 con 0x55c286c3b830 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.113+0000 7f3ac3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.113+0000 7f3ac3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c354b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35812/0 (socket says 172.21.15.120:35812) 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.114+0000 7f3ac3400700 1 -- 172.21.15.120:0/1105106526 learned_addr learned my addr 172.21.15.120:0/1105106526 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.114+0000 7f3abbe00700 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 0x55c286c2aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.114+0000 7f3ac3e00700 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c30400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.116+0000 7f3ac3400700 1 -- 172.21.15.120:0/1105106526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 msgr2=0x55c286c30400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.116+0000 7f3ac3400700 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c30400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.116+0000 7f3ac3400700 1 -- 172.21.15.120:0/1105106526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 msgr2=0x55c286c2aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.116+0000 7f3ac3400700 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 0x55c286c2aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.116+0000 7f3ac3400700 1 -- 172.21.15.120:0/1105106526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c286c31d70 con 0x55c286ab7e40 2024-05-14T09:29:02.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.117+0000 7f3ac3e00700 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c30400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:02.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.117+0000 7f3ac3400700 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c354b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4000f80 tx=0x7f3ab401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65d5b87dcd58381 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:02.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.118+0000 7f3ab3e00700 1 -- 172.21.15.120:0/1105106526 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4021040 con 0x55c286ab7e40 2024-05-14T09:29:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.119+0000 7f3ab3e00700 1 -- 172.21.15.120:0/1105106526 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ab400cd00 con 0x55c286ab7e40 2024-05-14T09:29:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.120+0000 7f3ab3e00700 1 -- 172.21.15.120:0/1105106526 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab402e9b0 con 0x55c286ab7e40 2024-05-14T09:29:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/1105106526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 msgr2=0x55c286c354b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c354b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4000f80 tx=0x7f3ab401d040 comp rx=0 tx=0).stop 2024-05-14T09:29:02.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/1105106526 shutdown_connections 2024-05-14T09:29:02.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c3b830 0x55c286c30400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286ab7e40 0x55c286c354b0 secure :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4000f80 tx=0x7f3ab401d040 comp rx=0 tx=0).stop 2024-05-14T09:29:02.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/1105106526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c359f0 0x55c286c2aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/1105106526 >> 172.21.15.120:0/1105106526 conn(0x55c286afcf70 msgr2=0x55c286c38cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:02.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.121+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/1105106526 shutdown_connections 2024-05-14T09:29:02.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.122+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/1105106526 wait complete. 2024-05-14T09:29:02.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.123+0000 7f3ad8a73b80 1 -- start start 2024-05-14T09:29:02.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.123+0000 7f3ad8a73b80 1 Processor -- start 2024-05-14T09:29:02.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c359f0 0x55c286c67b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c68090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ad8a73b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c685d0 0x55c286cc9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41af650 con 0x55c286c685d0 2024-05-14T09:29:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41aef80 con 0x55c286c3b830 2024-05-14T09:29:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ad8a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac4073ad0 con 0x55c286c359f0 2024-05-14T09:29:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ad8a73b80 10 client.0 _ll_register_callbacks cb 0x55c286afec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c685d0 0x55c286cc9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.124+0000 7f3ac3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c359f0 0x55c286c67b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.125+0000 7f3ac3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c359f0 0x55c286c67b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:41726/0 (socket says 172.21.15.120:41726) 2024-05-14T09:29:02.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.125+0000 7f3ac3400700 1 -- 172.21.15.120:0/2371749518 learned_addr learned my addr 172.21.15.120:0/2371749518 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:02.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.125+0000 7f3abbe00700 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c68090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.126+0000 7f3ac3400700 1 -- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 msgr2=0x55c286c68090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:02.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.126+0000 7f3ac3400700 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c68090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.126+0000 7f3ac3400700 1 -- 172.21.15.120:0/2371749518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c685d0 msgr2=0x55c286cc9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:02.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.126+0000 7f3ac3400700 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c685d0 0x55c286cc9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.126+0000 7f3ac3400700 1 -- 172.21.15.120:0/2371749518 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c286cca3b0 con 0x55c286c359f0 2024-05-14T09:29:02.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.127+0000 7f3ac3400700 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c359f0 0x55c286c67b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009b00 tx=0x7f3ab400cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8496a4b9e9d8ddaa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:02.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.127+0000 7f3ab1600700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:02.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.127+0000 7f3ab1600700 1 -- 172.21.15.120:0/2371749518 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4021040 con 0x55c286c359f0 2024-05-14T09:29:02.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.127+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ab400cd00 con 0x55c286c359f0 2024-05-14T09:29:02.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.128+0000 7f3ab1600700 1 -- 172.21.15.120:0/2371749518 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3ab400bcc0 con 0x55c286c359f0 2024-05-14T09:29:02.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.129+0000 7f3ab1600700 1 -- 172.21.15.120:0/2371749518 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3ab402e480 con 0x55c286c359f0 2024-05-14T09:29:02.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.129+0000 7f3ad8a73b80 10 client.25945 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:02.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.129+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c286ccb500 con 0x55c286c359f0 2024-05-14T09:29:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.132+0000 7f3ab1600700 1 -- 172.21.15.120:0/2371749518 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ab400cd00 con 0x55c286c359f0 2024-05-14T09:29:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.132+0000 7f3ab1600700 1 -- 172.21.15.120:0/2371749518 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f3ab4011070 con 0x55c286c359f0 2024-05-14T09:29:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.134+0000 7f3ad8a73b80 10 client.25945 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.134+0000 7f3ad8a73b80 10 client.25945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.134+0000 7f3ad8a73b80 20 client.25945 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.134+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286ccb6d0 0x55c286ccdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:02.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.134+0000 7f3ad8a73b80 4 client.25945 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:29:02.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.134+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c286c021c0 con 0x55c286ccb6d0 2024-05-14T09:29:02.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.135+0000 7f3abbe00700 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286ccb6d0 0x55c286ccdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.136+0000 7f3abbe00700 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286ccb6d0 0x55c286ccdaf0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed80412ac86f5b89 server_cookie=e293a6070ca74d92 in_seq=0 out_seq=0 2024-05-14T09:29:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.136+0000 7f3ab1600700 10 client.25945 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.136+0000 7f3ab1600700 1 -- 172.21.15.120:0/2371749518 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c286c021c0 con 0x55c286ccb6d0 2024-05-14T09:29:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.137+0000 7f3ab1600700 10 client.25945 handle_command_reply: tid=0 2024-05-14T09:29:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.137+0000 7f3ad8a73b80 1 client.25945 shutdown 2024-05-14T09:29:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.137+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c359f0 msgr2=0x55c286c67b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.137+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c359f0 0x55c286c67b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009b00 tx=0x7f3ab400cf30 comp rx=0 tx=0).stop 2024-05-14T09:29:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.138+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 shutdown_connections 2024-05-14T09:29:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.138+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55c286ccb6d0 0x55c286ccdaf0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.138+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c286c685d0 0x55c286cc9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.138+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c286c359f0 0x55c286c67b50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.138+0000 7f3ad8a73b80 1 --2- 172.21.15.120:0/2371749518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c286c3b830 0x55c286c68090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.138+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 >> 172.21.15.120:0/2371749518 conn(0x55c286afcf70 msgr2=0x55c286c2a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.138+0000 7f3ab1600700 0 client.25945 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.139+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 shutdown_connections 2024-05-14T09:29:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.139+0000 7f3ad8a73b80 1 -- 172.21.15.120:0/2371749518 wait complete. 2024-05-14T09:29:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.140+0000 7f3ad8a73b80 20 client.25945 trim_cache size 0 max 16384 2024-05-14T09:29:02.140 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:29:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-05-14T09:29:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-05-14T09:29:02.140 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:29:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.141+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3aa80b2980 msgr2=0x7f3aa80b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.141+0000 7f3aca000700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3aa80b2980 0x7f3aa80b4e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3abc005d10 tx=0x7f3abc009310 comp rx=0 tx=0).stop 2024-05-14T09:29:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.141+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40764b0 msgr2=0x7f3ac41a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.141+0000 7f3aca000700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40764b0 0x7f3ac41a1950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00e9f0 tx=0x7f3aac00ed00 comp rx=0 tx=0).stop 2024-05-14T09:29:02.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.142+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 shutdown_connections 2024-05-14T09:29:02.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.142+0000 7f3aca000700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3aa80b2980 0x7f3aa80b4e90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.142+0000 7f3aca000700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ac4115370 0x7f3ac41a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.142+0000 7f3aca000700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ac4075b60 0x7f3ac41a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.142+0000 7f3aca000700 1 --2- 172.21.15.120:0/624854466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40764b0 0x7f3ac41a1950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:02.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.142+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 >> 172.21.15.120:0/624854466 conn(0x7f3ac4100040 msgr2=0x7f3ac4102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:02.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.142+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 shutdown_connections 2024-05-14T09:29:02.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:02.143+0000 7f3aca000700 1 -- 172.21.15.120:0/624854466 wait complete. 2024-05-14T09:29:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:01 smithi152 ceph-mon[34868]: pgmap v720: 129 pgs: 129 active+clean; 953 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 759 op/s 2024-05-14T09:29:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:01 smithi175 ceph-mon[35353]: pgmap v720: 129 pgs: 129 active+clean; 953 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 759 op/s 2024-05-14T09:29:03.008 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T09:29:03.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:29:03.781 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:03 smithi120 ceph-mon[31085]: pgmap v721: 129 pgs: 129 active+clean; 954 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 689 op/s 2024-05-14T09:29:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:03 smithi152 ceph-mon[34868]: pgmap v721: 129 pgs: 129 active+clean; 954 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 689 op/s 2024-05-14T09:29:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:03 smithi175 ceph-mon[35353]: pgmap v721: 129 pgs: 129 active+clean; 954 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 689 op/s 2024-05-14T09:29:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 90.0 s, 516.2 tps, lat 137.111 ms stddev 72.125 2024-05-14T09:29:05.868 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:05 smithi120 ceph-mon[31085]: pgmap v722: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 731 op/s 2024-05-14T09:29:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:05 smithi152 ceph-mon[34868]: pgmap v722: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 731 op/s 2024-05-14T09:29:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:05 smithi175 ceph-mon[35353]: pgmap v722: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 731 op/s 2024-05-14T09:29:06.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.324+0000 7f1b5a000700 1 -- 172.21.15.120:0/3994572183 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c003b80 con 0x7f1b5c1034c0 2024-05-14T09:29:06.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.325+0000 7f1b62800700 1 -- 172.21.15.120:0/3994572183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 msgr2=0x7f1b5c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:06.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.325+0000 7f1b62800700 1 --2- 172.21.15.120:0/3994572183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 0x7f1b5c1038d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0099c0 tx=0x7f1b4c009cd0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.326+0000 7f1b62800700 1 -- 172.21.15.120:0/3994572183 shutdown_connections 2024-05-14T09:29:06.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.326+0000 7f1b62800700 1 --2- 172.21.15.120:0/3994572183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 0x7f1b5c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.326+0000 7f1b62800700 1 --2- 172.21.15.120:0/3994572183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 0x7f1b5c1038d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.326+0000 7f1b62800700 1 --2- 172.21.15.120:0/3994572183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b5c107df0 0x7f1b5c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.326+0000 7f1b62800700 1 -- 172.21.15.120:0/3994572183 >> 172.21.15.120:0/3994572183 conn(0x7f1b5c0fedc0 msgr2=0x7f1b5c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:06.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.327+0000 7f1b62800700 1 -- 172.21.15.120:0/3994572183 shutdown_connections 2024-05-14T09:29:06.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.327+0000 7f1b62800700 1 -- 172.21.15.120:0/3994572183 wait complete. 2024-05-14T09:29:06.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.329+0000 7f1b62800700 1 Processor -- start 2024-05-14T09:29:06.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.329+0000 7f1b62800700 1 -- start start 2024-05-14T09:29:06.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.329+0000 7f1b62800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 0x7f1b5c10a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:06.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.329+0000 7f1b62800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b5c107df0 0x7f1b5c10a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:06.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.330+0000 7f1b62800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 0x7f1b5c10aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:06.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.330+0000 7f1b62800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c112200 con 0x7f1b5c1034c0 2024-05-14T09:29:06.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.330+0000 7f1b62800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c112080 con 0x7f1b5c108740 2024-05-14T09:29:06.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.330+0000 7f1b62800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c112380 con 0x7f1b5c107df0 2024-05-14T09:29:06.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.331+0000 7f1b5be00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 0x7f1b5c10aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:06.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.331+0000 7f1b5be00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 0x7f1b5c10aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:60520/0 (socket says 172.21.15.120:60520) 2024-05-14T09:29:06.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.331+0000 7f1b5be00700 1 -- 172.21.15.120:0/167063441 learned_addr learned my addr 172.21.15.120:0/167063441 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:06.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.332+0000 7f1b5b400700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 0x7f1b5c10a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:06.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.332+0000 7f1b5aa00700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b5c107df0 0x7f1b5c10a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:06.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.333+0000 7f1b5be00700 1 -- 172.21.15.120:0/167063441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b5c107df0 msgr2=0x7f1b5c10a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:06.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.333+0000 7f1b5be00700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b5c107df0 0x7f1b5c10a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.333+0000 7f1b5be00700 1 -- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 msgr2=0x7f1b5c10a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:06.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.333+0000 7f1b5be00700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 0x7f1b5c10a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.333+0000 7f1b5be00700 1 -- 172.21.15.120:0/167063441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c19cba0 con 0x7f1b5c108740 2024-05-14T09:29:06.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.333+0000 7f1b5b400700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 0x7f1b5c10a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:06.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.334+0000 7f1b5be00700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 0x7f1b5c10aba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400ef30 tx=0x7f1b5400c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:06.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.334+0000 7f1b53e00700 1 -- 172.21.15.120:0/167063441 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b540092e0 con 0x7f1b5c108740 2024-05-14T09:29:06.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.334+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5c19ce30 con 0x7f1b5c108740 2024-05-14T09:29:06.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.334+0000 7f1b53e00700 1 -- 172.21.15.120:0/167063441 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b54004bb0 con 0x7f1b5c108740 2024-05-14T09:29:06.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.334+0000 7f1b53e00700 1 -- 172.21.15.120:0/167063441 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54004040 con 0x7f1b5c108740 2024-05-14T09:29:06.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.334+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5c19d3c0 con 0x7f1b5c108740 2024-05-14T09:29:06.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.339+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c104970 con 0x7f1b5c108740 2024-05-14T09:29:06.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.341+0000 7f1b53e00700 1 -- 172.21.15.120:0/167063441 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1b5401b030 con 0x7f1b5c108740 2024-05-14T09:29:06.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.345+0000 7f1b53e00700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1b400b2860 0x7f1b400b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:06.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.345+0000 7f1b53e00700 1 -- 172.21.15.120:0/167063441 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1b540e2150 con 0x7f1b5c108740 2024-05-14T09:29:06.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.345+0000 7f1b5b400700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1b400b2860 0x7f1b400b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:06.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.347+0000 7f1b5b400700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1b400b2860 0x7f1b400b4d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009350 tx=0x7f1b4c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:06.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.356+0000 7f1b53e00700 1 -- 172.21.15.120:0/167063441 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1b54022020 con 0x7f1b5c108740 2024-05-14T09:29:06.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.849+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b5c10b650 con 0x7f1b5c108740 2024-05-14T09:29:06.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.853+0000 7f1b53e00700 1 -- 172.21.15.120:0/167063441 <== mon.2 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11960 (secure 0 0 0) 0x7f1b54010040 con 0x7f1b5c108740 2024-05-14T09:29:06.853 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:29:06.853 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:28:30.407460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:29:06.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.856+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1b400b2860 msgr2=0x7f1b400b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:06.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.856+0000 7f1b62800700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1b400b2860 0x7f1b400b4d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009350 tx=0x7f1b4c01a040 comp rx=0 tx=0).stop 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.856+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 msgr2=0x7f1b5c10aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.856+0000 7f1b62800700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 0x7f1b5c10aba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400ef30 tx=0x7f1b5400c450 comp rx=0 tx=0).stop 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 shutdown_connections 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1b400b2860 0x7f1b400b4d70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b5c108740 0x7f1b5c10aba0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b5c1034c0 0x7f1b5c10a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 --2- 172.21.15.120:0/167063441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b5c107df0 0x7f1b5c10a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 >> 172.21.15.120:0/167063441 conn(0x7f1b5c0fedc0 msgr2=0x7f1b5c10fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:06.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 shutdown_connections 2024-05-14T09:29:06.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:06.857+0000 7f1b62800700 1 -- 172.21.15.120:0/167063441 wait complete. 2024-05-14T09:29:06.859 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 41 2024-05-14T09:29:08.103 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:07 smithi120 ceph-mon[31085]: pgmap v723: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 681 op/s 2024-05-14T09:29:08.103 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:07 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/167063441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:29:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:07 smithi152 ceph-mon[34868]: pgmap v723: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 681 op/s 2024-05-14T09:29:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:07 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/167063441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:29:08.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:07 smithi175 ceph-mon[35353]: pgmap v723: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 681 op/s 2024-05-14T09:29:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:07 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/167063441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:29:08.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T09:29:09.300 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:09.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 95.0 s, 590.2 tps, lat 177.565 ms stddev 1167.085 2024-05-14T09:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.508+0000 7f2e12600640 1 -- 172.21.15.120:0/880240592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 msgr2=0x7f2e0c10bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.508+0000 7f2e12600640 1 --2- 172.21.15.120:0/880240592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 0x7f2e0c10bce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2df8007350 tx=0x7f2df8029f60 comp rx=0 tx=0).stop 2024-05-14T09:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.508+0000 7f2e12600640 1 -- 172.21.15.120:0/880240592 shutdown_connections 2024-05-14T09:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.508+0000 7f2e12600640 1 --2- 172.21.15.120:0/880240592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c1105d0 0x7f2e0c1129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.509+0000 7f2e12600640 1 --2- 172.21.15.120:0/880240592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 0x7f2e0c10bce0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.509+0000 7f2e12600640 1 --2- 172.21.15.120:0/880240592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e0c10a690 0x7f2e0c10b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.509+0000 7f2e12600640 1 -- 172.21.15.120:0/880240592 >> 172.21.15.120:0/880240592 conn(0x7f2e0c070670 msgr2=0x7f2e0c072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.509+0000 7f2e12600640 1 -- 172.21.15.120:0/880240592 shutdown_connections 2024-05-14T09:29:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.510+0000 7f2e12600640 1 -- 172.21.15.120:0/880240592 wait complete. 2024-05-14T09:29:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 Processor -- start 2024-05-14T09:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 -- start start 2024-05-14T09:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c10a690 0x7f2e0c1a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 0x7f2e0c1a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e0c1105d0 0x7f2e0c1b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c115790 con 0x7f2e0c10a690 2024-05-14T09:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c115610 con 0x7f2e0c1105d0 2024-05-14T09:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.512+0000 7f2e12600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c115910 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.513+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c10a690 0x7f2e0c1a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.513+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c10a690 0x7f2e0c1a8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53154/0 (socket says 172.21.15.120:53154) 2024-05-14T09:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.513+0000 7f2e0b400640 1 -- 172.21.15.120:0/3374241340 learned_addr learned my addr 172.21.15.120:0/3374241340 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.513+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 0x7f2e0c1a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.514+0000 7f2e0be00640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e0c1105d0 0x7f2e0c1b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.514+0000 7f2e0aa00640 1 -- 172.21.15.120:0/3374241340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e0c1105d0 msgr2=0x7f2e0c1b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.514+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e0c1105d0 0x7f2e0c1b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.514+0000 7f2e0aa00640 1 -- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c10a690 msgr2=0x7f2e0c1a8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.515+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c10a690 0x7f2e0c1a8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.515+0000 7f2e0aa00640 1 -- 172.21.15.120:0/3374241340 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c1b0a50 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.515+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c10a690 0x7f2e0c1a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.516+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 0x7f2e0c1a9450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2df8007320 tx=0x7f2df8005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.517+0000 7f2e03e00640 1 -- 172.21.15.120:0/3374241340 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8004260 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.517+0000 7f2e03e00640 1 -- 172.21.15.120:0/3374241340 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2df8004400 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.517+0000 7f2e03e00640 1 -- 172.21.15.120:0/3374241340 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df803a730 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.518+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c1b0ce0 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.518+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c1b1180 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 Processor -- start 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 -- start start 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864583100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641b82f0 0x564864583680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641c04d0 0x56486458a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5648644e7550 con 0x5648641b82f0 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56486448cbc0 con 0x5648641e11b0 2024-05-14T09:29:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.524+0000 7f2e195b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5648644e3510 con 0x5648641c04d0 2024-05-14T09:29:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.525+0000 7f2e0be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864583100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.525+0000 7f2e0be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864583100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:46804/0 (socket says 172.21.15.120:46804) 2024-05-14T09:29:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.525+0000 7f2e0be00640 1 -- 172.21.15.120:0/2295154785 learned_addr learned my addr 172.21.15.120:0/2295154785 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.526+0000 7f2e0be00640 1 -- 172.21.15.120:0/2295154785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641c04d0 msgr2=0x56486458a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.526+0000 7f2e0be00640 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641c04d0 0x56486458a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.526+0000 7f2e0be00640 1 -- 172.21.15.120:0/2295154785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641b82f0 msgr2=0x564864583680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:29:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.526+0000 7f2e0b400640 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641b82f0 0x564864583680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.526+0000 7f2e0be00640 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641b82f0 0x564864583680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.526+0000 7f2e0be00640 1 -- 172.21.15.120:0/2295154785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648641f9210 con 0x5648641e11b0 2024-05-14T09:29:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.527+0000 7f2e03e00640 1 -- 172.21.15.120:0/3374241340 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2df8041070 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.527+0000 7f2e0be00640 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864583100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400aea0 tx=0x7f2e0400af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66c98181d386659c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.528+0000 7f2e00c00640 1 -- 172.21.15.120:0/2295154785 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04004b20 con 0x5648641e11b0 2024-05-14T09:29:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.528+0000 7f2e00c00640 1 -- 172.21.15.120:0/2295154785 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e04004cc0 con 0x5648641e11b0 2024-05-14T09:29:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.528+0000 7f2e00c00640 1 -- 172.21.15.120:0/2295154785 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04005420 con 0x5648641e11b0 2024-05-14T09:29:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.529+0000 7f2e03e00640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2df00b2860 0x7f2df00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.530+0000 7f2e03e00640 1 -- 172.21.15.120:0/3374241340 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2df81014a0 con 0x7f2e0c10b8d0 2024-05-14T09:29:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.530+0000 7f2e195b9740 1 -- 172.21.15.120:0/2295154785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 msgr2=0x564864583100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.530+0000 7f2e195b9740 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864583100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400aea0 tx=0x7f2e0400af90 comp rx=0 tx=0).stop 2024-05-14T09:29:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e195b9740 1 -- 172.21.15.120:0/2295154785 shutdown_connections 2024-05-14T09:29:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e195b9740 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641c04d0 0x56486458a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e195b9740 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641b82f0 0x564864583680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e195b9740 1 --2- 172.21.15.120:0/2295154785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864583100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e195b9740 1 -- 172.21.15.120:0/2295154785 >> 172.21.15.120:0/2295154785 conn(0x5648641d5300 msgr2=0x56486457ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2df00b2860 0x7f2df00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e195b9740 1 -- 172.21.15.120:0/2295154785 shutdown_connections 2024-05-14T09:29:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.531+0000 7f2e195b9740 1 -- 172.21.15.120:0/2295154785 wait complete. 2024-05-14T09:29:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.532+0000 7f2e195b9740 1 -- start start 2024-05-14T09:29:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.533+0000 7f2e195b9740 1 Processor -- start 2024-05-14T09:29:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.533+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2df00b2860 0x7f2df00b4d70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x56486457f820 tx=0x7f2dfc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.535+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486458cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.535+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x56486458d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.535+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486458cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486458cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54140/0 (socket says 172.21.15.120:54140) 2024-05-14T09:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e0b400640 1 -- 172.21.15.120:0/3163924996 learned_addr learned my addr 172.21.15.120:0/3163924996 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x5648645941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x56486458d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56486458afd0 con 0x5648641c04d0 2024-05-14T09:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5648644a0660 con 0x5648641e11b0 2024-05-14T09:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56486458b150 con 0x5648641b82f0 2024-05-14T09:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.536+0000 7f2e195b9740 10 client.0 _ll_register_callbacks cb 0x56486446a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.537+0000 7f2e0be00640 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x5648645941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.537+0000 7f2e0aa00640 1 -- 172.21.15.120:0/3163924996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 msgr2=0x56486458cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.537+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486458cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.537+0000 7f2e0aa00640 1 -- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 msgr2=0x5648645941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.537+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x5648645941a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.538+0000 7f2e0aa00640 1 -- 172.21.15.120:0/3163924996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648642c5620 con 0x5648641c04d0 2024-05-14T09:29:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.538+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x56486458d240 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2df802a480 tx=0x7f2df80c8550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74620175cb158dbc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.538+0000 7f2df5600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.540+0000 7f2df5600640 1 -- 172.21.15.120:0/3163924996 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df80c81d0 con 0x5648641c04d0 2024-05-14T09:29:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.541+0000 7f2df5600640 1 -- 172.21.15.120:0/3163924996 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2df8101160 con 0x5648641c04d0 2024-05-14T09:29:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.541+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e04004cc0 con 0x5648641c04d0 2024-05-14T09:29:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.542+0000 7f2df5600640 1 -- 172.21.15.120:0/3163924996 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2df80c8dc0 con 0x5648641c04d0 2024-05-14T09:29:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.542+0000 7f2e195b9740 10 client.16401 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.542+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5648645970d0 con 0x5648641c04d0 2024-05-14T09:29:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.543+0000 7f2df5600640 1 -- 172.21.15.120:0/3163924996 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e04004cc0 con 0x5648641c04d0 2024-05-14T09:29:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.544+0000 7f2df5600640 1 -- 172.21.15.120:0/3163924996 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f2df80b00c0 con 0x5648641c04d0 2024-05-14T09:29:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.544+0000 7f2e195b9740 10 client.16401 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.544+0000 7f2e195b9740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.544+0000 7f2e195b9740 20 client.16401 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.544+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56486419fd80 0x56486459a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.544+0000 7f2e195b9740 4 client.16401 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.544+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648644f5160 con 0x56486419fd80 2024-05-14T09:29:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.546+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56486419fd80 0x56486459a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.549+0000 7f2df5600640 10 client.16401 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.549+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56486419fd80 0x56486459a850 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18d923324bc75f3d server_cookie=e6964bec104f74e1 in_seq=0 out_seq=0 2024-05-14T09:29:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.551+0000 7f2df5600640 1 -- 172.21.15.120:0/3163924996 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5648644f5160 con 0x56486419fd80 2024-05-14T09:29:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.551+0000 7f2df5600640 10 client.16401 handle_command_reply: tid=0 2024-05-14T09:29:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.551+0000 7f2e195b9740 1 client.16401 shutdown 2024-05-14T09:29:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.552+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 msgr2=0x56486458d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.552+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x56486458d240 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2df802a480 tx=0x7f2df80c8550 comp rx=0 tx=0).stop 2024-05-14T09:29:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 shutdown_connections 2024-05-14T09:29:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56486419fd80 0x56486459a850 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x5648645941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x56486458d240 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3163924996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486458cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 >> 172.21.15.120:0/3163924996 conn(0x5648641d5300 msgr2=0x56486457da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2df5600640 0 client.16401 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.553+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 shutdown_connections 2024-05-14T09:29:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.554+0000 7f2e195b9740 1 -- 172.21.15.120:0/3163924996 wait complete. 2024-05-14T09:29:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.554+0000 7f2e195b9740 20 client.16401 trim_cache size 0 max 16384 2024-05-14T09:29:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.587+0000 7f2e195b9740 1 Processor -- start 2024-05-14T09:29:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.588+0000 7f2e195b9740 1 -- start start 2024-05-14T09:29:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.588+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486457e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.588+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641c04d0 0x5648645940c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.588+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641e11b0 0x564864581890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.588+0000 7f2e195b9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1bb6d0 con 0x5648641e11b0 2024-05-14T09:29:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.588+0000 7f2e195b9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1bd270 con 0x5648641c04d0 2024-05-14T09:29:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.588+0000 7f2e195b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1bbda0 con 0x5648641b82f0 2024-05-14T09:29:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.589+0000 7f2e0be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641e11b0 0x564864581890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.589+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486457e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.589+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486457e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54142/0 (socket says 172.21.15.120:54142) 2024-05-14T09:29:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.589+0000 7f2e0b400640 1 -- 172.21.15.120:0/225532403 learned_addr learned my addr 172.21.15.120:0/225532403 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.590+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641c04d0 0x5648645940c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.591+0000 7f2e0be00640 1 -- 172.21.15.120:0/225532403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 msgr2=0x56486457e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.591+0000 7f2e0be00640 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486457e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.591+0000 7f2e0be00640 1 -- 172.21.15.120:0/225532403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641c04d0 msgr2=0x5648645940c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.591+0000 7f2e0be00640 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641c04d0 0x5648645940c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.591+0000 7f2e0be00640 1 -- 172.21.15.120:0/225532403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486457a280 con 0x5648641e11b0 2024-05-14T09:29:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.592+0000 7f2e0be00640 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641e11b0 0x564864581890 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2e04006010 tx=0x7f2e04004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6edf924e74b60a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.592+0000 7f2df7e00640 1 -- 172.21.15.120:0/225532403 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400c5e0 con 0x5648641e11b0 2024-05-14T09:29:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.593+0000 7f2df7e00640 1 -- 172.21.15.120:0/225532403 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e0400cc10 con 0x5648641e11b0 2024-05-14T09:29:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.593+0000 7f2df7e00640 1 -- 172.21.15.120:0/225532403 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04020b40 con 0x5648641e11b0 2024-05-14T09:29:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.594+0000 7f2e195b9740 1 -- 172.21.15.120:0/225532403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641e11b0 msgr2=0x564864581890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.594+0000 7f2e195b9740 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641e11b0 0x564864581890 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2e04006010 tx=0x7f2e04004ca0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.595+0000 7f2e195b9740 1 -- 172.21.15.120:0/225532403 shutdown_connections 2024-05-14T09:29:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.595+0000 7f2e195b9740 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641e11b0 0x564864581890 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.595+0000 7f2e195b9740 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641c04d0 0x5648645940c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.595+0000 7f2e195b9740 1 --2- 172.21.15.120:0/225532403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x56486457e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.595+0000 7f2e195b9740 1 -- 172.21.15.120:0/225532403 >> 172.21.15.120:0/225532403 conn(0x5648641d5300 msgr2=0x56486457e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.595+0000 7f2e195b9740 1 -- 172.21.15.120:0/225532403 shutdown_connections 2024-05-14T09:29:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.595+0000 7f2e195b9740 1 -- 172.21.15.120:0/225532403 wait complete. 2024-05-14T09:29:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.596+0000 7f2e195b9740 1 -- start start 2024-05-14T09:29:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.596+0000 7f2e195b9740 1 Processor -- start 2024-05-14T09:29:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.598+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x5648645913d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.598+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x564864591910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.598+0000 7f2e195b9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864592840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.598+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x5648645913d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x5648645913d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54146/0 (socket says 172.21.15.120:54146) 2024-05-14T09:29:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e0b400640 1 -- 172.21.15.120:0/3126222024 learned_addr learned my addr 172.21.15.120:0/3126222024 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1bcba0 con 0x5648641c04d0 2024-05-14T09:29:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1bc4d0 con 0x5648641e11b0 2024-05-14T09:29:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1b96d0 con 0x5648641b82f0 2024-05-14T09:29:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e195b9740 10 client.0 _ll_register_callbacks cb 0x7f2df80c4580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e0aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x564864591910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.599+0000 7f2e0be00640 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864592840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.601+0000 7f2e0b400640 1 -- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 msgr2=0x564864592840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.601+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864592840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.601+0000 7f2e0b400640 1 -- 172.21.15.120:0/3126222024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 msgr2=0x564864591910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.601+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x564864591910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.601+0000 7f2e0b400640 1 -- 172.21.15.120:0/3126222024 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564864592e00 con 0x5648641b82f0 2024-05-14T09:29:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.601+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x564864591910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.602+0000 7f2df5600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.602+0000 7f2e0b400640 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x5648645913d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc012cc0 tx=0x7f2dfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f526a1a821e78029 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.602+0000 7f2df5600640 1 -- 172.21.15.120:0/3126222024 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc004020 con 0x5648641b82f0 2024-05-14T09:29:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.602+0000 7f2df5600640 1 -- 172.21.15.120:0/3126222024 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2dfc0041c0 con 0x5648641b82f0 2024-05-14T09:29:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.603+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e0400cc10 con 0x5648641b82f0 2024-05-14T09:29:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.603+0000 7f2df5600640 1 -- 172.21.15.120:0/3126222024 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2dfc0043c0 con 0x5648641b82f0 2024-05-14T09:29:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.603+0000 7f2e195b9740 10 client.25966 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.603+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564864594160 con 0x5648641b82f0 2024-05-14T09:29:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.604+0000 7f2df5600640 1 -- 172.21.15.120:0/3126222024 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e0400cc10 con 0x5648641b82f0 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.605+0000 7f2df5600640 1 -- 172.21.15.120:0/3126222024 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f2dfc02c480 con 0x5648641b82f0 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.605+0000 7f2e195b9740 10 client.25966 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.605+0000 7f2e195b9740 10 client.25966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.605+0000 7f2e195b9740 20 client.25966 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.605+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5648641751c0 0x5648646050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.605+0000 7f2e195b9740 4 client.25966 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.605+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648644eefd0 con 0x5648641751c0 2024-05-14T09:29:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.606+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5648641751c0 0x5648646050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.607+0000 7f2e0aa00640 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5648641751c0 0x5648646050d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2206ef4162ab907 server_cookie=784abcea04481d46 in_seq=0 out_seq=0 2024-05-14T09:29:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.607+0000 7f2df5600640 10 client.25966 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.634+0000 7f2df5600640 1 -- 172.21.15.120:0/3126222024 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648644eefd0 con 0x5648641751c0 2024-05-14T09:29:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.634+0000 7f2df5600640 10 client.25966 handle_command_reply: tid=0 2024-05-14T09:29:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.634+0000 7f2e195b9740 1 client.25966 shutdown 2024-05-14T09:29:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.635+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 msgr2=0x5648645913d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.635+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x5648645913d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc012cc0 tx=0x7f2dfc0046c0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.636+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 shutdown_connections 2024-05-14T09:29:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.636+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5648641751c0 0x5648646050d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.636+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5648641e11b0 0x564864592840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.636+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5648641c04d0 0x564864591910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.636+0000 7f2e195b9740 1 --2- 172.21.15.120:0/3126222024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648641b82f0 0x5648645913d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.636+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 >> 172.21.15.120:0/3126222024 conn(0x5648641d5300 msgr2=0x56486459f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.636+0000 7f2df5600640 0 client.25966 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.637+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 shutdown_connections 2024-05-14T09:29:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.637+0000 7f2e195b9740 1 -- 172.21.15.120:0/3126222024 wait complete. 2024-05-14T09:29:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.637+0000 7f2e195b9740 20 client.25966 trim_cache size 0 max 16384 2024-05-14T09:29:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:29:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:29:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:29:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:29:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.639+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2df00b2860 msgr2=0x7f2df00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.639+0000 7f2e12600640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2df00b2860 0x7f2df00b4d70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x56486457f820 tx=0x7f2dfc00b410 comp rx=0 tx=0).stop 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.639+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 msgr2=0x7f2e0c1a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.639+0000 7f2e12600640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 0x7f2e0c1a9450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2df8007320 tx=0x7f2df8005e10 comp rx=0 tx=0).stop 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.640+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 shutdown_connections 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.640+0000 7f2e12600640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2df00b2860 0x7f2df00b4d70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.640+0000 7f2e12600640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e0c1105d0 0x7f2e0c1b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.640+0000 7f2e12600640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c10b8d0 0x7f2e0c1a9450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.640+0000 7f2e12600640 1 --2- 172.21.15.120:0/3374241340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e0c10a690 0x7f2e0c1a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:09.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.640+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 >> 172.21.15.120:0/3374241340 conn(0x7f2e0c070670 msgr2=0x7f2e0c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.642+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 shutdown_connections 2024-05-14T09:29:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:09.643+0000 7f2e12600640 1 -- 172.21.15.120:0/3374241340 wait complete. 2024-05-14T09:29:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:09 smithi120 ceph-mon[31085]: pgmap v724: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 704 op/s 2024-05-14T09:29:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:09 smithi152 ceph-mon[34868]: pgmap v724: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 704 op/s 2024-05-14T09:29:10.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:09 smithi175 ceph-mon[35353]: pgmap v724: 129 pgs: 129 active+clean; 955 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 704 op/s 2024-05-14T09:29:12.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:11 smithi120 ceph-mon[31085]: pgmap v725: 129 pgs: 129 active+clean; 955 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 722 op/s 2024-05-14T09:29:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:11 smithi152 ceph-mon[34868]: pgmap v725: 129 pgs: 129 active+clean; 955 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 722 op/s 2024-05-14T09:29:12.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:11 smithi175 ceph-mon[35353]: pgmap v725: 129 pgs: 129 active+clean; 955 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 722 op/s 2024-05-14T09:29:12.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.687+0000 7fc977c00700 1 -- 172.21.15.120:0/1662347473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 msgr2=0x7fc9701111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.687+0000 7fc977c00700 1 --2- 172.21.15.120:0/1662347473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701111d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc968009920 tx=0x7fc968009c30 comp rx=0 tx=0).stop 2024-05-14T09:29:12.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.688+0000 7fc977c00700 1 -- 172.21.15.120:0/1662347473 shutdown_connections 2024-05-14T09:29:12.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.688+0000 7fc977c00700 1 --2- 172.21.15.120:0/1662347473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701111d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.688+0000 7fc977c00700 1 --2- 172.21.15.120:0/1662347473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9701045f0 0x7fc970104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.688+0000 7fc977c00700 1 --2- 172.21.15.120:0/1662347473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc970108f20 0x7fc970109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.688+0000 7fc977c00700 1 -- 172.21.15.120:0/1662347473 >> 172.21.15.120:0/1662347473 conn(0x7fc970100040 msgr2=0x7fc970102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:12.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.689+0000 7fc977c00700 1 -- 172.21.15.120:0/1662347473 shutdown_connections 2024-05-14T09:29:12.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.689+0000 7fc977c00700 1 -- 172.21.15.120:0/1662347473 wait complete. 2024-05-14T09:29:12.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.691+0000 7fc977c00700 1 Processor -- start 2024-05-14T09:29:12.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.692+0000 7fc977c00700 1 -- start start 2024-05-14T09:29:12.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.692+0000 7fc977c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9701045f0 0x7fc9701a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc977c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc970108f20 0x7fc9701a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc977c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc977c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701143a0 con 0x7fc970108f20 2024-05-14T09:29:12.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc977c00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc970114220 con 0x7fc9701045f0 2024-05-14T09:29:12.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc977c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc970114520 con 0x7fc970109870 2024-05-14T09:29:12.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc975c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc975c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701ad100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54166/0 (socket says 172.21.15.120:54166) 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.693+0000 7fc975c00700 1 -- 172.21.15.120:0/2963980732 learned_addr learned my addr 172.21.15.120:0/2963980732 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc975200700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9701045f0 0x7fc9701a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc96fe00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc970108f20 0x7fc9701a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc975c00700 1 -- 172.21.15.120:0/2963980732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9701045f0 msgr2=0x7fc9701a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc975c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9701045f0 0x7fc9701a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc975c00700 1 -- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc970108f20 msgr2=0x7fc9701a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc975c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc970108f20 0x7fc9701a2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc975c00700 1 -- 172.21.15.120:0/2963980732 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9701ad640 con 0x7fc970109870 2024-05-14T09:29:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.694+0000 7fc975c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701ad100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc968009230 tx=0x7fc96800b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.695+0000 7fc96d600700 1 -- 172.21.15.120:0/2963980732 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96800b840 con 0x7fc970109870 2024-05-14T09:29:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.695+0000 7fc96d600700 1 -- 172.21.15.120:0/2963980732 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc96800b9e0 con 0x7fc970109870 2024-05-14T09:29:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.695+0000 7fc96d600700 1 -- 172.21.15.120:0/2963980732 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968003b50 con 0x7fc970109870 2024-05-14T09:29:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.695+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9701ad870 con 0x7fc970109870 2024-05-14T09:29:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.695+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9701adc70 con 0x7fc970109870 2024-05-14T09:29:12.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.702+0000 7fc96d600700 1 -- 172.21.15.120:0/2963980732 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fc968003cf0 con 0x7fc970109870 2024-05-14T09:29:12.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.707+0000 7fc96d600700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9580b2880 0x7fc9580b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.708+0000 7fc96d600700 1 -- 172.21.15.120:0/2963980732 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc9680e4570 con 0x7fc970109870 2024-05-14T09:29:12.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.708+0000 7fc986838b80 1 Processor -- start 2024-05-14T09:29:12.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.708+0000 7fc975200700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9580b2880 0x7fc9580b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.709+0000 7fc986838b80 1 -- start start 2024-05-14T09:29:12.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.709+0000 7fc986838b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9916b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.709+0000 7fc986838b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d991bf0 0x55ba2d98b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.709+0000 7fc986838b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d98c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.709+0000 7fc986838b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d8ada20 con 0x55ba2d991bf0 2024-05-14T09:29:12.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.709+0000 7fc986838b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d84b760 con 0x55ba2d98bc50 2024-05-14T09:29:12.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.709+0000 7fc986838b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d8a99e0 con 0x55ba2d80de40 2024-05-14T09:29:12.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.710+0000 7fc96fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d991bf0 0x55ba2d98b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.710+0000 7fc96fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d991bf0 0x55ba2d98b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53222/0 (socket says 172.21.15.120:53222) 2024-05-14T09:29:12.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.710+0000 7fc96fe00700 1 -- 172.21.15.120:0/4100013113 learned_addr learned my addr 172.21.15.120:0/4100013113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:12.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.711+0000 7fc975c00700 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d98c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.711+0000 7fc96fe00700 1 -- 172.21.15.120:0/4100013113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 msgr2=0x55ba2d9916b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:12.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.711+0000 7fc96fe00700 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.711+0000 7fc96fe00700 1 -- 172.21.15.120:0/4100013113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 msgr2=0x55ba2d98c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:12.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.711+0000 7fc96fe00700 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d98c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.711+0000 7fc96fe00700 1 -- 172.21.15.120:0/4100013113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d7fa8d0 con 0x55ba2d991bf0 2024-05-14T09:29:12.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.712+0000 7fc96fe00700 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d991bf0 0x55ba2d98b710 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009c60 tx=0x7fc95c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4e894c7cf9ada1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:12.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.713+0000 7fc962000700 1 -- 172.21.15.120:0/4100013113 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c004220 con 0x55ba2d991bf0 2024-05-14T09:29:12.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.713+0000 7fc962000700 1 -- 172.21.15.120:0/4100013113 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95c00fe00 con 0x55ba2d991bf0 2024-05-14T09:29:12.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc986838b80 1 -- 172.21.15.120:0/4100013113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d991bf0 msgr2=0x55ba2d98b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc975200700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9580b2880 0x7fc9580b4d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9701116e0 tx=0x7fc964009f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:12.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc986838b80 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d991bf0 0x55ba2d98b710 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009c60 tx=0x7fc95c009f70 comp rx=0 tx=0).stop 2024-05-14T09:29:12.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc986838b80 1 -- 172.21.15.120:0/4100013113 shutdown_connections 2024-05-14T09:29:12.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc986838b80 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d98c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc986838b80 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9916b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc986838b80 1 --2- 172.21.15.120:0/4100013113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d991bf0 0x55ba2d98b710 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.715+0000 7fc986838b80 1 -- 172.21.15.120:0/4100013113 >> 172.21.15.120:0/4100013113 conn(0x55ba2d84ca80 msgr2=0x55ba2d986790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:12.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.716+0000 7fc986838b80 1 -- 172.21.15.120:0/4100013113 shutdown_connections 2024-05-14T09:29:12.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.716+0000 7fc986838b80 1 -- 172.21.15.120:0/4100013113 wait complete. 2024-05-14T09:29:12.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.717+0000 7fc986838b80 1 -- start start 2024-05-14T09:29:12.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.717+0000 7fc986838b80 1 Processor -- start 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.718+0000 7fc986838b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.718+0000 7fc986838b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d995930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.718+0000 7fc986838b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d991bf0 0x55ba2d995e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.718+0000 7fc986838b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d9986c0 con 0x55ba2d98bc50 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.718+0000 7fc986838b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d813b20 con 0x55ba2d991bf0 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.718+0000 7fc986838b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d998840 con 0x55ba2d80de40 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.718+0000 7fc986838b80 10 client.0 _ll_register_callbacks cb 0x55ba2d841380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.719+0000 7fc96fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d995930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.719+0000 7fc96fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d995930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53224/0 (socket says 172.21.15.120:53224) 2024-05-14T09:29:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.719+0000 7fc975200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.719+0000 7fc975200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54176/0 (socket says 172.21.15.120:54176) 2024-05-14T09:29:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.719+0000 7fc975200700 1 -- 172.21.15.120:0/2068002967 learned_addr learned my addr 172.21.15.120:0/2068002967 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.719+0000 7fc975c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d991bf0 0x55ba2d995e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.720+0000 7fc975200700 1 -- 172.21.15.120:0/2068002967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d991bf0 msgr2=0x55ba2d995e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.720+0000 7fc975200700 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d991bf0 0x55ba2d995e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.720+0000 7fc975200700 1 -- 172.21.15.120:0/2068002967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 msgr2=0x55ba2d995930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.720+0000 7fc975200700 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d995930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.720+0000 7fc975200700 1 -- 172.21.15.120:0/2068002967 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d873420 con 0x55ba2d80de40 2024-05-14T09:29:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.721+0000 7fc975200700 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9953f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc96401a710 tx=0x7fc964004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df83f95ea4c52839 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.721+0000 7fc956a00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:12.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.723+0000 7fc956a00700 1 -- 172.21.15.120:0/2068002967 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964012040 con 0x55ba2d80de40 2024-05-14T09:29:12.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.723+0000 7fc956a00700 1 -- 172.21.15.120:0/2068002967 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc964004db0 con 0x55ba2d80de40 2024-05-14T09:29:12.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.723+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc95c00fe00 con 0x55ba2d80de40 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.724+0000 7fc956a00700 1 -- 172.21.15.120:0/2068002967 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc964018660 con 0x55ba2d80de40 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.724+0000 7fc986838b80 10 client.25975 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.724+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ba2d9b43e0 con 0x55ba2d80de40 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.725+0000 7fc956a00700 1 -- 172.21.15.120:0/2068002967 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95c00fe00 con 0x55ba2d80de40 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc956a00700 1 -- 172.21.15.120:0/2068002967 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fc964022860 con 0x55ba2d80de40 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc986838b80 10 client.25975 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc986838b80 10 client.25975 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc986838b80 20 client.25975 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc986838b80 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2d9b6a20 0x55ba2d9b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc986838b80 4 client.25975 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba2d958070 con 0x55ba2d9b6a20 2024-05-14T09:29:12.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.726+0000 7fc96fe00700 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2d9b6a20 0x55ba2d9b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.729+0000 7fc96fe00700 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2d9b6a20 0x55ba2d9b8e40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d85cc085015723de server_cookie=2597c06185502a8b in_seq=0 out_seq=0 2024-05-14T09:29:12.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.730+0000 7fc956a00700 10 client.25975 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:29:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.731+0000 7fc956a00700 1 -- 172.21.15.120:0/2068002967 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ba2d958070 con 0x55ba2d9b6a20 2024-05-14T09:29:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.732+0000 7fc956a00700 10 client.25975 handle_command_reply: tid=0 2024-05-14T09:29:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.732+0000 7fc986838b80 1 client.25975 shutdown 2024-05-14T09:29:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.733+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 msgr2=0x55ba2d9953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.733+0000 7fc986838b80 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9953f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc96401a710 tx=0x7fc964004ad0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.734+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 shutdown_connections 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.734+0000 7fc986838b80 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2d9b6a20 0x55ba2d9b8e40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.734+0000 7fc986838b80 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d991bf0 0x55ba2d995e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.734+0000 7fc986838b80 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d80de40 0x55ba2d9953f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.734+0000 7fc986838b80 1 --2- 172.21.15.120:0/2068002967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d995930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.734+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 >> 172.21.15.120:0/2068002967 conn(0x55ba2d84ca80 msgr2=0x55ba2d98a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.734+0000 7fc956a00700 0 client.25975 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:29:12.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.735+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 shutdown_connections 2024-05-14T09:29:12.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.735+0000 7fc986838b80 1 -- 172.21.15.120:0/2068002967 wait complete. 2024-05-14T09:29:12.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.736+0000 7fc986838b80 20 client.25975 trim_cache size 0 max 16384 2024-05-14T09:29:12.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.769+0000 7fc986838b80 1 Processor -- start 2024-05-14T09:29:12.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.770+0000 7fc986838b80 1 -- start start 2024-05-14T09:29:12.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.771+0000 7fc986838b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d80de40 0x55ba2d98b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.771+0000 7fc986838b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d980aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc986838b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d990c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc986838b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701adfb0 con 0x55ba2d80de40 2024-05-14T09:29:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc986838b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701afb50 con 0x55ba2d98bc50 2024-05-14T09:29:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc986838b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701ae680 con 0x55ba2d991bf0 2024-05-14T09:29:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc96fe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d980aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc975200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d80de40 0x55ba2d98b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc96fe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d980aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:46876/0 (socket says 172.21.15.120:46876) 2024-05-14T09:29:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.772+0000 7fc96fe00700 1 -- 172.21.15.120:0/3488085630 learned_addr learned my addr 172.21.15.120:0/3488085630 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.773+0000 7fc96fe00700 1 -- 172.21.15.120:0/3488085630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 msgr2=0x55ba2d990c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:29:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.773+0000 7fc96fe00700 1 --2- 172.21.15.120:0/3488085630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d990c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.773+0000 7fc96fe00700 1 -- 172.21.15.120:0/3488085630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d80de40 msgr2=0x55ba2d98b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.773+0000 7fc96fe00700 1 --2- 172.21.15.120:0/3488085630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d80de40 0x55ba2d98b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.773+0000 7fc96fe00700 1 -- 172.21.15.120:0/3488085630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d997c90 con 0x55ba2d98bc50 2024-05-14T09:29:12.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.775+0000 7fc96fe00700 1 --2- 172.21.15.120:0/3488085630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d980aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009c30 tx=0x7fc95c01e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f07d012d7be3cc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:12.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.776+0000 7fc961600700 1 -- 172.21.15.120:0/3488085630 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c02c070 con 0x55ba2d98bc50 2024-05-14T09:29:12.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.776+0000 7fc961600700 1 -- 172.21.15.120:0/3488085630 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95c028e50 con 0x55ba2d98bc50 2024-05-14T09:29:12.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.776+0000 7fc961600700 1 -- 172.21.15.120:0/3488085630 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c028620 con 0x55ba2d98bc50 2024-05-14T09:29:12.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.777+0000 7fc986838b80 1 -- 172.21.15.120:0/3488085630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 msgr2=0x55ba2d980aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.777+0000 7fc986838b80 1 --2- 172.21.15.120:0/3488085630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d980aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009c30 tx=0x7fc95c01e040 comp rx=0 tx=0).stop 2024-05-14T09:29:12.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.779+0000 7fc986838b80 1 -- 172.21.15.120:0/3488085630 shutdown_connections 2024-05-14T09:29:12.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.779+0000 7fc986838b80 1 --2- 172.21.15.120:0/3488085630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d990c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.779+0000 7fc986838b80 1 --2- 172.21.15.120:0/3488085630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d80de40 0x55ba2d98b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.779+0000 7fc986838b80 1 --2- 172.21.15.120:0/3488085630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d98bc50 0x55ba2d980aa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.779+0000 7fc986838b80 1 -- 172.21.15.120:0/3488085630 >> 172.21.15.120:0/3488085630 conn(0x55ba2d84ca80 msgr2=0x55ba2d990550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:12.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.779+0000 7fc986838b80 1 -- 172.21.15.120:0/3488085630 shutdown_connections 2024-05-14T09:29:12.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.780+0000 7fc986838b80 1 -- 172.21.15.120:0/3488085630 wait complete. 2024-05-14T09:29:12.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.780+0000 7fc986838b80 1 -- start start 2024-05-14T09:29:12.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.781+0000 7fc986838b80 1 Processor -- start 2024-05-14T09:29:12.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.783+0000 7fc986838b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d80de40 0x55ba2d99db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.783+0000 7fc986838b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d99e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.783+0000 7fc986838b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d98a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.783+0000 7fc986838b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701af480 con 0x55ba2d98bc50 2024-05-14T09:29:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.783+0000 7fc986838b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701aedb0 con 0x55ba2d80de40 2024-05-14T09:29:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.783+0000 7fc986838b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701a0080 con 0x55ba2d991bf0 2024-05-14T09:29:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.783+0000 7fc986838b80 10 client.0 _ll_register_callbacks cb 0x55ba2d841380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.784+0000 7fc975c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d98a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.784+0000 7fc975c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d98a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54200/0 (socket says 172.21.15.120:54200) 2024-05-14T09:29:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.784+0000 7fc975c00700 1 -- 172.21.15.120:0/3841429094 learned_addr learned my addr 172.21.15.120:0/3841429094 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.784+0000 7fc975200700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d80de40 0x55ba2d99db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.785+0000 7fc96fe00700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d99e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc975c00700 1 -- 172.21.15.120:0/3841429094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d80de40 msgr2=0x55ba2d99db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc975c00700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d80de40 0x55ba2d99db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc975c00700 1 -- 172.21.15.120:0/3841429094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 msgr2=0x55ba2d99e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc975c00700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d99e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc975c00700 1 -- 172.21.15.120:0/3841429094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d98ac40 con 0x55ba2d991bf0 2024-05-14T09:29:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc975200700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d80de40 0x55ba2d99db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc975c00700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d98a700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9680ab810 tx=0x7fc968009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c7a52a4b3a86cb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc956a00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc956a00700 1 -- 172.21.15.120:0/3841429094 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680c5060 con 0x55ba2d991bf0 2024-05-14T09:29:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.786+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc95c028e50 con 0x55ba2d991bf0 2024-05-14T09:29:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.787+0000 7fc956a00700 1 -- 172.21.15.120:0/3841429094 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc9680b20b0 con 0x55ba2d991bf0 2024-05-14T09:29:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.787+0000 7fc956a00700 1 -- 172.21.15.120:0/3841429094 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc9680afc30 con 0x55ba2d991bf0 2024-05-14T09:29:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.787+0000 7fc986838b80 10 client.25978 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.787+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ba2da20980 con 0x55ba2d991bf0 2024-05-14T09:29:12.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.788+0000 7fc956a00700 1 -- 172.21.15.120:0/3841429094 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95c028e50 con 0x55ba2d991bf0 2024-05-14T09:29:12.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.788+0000 7fc956a00700 1 -- 172.21.15.120:0/3841429094 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fc96806c020 con 0x55ba2d991bf0 2024-05-14T09:29:12.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.788+0000 7fc986838b80 10 client.25978 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:12.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.789+0000 7fc986838b80 10 client.25978 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:29:12.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.789+0000 7fc986838b80 20 client.25978 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:12.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.789+0000 7fc986838b80 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2da21040 0x55ba2da23460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:12.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.789+0000 7fc986838b80 4 client.25978 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:29:12.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.789+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba2d8bb400 con 0x55ba2da21040 2024-05-14T09:29:12.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.789+0000 7fc975200700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2da21040 0x55ba2da23460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:12.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.790+0000 7fc956a00700 10 client.25978 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:29:12.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.790+0000 7fc975200700 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2da21040 0x55ba2da23460 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d1cd4d4cb3e9e54e server_cookie=25b5838048c32cfa in_seq=0 out_seq=0 2024-05-14T09:29:12.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.790+0000 7fc956a00700 1 -- 172.21.15.120:0/3841429094 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba2d8bb400 con 0x55ba2da21040 2024-05-14T09:29:12.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.790+0000 7fc956a00700 10 client.25978 handle_command_reply: tid=0 2024-05-14T09:29:12.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.791+0000 7fc986838b80 1 client.25978 shutdown 2024-05-14T09:29:12.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 msgr2=0x55ba2d98a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d98a700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9680ab810 tx=0x7fc968009c30 comp rx=0 tx=0).stop 2024-05-14T09:29:12.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 shutdown_connections 2024-05-14T09:29:12.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55ba2da21040 0x55ba2da23460 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2d80de40 0x55ba2d99db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba2d991bf0 0x55ba2d98a700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 --2- 172.21.15.120:0/3841429094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ba2d98bc50 0x55ba2d99e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 >> 172.21.15.120:0/3841429094 conn(0x55ba2d84ca80 msgr2=0x55ba2d9938d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.792+0000 7fc956a00700 0 client.25978 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.793+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 shutdown_connections 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.793+0000 7fc986838b80 1 -- 172.21.15.120:0/3841429094 wait complete. 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.793+0000 7fc986838b80 20 client.25978 trim_cache size 0 max 16384 2024-05-14T09:29:12.794 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9580b2880 msgr2=0x7fc9580b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9580b2880 0x7fc9580b4d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9701116e0 tx=0x7fc964009f00 comp rx=0 tx=0).stop 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 msgr2=0x7fc9701ad100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701ad100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc968009230 tx=0x7fc96800b560 comp rx=0 tx=0).stop 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 shutdown_connections 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc9580b2880 0x7fc9580b4d90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9701045f0 0x7fc9701a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970109870 0x7fc9701ad100 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 --2- 172.21.15.120:0/2963980732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc970108f20 0x7fc9701a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:12.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.794+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 >> 172.21.15.120:0/2963980732 conn(0x7fc970100040 msgr2=0x7fc97010a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:12.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.797+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 shutdown_connections 2024-05-14T09:29:12.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:12.797+0000 7fc977c00700 1 -- 172.21.15.120:0/2963980732 wait complete. 2024-05-14T09:29:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:13 smithi120 ceph-mon[31085]: pgmap v726: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.4 MiB/s wr, 615 op/s 2024-05-14T09:29:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:13 smithi152 ceph-mon[34868]: pgmap v726: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.4 MiB/s wr, 615 op/s 2024-05-14T09:29:14.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:13 smithi175 ceph-mon[35353]: pgmap v726: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.4 MiB/s wr, 615 op/s 2024-05-14T09:29:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 100.0 s, 617.2 tps, lat 332.802 ms stddev 2016.402 2024-05-14T09:29:14.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T09:29:15.242 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:15 smithi120 ceph-mon[31085]: pgmap v727: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 MiB/s wr, 642 op/s 2024-05-14T09:29:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:15 smithi152 ceph-mon[34868]: pgmap v727: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 MiB/s wr, 642 op/s 2024-05-14T09:29:16.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:15 smithi175 ceph-mon[35353]: pgmap v727: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 MiB/s wr, 642 op/s 2024-05-14T09:29:17.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.776+0000 7fdc5d600700 1 -- 172.21.15.120:0/499569639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc5810e900 msgr2=0x7fdc58110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.776+0000 7fdc5d600700 1 --2- 172.21.15.120:0/499569639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc5810e900 0x7fdc58110dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009f90 tx=0x7fdc5000b330 comp rx=0 tx=0).stop 2024-05-14T09:29:17.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.777+0000 7fdc5d600700 1 -- 172.21.15.120:0/499569639 shutdown_connections 2024-05-14T09:29:17.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.777+0000 7fdc5d600700 1 --2- 172.21.15.120:0/499569639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc5810e900 0x7fdc58110dc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.777+0000 7fdc5d600700 1 --2- 172.21.15.120:0/499569639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105520 0x7fdc58105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.777+0000 7fdc5d600700 1 --2- 172.21.15.120:0/499569639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc58105e70 0x7fdc5810e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.777+0000 7fdc5d600700 1 -- 172.21.15.120:0/499569639 >> 172.21.15.120:0/499569639 conn(0x7fdc580fedc0 msgr2=0x7fdc581011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:17.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.778+0000 7fdc5d600700 1 -- 172.21.15.120:0/499569639 shutdown_connections 2024-05-14T09:29:17.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.778+0000 7fdc5d600700 1 -- 172.21.15.120:0/499569639 wait complete. 2024-05-14T09:29:17.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.780+0000 7fdc5d600700 1 Processor -- start 2024-05-14T09:29:17.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.780+0000 7fdc5d600700 1 -- start start 2024-05-14T09:29:17.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc5d600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc58105520 0x7fdc58104d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc5d600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105e70 0x7fdc58103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc5d600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc5810e900 0x7fdc581037b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc5d600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581142f0 con 0x7fdc5810e900 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc5d600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58114170 con 0x7fdc58105520 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc5d600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58114470 con 0x7fdc58105e70 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc56000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105e70 0x7fdc58103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc56000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105e70 0x7fdc58103210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54230/0 (socket says 172.21.15.120:54230) 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc56000700 1 -- 172.21.15.120:0/3176983481 learned_addr learned my addr 172.21.15.120:0/3176983481 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.781+0000 7fdc57400700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc5810e900 0x7fdc581037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.782+0000 7fdc56a00700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc58105520 0x7fdc58104d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.782+0000 7fdc56000700 1 -- 172.21.15.120:0/3176983481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc58105520 msgr2=0x7fdc58104d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.782+0000 7fdc56000700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc58105520 0x7fdc58104d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.782+0000 7fdc56000700 1 -- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc5810e900 msgr2=0x7fdc581037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.782+0000 7fdc56000700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc5810e900 0x7fdc581037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.782+0000 7fdc56000700 1 -- 172.21.15.120:0/3176983481 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc58103fe0 con 0x7fdc58105e70 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.782+0000 7fdc57400700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc5810e900 0x7fdc581037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.783+0000 7fdc56000700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105e70 0x7fdc58103210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400e9a0 tx=0x7fdc4400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.783+0000 7fdc56a00700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc58105520 0x7fdc58104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.783+0000 7fdc4f400700 1 -- 172.21.15.120:0/3176983481 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400cbd0 con 0x7fdc58105e70 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.783+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc581ad730 con 0x7fdc58105e70 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.783+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581adcc0 con 0x7fdc58105e70 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.783+0000 7fdc4f400700 1 -- 172.21.15.120:0/3176983481 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc4400cd70 con 0x7fdc58105e70 2024-05-14T09:29:17.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.783+0000 7fdc4f400700 1 -- 172.21.15.120:0/3176983481 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44018680 con 0x7fdc58105e70 2024-05-14T09:29:17.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.789+0000 7fdc4f400700 1 -- 172.21.15.120:0/3176983481 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fdc44018820 con 0x7fdc58105e70 2024-05-14T09:29:17.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.790+0000 7fdc6c08fb80 1 Processor -- start 2024-05-14T09:29:17.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.790+0000 7fdc6c08fb80 1 -- start start 2024-05-14T09:29:17.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.791+0000 7fdc4f400700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdc3c0b29c0 0x7fdc3c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.792+0000 7fdc4f400700 1 -- 172.21.15.120:0/3176983481 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fdc440e29d0 con 0x7fdc58105e70 2024-05-14T09:29:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.792+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4c69e40 0x55c3e4ded2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.792+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4de74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.792+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4de79f0 0x55c3e4de7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.792+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c3e4d09a20 con 0x55c3e4ded830 2024-05-14T09:29:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.792+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c3e4ca7760 con 0x55c3e4de79f0 2024-05-14T09:29:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.792+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c3e4d059e0 con 0x55c3e4c69e40 2024-05-14T09:29:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.793+0000 7fdc56a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4c69e40 0x55c3e4ded2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.793+0000 7fdc56000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4de74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.793+0000 7fdc56a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4c69e40 0x55c3e4ded2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54244/0 (socket says 172.21.15.120:54244) 2024-05-14T09:29:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.793+0000 7fdc56000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4de74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53256/0 (socket says 172.21.15.120:53256) 2024-05-14T09:29:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.793+0000 7fdc56a00700 1 -- 172.21.15.120:0/1429485510 learned_addr learned my addr 172.21.15.120:0/1429485510 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.793+0000 7fdc57400700 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4de79f0 0x55c3e4de7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.794+0000 7fdc56a00700 1 -- 172.21.15.120:0/1429485510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4de79f0 msgr2=0x55c3e4de7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.794+0000 7fdc56a00700 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4de79f0 0x55c3e4de7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.794+0000 7fdc56a00700 1 -- 172.21.15.120:0/1429485510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 msgr2=0x55c3e4de74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.794+0000 7fdc56a00700 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4de74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.794+0000 7fdc56a00700 1 -- 172.21.15.120:0/1429485510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e4c568d0 con 0x55c3e4c69e40 2024-05-14T09:29:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.794+0000 7fdc57400700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdc3c0b29c0 0x7fdc3c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.795+0000 7fdc56a00700 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4c69e40 0x55c3e4ded2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009cc0 tx=0x7fdc48010370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3354664a06be2757 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:17.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.795+0000 7fdc57400700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdc3c0b29c0 0x7fdc3c0b4ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdc5819ee00 tx=0x7fdc5000b330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.796+0000 7fdc43e00700 1 -- 172.21.15.120:0/1429485510 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48010bc0 con 0x55c3e4c69e40 2024-05-14T09:29:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.796+0000 7fdc43e00700 1 -- 172.21.15.120:0/1429485510 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc480044c0 con 0x55c3e4c69e40 2024-05-14T09:29:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.796+0000 7fdc43e00700 1 -- 172.21.15.120:0/1429485510 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48012450 con 0x55c3e4c69e40 2024-05-14T09:29:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.797+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1429485510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4c69e40 msgr2=0x55c3e4ded2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.797+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4c69e40 0x55c3e4ded2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009cc0 tx=0x7fdc48010370 comp rx=0 tx=0).stop 2024-05-14T09:29:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.797+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1429485510 shutdown_connections 2024-05-14T09:29:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.797+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4de79f0 0x55c3e4de7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.797+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4c69e40 0x55c3e4ded2f0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009cc0 tx=0x7fdc48010370 comp rx=0 tx=0).stop 2024-05-14T09:29:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.797+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1429485510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4de74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.797+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1429485510 >> 172.21.15.120:0/1429485510 conn(0x55c3e4caef70 msgr2=0x55c3e4de22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.798+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1429485510 shutdown_connections 2024-05-14T09:29:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.798+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1429485510 wait complete. 2024-05-14T09:29:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.799+0000 7fdc6c08fb80 1 -- start start 2024-05-14T09:29:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.799+0000 7fdc6c08fb80 1 Processor -- start 2024-05-14T09:29:17.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.799+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4df1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.799+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4df1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4dfd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c3e4df4310 con 0x55c3e4ded830 2024-05-14T09:29:17.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c3e4c6fb20 con 0x55c3e4df1bc0 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c3e4df4490 con 0x55c3e4de79f0 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc6c08fb80 10 client.0 _ll_register_callbacks cb 0x55c3e4cb0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4dfd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4dfd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:46916/0 (socket says 172.21.15.120:46916) 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 -- 172.21.15.120:0/1767485261 learned_addr learned my addr 172.21.15.120:0/1767485261 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc56a00700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4df1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc56000700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4df1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 -- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 msgr2=0x55c3e4df1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4df1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 -- 172.21.15.120:0/1767485261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 msgr2=0x55c3e4df1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4df1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc57400700 1 -- 172.21.15.120:0/1767485261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e4ccf420 con 0x55c3e4df1bc0 2024-05-14T09:29:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.800+0000 7fdc56a00700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4df1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.801+0000 7fdc57400700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4dfd7b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc50007780 tx=0x7fdc50009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=285f655d7c72d23d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.801+0000 7fdc40c00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:29:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.801+0000 7fdc40c00700 1 -- 172.21.15.120:0/1767485261 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5002e070 con 0x55c3e4df1bc0 2024-05-14T09:29:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.801+0000 7fdc40c00700 1 -- 172.21.15.120:0/1767485261 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fdc5001eac0 con 0x55c3e4df1bc0 2024-05-14T09:29:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.801+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc480044c0 con 0x55c3e4df1bc0 2024-05-14T09:29:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.802+0000 7fdc40c00700 1 -- 172.21.15.120:0/1767485261 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fdc50038050 con 0x55c3e4df1bc0 2024-05-14T09:29:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.802+0000 7fdc6c08fb80 10 client.35909 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.802+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c3e4dff4a0 con 0x55c3e4df1bc0 2024-05-14T09:29:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.802+0000 7fdc40c00700 1 -- 172.21.15.120:0/1767485261 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc480044c0 con 0x55c3e4df1bc0 2024-05-14T09:29:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc40c00700 1 -- 172.21.15.120:0/1767485261 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fdc50011070 con 0x55c3e4df1bc0 2024-05-14T09:29:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc6c08fb80 10 client.35909 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc6c08fb80 10 client.35909 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:29:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc6c08fb80 20 client.35909 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e01b30 0x55c3e4e03fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc6c08fb80 4 client.35909 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3e4db41c0 con 0x55c3e4e01b30 2024-05-14T09:29:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.804+0000 7fdc56a00700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e01b30 0x55c3e4e03fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.805+0000 7fdc56a00700 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e01b30 0x55c3e4e03fb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ddab0e3f1bc010b9 server_cookie=1ab7439a0091b592 in_seq=0 out_seq=0 2024-05-14T09:29:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.805+0000 7fdc40c00700 10 client.35909 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:29:17.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.806+0000 7fdc40c00700 1 -- 172.21.15.120:0/1767485261 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c3e4db41c0 con 0x55c3e4e01b30 2024-05-14T09:29:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc40c00700 10 client.35909 handle_command_reply: tid=0 2024-05-14T09:29:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 client.35909 shutdown 2024-05-14T09:29:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 msgr2=0x55c3e4dfd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4dfd7b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc50007780 tx=0x7fdc50009920 comp rx=0 tx=0).stop 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 shutdown_connections 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4dfd7b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e01b30 0x55c3e4e03fb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4df1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/1767485261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4ded830 0x55c3e4df1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.807+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 >> 172.21.15.120:0/1767485261 conn(0x55c3e4caef70 msgr2=0x55c3e4de7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.808+0000 7fdc40c00700 0 client.35909 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.808+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 shutdown_connections 2024-05-14T09:29:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.808+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/1767485261 wait complete. 2024-05-14T09:29:17.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.808+0000 7fdc6c08fb80 20 client.35909 trim_cache size 0 max 16384 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 Processor -- start 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 -- start start 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4de74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4ded830 0x55c3e4ddc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e09770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3800ebb0 con 0x55c3e4df1bc0 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc38010750 con 0x55c3e4ded830 2024-05-14T09:29:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.829+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3800f280 con 0x55c3e4de79f0 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc57400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e09770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4ded830 0x55c3e4ddc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4ded830 0x55c3e4ddc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:46922/0 (socket says 172.21.15.120:46922) 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc57400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e09770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53268/0 (socket says 172.21.15.120:53268) 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 -- 172.21.15.120:0/3916237388 learned_addr learned my addr 172.21.15.120:0/3916237388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56a00700 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4de74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 -- 172.21.15.120:0/3916237388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 msgr2=0x55c3e4de74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4de74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 -- 172.21.15.120:0/3916237388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4df1bc0 msgr2=0x55c3e4e09770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e09770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc56000700 1 -- 172.21.15.120:0/3916237388 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e4de3ce0 con 0x55c3e4ded830 2024-05-14T09:29:17.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.830+0000 7fdc57400700 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e09770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:17.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.831+0000 7fdc56000700 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4ded830 0x55c3e4ddc7b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c5b0 tx=0x7fdc44014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42fc70090a4e48e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:17.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.831+0000 7fdc43400700 1 -- 172.21.15.120:0/3916237388 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440aa510 con 0x55c3e4ded830 2024-05-14T09:29:17.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.831+0000 7fdc43400700 1 -- 172.21.15.120:0/3916237388 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc440ab100 con 0x55c3e4ded830 2024-05-14T09:29:17.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.831+0000 7fdc43400700 1 -- 172.21.15.120:0/3916237388 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440a65d0 con 0x55c3e4ded830 2024-05-14T09:29:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/3916237388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4ded830 msgr2=0x55c3e4ddc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4ded830 0x55c3e4ddc7b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c5b0 tx=0x7fdc44014000 comp rx=0 tx=0).stop 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/3916237388 shutdown_connections 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e09770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4de79f0 0x55c3e4de74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/3916237388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4ded830 0x55c3e4ddc7b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/3916237388 >> 172.21.15.120:0/3916237388 conn(0x55c3e4caef70 msgr2=0x55c3e4ddc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/3916237388 shutdown_connections 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.832+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/3916237388 wait complete. 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.833+0000 7fdc6c08fb80 1 -- start start 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.833+0000 7fdc6c08fb80 1 Processor -- start 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4de79f0 0x55c3e4df4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4ded830 0x55c3e4df5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc6c08fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdc38010080 con 0x55c3e4de79f0 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3800f9b0 con 0x55c3e4df1bc0 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc6c08fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3800cb70 con 0x55c3e4ded830 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc6c08fb80 10 client.0 _ll_register_callbacks cb 0x55c3e4cb0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4de79f0 0x55c3e4df4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4de79f0 0x55c3e4df4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53270/0 (socket says 172.21.15.120:53270) 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 -- 172.21.15.120:0/134729050 learned_addr learned my addr 172.21.15.120:0/134729050 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc57400700 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56000700 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4ded830 0x55c3e4df5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 -- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4ded830 msgr2=0x55c3e4df5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4ded830 0x55c3e4df5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 -- 172.21.15.120:0/134729050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 msgr2=0x55c3e4e642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.834+0000 7fdc56a00700 1 -- 172.21.15.120:0/134729050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e4e64850 con 0x55c3e4de79f0 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.835+0000 7fdc56a00700 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4de79f0 0x55c3e4df4cf0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009be0 tx=0x7fdc480097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffaa360e00f35ad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.835+0000 7fdc40c00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.835+0000 7fdc40c00700 1 -- 172.21.15.120:0/134729050 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48005520 con 0x55c3e4de79f0 2024-05-14T09:29:17.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.835+0000 7fdc40c00700 1 -- 172.21.15.120:0/134729050 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fdc480109c0 con 0x55c3e4de79f0 2024-05-14T09:29:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.835+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc440ab100 con 0x55c3e4de79f0 2024-05-14T09:29:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.836+0000 7fdc40c00700 1 -- 172.21.15.120:0/134729050 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fdc48010bc0 con 0x55c3e4de79f0 2024-05-14T09:29:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.836+0000 7fdc6c08fb80 10 client.16434 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.836+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c3e4e6bb70 con 0x55c3e4de79f0 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.836+0000 7fdc40c00700 1 -- 172.21.15.120:0/134729050 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc440ab100 con 0x55c3e4de79f0 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.836+0000 7fdc40c00700 1 -- 172.21.15.120:0/134729050 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fdc4800f040 con 0x55c3e4de79f0 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.837+0000 7fdc6c08fb80 10 client.16434 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.837+0000 7fdc6c08fb80 10 client.16434 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.837+0000 7fdc6c08fb80 20 client.16434 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.837+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e6bf50 0x55c3e4e6e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.837+0000 7fdc6c08fb80 4 client.16434 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.837+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3e4d17400 con 0x55c3e4e6bf50 2024-05-14T09:29:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.837+0000 7fdc56000700 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e6bf50 0x55c3e4e6e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.838+0000 7fdc40c00700 10 client.16434 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.838+0000 7fdc56000700 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e6bf50 0x55c3e4e6e370 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8dbcd0b41762ccf6 server_cookie=9e6564bbabddc05d in_seq=0 out_seq=0 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc40c00700 1 -- 172.21.15.120:0/134729050 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3e4d17400 con 0x55c3e4e6bf50 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc40c00700 10 client.16434 handle_command_reply: tid=0 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 client.16434 shutdown 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4de79f0 msgr2=0x55c3e4df4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4de79f0 0x55c3e4df4cf0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009be0 tx=0x7fdc480097d0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 shutdown_connections 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c3e4df1bc0 0x55c3e4e642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x55c3e4e6bf50 0x55c3e4e6e370 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c3e4de79f0 0x55c3e4df4cf0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 --2- 172.21.15.120:0/134729050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3e4ded830 0x55c3e4df5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 >> 172.21.15.120:0/134729050 conn(0x55c3e4caef70 msgr2=0x55c3e4def640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc40c00700 0 client.16434 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:29:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 shutdown_connections 2024-05-14T09:29:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.839+0000 7fdc6c08fb80 1 -- 172.21.15.120:0/134729050 wait complete. 2024-05-14T09:29:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.840+0000 7fdc6c08fb80 20 client.16434 trim_cache size 0 max 16384 2024-05-14T09:29:17.844 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdc3c0b29c0 msgr2=0x7fdc3c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdc3c0b29c0 0x7fdc3c0b4ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdc5819ee00 tx=0x7fdc5000b330 comp rx=0 tx=0).stop 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105e70 msgr2=0x7fdc58103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105e70 0x7fdc58103210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400e9a0 tx=0x7fdc4400ecb0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 shutdown_connections 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fdc3c0b29c0 0x7fdc3c0b4ed0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc58105520 0x7fdc58104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc5810e900 0x7fdc581037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 --2- 172.21.15.120:0/3176983481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc58105e70 0x7fdc58103210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 >> 172.21.15.120:0/3176983481 conn(0x7fdc580fedc0 msgr2=0x7fdc58100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 shutdown_connections 2024-05-14T09:29:17.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:17.841+0000 7fdc5d600700 1 -- 172.21.15.120:0/3176983481 wait complete. 2024-05-14T09:29:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:17 smithi120 ceph-mon[31085]: pgmap v728: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 665 op/s 2024-05-14T09:29:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:17 smithi152 ceph-mon[34868]: pgmap v728: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 665 op/s 2024-05-14T09:29:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:17 smithi175 ceph-mon[35353]: pgmap v728: 129 pgs: 129 active+clean; 956 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 665 op/s 2024-05-14T09:29:19.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T09:29:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 105.0 s, 482.4 tps, lat 206.932 ms stddev 299.875 2024-05-14T09:29:19.739 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:19 smithi152 ceph-mon[34868]: pgmap v729: 129 pgs: 129 active+clean; 968 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 711 op/s 2024-05-14T09:29:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:19 smithi175 ceph-mon[35353]: pgmap v729: 129 pgs: 129 active+clean; 968 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 711 op/s 2024-05-14T09:29:20.339 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:19 smithi120 ceph-mon[31085]: pgmap v729: 129 pgs: 129 active+clean; 968 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 711 op/s 2024-05-14T09:29:22.168 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:21 smithi120 ceph-mon[31085]: pgmap v730: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-05-14T09:29:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:21 smithi152 ceph-mon[34868]: pgmap v730: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-05-14T09:29:22.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:21 smithi175 ceph-mon[35353]: pgmap v730: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-05-14T09:29:22.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.655+0000 7f1aca200700 1 -- 172.21.15.120:0/3472893073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc0a7600 msgr2=0x7f1abc0a9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.655+0000 7f1aca200700 1 --2- 172.21.15.120:0/3472893073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc0a7600 0x7f1abc0a9a20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ac406a3c0 tx=0x7f1ac4069fc0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.656+0000 7f1aca200700 1 -- 172.21.15.120:0/3472893073 shutdown_connections 2024-05-14T09:29:22.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.656+0000 7f1aca200700 1 --2- 172.21.15.120:0/3472893073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc0a7600 0x7f1abc0a9a20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.656+0000 7f1aca200700 1 --2- 172.21.15.120:0/3472893073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc007e20 0x7f1abc008230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.656+0000 7f1aca200700 1 --2- 172.21.15.120:0/3472893073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1abc008770 0x7f1abc0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.656+0000 7f1aca200700 1 -- 172.21.15.120:0/3472893073 >> 172.21.15.120:0/3472893073 conn(0x7f1abc00c160 msgr2=0x7f1abc00c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.656+0000 7f1aca200700 1 -- 172.21.15.120:0/3472893073 shutdown_connections 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.656+0000 7f1aca200700 1 -- 172.21.15.120:0/3472893073 wait complete. 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.658+0000 7f1aca200700 1 Processor -- start 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.658+0000 7f1aca200700 1 -- start start 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.659+0000 7f1aca200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc007e20 0x7f1abc0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.659+0000 7f1aca200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc008770 0x7f1abc0a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.659+0000 7f1aca200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1abc0a7600 0x7f1abc0a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.659+0000 7f1aca200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc0acb40 con 0x7f1abc008770 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.660+0000 7f1aca200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc0ac9c0 con 0x7f1abc007e20 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.660+0000 7f1aca200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc0accc0 con 0x7f1abc0a7600 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.660+0000 7f1ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc008770 0x7f1abc0a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.660+0000 7f1ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc008770 0x7f1abc0a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39188/0 (socket says 172.21.15.120:39188) 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.660+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2804184544 learned_addr learned my addr 172.21.15.120:0/2804184544 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.660+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc007e20 0x7f1abc0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.660+0000 7f1ac9800700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1abc0a7600 0x7f1abc0a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.661+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2804184544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1abc0a7600 msgr2=0x7f1abc0a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.661+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1abc0a7600 0x7f1abc0a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.661+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2804184544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc007e20 msgr2=0x7f1abc0a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.661+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc007e20 0x7f1abc0a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.661+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2804184544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc0a4b80 con 0x7f1abc008770 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.662+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc008770 0x7f1abc0a0180 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000e9a0 tx=0x7f1ab000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.662+0000 7f1ac1600700 1 -- 172.21.15.120:0/2804184544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000c9c0 con 0x7f1abc008770 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.662+0000 7f1ac1600700 1 -- 172.21.15.120:0/2804184544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ab0010430 con 0x7f1abc008770 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.662+0000 7f1ac1600700 1 -- 172.21.15.120:0/2804184544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0018680 con 0x7f1abc008770 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.662+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc0a4e70 con 0x7f1abc008770 2024-05-14T09:29:22.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.663+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc0a5400 con 0x7f1abc008770 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.671+0000 7f1ada267b80 1 Processor -- start 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.671+0000 7f1ac1600700 1 -- 172.21.15.120:0/2804184544 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1ab000cb60 con 0x7f1abc008770 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.673+0000 7f1ada267b80 1 -- start start 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.673+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6129be40 0x559e6141f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61419700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61419c40 0x559e6141a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ada267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e6133ba20 con 0x559e61419c40 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ada267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559e612d9760 con 0x559e6141fa80 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ada267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559e613379e0 con 0x559e6129be40 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ac1600700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1aac0b29c0 0x7f1aac0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61419c40 0x559e6141a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ac3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61419c40 0x559e6141a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39196/0 (socket says 172.21.15.120:39196) 2024-05-14T09:29:22.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.674+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2834556286 learned_addr learned my addr 172.21.15.120:0/2834556286 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.675+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61419700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.676+0000 7f1ac8e00700 1 -- 172.21.15.120:0/2834556286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6129be40 msgr2=0x559e6141f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.676+0000 7f1ac9800700 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6129be40 0x559e6141f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.676+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6129be40 0x559e6141f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.676+0000 7f1ac8e00700 1 -- 172.21.15.120:0/2834556286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61419c40 msgr2=0x559e6141a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.676+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61419c40 0x559e6141a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.676+0000 7f1ac8e00700 1 -- 172.21.15.120:0/2834556286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e612888d0 con 0x559e6141fa80 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.676+0000 7f1ac1600700 1 -- 172.21.15.120:0/2804184544 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1ab00e2660 con 0x7f1abc008770 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.677+0000 7f1ac9800700 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6129be40 0x559e6141f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.677+0000 7f1ac9800700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1aac0b29c0 0x7f1aac0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.678+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61419700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8005fd0 tx=0x7f1ab8011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f04b3c6ff81741 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.678+0000 7f1ac9800700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1aac0b29c0 0x7f1aac0b4ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ac402ec10 tx=0x7f1ac4069fc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.678+0000 7f1ab6000700 1 -- 172.21.15.120:0/2834556286 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8011cc0 con 0x559e6141fa80 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.678+0000 7f1ab6000700 1 -- 172.21.15.120:0/2834556286 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ab80044e0 con 0x559e6141fa80 2024-05-14T09:29:22.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.678+0000 7f1ab6000700 1 -- 172.21.15.120:0/2834556286 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80193e0 con 0x559e6141fa80 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.679+0000 7f1ada267b80 1 -- 172.21.15.120:0/2834556286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 msgr2=0x559e61419700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.679+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61419700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8005fd0 tx=0x7f1ab8011440 comp rx=0 tx=0).stop 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.680+0000 7f1ada267b80 1 -- 172.21.15.120:0/2834556286 shutdown_connections 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.680+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e61419c40 0x559e6141a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.680+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6129be40 0x559e6141f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.680+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2834556286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61419700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.680+0000 7f1ada267b80 1 -- 172.21.15.120:0/2834556286 >> 172.21.15.120:0/2834556286 conn(0x559e612e0f70 msgr2=0x559e61414400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.681+0000 7f1ada267b80 1 -- 172.21.15.120:0/2834556286 shutdown_connections 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.681+0000 7f1ada267b80 1 -- 172.21.15.120:0/2834556286 wait complete. 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.682+0000 7f1ada267b80 1 -- start start 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.682+0000 7f1ada267b80 1 Processor -- start 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.683+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61423130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.683+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e61423670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.683+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61423bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ada267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e614374a0 con 0x559e6129be40 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ada267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559e612a1b20 con 0x559e6141fa80 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ada267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559e61437620 con 0x559e61419c40 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ac3e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e61423670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ada267b80 10 client.0 _ll_register_callbacks cb 0x559e612e2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ac3e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e61423670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:46690/0 (socket says 172.21.15.120:46690) 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ac3e00700 1 -- 172.21.15.120:0/3213002302 learned_addr learned my addr 172.21.15.120:0/3213002302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61423130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.684+0000 7f1ac9800700 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61423bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.685+0000 7f1ac3e00700 1 -- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 msgr2=0x559e61423bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.685+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61423bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.685+0000 7f1ac3e00700 1 -- 172.21.15.120:0/3213002302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 msgr2=0x559e61423130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.685+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61423130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.685+0000 7f1ac3e00700 1 -- 172.21.15.120:0/3213002302 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e61301420 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.686+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e61423670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009230 tx=0x7f1ab006f260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81a1595909887bf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.686+0000 7f1aaaa00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.686+0000 7f1aaaa00700 1 -- 172.21.15.120:0/3213002302 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a8ff0 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.686+0000 7f1aaaa00700 1 -- 172.21.15.120:0/3213002302 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1ab00cc0b0 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.687+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ab80044e0 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.687+0000 7f1aaaa00700 1 -- 172.21.15.120:0/3213002302 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1ab00772e0 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.687+0000 7f1ada267b80 10 client.26005 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.687+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559e61442060 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.688+0000 7f1aaaa00700 1 -- 172.21.15.120:0/3213002302 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ab80044e0 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.688+0000 7f1aaaa00700 1 -- 172.21.15.120:0/3213002302 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f1ab00b2250 con 0x559e61419c40 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.688+0000 7f1ada267b80 10 client.26005 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.688+0000 7f1ada267b80 10 client.26005 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:29:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.688+0000 7f1ada267b80 20 client.26005 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.689+0000 7f1ada267b80 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e61444580 0x559e614469e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.689+0000 7f1ada267b80 4 client.26005 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.689+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e613e61c0 con 0x559e61444580 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.689+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e61444580 0x559e614469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.691+0000 7f1aaaa00700 10 client.26005 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.691+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e61444580 0x559e614469e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a05dba6c518b217 server_cookie=37f6b801ed7af348 in_seq=0 out_seq=0 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.693+0000 7f1aaaa00700 1 -- 172.21.15.120:0/3213002302 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559e613e61c0 con 0x559e61444580 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.693+0000 7f1aaaa00700 10 client.26005 handle_command_reply: tid=0 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.693+0000 7f1ada267b80 1 client.26005 shutdown 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 msgr2=0x559e61423670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e61423670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009230 tx=0x7f1ab006f260 comp rx=0 tx=0).stop 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 shutdown_connections 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61423bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e61444580 0x559e614469e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61423130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 --2- 172.21.15.120:0/3213002302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e61423670 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 >> 172.21.15.120:0/3213002302 conn(0x559e612e0f70 msgr2=0x559e614186f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.694+0000 7f1aaaa00700 0 client.26005 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.695+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 shutdown_connections 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.695+0000 7f1ada267b80 1 -- 172.21.15.120:0/3213002302 wait complete. 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.695+0000 7f1ada267b80 20 client.26005 trim_cache size 0 max 16384 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.723+0000 7f1ada267b80 1 Processor -- start 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.723+0000 7f1ada267b80 1 -- start start 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.724+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61419700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.724+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e614239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.724+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61440590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.724+0000 7f1ada267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1512d0 con 0x559e6129be40 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.724+0000 7f1ada267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc152e70 con 0x559e6141fa80 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.724+0000 7f1ada267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1519a0 con 0x559e61419c40 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.725+0000 7f1ac3e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e614239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.725+0000 7f1ac8e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61419700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.725+0000 7f1ac8e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61419700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39210/0 (socket says 172.21.15.120:39210) 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.725+0000 7f1ac9800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61440590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.725+0000 7f1ac8e00700 1 -- 172.21.15.120:0/701918346 learned_addr learned my addr 172.21.15.120:0/701918346 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.727+0000 7f1ac3e00700 1 -- 172.21.15.120:0/701918346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 msgr2=0x559e61440590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.727+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/701918346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61440590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.727+0000 7f1ac3e00700 1 -- 172.21.15.120:0/701918346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 msgr2=0x559e61419700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.727+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/701918346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61419700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.727+0000 7f1ac3e00700 1 -- 172.21.15.120:0/701918346 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e61410c40 con 0x559e61419c40 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.727+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/701918346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e614239f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00a9810 tx=0x7f1ab00a9300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4ee47553b6425ff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.728+0000 7f1ab5600700 1 -- 172.21.15.120:0/701918346 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a8ff0 con 0x559e61419c40 2024-05-14T09:29:22.922 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:29:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.728+0000 7f1ab5600700 1 -- 172.21.15.120:0/701918346 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ab0073070 con 0x559e61419c40 2024-05-14T09:29:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.728+0000 7f1ab5600700 1 -- 172.21.15.120:0/701918346 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab006f2d0 con 0x559e61419c40 2024-05-14T09:29:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.729+0000 7f1ada267b80 1 -- 172.21.15.120:0/701918346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 msgr2=0x559e614239f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.729+0000 7f1ada267b80 1 --2- 172.21.15.120:0/701918346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e614239f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00a9810 tx=0x7f1ab00a9300 comp rx=0 tx=0).stop 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.729+0000 7f1ada267b80 1 -- 172.21.15.120:0/701918346 shutdown_connections 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.729+0000 7f1ada267b80 1 --2- 172.21.15.120:0/701918346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e6141fa80 0x559e61440590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.729+0000 7f1ada267b80 1 --2- 172.21.15.120:0/701918346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e61419700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.729+0000 7f1ada267b80 1 --2- 172.21.15.120:0/701918346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e61419c40 0x559e614239f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.729+0000 7f1ada267b80 1 -- 172.21.15.120:0/701918346 >> 172.21.15.120:0/701918346 conn(0x559e612e0f70 msgr2=0x559e6141e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.730+0000 7f1ada267b80 1 -- 172.21.15.120:0/701918346 shutdown_connections 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.730+0000 7f1ada267b80 1 -- 172.21.15.120:0/701918346 wait complete. 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.730+0000 7f1ada267b80 1 -- start start 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.731+0000 7f1ada267b80 1 Processor -- start 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e6143cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61419c40 0x559e6144b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ada267b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6141fa80 0x559e6144bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ada267b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1527a0 con 0x559e6129be40 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ada267b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1520d0 con 0x559e61419c40 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ada267b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc14f290 con 0x559e6141fa80 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ada267b80 10 client.0 _ll_register_callbacks cb 0x559e612e2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.732+0000 7f1ac8e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e6143cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.733+0000 7f1ac8e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e6143cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39218/0 (socket says 172.21.15.120:39218) 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.733+0000 7f1ac8e00700 1 -- 172.21.15.120:0/2541518805 learned_addr learned my addr 172.21.15.120:0/2541518805 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.733+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61419c40 0x559e6144b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.733+0000 7f1ac9800700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6141fa80 0x559e6144bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.733+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2541518805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6141fa80 msgr2=0x559e6144bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.733+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6141fa80 0x559e6144bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.733+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2541518805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 msgr2=0x559e6143cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.734+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e6143cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.734+0000 7f1ac3e00700 1 -- 172.21.15.120:0/2541518805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e61414ed0 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.734+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e6143cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.734+0000 7f1ac3e00700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61419c40 0x559e6144b7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00a9580 tx=0x7f1ab0010690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20a0c4f2b341aa5d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.735+0000 7f1aaaa00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.735+0000 7f1aaaa00700 1 -- 172.21.15.120:0/2541518805 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a8ff0 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.735+0000 7f1aaaa00700 1 -- 172.21.15.120:0/2541518805 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1ab00aabb0 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.736+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ab0073070 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.736+0000 7f1aaaa00700 1 -- 172.21.15.120:0/2541518805 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1ab00c5050 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.738+0000 7f1ada267b80 10 client.35933 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.738+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559e614aea80 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.739+0000 7f1aaaa00700 1 -- 172.21.15.120:0/2541518805 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ab0073070 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.740+0000 7f1aaaa00700 1 -- 172.21.15.120:0/2541518805 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f1ab00c8080 con 0x559e61419c40 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.740+0000 7f1ada267b80 10 client.35933 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.740+0000 7f1ada267b80 10 client.35933 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:29:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.740+0000 7f1ada267b80 20 client.35933 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.740+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e614aef10 0x559e614b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.740+0000 7f1ada267b80 4 client.35933 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.740+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e61349400 con 0x559e614aef10 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.741+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e614aef10 0x559e614b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.742+0000 7f1aaaa00700 10 client.35933 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.742+0000 7f1ac8e00700 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e614aef10 0x559e614b1330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e4450eb8d282671d server_cookie=883256d6a0ff34c0 in_seq=0 out_seq=0 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.743+0000 7f1aaaa00700 1 -- 172.21.15.120:0/2541518805 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e61349400 con 0x559e614aef10 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.743+0000 7f1aaaa00700 10 client.35933 handle_command_reply: tid=0 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.743+0000 7f1ada267b80 1 client.35933 shutdown 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.744+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61419c40 msgr2=0x559e6144b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.744+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61419c40 0x559e6144b7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00a9580 tx=0x7f1ab0010690 comp rx=0 tx=0).stop 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.745+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 shutdown_connections 2024-05-14T09:29:22.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.745+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x559e614aef10 0x559e614b1330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.745+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559e6141fa80 0x559e6144bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.745+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e6129be40 0x559e6143cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.745+0000 7f1ada267b80 1 --2- 172.21.15.120:0/2541518805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559e61419c40 0x559e6144b7b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.745+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 >> 172.21.15.120:0/2541518805 conn(0x559e612e0f70 msgr2=0x559e6140e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.745+0000 7f1aaaa00700 0 client.35933 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.746+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 shutdown_connections 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.746+0000 7f1ada267b80 1 -- 172.21.15.120:0/2541518805 wait complete. 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.746+0000 7f1ada267b80 20 client.35933 trim_cache size 0 max 16384 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.747+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1aac0b29c0 msgr2=0x7f1aac0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1aac0b29c0 0x7f1aac0b4ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ac402ec10 tx=0x7f1ac4069fc0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc008770 msgr2=0x7f1abc0a0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc008770 0x7f1abc0a0180 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000e9a0 tx=0x7f1ab000ecb0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 shutdown_connections 2024-05-14T09:29:22.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1aac0b29c0 0x7f1aac0b4ed0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1abc007e20 0x7f1abc0a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1abc0a7600 0x7f1abc0a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 --2- 172.21.15.120:0/2804184544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1abc008770 0x7f1abc0a0180 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 >> 172.21.15.120:0/2804184544 conn(0x7f1abc00c160 msgr2=0x7f1abc0934f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:22.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.748+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 shutdown_connections 2024-05-14T09:29:22.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:22.749+0000 7f1aca200700 1 -- 172.21.15.120:0/2804184544 wait complete. 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.975+0000 7fccffe00640 1 -- 172.21.15.120:0/476332080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810a280 msgr2=0x7fccf810af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.975+0000 7fccffe00640 1 --2- 172.21.15.120:0/476332080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810a280 0x7fccf810af80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fccec009860 tx=0x7fccec02a340 comp rx=0 tx=0).stop 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.976+0000 7fccffe00640 1 -- 172.21.15.120:0/476332080 shutdown_connections 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.976+0000 7fccffe00640 1 --2- 172.21.15.120:0/476332080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf81101c0 0x7fccf81125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.976+0000 7fccffe00640 1 --2- 172.21.15.120:0/476332080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccf810b4c0 0x7fccf810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.976+0000 7fccffe00640 1 --2- 172.21.15.120:0/476332080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810a280 0x7fccf810af80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.976+0000 7fccffe00640 1 -- 172.21.15.120:0/476332080 >> 172.21.15.120:0/476332080 conn(0x7fccf8078f10 msgr2=0x7fccf8107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.977+0000 7fccffe00640 1 -- 172.21.15.120:0/476332080 shutdown_connections 2024-05-14T09:29:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.977+0000 7fccffe00640 1 -- 172.21.15.120:0/476332080 wait complete. 2024-05-14T09:29:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.978+0000 7fccffe00640 1 Processor -- start 2024-05-14T09:29:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.978+0000 7fccffe00640 1 -- start start 2024-05-14T09:29:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccffe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf810a280 0x7fccf81a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccfd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf810a280 0x7fccf81a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccffe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810b4c0 0x7fccf81a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccffe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccf81101c0 0x7fccf81a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccffe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8115bc0 con 0x7fccf810a280 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccffe00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8115a40 con 0x7fccf810b4c0 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccffe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8115d40 con 0x7fccf81101c0 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccfd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf810a280 0x7fccf81a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39250/0 (socket says 172.21.15.120:39250) 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.979+0000 7fccfd400640 1 -- 172.21.15.120:0/433267359 learned_addr learned my addr 172.21.15.120:0/433267359 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.980+0000 7fccfca00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810b4c0 0x7fccf81a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.980+0000 7fccfd400640 1 -- 172.21.15.120:0/433267359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccf81101c0 msgr2=0x7fccf81a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.980+0000 7fccfd400640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccf81101c0 0x7fccf81a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.980+0000 7fccfd400640 1 -- 172.21.15.120:0/433267359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810b4c0 msgr2=0x7fccf81a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.980+0000 7fccfd400640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810b4c0 0x7fccf81a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.980+0000 7fccfd400640 1 -- 172.21.15.120:0/433267359 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf81a83f0 con 0x7fccf810a280 2024-05-14T09:29:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.980+0000 7fccfd400640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf810a280 0x7fccf81a08b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fccec02a8b0 tx=0x7fccec032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.981+0000 7fccf6000640 1 -- 172.21.15.120:0/433267359 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec037040 con 0x7fccf810a280 2024-05-14T09:29:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.981+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf81a8680 con 0x7fccf810a280 2024-05-14T09:29:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.982+0000 7fccf6000640 1 -- 172.21.15.120:0/433267359 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccec0305b0 con 0x7fccf810a280 2024-05-14T09:29:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.982+0000 7fccf6000640 1 -- 172.21.15.120:0/433267359 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0035f0 con 0x7fccf810a280 2024-05-14T09:29:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.982+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81a8b60 con 0x7fccf810a280 2024-05-14T09:29:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.988+0000 7fcd06e02740 1 Processor -- start 2024-05-14T09:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.988+0000 7fcd06e02740 1 -- start start 2024-05-14T09:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.989+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07308100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.989+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07308680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.989+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b0730f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.989+0000 7fcd06e02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560b0726c550 con 0x560b06f3d2f0 2024-05-14T09:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.989+0000 7fcd06e02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560b07211bc0 con 0x560b06f454d0 2024-05-14T09:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.989+0000 7fcd06e02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560b07268510 con 0x560b06f661b0 2024-05-14T09:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.990+0000 7fccfde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07308100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.990+0000 7fccfca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b0730f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.990+0000 7fccfca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b0730f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:36740/0 (socket says 172.21.15.120:36740) 2024-05-14T09:29:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.990+0000 7fccfca00640 1 -- 172.21.15.120:0/1973874959 learned_addr learned my addr 172.21.15.120:0/1973874959 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.990+0000 7fccf6000640 1 -- 172.21.15.120:0/433267359 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fccec043020 con 0x7fccf810a280 2024-05-14T09:29:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.991+0000 7fccfca00640 1 -- 172.21.15.120:0/1973874959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 msgr2=0x560b07308100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.991+0000 7fccfca00640 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07308100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.991+0000 7fccfca00640 1 -- 172.21.15.120:0/1973874959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 msgr2=0x560b07308680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.991+0000 7fccfca00640 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07308680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.991+0000 7fccfca00640 1 -- 172.21.15.120:0/1973874959 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b06f7e210 con 0x560b06f454d0 2024-05-14T09:29:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.992+0000 7fccfde00640 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07308100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.993+0000 7fccfca00640 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b0730f580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009c10 tx=0x7fcce40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6796cb0e1bac687 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.993+0000 7fccea600640 1 -- 172.21.15.120:0/1973874959 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4012450 con 0x560b06f454d0 2024-05-14T09:29:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.994+0000 7fccf6000640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcce00b28b0 0x7fcce00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.994+0000 7fccf6000640 1 -- 172.21.15.120:0/433267359 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fccec101b30 con 0x7fccf810a280 2024-05-14T09:29:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.995+0000 7fccea600640 1 -- 172.21.15.120:0/1973874959 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcce4012a80 con 0x560b06f454d0 2024-05-14T09:29:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.995+0000 7fccea600640 1 -- 172.21.15.120:0/1973874959 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce400fa90 con 0x560b06f454d0 2024-05-14T09:29:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.995+0000 7fccfde00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcce00b28b0 0x7fcce00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 -- 172.21.15.120:0/1973874959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 msgr2=0x560b0730f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b0730f580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009c10 tx=0x7fcce40117b0 comp rx=0 tx=0).stop 2024-05-14T09:29:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fccfde00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcce00b28b0 0x7fcce00b4dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fccf0005fd0 tx=0x7fccf0008340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 -- 172.21.15.120:0/1973874959 shutdown_connections 2024-05-14T09:29:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b0730f580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07308680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1973874959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07308100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 -- 172.21.15.120:0/1973874959 >> 172.21.15.120:0/1973874959 conn(0x560b06f5a300 msgr2=0x560b07303a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.998+0000 7fcd06e02740 1 -- 172.21.15.120:0/1973874959 shutdown_connections 2024-05-14T09:29:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.999+0000 7fcd06e02740 1 -- 172.21.15.120:0/1973874959 wait complete. 2024-05-14T09:29:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:22.999+0000 7fcd06e02740 1 -- start start 2024-05-14T09:29:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.000+0000 7fcd06e02740 1 Processor -- start 2024-05-14T09:29:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.001+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07311c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.001+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f454d0 0x560b073121a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.001+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07319100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.001+0000 7fcd06e02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560b0730ffd0 con 0x560b06f3d2f0 2024-05-14T09:29:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.001+0000 7fcd06e02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560b07225660 con 0x560b06f661b0 2024-05-14T09:29:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.001+0000 7fcd06e02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560b07310150 con 0x560b06f454d0 2024-05-14T09:29:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.001+0000 7fcd06e02740 10 client.0 _ll_register_callbacks cb 0x560b071ef400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.002+0000 7fccfd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07311c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.002+0000 7fccfd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07311c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39270/0 (socket says 172.21.15.120:39270) 2024-05-14T09:29:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.002+0000 7fccfca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f454d0 0x560b073121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.002+0000 7fccfd400640 1 -- 172.21.15.120:0/1695284781 learned_addr learned my addr 172.21.15.120:0/1695284781 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.002+0000 7fccfde00640 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07319100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.003+0000 7fccfd400640 1 -- 172.21.15.120:0/1695284781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f454d0 msgr2=0x560b073121a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.003+0000 7fccfd400640 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f454d0 0x560b073121a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.003+0000 7fccfd400640 1 -- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 msgr2=0x560b07319100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.003+0000 7fccfd400640 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07319100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.003+0000 7fccfd400640 1 -- 172.21.15.120:0/1695284781 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b0704a620 con 0x560b06f3d2f0 2024-05-14T09:29:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.004+0000 7fccfd400640 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07311c60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fccec0c4e60 tx=0x7fccec0c8610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b585767044329568 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.004+0000 7fccdea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.004+0000 7fccdea00640 1 -- 172.21.15.120:0/1695284781 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0c8de0 con 0x560b06f3d2f0 2024-05-14T09:29:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.004+0000 7fccdea00640 1 -- 172.21.15.120:0/1695284781 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fccec030760 con 0x560b06f3d2f0 2024-05-14T09:29:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.005+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce4012a80 con 0x560b06f3d2f0 2024-05-14T09:29:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.005+0000 7fccdea00640 1 -- 172.21.15.120:0/1695284781 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fccec0cd190 con 0x560b06f3d2f0 2024-05-14T09:29:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.005+0000 7fcd06e02740 10 client.16455 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.005+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x560b0731bfa0 con 0x560b06f3d2f0 2024-05-14T09:29:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.006+0000 7fccdea00640 1 -- 172.21.15.120:0/1695284781 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcce4012a80 con 0x560b06f3d2f0 2024-05-14T09:29:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.006+0000 7fccdea00640 1 -- 172.21.15.120:0/1695284781 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fccec0cf390 con 0x560b06f3d2f0 2024-05-14T09:29:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.006+0000 7fcd06e02740 10 client.16455 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.006+0000 7fcd06e02740 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.007+0000 7fcd06e02740 20 client.16455 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.007+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06f24d80 0x560b0731f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.007+0000 7fcd06e02740 4 client.16455 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.007+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b0727a160 con 0x560b06f24d80 2024-05-14T09:29:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.008+0000 7fccfca00640 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06f24d80 0x560b0731f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.009+0000 7fccfca00640 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06f24d80 0x560b0731f480 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39bb3b35ff6c7e20 server_cookie=c63d356ea00c5946 in_seq=0 out_seq=0 2024-05-14T09:29:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.010+0000 7fccdea00640 10 client.16455 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.012+0000 7fccdea00640 1 -- 172.21.15.120:0/1695284781 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560b0727a160 con 0x560b06f24d80 2024-05-14T09:29:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.012+0000 7fccdea00640 10 client.16455 handle_command_reply: tid=0 2024-05-14T09:29:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.013+0000 7fcd06e02740 1 client.16455 shutdown 2024-05-14T09:29:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 msgr2=0x560b07311c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07311c60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fccec0c4e60 tx=0x7fccec0c8610 comp rx=0 tx=0).stop 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 shutdown_connections 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06f24d80 0x560b0731f480 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07319100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f454d0 0x560b073121a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1695284781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07311c60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fccdea00640 0 client.16455 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.014+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 >> 172.21.15.120:0/1695284781 conn(0x560b06f5a300 msgr2=0x560b07302a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.015+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 shutdown_connections 2024-05-14T09:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.015+0000 7fcd06e02740 1 -- 172.21.15.120:0/1695284781 wait complete. 2024-05-14T09:29:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.015+0000 7fcd06e02740 20 client.16455 trim_cache size 0 max 16384 2024-05-14T09:29:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 Processor -- start 2024-05-14T09:29:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 -- start start 2024-05-14T09:29:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f3d2f0 0x560b072fe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f454d0 0x560b07323c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07324170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81b3010 con 0x560b06f454d0 2024-05-14T09:29:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81b4bb0 con 0x560b06f661b0 2024-05-14T09:29:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.050+0000 7fcd06e02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81b36e0 con 0x560b06f3d2f0 2024-05-14T09:29:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.051+0000 7fccfca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f454d0 0x560b07323c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.051+0000 7fccfde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07324170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.051+0000 7fccfd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f3d2f0 0x560b072fe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.051+0000 7fccfd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f3d2f0 0x560b072fe720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:46748/0 (socket says 172.21.15.120:46748) 2024-05-14T09:29:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.051+0000 7fccfd400640 1 -- 172.21.15.120:0/4017091696 learned_addr learned my addr 172.21.15.120:0/4017091696 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.052+0000 7fccfd400640 1 -- 172.21.15.120:0/4017091696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 msgr2=0x560b07324170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.052+0000 7fccfd400640 1 --2- 172.21.15.120:0/4017091696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07324170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.052+0000 7fccfd400640 1 -- 172.21.15.120:0/4017091696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f454d0 msgr2=0x560b07323c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.052+0000 7fccfd400640 1 --2- 172.21.15.120:0/4017091696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f454d0 0x560b07323c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.052+0000 7fccfd400640 1 -- 172.21.15.120:0/4017091696 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b072ff280 con 0x560b06f3d2f0 2024-05-14T09:29:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.053+0000 7fccfd400640 1 --2- 172.21.15.120:0/4017091696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f3d2f0 0x560b072fe720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fccec101ef0 tx=0x7fccec0c8680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639daa6ef9cbbf83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.054+0000 7fcce9c00640 1 -- 172.21.15.120:0/4017091696 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0c8de0 con 0x560b06f3d2f0 2024-05-14T09:29:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.054+0000 7fcce9c00640 1 -- 172.21.15.120:0/4017091696 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccec0e8070 con 0x560b06f3d2f0 2024-05-14T09:29:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.054+0000 7fcce9c00640 1 -- 172.21.15.120:0/4017091696 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0cf390 con 0x560b06f3d2f0 2024-05-14T09:29:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.055+0000 7fcd06e02740 1 -- 172.21.15.120:0/4017091696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f3d2f0 msgr2=0x560b072fe720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.055+0000 7fcd06e02740 1 --2- 172.21.15.120:0/4017091696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f3d2f0 0x560b072fe720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fccec101ef0 tx=0x7fccec0c8680 comp rx=0 tx=0).stop 2024-05-14T09:29:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.055+0000 7fcd06e02740 1 -- 172.21.15.120:0/4017091696 shutdown_connections 2024-05-14T09:29:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.055+0000 7fcd06e02740 1 --2- 172.21.15.120:0/4017091696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f661b0 0x560b07324170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.055+0000 7fcd06e02740 1 --2- 172.21.15.120:0/4017091696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f454d0 0x560b07323c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.055+0000 7fcd06e02740 1 --2- 172.21.15.120:0/4017091696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f3d2f0 0x560b072fe720 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.055+0000 7fcd06e02740 1 -- 172.21.15.120:0/4017091696 >> 172.21.15.120:0/4017091696 conn(0x560b06f5a300 msgr2=0x560b0730c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.056+0000 7fcd06e02740 1 -- 172.21.15.120:0/4017091696 shutdown_connections 2024-05-14T09:29:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.057+0000 7fcd06e02740 1 -- 172.21.15.120:0/4017091696 wait complete. 2024-05-14T09:29:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.057+0000 7fcd06e02740 1 -- start start 2024-05-14T09:29:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.058+0000 7fcd06e02740 1 Processor -- start 2024-05-14T09:29:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.059+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07317e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.059+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b07318370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.059+0000 7fcd06e02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07385d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.059+0000 7fcd06e02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81b44e0 con 0x560b06f3d2f0 2024-05-14T09:29:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.059+0000 7fcd06e02740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81b3e10 con 0x560b06f454d0 2024-05-14T09:29:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.059+0000 7fcd06e02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81b0ff0 con 0x560b06f661b0 2024-05-14T09:29:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.059+0000 7fcd06e02740 10 client.0 _ll_register_callbacks cb 0x7fccec045f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.060+0000 7fccfde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07385d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.060+0000 7fccfd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07317e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.060+0000 7fccfde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07385d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:46762/0 (socket says 172.21.15.120:46762) 2024-05-14T09:29:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.060+0000 7fccfde00640 1 -- 172.21.15.120:0/1523511953 learned_addr learned my addr 172.21.15.120:0/1523511953 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.060+0000 7fccfca00640 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b07318370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.061+0000 7fccfde00640 1 -- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 msgr2=0x560b07318370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.061+0000 7fccfde00640 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b07318370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.061+0000 7fccfde00640 1 -- 172.21.15.120:0/1523511953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 msgr2=0x560b07317e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.061+0000 7fccfde00640 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07317e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.061+0000 7fccfde00640 1 -- 172.21.15.120:0/1523511953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b07386340 con 0x560b06f661b0 2024-05-14T09:29:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.062+0000 7fccfde00640 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07385d00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fccf001de30 tx=0x7fccf0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=207874a786841386 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.062+0000 7fccdea00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.062+0000 7fccdea00640 1 -- 172.21.15.120:0/1523511953 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf001de60 con 0x560b06f661b0 2024-05-14T09:29:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.062+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccec0e8070 con 0x560b06f661b0 2024-05-14T09:29:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.062+0000 7fccdea00640 1 -- 172.21.15.120:0/1523511953 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fccf0003970 con 0x560b06f661b0 2024-05-14T09:29:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.063+0000 7fccdea00640 1 -- 172.21.15.120:0/1523511953 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fccf0003b70 con 0x560b06f661b0 2024-05-14T09:29:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.063+0000 7fcd06e02740 10 client.26023 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.063+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x560b073876f0 con 0x560b06f661b0 2024-05-14T09:29:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.064+0000 7fccdea00640 1 -- 172.21.15.120:0/1523511953 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccec0e8070 con 0x560b06f661b0 2024-05-14T09:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.065+0000 7fccdea00640 1 -- 172.21.15.120:0/1523511953 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fccf0027470 con 0x560b06f661b0 2024-05-14T09:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.065+0000 7fcd06e02740 10 client.26023 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.065+0000 7fcd06e02740 10 client.26023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.065+0000 7fcd06e02740 20 client.26023 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.065+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06efa1c0 0x560b0738a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.065+0000 7fcd06e02740 4 client.26023 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.065+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b07273fd0 con 0x560b06efa1c0 2024-05-14T09:29:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.066+0000 7fccfd400640 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06efa1c0 0x560b0738a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.068+0000 7fccfd400640 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06efa1c0 0x560b0738a0f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91916df4ff5088ae server_cookie=40e02491f3824fb3 in_seq=0 out_seq=0 2024-05-14T09:29:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.068+0000 7fccdea00640 10 client.26023 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.102+0000 7fccdea00640 1 -- 172.21.15.120:0/1523511953 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b07273fd0 con 0x560b06efa1c0 2024-05-14T09:29:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.102+0000 7fccdea00640 10 client.26023 handle_command_reply: tid=0 2024-05-14T09:29:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.102+0000 7fcd06e02740 1 client.26023 shutdown 2024-05-14T09:29:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.104+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 msgr2=0x560b07385d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.104+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07385d00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fccf001de30 tx=0x7fccf0004a40 comp rx=0 tx=0).stop 2024-05-14T09:29:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 shutdown_connections 2024-05-14T09:29:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560b06efa1c0 0x560b0738a0f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fccdea00640 0 client.26023 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b06f661b0 0x560b07385d00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b06f454d0 0x560b07318370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fcd06e02740 1 --2- 172.21.15.120:0/1523511953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560b06f3d2f0 0x560b07317e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 >> 172.21.15.120:0/1523511953 conn(0x560b06f5a300 msgr2=0x560b07306890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.105+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 shutdown_connections 2024-05-14T09:29:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.106+0000 7fcd06e02740 1 -- 172.21.15.120:0/1523511953 wait complete. 2024-05-14T09:29:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.106+0000 7fcd06e02740 20 client.26023 trim_cache size 0 max 16384 2024-05-14T09:29:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:29:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:29:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:29:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.107+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcce00b28b0 msgr2=0x7fcce00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.107+0000 7fccffe00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcce00b28b0 0x7fcce00b4dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fccf0005fd0 tx=0x7fccf0008340 comp rx=0 tx=0).stop 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.107+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf810a280 msgr2=0x7fccf81a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.107+0000 7fccffe00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf810a280 0x7fccf81a08b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fccec02a8b0 tx=0x7fccec032e70 comp rx=0 tx=0).stop 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.107+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 shutdown_connections 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.108+0000 7fccffe00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fcce00b28b0 0x7fcce00b4dc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.108+0000 7fccffe00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccf81101c0 0x7fccf81a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.108+0000 7fccffe00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccf810b4c0 0x7fccf81a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.108+0000 7fccffe00640 1 --2- 172.21.15.120:0/433267359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccf810a280 0x7fccf81a08b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.108+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 >> 172.21.15.120:0/433267359 conn(0x7fccf8078f10 msgr2=0x7fccf810c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.108+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 shutdown_connections 2024-05-14T09:29:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:23.108+0000 7fccffe00640 1 -- 172.21.15.120:0/433267359 wait complete. 2024-05-14T09:29:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:23 smithi152 ceph-mon[34868]: pgmap v731: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 585 op/s 2024-05-14T09:29:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:23 smithi175 ceph-mon[35353]: pgmap v731: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 585 op/s 2024-05-14T09:29:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 110.0 s, 587.8 tps, lat 169.829 ms stddev 46.442 2024-05-14T09:29:24.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:23 smithi120 ceph-mon[31085]: pgmap v731: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 585 op/s 2024-05-14T09:29:25.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T09:29:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:25 smithi152 ceph-mon[34868]: pgmap v732: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 628 op/s 2024-05-14T09:29:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:25 smithi175 ceph-mon[35353]: pgmap v732: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 628 op/s 2024-05-14T09:29:26.276 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:26.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:25 smithi120 ceph-mon[31085]: pgmap v732: 129 pgs: 129 active+clean; 972 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 628 op/s 2024-05-14T09:29:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:27 smithi152 ceph-mon[34868]: pgmap v733: 129 pgs: 129 active+clean; 972 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 635 op/s 2024-05-14T09:29:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:27 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:29:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:27 smithi175 ceph-mon[35353]: pgmap v733: 129 pgs: 129 active+clean; 972 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 635 op/s 2024-05-14T09:29:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:27 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:29:28.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:27 smithi120 ceph-mon[31085]: pgmap v733: 129 pgs: 129 active+clean; 972 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 635 op/s 2024-05-14T09:29:28.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:28 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:29:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 115.0 s, 511.8 tps, lat 192.772 ms stddev 79.597 2024-05-14T09:29:29.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:29 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:29 smithi120 ceph-mon[31085]: pgmap v734: 129 pgs: 129 active+clean; 972 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 651 op/s 2024-05-14T09:29:29.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:29 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:29 smithi152 ceph-mon[34868]: pgmap v734: 129 pgs: 129 active+clean; 972 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 651 op/s 2024-05-14T09:29:29.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:29 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:29.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:29 smithi175 ceph-mon[35353]: pgmap v734: 129 pgs: 129 active+clean; 972 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 651 op/s 2024-05-14T09:29:30.293 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:29:30.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 -- 172.21.15.120:0/3642702390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c075b60 msgr2=0x7fa81c075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 --2- 172.21.15.120:0/3642702390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c075b60 0x7fa81c075f70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009990 tx=0x7fa80c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 -- 172.21.15.120:0/3642702390 shutdown_connections 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 --2- 172.21.15.120:0/3642702390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81c115370 0x7fa81c117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 --2- 172.21.15.120:0/3642702390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c075b60 0x7fa81c075f70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 --2- 172.21.15.120:0/3642702390 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c0764b0 0x7fa81c114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 -- 172.21.15.120:0/3642702390 >> 172.21.15.120:0/3642702390 conn(0x7fa81c100040 msgr2=0x7fa81c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 -- 172.21.15.120:0/3642702390 shutdown_connections 2024-05-14T09:29:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.561+0000 7fa821200700 1 -- 172.21.15.120:0/3642702390 wait complete. 2024-05-14T09:29:30.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 Processor -- start 2024-05-14T09:29:30.564 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:29:30.564 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 -- start start 2024-05-14T09:29:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c075b60 0x7fa81c1a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c0764b0 0x7fa81c1a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81c115370 0x7fa81c1a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c11a9c0 con 0x7fa81c075b60 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c11a840 con 0x7fa81c115370 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.563+0000 7fa821200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c11ab40 con 0x7fa81c0764b0 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.564+0000 7fa819e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c075b60 0x7fa81c1a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.564+0000 7fa819e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c075b60 0x7fa81c1a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36154/0 (socket says 172.21.15.120:36154) 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.564+0000 7fa819e00700 1 -- 172.21.15.120:0/3843462340 learned_addr learned my addr 172.21.15.120:0/3843462340 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.564+0000 7fa819400700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c0764b0 0x7fa81c1a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa819e00700 1 -- 172.21.15.120:0/3843462340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c0764b0 msgr2=0x7fa81c1a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa819e00700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c0764b0 0x7fa81c1a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa819e00700 1 -- 172.21.15.120:0/3843462340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81c115370 msgr2=0x7fa81c1a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa81a800700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81c115370 0x7fa81c1a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa819e00700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81c115370 0x7fa81c1a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa819e00700 1 -- 172.21.15.120:0/3843462340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c1a6280 con 0x7fa81c075b60 2024-05-14T09:29:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa81a800700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81c115370 0x7fa81c1a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.565+0000 7fa819e00700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c075b60 0x7fa81c1a13b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b650 tx=0x7fa80c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.566+0000 7fa812a00700 1 -- 172.21.15.120:0/3843462340 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c027070 con 0x7fa81c075b60 2024-05-14T09:29:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.566+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c1a6510 con 0x7fa81c075b60 2024-05-14T09:29:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.566+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c1ade90 con 0x7fa81c075b60 2024-05-14T09:29:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.566+0000 7fa812a00700 1 -- 172.21.15.120:0/3843462340 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa80c022470 con 0x7fa81c075b60 2024-05-14T09:29:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.566+0000 7fa812a00700 1 -- 172.21.15.120:0/3843462340 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c017650 con 0x7fa81c075b60 2024-05-14T09:29:30.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.571+0000 7fa812a00700 1 -- 172.21.15.120:0/3843462340 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa80c009d10 con 0x7fa81c075b60 2024-05-14T09:29:30.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.574+0000 7fa82fccbb80 1 Processor -- start 2024-05-14T09:29:30.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.574+0000 7fa82fccbb80 1 -- start start 2024-05-14T09:29:30.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.576+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.576+0000 7fa812a00700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8000b2900 0x7fa8000b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.576+0000 7fa812a00700 1 -- 172.21.15.120:0/3843462340 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa80c0e3160 con 0x7fa81c075b60 2024-05-14T09:29:30.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa81a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c8830 0x55da3f9c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55da3f8e4a20 con 0x55da3f844e40 2024-05-14T09:29:30.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da3f882760 con 0x55da3f9c8830 2024-05-14T09:29:30.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da3f8e09e0 con 0x55da3f9c29f0 2024-05-14T09:29:30.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa81a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36170/0 (socket says 172.21.15.120:36170) 2024-05-14T09:29:30.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.577+0000 7fa81a800700 1 -- 172.21.15.120:0/3176485136 learned_addr learned my addr 172.21.15.120:0/3176485136 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:30.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.578+0000 7fa819e00700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8000b2900 0x7fa8000b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.578+0000 7fa819400700 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c8830 0x55da3f9c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.579+0000 7fa81a800700 1 -- 172.21.15.120:0/3176485136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 msgr2=0x55da3f9c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.579+0000 7fa81a800700 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.579+0000 7fa81a800700 1 -- 172.21.15.120:0/3176485136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c8830 msgr2=0x55da3f9c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.580+0000 7fa81a800700 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c8830 0x55da3f9c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.580+0000 7fa81a800700 1 -- 172.21.15.120:0/3176485136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3f8318d0 con 0x55da3f844e40 2024-05-14T09:29:30.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.580+0000 7fa819e00700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8000b2900 0x7fa8000b4e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c010 tx=0x7fa80c009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:30.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.581+0000 7fa81a800700 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c82f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa814009510 tx=0x7fa8140077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2135eb6bb10eb4f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:30.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.581+0000 7fa807400700 1 -- 172.21.15.120:0/3176485136 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8140155f0 con 0x55da3f844e40 2024-05-14T09:29:30.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.581+0000 7fa807400700 1 -- 172.21.15.120:0/3176485136 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa814015c20 con 0x55da3f844e40 2024-05-14T09:29:30.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.581+0000 7fa807400700 1 -- 172.21.15.120:0/3176485136 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814014a10 con 0x55da3f844e40 2024-05-14T09:29:30.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.584+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3176485136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 msgr2=0x55da3f9c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.584+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c82f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa814009510 tx=0x7fa8140077e0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.584+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3176485136 shutdown_connections 2024-05-14T09:29:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.584+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.584+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c82f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.584+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3176485136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c8830 0x55da3f9c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.584+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3176485136 >> 172.21.15.120:0/3176485136 conn(0x55da3f889f70 msgr2=0x55da3f9bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.585+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3176485136 shutdown_connections 2024-05-14T09:29:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.585+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3176485136 wait complete. 2024-05-14T09:29:30.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.586+0000 7fa82fccbb80 1 -- start start 2024-05-14T09:29:30.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 1 Processor -- start 2024-05-14T09:29:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c8830 0x55da3f9cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55da3f9cf2b0 con 0x55da3f9c8830 2024-05-14T09:29:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da3f84ab20 con 0x55da3f844e40 2024-05-14T09:29:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da3f9cf430 con 0x55da3f9c29f0 2024-05-14T09:29:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.587+0000 7fa82fccbb80 10 client.0 _ll_register_callbacks cb 0x55da3f88bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.589+0000 7fa81a800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.589+0000 7fa81a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c8830 0x55da3f9cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.590+0000 7fa819400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.590+0000 7fa819400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:49064/0 (socket says 172.21.15.120:49064) 2024-05-14T09:29:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.590+0000 7fa819400700 1 -- 172.21.15.120:0/3427448495 learned_addr learned my addr 172.21.15.120:0/3427448495 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:30.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.592+0000 7fa819400700 1 -- 172.21.15.120:0/3427448495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 msgr2=0x55da3f9cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.593+0000 7fa819400700 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.593+0000 7fa819400700 1 -- 172.21.15.120:0/3427448495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c8830 msgr2=0x55da3f9cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.593+0000 7fa819400700 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c8830 0x55da3f9cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.593+0000 7fa819400700 1 -- 172.21.15.120:0/3427448495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da3f8aa420 con 0x55da3f9c29f0 2024-05-14T09:29:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.593+0000 7fa81a800700 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c8830 0x55da3f9cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:30.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.595+0000 7fa819400700 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9cc530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa808012700 tx=0x7fa808012a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491ffeff82bdc5f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:30.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.595+0000 7fa7fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:30.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.595+0000 7fa7fbe00700 1 -- 172.21.15.120:0/3427448495 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa808004260 con 0x55da3f9c29f0 2024-05-14T09:29:30.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.595+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa814015c20 con 0x55da3f9c29f0 2024-05-14T09:29:30.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.596+0000 7fa7fbe00700 1 -- 172.21.15.120:0/3427448495 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa808004400 con 0x55da3f9c29f0 2024-05-14T09:29:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.596+0000 7fa7fbe00700 1 -- 172.21.15.120:0/3427448495 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa808003680 con 0x55da3f9c29f0 2024-05-14T09:29:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.596+0000 7fa82fccbb80 10 client.26032 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.596+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55da3f9d9f60 con 0x55da3f9c29f0 2024-05-14T09:29:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.597+0000 7fa7fbe00700 1 -- 172.21.15.120:0/3427448495 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa814015c20 con 0x55da3f9c29f0 2024-05-14T09:29:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.597+0000 7fa7fbe00700 1 -- 172.21.15.120:0/3427448495 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fa808011a00 con 0x55da3f9c29f0 2024-05-14T09:29:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.597+0000 7fa82fccbb80 10 client.26032 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.598+0000 7fa82fccbb80 10 client.26032 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:29:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.598+0000 7fa82fccbb80 20 client.26032 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.598+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3f9dc5a0 0x55da3f9de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.598+0000 7fa82fccbb80 4 client.26032 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:30.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.598+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da3f98f1c0 con 0x55da3f9dc5a0 2024-05-14T09:29:30.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.599+0000 7fa81a800700 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3f9dc5a0 0x55da3f9de9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.600+0000 7fa7fbe00700 10 client.26032 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:29:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.600+0000 7fa81a800700 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3f9dc5a0 0x55da3f9de9c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=866ae48a0ddb0350 server_cookie=f52f770029a133a2 in_seq=0 out_seq=0 2024-05-14T09:29:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.604+0000 7fa7fbe00700 1 -- 172.21.15.120:0/3427448495 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55da3f98f1c0 con 0x55da3f9dc5a0 2024-05-14T09:29:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.604+0000 7fa7fbe00700 10 client.26032 handle_command_reply: tid=0 2024-05-14T09:29:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.604+0000 7fa82fccbb80 1 client.26032 shutdown 2024-05-14T09:29:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 msgr2=0x55da3f9cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9cc530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa808012700 tx=0x7fa808012a10 comp rx=0 tx=0).stop 2024-05-14T09:29:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 shutdown_connections 2024-05-14T09:29:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3f9dc5a0 0x55da3f9de9c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c8830 0x55da3f9cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/3427448495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c29f0 0x55da3f9cc530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa7fbe00700 0 client.26032 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:29:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.605+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 >> 172.21.15.120:0/3427448495 conn(0x55da3f889f70 msgr2=0x55da3f9c14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.606+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 shutdown_connections 2024-05-14T09:29:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.606+0000 7fa82fccbb80 1 -- 172.21.15.120:0/3427448495 wait complete. 2024-05-14T09:29:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.606+0000 7fa82fccbb80 20 client.26032 trim_cache size 0 max 16384 2024-05-14T09:29:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 Processor -- start 2024-05-14T09:29:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 -- start start 2024-05-14T09:29:30.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c29f0 0x55da3f9c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 0x55da3f9cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc00eb80 con 0x55da3f844e40 2024-05-14T09:29:30.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc010720 con 0x55da3f9c29f0 2024-05-14T09:29:30.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.635+0000 7fa82fccbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc00f250 con 0x55da3f9c8830 2024-05-14T09:29:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.636+0000 7fa81a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.636+0000 7fa81a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36186/0 (socket says 172.21.15.120:36186) 2024-05-14T09:29:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.636+0000 7fa81a800700 1 -- 172.21.15.120:0/653034468 learned_addr learned my addr 172.21.15.120:0/653034468 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.636+0000 7fa81a800700 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 0x55da3f9cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.636+0000 7fa819400700 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c29f0 0x55da3f9c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.637+0000 7fa81a800700 1 -- 172.21.15.120:0/653034468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 msgr2=0x55da3f9cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.637+0000 7fa81a800700 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 0x55da3f9cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.637+0000 7fa81a800700 1 -- 172.21.15.120:0/653034468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c29f0 msgr2=0x55da3f9c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.637+0000 7fa81a800700 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c29f0 0x55da3f9c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.637+0000 7fa81a800700 1 -- 172.21.15.120:0/653034468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3f9ccdf0 con 0x55da3f844e40 2024-05-14T09:29:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.639+0000 7fa81a800700 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c24b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa8140090b0 tx=0x7fa814009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423a79a611286684 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:30.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.641+0000 7fa806a00700 1 -- 172.21.15.120:0/653034468 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814004d10 con 0x55da3f844e40 2024-05-14T09:29:30.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.641+0000 7fa806a00700 1 -- 172.21.15.120:0/653034468 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa81402d070 con 0x55da3f844e40 2024-05-14T09:29:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.641+0000 7fa806a00700 1 -- 172.21.15.120:0/653034468 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814015650 con 0x55da3f844e40 2024-05-14T09:29:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.642+0000 7fa82fccbb80 1 -- 172.21.15.120:0/653034468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 msgr2=0x55da3f9c24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.642+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c24b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa8140090b0 tx=0x7fa814009d40 comp rx=0 tx=0).stop 2024-05-14T09:29:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.642+0000 7fa82fccbb80 1 -- 172.21.15.120:0/653034468 shutdown_connections 2024-05-14T09:29:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.642+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 0x55da3f9cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.642+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f844e40 0x55da3f9c24b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.643+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/653034468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f9c29f0 0x55da3f9c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.643+0000 7fa82fccbb80 1 -- 172.21.15.120:0/653034468 >> 172.21.15.120:0/653034468 conn(0x55da3f889f70 msgr2=0x55da3f9c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.643+0000 7fa82fccbb80 1 -- 172.21.15.120:0/653034468 shutdown_connections 2024-05-14T09:29:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.644+0000 7fa82fccbb80 1 -- 172.21.15.120:0/653034468 wait complete. 2024-05-14T09:29:30.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.645+0000 7fa82fccbb80 1 -- start start 2024-05-14T09:29:30.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.645+0000 7fa82fccbb80 1 Processor -- start 2024-05-14T09:29:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.648+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9d4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.648+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c29f0 0x55da3f9d4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.649+0000 7fa82fccbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 0x55da3f9e3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.649+0000 7fa81a800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9d4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.649+0000 7fa81a800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9d4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:50288/0 (socket says 172.21.15.120:50288) 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.649+0000 7fa81a800700 1 -- 172.21.15.120:0/2188559872 learned_addr learned my addr 172.21.15.120:0/2188559872 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.650+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc010050 con 0x55da3f9c29f0 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.650+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc00f980 con 0x55da3f844e40 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.650+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc00cb40 con 0x55da3f9c8830 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.650+0000 7fa82fccbb80 10 client.0 _ll_register_callbacks cb 0x55da3f88bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.650+0000 7fa819400700 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c29f0 0x55da3f9d4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.651+0000 7fa81a800700 1 -- 172.21.15.120:0/2188559872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 msgr2=0x55da3f9e3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.651+0000 7fa81a800700 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 0x55da3f9e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.651+0000 7fa81a800700 1 -- 172.21.15.120:0/2188559872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c29f0 msgr2=0x55da3f9d4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:30.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.651+0000 7fa81a800700 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c29f0 0x55da3f9d4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.651+0000 7fa81a800700 1 -- 172.21.15.120:0/2188559872 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da3f9e36b0 con 0x55da3f844e40 2024-05-14T09:29:30.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.652+0000 7fa81a800700 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9d4710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa814009e60 tx=0x7fa814004bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4896831000bf78a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.652+0000 7fa7fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:29:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.652+0000 7fa7fbe00700 1 -- 172.21.15.120:0/2188559872 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814015960 con 0x55da3f844e40 2024-05-14T09:29:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.653+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa81402d070 con 0x55da3f844e40 2024-05-14T09:29:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.653+0000 7fa7fbe00700 1 -- 172.21.15.120:0/2188559872 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa814015b00 con 0x55da3f844e40 2024-05-14T09:29:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.654+0000 7fa7fbe00700 1 -- 172.21.15.120:0/2188559872 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa814043050 con 0x55da3f844e40 2024-05-14T09:29:30.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.654+0000 7fa82fccbb80 10 client.35966 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:30.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.654+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55da3fa463b0 con 0x55da3f844e40 2024-05-14T09:29:30.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.656+0000 7fa7fbe00700 1 -- 172.21.15.120:0/2188559872 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa81402d070 con 0x55da3f844e40 2024-05-14T09:29:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.657+0000 7fa7fbe00700 1 -- 172.21.15.120:0/2188559872 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fa814021040 con 0x55da3f844e40 2024-05-14T09:29:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.657+0000 7fa82fccbb80 10 client.35966 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.657+0000 7fa82fccbb80 10 client.35966 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:29:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.657+0000 7fa82fccbb80 20 client.35966 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.657+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3fa466c0 0x55da3fa48ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.657+0000 7fa82fccbb80 4 client.35966 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:29:30.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.657+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da3f8f2400 con 0x55da3fa466c0 2024-05-14T09:29:30.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.658+0000 7fa819400700 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3fa466c0 0x55da3fa48ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:30.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.659+0000 7fa7fbe00700 10 client.35966 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:29:30.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.660+0000 7fa819400700 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3fa466c0 0x55da3fa48ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94326a6ca30aac6b server_cookie=176583e1b5d51efb in_seq=0 out_seq=0 2024-05-14T09:29:30.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.660+0000 7fa7fbe00700 1 -- 172.21.15.120:0/2188559872 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da3f8f2400 con 0x55da3fa466c0 2024-05-14T09:29:30.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.660+0000 7fa7fbe00700 10 client.35966 handle_command_reply: tid=0 2024-05-14T09:29:30.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.660+0000 7fa82fccbb80 1 client.35966 shutdown 2024-05-14T09:29:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 msgr2=0x55da3f9d4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9d4710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa814009e60 tx=0x7fa814004bb0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 shutdown_connections 2024-05-14T09:29:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55da3fa466c0 0x55da3fa48ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da3f844e40 0x55da3f9d4710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da3f9c8830 0x55da3f9e3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 --2- 172.21.15.120:0/2188559872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da3f9c29f0 0x55da3f9d4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 >> 172.21.15.120:0/2188559872 conn(0x55da3f889f70 msgr2=0x55da3f9c5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa7fbe00700 0 client.35966 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:29:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 shutdown_connections 2024-05-14T09:29:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 1 -- 172.21.15.120:0/2188559872 wait complete. 2024-05-14T09:29:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.663+0000 7fa82fccbb80 20 client.35966 trim_cache size 0 max 16384 2024-05-14T09:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:29:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8000b2900 msgr2=0x7fa8000b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8000b2900 0x7fa8000b4e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c010 tx=0x7fa80c009280 comp rx=0 tx=0).stop 2024-05-14T09:29:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c075b60 msgr2=0x7fa81c1a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c075b60 0x7fa81c1a13b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b650 tx=0x7fa80c0047b0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 shutdown_connections 2024-05-14T09:29:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8000b2900 0x7fa8000b4e10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81c115370 0x7fa81c1a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa81c075b60 0x7fa81c1a13b0 secure :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b650 tx=0x7fa80c0047b0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 --2- 172.21.15.120:0/3843462340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa81c0764b0 0x7fa81c1a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.665+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 >> 172.21.15.120:0/3843462340 conn(0x7fa81c100040 msgr2=0x7fa81c1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.666+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 shutdown_connections 2024-05-14T09:29:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:30.666+0000 7fa821200700 1 -- 172.21.15.120:0/3843462340 wait complete. 2024-05-14T09:29:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:29:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:29:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:29:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:29:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:29:31.309 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:31 smithi120 ceph-mon[31085]: pgmap v735: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.4 MiB/s wr, 610 op/s 2024-05-14T09:29:31.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T09:29:31.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:31 smithi152 ceph-mon[34868]: pgmap v735: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.4 MiB/s wr, 610 op/s 2024-05-14T09:29:31.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:31 smithi175 ceph-mon[35353]: pgmap v735: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.4 MiB/s wr, 610 op/s 2024-05-14T09:29:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:33.976 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:33 smithi175 ceph-mon[35353]: pgmap v736: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.6 MiB/s wr, 556 op/s 2024-05-14T09:29:34.005 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:33 smithi120 ceph-mon[31085]: pgmap v736: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.6 MiB/s wr, 556 op/s 2024-05-14T09:29:34.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:33 smithi152 ceph-mon[34868]: pgmap v736: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.6 MiB/s wr, 556 op/s 2024-05-14T09:29:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 120.0 s, 447.9 tps, lat 188.280 ms stddev 79.876 2024-05-14T09:29:35.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.429+0000 7f5e53600700 1 -- 172.21.15.120:0/1591473396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c110970 msgr2=0x7f5e4c110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.429+0000 7f5e53600700 1 --2- 172.21.15.120:0/1591473396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c110970 0x7f5e4c110d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009990 tx=0x7f5e3c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.430+0000 7f5e53600700 1 -- 172.21.15.120:0/1591473396 shutdown_connections 2024-05-14T09:29:35.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.430+0000 7f5e53600700 1 --2- 172.21.15.120:0/1591473396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e4c10b2e0 0x7f5e4c117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.430+0000 7f5e53600700 1 --2- 172.21.15.120:0/1591473396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c110970 0x7f5e4c110d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.430+0000 7f5e53600700 1 --2- 172.21.15.120:0/1591473396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 0x7f5e4c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.430+0000 7f5e53600700 1 -- 172.21.15.120:0/1591473396 >> 172.21.15.120:0/1591473396 conn(0x7f5e4c077c80 msgr2=0x7f5e4c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:35.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.430+0000 7f5e53600700 1 -- 172.21.15.120:0/1591473396 shutdown_connections 2024-05-14T09:29:35.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.430+0000 7f5e53600700 1 -- 172.21.15.120:0/1591473396 wait complete. 2024-05-14T09:29:35.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.432+0000 7f5e53600700 1 Processor -- start 2024-05-14T09:29:35.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.433+0000 7f5e53600700 1 -- start start 2024-05-14T09:29:35.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.433+0000 7f5e53600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 0x7f5e4c1a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.433+0000 7f5e53600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e4c10b2e0 0x7f5e4c1a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.433+0000 7f5e53600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c110970 0x7f5e4c1a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.433+0000 7f5e53600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c11a970 con 0x7f5e4c10b2e0 2024-05-14T09:29:35.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.433+0000 7f5e53600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c11a7f0 con 0x7f5e4c10a990 2024-05-14T09:29:35.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.433+0000 7f5e53600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c11aaf0 con 0x7f5e4c110970 2024-05-14T09:29:35.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.434+0000 7f5e50c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 0x7f5e4c1a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.434+0000 7f5e50c00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 0x7f5e4c1a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:50306/0 (socket says 172.21.15.120:50306) 2024-05-14T09:29:35.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.434+0000 7f5e50c00700 1 -- 172.21.15.120:0/1274210465 learned_addr learned my addr 172.21.15.120:0/1274210465 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:35.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.435+0000 7f5e50c00700 1 -- 172.21.15.120:0/1274210465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c110970 msgr2=0x7f5e4c1a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.435+0000 7f5e50c00700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c110970 0x7f5e4c1a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.435+0000 7f5e50c00700 1 -- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e4c10b2e0 msgr2=0x7f5e4c1a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.435+0000 7f5e4be00700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e4c10b2e0 0x7f5e4c1a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.435+0000 7f5e50c00700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e4c10b2e0 0x7f5e4c1a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.435+0000 7f5e50c00700 1 -- 172.21.15.120:0/1274210465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c1a6350 con 0x7f5e4c10a990 2024-05-14T09:29:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.435+0000 7f5e4be00700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e4c10b2e0 0x7f5e4c1a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.436+0000 7f5e50c00700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 0x7f5e4c1a1480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0047b0 tx=0x7f5e3c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:35.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.436+0000 7f5e49600700 1 -- 172.21.15.120:0/1274210465 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c026070 con 0x7f5e4c10a990 2024-05-14T09:29:35.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.436+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c1a65e0 con 0x7f5e4c10a990 2024-05-14T09:29:35.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.436+0000 7f5e49600700 1 -- 172.21.15.120:0/1274210465 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e3c021410 con 0x7f5e4c10a990 2024-05-14T09:29:35.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.436+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c1adf60 con 0x7f5e4c10a990 2024-05-14T09:29:35.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.437+0000 7f5e49600700 1 -- 172.21.15.120:0/1274210465 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c017650 con 0x7f5e4c10a990 2024-05-14T09:29:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.444+0000 7f5e49600700 1 -- 172.21.15.120:0/1274210465 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5e3c029070 con 0x7f5e4c10a990 2024-05-14T09:29:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.446+0000 7f5e49600700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5e340b2900 0x7f5e340b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.446+0000 7f5e49600700 1 -- 172.21.15.120:0/1274210465 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5e3c0e35e0 con 0x7f5e4c10a990 2024-05-14T09:29:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.447+0000 7f5e4be00700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5e340b2900 0x7f5e340b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.450+0000 7f5e4be00700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5e340b2900 0x7f5e340b4e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c07b210 tx=0x7f5e40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.450+0000 7f5e62162b80 1 Processor -- start 2024-05-14T09:29:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.451+0000 7f5e62162b80 1 -- start start 2024-05-14T09:29:35.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.453+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8c3ee40 0x5630e8dc26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.453+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.453+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.453+0000 7f5e62162b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5630e8cdea20 con 0x5630e8dbcc50 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.453+0000 7f5e62162b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5630e8c7c760 con 0x5630e8dc2bf0 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.453+0000 7f5e62162b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5630e8cda9e0 con 0x5630e8c3ee40 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36222/0 (socket says 172.21.15.120:36222) 2024-05-14T09:29:35.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 -- 172.21.15.120:0/3296350368 learned_addr learned my addr 172.21.15.120:0/3296350368 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e4be00700 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 -- 172.21.15.120:0/3296350368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8c3ee40 msgr2=0x5630e8dc26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8c3ee40 0x5630e8dc26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 -- 172.21.15.120:0/3296350368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 msgr2=0x5630e8dbc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e51600700 1 -- 172.21.15.120:0/3296350368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8c2b8d0 con 0x5630e8dbcc50 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.454+0000 7f5e4be00700 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:35.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.455+0000 7f5e51600700 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbd060 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400e3e0 tx=0x7f5e4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b819cb486a9b25 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:35.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.455+0000 7f5e3a000700 1 -- 172.21.15.120:0/3296350368 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44004bb0 con 0x5630e8dbcc50 2024-05-14T09:29:35.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.456+0000 7f5e3a000700 1 -- 172.21.15.120:0/3296350368 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e44004d50 con 0x5630e8dbcc50 2024-05-14T09:29:35.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.456+0000 7f5e3a000700 1 -- 172.21.15.120:0/3296350368 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44004240 con 0x5630e8dbcc50 2024-05-14T09:29:35.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.457+0000 7f5e62162b80 1 -- 172.21.15.120:0/3296350368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 msgr2=0x5630e8dbd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.457+0000 7f5e62162b80 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbd060 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400e3e0 tx=0x7f5e4400b040 comp rx=0 tx=0).stop 2024-05-14T09:29:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.459+0000 7f5e62162b80 1 -- 172.21.15.120:0/3296350368 shutdown_connections 2024-05-14T09:29:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.459+0000 7f5e62162b80 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbd060 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.459+0000 7f5e62162b80 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8c3ee40 0x5630e8dc26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.459+0000 7f5e62162b80 1 --2- 172.21.15.120:0/3296350368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.459+0000 7f5e62162b80 1 -- 172.21.15.120:0/3296350368 >> 172.21.15.120:0/3296350368 conn(0x5630e8c7da80 msgr2=0x5630e8db7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.459+0000 7f5e62162b80 1 -- 172.21.15.120:0/3296350368 shutdown_connections 2024-05-14T09:29:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.459+0000 7f5e62162b80 1 -- 172.21.15.120:0/3296350368 wait complete. 2024-05-14T09:29:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.460+0000 7f5e62162b80 1 -- start start 2024-05-14T09:29:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.461+0000 7f5e62162b80 1 Processor -- start 2024-05-14T09:29:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.461+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8c3ee40 0x5630e8dc6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.462+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dbcc50 0x5630e8dc6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.462+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.462+0000 7f5e62162b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5630e8dc9660 con 0x5630e8c3ee40 2024-05-14T09:29:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.462+0000 7f5e62162b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5630e8c44b20 con 0x5630e8dc2bf0 2024-05-14T09:29:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.462+0000 7f5e62162b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5630e8dc97e0 con 0x5630e8dbcc50 2024-05-14T09:29:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.462+0000 7f5e62162b80 10 client.0 _ll_register_callbacks cb 0x5630e8c72380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.463+0000 7f5e50c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8c3ee40 0x5630e8dc6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.463+0000 7f5e50c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8c3ee40 0x5630e8dc6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36232/0 (socket says 172.21.15.120:36232) 2024-05-14T09:29:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.463+0000 7f5e50c00700 1 -- 172.21.15.120:0/2795769966 learned_addr learned my addr 172.21.15.120:0/2795769966 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:35.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.463+0000 7f5e4be00700 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dbcc50 0x5630e8dc6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.463+0000 7f5e51600700 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.464+0000 7f5e50c00700 1 -- 172.21.15.120:0/2795769966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dbcc50 msgr2=0x5630e8dc6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.464+0000 7f5e50c00700 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dbcc50 0x5630e8dc6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.464+0000 7f5e50c00700 1 -- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 msgr2=0x5630e8dc6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.464+0000 7f5e50c00700 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.464+0000 7f5e50c00700 1 -- 172.21.15.120:0/2795769966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e8ca4420 con 0x5630e8c3ee40 2024-05-14T09:29:35.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.465+0000 7f5e50c00700 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8c3ee40 0x5630e8dc6440 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c000c00 tx=0x7f5e3c0aa0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff12b5124e5754 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:35.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.465+0000 7f5e2ea00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:35.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.466+0000 7f5e2ea00700 1 -- 172.21.15.120:0/2795769966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0aa890 con 0x5630e8c3ee40 2024-05-14T09:29:35.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.466+0000 7f5e2ea00700 1 -- 172.21.15.120:0/2795769966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5e3c0a6e80 con 0x5630e8c3ee40 2024-05-14T09:29:35.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.467+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e44004d50 con 0x5630e8c3ee40 2024-05-14T09:29:35.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.467+0000 7f5e2ea00700 1 -- 172.21.15.120:0/2795769966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f5e3c0aec40 con 0x5630e8c3ee40 2024-05-14T09:29:35.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.467+0000 7f5e62162b80 10 client.16485 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:35.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.467+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5630e8dd4250 con 0x5630e8c3ee40 2024-05-14T09:29:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e2ea00700 1 -- 172.21.15.120:0/2795769966 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e44004d50 con 0x5630e8c3ee40 2024-05-14T09:29:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e2ea00700 1 -- 172.21.15.120:0/2795769966 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f5e3c0aaaf0 con 0x5630e8c3ee40 2024-05-14T09:29:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e62162b80 10 client.16485 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e62162b80 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e62162b80 20 client.16485 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e62162b80 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8dd6770 0x5630e8dd8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e62162b80 4 client.16485 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.468+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630e8d89070 con 0x5630e8dd6770 2024-05-14T09:29:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.469+0000 7f5e4be00700 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8dd6770 0x5630e8dd8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.470+0000 7f5e4be00700 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8dd6770 0x5630e8dd8be0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82d5809d12c0f89 server_cookie=fd07ce7e22f041c0 in_seq=0 out_seq=0 2024-05-14T09:29:35.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.470+0000 7f5e2ea00700 10 client.16485 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:35.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.472+0000 7f5e2ea00700 1 -- 172.21.15.120:0/2795769966 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5630e8d89070 con 0x5630e8dd6770 2024-05-14T09:29:35.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.472+0000 7f5e2ea00700 10 client.16485 handle_command_reply: tid=0 2024-05-14T09:29:35.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 client.16485 shutdown 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8c3ee40 msgr2=0x5630e8dc6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8c3ee40 0x5630e8dc6440 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c000c00 tx=0x7f5e3c0aa0f0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 shutdown_connections 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8dd6770 0x5630e8dd8be0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8c3ee40 0x5630e8dc6440 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 --2- 172.21.15.120:0/2795769966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dbcc50 0x5630e8dc6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 >> 172.21.15.120:0/2795769966 conn(0x5630e8c7da80 msgr2=0x5630e8dbb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.473+0000 7f5e2ea00700 0 client.16485 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.474+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 shutdown_connections 2024-05-14T09:29:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.474+0000 7f5e62162b80 1 -- 172.21.15.120:0/2795769966 wait complete. 2024-05-14T09:29:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.474+0000 7f5e62162b80 20 client.16485 trim_cache size 0 max 16384 2024-05-14T09:29:35.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.503+0000 7f5e62162b80 1 Processor -- start 2024-05-14T09:29:35.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.503+0000 7f5e62162b80 1 -- start start 2024-05-14T09:29:35.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dbcc50 0x5630e8dbc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dd26b0 0x5630e8dc07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e62162b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c1b69c0 con 0x5630e8dc2bf0 2024-05-14T09:29:35.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e62162b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c1b8560 con 0x5630e8dbcc50 2024-05-14T09:29:35.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e62162b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c1b7090 con 0x5630e8dd26b0 2024-05-14T09:29:35.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e4be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e4be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36238/0 (socket says 172.21.15.120:36238) 2024-05-14T09:29:35.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e4be00700 1 -- 172.21.15.120:0/782011721 learned_addr learned my addr 172.21.15.120:0/782011721 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:35.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.505+0000 7f5e4be00700 1 -- 172.21.15.120:0/782011721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dd26b0 msgr2=0x5630e8dc07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.505+0000 7f5e4be00700 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dd26b0 0x5630e8dc07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.505+0000 7f5e4be00700 1 -- 172.21.15.120:0/782011721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dbcc50 msgr2=0x5630e8dbc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.504+0000 7f5e50c00700 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dbcc50 0x5630e8dbc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.505+0000 7f5e4be00700 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dbcc50 0x5630e8dbc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.505+0000 7f5e4be00700 1 -- 172.21.15.120:0/782011721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8dc49b0 con 0x5630e8dc2bf0 2024-05-14T09:29:35.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.505+0000 7f5e50c00700 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dbcc50 0x5630e8dbc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:35.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.506+0000 7f5e4be00700 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc5760 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009fd0 tx=0x7f5e40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a799ebeeb63bf78c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:35.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.506+0000 7f5e39600700 1 -- 172.21.15.120:0/782011721 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4002e070 con 0x5630e8dc2bf0 2024-05-14T09:29:35.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.506+0000 7f5e39600700 1 -- 172.21.15.120:0/782011721 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e400044c0 con 0x5630e8dc2bf0 2024-05-14T09:29:35.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.506+0000 7f5e39600700 1 -- 172.21.15.120:0/782011721 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40028760 con 0x5630e8dc2bf0 2024-05-14T09:29:35.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 -- 172.21.15.120:0/782011721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dc2bf0 msgr2=0x5630e8dc5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc5760 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009fd0 tx=0x7f5e40016000 comp rx=0 tx=0).stop 2024-05-14T09:29:35.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 -- 172.21.15.120:0/782011721 shutdown_connections 2024-05-14T09:29:35.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dbcc50 0x5630e8dbc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dd26b0 0x5630e8dc07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 --2- 172.21.15.120:0/782011721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dc2bf0 0x5630e8dc5760 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 -- 172.21.15.120:0/782011721 >> 172.21.15.120:0/782011721 conn(0x5630e8c7da80 msgr2=0x5630e8dc00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:35.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 -- 172.21.15.120:0/782011721 shutdown_connections 2024-05-14T09:29:35.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.508+0000 7f5e62162b80 1 -- 172.21.15.120:0/782011721 wait complete. 2024-05-14T09:29:35.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.509+0000 7f5e62162b80 1 -- start start 2024-05-14T09:29:35.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.509+0000 7f5e62162b80 1 Processor -- start 2024-05-14T09:29:35.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e62162b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dd26b0 0x5630e8dbc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e62162b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c1b7e90 con 0x5630e8dbcc50 2024-05-14T09:29:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e62162b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c1b77c0 con 0x5630e8dd26b0 2024-05-14T09:29:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e62162b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c1b4980 con 0x5630e8dc2bf0 2024-05-14T09:29:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e62162b80 10 client.0 _ll_register_callbacks cb 0x5630e8c72380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e50c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e50c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36252/0 (socket says 172.21.15.120:36252) 2024-05-14T09:29:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.511+0000 7f5e51600700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dd26b0 0x5630e8dbc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.510+0000 7f5e50c00700 1 -- 172.21.15.120:0/1826315036 learned_addr learned my addr 172.21.15.120:0/1826315036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:35.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.512+0000 7f5e4be00700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.514+0000 7f5e51600700 1 -- 172.21.15.120:0/1826315036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dc2bf0 msgr2=0x5630e8dbc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.514+0000 7f5e51600700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.514+0000 7f5e51600700 1 -- 172.21.15.120:0/1826315036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 msgr2=0x5630e8dbbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:35.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.514+0000 7f5e51600700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.514+0000 7f5e51600700 1 -- 172.21.15.120:0/1826315036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e8e40090 con 0x5630e8dd26b0 2024-05-14T09:29:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.514+0000 7f5e50c00700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.514+0000 7f5e4be00700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.515+0000 7f5e51600700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dd26b0 0x5630e8dbc580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5630e8dd2ae0 tx=0x7f5e44009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10a46c1ef307cde server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.515+0000 7f5e2ea00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:29:35.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.515+0000 7f5e2ea00700 1 -- 172.21.15.120:0/1826315036 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44022030 con 0x5630e8dd26b0 2024-05-14T09:29:35.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.515+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e400044c0 con 0x5630e8dd26b0 2024-05-14T09:29:35.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.516+0000 7f5e2ea00700 1 -- 172.21.15.120:0/1826315036 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5e44019040 con 0x5630e8dd26b0 2024-05-14T09:29:35.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.516+0000 7f5e2ea00700 1 -- 172.21.15.120:0/1826315036 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f5e4402f050 con 0x5630e8dd26b0 2024-05-14T09:29:35.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.517+0000 7f5e62162b80 10 client.35978 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:35.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.517+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5630e8e41260 con 0x5630e8dd26b0 2024-05-14T09:29:35.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e2ea00700 1 -- 172.21.15.120:0/1826315036 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e400044c0 con 0x5630e8dd26b0 2024-05-14T09:29:35.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e2ea00700 1 -- 172.21.15.120:0/1826315036 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f5e440294e0 con 0x5630e8dd26b0 2024-05-14T09:29:35.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e62162b80 10 client.35978 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:35.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e62162b80 10 client.35978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:35.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e62162b80 20 client.35978 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:35.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e62162b80 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8e415f0 0x5630e8e43a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:35.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e62162b80 4 client.35978 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:29:35.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.518+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630e8cec400 con 0x5630e8e415f0 2024-05-14T09:29:35.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.519+0000 7f5e50c00700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8e415f0 0x5630e8e43a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:35.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.521+0000 7f5e2ea00700 10 client.35978 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:35.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.521+0000 7f5e50c00700 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8e415f0 0x5630e8e43a10 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d998dd8f1f93e9ac server_cookie=30a9a87ce2436059 in_seq=0 out_seq=0 2024-05-14T09:29:35.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.522+0000 7f5e2ea00700 1 -- 172.21.15.120:0/1826315036 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630e8cec400 con 0x5630e8e415f0 2024-05-14T09:29:35.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.522+0000 7f5e2ea00700 10 client.35978 handle_command_reply: tid=0 2024-05-14T09:29:35.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.522+0000 7f5e62162b80 1 client.35978 shutdown 2024-05-14T09:29:35.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.522+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dd26b0 msgr2=0x5630e8dbc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.522+0000 7f5e62162b80 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dd26b0 0x5630e8dbc580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5630e8dd2ae0 tx=0x7f5e44009920 comp rx=0 tx=0).stop 2024-05-14T09:29:35.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.522+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 shutdown_connections 2024-05-14T09:29:35.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.523+0000 7f5e62162b80 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5630e8e415f0 0x5630e8e43a10 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.523+0000 7f5e62162b80 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630e8dd26b0 0x5630e8dbc580 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.523+0000 7f5e62162b80 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630e8dbcc50 0x5630e8dbbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.523+0000 7f5e62162b80 1 --2- 172.21.15.120:0/1826315036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630e8dc2bf0 0x5630e8dbc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.523+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 >> 172.21.15.120:0/1826315036 conn(0x5630e8c7da80 msgr2=0x5630e8dc54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:35.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.523+0000 7f5e2ea00700 0 client.35978 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:35.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.523+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 shutdown_connections 2024-05-14T09:29:35.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.524+0000 7f5e62162b80 1 -- 172.21.15.120:0/1826315036 wait complete. 2024-05-14T09:29:35.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.524+0000 7f5e62162b80 20 client.35978 trim_cache size 0 max 16384 2024-05-14T09:29:35.524 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:29:35.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.525+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5e340b2900 msgr2=0x7f5e340b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5e340b2900 0x7f5e340b4e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c07b210 tx=0x7f5e40009260 comp rx=0 tx=0).stop 2024-05-14T09:29:35.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 msgr2=0x7f5e4c1a1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:35.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 0x7f5e4c1a1480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0047b0 tx=0x7f5e3c005e80 comp rx=0 tx=0).stop 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 shutdown_connections 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f5e340b2900 0x7f5e340b4e10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e4c10a990 0x7f5e4c1a1480 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c110970 0x7f5e4c1a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 --2- 172.21.15.120:0/1274210465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e4c10b2e0 0x7f5e4c1a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 >> 172.21.15.120:0/1274210465 conn(0x7f5e4c077c80 msgr2=0x7f5e4c07bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 shutdown_connections 2024-05-14T09:29:35.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:35.526+0000 7f5e53600700 1 -- 172.21.15.120:0/1274210465 wait complete. 2024-05-14T09:29:35.723 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:35 smithi120 ceph-mon[31085]: pgmap v737: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.6 MiB/s wr, 621 op/s 2024-05-14T09:29:35.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:35 smithi175 ceph-mon[35353]: pgmap v737: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.6 MiB/s wr, 621 op/s 2024-05-14T09:29:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:35 smithi152 ceph-mon[34868]: pgmap v737: 129 pgs: 129 active+clean; 972 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.6 MiB/s wr, 621 op/s 2024-05-14T09:29:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.472+0000 7f2d2ea00640 1 -- 172.21.15.120:0/1076272914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28106eb0 msgr2=0x7f2d281092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.472+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/1076272914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28106eb0 0x7f2d281092d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400dc90 tx=0x7f2d1402e370 comp rx=0 tx=0).stop 2024-05-14T09:29:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.473+0000 7f2d2ea00640 1 -- 172.21.15.120:0/1076272914 shutdown_connections 2024-05-14T09:29:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.473+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/1076272914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d28109810 0x7f2d2810bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.473+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/1076272914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28106eb0 0x7f2d281092d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.473+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/1076272914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28104550 0x7f2d28106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.473+0000 7f2d2ea00640 1 -- 172.21.15.120:0/1076272914 >> 172.21.15.120:0/1076272914 conn(0x7f2d280fdb50 msgr2=0x7f2d28100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:36.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.475+0000 7f2d2ea00640 1 -- 172.21.15.120:0/1076272914 shutdown_connections 2024-05-14T09:29:36.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.475+0000 7f2d2ea00640 1 -- 172.21.15.120:0/1076272914 wait complete. 2024-05-14T09:29:36.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.477+0000 7f2d2ea00640 1 Processor -- start 2024-05-14T09:29:36.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.477+0000 7f2d2ea00640 1 -- start start 2024-05-14T09:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.478+0000 7f2d2ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28104550 0x7f2d28197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.478+0000 7f2d2ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28106eb0 0x7f2d281983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.478+0000 7f2d2ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d28109810 0x7f2d2819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.478+0000 7f2d2ea00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2810d290 con 0x7f2d28106eb0 2024-05-14T09:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.478+0000 7f2d2ea00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2810d110 con 0x7f2d28109810 2024-05-14T09:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.478+0000 7f2d2ea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2810d410 con 0x7f2d28104550 2024-05-14T09:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.478+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28106eb0 0x7f2d281983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.479+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28106eb0 0x7f2d281983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36260/0 (socket says 172.21.15.120:36260) 2024-05-14T09:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.479+0000 7f2d2cc00640 1 -- 172.21.15.120:0/3620531420 learned_addr learned my addr 172.21.15.120:0/3620531420 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.479+0000 7f2d2e000640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d28109810 0x7f2d2819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.480+0000 7f2d2d600640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28104550 0x7f2d28197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.480+0000 7f2d2cc00640 1 -- 172.21.15.120:0/3620531420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28104550 msgr2=0x7f2d28197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.480+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28104550 0x7f2d28197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.480+0000 7f2d2cc00640 1 -- 172.21.15.120:0/3620531420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d28109810 msgr2=0x7f2d2819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.480+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d28109810 0x7f2d2819f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.480+0000 7f2d2cc00640 1 -- 172.21.15.120:0/3620531420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2819f9a0 con 0x7f2d28106eb0 2024-05-14T09:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.481+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28106eb0 0x7f2d281983a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2d14000c00 tx=0x7f2d14004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:36.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.482+0000 7f2d26000640 1 -- 172.21.15.120:0/3620531420 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140051d0 con 0x7f2d28106eb0 2024-05-14T09:29:36.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.482+0000 7f2d26000640 1 -- 172.21.15.120:0/3620531420 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d14044070 con 0x7f2d28106eb0 2024-05-14T09:29:36.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.483+0000 7f2d26000640 1 -- 172.21.15.120:0/3620531420 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1403f940 con 0x7f2d28106eb0 2024-05-14T09:29:36.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.483+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2819fc30 con 0x7f2d28106eb0 2024-05-14T09:29:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.484+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d281a00d0 con 0x7f2d28106eb0 2024-05-14T09:29:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.492+0000 7f2d26000640 1 -- 172.21.15.120:0/3620531420 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f2d1400bc10 con 0x7f2d28106eb0 2024-05-14T09:29:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.492+0000 7f2d3700e740 1 Processor -- start 2024-05-14T09:29:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.494+0000 7f2d3700e740 1 -- start start 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.496+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb639f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.496+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb639f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.496+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.496+0000 7f2d3700e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559cb6303550 con 0x559cb5ffd1b0 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.496+0000 7f2d3700e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559cb62a8bc0 con 0x559cb5fd42f0 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.496+0000 7f2d3700e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559cb62ff510 con 0x559cb5fdc4d0 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.497+0000 7f2d2e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb639f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.497+0000 7f2d2e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb639f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36276/0 (socket says 172.21.15.120:36276) 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.497+0000 7f2d2e000640 1 -- 172.21.15.120:0/4190785537 learned_addr learned my addr 172.21.15.120:0/4190785537 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.497+0000 7f2d2d600640 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb639f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.498+0000 7f2d26000640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2d100b2830 0x7f2d100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.498+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.498+0000 7f2d2e000640 1 -- 172.21.15.120:0/4190785537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 msgr2=0x559cb63a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.498+0000 7f2d2e000640 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63a67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.499+0000 7f2d2e000640 1 -- 172.21.15.120:0/4190785537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 msgr2=0x559cb639f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.499+0000 7f2d2e000640 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb639f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.499+0000 7f2d2e000640 1 -- 172.21.15.120:0/4190785537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cb6015210 con 0x559cb5ffd1b0 2024-05-14T09:29:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.499+0000 7f2d2d600640 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb639f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.499+0000 7f2d26000640 1 -- 172.21.15.120:0/3620531420 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2d14106110 con 0x7f2d28106eb0 2024-05-14T09:29:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.500+0000 7f2d2e000640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2d100b2830 0x7f2d100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.501+0000 7f2d2e000640 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb639f330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009ef0 tx=0x7f2d2000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1b25afc422b5d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.502+0000 7f2d1a600640 1 -- 172.21.15.120:0/4190785537 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20021070 con 0x559cb5ffd1b0 2024-05-14T09:29:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.503+0000 7f2d1a600640 1 -- 172.21.15.120:0/4190785537 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d2001b410 con 0x559cb5ffd1b0 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.504+0000 7f2d1a600640 1 -- 172.21.15.120:0/4190785537 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20015070 con 0x559cb5ffd1b0 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.504+0000 7f2d3700e740 1 -- 172.21.15.120:0/4190785537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 msgr2=0x559cb639f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.504+0000 7f2d3700e740 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb639f330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009ef0 tx=0x7f2d2000f730 comp rx=0 tx=0).stop 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d2e000640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2d100b2830 0x7f2d100b4d40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001e000 tx=0x7f2d20010b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d3700e740 1 -- 172.21.15.120:0/4190785537 shutdown_connections 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d3700e740 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d3700e740 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb639f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d3700e740 1 --2- 172.21.15.120:0/4190785537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb639f330 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d3700e740 1 -- 172.21.15.120:0/4190785537 >> 172.21.15.120:0/4190785537 conn(0x559cb5ff1300 msgr2=0x559cb639acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d3700e740 1 -- 172.21.15.120:0/4190785537 shutdown_connections 2024-05-14T09:29:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.505+0000 7f2d3700e740 1 -- 172.21.15.120:0/4190785537 wait complete. 2024-05-14T09:29:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.506+0000 7f2d3700e740 1 -- start start 2024-05-14T09:29:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.507+0000 7f2d3700e740 1 Processor -- start 2024-05-14T09:29:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.508+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.508+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.508+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb63b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.508+0000 7f2d3700e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559cb63afab0 con 0x559cb5fdc4d0 2024-05-14T09:29:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.508+0000 7f2d3700e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559cb62bc660 con 0x559cb5ffd1b0 2024-05-14T09:29:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.508+0000 7f2d3700e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559cb63afc30 con 0x559cb5fd42f0 2024-05-14T09:29:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.508+0000 7f2d3700e740 10 client.0 _ll_register_callbacks cb 0x559cb6286400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.510+0000 7f2d2d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.510+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.510+0000 7f2d2d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:49178/0 (socket says 172.21.15.120:49178) 2024-05-14T09:29:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.510+0000 7f2d2d600640 1 -- 172.21.15.120:0/3582763753 learned_addr learned my addr 172.21.15.120:0/3582763753 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.510+0000 7f2d2e000640 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb63b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.511+0000 7f2d2cc00640 1 -- 172.21.15.120:0/3582763753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 msgr2=0x559cb63b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.511+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.511+0000 7f2d2cc00640 1 -- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 msgr2=0x559cb63b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.511+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb63b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.511+0000 7f2d2cc00640 1 -- 172.21.15.120:0/3582763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cb60e1620 con 0x559cb5fdc4d0 2024-05-14T09:29:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.512+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b1af0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2d141038c0 tx=0x7f2d140ccda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3495d90fe164a7dd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.512+0000 7f2d0ea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.513+0000 7f2d0ea00640 1 -- 172.21.15.120:0/3582763753 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140cd390 con 0x559cb5fdc4d0 2024-05-14T09:29:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.513+0000 7f2d0ea00640 1 -- 172.21.15.120:0/3582763753 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2d140d5f70 con 0x559cb5fdc4d0 2024-05-14T09:29:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.513+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d2001b410 con 0x559cb5fdc4d0 2024-05-14T09:29:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.513+0000 7f2d0ea00640 1 -- 172.21.15.120:0/3582763753 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2d140d1740 con 0x559cb5fdc4d0 2024-05-14T09:29:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.513+0000 7f2d3700e740 10 client.16503 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.513+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559cb63bb980 con 0x559cb5fdc4d0 2024-05-14T09:29:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.514+0000 7f2d0ea00640 1 -- 172.21.15.120:0/3582763753 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d2001b410 con 0x559cb5fdc4d0 2024-05-14T09:29:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.514+0000 7f2d0ea00640 1 -- 172.21.15.120:0/3582763753 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f2d1403fc70 con 0x559cb5fdc4d0 2024-05-14T09:29:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.515+0000 7f2d3700e740 10 client.16503 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.515+0000 7f2d3700e740 10 client.16503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.515+0000 7f2d3700e740 20 client.16503 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.515+0000 7f2d3700e740 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5fbbd80 0x559cb63bf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.515+0000 7f2d3700e740 4 client.16503 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.515+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cb6311160 con 0x559cb5fbbd80 2024-05-14T09:29:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.516+0000 7f2d2d600640 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5fbbd80 0x559cb63bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.518+0000 7f2d2d600640 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5fbbd80 0x559cb63bf290 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=608683e13c5fed4b server_cookie=cfa4aa2ec8b2a411 in_seq=0 out_seq=0 2024-05-14T09:29:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.518+0000 7f2d0ea00640 10 client.16503 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:36.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.521+0000 7f2d0ea00640 1 -- 172.21.15.120:0/3582763753 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559cb6311160 con 0x559cb5fbbd80 2024-05-14T09:29:36.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.521+0000 7f2d0ea00640 10 client.16503 handle_command_reply: tid=0 2024-05-14T09:29:36.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.521+0000 7f2d3700e740 1 client.16503 shutdown 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.521+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 msgr2=0x559cb63b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.521+0000 7f2d3700e740 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b1af0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2d141038c0 tx=0x7f2d140ccda0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 shutdown_connections 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5fbbd80 0x559cb63bf290 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb63b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b1af0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 --2- 172.21.15.120:0/3582763753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 >> 172.21.15.120:0/3582763753 conn(0x559cb5ff1300 msgr2=0x559cb639dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:36.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d0ea00640 0 client.16503 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:36.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 shutdown_connections 2024-05-14T09:29:36.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.522+0000 7f2d3700e740 1 -- 172.21.15.120:0/3582763753 wait complete. 2024-05-14T09:29:36.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.523+0000 7f2d3700e740 20 client.16503 trim_cache size 0 max 16384 2024-05-14T09:29:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.557+0000 7f2d3700e740 1 Processor -- start 2024-05-14T09:29:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.558+0000 7f2d3700e740 1 -- start start 2024-05-14T09:29:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.559+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb63a3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.559+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.559+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb63a3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.560+0000 7f2d3700e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281aa7a0 con 0x559cb5ffd1b0 2024-05-14T09:29:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.560+0000 7f2d3700e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281ac340 con 0x559cb5fd42f0 2024-05-14T09:29:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.560+0000 7f2d3700e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281aae70 con 0x559cb5fdc4d0 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.560+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:49188/0 (socket says 172.21.15.120:49188) 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2cc00640 1 -- 172.21.15.120:0/1288858728 learned_addr learned my addr 172.21.15.120:0/1288858728 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2e000640 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb63a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2e000640 1 -- 172.21.15.120:0/1288858728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 msgr2=0x559cb63b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2e000640 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2e000640 1 -- 172.21.15.120:0/1288858728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 msgr2=0x559cb63a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2e000640 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb63a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.561+0000 7f2d2e000640 1 -- 172.21.15.120:0/1288858728 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cb63964a0 con 0x559cb5ffd1b0 2024-05-14T09:29:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.562+0000 7f2d2e000640 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb63a3650 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001f040 tx=0x7f2d20025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9d5487dbbc685e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.563+0000 7f2d19c00640 1 -- 172.21.15.120:0/1288858728 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20036070 con 0x559cb5ffd1b0 2024-05-14T09:29:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.563+0000 7f2d19c00640 1 -- 172.21.15.120:0/1288858728 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d20004e10 con 0x559cb5ffd1b0 2024-05-14T09:29:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.563+0000 7f2d19c00640 1 -- 172.21.15.120:0/1288858728 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20021070 con 0x559cb5ffd1b0 2024-05-14T09:29:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.564+0000 7f2d3700e740 1 -- 172.21.15.120:0/1288858728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 msgr2=0x559cb63a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.564+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb63a3650 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001f040 tx=0x7f2d20025000 comp rx=0 tx=0).stop 2024-05-14T09:29:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.565+0000 7f2d3700e740 1 -- 172.21.15.120:0/1288858728 shutdown_connections 2024-05-14T09:29:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.565+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5ffd1b0 0x559cb63a3650 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.565+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.565+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1288858728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5fd42f0 0x559cb63a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.565+0000 7f2d3700e740 1 -- 172.21.15.120:0/1288858728 >> 172.21.15.120:0/1288858728 conn(0x559cb5ff1300 msgr2=0x559cb63b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.565+0000 7f2d3700e740 1 -- 172.21.15.120:0/1288858728 shutdown_connections 2024-05-14T09:29:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.566+0000 7f2d3700e740 1 -- 172.21.15.120:0/1288858728 wait complete. 2024-05-14T09:29:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.566+0000 7f2d3700e740 1 -- start start 2024-05-14T09:29:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.568+0000 7f2d3700e740 1 Processor -- start 2024-05-14T09:29:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d3700e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb6425ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d3700e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281abc70 con 0x559cb5fdc4d0 2024-05-14T09:29:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d3700e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281ab5a0 con 0x559cb5ffd1b0 2024-05-14T09:29:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d3700e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281a8760 con 0x559cb5fd42f0 2024-05-14T09:29:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d3700e740 10 client.0 _ll_register_callbacks cb 0x7f2d140057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36294/0 (socket says 172.21.15.120:36294) 2024-05-14T09:29:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.569+0000 7f2d2cc00640 1 -- 172.21.15.120:0/1886065046 learned_addr learned my addr 172.21.15.120:0/1886065046 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.571+0000 7f2d2e000640 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb6425ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d2cc00640 1 -- 172.21.15.120:0/1886065046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 msgr2=0x559cb63b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d2cc00640 1 -- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 msgr2=0x559cb6425ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb6425ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d2cc00640 1 -- 172.21.15.120:0/1886065046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cb639b260 con 0x559cb5fdc4d0 2024-05-14T09:29:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d2cc00640 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8560 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2d14103be0 tx=0x7f2d140cce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b736bde1790010ce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d0ea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.572+0000 7f2d0ea00640 1 -- 172.21.15.120:0/1886065046 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140d1740 con 0x559cb5fdc4d0 2024-05-14T09:29:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.573+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d20004e10 con 0x559cb5fdc4d0 2024-05-14T09:29:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.573+0000 7f2d2e000640 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb6425ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.573+0000 7f2d0ea00640 1 -- 172.21.15.120:0/1886065046 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f2d140cb2e0 con 0x559cb5fdc4d0 2024-05-14T09:29:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.573+0000 7f2d0ea00640 1 -- 172.21.15.120:0/1886065046 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2d140ca790 con 0x559cb5fdc4d0 2024-05-14T09:29:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.573+0000 7f2d3700e740 10 client.16509 fetch_fsmap learned FSMap version 41 2024-05-14T09:29:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.573+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559cb63a81a0 con 0x559cb5fdc4d0 2024-05-14T09:29:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d0ea00640 1 -- 172.21.15.120:0/1886065046 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d140ca790 con 0x559cb5fdc4d0 2024-05-14T09:29:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d0ea00640 1 -- 172.21.15.120:0/1886065046 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f2d1403fc70 con 0x559cb5fdc4d0 2024-05-14T09:29:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d3700e740 10 client.16509 fetch_fsmap finished waiting for FSMap version 41 2024-05-14T09:29:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d3700e740 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d3700e740 20 client.16509 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5f911c0 0x559cb63aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d3700e740 4 client.16509 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:29:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.574+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559cb630afd0 con 0x559cb5f911c0 2024-05-14T09:29:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.575+0000 7f2d2d600640 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5f911c0 0x559cb63aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.576+0000 7f2d0ea00640 10 client.16509 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.577+0000 7f2d2d600640 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5f911c0 0x559cb63aa9f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93328b66e9f4634e server_cookie=ed00ab8559faaa55 in_seq=0 out_seq=0 2024-05-14T09:29:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.605+0000 7f2d0ea00640 1 -- 172.21.15.120:0/1886065046 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559cb630afd0 con 0x559cb5f911c0 2024-05-14T09:29:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.605+0000 7f2d0ea00640 10 client.16509 handle_command_reply: tid=0 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.605+0000 7f2d3700e740 1 client.16509 shutdown 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 msgr2=0x559cb63b8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8560 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2d14103be0 tx=0x7f2d140cce10 comp rx=0 tx=0).stop 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 shutdown_connections 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559cb5f911c0 0x559cb63aa9f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559cb5ffd1b0 0x559cb6425ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559cb5fdc4d0 0x559cb63b8560 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 --2- 172.21.15.120:0/1886065046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559cb5fd42f0 0x559cb63b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 >> 172.21.15.120:0/1886065046 conn(0x559cb5ff1300 msgr2=0x559cb639f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.606+0000 7f2d0ea00640 0 client.16509 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.607+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 shutdown_connections 2024-05-14T09:29:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.607+0000 7f2d3700e740 1 -- 172.21.15.120:0/1886065046 wait complete. 2024-05-14T09:29:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.607+0000 7f2d3700e740 20 client.16509 trim_cache size 0 max 16384 2024-05-14T09:29:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:29:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:29:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:29:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:29:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.608+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2d100b2830 msgr2=0x7f2d100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.608+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2d100b2830 0x7f2d100b4d40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001e000 tx=0x7f2d20010b40 comp rx=0 tx=0).stop 2024-05-14T09:29:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.608+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28106eb0 msgr2=0x7f2d281983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.608+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28106eb0 0x7f2d281983a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2d14000c00 tx=0x7f2d14004e50 comp rx=0 tx=0).stop 2024-05-14T09:29:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.609+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 shutdown_connections 2024-05-14T09:29:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.609+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f2d100b2830 0x7f2d100b4d40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.609+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d28109810 0x7f2d2819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.609+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d28106eb0 0x7f2d281983a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.609+0000 7f2d2ea00640 1 --2- 172.21.15.120:0/3620531420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d28104550 0x7f2d28197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.609+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 >> 172.21.15.120:0/3620531420 conn(0x7f2d280fdb50 msgr2=0x7f2d28105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.610+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 shutdown_connections 2024-05-14T09:29:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:36.610+0000 7f2d2ea00640 1 -- 172.21.15.120:0/3620531420 wait complete. 2024-05-14T09:29:37.476 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T09:29:37.476 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T09:29:37.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:37 smithi120 ceph-mon[31085]: pgmap v738: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 641 op/s 2024-05-14T09:29:38.007 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:37 smithi152 ceph-mon[34868]: pgmap v738: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 641 op/s 2024-05-14T09:29:38.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:37 smithi175 ceph-mon[35353]: pgmap v738: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 641 op/s 2024-05-14T09:29:39.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:38 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:39.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:38 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:39.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:38 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:39.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 125.0 s, 503.9 tps, lat 232.204 ms stddev 391.182 2024-05-14T09:29:39.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:39 smithi120 ceph-mon[31085]: pgmap v739: 129 pgs: 129 active+clean; 985 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.8 MiB/s wr, 742 op/s 2024-05-14T09:29:40.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:39 smithi175 ceph-mon[35353]: pgmap v739: 129 pgs: 129 active+clean; 985 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.8 MiB/s wr, 742 op/s 2024-05-14T09:29:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:39 smithi152 ceph-mon[34868]: pgmap v739: 129 pgs: 129 active+clean; 985 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.8 MiB/s wr, 742 op/s 2024-05-14T09:29:42.073 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:41 smithi120 ceph-mon[31085]: pgmap v740: 129 pgs: 129 active+clean; 1000 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 727 op/s 2024-05-14T09:29:42.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:41 smithi152 ceph-mon[34868]: pgmap v740: 129 pgs: 129 active+clean; 1000 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 727 op/s 2024-05-14T09:29:42.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:41 smithi175 ceph-mon[35353]: pgmap v740: 129 pgs: 129 active+clean; 1000 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 727 op/s 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.068+0000 7f1080a00700 1 -- 172.21.15.120:0/825346178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c105520 msgr2=0x7f107c105930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.068+0000 7f1080a00700 1 --2- 172.21.15.120:0/825346178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c105520 0x7f107c105930 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f106c009990 tx=0x7f106c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.068+0000 7f1080a00700 1 -- 172.21.15.120:0/825346178 shutdown_connections 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.068+0000 7f1080a00700 1 --2- 172.21.15.120:0/825346178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f107c10e900 0x7f107c110de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.068+0000 7f1080a00700 1 --2- 172.21.15.120:0/825346178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c105520 0x7f107c105930 secure :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f106c009990 tx=0x7f106c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.068+0000 7f1080a00700 1 --2- 172.21.15.120:0/825346178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 0x7f107c10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.068+0000 7f1080a00700 1 -- 172.21.15.120:0/825346178 >> 172.21.15.120:0/825346178 conn(0x7f107c0fef30 msgr2=0x7f107c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.069+0000 7f1080a00700 1 -- 172.21.15.120:0/825346178 shutdown_connections 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.069+0000 7f1080a00700 1 -- 172.21.15.120:0/825346178 wait complete. 2024-05-14T09:29:43.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.070+0000 7f1080a00700 1 Processor -- start 2024-05-14T09:29:43.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.070+0000 7f1080a00700 1 -- start start 2024-05-14T09:29:43.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.071+0000 7f1080a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 0x7f107c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.071+0000 7f1080a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c10e900 0x7f107c119290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.071+0000 7f1080a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f107c11e9a0 0x7f107c113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.071+0000 7f1080a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f107c104d30 con 0x7f107c10e900 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.071+0000 7f1080a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f107c104bb0 con 0x7f107c11e9a0 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.071+0000 7f1080a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f107c104eb0 con 0x7f107c105e70 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.072+0000 7f1079e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 0x7f107c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.072+0000 7f1079e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 0x7f107c118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55818/0 (socket says 172.21.15.120:55818) 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.072+0000 7f1079e00700 1 -- 172.21.15.120:0/3040942961 learned_addr learned my addr 172.21.15.120:0/3040942961 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:43.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.072+0000 7f107a800700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f107c11e9a0 0x7f107c113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.072+0000 7f1079400700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c10e900 0x7f107c119290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.073+0000 7f1079e00700 1 -- 172.21.15.120:0/3040942961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f107c11e9a0 msgr2=0x7f107c113e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.073+0000 7f1079e00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f107c11e9a0 0x7f107c113e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.073+0000 7f1079e00700 1 -- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c10e900 msgr2=0x7f107c119290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.073+0000 7f1079e00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c10e900 0x7f107c119290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.073+0000 7f1079e00700 1 -- 172.21.15.120:0/3040942961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c11f0f0 con 0x7f107c105e70 2024-05-14T09:29:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.074+0000 7f1079e00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 0x7f107c118cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.074+0000 7f1072a00700 1 -- 172.21.15.120:0/3040942961 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c026070 con 0x7f107c105e70 2024-05-14T09:29:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.075+0000 7f1072a00700 1 -- 172.21.15.120:0/3040942961 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f106c021410 con 0x7f107c105e70 2024-05-14T09:29:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.075+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c114380 con 0x7f107c105e70 2024-05-14T09:29:43.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.075+0000 7f1072a00700 1 -- 172.21.15.120:0/3040942961 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c017650 con 0x7f107c105e70 2024-05-14T09:29:43.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.075+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c114810 con 0x7f107c105e70 2024-05-14T09:29:43.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.083+0000 7f1072a00700 1 -- 172.21.15.120:0/3040942961 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f106c009d10 con 0x7f107c105e70 2024-05-14T09:29:43.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.083+0000 7f108f5fdb80 1 Processor -- start 2024-05-14T09:29:43.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.083+0000 7f108f5fdb80 1 -- start start 2024-05-14T09:29:43.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.084+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bace730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.084+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bac8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.084+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bf6b9eaaa0 con 0x55bf6bac8cd0 2024-05-14T09:29:43.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bf6b9887e0 con 0x55bf6b94aec0 2024-05-14T09:29:43.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf6b9e6a60 con 0x55bf6bacec70 2024-05-14T09:29:43.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f107a800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bace730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f107a800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bace730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:50098/0 (socket says 172.21.15.120:50098) 2024-05-14T09:29:43.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f107a800700 1 -- 172.21.15.120:0/3718864655 learned_addr learned my addr 172.21.15.120:0/3718864655 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:43.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f1072a00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f10600b2900 0x7f10600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.085+0000 7f1072a00700 1 -- 172.21.15.120:0/3040942961 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f106c0e2fc0 con 0x7f107c105e70 2024-05-14T09:29:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.086+0000 7f107a800700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f10600b2900 0x7f10600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.086+0000 7f1079e00700 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bac8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.086+0000 7f107a800700 1 -- 172.21.15.120:0/3718864655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 msgr2=0x55bf6bac8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.086+0000 7f107a800700 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bac8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.086+0000 7f107a800700 1 -- 172.21.15.120:0/3718864655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 msgr2=0x55bf6bac90e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:29:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.086+0000 7f1079400700 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.087+0000 7f107a800700 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.087+0000 7f107a800700 1 -- 172.21.15.120:0/3718864655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6b937950 con 0x55bf6b94aec0 2024-05-14T09:29:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.087+0000 7f1079400700 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.088+0000 7f107a800700 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bace730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1074013c00 tx=0x7f1074013f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23fc2ff9737332d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:43.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.088+0000 7f1067400700 1 -- 172.21.15.120:0/3718864655 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074019960 con 0x55bf6b94aec0 2024-05-14T09:29:43.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.088+0000 7f107a800700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f10600b2900 0x7f10600b4e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f107400a000 tx=0x7f107401c000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:43.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.089+0000 7f1067400700 1 -- 172.21.15.120:0/3718864655 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1074016e90 con 0x55bf6b94aec0 2024-05-14T09:29:43.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.089+0000 7f1067400700 1 -- 172.21.15.120:0/3718864655 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074021cd0 con 0x55bf6b94aec0 2024-05-14T09:29:43.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.091+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3718864655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 msgr2=0x55bf6bace730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.091+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bace730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1074013c00 tx=0x7f1074013f10 comp rx=0 tx=0).stop 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.091+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3718864655 shutdown_connections 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.091+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bace730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.091+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.091+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3718864655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bac8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.091+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3718864655 >> 172.21.15.120:0/3718864655 conn(0x55bf6b989b00 msgr2=0x55bf6bac3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.092+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3718864655 shutdown_connections 2024-05-14T09:29:43.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.092+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3718864655 wait complete. 2024-05-14T09:29:43.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.092+0000 7f108f5fdb80 1 -- start start 2024-05-14T09:29:43.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.093+0000 7f108f5fdb80 1 Processor -- start 2024-05-14T09:29:43.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.093+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bad24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.093+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bad2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bad2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bf6bad56e0 con 0x55bf6bac8cd0 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bf6b950ba0 con 0x55bf6b94aec0 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf6bad5860 con 0x55bf6bacec70 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f108f5fdb80 10 client.0 _ll_register_callbacks cb 0x55bf6b97e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f1079e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bad24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f1079e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bad24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:50102/0 (socket says 172.21.15.120:50102) 2024-05-14T09:29:43.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.094+0000 7f1079e00700 1 -- 172.21.15.120:0/204802209 learned_addr learned my addr 172.21.15.120:0/204802209 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:43.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.095+0000 7f1079400700 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bad2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.095+0000 7f107a800700 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bad2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.095+0000 7f1079e00700 1 -- 172.21.15.120:0/204802209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 msgr2=0x55bf6bad2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:43.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.095+0000 7f1079e00700 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bad2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.095+0000 7f1079e00700 1 -- 172.21.15.120:0/204802209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 msgr2=0x55bf6bad2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:43.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.095+0000 7f1079e00700 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bad2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.095+0000 7f1079e00700 1 -- 172.21.15.120:0/204802209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6b9b04a0 con 0x55bf6b94aec0 2024-05-14T09:29:43.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.096+0000 7f105be00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:29:43.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.096+0000 7f1079e00700 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bad24e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f106c0a9f70 tx=0x7f106c0a99e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5532feea39310d47 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:43.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.097+0000 7f105be00700 1 -- 172.21.15.120:0/204802209 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0aa970 con 0x55bf6b94aec0 2024-05-14T09:29:43.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.097+0000 7f105be00700 1 -- 172.21.15.120:0/204802209 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f106c0aa6e0 con 0x55bf6b94aec0 2024-05-14T09:29:43.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.097+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1074016e90 con 0x55bf6b94aec0 2024-05-14T09:29:43.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.098+0000 7f105be00700 1 -- 172.21.15.120:0/204802209 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f106c0aa270 con 0x55bf6b94aec0 2024-05-14T09:29:43.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.098+0000 7f108f5fdb80 10 client.35999 fetch_fsmap learned FSMap version 43 2024-05-14T09:29:43.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.098+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55bf6baf1300 con 0x55bf6b94aec0 2024-05-14T09:29:43.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.098+0000 7f105be00700 1 -- 172.21.15.120:0/204802209 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1074016e90 con 0x55bf6b94aec0 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.099+0000 7f105be00700 1 -- 172.21.15.120:0/204802209 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f106c005110 con 0x55bf6b94aec0 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.099+0000 7f108f5fdb80 10 client.35999 fetch_fsmap finished waiting for FSMap version 43 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.099+0000 7f108f5fdb80 10 client.35999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.099+0000 7f108f5fdb80 20 client.35999 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.099+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6baf3900 0x55bf6baf5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.099+0000 7f108f5fdb80 4 client.35999 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.099+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf6ba950f0 con 0x55bf6baf3900 2024-05-14T09:29:43.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.100+0000 7f1079400700 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6baf3900 0x55bf6baf5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.101+0000 7f1079400700 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6baf3900 0x55bf6baf5d90 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16406789639cb69 server_cookie=94d6e2bd7c26e77e in_seq=0 out_seq=0 2024-05-14T09:29:43.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.101+0000 7f105be00700 10 client.35999 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:43.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.104+0000 7f105be00700 1 -- 172.21.15.120:0/204802209 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bf6ba950f0 con 0x55bf6baf3900 2024-05-14T09:29:43.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.104+0000 7f105be00700 10 client.35999 handle_command_reply: tid=0 2024-05-14T09:29:43.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.104+0000 7f108f5fdb80 1 client.35999 shutdown 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.104+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 msgr2=0x55bf6bad24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.104+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bad24e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f106c0a9f70 tx=0x7f106c0a99e0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.104+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 shutdown_connections 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.104+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6baf3900 0x55bf6baf5d90 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bad24e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bacec70 0x55bf6bad2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/204802209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bad2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 >> 172.21.15.120:0/204802209 conn(0x55bf6b989b00 msgr2=0x55bf6bac7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:43.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f105be00700 0 client.35999 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:43.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 shutdown_connections 2024-05-14T09:29:43.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f108f5fdb80 1 -- 172.21.15.120:0/204802209 wait complete. 2024-05-14T09:29:43.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.105+0000 7f108f5fdb80 20 client.35999 trim_cache size 0 max 16384 2024-05-14T09:29:43.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.140+0000 7f108f5fdb80 1 Processor -- start 2024-05-14T09:29:43.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.140+0000 7f108f5fdb80 1 -- start start 2024-05-14T09:29:43.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.141+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6b94aec0 0x55bf6bac8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.141+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.141+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6bacec70 0x55bf6bafb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.141+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f107c075680 con 0x55bf6bac8cd0 2024-05-14T09:29:43.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.141+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f107c1b8950 con 0x55bf6bacec70 2024-05-14T09:29:43.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.141+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f107c1b7420 con 0x55bf6b94aec0 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38396/0 (socket says 172.21.15.120:38396) 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 -- 172.21.15.120:0/1254275624 learned_addr learned my addr 172.21.15.120:0/1254275624 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079e00700 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6b94aec0 0x55bf6bac8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f107a800700 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6bacec70 0x55bf6bafb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 -- 172.21.15.120:0/1254275624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6b94aec0 msgr2=0x55bf6bac8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6b94aec0 0x55bf6bac8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 -- 172.21.15.120:0/1254275624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6bacec70 msgr2=0x55bf6bafb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6bacec70 0x55bf6bafb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.142+0000 7f1079400700 1 -- 172.21.15.120:0/1254275624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6bacf120 con 0x55bf6bac8cd0 2024-05-14T09:29:43.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.143+0000 7f1079400700 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac3940 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1068003b00 tx=0x7f1068009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cc0d0021a473b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:43.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.144+0000 7f1066a00700 1 -- 172.21.15.120:0/1254275624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068005230 con 0x55bf6bac8cd0 2024-05-14T09:29:43.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.144+0000 7f1066a00700 1 -- 172.21.15.120:0/1254275624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1068004c50 con 0x55bf6bac8cd0 2024-05-14T09:29:43.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.144+0000 7f1066a00700 1 -- 172.21.15.120:0/1254275624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068009c60 con 0x55bf6bac8cd0 2024-05-14T09:29:43.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.145+0000 7f108f5fdb80 1 -- 172.21.15.120:0/1254275624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 msgr2=0x55bf6bac3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.145+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac3940 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1068003b00 tx=0x7f1068009260 comp rx=0 tx=0).stop 2024-05-14T09:29:43.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.145+0000 7f108f5fdb80 1 -- 172.21.15.120:0/1254275624 shutdown_connections 2024-05-14T09:29:43.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.145+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6bacec70 0x55bf6bafb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.145+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6b94aec0 0x55bf6bac8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.145+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/1254275624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bac8cd0 0x55bf6bac3940 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.145+0000 7f108f5fdb80 1 -- 172.21.15.120:0/1254275624 >> 172.21.15.120:0/1254275624 conn(0x55bf6b989b00 msgr2=0x55bf6bad2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:43.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.146+0000 7f108f5fdb80 1 -- 172.21.15.120:0/1254275624 shutdown_connections 2024-05-14T09:29:43.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.146+0000 7f108f5fdb80 1 -- 172.21.15.120:0/1254275624 wait complete. 2024-05-14T09:29:43.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.146+0000 7f108f5fdb80 1 -- start start 2024-05-14T09:29:43.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.147+0000 7f108f5fdb80 1 Processor -- start 2024-05-14T09:29:43.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.147+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bada910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.148+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bacec70 0x55bf6badae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.148+0000 7f108f5fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bad7ec0 0x55bf6bad82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.148+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f107c1b8220 con 0x55bf6bacec70 2024-05-14T09:29:43.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.148+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f107c1b7b50 con 0x55bf6b94aec0 2024-05-14T09:29:43.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.148+0000 7f108f5fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f107c073640 con 0x55bf6bad7ec0 2024-05-14T09:29:43.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.148+0000 7f108f5fdb80 10 client.0 _ll_register_callbacks cb 0x55bf6b97e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:43.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.149+0000 7f1079e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bada910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.149+0000 7f1079400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bacec70 0x55bf6badae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.149+0000 7f1079400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bacec70 0x55bf6badae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38406/0 (socket says 172.21.15.120:38406) 2024-05-14T09:29:43.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.149+0000 7f1079400700 1 -- 172.21.15.120:0/3708876894 learned_addr learned my addr 172.21.15.120:0/3708876894 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:43.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.150+0000 7f107a800700 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bad7ec0 0x55bf6bad82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.150+0000 7f1079400700 1 -- 172.21.15.120:0/3708876894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bad7ec0 msgr2=0x55bf6bad82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:43.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.150+0000 7f1079400700 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bad7ec0 0x55bf6bad82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.150+0000 7f1079400700 1 -- 172.21.15.120:0/3708876894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 msgr2=0x55bf6bada910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:43.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.150+0000 7f1079400700 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bada910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.150+0000 7f1079400700 1 -- 172.21.15.120:0/3708876894 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6bad8970 con 0x55bf6bacec70 2024-05-14T09:29:43.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.150+0000 7f107a800700 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bad7ec0 0x55bf6bad82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:43.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.151+0000 7f1079400700 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bacec70 0x55bf6badae50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f10680046e0 tx=0x7f1068004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0f6f098c4c0c9b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:43.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.151+0000 7f105be00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:43.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.151+0000 7f105be00700 1 -- 172.21.15.120:0/3708876894 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068009cf0 con 0x55bf6bacec70 2024-05-14T09:29:43.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.151+0000 7f105be00700 1 -- 172.21.15.120:0/3708876894 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1068005030 con 0x55bf6bacec70 2024-05-14T09:29:43.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.151+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1068004c50 con 0x55bf6bacec70 2024-05-14T09:29:43.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.153+0000 7f105be00700 1 -- 172.21.15.120:0/3708876894 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1068036050 con 0x55bf6bacec70 2024-05-14T09:29:43.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.153+0000 7f108f5fdb80 10 client.16524 fetch_fsmap learned FSMap version 43 2024-05-14T09:29:43.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.153+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55bf6bb5fe80 con 0x55bf6bacec70 2024-05-14T09:29:43.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.153+0000 7f105be00700 1 -- 172.21.15.120:0/3708876894 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1068004c50 con 0x55bf6bacec70 2024-05-14T09:29:43.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.153+0000 7f105be00700 1 -- 172.21.15.120:0/3708876894 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f106801b6f0 con 0x55bf6bacec70 2024-05-14T09:29:43.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.153+0000 7f108f5fdb80 10 client.16524 fetch_fsmap finished waiting for FSMap version 43 2024-05-14T09:29:43.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.153+0000 7f108f5fdb80 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:43.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.154+0000 7f108f5fdb80 20 client.16524 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:43.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.154+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6bb604e0 0x55bf6bb62900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.154+0000 7f108f5fdb80 4 client.16524 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T09:29:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.154+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bf6b9f8480 con 0x55bf6bb604e0 2024-05-14T09:29:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.154+0000 7f1079e00700 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6bb604e0 0x55bf6bb62900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.156+0000 7f1079e00700 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6bb604e0 0x55bf6bb62900 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f0fd989372169b server_cookie=6b74151af65ca145 in_seq=0 out_seq=0 2024-05-14T09:29:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.156+0000 7f105be00700 10 client.16524 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:43.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.159+0000 7f105be00700 1 -- 172.21.15.120:0/3708876894 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bf6b9f8480 con 0x55bf6bb604e0 2024-05-14T09:29:43.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.159+0000 7f105be00700 10 client.16524 handle_command_reply: tid=0 2024-05-14T09:29:43.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.159+0000 7f108f5fdb80 1 client.16524 shutdown 2024-05-14T09:29:43.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bacec70 msgr2=0x55bf6badae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bacec70 0x55bf6badae50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f10680046e0 tx=0x7f1068004870 comp rx=0 tx=0).stop 2024-05-14T09:29:43.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 shutdown_connections 2024-05-14T09:29:43.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf6bb604e0 0x55bf6bb62900 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf6b94aec0 0x55bf6bada910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf6bad7ec0 0x55bf6bad82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.161 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:29:43.161 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-05-14T09:29:43.161 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "4117a9b9-a712-45e2-922e-9ba06c69a782", 2024-05-14T09:29:43.161 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-05-14T09:29:43.161 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:29:43.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 --2- 172.21.15.120:0/3708876894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf6bacec70 0x55bf6badae50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 >> 172.21.15.120:0/3708876894 conn(0x55bf6b989b00 msgr2=0x55bf6bacc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:43.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.160+0000 7f105be00700 0 client.16524 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:43.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.161+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 shutdown_connections 2024-05-14T09:29:43.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.161+0000 7f108f5fdb80 1 -- 172.21.15.120:0/3708876894 wait complete. 2024-05-14T09:29:43.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.161+0000 7f108f5fdb80 20 client.16524 trim_cache size 0 max 16384 2024-05-14T09:29:43.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.162+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f10600b2900 msgr2=0x7f10600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.162+0000 7f1080a00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f10600b2900 0x7f10600b4e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f107400a000 tx=0x7f107401c000 comp rx=0 tx=0).stop 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.162+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 msgr2=0x7f107c118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.162+0000 7f1080a00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 0x7f107c118cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c0057c0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 shutdown_connections 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f10600b2900 0x7f10600b4e10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f107c11e9a0 0x7f107c113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f107c105e70 0x7f107c118cd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 --2- 172.21.15.120:0/3040942961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f107c10e900 0x7f107c119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 >> 172.21.15.120:0/3040942961 conn(0x7f107c0fef30 msgr2=0x7f107c0ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 shutdown_connections 2024-05-14T09:29:43.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:43.163+0000 7f1080a00700 1 -- 172.21.15.120:0/3040942961 wait complete. 2024-05-14T09:29:43.478 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c[66510]: 2024-05-14T09:29:43.198+0000 7ff5eb400700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005be [2,head] /volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_subtrans/0001 auth v32 ap=1 s=32768 n(v0 rc2024-05-14T09:29:31.477657+0000 b32768 1=1+0) caps={15282=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563adb21db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005be:[<0x1000000000f/0001 v28>,<0x10000000006/pg_subtrans v1390>,<0x10000000005/data v964>,<0x10000000003/postgres v392>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v415>,<0x10000000001/sv_0 v424>,<0x10000000000/qa v418>,<0x1/volumes v411>]//[3]","memoryvalue":"(4)0x100000005be:[<0x1000000000f/0001 v32>,<0x10000000006/pg_subtrans v1452>,<0x10000000005/data v1008>,<0x10000000003/postgres v394>,<0x10000000002/92af4004-749c-4392-ae36-0928c82dd90e v427>,<0x10000000001/sv_0 v434>,<0x10000000000/qa v394>,<0x1/volumes v413>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T09:29:43.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: pgmap v741: 129 pgs: 129 active+clean; 1004 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub queued for path: / 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:43.886 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:43.887 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:43.887 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:43 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:29:44.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: pgmap v741: 129 pgs: 129 active+clean; 1004 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub queued for path: / 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:44.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:44.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:43 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: pgmap v741: 129 pgs: 129 active+clean; 1004 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub queued for path: / 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:44.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:44.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:44.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:44.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:43 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 130.0 s, 530.2 tps, lat 188.902 ms stddev 331.595 2024-05-14T09:29:44.838 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:29:45.043 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:45.043 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.043 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:45.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:45.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: Scrub error on inode 0x100000005be (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_subtrans/0001) see mds.c log and `damage ls` output for details 2024-05-14T09:29:45.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: active paths [/] 2024-05-14T09:29:45.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.044 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:44 smithi120 ceph-mon[31085]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: Scrub error on inode 0x100000005be (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_subtrans/0001) see mds.c log and `damage ls` output for details 2024-05-14T09:29:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: active paths [/] 2024-05-14T09:29:45.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:44 smithi152 ceph-mon[34868]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: Scrub error on inode 0x100000005be (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_subtrans/0001) see mds.c log and `damage ls` output for details 2024-05-14T09:29:45.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: active paths [/] 2024-05-14T09:29:45.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:45.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:44 smithi175 ceph-mon[35353]: scrub summary: idle+waiting paths [/] 2024-05-14T09:29:46.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:45 smithi120 ceph-mon[31085]: pgmap v742: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 14 MiB/s wr, 716 op/s 2024-05-14T09:29:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:45 smithi152 ceph-mon[34868]: pgmap v742: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 14 MiB/s wr, 716 op/s 2024-05-14T09:29:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:45 smithi175 ceph-mon[35353]: pgmap v742: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 14 MiB/s wr, 716 op/s 2024-05-14T09:29:47.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:47 smithi120 ceph-mon[31085]: pgmap v743: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 13 MiB/s wr, 729 op/s 2024-05-14T09:29:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:47 smithi152 ceph-mon[34868]: pgmap v743: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 13 MiB/s wr, 729 op/s 2024-05-14T09:29:48.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:47 smithi175 ceph-mon[35353]: pgmap v743: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 13 MiB/s wr, 729 op/s 2024-05-14T09:29:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 135.0 s, 479.8 tps, lat 208.396 ms stddev 413.640 2024-05-14T09:29:49.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.362+0000 7f8af0400700 1 -- 172.21.15.120:0/2948733168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 msgr2=0x7f8ae81111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.362+0000 7f8af0400700 1 --2- 172.21.15.120:0/2948733168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 0x7f8ae81111d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009fc0 tx=0x7f8ad800b330 comp rx=0 tx=0).stop 2024-05-14T09:29:49.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.363+0000 7f8af0400700 1 -- 172.21.15.120:0/2948733168 shutdown_connections 2024-05-14T09:29:49.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.363+0000 7f8af0400700 1 --2- 172.21.15.120:0/2948733168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ae81045f0 0x7f8ae8104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.363+0000 7f8af0400700 1 --2- 172.21.15.120:0/2948733168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 0x7f8ae81111d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.363+0000 7f8af0400700 1 --2- 172.21.15.120:0/2948733168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ae8108f20 0x7f8ae8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.363+0000 7f8af0400700 1 -- 172.21.15.120:0/2948733168 >> 172.21.15.120:0/2948733168 conn(0x7f8ae8100040 msgr2=0x7f8ae8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.364+0000 7f8af0400700 1 -- 172.21.15.120:0/2948733168 shutdown_connections 2024-05-14T09:29:49.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.364+0000 7f8af0400700 1 -- 172.21.15.120:0/2948733168 wait complete. 2024-05-14T09:29:49.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.366+0000 7f8af0400700 1 Processor -- start 2024-05-14T09:29:49.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.366+0000 7f8af0400700 1 -- start start 2024-05-14T09:29:49.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.367+0000 7f8af0400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ae81045f0 0x7f8ae819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.367+0000 7f8af0400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ae8108f20 0x7f8ae819d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.367+0000 7f8af0400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 0x7f8ae81a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.367+0000 7f8af0400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae8116600 con 0x7f8ae8108f20 2024-05-14T09:29:49.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.367+0000 7f8af0400700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae8116480 con 0x7f8ae81045f0 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.367+0000 7f8af0400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae8116780 con 0x7f8ae8109870 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.368+0000 7f8aed000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ae8108f20 0x7f8ae819d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.368+0000 7f8aeda00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ae81045f0 0x7f8ae819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.368+0000 7f8aeda00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ae81045f0 0x7f8ae819cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:44324/0 (socket says 172.21.15.120:44324) 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.368+0000 7f8aeda00700 1 -- 172.21.15.120:0/396390668 learned_addr learned my addr 172.21.15.120:0/396390668 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.368+0000 7f8aee400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 0x7f8ae81a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.369+0000 7f8aed000700 1 -- 172.21.15.120:0/396390668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 msgr2=0x7f8ae81a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.369+0000 7f8aed000700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 0x7f8ae81a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.369+0000 7f8aed000700 1 -- 172.21.15.120:0/396390668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ae81045f0 msgr2=0x7f8ae819cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.369+0000 7f8aed000700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ae81045f0 0x7f8ae819cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.369+0000 7f8aed000700 1 -- 172.21.15.120:0/396390668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae81a1e80 con 0x7f8ae8108f20 2024-05-14T09:29:49.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.370+0000 7f8aed000700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ae8108f20 0x7f8ae819d550 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4005fd0 tx=0x7f8ad400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.371+0000 7f8ae6000700 1 -- 172.21.15.120:0/396390668 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400cbd0 con 0x7f8ae8108f20 2024-05-14T09:29:49.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.371+0000 7f8ae6000700 1 -- 172.21.15.120:0/396390668 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad40044b0 con 0x7f8ae8108f20 2024-05-14T09:29:49.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.372+0000 7f8ae6000700 1 -- 172.21.15.120:0/396390668 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4003dd0 con 0x7f8ae8108f20 2024-05-14T09:29:49.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.372+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae81a2170 con 0x7f8ae8108f20 2024-05-14T09:29:49.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.372+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae81a9a90 con 0x7f8ae8108f20 2024-05-14T09:29:49.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.381+0000 7f8afeed2b80 1 Processor -- start 2024-05-14T09:29:49.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.381+0000 7f8afeed2b80 1 -- start start 2024-05-14T09:29:49.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.381+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec3d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.382+0000 7f8aee400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec3d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.382+0000 7f8ae6000700 1 -- 172.21.15.120:0/396390668 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8ad4003f70 con 0x7f8ae8108f20 2024-05-14T09:29:49.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.382+0000 7f8aee400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec3d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55072/0 (socket says 172.21.15.120:55072) 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.382+0000 7f8aee400700 1 -- 172.21.15.120:0/1928541297 learned_addr learned my addr 172.21.15.120:0/1928541297 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.382+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec37710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.383+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec38060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.383+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559eceb59a20 con 0x559eceab9e40 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.383+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559eceaf7760 con 0x559ecec37c50 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.383+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559eceb559e0 con 0x559ecec3dbf0 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.383+0000 7f8aed000700 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec38060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.383+0000 7f8aeda00700 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec37710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.384+0000 7f8aed000700 1 -- 172.21.15.120:0/1928541297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 msgr2=0x559ecec37710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.384+0000 7f8aed000700 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec37710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.384+0000 7f8aed000700 1 -- 172.21.15.120:0/1928541297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 msgr2=0x559ecec3d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.385+0000 7f8aed000700 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec3d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.385+0000 7f8aed000700 1 -- 172.21.15.120:0/1928541297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eceaa68d0 con 0x559ecec37c50 2024-05-14T09:29:49.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.385+0000 7f8aee400700 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec3d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:49.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.385+0000 7f8aed000700 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec38060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40dfd60 tx=0x7f8ad40e88c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49042b8b3d7e08ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.386+0000 7f8ae6000700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8acc0b2980 0x7f8acc0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.387+0000 7f8adea00700 1 -- 172.21.15.120:0/1928541297 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40a5f00 con 0x559ecec37c50 2024-05-14T09:29:49.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.387+0000 7f8adea00700 1 -- 172.21.15.120:0/1928541297 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad40f7030 con 0x559ecec37c50 2024-05-14T09:29:49.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.387+0000 7f8adea00700 1 -- 172.21.15.120:0/1928541297 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40a9020 con 0x559ecec37c50 2024-05-14T09:29:49.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.387+0000 7f8ae6000700 1 -- 172.21.15.120:0/396390668 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8ad40e2690 con 0x7f8ae8108f20 2024-05-14T09:29:49.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.388+0000 7f8aee400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8acc0b2980 0x7f8acc0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.389+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 msgr2=0x559ecec38060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec38060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40dfd60 tx=0x7f8ad40e88c0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8aee400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8acc0b2980 0x7f8acc0b4e90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009840 tx=0x7f8ad8009f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 shutdown_connections 2024-05-14T09:29:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec38060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec3d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1928541297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec37710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 >> 172.21.15.120:0/1928541297 conn(0x559eceaf8a80 msgr2=0x559ecec32790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 shutdown_connections 2024-05-14T09:29:49.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.390+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1928541297 wait complete. 2024-05-14T09:29:49.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.391+0000 7f8afeed2b80 1 -- start start 2024-05-14T09:29:49.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.391+0000 7f8afeed2b80 1 Processor -- start 2024-05-14T09:29:49.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.392+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559eceab9e40 0x559ecec41450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.392+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec37c50 0x559ecec41990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.392+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec3dbf0 0x559ecec41ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.392+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559ecec446c0 con 0x559ecec3dbf0 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.392+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559eceabfb20 con 0x559eceab9e40 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.392+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559ecec44840 con 0x559ecec37c50 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.393+0000 7f8afeed2b80 10 client.0 _ll_register_callbacks cb 0x559eceaed380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.393+0000 7f8aed000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec37c50 0x559ecec41990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.393+0000 7f8aed000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec37c50 0x559ecec41990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50082/0 (socket says 172.21.15.120:50082) 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.393+0000 7f8aed000700 1 -- 172.21.15.120:0/662715809 learned_addr learned my addr 172.21.15.120:0/662715809 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.393+0000 7f8aee400700 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec3dbf0 0x559ecec41ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.394+0000 7f8aeda00700 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559eceab9e40 0x559ecec41450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.394+0000 7f8aed000700 1 -- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559eceab9e40 msgr2=0x559ecec41450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.394+0000 7f8aed000700 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559eceab9e40 0x559ecec41450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.394+0000 7f8aed000700 1 -- 172.21.15.120:0/662715809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec3dbf0 msgr2=0x559ecec41ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.394+0000 7f8aed000700 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec3dbf0 0x559ecec41ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.394+0000 7f8aed000700 1 -- 172.21.15.120:0/662715809 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eceb1f420 con 0x559ecec37c50 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.395+0000 7f8aed000700 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec37c50 0x559ecec41990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40e8fd0 tx=0x7f8ad4009a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19a2eaad472efa9a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.395+0000 7f8ad3400700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.395+0000 7f8ad3400700 1 -- 172.21.15.120:0/662715809 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40a9200 con 0x559ecec37c50 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.395+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ad40f7030 con 0x559ecec37c50 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.396+0000 7f8ad3400700 1 -- 172.21.15.120:0/662715809 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8ad4003680 con 0x559ecec37c50 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.396+0000 7f8ad3400700 1 -- 172.21.15.120:0/662715809 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f8ad40a93f0 con 0x559ecec37c50 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.396+0000 7f8afeed2b80 10 client.26080 fetch_fsmap learned FSMap version 43 2024-05-14T09:29:49.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.396+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x559ecec446c0 con 0x559ecec37c50 2024-05-14T09:29:49.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.397+0000 7f8ad3400700 1 -- 172.21.15.120:0/662715809 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad40a9fb0 con 0x559ecec37c50 2024-05-14T09:29:49.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.397+0000 7f8ad3400700 1 -- 172.21.15.120:0/662715809 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f8ad40a5b40 con 0x559ecec37c50 2024-05-14T09:29:49.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.397+0000 7f8afeed2b80 10 client.26080 fetch_fsmap finished waiting for FSMap version 43 2024-05-14T09:29:49.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.397+0000 7f8afeed2b80 10 client.26080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:49.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.397+0000 7f8afeed2b80 20 client.26080 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:49.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.397+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ecec51660 0x559ecec53a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.398+0000 7f8afeed2b80 4 client.26080 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:49.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.398+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8ad40f7030 con 0x559ecec51660 2024-05-14T09:29:49.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.398+0000 7f8aeda00700 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ecec51660 0x559ecec53a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.400+0000 7f8aeda00700 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ecec51660 0x559ecec53a80 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0db1e225fc57223 server_cookie=cdd78e80ce3f9e9 in_seq=0 out_seq=0 2024-05-14T09:29:49.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.401+0000 7f8ad3400700 10 client.26080 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:49.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.402+0000 7f8ad3400700 1 -- 172.21.15.120:0/662715809 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f8ad40f7030 con 0x559ecec51660 2024-05-14T09:29:49.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.403+0000 7f8ad3400700 10 client.26080 handle_command_reply: tid=0 2024-05-14T09:29:49.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.403+0000 7f8afeed2b80 1 client.26080 shutdown 2024-05-14T09:29:49.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec37c50 msgr2=0x559ecec41990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec37c50 0x559ecec41990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40e8fd0 tx=0x7f8ad4009a30 comp rx=0 tx=0).stop 2024-05-14T09:29:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 shutdown_connections 2024-05-14T09:29:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ecec51660 0x559ecec53a80 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559eceab9e40 0x559ecec41450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec3dbf0 0x559ecec41ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/662715809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec37c50 0x559ecec41990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 >> 172.21.15.120:0/662715809 conn(0x559eceaf8a80 msgr2=0x559ecec36700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.404+0000 7f8ad3400700 0 client.26080 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.405+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 shutdown_connections 2024-05-14T09:29:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.405+0000 7f8afeed2b80 1 -- 172.21.15.120:0/662715809 wait complete. 2024-05-14T09:29:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.405+0000 7f8afeed2b80 20 client.26080 trim_cache size 0 max 16384 2024-05-14T09:29:49.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.437+0000 7f8afeed2b80 1 Processor -- start 2024-05-14T09:29:49.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.437+0000 7f8afeed2b80 1 -- start start 2024-05-14T09:29:49.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.438+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec37710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.438+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec2cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.438+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec4daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.438+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81ae2b0 con 0x559eceab9e40 2024-05-14T09:29:49.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.438+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81afeb0 con 0x559ecec37c50 2024-05-14T09:29:49.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.438+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81ae980 con 0x559ecec3dbf0 2024-05-14T09:29:49.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.439+0000 7f8aee400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec4daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.439+0000 7f8aee400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec4daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50088/0 (socket says 172.21.15.120:50088) 2024-05-14T09:29:49.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.439+0000 7f8aee400700 1 -- 172.21.15.120:0/3875590779 learned_addr learned my addr 172.21.15.120:0/3875590779 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.439+0000 7f8aee400700 1 -- 172.21.15.120:0/3875590779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 msgr2=0x559ecec2cb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:29:49.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.440+0000 7f8aee400700 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec2cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.440+0000 7f8aee400700 1 -- 172.21.15.120:0/3875590779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 msgr2=0x559ecec37710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:29:49.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.440+0000 7f8aeda00700 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec37710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.441+0000 7f8aee400700 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec37710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.441+0000 7f8aee400700 1 -- 172.21.15.120:0/3875590779 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ecec44250 con 0x559ecec3dbf0 2024-05-14T09:29:49.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.442+0000 7f8aeda00700 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec37710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:29:49.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.442+0000 7f8aee400700 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec4daa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8003f00 tx=0x7f8ad801f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e4867978df17d20 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.443+0000 7f8ade000700 1 -- 172.21.15.120:0/3875590779 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad802f070 con 0x559ecec3dbf0 2024-05-14T09:29:49.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.443+0000 7f8ade000700 1 -- 172.21.15.120:0/3875590779 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad8007b90 con 0x559ecec3dbf0 2024-05-14T09:29:49.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.443+0000 7f8ade000700 1 -- 172.21.15.120:0/3875590779 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8005810 con 0x559ecec3dbf0 2024-05-14T09:29:49.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.444+0000 7f8afeed2b80 1 -- 172.21.15.120:0/3875590779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 msgr2=0x559ecec4daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.444+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec4daa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8003f00 tx=0x7f8ad801f000 comp rx=0 tx=0).stop 2024-05-14T09:29:49.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.444+0000 7f8afeed2b80 1 -- 172.21.15.120:0/3875590779 shutdown_connections 2024-05-14T09:29:49.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.444+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ecec3dbf0 0x559ecec4daa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.444+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559eceab9e40 0x559ecec37710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.444+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/3875590779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec37c50 0x559ecec2cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.444+0000 7f8afeed2b80 1 -- 172.21.15.120:0/3875590779 >> 172.21.15.120:0/3875590779 conn(0x559eceaf8a80 msgr2=0x559ecec41410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.445+0000 7f8afeed2b80 1 -- 172.21.15.120:0/3875590779 shutdown_connections 2024-05-14T09:29:49.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.445+0000 7f8afeed2b80 1 -- 172.21.15.120:0/3875590779 wait complete. 2024-05-14T09:29:49.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.446+0000 7f8afeed2b80 1 -- start start 2024-05-14T09:29:49.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.446+0000 7f8afeed2b80 1 Processor -- start 2024-05-14T09:29:49.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.447+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559eceab9e40 0x559ecec56c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.447+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec37c50 0x559ecec54c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.447+0000 7f8afeed2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec3dbf0 0x559ecec551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.447+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81af780 con 0x559ecec37c50 2024-05-14T09:29:49.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.448+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81af0b0 con 0x559ecec3dbf0 2024-05-14T09:29:49.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.448+0000 7f8afeed2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81ac270 con 0x559eceab9e40 2024-05-14T09:29:49.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.448+0000 7f8afeed2b80 10 client.0 _ll_register_callbacks cb 0x559eceaed380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:49.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.448+0000 7f8aee400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec3dbf0 0x559ecec551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.449+0000 7f8aed000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec37c50 0x559ecec54c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.449+0000 7f8aeda00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559eceab9e40 0x559ecec56c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.449+0000 7f8aed000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec37c50 0x559ecec54c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55092/0 (socket says 172.21.15.120:55092) 2024-05-14T09:29:49.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.449+0000 7f8aed000700 1 -- 172.21.15.120:0/1152850635 learned_addr learned my addr 172.21.15.120:0/1152850635 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aed000700 1 -- 172.21.15.120:0/1152850635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559eceab9e40 msgr2=0x559ecec56c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aed000700 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559eceab9e40 0x559ecec56c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aed000700 1 -- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec3dbf0 msgr2=0x559ecec551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aed000700 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec3dbf0 0x559ecec551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aed000700 1 -- 172.21.15.120:0/1152850635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ecec559c0 con 0x559ecec37c50 2024-05-14T09:29:49.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aeda00700 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559eceab9e40 0x559ecec56c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:49.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aee400700 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec3dbf0 0x559ecec551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:49.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.450+0000 7f8aed000700 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec37c50 0x559ecec54c50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40a93c0 tx=0x7f8ad40038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d086b4113872b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.451+0000 7f8ad3400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:49.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.451+0000 7f8ad3400700 1 -- 172.21.15.120:0/1152850635 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40a9680 con 0x559ecec37c50 2024-05-14T09:29:49.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.451+0000 7f8ad3400700 1 -- 172.21.15.120:0/1152850635 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8ad40e2340 con 0x559ecec37c50 2024-05-14T09:29:49.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.452+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ad8007b90 con 0x559ecec37c50 2024-05-14T09:29:49.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.452+0000 7f8ad3400700 1 -- 172.21.15.120:0/1152850635 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f8ad40a5220 con 0x559ecec37c50 2024-05-14T09:29:49.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.452+0000 7f8afeed2b80 10 client.16539 fetch_fsmap learned FSMap version 43 2024-05-14T09:29:49.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.452+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x559ececbbaf0 con 0x559ecec37c50 2024-05-14T09:29:49.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.453+0000 7f8ad3400700 1 -- 172.21.15.120:0/1152850635 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad8007b90 con 0x559ecec37c50 2024-05-14T09:29:49.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.453+0000 7f8ad3400700 1 -- 172.21.15.120:0/1152850635 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f8ad40dfe10 con 0x559ecec37c50 2024-05-14T09:29:49.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.453+0000 7f8afeed2b80 10 client.16539 fetch_fsmap finished waiting for FSMap version 43 2024-05-14T09:29:49.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.453+0000 7f8afeed2b80 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:49.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.453+0000 7f8afeed2b80 20 client.16539 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:49.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.453+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ececbbff0 0x559ececbe410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.455+0000 7f8afeed2b80 4 client.16539 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:29:49.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.455+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559ecec04070 con 0x559ececbbff0 2024-05-14T09:29:49.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.456+0000 7f8aeda00700 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ececbbff0 0x559ececbe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.457+0000 7f8ad3400700 10 client.16539 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:49.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.457+0000 7f8aeda00700 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ececbbff0 0x559ececbe410 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f198d7588c645309 server_cookie=9ce3c3c06704839e in_seq=0 out_seq=0 2024-05-14T09:29:49.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.458+0000 7f8ad3400700 1 -- 172.21.15.120:0/1152850635 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559ecec04070 con 0x559ececbbff0 2024-05-14T09:29:49.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.458+0000 7f8ad3400700 10 client.16539 handle_command_reply: tid=0 2024-05-14T09:29:49.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.458+0000 7f8afeed2b80 1 client.16539 shutdown 2024-05-14T09:29:49.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec37c50 msgr2=0x559ecec54c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec37c50 0x559ecec54c50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40a93c0 tx=0x7f8ad40038b0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 shutdown_connections 2024-05-14T09:29:49.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x559ececbbff0 0x559ececbe410 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8ad3400700 0 client.16539 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ecec3dbf0 0x559ecec551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559eceab9e40 0x559ecec56c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 --2- 172.21.15.120:0/1152850635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559ecec37c50 0x559ecec54c50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.459+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 >> 172.21.15.120:0/1152850635 conn(0x559eceaf8a80 msgr2=0x559ecec3b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.460+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 shutdown_connections 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.460+0000 7f8afeed2b80 1 -- 172.21.15.120:0/1152850635 wait complete. 2024-05-14T09:29:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.460+0000 7f8afeed2b80 20 client.16539 trim_cache size 0 max 16384 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: "4117a9b9-a712-45e2-922e-9ba06c69a782": { 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "4117a9b9-a712-45e2-922e-9ba06c69a782", 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:29:49.461 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:29:49.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8acc0b2980 msgr2=0x7f8acc0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8acc0b2980 0x7f8acc0b4e90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009840 tx=0x7f8ad8009f30 comp rx=0 tx=0).stop 2024-05-14T09:29:49.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ae8108f20 msgr2=0x7f8ae819d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ae8108f20 0x7f8ae819d550 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4005fd0 tx=0x7f8ad400ee70 comp rx=0 tx=0).stop 2024-05-14T09:29:49.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 shutdown_connections 2024-05-14T09:29:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8acc0b2980 0x7f8acc0b4e90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ae81045f0 0x7f8ae819cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ae8109870 0x7f8ae81a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 --2- 172.21.15.120:0/396390668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ae8108f20 0x7f8ae819d550 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.462+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 >> 172.21.15.120:0/396390668 conn(0x7f8ae8100040 msgr2=0x7f8ae81086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.463+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 shutdown_connections 2024-05-14T09:29:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:29:49.463+0000 7f8af0400700 1 -- 172.21.15.120:0/396390668 wait complete. 2024-05-14T09:29:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.942+0000 7f943b200640 1 -- 172.21.15.120:0/3304704630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c107610 msgr2=0x7f943c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.942+0000 7f943b200640 1 --2- 172.21.15.120:0/3304704630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c107610 0x7f943c107a20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9434009ca0 tx=0x7f943402a8c0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.943+0000 7f943b200640 1 -- 172.21.15.120:0/3304704630 shutdown_connections 2024-05-14T09:29:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.943+0000 7f943b200640 1 --2- 172.21.15.120:0/3304704630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c107610 0x7f943c107a20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.943+0000 7f943b200640 1 --2- 172.21.15.120:0/3304704630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c104cb0 0x7f943c1070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.943+0000 7f943b200640 1 --2- 172.21.15.120:0/3304704630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943c102350 0x7f943c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.943+0000 7f943b200640 1 -- 172.21.15.120:0/3304704630 >> 172.21.15.120:0/3304704630 conn(0x7f943c0fdb60 msgr2=0x7f943c100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.943+0000 7f943b200640 1 -- 172.21.15.120:0/3304704630 shutdown_connections 2024-05-14T09:29:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.943+0000 7f943b200640 1 -- 172.21.15.120:0/3304704630 wait complete. 2024-05-14T09:29:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.944+0000 7f943b200640 1 Processor -- start 2024-05-14T09:29:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.945+0000 7f943b200640 1 -- start start 2024-05-14T09:29:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.947+0000 7f943b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943c102350 0x7f943c071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.947+0000 7f943b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c104cb0 0x7f943c072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.947+0000 7f943b200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c107610 0x7f943c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.947+0000 7f943b200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f943c115a40 con 0x7f943c104cb0 2024-05-14T09:29:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.947+0000 7f943b200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1158c0 con 0x7f943c107610 2024-05-14T09:29:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.947+0000 7f943b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f943c115bc0 con 0x7f943c102350 2024-05-14T09:29:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.948+0000 7f9439400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c104cb0 0x7f943c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.948+0000 7f943a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c107610 0x7f943c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.948+0000 7f943a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c107610 0x7f943c0730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:44372/0 (socket says 172.21.15.120:44372) 2024-05-14T09:29:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.948+0000 7f943a800640 1 -- 172.21.15.120:0/2955985991 learned_addr learned my addr 172.21.15.120:0/2955985991 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.948+0000 7f9439e00640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943c102350 0x7f943c071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.949+0000 7f9439e00640 1 -- 172.21.15.120:0/2955985991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c107610 msgr2=0x7f943c0730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.949+0000 7f9439e00640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c107610 0x7f943c0730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.949+0000 7f9439e00640 1 -- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c104cb0 msgr2=0x7f943c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.949+0000 7f9439e00640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c104cb0 0x7f943c072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.949+0000 7f9439e00640 1 -- 172.21.15.120:0/2955985991 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c073750 con 0x7f943c102350 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.949+0000 7f943a800640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c107610 0x7f943c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.949+0000 7f9439400640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c104cb0 0x7f943c072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.950+0000 7f9439e00640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943c102350 0x7f943c071c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f942c005fd0 tx=0x7f942c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.950+0000 7f9432a00640 1 -- 172.21.15.120:0/2955985991 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c009c00 con 0x7f943c102350 2024-05-14T09:29:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.950+0000 7f9432a00640 1 -- 172.21.15.120:0/2955985991 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f942c0044c0 con 0x7f943c102350 2024-05-14T09:29:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.951+0000 7f9432a00640 1 -- 172.21.15.120:0/2955985991 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c003de0 con 0x7f943c102350 2024-05-14T09:29:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.951+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c073a40 con 0x7f943c102350 2024-05-14T09:29:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.951+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c073fe0 con 0x7f943c102350 2024-05-14T09:29:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.956+0000 7f9447c05740 1 Processor -- start 2024-05-14T09:29:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.956+0000 7f9447c05740 1 -- start start 2024-05-14T09:29:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f9447c05740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a64300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f9447c05740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96992f0 0x55d0c9a64880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f9447c05740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96a14d0 0x55d0c9a6b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f9447c05740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d0c99c8550 con 0x55d0c96a14d0 2024-05-14T09:29:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f9447c05740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0c996dbc0 con 0x55d0c96c21b0 2024-05-14T09:29:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f9447c05740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0c99c4510 con 0x55d0c96992f0 2024-05-14T09:29:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f943a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a64300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f943a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a64300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:44380/0 (socket says 172.21.15.120:44380) 2024-05-14T09:29:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f943a800640 1 -- 172.21.15.120:0/103151786 learned_addr learned my addr 172.21.15.120:0/103151786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.957+0000 7f9439400640 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96a14d0 0x55d0c9a6b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.958+0000 7f943a800640 1 -- 172.21.15.120:0/103151786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96992f0 msgr2=0x55d0c9a64880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:29:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.958+0000 7f943a800640 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96992f0 0x55d0c9a64880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.958+0000 7f943a800640 1 -- 172.21.15.120:0/103151786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96a14d0 msgr2=0x55d0c9a6b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.958+0000 7f943a800640 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96a14d0 0x55d0c9a6b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.958+0000 7f943a800640 1 -- 172.21.15.120:0/103151786 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c96da210 con 0x55d0c96c21b0 2024-05-14T09:29:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.958+0000 7f9432a00640 1 -- 172.21.15.120:0/2955985991 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f942c0035f0 con 0x7f943c102350 2024-05-14T09:29:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.959+0000 7f943a800640 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a64300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f943402ae30 tx=0x7f9434009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29071599fc1ab9e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.959+0000 7f9427000640 1 -- 172.21.15.120:0/103151786 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434031a80 con 0x55d0c96c21b0 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.959+0000 7f9427000640 1 -- 172.21.15.120:0/103151786 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9434036040 con 0x55d0c96c21b0 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.960+0000 7f9427000640 1 -- 172.21.15.120:0/103151786 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434004560 con 0x55d0c96c21b0 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 -- 172.21.15.120:0/103151786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 msgr2=0x55d0c9a64300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a64300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f943402ae30 tx=0x7f9434009a20 comp rx=0 tx=0).stop 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 -- 172.21.15.120:0/103151786 shutdown_connections 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96a14d0 0x55d0c9a6b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96992f0 0x55d0c9a64880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 --2- 172.21.15.120:0/103151786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a64300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 -- 172.21.15.120:0/103151786 >> 172.21.15.120:0/103151786 conn(0x55d0c96b6300 msgr2=0x55d0c9a5fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.961+0000 7f9447c05740 1 -- 172.21.15.120:0/103151786 shutdown_connections 2024-05-14T09:29:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.962+0000 7f9447c05740 1 -- 172.21.15.120:0/103151786 wait complete. 2024-05-14T09:29:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.962+0000 7f9432a00640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f94200b27c0 0x7f94200b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.962+0000 7f9432a00640 1 -- 172.21.15.120:0/2955985991 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f942c0e2080 con 0x7f943c102350 2024-05-14T09:29:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.963+0000 7f9439400640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f94200b27c0 0x7f94200b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.964+0000 7f9447c05740 1 -- start start 2024-05-14T09:29:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.964+0000 7f9439400640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f94200b27c0 0x7f94200b4cd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55d0c9a60a20 tx=0x7f942800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.964+0000 7f9447c05740 1 Processor -- start 2024-05-14T09:29:49.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.965+0000 7f9447c05740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.965+0000 7f9439e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.965+0000 7f9439e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55122/0 (socket says 172.21.15.120:55122) 2024-05-14T09:29:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.965+0000 7f9439e00640 1 -- 172.21.15.120:0/4164979892 learned_addr learned my addr 172.21.15.120:0/4164979892 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.965+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 0x55d0c9a6e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a75260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d0c9a6c170 con 0x55d0c96992f0 2024-05-14T09:29:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0c9981660 con 0x55d0c96c21b0 2024-05-14T09:29:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0c9a6c2f0 con 0x55d0c96a14d0 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9447c05740 10 client.0 _ll_register_callbacks cb 0x55d0c994b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9439e00640 1 -- 172.21.15.120:0/4164979892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 msgr2=0x55d0c9a6e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9439e00640 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 0x55d0c9a6e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9439e00640 1 -- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 msgr2=0x55d0c9a75260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9439e00640 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a75260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9439e00640 1 -- 172.21.15.120:0/4164979892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c97a6620 con 0x55d0c96992f0 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.966+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9434036040 con 0x55d0c96992f0 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.967+0000 7f9439e00640 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6ddc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f942c0a8fa0 tx=0x7f942c0a9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0b465ade46aea4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.967+0000 7f941b400640 10 client.16551 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.967+0000 7f941b400640 1 -- 172.21.15.120:0/4164979892 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c020040 con 0x55d0c96992f0 2024-05-14T09:29:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.967+0000 7f941b400640 1 -- 172.21.15.120:0/4164979892 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f942c0ad120 con 0x55d0c96992f0 2024-05-14T09:29:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.967+0000 7f941b400640 1 -- 172.21.15.120:0/4164979892 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f942c0a8a10 con 0x55d0c96992f0 2024-05-14T09:29:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.968+0000 7f9447c05740 10 client.16551 fetch_fsmap learned FSMap version 44 2024-05-14T09:29:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.968+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55d0c9a78120 con 0x55d0c96992f0 2024-05-14T09:29:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.968+0000 7f941b400640 1 -- 172.21.15.120:0/4164979892 <== mon.0 v2:172.21.15.120:3300/0 4 ==== fsmap(e 44) ==== 8378+0+0 (secure 0 0 0) 0x7f942c0a4c10 con 0x55d0c96992f0 2024-05-14T09:29:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.968+0000 7f9447c05740 10 client.16551 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T09:29:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.968+0000 7f9447c05740 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.968+0000 7f9447c05740 20 client.16551 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.968+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c9680d80 0x55d0c9a7b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.969+0000 7f9447c05740 4 client.16551 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:29:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.969+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0c99d6160 con 0x55d0c9680d80 2024-05-14T09:29:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.969+0000 7f9439400640 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c9680d80 0x55d0c9a7b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.970+0000 7f9439400640 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c9680d80 0x55d0c9a7b7e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=246acb53aceb294a server_cookie=2c409574572681de in_seq=0 out_seq=0 2024-05-14T09:29:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.970+0000 7f941b400640 10 client.16551 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.972+0000 7f941b400640 1 -- 172.21.15.120:0/4164979892 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d0c99d6160 con 0x55d0c9680d80 2024-05-14T09:29:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.972+0000 7f941b400640 10 client.16551 handle_command_reply: tid=0 2024-05-14T09:29:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.972+0000 7f9447c05740 1 client.16551 shutdown 2024-05-14T09:29:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.973+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 msgr2=0x55d0c9a6ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.973+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6ddc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f942c0a8fa0 tx=0x7f942c0a9800 comp rx=0 tx=0).stop 2024-05-14T09:29:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.973+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 shutdown_connections 2024-05-14T09:29:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.973+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c9680d80 0x55d0c9a7b7e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.973+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9a75260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.973+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 0x55d0c9a6e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.973+0000 7f9447c05740 1 --2- 172.21.15.120:0/4164979892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6ddc0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.974+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 >> 172.21.15.120:0/4164979892 conn(0x55d0c96b6300 msgr2=0x55d0c9a5ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.974+0000 7f941b400640 0 client.16551 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.974+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 shutdown_connections 2024-05-14T09:29:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.974+0000 7f9447c05740 1 -- 172.21.15.120:0/4164979892 wait complete. 2024-05-14T09:29:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:49.975+0000 7f9447c05740 20 client.16551 trim_cache size 0 max 16384 2024-05-14T09:29:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.003+0000 7f9447c05740 1 Processor -- start 2024-05-14T09:29:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.003+0000 7f9447c05740 1 -- start start 2024-05-14T09:29:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.004+0000 7f9447c05740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.004+0000 7f9447c05740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96a14d0 0x55d0c9a631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.004+0000 7f9447c05740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96c21b0 0x55d0c9a636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.004+0000 7f9447c05740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1bb6f0 con 0x55d0c96992f0 2024-05-14T09:29:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.004+0000 7f9447c05740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1bd2f0 con 0x55d0c96a14d0 2024-05-14T09:29:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.004+0000 7f9447c05740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1bbdc0 con 0x55d0c96c21b0 2024-05-14T09:29:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.005+0000 7f943a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96c21b0 0x55d0c9a636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.005+0000 7f943a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96c21b0 0x55d0c9a636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50122/0 (socket says 172.21.15.120:50122) 2024-05-14T09:29:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.005+0000 7f943a800640 1 -- 172.21.15.120:0/2021334967 learned_addr learned my addr 172.21.15.120:0/2021334967 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.005+0000 7f9439400640 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96a14d0 0x55d0c9a631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.005+0000 7f9439e00640 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.006+0000 7f943a800640 1 -- 172.21.15.120:0/2021334967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96a14d0 msgr2=0x55d0c9a631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.006+0000 7f943a800640 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96a14d0 0x55d0c9a631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.006+0000 7f943a800640 1 -- 172.21.15.120:0/2021334967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 msgr2=0x55d0c9a6e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.006+0000 7f943a800640 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.006+0000 7f943a800640 1 -- 172.21.15.120:0/2021334967 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c9a5b4a0 con 0x55d0c96c21b0 2024-05-14T09:29:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.006+0000 7f9439e00640 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:29:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.007+0000 7f943a800640 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96c21b0 0x55d0c9a636e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f94340319e0 tx=0x7f943402a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64b0f299a7766ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.007+0000 7f9426600640 1 -- 172.21.15.120:0/2021334967 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943404a040 con 0x55d0c96c21b0 2024-05-14T09:29:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.008+0000 7f9426600640 1 -- 172.21.15.120:0/2021334967 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9434003970 con 0x55d0c96c21b0 2024-05-14T09:29:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.008+0000 7f9426600640 1 -- 172.21.15.120:0/2021334967 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434004400 con 0x55d0c96c21b0 2024-05-14T09:29:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.009+0000 7f9447c05740 1 -- 172.21.15.120:0/2021334967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96c21b0 msgr2=0x55d0c9a636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.009+0000 7f9447c05740 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96c21b0 0x55d0c9a636e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f94340319e0 tx=0x7f943402a8c0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.009+0000 7f9447c05740 1 -- 172.21.15.120:0/2021334967 shutdown_connections 2024-05-14T09:29:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.009+0000 7f9447c05740 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96c21b0 0x55d0c9a636e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.009+0000 7f9447c05740 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96a14d0 0x55d0c9a631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.009+0000 7f9447c05740 1 --2- 172.21.15.120:0/2021334967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a6e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.009+0000 7f9447c05740 1 -- 172.21.15.120:0/2021334967 >> 172.21.15.120:0/2021334967 conn(0x55d0c96b6300 msgr2=0x55d0c9a62a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.010+0000 7f9447c05740 1 -- 172.21.15.120:0/2021334967 shutdown_connections 2024-05-14T09:29:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.010+0000 7f9447c05740 1 -- 172.21.15.120:0/2021334967 wait complete. 2024-05-14T09:29:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.011+0000 7f9447c05740 1 -- start start 2024-05-14T09:29:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.011+0000 7f9447c05740 1 Processor -- start 2024-05-14T09:29:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9447c05740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a74a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9447c05740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 0x55d0c9a74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9447c05740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9ae1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9447c05740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1bcbc0 con 0x55d0c96992f0 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9439e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a74a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9439e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a74a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55130/0 (socket says 172.21.15.120:55130) 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9439e00640 1 -- 172.21.15.120:0/3634537288 learned_addr learned my addr 172.21.15.120:0/3634537288 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f943a800640 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9ae1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1bc4f0 con 0x55d0c96c21b0 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1b96f0 con 0x55d0c96a14d0 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9447c05740 10 client.0 _ll_register_callbacks cb 0x7f942c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:29:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.012+0000 7f9439400640 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 0x55d0c9a74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.013+0000 7f943a800640 1 -- 172.21.15.120:0/3634537288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 msgr2=0x55d0c9a74f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.013+0000 7f943a800640 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 0x55d0c9a74f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.013+0000 7f943a800640 1 -- 172.21.15.120:0/3634537288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 msgr2=0x55d0c9a74a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:29:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.013+0000 7f943a800640 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a74a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.013+0000 7f943a800640 1 -- 172.21.15.120:0/3634537288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c9ae20c0 con 0x55d0c96c21b0 2024-05-14T09:29:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.014+0000 7f943a800640 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9ae1b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9434005e30 tx=0x7f94340098f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a75c759eb101167 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:29:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.014+0000 7f941b400640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:29:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.014+0000 7f941b400640 1 -- 172.21.15.120:0/3634537288 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943405b030 con 0x55d0c96c21b0 2024-05-14T09:29:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.015+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9434003970 con 0x55d0c96c21b0 2024-05-14T09:29:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.015+0000 7f941b400640 1 -- 172.21.15.120:0/3634537288 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f943405c070 con 0x55d0c96c21b0 2024-05-14T09:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.016+0000 7f941b400640 1 -- 172.21.15.120:0/3634537288 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9434066050 con 0x55d0c96c21b0 2024-05-14T09:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.016+0000 7f9447c05740 10 client.36032 fetch_fsmap learned FSMap version 44 2024-05-14T09:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.016+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55d0c9ae32e0 con 0x55d0c96c21b0 2024-05-14T09:29:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.017+0000 7f941b400640 1 -- 172.21.15.120:0/3634537288 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9434003970 con 0x55d0c96c21b0 2024-05-14T09:29:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.017+0000 7f941b400640 1 -- 172.21.15.120:0/3634537288 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 44) ==== 8378+0+0 (secure 0 0 0) 0x7f943404d070 con 0x55d0c96c21b0 2024-05-14T09:29:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.017+0000 7f9447c05740 10 client.36032 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T09:29:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.017+0000 7f9447c05740 10 client.36032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:29:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.017+0000 7f9447c05740 20 client.36032 populate_metadata read hostname 'smithi120' 2024-05-14T09:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.017+0000 7f9447c05740 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c96561c0 0x55d0c9ae5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.018+0000 7f9447c05740 4 client.36032 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.018+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0c99cffd0 con 0x55d0c96561c0 2024-05-14T09:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.018+0000 7f9439e00640 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c96561c0 0x55d0c9ae5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:29:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.019+0000 7f941b400640 10 client.36032 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.020+0000 7f9439e00640 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c96561c0 0x55d0c9ae5c10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cda5db2d513770e server_cookie=6f9812c6139279f2 in_seq=0 out_seq=0 2024-05-14T09:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.057+0000 7f941b400640 1 -- 172.21.15.120:0/3634537288 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0c99cffd0 con 0x55d0c96561c0 2024-05-14T09:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.057+0000 7f941b400640 10 client.36032 handle_command_reply: tid=0 2024-05-14T09:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.057+0000 7f9447c05740 1 client.36032 shutdown 2024-05-14T09:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.057+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 msgr2=0x55d0c9ae1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.057+0000 7f9447c05740 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9ae1b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9434005e30 tx=0x7f94340098f0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 shutdown_connections 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0c96561c0 0x55d0c9ae5c10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0c96c21b0 0x55d0c9ae1b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0c96a14d0 0x55d0c9a74f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 --2- 172.21.15.120:0/3634537288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0c96992f0 0x55d0c9a74a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 >> 172.21.15.120:0/3634537288 conn(0x55d0c96b6300 msgr2=0x55d0c9a634c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f941b400640 0 client.36032 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 shutdown_connections 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 1 -- 172.21.15.120:0/3634537288 wait complete. 2024-05-14T09:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.059+0000 7f9447c05740 20 client.36032 trim_cache size 0 max 16384 2024-05-14T09:29:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:29:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:29:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:29:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f94200b27c0 msgr2=0x7f94200b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f94200b27c0 0x7f94200b4cd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55d0c9a60a20 tx=0x7f942800b390 comp rx=0 tx=0).stop 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943c102350 msgr2=0x7f943c071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943c102350 0x7f943c071c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f942c005fd0 tx=0x7f942c00dde0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 shutdown_connections 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f94200b27c0 0x7f94200b4cd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943c107610 0x7f943c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f943c104cb0 0x7f943c072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 --2- 172.21.15.120:0/2955985991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943c102350 0x7f943c071c40 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f942c005fd0 tx=0x7f942c00dde0 comp rx=0 tx=0).stop 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.060+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 >> 172.21.15.120:0/2955985991 conn(0x7f943c0fdb60 msgr2=0x7f943c103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.061+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 shutdown_connections 2024-05-14T09:29:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:29:50.061+0000 7f943b200640 1 -- 172.21.15.120:0/2955985991 wait complete. 2024-05-14T09:29:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[31080]: 2024-05-14T09:29:49.798+0000 7fa7d9e00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T09:29:50.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:49 smithi120 ceph-mon[31085]: pgmap v744: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 16 MiB/s wr, 758 op/s 2024-05-14T09:29:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:49 smithi152 ceph-mon[34868]: pgmap v744: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 16 MiB/s wr, 758 op/s 2024-05-14T09:29:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:49 smithi175 ceph-mon[35353]: pgmap v744: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 16 MiB/s wr, 758 op/s 2024-05-14T09:29:50.811 INFO:tasks.cephfs.filesystem:scrub status for tag:4117a9b9-a712-45e2-922e-9ba06c69a782 - {'path': '/', 'tag': '4117a9b9-a712-45e2-922e-9ba06c69a782', 'options': 'recursive,force'} 2024-05-14T09:29:51.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:50 smithi120 ceph-mon[31085]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T09:29:51.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:50 smithi120 ceph-mon[31085]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:active 2024-05-14T09:29:51.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:50 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:50 smithi152 ceph-mon[34868]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T09:29:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:50 smithi152 ceph-mon[34868]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:active 2024-05-14T09:29:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:50 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:51.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:50 smithi175 ceph-mon[35353]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T09:29:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:50 smithi175 ceph-mon[35353]: mds.? [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] up:active 2024-05-14T09:29:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:50 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:51 smithi120 ceph-mon[31085]: pgmap v745: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 15 MiB/s wr, 672 op/s 2024-05-14T09:29:52.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:51 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:51 smithi152 ceph-mon[34868]: pgmap v745: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 15 MiB/s wr, 672 op/s 2024-05-14T09:29:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:51 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:51 smithi175 ceph-mon[35353]: pgmap v745: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 15 MiB/s wr, 672 op/s 2024-05-14T09:29:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:51 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:29:53.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:52 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:29:53.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:52 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:29:53.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:52 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:29:53.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:52 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:29:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:52 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:29:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:52 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:29:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:52 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:29:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:52 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:29:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:52 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:29:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:52 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:29:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:52 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:29:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:52 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:29:54.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:53 smithi120 ceph-mon[31085]: scrub summary: idle 2024-05-14T09:29:54.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:53 smithi120 ceph-mon[31085]: pgmap v746: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 13 MiB/s wr, 613 op/s 2024-05-14T09:29:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:53 smithi152 ceph-mon[34868]: scrub summary: idle 2024-05-14T09:29:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:53 smithi152 ceph-mon[34868]: pgmap v746: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 13 MiB/s wr, 613 op/s 2024-05-14T09:29:54.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:53 smithi175 ceph-mon[35353]: scrub summary: idle 2024-05-14T09:29:54.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:53 smithi175 ceph-mon[35353]: pgmap v746: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 13 MiB/s wr, 613 op/s 2024-05-14T09:29:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 140.0 s, 694.0 tps, lat 139.802 ms stddev 227.850 2024-05-14T09:29:56.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:55 smithi120 ceph-mon[31085]: pgmap v747: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 14 MiB/s wr, 619 op/s 2024-05-14T09:29:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:55 smithi152 ceph-mon[34868]: pgmap v747: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 14 MiB/s wr, 619 op/s 2024-05-14T09:29:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:55 smithi175 ceph-mon[35353]: pgmap v747: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 14 MiB/s wr, 619 op/s 2024-05-14T09:29:58.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:57 smithi120 ceph-mon[31085]: pgmap v748: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 14 MiB/s wr, 658 op/s 2024-05-14T09:29:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:57 smithi152 ceph-mon[34868]: pgmap v748: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 14 MiB/s wr, 658 op/s 2024-05-14T09:29:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:57 smithi175 ceph-mon[35353]: pgmap v748: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 14 MiB/s wr, 658 op/s 2024-05-14T09:29:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 145.0 s, 569.4 tps, lat 181.319 ms stddev 338.608 2024-05-14T09:30:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:29:59 smithi120 ceph-mon[31085]: pgmap v749: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 16 MiB/s wr, 681 op/s 2024-05-14T09:30:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[31080]: 2024-05-14T09:29:59.999+0000 7fa7d9e00700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:30:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[31080]: 2024-05-14T09:29:59.999+0000 7fa7d9e00700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T09:30:00.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[31080]: 2024-05-14T09:29:59.999+0000 7fa7d9e00700 -1 log_channel(cluster) log [ERR] : mds.c(mds.4): Metadata damage detected 2024-05-14T09:30:00.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:29:59 smithi152 ceph-mon[34868]: pgmap v749: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 16 MiB/s wr, 681 op/s 2024-05-14T09:30:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:29:59 smithi175 ceph-mon[35353]: pgmap v749: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 16 MiB/s wr, 681 op/s 2024-05-14T09:30:01.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:00 smithi120 ceph-mon[31085]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:30:01.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:00 smithi120 ceph-mon[31085]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T09:30:01.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:00 smithi120 ceph-mon[31085]: mds.c(mds.4): Metadata damage detected 2024-05-14T09:30:01.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:00 smithi152 ceph-mon[34868]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:30:01.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:00 smithi152 ceph-mon[34868]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T09:30:01.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:00 smithi152 ceph-mon[34868]: mds.c(mds.4): Metadata damage detected 2024-05-14T09:30:01.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:00 smithi175 ceph-mon[35353]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:30:01.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:00 smithi175 ceph-mon[35353]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T09:30:01.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:00 smithi175 ceph-mon[35353]: mds.c(mds.4): Metadata damage detected 2024-05-14T09:30:02.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:01 smithi152 ceph-mon[34868]: pgmap v750: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 639 op/s 2024-05-14T09:30:02.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:01 smithi175 ceph-mon[35353]: pgmap v750: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 639 op/s 2024-05-14T09:30:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:01 smithi120 ceph-mon[31085]: pgmap v750: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 639 op/s 2024-05-14T09:30:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.379+0000 7f1d22c00640 1 -- 172.21.15.120:0/1348651450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10ffe0 msgr2=0x7f1d1c1103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.379+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1348651450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1103f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009ca0 tx=0x7f1d1402a8c0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.381+0000 7f1d22c00640 1 -- 172.21.15.120:0/1348651450 shutdown_connections 2024-05-14T09:30:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.381+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1348651450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1103f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.381+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1348651450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d1c10b2c0 0x7f1d1c10b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.381+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1348651450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10a470 0x7f1d1c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.381+0000 7f1d22c00640 1 -- 172.21.15.120:0/1348651450 >> 172.21.15.120:0/1348651450 conn(0x7f1d1c070460 msgr2=0x7f1d1c072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.381+0000 7f1d22c00640 1 -- 172.21.15.120:0/1348651450 shutdown_connections 2024-05-14T09:30:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.382+0000 7f1d22c00640 1 -- 172.21.15.120:0/1348651450 wait complete. 2024-05-14T09:30:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.383+0000 7f1d22c00640 1 Processor -- start 2024-05-14T09:30:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.385+0000 7f1d22c00640 1 -- start start 2024-05-14T09:30:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d22c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d1c10a470 0x7f1d1c1a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d22c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10b2c0 0x7f1d1c1a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d22c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d22c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c11e270 con 0x7f1d1c10b2c0 2024-05-14T09:30:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d22c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c11e0f0 con 0x7f1d1c10a470 2024-05-14T09:30:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d22c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c11e3f0 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d21800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d1c10a470 0x7f1d1c1a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.386+0000 7f1d22200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d22200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:41280/0 (socket says 172.21.15.120:41280) 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d22200640 1 -- 172.21.15.120:0/1777202145 learned_addr learned my addr 172.21.15.120:0/1777202145 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d20e00640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10b2c0 0x7f1d1c1a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d22200640 1 -- 172.21.15.120:0/1777202145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d1c10a470 msgr2=0x7f1d1c1a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d22200640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d1c10a470 0x7f1d1c1a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d22200640 1 -- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10b2c0 msgr2=0x7f1d1c1a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d22200640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10b2c0 0x7f1d1c1a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.387+0000 7f1d22200640 1 -- 172.21.15.120:0/1777202145 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c1b0980 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.388+0000 7f1d22200640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1b0310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031920 tx=0x7f1d14009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.389+0000 7f1d1a000640 1 -- 172.21.15.120:0/1777202145 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14003c70 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.389+0000 7f1d1a000640 1 -- 172.21.15.120:0/1777202145 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d14003e10 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.389+0000 7f1d1a000640 1 -- 172.21.15.120:0/1777202145 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14030bf0 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.390+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c1b0c10 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.390+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c1b10e0 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.394+0000 7f1d2b1f5740 1 Processor -- start 2024-05-14T09:30:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.396+0000 7f1d1a000640 1 -- 172.21.15.120:0/1777202145 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1d14004040 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.397+0000 7f1d2b1f5740 1 -- start start 2024-05-14T09:30:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.397+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996f51b0 0x562a99a97300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.397+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996cc2f0 0x562a99a97880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.397+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996d44d0 0x562a99a9e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.397+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562a999fb550 con 0x562a996d44d0 2024-05-14T09:30:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.397+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562a999a0bc0 con 0x562a996cc2f0 2024-05-14T09:30:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.397+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562a999f7510 con 0x562a996f51b0 2024-05-14T09:30:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.398+0000 7f1d21800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996cc2f0 0x562a99a97880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.398+0000 7f1d21800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996cc2f0 0x562a99a97880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33550/0 (socket says 172.21.15.120:33550) 2024-05-14T09:30:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.398+0000 7f1d21800640 1 -- 172.21.15.120:0/3654166192 learned_addr learned my addr 172.21.15.120:0/3654166192 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d1a000640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1d040b2860 0x7f1d040b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d20e00640 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996d44d0 0x562a99a9e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d1a000640 1 -- 172.21.15.120:0/1777202145 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1d14103c30 con 0x7f1d1c10ffe0 2024-05-14T09:30:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d20e00640 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996f51b0 0x562a99a97300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d22200640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1d040b2860 0x7f1d040b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d21800640 1 -- 172.21.15.120:0/3654166192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996f51b0 msgr2=0x562a99a97300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d21800640 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996f51b0 0x562a99a97300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d21800640 1 -- 172.21.15.120:0/3654166192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996d44d0 msgr2=0x562a99a9e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d21800640 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996d44d0 0x562a99a9e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.399+0000 7f1d21800640 1 -- 172.21.15.120:0/3654166192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9970d210 con 0x562a996cc2f0 2024-05-14T09:30:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.400+0000 7f1d22200640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1d040b2860 0x7f1d040b4d70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1d140cabb0 tx=0x7f1d14009580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.400+0000 7f1d21800640 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996cc2f0 0x562a99a97880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009c10 tx=0x7f1d100117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11f6be9a7506075 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.401+0000 7f1d0ea00640 1 -- 172.21.15.120:0/3654166192 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10012450 con 0x562a996cc2f0 2024-05-14T09:30:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.401+0000 7f1d0ea00640 1 -- 172.21.15.120:0/3654166192 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d10012a80 con 0x562a996cc2f0 2024-05-14T09:30:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.401+0000 7f1d0ea00640 1 -- 172.21.15.120:0/3654166192 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000f9b0 con 0x562a996cc2f0 2024-05-14T09:30:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3654166192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996cc2f0 msgr2=0x562a99a97880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996cc2f0 0x562a99a97880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009c10 tx=0x7f1d100117b0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3654166192 shutdown_connections 2024-05-14T09:30:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996d44d0 0x562a99a9e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996cc2f0 0x562a99a97880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3654166192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996f51b0 0x562a99a97300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3654166192 >> 172.21.15.120:0/3654166192 conn(0x562a996e9300 msgr2=0x562a99a92c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.403+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3654166192 shutdown_connections 2024-05-14T09:30:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.404+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3654166192 wait complete. 2024-05-14T09:30:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.405+0000 7f1d2b1f5740 1 -- start start 2024-05-14T09:30:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.405+0000 7f1d2b1f5740 1 Processor -- start 2024-05-14T09:30:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99aa0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99aa1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562a99a9f1d0 con 0x562a996cc2f0 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562a999b4660 con 0x562a996f51b0 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562a99a9f350 con 0x562a996d44d0 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d2b1f5740 10 client.0 _ll_register_callbacks cb 0x562a9997e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d20e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99aa0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d20e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99aa0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46352/0 (socket says 172.21.15.120:46352) 2024-05-14T09:30:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.407+0000 7f1d20e00640 1 -- 172.21.15.120:0/2849121785 learned_addr learned my addr 172.21.15.120:0/2849121785 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.408+0000 7f1d21800640 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99aa1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.408+0000 7f1d20e00640 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.408+0000 7f1d20e00640 1 -- 172.21.15.120:0/2849121785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 msgr2=0x562a99aa1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.408+0000 7f1d20e00640 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99aa1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.408+0000 7f1d20e00640 1 -- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 msgr2=0x562a99aa82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.408+0000 7f1d20e00640 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.408+0000 7f1d20e00640 1 -- 172.21.15.120:0/2849121785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a997d9620 con 0x562a996cc2f0 2024-05-14T09:30:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.409+0000 7f1d20e00640 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99aa0e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1d08013e50 tx=0x7f1d08005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caddd3322756596 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.410+0000 7f1d03400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.410+0000 7f1d03400640 1 -- 172.21.15.120:0/2849121785 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08011e80 con 0x562a996cc2f0 2024-05-14T09:30:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.410+0000 7f1d03400640 1 -- 172.21.15.120:0/2849121785 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1d08013020 con 0x562a996cc2f0 2024-05-14T09:30:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.410+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d10012a80 con 0x562a996cc2f0 2024-05-14T09:30:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.411+0000 7f1d03400640 1 -- 172.21.15.120:0/2849121785 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1d0802a050 con 0x562a996cc2f0 2024-05-14T09:30:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.411+0000 7f1d2b1f5740 10 client.16569 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.411+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x562a99aab0b0 con 0x562a996cc2f0 2024-05-14T09:30:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d03400640 1 -- 172.21.15.120:0/2849121785 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d10012a80 con 0x562a996cc2f0 2024-05-14T09:30:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d03400640 1 -- 172.21.15.120:0/2849121785 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f1d08003930 con 0x562a996cc2f0 2024-05-14T09:30:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d2b1f5740 10 client.16569 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d2b1f5740 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d2b1f5740 20 client.16569 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996b3d80 0x562a99aae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d2b1f5740 4 client.16569 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.412+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a99a09160 con 0x562a996b3d80 2024-05-14T09:30:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.413+0000 7f1d21800640 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996b3d80 0x562a99aae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.415+0000 7f1d03400640 10 client.16569 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.415+0000 7f1d21800640 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996b3d80 0x562a99aae740 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=874d11020bfd46e8 server_cookie=362c522656da2d7f in_seq=0 out_seq=0 2024-05-14T09:30:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.417+0000 7f1d03400640 1 -- 172.21.15.120:0/2849121785 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562a99a09160 con 0x562a996b3d80 2024-05-14T09:30:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.417+0000 7f1d03400640 10 client.16569 handle_command_reply: tid=0 2024-05-14T09:30:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.417+0000 7f1d2b1f5740 1 client.16569 shutdown 2024-05-14T09:30:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.418+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 msgr2=0x562a99aa0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.418+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99aa0e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1d08013e50 tx=0x7f1d08005f90 comp rx=0 tx=0).stop 2024-05-14T09:30:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 shutdown_connections 2024-05-14T09:30:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996b3d80 0x562a99aae740 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99aa1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/2849121785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99aa0e20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 >> 172.21.15.120:0/2849121785 conn(0x562a996e9300 msgr2=0x562a99a95ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d03400640 0 client.16569 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 shutdown_connections 2024-05-14T09:30:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.419+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/2849121785 wait complete. 2024-05-14T09:30:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.420+0000 7f1d2b1f5740 20 client.16569 trim_cache size 0 max 16384 2024-05-14T09:30:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.455+0000 7f1d2b1f5740 1 Processor -- start 2024-05-14T09:30:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.455+0000 7f1d2b1f5740 1 -- start start 2024-05-14T09:30:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.456+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99a923a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.456+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99a928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.456+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.456+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1bb700 con 0x562a996cc2f0 2024-05-14T09:30:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.456+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1bd2d0 con 0x562a996f51b0 2024-05-14T09:30:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.456+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1bbdd0 con 0x562a996d44d0 2024-05-14T09:30:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.457+0000 7f1d20e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99a923a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.457+0000 7f1d20e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99a923a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46354/0 (socket says 172.21.15.120:46354) 2024-05-14T09:30:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.457+0000 7f1d20e00640 1 -- 172.21.15.120:0/534025343 learned_addr learned my addr 172.21.15.120:0/534025343 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.457+0000 7f1d20e00640 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.457+0000 7f1d21800640 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99a928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.458+0000 7f1d21800640 1 -- 172.21.15.120:0/534025343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 msgr2=0x562a99aa8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.458+0000 7f1d21800640 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.458+0000 7f1d21800640 1 -- 172.21.15.120:0/534025343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 msgr2=0x562a99a923a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.458+0000 7f1d21800640 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99a923a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.458+0000 7f1d21800640 1 -- 172.21.15.120:0/534025343 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a99a8e4a0 con 0x562a996d44d0 2024-05-14T09:30:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.458+0000 7f1d20e00640 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99a923a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.458+0000 7f1d21800640 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99a928e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x562a99aa1e90 tx=0x7f1d100096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2d576d0cd83bdfc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.459+0000 7f1d0e000640 1 -- 172.21.15.120:0/534025343 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10012dd0 con 0x562a996d44d0 2024-05-14T09:30:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.459+0000 7f1d0e000640 1 -- 172.21.15.120:0/534025343 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d10009e60 con 0x562a996d44d0 2024-05-14T09:30:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.459+0000 7f1d0e000640 1 -- 172.21.15.120:0/534025343 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100128a0 con 0x562a996d44d0 2024-05-14T09:30:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/534025343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 msgr2=0x562a99a928e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99a928e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x562a99aa1e90 tx=0x7f1d100096e0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/534025343 shutdown_connections 2024-05-14T09:30:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996f51b0 0x562a99aa8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996d44d0 0x562a99a928e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/534025343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996cc2f0 0x562a99a923a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/534025343 >> 172.21.15.120:0/534025343 conn(0x562a996e9300 msgr2=0x562a99a9b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/534025343 shutdown_connections 2024-05-14T09:30:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.461+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/534025343 wait complete. 2024-05-14T09:30:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.462+0000 7f1d2b1f5740 1 -- start start 2024-05-14T09:30:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.462+0000 7f1d2b1f5740 1 Processor -- start 2024-05-14T09:30:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996cc2f0 0x562a99aa5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996d44d0 0x562a99aa6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d2b1f5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996f51b0 0x562a99aa7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1bcba0 con 0x562a996f51b0 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1bc4d0 con 0x562a996d44d0 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d2b1f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1b9700 con 0x562a996cc2f0 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d2b1f5740 10 client.0 _ll_register_callbacks cb 0x7f1d08009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d21800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996d44d0 0x562a99aa6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.463+0000 7f1d20e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996cc2f0 0x562a99aa5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.464+0000 7f1d21800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996d44d0 0x562a99aa6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33582/0 (socket says 172.21.15.120:33582) 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.464+0000 7f1d21800640 1 -- 172.21.15.120:0/3917431510 learned_addr learned my addr 172.21.15.120:0/3917431510 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.464+0000 7f1d20e00640 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996f51b0 0x562a99aa7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.465+0000 7f1d20e00640 1 -- 172.21.15.120:0/3917431510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996cc2f0 msgr2=0x562a99aa5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.465+0000 7f1d20e00640 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996cc2f0 0x562a99aa5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.465+0000 7f1d20e00640 1 -- 172.21.15.120:0/3917431510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996d44d0 msgr2=0x562a99aa6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.465+0000 7f1d20e00640 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996d44d0 0x562a99aa6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.465+0000 7f1d20e00640 1 -- 172.21.15.120:0/3917431510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a99aa7710 con 0x562a996f51b0 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.466+0000 7f1d20e00640 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996f51b0 0x562a99aa7150 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1d08013d10 tx=0x7f1d08013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f71c4eb0ea832f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.466+0000 7f1d03400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.466+0000 7f1d03400640 1 -- 172.21.15.120:0/3917431510 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08005850 con 0x562a996f51b0 2024-05-14T09:30:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.466+0000 7f1d03400640 1 -- 172.21.15.120:0/3917431510 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1d080050e0 con 0x562a996f51b0 2024-05-14T09:30:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.467+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d10009e60 con 0x562a996f51b0 2024-05-14T09:30:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.467+0000 7f1d03400640 1 -- 172.21.15.120:0/3917431510 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1d08040050 con 0x562a996f51b0 2024-05-14T09:30:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.468+0000 7f1d2b1f5740 10 client.16575 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.468+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x562a99aa89a0 con 0x562a996f51b0 2024-05-14T09:30:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.468+0000 7f1d03400640 1 -- 172.21.15.120:0/3917431510 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d08022420 con 0x562a996f51b0 2024-05-14T09:30:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.469+0000 7f1d03400640 1 -- 172.21.15.120:0/3917431510 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f1d0802e400 con 0x562a996f51b0 2024-05-14T09:30:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.469+0000 7f1d2b1f5740 10 client.16575 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.469+0000 7f1d2b1f5740 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.469+0000 7f1d2b1f5740 20 client.16575 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.469+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996891c0 0x562a99b18f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.469+0000 7f1d2b1f5740 4 client.16575 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:30:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.469+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f1d10009e60 con 0x562a996891c0 2024-05-14T09:30:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.470+0000 7f1d21800640 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996891c0 0x562a99b18f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.472+0000 7f1d21800640 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996891c0 0x562a99b18f40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb9c24f1a22f6ce server_cookie=45a80ad3a01ea9af in_seq=0 out_seq=0 2024-05-14T09:30:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.472+0000 7f1d03400640 10 client.16575 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.515+0000 7f1d03400640 1 -- 172.21.15.120:0/3917431510 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f1d10009e60 con 0x562a996891c0 2024-05-14T09:30:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.515+0000 7f1d03400640 10 client.16575 handle_command_reply: tid=0 2024-05-14T09:30:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.515+0000 7f1d2b1f5740 1 client.16575 shutdown 2024-05-14T09:30:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.515+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996f51b0 msgr2=0x562a99aa7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.515+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996f51b0 0x562a99aa7150 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1d08013d10 tx=0x7f1d08013b70 comp rx=0 tx=0).stop 2024-05-14T09:30:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.516+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 shutdown_connections 2024-05-14T09:30:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.516+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562a996891c0 0x562a99b18f40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.516+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562a996f51b0 0x562a99aa7150 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.516+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562a996d44d0 0x562a99aa6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.516+0000 7f1d2b1f5740 1 --2- 172.21.15.120:0/3917431510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a996cc2f0 0x562a99aa5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.516+0000 7f1d03400640 0 client.16575 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.516+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 >> 172.21.15.120:0/3917431510 conn(0x562a996e9300 msgr2=0x562a99a91250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.517+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 shutdown_connections 2024-05-14T09:30:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.517+0000 7f1d2b1f5740 1 -- 172.21.15.120:0/3917431510 wait complete. 2024-05-14T09:30:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.517+0000 7f1d2b1f5740 20 client.16575 trim_cache size 0 max 16384 2024-05-14T09:30:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:30:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:30:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:30:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:30:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1d040b2860 msgr2=0x7f1d040b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1d040b2860 0x7f1d040b4d70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1d140cabb0 tx=0x7f1d14009580 comp rx=0 tx=0).stop 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10ffe0 msgr2=0x7f1d1c1b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1b0310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031920 tx=0x7f1d14009870 comp rx=0 tx=0).stop 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 shutdown_connections 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1d040b2860 0x7f1d040b4d70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c10ffe0 0x7f1d1c1b0310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d1c10b2c0 0x7f1d1c1a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 --2- 172.21.15.120:0/1777202145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d1c10a470 0x7f1d1c1a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.519+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 >> 172.21.15.120:0/1777202145 conn(0x7f1d1c070460 msgr2=0x7f1d1c10bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.520+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 shutdown_connections 2024-05-14T09:30:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:03.520+0000 7f1d22c00640 1 -- 172.21.15.120:0/1777202145 wait complete. 2024-05-14T09:30:04.210 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:03 smithi152 ceph-mon[34868]: pgmap v751: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 627 op/s 2024-05-14T09:30:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:03 smithi175 ceph-mon[35353]: pgmap v751: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 627 op/s 2024-05-14T09:30:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 150.0 s, 632.2 tps, lat 157.552 ms stddev 249.005 2024-05-14T09:30:04.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:03 smithi120 ceph-mon[31085]: pgmap v751: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 627 op/s 2024-05-14T09:30:06.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:05 smithi152 ceph-mon[34868]: pgmap v752: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 641 op/s 2024-05-14T09:30:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:05 smithi175 ceph-mon[35353]: pgmap v752: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 641 op/s 2024-05-14T09:30:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:05 smithi120 ceph-mon[31085]: pgmap v752: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 641 op/s 2024-05-14T09:30:08.190 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:07 smithi120 ceph-mon[31085]: pgmap v753: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 671 op/s 2024-05-14T09:30:08.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:07 smithi152 ceph-mon[34868]: pgmap v753: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 671 op/s 2024-05-14T09:30:08.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:07 smithi175 ceph-mon[35353]: pgmap v753: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 671 op/s 2024-05-14T09:30:09.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 155.0 s, 592.0 tps, lat 168.323 ms stddev 262.962 2024-05-14T09:30:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:09 smithi120 ceph-mon[31085]: pgmap v754: 129 pgs: 129 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-05-14T09:30:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:09 smithi152 ceph-mon[34868]: pgmap v754: 129 pgs: 129 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-05-14T09:30:10.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:09 smithi175 ceph-mon[35353]: pgmap v754: 129 pgs: 129 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-05-14T09:30:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:11 smithi152 ceph-mon[34868]: pgmap v755: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 667 op/s 2024-05-14T09:30:12.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:11 smithi175 ceph-mon[35353]: pgmap v755: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 667 op/s 2024-05-14T09:30:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:11 smithi120 ceph-mon[31085]: pgmap v755: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 667 op/s 2024-05-14T09:30:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:13 smithi152 ceph-mon[34868]: pgmap v756: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 MiB/s wr, 619 op/s 2024-05-14T09:30:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:13 smithi175 ceph-mon[35353]: pgmap v756: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 MiB/s wr, 619 op/s 2024-05-14T09:30:14.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 160.0 s, 546.8 tps, lat 171.951 ms stddev 320.053 2024-05-14T09:30:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:13 smithi120 ceph-mon[31085]: pgmap v756: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 MiB/s wr, 619 op/s 2024-05-14T09:30:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:15 smithi152 ceph-mon[34868]: pgmap v757: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 611 op/s 2024-05-14T09:30:16.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:15 smithi175 ceph-mon[35353]: pgmap v757: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 611 op/s 2024-05-14T09:30:16.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:15 smithi120 ceph-mon[31085]: pgmap v757: 129 pgs: 129 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 611 op/s 2024-05-14T09:30:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.857+0000 7f4e3e400640 1 -- 172.21.15.120:0/456210938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810f890 msgr2=0x7f4e38111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.857+0000 7f4e3e400640 1 --2- 172.21.15.120:0/456210938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810f890 0x7f4e38111cb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009860 tx=0x7f4e2402a340 comp rx=0 tx=0).stop 2024-05-14T09:30:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.857+0000 7f4e3e400640 1 -- 172.21.15.120:0/456210938 shutdown_connections 2024-05-14T09:30:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.857+0000 7f4e3e400640 1 --2- 172.21.15.120:0/456210938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e381121f0 0x7f4e38114690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.857+0000 7f4e3e400640 1 --2- 172.21.15.120:0/456210938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810f890 0x7f4e38111cb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.857+0000 7f4e3e400640 1 --2- 172.21.15.120:0/456210938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e3810a0f0 0x7f4e3810a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.857+0000 7f4e3e400640 1 -- 172.21.15.120:0/456210938 >> 172.21.15.120:0/456210938 conn(0x7f4e38070670 msgr2=0x7f4e38072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.858+0000 7f4e3e400640 1 -- 172.21.15.120:0/456210938 shutdown_connections 2024-05-14T09:30:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.858+0000 7f4e3e400640 1 -- 172.21.15.120:0/456210938 wait complete. 2024-05-14T09:30:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.859+0000 7f4e3e400640 1 Processor -- start 2024-05-14T09:30:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.860+0000 7f4e3e400640 1 -- start start 2024-05-14T09:30:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.860+0000 7f4e3e400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810a0f0 0x7f4e381a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.860+0000 7f4e3e400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3810f890 0x7f4e381a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.860+0000 7f4e3e400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e381121f0 0x7f4e381aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e3e400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38117f00 con 0x7f4e3810a0f0 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e3e400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38117d80 con 0x7f4e381121f0 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e3e400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38118080 con 0x7f4e3810f890 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e37400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810a0f0 0x7f4e381a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e381121f0 0x7f4e381aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e36a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3810f890 0x7f4e381a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e37400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810a0f0 0x7f4e381a2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35538/0 (socket says 172.21.15.120:35538) 2024-05-14T09:30:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.861+0000 7f4e37400640 1 -- 172.21.15.120:0/2138765785 learned_addr learned my addr 172.21.15.120:0/2138765785 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.862+0000 7f4e37400640 1 -- 172.21.15.120:0/2138765785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3810f890 msgr2=0x7f4e381a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.863+0000 7f4e37400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3810f890 0x7f4e381a30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.863+0000 7f4e37400640 1 -- 172.21.15.120:0/2138765785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e381121f0 msgr2=0x7f4e381aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.863+0000 7f4e37400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e381121f0 0x7f4e381aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.863+0000 7f4e37400640 1 -- 172.21.15.120:0/2138765785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e381aa6e0 con 0x7f4e3810a0f0 2024-05-14T09:30:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.863+0000 7f4e36a00640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3810f890 0x7f4e381a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.863+0000 7f4e37e00640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e381121f0 0x7f4e381aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.864+0000 7f4e37400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810a0f0 0x7f4e381a2ba0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e9f0 tx=0x7f4e2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.865+0000 7f4e2fe00640 1 -- 172.21.15.120:0/2138765785 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800cab0 con 0x7f4e3810a0f0 2024-05-14T09:30:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.865+0000 7f4e2fe00640 1 -- 172.21.15.120:0/2138765785 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e2800cc50 con 0x7f4e3810a0f0 2024-05-14T09:30:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.865+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3810b6d0 con 0x7f4e3810a0f0 2024-05-14T09:30:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.865+0000 7f4e2fe00640 1 -- 172.21.15.120:0/2138765785 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2801f630 con 0x7f4e3810a0f0 2024-05-14T09:30:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.865+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3810bc70 con 0x7f4e3810a0f0 2024-05-14T09:30:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.871+0000 7f4e2fe00640 1 -- 172.21.15.120:0/2138765785 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4e28020420 con 0x7f4e3810a0f0 2024-05-14T09:30:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.874+0000 7f4e2fe00640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4e1c0b2930 0x7f4e1c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.874+0000 7f4e45405740 1 Processor -- start 2024-05-14T09:30:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.875+0000 7f4e2fe00640 1 -- 172.21.15.120:0/2138765785 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4e280eb0b0 con 0x7f4e3810a0f0 2024-05-14T09:30:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.875+0000 7f4e45405740 1 -- start start 2024-05-14T09:30:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.876+0000 7f4e36a00640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4e1c0b2930 0x7f4e1c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.877+0000 7f4e45405740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f73946100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.877+0000 7f4e45405740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73946680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.877+0000 7f4e45405740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f7394d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.877+0000 7f4e45405740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f738aa550 con 0x560f735a41b0 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.877+0000 7f4e45405740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f7384fbc0 con 0x560f735834d0 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.877+0000 7f4e45405740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560f738a6510 con 0x560f7357b2f0 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.878+0000 7f4e36a00640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4e1c0b2930 0x7f4e1c0b4e40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4e381a3c40 tx=0x7f4e2402bf90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.878+0000 7f4e36a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73946680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.878+0000 7f4e36a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73946680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:52976/0 (socket says 172.21.15.120:52976) 2024-05-14T09:30:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.878+0000 7f4e36a00640 1 -- 172.21.15.120:0/3068606761 learned_addr learned my addr 172.21.15.120:0/3068606761 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.879+0000 7f4e36a00640 1 -- 172.21.15.120:0/3068606761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 msgr2=0x560f7394d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:30:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.879+0000 7f4e36a00640 1 --2- 172.21.15.120:0/3068606761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f7394d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.879+0000 7f4e36a00640 1 -- 172.21.15.120:0/3068606761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 msgr2=0x560f73946100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.879+0000 7f4e36a00640 1 --2- 172.21.15.120:0/3068606761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f73946100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.879+0000 7f4e36a00640 1 -- 172.21.15.120:0/3068606761 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f735bc210 con 0x560f7357b2f0 2024-05-14T09:30:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.880+0000 7f4e36a00640 1 --2- 172.21.15.120:0/3068606761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73946680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e24034000 tx=0x7f4e2402a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf5ca5933985289e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.881+0000 7f4e2cc00640 1 -- 172.21.15.120:0/3068606761 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24037040 con 0x560f7357b2f0 2024-05-14T09:30:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.881+0000 7f4e2cc00640 1 -- 172.21.15.120:0/3068606761 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e24044070 con 0x560f7357b2f0 2024-05-14T09:30:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.881+0000 7f4e2cc00640 1 -- 172.21.15.120:0/3068606761 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24003850 con 0x560f7357b2f0 2024-05-14T09:30:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.885+0000 7f4e45405740 1 -- 172.21.15.120:0/3068606761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 msgr2=0x560f73946680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.885+0000 7f4e45405740 1 --2- 172.21.15.120:0/3068606761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73946680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e24034000 tx=0x7f4e2402a340 comp rx=0 tx=0).stop 2024-05-14T09:30:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.886+0000 7f4e45405740 1 -- 172.21.15.120:0/3068606761 shutdown_connections 2024-05-14T09:30:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.886+0000 7f4e45405740 1 --2- 172.21.15.120:0/3068606761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f7394d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.886+0000 7f4e45405740 1 --2- 172.21.15.120:0/3068606761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73946680 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.886+0000 7f4e45405740 1 --2- 172.21.15.120:0/3068606761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f73946100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.886+0000 7f4e45405740 1 -- 172.21.15.120:0/3068606761 >> 172.21.15.120:0/3068606761 conn(0x560f73598300 msgr2=0x560f73941a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.886+0000 7f4e45405740 1 -- 172.21.15.120:0/3068606761 shutdown_connections 2024-05-14T09:30:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.886+0000 7f4e45405740 1 -- 172.21.15.120:0/3068606761 wait complete. 2024-05-14T09:30:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.887+0000 7f4e45405740 1 -- start start 2024-05-14T09:30:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.887+0000 7f4e45405740 1 Processor -- start 2024-05-14T09:30:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.888+0000 7f4e45405740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.888+0000 7f4e45405740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f739500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.888+0000 7f4e45405740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73957040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.888+0000 7f4e45405740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f7394df70 con 0x560f7357b2f0 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.888+0000 7f4e45405740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f73863660 con 0x560f735834d0 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.888+0000 7f4e45405740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560f7394e0f0 con 0x560f735a41b0 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.888+0000 7f4e45405740 10 client.0 _ll_register_callbacks cb 0x560f7382d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.889+0000 7f4e36a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f739500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.889+0000 7f4e36a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f739500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:54114/0 (socket says 172.21.15.120:54114) 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.889+0000 7f4e36a00640 1 -- 172.21.15.120:0/623671664 learned_addr learned my addr 172.21.15.120:0/623671664 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.889+0000 7f4e37400640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.889+0000 7f4e37e00640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73957040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.890+0000 7f4e36a00640 1 -- 172.21.15.120:0/623671664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 msgr2=0x560f73957040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.890+0000 7f4e36a00640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73957040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.890+0000 7f4e36a00640 1 -- 172.21.15.120:0/623671664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 msgr2=0x560f7394fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.890+0000 7f4e36a00640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.890+0000 7f4e36a00640 1 -- 172.21.15.120:0/623671664 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f73688620 con 0x560f735834d0 2024-05-14T09:30:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.890+0000 7f4e37e00640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73957040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.891+0000 7f4e21600640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:30:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.891+0000 7f4e36a00640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f739500e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009860 tx=0x7f4e24030d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e72cc9bd3e31c6e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.892+0000 7f4e21600640 1 -- 172.21.15.120:0/623671664 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24058070 con 0x560f735834d0 2024-05-14T09:30:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.892+0000 7f4e21600640 1 -- 172.21.15.120:0/623671664 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4e24004040 con 0x560f735834d0 2024-05-14T09:30:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.892+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e24044070 con 0x560f735834d0 2024-05-14T09:30:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.893+0000 7f4e21600640 1 -- 172.21.15.120:0/623671664 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4e24064050 con 0x560f735834d0 2024-05-14T09:30:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.893+0000 7f4e45405740 10 client.36059 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.893+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x560f73959f70 con 0x560f735834d0 2024-05-14T09:30:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e21600640 1 -- 172.21.15.120:0/623671664 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e24032a00 con 0x560f735834d0 2024-05-14T09:30:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e21600640 1 -- 172.21.15.120:0/623671664 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f4e24049070 con 0x560f735834d0 2024-05-14T09:30:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e45405740 10 client.36059 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e45405740 10 client.36059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e45405740 20 client.36059 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e45405740 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f73562d80 0x560f7395d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e45405740 4 client.36059 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.894+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4e24044070 con 0x560f73562d80 2024-05-14T09:30:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.896+0000 7f4e37400640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f73562d80 0x560f7395d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.897+0000 7f4e37400640 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f73562d80 0x560f7395d2d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a5d4cbabd70bd5 server_cookie=75f91d66140f72bd in_seq=0 out_seq=0 2024-05-14T09:30:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.897+0000 7f4e21600640 10 client.36059 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.900+0000 7f4e21600640 1 -- 172.21.15.120:0/623671664 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f4e24044070 con 0x560f73562d80 2024-05-14T09:30:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.900+0000 7f4e21600640 10 client.36059 handle_command_reply: tid=0 2024-05-14T09:30:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.900+0000 7f4e45405740 1 client.36059 shutdown 2024-05-14T09:30:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 msgr2=0x560f739500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f739500e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009860 tx=0x7f4e24030d30 comp rx=0 tx=0).stop 2024-05-14T09:30:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 shutdown_connections 2024-05-14T09:30:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f73562d80 0x560f7395d2d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73957040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f739500e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 --2- 172.21.15.120:0/623671664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e21600640 0 client.36059 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.901+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 >> 172.21.15.120:0/623671664 conn(0x560f73598300 msgr2=0x560f739449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.902+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 shutdown_connections 2024-05-14T09:30:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.902+0000 7f4e45405740 1 -- 172.21.15.120:0/623671664 wait complete. 2024-05-14T09:30:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.902+0000 7f4e45405740 20 client.36059 trim_cache size 0 max 16384 2024-05-14T09:30:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.934+0000 7f4e45405740 1 Processor -- start 2024-05-14T09:30:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.935+0000 7f4e45405740 1 -- start start 2024-05-14T09:30:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.935+0000 7f4e45405740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.935+0000 7f4e45405740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73956f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.935+0000 7f4e45405740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73946560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.935+0000 7f4e45405740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4e381b3170 con 0x560f7357b2f0 2024-05-14T09:30:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.935+0000 7f4e45405740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4e381b4d40 con 0x560f735834d0 2024-05-14T09:30:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.935+0000 7f4e45405740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e381b3840 con 0x560f735a41b0 2024-05-14T09:30:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.936+0000 7f4e37400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.936+0000 7f4e37400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35568/0 (socket says 172.21.15.120:35568) 2024-05-14T09:30:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.936+0000 7f4e37400640 1 -- 172.21.15.120:0/1193048597 learned_addr learned my addr 172.21.15.120:0/1193048597 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.936+0000 7f4e36a00640 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73956f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.936+0000 7f4e37e00640 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73946560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.937+0000 7f4e37400640 1 -- 172.21.15.120:0/1193048597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 msgr2=0x560f73946560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.937+0000 7f4e37400640 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73946560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.937+0000 7f4e37400640 1 -- 172.21.15.120:0/1193048597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 msgr2=0x560f73956f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.937+0000 7f4e37400640 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73956f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.937+0000 7f4e37400640 1 -- 172.21.15.120:0/1193048597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f73942620 con 0x560f7357b2f0 2024-05-14T09:30:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.937+0000 7f4e37e00640 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73946560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:30:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.937+0000 7f4e37400640 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394f560 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e9c0 tx=0x7f4e28009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315a42d6f44c0d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.938+0000 7f4e23e00640 1 -- 172.21.15.120:0/1193048597 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e280cb070 con 0x560f7357b2f0 2024-05-14T09:30:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.938+0000 7f4e23e00640 1 -- 172.21.15.120:0/1193048597 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e280b6680 con 0x560f7357b2f0 2024-05-14T09:30:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.938+0000 7f4e23e00640 1 -- 172.21.15.120:0/1193048597 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28020970 con 0x560f7357b2f0 2024-05-14T09:30:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.939+0000 7f4e45405740 1 -- 172.21.15.120:0/1193048597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 msgr2=0x560f7394f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.939+0000 7f4e45405740 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394f560 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e9c0 tx=0x7f4e28009600 comp rx=0 tx=0).stop 2024-05-14T09:30:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.940+0000 7f4e45405740 1 -- 172.21.15.120:0/1193048597 shutdown_connections 2024-05-14T09:30:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.940+0000 7f4e45405740 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f735a41b0 0x560f73946560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.940+0000 7f4e45405740 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73956f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.940+0000 7f4e45405740 1 --2- 172.21.15.120:0/1193048597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f7357b2f0 0x560f7394f560 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.940+0000 7f4e45405740 1 -- 172.21.15.120:0/1193048597 >> 172.21.15.120:0/1193048597 conn(0x560f73598300 msgr2=0x560f7394ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.941+0000 7f4e45405740 1 -- 172.21.15.120:0/1193048597 shutdown_connections 2024-05-14T09:30:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.941+0000 7f4e45405740 1 -- 172.21.15.120:0/1193048597 wait complete. 2024-05-14T09:30:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.941+0000 7f4e45405740 1 -- start start 2024-05-14T09:30:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.942+0000 7f4e45405740 1 Processor -- start 2024-05-14T09:30:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.942+0000 7f4e45405740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73953f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.942+0000 7f4e45405740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73954460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.942+0000 7f4e45405740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f739c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.942+0000 7f4e45405740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4e381b4610 con 0x560f735a41b0 2024-05-14T09:30:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.942+0000 7f4e45405740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4e381b3f40 con 0x560f735834d0 2024-05-14T09:30:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.942+0000 7f4e45405740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e381b1170 con 0x560f7357b2f0 2024-05-14T09:30:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.943+0000 7f4e45405740 10 client.0 _ll_register_callbacks cb 0x7f4e300093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.943+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f739c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.943+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f739c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35578/0 (socket says 172.21.15.120:35578) 2024-05-14T09:30:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.943+0000 7f4e37e00640 1 -- 172.21.15.120:0/1664110915 learned_addr learned my addr 172.21.15.120:0/1664110915 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.943+0000 7f4e37400640 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73953f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.943+0000 7f4e36a00640 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73954460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.944+0000 7f4e37e00640 1 -- 172.21.15.120:0/1664110915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 msgr2=0x560f73953f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.944+0000 7f4e37e00640 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73953f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.944+0000 7f4e37e00640 1 -- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 msgr2=0x560f73954460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.944+0000 7f4e37e00640 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73954460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.944+0000 7f4e37e00640 1 -- 172.21.15.120:0/1664110915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f739c3a60 con 0x560f735a41b0 2024-05-14T09:30:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.944+0000 7f4e37e00640 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f739c3520 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4e30011a70 tx=0x7f4e30011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63ccad9e9638cd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.944+0000 7f4e21600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.949+0000 7f4e21600640 1 -- 172.21.15.120:0/1664110915 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30021060 con 0x560f735a41b0 2024-05-14T09:30:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.949+0000 7f4e21600640 1 -- 172.21.15.120:0/1664110915 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4e3001c600 con 0x560f735a41b0 2024-05-14T09:30:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.949+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e280b6680 con 0x560f735a41b0 2024-05-14T09:30:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.950+0000 7f4e21600640 1 -- 172.21.15.120:0/1664110915 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4e3001c800 con 0x560f735a41b0 2024-05-14T09:30:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.950+0000 7f4e45405740 10 client.16590 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.950+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x560f739c4d00 con 0x560f735a41b0 2024-05-14T09:30:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.951+0000 7f4e21600640 1 -- 172.21.15.120:0/1664110915 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e280b6680 con 0x560f735a41b0 2024-05-14T09:30:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.951+0000 7f4e21600640 1 -- 172.21.15.120:0/1664110915 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f4e30025c40 con 0x560f735a41b0 2024-05-14T09:30:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.952+0000 7f4e45405740 10 client.16590 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.952+0000 7f4e45405740 10 client.16590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.952+0000 7f4e45405740 20 client.16590 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.952+0000 7f4e45405740 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f735381c0 0x560f739c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.952+0000 7f4e45405740 4 client.16590 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:30:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.952+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560f738b8160 con 0x560f735381c0 2024-05-14T09:30:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.952+0000 7f4e37400640 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f735381c0 0x560f739c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.954+0000 7f4e37400640 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f735381c0 0x560f739c7760 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=681e4ce79a1e6476 server_cookie=eec3c313316ce38a in_seq=0 out_seq=0 2024-05-14T09:30:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.954+0000 7f4e21600640 10 client.16590 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.994+0000 7f4e21600640 1 -- 172.21.15.120:0/1664110915 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560f738b8160 con 0x560f735381c0 2024-05-14T09:30:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.994+0000 7f4e21600640 10 client.16590 handle_command_reply: tid=0 2024-05-14T09:30:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.994+0000 7f4e45405740 1 client.16590 shutdown 2024-05-14T09:30:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 msgr2=0x560f739c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f739c3520 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4e30011a70 tx=0x7f4e30011f30 comp rx=0 tx=0).stop 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 shutdown_connections 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f735381c0 0x560f739c7760 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f735a41b0 0x560f739c3520 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f735834d0 0x560f73954460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 --2- 172.21.15.120:0/1664110915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f7357b2f0 0x560f73953f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 >> 172.21.15.120:0/1664110915 conn(0x560f73598300 msgr2=0x560f73944940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e21600640 0 client.16590 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 shutdown_connections 2024-05-14T09:30:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.996+0000 7f4e45405740 1 -- 172.21.15.120:0/1664110915 wait complete. 2024-05-14T09:30:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:30:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:30:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:30:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.997+0000 7f4e45405740 20 client.16590 trim_cache size 0 max 16384 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4e1c0b2930 msgr2=0x7f4e1c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4e1c0b2930 0x7f4e1c0b4e40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4e381a3c40 tx=0x7f4e2402bf90 comp rx=0 tx=0).stop 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810a0f0 msgr2=0x7f4e381a2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810a0f0 0x7f4e381a2ba0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e9f0 tx=0x7f4e2800eeb0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 shutdown_connections 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4e1c0b2930 0x7f4e1c0b4e40 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4e381a3c40 tx=0x7f4e2402bf90 comp rx=0 tx=0).stop 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e381121f0 0x7f4e381aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3810f890 0x7f4e381a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 --2- 172.21.15.120:0/2138765785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e3810a0f0 0x7f4e381a2ba0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.998+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 >> 172.21.15.120:0/2138765785 conn(0x7f4e38070670 msgr2=0x7f4e38110890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.999+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 shutdown_connections 2024-05-14T09:30:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:16.999+0000 7f4e3e400640 1 -- 172.21.15.120:0/2138765785 wait complete. 2024-05-14T09:30:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:17 smithi152 ceph-mon[34868]: pgmap v758: 129 pgs: 129 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 622 op/s 2024-05-14T09:30:18.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:17 smithi175 ceph-mon[35353]: pgmap v758: 129 pgs: 129 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 622 op/s 2024-05-14T09:30:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:17 smithi120 ceph-mon[31085]: pgmap v758: 129 pgs: 129 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 622 op/s 2024-05-14T09:30:19.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 165.0 s, 554.0 tps, lat 160.361 ms stddev 237.069 2024-05-14T09:30:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:19 smithi152 ceph-mon[34868]: pgmap v759: 129 pgs: 129 active+clean; 1.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-05-14T09:30:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:19 smithi175 ceph-mon[35353]: pgmap v759: 129 pgs: 129 active+clean; 1.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-05-14T09:30:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:19 smithi120 ceph-mon[31085]: pgmap v759: 129 pgs: 129 active+clean; 1.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-05-14T09:30:20.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T09:30:21.557 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:30:22.016 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:21 smithi120 ceph-mon[31085]: pgmap v760: 129 pgs: 129 active+clean; 1.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 13 MiB/s wr, 700 op/s 2024-05-14T09:30:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:21 smithi175 ceph-mon[35353]: pgmap v760: 129 pgs: 129 active+clean; 1.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 13 MiB/s wr, 700 op/s 2024-05-14T09:30:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:21 smithi152 ceph-mon[34868]: pgmap v760: 129 pgs: 129 active+clean; 1.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 13 MiB/s wr, 700 op/s 2024-05-14T09:30:24.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:23 smithi175 ceph-mon[35353]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 627 op/s 2024-05-14T09:30:24.323 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:23 smithi152 ceph-mon[34868]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 627 op/s 2024-05-14T09:30:24.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 170.0 s, 569.2 tps, lat 175.383 ms stddev 250.468 2024-05-14T09:30:24.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:23 smithi120 ceph-mon[31085]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 627 op/s 2024-05-14T09:30:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:25 smithi175 ceph-mon[35353]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 656 op/s 2024-05-14T09:30:26.254 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:25 smithi120 ceph-mon[31085]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 656 op/s 2024-05-14T09:30:26.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:25 smithi152 ceph-mon[34868]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 656 op/s 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.777+0000 7f77b3200700 1 -- 172.21.15.120:0/1958580559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac110290 msgr2=0x7f77ac117bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.777+0000 7f77b3200700 1 --2- 172.21.15.120:0/1958580559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac110290 0x7f77ac117bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f779c00b0d0 tx=0x7f779c00b3e0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.777+0000 7f77b3200700 1 -- 172.21.15.120:0/1958580559 shutdown_connections 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.777+0000 7f77b3200700 1 --2- 172.21.15.120:0/1958580559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac110290 0x7f77ac117bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.777+0000 7f77b3200700 1 --2- 172.21.15.120:0/1958580559 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77ac10b010 0x7f77ac10b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.777+0000 7f77b3200700 1 --2- 172.21.15.120:0/1958580559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10f940 0x7f77ac10fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.777+0000 7f77b3200700 1 -- 172.21.15.120:0/1958580559 >> 172.21.15.120:0/1958580559 conn(0x7f77ac06f4d0 msgr2=0x7f77ac06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.778+0000 7f77b3200700 1 -- 172.21.15.120:0/1958580559 shutdown_connections 2024-05-14T09:30:26.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.778+0000 7f77b3200700 1 -- 172.21.15.120:0/1958580559 wait complete. 2024-05-14T09:30:26.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.781+0000 7f77b3200700 1 Processor -- start 2024-05-14T09:30:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.781+0000 7f77b3200700 1 -- start start 2024-05-14T09:30:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.782+0000 7f77b3200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10b010 0x7f77ac115090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.782+0000 7f77b3200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac10f940 0x7f77ac1155d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.782+0000 7f77b3200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77ac110290 0x7f77ac115b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.782+0000 7f77b3200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac11a690 con 0x7f77ac110290 2024-05-14T09:30:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.782+0000 7f77b3200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac11a510 con 0x7f77ac10b010 2024-05-14T09:30:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.782+0000 7f77b3200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac11a810 con 0x7f77ac10f940 2024-05-14T09:30:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.783+0000 7f77ab400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac10f940 0x7f77ac1155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.783+0000 7f77abe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10b010 0x7f77ac115090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.783+0000 7f77abe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10b010 0x7f77ac115090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42040/0 (socket says 172.21.15.120:42040) 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.783+0000 7f77abe00700 1 -- 172.21.15.120:0/4282175712 learned_addr learned my addr 172.21.15.120:0/4282175712 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.784+0000 7f77abe00700 1 -- 172.21.15.120:0/4282175712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac10f940 msgr2=0x7f77ac1155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.784+0000 7f77abe00700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac10f940 0x7f77ac1155d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.784+0000 7f77abe00700 1 -- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77ac110290 msgr2=0x7f77ac115b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.784+0000 7f77abe00700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77ac110290 0x7f77ac115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.784+0000 7f77abe00700 1 -- 172.21.15.120:0/4282175712 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac1b5ce0 con 0x7f77ac10b010 2024-05-14T09:30:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.784+0000 7f77abe00700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10b010 0x7f77ac115090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77a400c920 tx=0x7f77a400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.785+0000 7f77a8c00700 1 -- 172.21.15.120:0/4282175712 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4007b00 con 0x7f77ac10b010 2024-05-14T09:30:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.785+0000 7f77a8c00700 1 -- 172.21.15.120:0/4282175712 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77a4004cc0 con 0x7f77ac10b010 2024-05-14T09:30:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.785+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ac1b5fd0 con 0x7f77ac10b010 2024-05-14T09:30:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.785+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ac1b64d0 con 0x7f77ac10b010 2024-05-14T09:30:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.785+0000 7f77a8c00700 1 -- 172.21.15.120:0/4282175712 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4005420 con 0x7f77ac10b010 2024-05-14T09:30:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.793+0000 7f77c1e30b80 1 Processor -- start 2024-05-14T09:30:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.794+0000 7f77a8c00700 1 -- 172.21.15.120:0/4282175712 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f77a400f450 con 0x7f77ac10b010 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.795+0000 7f77c1e30b80 1 -- start start 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.795+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628ab9f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.795+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628ab9ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.795+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628ab9ee060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.795+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628ab90fa20 con 0x5628ab9f3bf0 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.795+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628ab8ad760 con 0x5628ab9edc50 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.795+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5628ab90b9e0 con 0x5628ab86fe40 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.796+0000 7f77ab400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628ab9ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.796+0000 7f77ab400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628ab9ee060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42048/0 (socket says 172.21.15.120:42048) 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.796+0000 7f77ab400700 1 -- 172.21.15.120:0/3771356404 learned_addr learned my addr 172.21.15.120:0/3771356404 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.796+0000 7f77abe00700 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628ab9ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.797+0000 7f77a8c00700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77900b2940 0x7f77900b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.797+0000 7f77ab400700 1 -- 172.21.15.120:0/3771356404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 msgr2=0x5628ab9f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.797+0000 7f77ab400700 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628ab9f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.797+0000 7f77ab400700 1 -- 172.21.15.120:0/3771356404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 msgr2=0x5628ab9ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.797+0000 7f77ab400700 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628ab9ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.797+0000 7f77ab400700 1 -- 172.21.15.120:0/3771356404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628ab85c8d0 con 0x5628ab9edc50 2024-05-14T09:30:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.798+0000 7f77a8c00700 1 -- 172.21.15.120:0/4282175712 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f77a40e2050 con 0x7f77ac10b010 2024-05-14T09:30:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.798+0000 7f77b1200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77900b2940 0x7f77900b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.798+0000 7f77ab400700 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628ab9ee060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7798009820 tx=0x7f7798009af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec53a37d1cd9fdae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.798+0000 7f77a1600700 1 -- 172.21.15.120:0/3771356404 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779800edc0 con 0x5628ab9edc50 2024-05-14T09:30:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.799+0000 7f77a1600700 1 -- 172.21.15.120:0/3771356404 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77980044e0 con 0x5628ab9edc50 2024-05-14T09:30:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.799+0000 7f77a1600700 1 -- 172.21.15.120:0/3771356404 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798005280 con 0x5628ab9edc50 2024-05-14T09:30:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3771356404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 msgr2=0x5628ab9ee060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628ab9ee060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7798009820 tx=0x7f7798009af0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77b1200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77900b2940 0x7f77900b4e50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f779c009e60 tx=0x7f779c009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3771356404 shutdown_connections 2024-05-14T09:30:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628ab9ee060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628ab9f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3771356404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628ab9ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.800+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3771356404 >> 172.21.15.120:0/3771356404 conn(0x5628ab8aea80 msgr2=0x5628ab9e8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.801+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3771356404 shutdown_connections 2024-05-14T09:30:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.801+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3771356404 wait complete. 2024-05-14T09:30:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.802+0000 7f77c1e30b80 1 -- start start 2024-05-14T09:30:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.802+0000 7f77c1e30b80 1 Processor -- start 2024-05-14T09:30:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.803+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab86fe40 0x5628ab9f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.803+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.804+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.804+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628ab9fa6c0 con 0x5628ab86fe40 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.804+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628ab875b20 con 0x5628ab9f3bf0 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.804+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5628ab9fa840 con 0x5628ab9edc50 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.804+0000 7f77c1e30b80 10 client.0 _ll_register_callbacks cb 0x5628ab8a3380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.804+0000 7f77abe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab86fe40 0x5628ab9f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.804+0000 7f77ab400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.805+0000 7f77b1200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.805+0000 7f77b1200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42052/0 (socket says 172.21.15.120:42052) 2024-05-14T09:30:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.805+0000 7f77b1200700 1 -- 172.21.15.120:0/3151399275 learned_addr learned my addr 172.21.15.120:0/3151399275 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.806+0000 7f77b1200700 1 -- 172.21.15.120:0/3151399275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 msgr2=0x5628ab9f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.806+0000 7f77b1200700 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.806+0000 7f77b1200700 1 -- 172.21.15.120:0/3151399275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab86fe40 msgr2=0x5628ab9f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.806+0000 7f77b1200700 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab86fe40 0x5628ab9f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.806+0000 7f77b1200700 1 -- 172.21.15.120:0/3151399275 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628ab8d5420 con 0x5628ab9f3bf0 2024-05-14T09:30:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.806+0000 7f77b1200700 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7e50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f779c015000 tx=0x7f779c003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0779b5a3715becf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.806+0000 7f7796000700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:30:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.807+0000 7f7796000700 1 -- 172.21.15.120:0/3151399275 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c007c50 con 0x5628ab9f3bf0 2024-05-14T09:30:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.807+0000 7f7796000700 1 -- 172.21.15.120:0/3151399275 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f779c027460 con 0x5628ab9f3bf0 2024-05-14T09:30:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.808+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77980044e0 con 0x5628ab9f3bf0 2024-05-14T09:30:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.809+0000 7f7796000700 1 -- 172.21.15.120:0/3151399275 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f779c0092e0 con 0x5628ab9f3bf0 2024-05-14T09:30:26.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.810+0000 7f77c1e30b80 10 client.36077 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.811+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5628aba05340 con 0x5628ab9f3bf0 2024-05-14T09:30:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.812+0000 7f7796000700 1 -- 172.21.15.120:0/3151399275 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77980044e0 con 0x5628ab9f3bf0 2024-05-14T09:30:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.812+0000 7f7796000700 1 -- 172.21.15.120:0/3151399275 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f779c011070 con 0x5628ab9f3bf0 2024-05-14T09:30:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.813+0000 7f77c1e30b80 10 client.36077 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.813+0000 7f77c1e30b80 10 client.36077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.813+0000 7f77c1e30b80 20 client.36077 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.813+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba07980 0x5628aba09da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.813+0000 7f77c1e30b80 4 client.36077 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.813+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628ab9ba070 con 0x5628aba07980 2024-05-14T09:30:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.814+0000 7f77abe00700 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba07980 0x5628aba09da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.817+0000 7f77abe00700 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba07980 0x5628aba09da0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced4758c0194031d server_cookie=85f1c66070690e55 in_seq=0 out_seq=0 2024-05-14T09:30:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.817+0000 7f7796000700 10 client.36077 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.818+0000 7f7796000700 1 -- 172.21.15.120:0/3151399275 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5628ab9ba070 con 0x5628aba07980 2024-05-14T09:30:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.818+0000 7f7796000700 10 client.36077 handle_command_reply: tid=0 2024-05-14T09:30:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.819+0000 7f77c1e30b80 1 client.36077 shutdown 2024-05-14T09:30:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9f3bf0 msgr2=0x5628ab9f7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7e50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f779c015000 tx=0x7f779c003c80 comp rx=0 tx=0).stop 2024-05-14T09:30:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 shutdown_connections 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba07980 0x5628aba09da0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7e50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab86fe40 0x5628ab9f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f7796000700 0 client.36077 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/3151399275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 >> 172.21.15.120:0/3151399275 conn(0x5628ab8aea80 msgr2=0x5628ab9ec700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.820+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 shutdown_connections 2024-05-14T09:30:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.821+0000 7f77c1e30b80 1 -- 172.21.15.120:0/3151399275 wait complete. 2024-05-14T09:30:26.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.821+0000 7f77c1e30b80 20 client.36077 trim_cache size 0 max 16384 2024-05-14T09:30:26.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.860+0000 7f77c1e30b80 1 Processor -- start 2024-05-14T09:30:26.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.861+0000 7f77c1e30b80 1 -- start start 2024-05-14T09:30:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.861+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab86fe40 0x5628ab9ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.861+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.861+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.861+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f778c00eb50 con 0x5628ab9f3bf0 2024-05-14T09:30:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.861+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f778c010720 con 0x5628ab86fe40 2024-05-14T09:30:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.861+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f778c00f220 con 0x5628ab9edc50 2024-05-14T09:30:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.862+0000 7f77abe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab86fe40 0x5628ab9ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.862+0000 7f77abe00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab86fe40 0x5628ab9ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42062/0 (socket says 172.21.15.120:42062) 2024-05-14T09:30:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.862+0000 7f77abe00700 1 -- 172.21.15.120:0/86669169 learned_addr learned my addr 172.21.15.120:0/86669169 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.862+0000 7f77ab400700 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.863+0000 7f77abe00700 1 -- 172.21.15.120:0/86669169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 msgr2=0x5628ab9f66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.863+0000 7f77abe00700 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.863+0000 7f77abe00700 1 -- 172.21.15.120:0/86669169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 msgr2=0x5628ab9f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.863+0000 7f77abe00700 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.863+0000 7f77abe00700 1 -- 172.21.15.120:0/86669169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628ab9f71a0 con 0x5628ab86fe40 2024-05-14T09:30:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.864+0000 7f77abe00700 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab86fe40 0x5628ab9ed710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77a4004f90 tx=0x7f77a40e5b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cc8e075fcefa010 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:26.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.864+0000 7f77a0c00700 1 -- 172.21.15.120:0/86669169 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a401d040 con 0x5628ab86fe40 2024-05-14T09:30:26.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.864+0000 7f77a0c00700 1 -- 172.21.15.120:0/86669169 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77a40a8de0 con 0x5628ab86fe40 2024-05-14T09:30:26.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.864+0000 7f77a0c00700 1 -- 172.21.15.120:0/86669169 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a401d040 con 0x5628ab86fe40 2024-05-14T09:30:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.866+0000 7f77c1e30b80 1 -- 172.21.15.120:0/86669169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab86fe40 msgr2=0x5628ab9ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.866+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab86fe40 0x5628ab9ed710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77a4004f90 tx=0x7f77a40e5b30 comp rx=0 tx=0).stop 2024-05-14T09:30:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.866+0000 7f77c1e30b80 1 -- 172.21.15.120:0/86669169 shutdown_connections 2024-05-14T09:30:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.866+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab86fe40 0x5628ab9ed710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.866+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628ab9f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.866+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/86669169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab9edc50 0x5628ab9f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.866+0000 7f77c1e30b80 1 -- 172.21.15.120:0/86669169 >> 172.21.15.120:0/86669169 conn(0x5628ab8aea80 msgr2=0x5628ab9f7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:26.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.867+0000 7f77c1e30b80 1 -- 172.21.15.120:0/86669169 shutdown_connections 2024-05-14T09:30:26.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.867+0000 7f77c1e30b80 1 -- 172.21.15.120:0/86669169 wait complete. 2024-05-14T09:30:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.868+0000 7f77c1e30b80 1 -- start start 2024-05-14T09:30:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.869+0000 7f77c1e30b80 1 Processor -- start 2024-05-14T09:30:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628aba0ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628aba0f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77c1e30b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628aba0f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f778c00fff0 con 0x5628ab9f3bf0 2024-05-14T09:30:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f778c00f920 con 0x5628ab9edc50 2024-05-14T09:30:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77c1e30b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f778c00cb10 con 0x5628ab86fe40 2024-05-14T09:30:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77c1e30b80 10 client.0 _ll_register_callbacks cb 0x5628ab8a3380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.870+0000 7f77abe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628aba0ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.871+0000 7f77ab400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628aba0f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.871+0000 7f77abe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628aba0ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:52390/0 (socket says 172.21.15.120:52390) 2024-05-14T09:30:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.871+0000 7f77abe00700 1 -- 172.21.15.120:0/1312145731 learned_addr learned my addr 172.21.15.120:0/1312145731 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.871+0000 7f77b1200700 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628aba0f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.871+0000 7f77abe00700 1 -- 172.21.15.120:0/1312145731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 msgr2=0x5628aba0f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.871+0000 7f77abe00700 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628aba0f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.871+0000 7f77abe00700 1 -- 172.21.15.120:0/1312145731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 msgr2=0x5628aba0f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.872+0000 7f77abe00700 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628aba0f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.872+0000 7f77abe00700 1 -- 172.21.15.120:0/1312145731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628aba71130 con 0x5628ab86fe40 2024-05-14T09:30:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.872+0000 7f77b1200700 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628aba0f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.872+0000 7f77abe00700 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628aba0ee10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77a40dfb20 tx=0x7f77a4007ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c3510e10f261bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.872+0000 7f7796000700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:30:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.873+0000 7f7796000700 1 -- 172.21.15.120:0/1312145731 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a401d040 con 0x5628ab86fe40 2024-05-14T09:30:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.873+0000 7f7796000700 1 -- 172.21.15.120:0/1312145731 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f77a40055c0 con 0x5628ab86fe40 2024-05-14T09:30:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.873+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77a40a8de0 con 0x5628ab86fe40 2024-05-14T09:30:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.874+0000 7f7796000700 1 -- 172.21.15.120:0/1312145731 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f77a40ad680 con 0x5628ab86fe40 2024-05-14T09:30:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.875+0000 7f77c1e30b80 10 client.26149 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.875+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5628aba72350 con 0x5628ab86fe40 2024-05-14T09:30:26.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.875+0000 7f7796000700 1 -- 172.21.15.120:0/1312145731 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77a40a8de0 con 0x5628ab86fe40 2024-05-14T09:30:26.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.875+0000 7f7796000700 1 -- 172.21.15.120:0/1312145731 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f77a40c3bc0 con 0x5628ab86fe40 2024-05-14T09:30:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.876+0000 7f77c1e30b80 10 client.26149 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.876+0000 7f77c1e30b80 10 client.26149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.876+0000 7f77c1e30b80 20 client.26149 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.876+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba728f0 0x5628aba74d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.876+0000 7f77c1e30b80 4 client.26149 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T09:30:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.876+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5628ab91d400 con 0x5628aba728f0 2024-05-14T09:30:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.877+0000 7f77ab400700 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba728f0 0x5628aba74d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.878+0000 7f7796000700 10 client.26149 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.878+0000 7f77ab400700 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba728f0 0x5628aba74d10 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15170884e23d891 server_cookie=31ede4182a7ced73 in_seq=0 out_seq=0 2024-05-14T09:30:26.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.879+0000 7f7796000700 1 -- 172.21.15.120:0/1312145731 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5628ab91d400 con 0x5628aba728f0 2024-05-14T09:30:26.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.879+0000 7f7796000700 10 client.26149 handle_command_reply: tid=0 2024-05-14T09:30:26.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.879+0000 7f77c1e30b80 1 client.26149 shutdown 2024-05-14T09:30:26.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.881+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 msgr2=0x5628aba0ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.881+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628aba0ee10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77a40dfb20 tx=0x7f77a4007ed0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.882+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 shutdown_connections 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.882+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5628aba728f0 0x5628aba74d10 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.882+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628ab9f3bf0 0x5628aba0f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.882+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ab86fe40 0x5628aba0ee10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.882+0000 7f77c1e30b80 1 --2- 172.21.15.120:0/1312145731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628ab9edc50 0x5628aba0f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.882+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 >> 172.21.15.120:0/1312145731 conn(0x5628ab8aea80 msgr2=0x5628ab9f6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.883+0000 7f7796000700 0 client.26149 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.883+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 shutdown_connections 2024-05-14T09:30:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.884+0000 7f77c1e30b80 1 -- 172.21.15.120:0/1312145731 wait complete. 2024-05-14T09:30:26.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.884+0000 7f77c1e30b80 20 client.26149 trim_cache size 0 max 16384 2024-05-14T09:30:26.884 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:30:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-05-14T09:30:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-05-14T09:30:26.884 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:30:26.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.885+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77900b2940 msgr2=0x7f77900b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.885+0000 7f77b3200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77900b2940 0x7f77900b4e50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f779c009e60 tx=0x7f779c009800 comp rx=0 tx=0).stop 2024-05-14T09:30:26.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.885+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10b010 msgr2=0x7f77ac115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:26.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.885+0000 7f77b3200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10b010 0x7f77ac115090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77a400c920 tx=0x7f77a400cc30 comp rx=0 tx=0).stop 2024-05-14T09:30:26.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.886+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 shutdown_connections 2024-05-14T09:30:26.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.886+0000 7f77b3200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77900b2940 0x7f77900b4e50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.886+0000 7f77b3200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ac10b010 0x7f77ac115090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.886+0000 7f77b3200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77ac110290 0x7f77ac115b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.886+0000 7f77b3200700 1 --2- 172.21.15.120:0/4282175712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac10f940 0x7f77ac1155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:26.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.886+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 >> 172.21.15.120:0/4282175712 conn(0x7f77ac06f4d0 msgr2=0x7f77ac10daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:26.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.887+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 shutdown_connections 2024-05-14T09:30:26.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:26.887+0000 7f77b3200700 1 -- 172.21.15.120:0/4282175712 wait complete. 2024-05-14T09:30:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:27 smithi120 ceph-mon[31085]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 680 op/s 2024-05-14T09:30:28.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:27 smithi152 ceph-mon[34868]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 680 op/s 2024-05-14T09:30:28.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:27 smithi175 ceph-mon[35353]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 680 op/s 2024-05-14T09:30:28.984 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T09:30:28.984 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T09:30:29.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 175.0 s, 601.2 tps, lat 177.620 ms stddev 241.016 2024-05-14T09:30:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:30:30.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:29 smithi120 ceph-mon[31085]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 13 MiB/s wr, 716 op/s 2024-05-14T09:30:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.308+0000 7f9f11800640 1 -- 172.21.15.120:0/4251358573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10a550 msgr2=0x7f9f0c10af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.308+0000 7f9f11800640 1 --2- 172.21.15.120:0/4251358573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10a550 0x7f9f0c10af40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009ca0 tx=0x7f9f0402a8b0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.309+0000 7f9f11800640 1 -- 172.21.15.120:0/4251358573 shutdown_connections 2024-05-14T09:30:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.309+0000 7f9f11800640 1 --2- 172.21.15.120:0/4251358573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f0c1101a0 0x7f9f0c1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.309+0000 7f9f11800640 1 --2- 172.21.15.120:0/4251358573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10b480 0x7f9f0c10b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.309+0000 7f9f11800640 1 --2- 172.21.15.120:0/4251358573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c10a550 0x7f9f0c10af40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.309+0000 7f9f11800640 1 -- 172.21.15.120:0/4251358573 >> 172.21.15.120:0/4251358573 conn(0x7f9f0c070670 msgr2=0x7f9f0c072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.309+0000 7f9f11800640 1 -- 172.21.15.120:0/4251358573 shutdown_connections 2024-05-14T09:30:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.310+0000 7f9f11800640 1 -- 172.21.15.120:0/4251358573 wait complete. 2024-05-14T09:30:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.311+0000 7f9f11800640 1 Processor -- start 2024-05-14T09:30:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.311+0000 7f9f11800640 1 -- start start 2024-05-14T09:30:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.312+0000 7f9f11800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10a550 0x7f9f0c11b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.312+0000 7f9f11800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f0c10b480 0x7f9f0c11be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.312+0000 7f9f11800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c1101a0 0x7f9f0c11a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.312+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10a550 0x7f9f0c11b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.313+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10a550 0x7f9f0c11b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:38238/0 (socket says 172.21.15.120:38238) 2024-05-14T09:30:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.313+0000 7f9f11800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c112310 con 0x7f9f0c10b480 2024-05-14T09:30:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.313+0000 7f9f11800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c112190 con 0x7f9f0c1101a0 2024-05-14T09:30:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.313+0000 7f9f11800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c112490 con 0x7f9f0c10a550 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.313+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2686540329 learned_addr learned my addr 172.21.15.120:0/2686540329 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c1101a0 0x7f9f0c11a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0a000640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f0c10b480 0x7f9f0c11be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2686540329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c1101a0 msgr2=0x7f9f0c11a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c1101a0 0x7f9f0c11a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f0c10b480 msgr2=0x7f9f0c11be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f0c10b480 0x7f9f0c11be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2686540329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c11a880 con 0x7f9f0c10a550 2024-05-14T09:30:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.314+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c1101a0 0x7f9f0c11a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.315+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10a550 0x7f9f0c11b940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f0402aea0 tx=0x7f9f04003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.316+0000 7f9f03400640 1 -- 172.21.15.120:0/2686540329 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04004450 con 0x7f9f0c10a550 2024-05-14T09:30:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.316+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c11ab10 con 0x7f9f0c10a550 2024-05-14T09:30:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.316+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c1b9db0 con 0x7f9f0c10a550 2024-05-14T09:30:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.316+0000 7f9f03400640 1 -- 172.21.15.120:0/2686540329 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f04040070 con 0x7f9f0c10a550 2024-05-14T09:30:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.316+0000 7f9f03400640 1 -- 172.21.15.120:0/2686540329 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04045b60 con 0x7f9f0c10a550 2024-05-14T09:30:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.323+0000 7f9f03400640 1 -- 172.21.15.120:0/2686540329 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f9f04045470 con 0x7f9f0c10a550 2024-05-14T09:30:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.325+0000 7f9f187c0740 1 Processor -- start 2024-05-14T09:30:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.325+0000 7f9f187c0740 1 -- start start 2024-05-14T09:30:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.325+0000 7f9f03400640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9ef00b2860 0x7f9ef00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.325+0000 7f9f03400640 1 -- 172.21.15.120:0/2686540329 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9f04103840 con 0x7f9f0c10a550 2024-05-14T09:30:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.326+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9ef00b2860 0x7f9ef00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.326+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc243d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.326+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc243d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.326+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2444580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.326+0000 7f9f187c0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55abc23a1550 con 0x55abc20722f0 2024-05-14T09:30:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.326+0000 7f9f187c0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55abc2346bc0 con 0x55abc207a4d0 2024-05-14T09:30:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.326+0000 7f9f187c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55abc239d510 con 0x55abc209b1b0 2024-05-14T09:30:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.327+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc243d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.327+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc243d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:38244/0 (socket says 172.21.15.120:38244) 2024-05-14T09:30:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.327+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2932024500 learned_addr learned my addr 172.21.15.120:0/2932024500 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.327+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2444580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.327+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9ef00b2860 0x7f9ef00b4d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4011490 tx=0x7f9ef4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0a000640 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc243d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2932024500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 msgr2=0x55abc2444580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2444580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2932024500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 msgr2=0x55abc243d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc243d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2932024500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc20b3210 con 0x55abc209b1b0 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2444580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.328+0000 7f9f0a000640 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc243d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:30:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.329+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc243d100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f040c7d30 tx=0x7f9f040095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122dae80a18086f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.329+0000 7f9efbe00640 1 -- 172.21.15.120:0/2932024500 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040cb1c0 con 0x55abc209b1b0 2024-05-14T09:30:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.329+0000 7f9efbe00640 1 -- 172.21.15.120:0/2932024500 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f04036020 con 0x55abc209b1b0 2024-05-14T09:30:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.330+0000 7f9efbe00640 1 -- 172.21.15.120:0/2932024500 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04009870 con 0x55abc209b1b0 2024-05-14T09:30:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.331+0000 7f9f187c0740 1 -- 172.21.15.120:0/2932024500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 msgr2=0x55abc243d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.331+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc243d100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f040c7d30 tx=0x7f9f040095c0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.333+0000 7f9f187c0740 1 -- 172.21.15.120:0/2932024500 shutdown_connections 2024-05-14T09:30:30.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.333+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2444580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.333+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc243d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.333+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2932024500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc243d100 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.333+0000 7f9f187c0740 1 -- 172.21.15.120:0/2932024500 >> 172.21.15.120:0/2932024500 conn(0x55abc208f300 msgr2=0x55abc2438a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:30.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.333+0000 7f9f187c0740 1 -- 172.21.15.120:0/2932024500 shutdown_connections 2024-05-14T09:30:30.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.333+0000 7f9f187c0740 1 -- 172.21.15.120:0/2932024500 wait complete. 2024-05-14T09:30:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.334+0000 7f9f187c0740 1 -- start start 2024-05-14T09:30:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.335+0000 7f9f187c0740 1 Processor -- start 2024-05-14T09:30:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.337+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc24469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.337+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2446f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.337+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.337+0000 7f9f187c0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55abc2444d90 con 0x55abc20722f0 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.337+0000 7f9f187c0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55abc235a660 con 0x55abc207a4d0 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.337+0000 7f9f187c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55abc2444f10 con 0x55abc209b1b0 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.337+0000 7f9f187c0740 10 client.0 _ll_register_callbacks cb 0x55abc2324400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.338+0000 7f9f0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.338+0000 7f9f0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:38248/0 (socket says 172.21.15.120:38248) 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.338+0000 7f9f0b400640 1 -- 172.21.15.120:0/925684495 learned_addr learned my addr 172.21.15.120:0/925684495 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.338+0000 7f9f0a000640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2446f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.339+0000 7f9f0b400640 1 -- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 msgr2=0x55abc2446f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.339+0000 7f9f0b400640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2446f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.339+0000 7f9f0b400640 1 -- 172.21.15.120:0/925684495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 msgr2=0x55abc24469d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.339+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc24469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.339+0000 7f9f0b400640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc24469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.340+0000 7f9f0b400640 1 -- 172.21.15.120:0/925684495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc217f620 con 0x55abc209b1b0 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.340+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc24469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.340+0000 7f9f0b400640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244de70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40037e0 tx=0x7f9ef4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da92b44b40ae3104 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.340+0000 7f9ef8c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:30:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.341+0000 7f9ef8c00640 1 -- 172.21.15.120:0/925684495 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef402b060 con 0x55abc209b1b0 2024-05-14T09:30:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.341+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f04036020 con 0x55abc209b1b0 2024-05-14T09:30:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.341+0000 7f9ef8c00640 1 -- 172.21.15.120:0/925684495 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9ef400f980 con 0x55abc209b1b0 2024-05-14T09:30:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.342+0000 7f9ef8c00640 1 -- 172.21.15.120:0/925684495 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f9ef4032050 con 0x55abc209b1b0 2024-05-14T09:30:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.342+0000 7f9f187c0740 10 client.26161 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.342+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55abc2450e10 con 0x55abc209b1b0 2024-05-14T09:30:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.343+0000 7f9ef8c00640 1 -- 172.21.15.120:0/925684495 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f04036020 con 0x55abc209b1b0 2024-05-14T09:30:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.344+0000 7f9ef8c00640 1 -- 172.21.15.120:0/925684495 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f9ef401a050 con 0x55abc209b1b0 2024-05-14T09:30:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.344+0000 7f9f187c0740 10 client.26161 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.344+0000 7f9f187c0740 10 client.26161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.344+0000 7f9f187c0740 20 client.26161 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.344+0000 7f9f187c0740 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc2059d80 0x55abc2454620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.345+0000 7f9f187c0740 4 client.26161 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.346+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc2059d80 0x55abc2454620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.346+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abc23af160 con 0x55abc2059d80 2024-05-14T09:30:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.347+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc2059d80 0x55abc2454620 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5eaf00eeec46cd7 server_cookie=fb8035c4ce972e0f in_seq=0 out_seq=0 2024-05-14T09:30:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.347+0000 7f9ef8c00640 10 client.26161 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.348+0000 7f9ef8c00640 1 -- 172.21.15.120:0/925684495 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55abc23af160 con 0x55abc2059d80 2024-05-14T09:30:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.348+0000 7f9ef8c00640 10 client.26161 handle_command_reply: tid=0 2024-05-14T09:30:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 client.26161 shutdown 2024-05-14T09:30:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 msgr2=0x55abc244de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244de70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40037e0 tx=0x7f9ef4004730 comp rx=0 tx=0).stop 2024-05-14T09:30:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 shutdown_connections 2024-05-14T09:30:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc2059d80 0x55abc2454620 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244de70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc207a4d0 0x55abc2446f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 --2- 172.21.15.120:0/925684495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc20722f0 0x55abc24469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.349+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 >> 172.21.15.120:0/925684495 conn(0x55abc208f300 msgr2=0x55abc2437a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.350+0000 7f9ef8c00640 0 client.26161 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.350+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 shutdown_connections 2024-05-14T09:30:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.350+0000 7f9f187c0740 1 -- 172.21.15.120:0/925684495 wait complete. 2024-05-14T09:30:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.350+0000 7f9f187c0740 20 client.26161 trim_cache size 0 max 16384 2024-05-14T09:30:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.377+0000 7f9f187c0740 1 Processor -- start 2024-05-14T09:30:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.378+0000 7f9f187c0740 1 -- start start 2024-05-14T09:30:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.378+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc2438450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.378+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc2438990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.378+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.378+0000 7f9f187c0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee800fb80 con 0x55abc207a4d0 2024-05-14T09:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.378+0000 7f9f187c0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8011750 con 0x55abc20722f0 2024-05-14T09:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.378+0000 7f9f187c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8010250 con 0x55abc209b1b0 2024-05-14T09:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.379+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc2438450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.379+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc2438450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56462/0 (socket says 172.21.15.120:56462) 2024-05-14T09:30:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.379+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2861584756 learned_addr learned my addr 172.21.15.120:0/2861584756 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.379+0000 7f9f0a000640 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc2438990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.380+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.380+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2861584756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 msgr2=0x55abc244dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.380+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.380+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2861584756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 msgr2=0x55abc2438990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.380+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc2438990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.380+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2861584756 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc2433720 con 0x55abc20722f0 2024-05-14T09:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.381+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.381+0000 7f9f0a000640 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc2438990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:30:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.382+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc2438450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f040caa00 tx=0x7f9f0402a8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abca956bd30832a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.384+0000 7f9efb400640 1 -- 172.21.15.120:0/2861584756 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040caac0 con 0x55abc20722f0 2024-05-14T09:30:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.384+0000 7f9efb400640 1 -- 172.21.15.120:0/2861584756 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f04036040 con 0x55abc20722f0 2024-05-14T09:30:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.384+0000 7f9efb400640 1 -- 172.21.15.120:0/2861584756 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f041010b0 con 0x55abc20722f0 2024-05-14T09:30:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.385+0000 7f9f187c0740 1 -- 172.21.15.120:0/2861584756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 msgr2=0x55abc2438450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.385+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc2438450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f040caa00 tx=0x7f9f0402a8b0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.385+0000 7f9f187c0740 1 -- 172.21.15.120:0/2861584756 shutdown_connections 2024-05-14T09:30:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.385+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc244dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.386+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc2438990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.386+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2861584756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc2438450 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.386+0000 7f9f187c0740 1 -- 172.21.15.120:0/2861584756 >> 172.21.15.120:0/2861584756 conn(0x55abc208f300 msgr2=0x55abc24410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.386+0000 7f9f187c0740 1 -- 172.21.15.120:0/2861584756 shutdown_connections 2024-05-14T09:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.386+0000 7f9f187c0740 1 -- 172.21.15.120:0/2861584756 wait complete. 2024-05-14T09:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.387+0000 7f9f187c0740 1 -- start start 2024-05-14T09:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.387+0000 7f9f187c0740 1 Processor -- start 2024-05-14T09:30:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc244b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc244b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f187c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc24ba950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f187c0740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8011020 con 0x55abc207a4d0 2024-05-14T09:30:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f187c0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8010950 con 0x55abc20722f0 2024-05-14T09:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f187c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee800db80 con 0x55abc209b1b0 2024-05-14T09:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f187c0740 10 client.0 _ll_register_callbacks cb 0x7f9ef40040e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc244b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f0aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc244b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56476/0 (socket says 172.21.15.120:56476) 2024-05-14T09:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f0aa00640 1 -- 172.21.15.120:0/2173561863 learned_addr learned my addr 172.21.15.120:0/2173561863 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc24ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.388+0000 7f9f0a000640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc244b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.389+0000 7f9f0b400640 1 -- 172.21.15.120:0/2173561863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 msgr2=0x55abc244b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.389+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc244b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.389+0000 7f9f0b400640 1 -- 172.21.15.120:0/2173561863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 msgr2=0x55abc244b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.389+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc244b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.389+0000 7f9f0b400640 1 -- 172.21.15.120:0/2173561863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc244c050 con 0x55abc209b1b0 2024-05-14T09:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.389+0000 7f9f0a000640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc244b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.390+0000 7f9f0b400640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc24ba950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4011d20 tx=0x7f9ef40036e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c44ff523a991609e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.391+0000 7f9ef8c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.391+0000 7f9ef8c00640 1 -- 172.21.15.120:0/2173561863 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef400fb60 con 0x55abc209b1b0 2024-05-14T09:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.391+0000 7f9ef8c00640 1 -- 172.21.15.120:0/2173561863 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9ef4009040 con 0x55abc209b1b0 2024-05-14T09:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.391+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f04036040 con 0x55abc209b1b0 2024-05-14T09:30:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.392+0000 7f9ef8c00640 1 -- 172.21.15.120:0/2173561863 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f9ef400fd00 con 0x55abc209b1b0 2024-05-14T09:30:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.392+0000 7f9f187c0740 10 client.26167 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.392+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55abc24bc050 con 0x55abc209b1b0 2024-05-14T09:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.393+0000 7f9ef8c00640 1 -- 172.21.15.120:0/2173561863 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ef4026880 con 0x55abc209b1b0 2024-05-14T09:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.393+0000 7f9ef8c00640 1 -- 172.21.15.120:0/2173561863 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f9ef401a040 con 0x55abc209b1b0 2024-05-14T09:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.394+0000 7f9f187c0740 10 client.26167 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.394+0000 7f9f187c0740 10 client.26167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.394+0000 7f9f187c0740 20 client.26167 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.394+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc202f1c0 0x55abc24beb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.394+0000 7f9f187c0740 4 client.26167 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.394+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9f04036040 con 0x55abc202f1c0 2024-05-14T09:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.394+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc202f1c0 0x55abc24beb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.396+0000 7f9f0aa00640 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc202f1c0 0x55abc24beb20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc3a3504b1fc901 server_cookie=759c33e7edb879f2 in_seq=0 out_seq=0 2024-05-14T09:30:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.396+0000 7f9ef8c00640 10 client.26167 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.427+0000 7f9ef8c00640 1 -- 172.21.15.120:0/2173561863 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f9f04036040 con 0x55abc202f1c0 2024-05-14T09:30:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.427+0000 7f9ef8c00640 10 client.26167 handle_command_reply: tid=0 2024-05-14T09:30:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.427+0000 7f9f187c0740 1 client.26167 shutdown 2024-05-14T09:30:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 msgr2=0x55abc24ba950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc24ba950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4011d20 tx=0x7f9ef40036e0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 shutdown_connections 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55abc202f1c0 0x55abc24beb20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc209b1b0 0x55abc24ba950 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abc207a4d0 0x55abc244b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 --2- 172.21.15.120:0/2173561863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55abc20722f0 0x55abc244b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 >> 172.21.15.120:0/2173561863 conn(0x55abc208f300 msgr2=0x55abc243b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9ef8c00640 0 client.26167 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.428+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 shutdown_connections 2024-05-14T09:30:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.429+0000 7f9f187c0740 1 -- 172.21.15.120:0/2173561863 wait complete. 2024-05-14T09:30:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.429+0000 7f9f187c0740 20 client.26167 trim_cache size 0 max 16384 2024-05-14T09:30:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:30:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:30:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:30:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:30:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.430+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9ef00b2860 msgr2=0x7f9ef00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.430+0000 7f9f11800640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9ef00b2860 0x7f9ef00b4d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4011490 tx=0x7f9ef4005f90 comp rx=0 tx=0).stop 2024-05-14T09:30:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.430+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10a550 msgr2=0x7f9f0c11b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.430+0000 7f9f11800640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10a550 0x7f9f0c11b940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f0402aea0 tx=0x7f9f04003c20 comp rx=0 tx=0).stop 2024-05-14T09:30:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.431+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 shutdown_connections 2024-05-14T09:30:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.431+0000 7f9f11800640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9ef00b2860 0x7f9ef00b4d70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.431+0000 7f9f11800640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f0c1101a0 0x7f9f0c11a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.431+0000 7f9f11800640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f0c10b480 0x7f9f0c11be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.431+0000 7f9f11800640 1 --2- 172.21.15.120:0/2686540329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f0c10a550 0x7f9f0c11b940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.431+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 >> 172.21.15.120:0/2686540329 conn(0x7f9f0c070670 msgr2=0x7f9f0c10e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.431+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 shutdown_connections 2024-05-14T09:30:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:30.432+0000 7f9f11800640 1 -- 172.21.15.120:0/2686540329 wait complete. 2024-05-14T09:30:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:29 smithi152 ceph-mon[34868]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 13 MiB/s wr, 716 op/s 2024-05-14T09:30:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:29 smithi175 ceph-mon[35353]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 13 MiB/s wr, 716 op/s 2024-05-14T09:30:31.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:30 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:30:31.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:30 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:30:31.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:30 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:30:32.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:32 smithi175 ceph-mon[35353]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 679 op/s 2024-05-14T09:30:32.136 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:32 smithi120 ceph-mon[31085]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 679 op/s 2024-05-14T09:30:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:32 smithi152 ceph-mon[34868]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 679 op/s 2024-05-14T09:30:33.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.387+0000 7f6cddc00700 1 -- 172.21.15.120:0/1722474097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810a930 msgr2=0x7f6cd810ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:33.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.388+0000 7f6cddc00700 1 --2- 172.21.15.120:0/1722474097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810a930 0x7f6cd810ad40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009990 tx=0x7f6cc0009ca0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.388+0000 7f6cddc00700 1 -- 172.21.15.120:0/1722474097 shutdown_connections 2024-05-14T09:30:33.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.388+0000 7f6cddc00700 1 --2- 172.21.15.120:0/1722474097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810a930 0x7f6cd810ad40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.388+0000 7f6cddc00700 1 --2- 172.21.15.120:0/1722474097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cd811d930 0x7f6cd811fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.388+0000 7f6cddc00700 1 --2- 172.21.15.120:0/1722474097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cd810b280 0x7f6cd811d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.388+0000 7f6cddc00700 1 -- 172.21.15.120:0/1722474097 >> 172.21.15.120:0/1722474097 conn(0x7f6cd806f4d0 msgr2=0x7f6cd806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:33.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.389+0000 7f6cddc00700 1 -- 172.21.15.120:0/1722474097 shutdown_connections 2024-05-14T09:30:33.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.389+0000 7f6cddc00700 1 -- 172.21.15.120:0/1722474097 wait complete. 2024-05-14T09:30:33.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.391+0000 7f6cddc00700 1 Processor -- start 2024-05-14T09:30:33.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.391+0000 7f6cddc00700 1 -- start start 2024-05-14T09:30:33.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.392+0000 7f6cddc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cd810a930 0x7f6cd811be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:33.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.392+0000 7f6cddc00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810b280 0x7f6cd8114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:33.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cddc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cd811d930 0x7f6cd81155d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cddc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8123190 con 0x7f6cd811d930 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cddc00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8123010 con 0x7f6cd810b280 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cddc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8123310 con 0x7f6cd810a930 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cd6000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810b280 0x7f6cd8114f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cd6000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810b280 0x7f6cd8114f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56500/0 (socket says 172.21.15.120:56500) 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cd6000700 1 -- 172.21.15.120:0/3275069914 learned_addr learned my addr 172.21.15.120:0/3275069914 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.393+0000 7f6cd7400700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cd811d930 0x7f6cd81155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.394+0000 7f6cd6000700 1 -- 172.21.15.120:0/3275069914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cd810a930 msgr2=0x7f6cd811be00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.394+0000 7f6cd6000700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cd810a930 0x7f6cd811be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.394+0000 7f6cd6000700 1 -- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cd811d930 msgr2=0x7f6cd81155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.394+0000 7f6cd6000700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cd811d930 0x7f6cd81155d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.394+0000 7f6cd6000700 1 -- 172.21.15.120:0/3275069914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd8119930 con 0x7f6cd810b280 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.394+0000 7f6cd6000700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810b280 0x7f6cd8114f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c9b0 tx=0x7f6cc800ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:33.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.395+0000 7f6ccf400700 1 -- 172.21.15.120:0/3275069914 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8007b00 con 0x7f6cd810b280 2024-05-14T09:30:33.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.395+0000 7f6ccf400700 1 -- 172.21.15.120:0/3275069914 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cc8007ca0 con 0x7f6cd810b280 2024-05-14T09:30:33.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.395+0000 7f6ccf400700 1 -- 172.21.15.120:0/3275069914 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8018660 con 0x7f6cd810b280 2024-05-14T09:30:33.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.395+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd8119c20 con 0x7f6cd810b280 2024-05-14T09:30:33.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.395+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd811a110 con 0x7f6cd810b280 2024-05-14T09:30:33.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.398+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd810c070 con 0x7f6cd810b280 2024-05-14T09:30:33.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.401+0000 7f6ccf400700 1 -- 172.21.15.120:0/3275069914 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6cc800f450 con 0x7f6cd810b280 2024-05-14T09:30:33.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.405+0000 7f6ccf400700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6cbc0b29d0 0x7f6cbc0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:33.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.405+0000 7f6ccf400700 1 -- 172.21.15.120:0/3275069914 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6cc80e24c0 con 0x7f6cd810b280 2024-05-14T09:30:33.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.405+0000 7f6cd6a00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6cbc0b29d0 0x7f6cbc0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:33.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.406+0000 7f6cd6a00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6cbc0b29d0 0x7f6cbc0b4ee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0006010 tx=0x7f6cc000b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:33.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.409+0000 7f6ccf400700 1 -- 172.21.15.120:0/3275069914 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6cc8014030 con 0x7f6cd810b280 2024-05-14T09:30:33.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.915+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cd8116460 con 0x7f6cd810b280 2024-05-14T09:30:33.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.919+0000 7f6ccf400700 1 -- 172.21.15.120:0/3275069914 <== mon.2 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11962 (secure 0 0 0) 0x7f6cc80a9e40 con 0x7f6cd810b280 2024-05-14T09:30:33.920 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:30:33.921 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1838398514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1838398514},{"type":"v1","addr":"172.21.15.120:6835","nonce":1838398514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1071479620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1071479620},{"type":"v1","addr":"172.21.15.120:6837","nonce":1071479620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T09:18:05.515901+0000","modified":"2024-05-14T09:29:50.410577+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34427,"mds_1":34409,"mds_2":34388,"mds_3":24469,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6839/3368743010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":3368743010},{"type":"v1","addr":"172.21.15.120:6839","nonce":3368743010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.120:6841/1248486929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":1248486929},{"type":"v1","addr":"172.21.15.120:6841","nonce":1248486929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"b","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6839/256598418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":256598418},{"type":"v1","addr":"172.21.15.152:6839","nonce":256598418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3706419963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3706419963},{"type":"v1","addr":"172.21.15.175:6833","nonce":3706419963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285285129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285285129},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285285129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":188,"addr":"172.21.15.175:6837/3978387102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3978387102},{"type":"v1","addr":"172.21.15.175:6837","nonce":3978387102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/339294041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":339294041},{"type":"v1","addr":"172.21.15.175:6839","nonce":339294041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34388":{"gid":34388,"name":"k","rank":2,"incarnation":22,"state":"up:active","state_seq":38,"addr":"172.21.15.152:6833/2515790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2515790469},{"type":"v1","addr":"172.21.15.152:6833","nonce":2515790469}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":1,"incarnation":20,"state":"up:active","state_seq":34,"addr":"172.21.15.152:6835/2913976247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2913976247},{"type":"v1","addr":"172.21.15.152:6835","nonce":2913976247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":0,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.152:6837/1812479560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1812479560},{"type":"v1","addr":"172.21.15.152:6837","nonce":1812479560}]},"join_fscid":-1,"export_targets":[2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34427,"qdb_cluster":[34388,24469,34409,24454,34427]},"id":1}]} 2024-05-14T09:30:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.923+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6cbc0b29d0 msgr2=0x7f6cbc0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.923+0000 7f6cddc00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6cbc0b29d0 0x7f6cbc0b4ee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0006010 tx=0x7f6cc000b560 comp rx=0 tx=0).stop 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.923+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810b280 msgr2=0x7f6cd8114f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.923+0000 7f6cddc00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810b280 0x7f6cd8114f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c9b0 tx=0x7f6cc800ccc0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.924+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 shutdown_connections 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.924+0000 7f6cddc00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6cbc0b29d0 0x7f6cbc0b4ee0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.924+0000 7f6cddc00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cd811d930 0x7f6cd81155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.924+0000 7f6cddc00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cd810a930 0x7f6cd811be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.924+0000 7f6cddc00700 1 --2- 172.21.15.120:0/3275069914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6cd810b280 0x7f6cd8114f30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.924+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 >> 172.21.15.120:0/3275069914 conn(0x7f6cd806f4d0 msgr2=0x7f6cd8072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:33.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.926+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 shutdown_connections 2024-05-14T09:30:33.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:33.926+0000 7f6cddc00700 1 -- 172.21.15.120:0/3275069914 wait complete. 2024-05-14T09:30:33.930 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 45 2024-05-14T09:30:34.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:34 smithi120 ceph-mon[31085]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 627 op/s 2024-05-14T09:30:34.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:34 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.135 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:34 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3275069914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:30:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 180.0 s, 571.3 tps, lat 192.994 ms stddev 242.804 2024-05-14T09:30:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:34 smithi152 ceph-mon[34868]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 627 op/s 2024-05-14T09:30:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:34 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:34 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3275069914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:30:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:34 smithi175 ceph-mon[35353]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 627 op/s 2024-05-14T09:30:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:34 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:34 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3275069914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T09:30:35.053 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T09:30:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:30:36.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:36 smithi120 ceph-mon[31085]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 645 op/s 2024-05-14T09:30:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:36 smithi152 ceph-mon[34868]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 645 op/s 2024-05-14T09:30:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:36 smithi175 ceph-mon[35353]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 645 op/s 2024-05-14T09:30:38.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:38 smithi120 ceph-mon[31085]: pgmap v768: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 10 MiB/s wr, 625 op/s 2024-05-14T09:30:38.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:38 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:38.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:38 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:38 smithi152 ceph-mon[34868]: pgmap v768: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 10 MiB/s wr, 625 op/s 2024-05-14T09:30:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:38 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:38 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:38 smithi175 ceph-mon[35353]: pgmap v768: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 10 MiB/s wr, 625 op/s 2024-05-14T09:30:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:38 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:38 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 185.0 s, 518.2 tps, lat 193.268 ms stddev 290.561 2024-05-14T09:30:39.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.475+0000 7f4885000700 1 -- 172.21.15.120:0/603510922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48800764b0 msgr2=0x7f4880114e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.475+0000 7f4885000700 1 --2- 172.21.15.120:0/603510922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48800764b0 0x7f4880114e30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4868009990 tx=0x7f4868009ca0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.475+0000 7f4885000700 1 -- 172.21.15.120:0/603510922 shutdown_connections 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.475+0000 7f4885000700 1 --2- 172.21.15.120:0/603510922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4880075b60 0x7f4880075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.475+0000 7f4885000700 1 --2- 172.21.15.120:0/603510922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4880115370 0x7f4880117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.475+0000 7f4885000700 1 --2- 172.21.15.120:0/603510922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48800764b0 0x7f4880114e30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.475+0000 7f4885000700 1 -- 172.21.15.120:0/603510922 >> 172.21.15.120:0/603510922 conn(0x7f4880100040 msgr2=0x7f4880102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.476+0000 7f4885000700 1 -- 172.21.15.120:0/603510922 shutdown_connections 2024-05-14T09:30:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.476+0000 7f4885000700 1 -- 172.21.15.120:0/603510922 wait complete. 2024-05-14T09:30:39.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.479+0000 7f4885000700 1 Processor -- start 2024-05-14T09:30:39.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.480+0000 7f4885000700 1 -- start start 2024-05-14T09:30:39.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.480+0000 7f4885000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4880075b60 0x7f48801a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.480+0000 7f4885000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48800764b0 0x7f48801a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.480+0000 7f4885000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4880115370 0x7f48801a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.480+0000 7f4885000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f488011aa60 con 0x7f4880115370 2024-05-14T09:30:39.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.480+0000 7f4885000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f488011a8e0 con 0x7f48800764b0 2024-05-14T09:30:39.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.480+0000 7f4885000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f488011abe0 con 0x7f4880075b60 2024-05-14T09:30:39.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.481+0000 7f487d400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48800764b0 0x7f48801a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.481+0000 7f487d400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48800764b0 0x7f48801a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:34990/0 (socket says 172.21.15.120:34990) 2024-05-14T09:30:39.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.481+0000 7f487d400700 1 -- 172.21.15.120:0/761010285 learned_addr learned my addr 172.21.15.120:0/761010285 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:39.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.481+0000 7f487de00700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4880075b60 0x7f48801a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.482+0000 7f487e800700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4880115370 0x7f48801a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.482+0000 7f487de00700 1 -- 172.21.15.120:0/761010285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48800764b0 msgr2=0x7f48801a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.482+0000 7f487de00700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48800764b0 0x7f48801a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.482+0000 7f487de00700 1 -- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4880115370 msgr2=0x7f48801a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.482+0000 7f487de00700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4880115370 0x7f48801a5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.482+0000 7f487de00700 1 -- 172.21.15.120:0/761010285 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48801a6320 con 0x7f4880075b60 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.482+0000 7f487e800700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4880115370 0x7f48801a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:39.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.483+0000 7f487de00700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4880075b60 0x7f48801a1450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f487000e9f0 tx=0x7f487000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:39.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.483+0000 7f4876a00700 1 -- 172.21.15.120:0/761010285 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000cbd0 con 0x7f4880075b60 2024-05-14T09:30:39.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.483+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48801a6610 con 0x7f4880075b60 2024-05-14T09:30:39.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.483+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488006d1e0 con 0x7f4880075b60 2024-05-14T09:30:39.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.484+0000 7f4876a00700 1 -- 172.21.15.120:0/761010285 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f487000cd70 con 0x7f4880075b60 2024-05-14T09:30:39.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.484+0000 7f4876a00700 1 -- 172.21.15.120:0/761010285 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870018680 con 0x7f4880075b60 2024-05-14T09:30:39.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.495+0000 7f4876a00700 1 -- 172.21.15.120:0/761010285 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4870018820 con 0x7f4880075b60 2024-05-14T09:30:39.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.498+0000 7f4876a00700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48640b29c0 0x7f48640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.498+0000 7f4876a00700 1 -- 172.21.15.120:0/761010285 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f48700e2670 con 0x7f4880075b60 2024-05-14T09:30:39.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.499+0000 7f487d400700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48640b29c0 0x7f48640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.500+0000 7f4893b07b80 1 Processor -- start 2024-05-14T09:30:39.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.501+0000 7f4893b07b80 1 -- start start 2024-05-14T09:30:39.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.501+0000 7f487d400700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48640b29c0 0x7f48640b4ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4868009750 tx=0x7f486800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:39.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7fdc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fdce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f4893b07b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7efea20 con 0x55c1c7e5ee40 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f4893b07b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7e9c760 con 0x55c1c7fdc9f0 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f4893b07b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7efa9e0 con 0x55c1c7fe2830 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f487d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7fdc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f487de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f487d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7fdc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44012/0 (socket says 172.21.15.120:44012) 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.502+0000 7f487d400700 1 -- 172.21.15.120:0/4057345467 learned_addr learned my addr 172.21.15.120:0/4057345467 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:39.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.503+0000 7f487e800700 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fdce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.503+0000 7f487d400700 1 -- 172.21.15.120:0/4057345467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 msgr2=0x55c1c7fdce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.503+0000 7f487d400700 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fdce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.503+0000 7f487d400700 1 -- 172.21.15.120:0/4057345467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 msgr2=0x55c1c7fe22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.503+0000 7f487d400700 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.503+0000 7f487d400700 1 -- 172.21.15.120:0/4057345467 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c7e4b8d0 con 0x55c1c7fe2830 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.504+0000 7f487d400700 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7fdc4b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f486800b7a0 tx=0x7f486801e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f32db91130eefd7d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.505+0000 7f487de00700 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.505+0000 7f486f400700 1 -- 172.21.15.120:0/4057345467 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868003880 con 0x55c1c7fe2830 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.505+0000 7f486f400700 1 -- 172.21.15.120:0/4057345467 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f486800f460 con 0x55c1c7fe2830 2024-05-14T09:30:39.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 -- 172.21.15.120:0/4057345467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 msgr2=0x55c1c7fdc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7fdc4b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f486800b7a0 tx=0x7f486801e000 comp rx=0 tx=0).stop 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 -- 172.21.15.120:0/4057345467 shutdown_connections 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fdce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 --2- 172.21.15.120:0/4057345467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7fdc4b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 -- 172.21.15.120:0/4057345467 >> 172.21.15.120:0/4057345467 conn(0x55c1c7ea3f70 msgr2=0x55c1c7fd72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 -- 172.21.15.120:0/4057345467 shutdown_connections 2024-05-14T09:30:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.507+0000 7f4893b07b80 1 -- 172.21.15.120:0/4057345467 wait complete. 2024-05-14T09:30:39.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.508+0000 7f4893b07b80 1 -- start start 2024-05-14T09:30:39.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.508+0000 7f4893b07b80 1 Processor -- start 2024-05-14T09:30:39.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.509+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.509+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fe6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.509+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7fe2830 0x55c1c7fe69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.509+0000 7f4893b07b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7fe9350 con 0x55c1c7fe2830 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.509+0000 7f4893b07b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7e64b20 con 0x55c1c7e5ee40 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.509+0000 7f4893b07b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7fe94d0 con 0x55c1c7fdc9f0 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.509+0000 7f4893b07b80 10 client.0 _ll_register_callbacks cb 0x55c1c7ea5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.510+0000 7f487de00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.510+0000 7f487d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fe6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.510+0000 7f487de00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:35004/0 (socket says 172.21.15.120:35004) 2024-05-14T09:30:39.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.510+0000 7f487de00700 1 -- 172.21.15.120:0/1678964325 learned_addr learned my addr 172.21.15.120:0/1678964325 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:39.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.511+0000 7f487e800700 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7fe2830 0x55c1c7fe69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.511+0000 7f487de00700 1 -- 172.21.15.120:0/1678964325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 msgr2=0x55c1c7fe6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.511+0000 7f487de00700 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fe6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.511+0000 7f487de00700 1 -- 172.21.15.120:0/1678964325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7fe2830 msgr2=0x55c1c7fe69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.512+0000 7f487de00700 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7fe2830 0x55c1c7fe69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.512+0000 7f487de00700 1 -- 172.21.15.120:0/1678964325 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c7ec4420 con 0x55c1c7e5ee40 2024-05-14T09:30:39.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.513+0000 7f487de00700 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe5f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f487000c5b0 tx=0x7f48700a91e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a7e2f69fabdb1f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:39.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.513+0000 7f4863e00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:30:39.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.513+0000 7f4863e00700 1 -- 172.21.15.120:0/1678964325 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700a93a0 con 0x55c1c7e5ee40 2024-05-14T09:30:39.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.513+0000 7f4863e00700 1 -- 172.21.15.120:0/1678964325 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f48700a5e80 con 0x55c1c7e5ee40 2024-05-14T09:30:39.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.513+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f486800f460 con 0x55c1c7e5ee40 2024-05-14T09:30:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.516+0000 7f4863e00700 1 -- 172.21.15.120:0/1678964325 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f48700a9f90 con 0x55c1c7e5ee40 2024-05-14T09:30:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.516+0000 7f4893b07b80 10 client.36119 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.516+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55c1c7ff3ea0 con 0x55c1c7e5ee40 2024-05-14T09:30:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4863e00700 1 -- 172.21.15.120:0/1678964325 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f486800f460 con 0x55c1c7e5ee40 2024-05-14T09:30:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4863e00700 1 -- 172.21.15.120:0/1678964325 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f48700bece0 con 0x55c1c7e5ee40 2024-05-14T09:30:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4893b07b80 10 client.36119 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4893b07b80 10 client.36119 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:30:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4893b07b80 20 client.36119 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4893b07b80 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c7ff64e0 0x55c1c7ff8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4893b07b80 4 client.36119 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:39.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.517+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1c7fa91c0 con 0x55c1c7ff64e0 2024-05-14T09:30:39.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.518+0000 7f487d400700 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c7ff64e0 0x55c1c7ff8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.519+0000 7f4863e00700 10 client.36119 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:30:39.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.521+0000 7f487d400700 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c7ff64e0 0x55c1c7ff8900 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d1bc8d8c1d0903e server_cookie=a8ec6362cb32dc6f in_seq=0 out_seq=0 2024-05-14T09:30:39.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.523+0000 7f4863e00700 1 -- 172.21.15.120:0/1678964325 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c1c7fa91c0 con 0x55c1c7ff64e0 2024-05-14T09:30:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.523+0000 7f4863e00700 10 client.36119 handle_command_reply: tid=0 2024-05-14T09:30:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.523+0000 7f4893b07b80 1 client.36119 shutdown 2024-05-14T09:30:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.523+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7e5ee40 msgr2=0x55c1c7fe5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.523+0000 7f4893b07b80 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe5f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f487000c5b0 tx=0x7f48700a91e0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.524+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 shutdown_connections 2024-05-14T09:30:39.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.524+0000 7f4893b07b80 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c7ff64e0 0x55c1c7ff8900 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.524+0000 7f4893b07b80 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fe5f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.524+0000 7f4893b07b80 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7fe2830 0x55c1c7fe69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.524+0000 7f4893b07b80 1 --2- 172.21.15.120:0/1678964325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7fe6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.524+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 >> 172.21.15.120:0/1678964325 conn(0x55c1c7ea3f70 msgr2=0x55c1c7fdce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.524+0000 7f4863e00700 0 client.36119 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:30:39.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.525+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 shutdown_connections 2024-05-14T09:30:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.525+0000 7f4893b07b80 1 -- 172.21.15.120:0/1678964325 wait complete. 2024-05-14T09:30:39.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.525+0000 7f4893b07b80 20 client.36119 trim_cache size 0 max 16384 2024-05-14T09:30:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.561+0000 7f4893b07b80 1 Processor -- start 2024-05-14T09:30:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.561+0000 7f4893b07b80 1 -- start start 2024-05-14T09:30:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.562+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fdc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.562+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ff2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.562+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.562+0000 7f4893b07b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f485c00eb30 con 0x55c1c7e5ee40 2024-05-14T09:30:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.562+0000 7f4893b07b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f485c010700 con 0x55c1c7fe2830 2024-05-14T09:30:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.562+0000 7f4893b07b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f485c00f200 con 0x55c1c7fdc9f0 2024-05-14T09:30:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.563+0000 7f487de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fdc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.563+0000 7f487de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fdc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52864/0 (socket says 172.21.15.120:52864) 2024-05-14T09:30:39.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.563+0000 7f487de00700 1 -- 172.21.15.120:0/3175646244 learned_addr learned my addr 172.21.15.120:0/3175646244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:39.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.564+0000 7f487e800700 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.564+0000 7f487d400700 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ff2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.565+0000 7f487e800700 1 -- 172.21.15.120:0/3175646244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 msgr2=0x55c1c7ff2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.565+0000 7f487e800700 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ff2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.565+0000 7f487e800700 1 -- 172.21.15.120:0/3175646244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 msgr2=0x55c1c7fdc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.565+0000 7f487e800700 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fdc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.567+0000 7f487e800700 1 -- 172.21.15.120:0/3175646244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c7fe2d00 con 0x55c1c7fe2830 2024-05-14T09:30:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.568+0000 7f487e800700 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdfd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4878007fa0 tx=0x7f4878011710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c2a6645d6af16d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.569+0000 7f486ea00700 1 -- 172.21.15.120:0/3175646244 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487801a640 con 0x55c1c7fe2830 2024-05-14T09:30:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.570+0000 7f486ea00700 1 -- 172.21.15.120:0/3175646244 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4878019870 con 0x55c1c7fe2830 2024-05-14T09:30:39.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.570+0000 7f486ea00700 1 -- 172.21.15.120:0/3175646244 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487800e840 con 0x55c1c7fe2830 2024-05-14T09:30:39.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.571+0000 7f4893b07b80 1 -- 172.21.15.120:0/3175646244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fe2830 msgr2=0x55c1c7ffdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.571+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdfd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4878007fa0 tx=0x7f4878011710 comp rx=0 tx=0).stop 2024-05-14T09:30:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.572+0000 7f4893b07b80 1 -- 172.21.15.120:0/3175646244 shutdown_connections 2024-05-14T09:30:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.572+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdfd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.572+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7fdc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.572+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3175646244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ff2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.572+0000 7f4893b07b80 1 -- 172.21.15.120:0/3175646244 >> 172.21.15.120:0/3175646244 conn(0x55c1c7ea3f70 msgr2=0x55c1c7fd72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.572+0000 7f4893b07b80 1 -- 172.21.15.120:0/3175646244 shutdown_connections 2024-05-14T09:30:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.572+0000 7f4893b07b80 1 -- 172.21.15.120:0/3175646244 wait complete. 2024-05-14T09:30:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.573+0000 7f4893b07b80 1 -- start start 2024-05-14T09:30:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.574+0000 7f4893b07b80 1 Processor -- start 2024-05-14T09:30:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.575+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7feee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.576+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ffd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.576+0000 7f4893b07b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.576+0000 7f487de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7feee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.577+0000 7f4893b07b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f485c00ffd0 con 0x55c1c7e5ee40 2024-05-14T09:30:39.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.577+0000 7f4893b07b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f485c00f900 con 0x55c1c7fdc9f0 2024-05-14T09:30:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.577+0000 7f4893b07b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f485c00caf0 con 0x55c1c7fe2830 2024-05-14T09:30:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.577+0000 7f487de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7feee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52870/0 (socket says 172.21.15.120:52870) 2024-05-14T09:30:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.578+0000 7f487de00700 1 -- 172.21.15.120:0/3906302580 learned_addr learned my addr 172.21.15.120:0/3906302580 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.578+0000 7f4893b07b80 10 client.0 _ll_register_callbacks cb 0x55c1c7ea5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.577+0000 7f487d400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ffd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.578+0000 7f487e800700 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.579+0000 7f487de00700 1 -- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 msgr2=0x55c1c7ffdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.579+0000 7f487de00700 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.579+0000 7f487de00700 1 -- 172.21.15.120:0/3906302580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 msgr2=0x55c1c7ffd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.580+0000 7f487de00700 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ffd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.580+0000 7f487de00700 1 -- 172.21.15.120:0/3906302580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c7ffe4a0 con 0x55c1c7e5ee40 2024-05-14T09:30:39.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.580+0000 7f487d400700 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ffd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.581+0000 7f487de00700 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7feee30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f48700b24a0 tx=0x7f48700cbd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446e5db841e09fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.581+0000 7f4863e00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.581+0000 7f4863e00700 1 -- 172.21.15.120:0/3906302580 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870088060 con 0x55c1c7e5ee40 2024-05-14T09:30:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.582+0000 7f4863e00700 1 -- 172.21.15.120:0/3906302580 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f48700c6050 con 0x55c1c7e5ee40 2024-05-14T09:30:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.582+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4878019870 con 0x55c1c7e5ee40 2024-05-14T09:30:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.583+0000 7f4863e00700 1 -- 172.21.15.120:0/3906302580 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f48700a93a0 con 0x55c1c7e5ee40 2024-05-14T09:30:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.583+0000 7f4893b07b80 10 client.16632 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.583+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55c1c8060b90 con 0x55c1c7e5ee40 2024-05-14T09:30:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4863e00700 1 -- 172.21.15.120:0/3906302580 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4878019870 con 0x55c1c7e5ee40 2024-05-14T09:30:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4863e00700 1 -- 172.21.15.120:0/3906302580 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f48700bece0 con 0x55c1c7e5ee40 2024-05-14T09:30:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4893b07b80 10 client.16632 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4893b07b80 10 client.16632 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-14T09:30:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4893b07b80 20 client.16632 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c8061250 0x55c1c8063670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4893b07b80 4 client.16632 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:30:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.584+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 --> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1c7f0c400 con 0x55c1c8061250 2024-05-14T09:30:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.586+0000 7f487d400700 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c8061250 0x55c1c8063670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.587+0000 7f487d400700 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c8061250 0x55c1c8063670 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2c24bc4c0efa028c server_cookie=c112507c2e7e0e60 in_seq=0 out_seq=0 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.587+0000 7f4863e00700 10 client.16632 ms_handle_connect on v2:172.21.15.175:6836/3978387102 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.588+0000 7f4863e00700 1 -- 172.21.15.120:0/3906302580 <== mds.4 v2:172.21.15.175:6836/3978387102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+211 (crc 0 0 0) 0x55c1c7f0c400 con 0x55c1c8061250 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.588+0000 7f4863e00700 10 client.16632 handle_command_reply: tid=0 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.588+0000 7f4893b07b80 1 client.16632 shutdown 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 msgr2=0x55c1c7feee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7feee30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f48700b24a0 tx=0x7f48700cbd80 comp rx=0 tx=0).stop 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 shutdown_connections 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:6836/3978387102,v1:172.21.15.175:6837/3978387102] conn(0x55c1c8061250 0x55c1c8063670 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4863e00700 0 client.16632 ms_handle_reset on v2:172.21.15.175:6836/3978387102 2024-05-14T09:30:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1c7fe2830 0x55c1c7ffdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1c7e5ee40 0x55c1c7feee30 secure :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f48700b24a0 tx=0x7f48700cbd80 comp rx=0 tx=0).stop 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 --2- 172.21.15.120:0/3906302580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c7fdc9f0 0x55c1c7ffd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.589+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 >> 172.21.15.120:0/3906302580 conn(0x55c1c7ea3f70 msgr2=0x55c1c7fd72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.590+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 shutdown_connections 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.590+0000 7f4893b07b80 1 -- 172.21.15.120:0/3906302580 wait complete. 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:30:39.592 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-05-14T09:30:39.593 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4045307680, 2024-05-14T09:30:39.593 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511629246, 2024-05-14T09:30:39.593 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_subtrans/0001" 2024-05-14T09:30:39.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:30:39.593 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-05-14T09:30:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.591+0000 7f4893b07b80 20 client.16632 trim_cache size 0 max 16384 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48640b29c0 msgr2=0x7f48640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48640b29c0 0x7f48640b4ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4868009750 tx=0x7f486800b260 comp rx=0 tx=0).stop 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4880075b60 msgr2=0x7f48801a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4880075b60 0x7f48801a1450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f487000e9f0 tx=0x7f487000ed00 comp rx=0 tx=0).stop 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 shutdown_connections 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f48640b29c0 0x7f48640b4ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4880115370 0x7f48801a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4880075b60 0x7f48801a1450 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 --2- 172.21.15.120:0/761010285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48800764b0 0x7f48801a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.592+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 >> 172.21.15.120:0/761010285 conn(0x7f4880100040 msgr2=0x7f48801006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.593+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 shutdown_connections 2024-05-14T09:30:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:39.593+0000 7f4885000700 1 -- 172.21.15.120:0/761010285 wait complete. 2024-05-14T09:30:40.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:40 smithi175 ceph-mon[35353]: pgmap v769: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 661 op/s 2024-05-14T09:30:40.280 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:30:40.280 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:30:40.280 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:40 smithi120 ceph-mon[31085]: pgmap v769: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 661 op/s 2024-05-14T09:30:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:30:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:30:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:40.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:40 smithi152 ceph-mon[34868]: pgmap v769: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 661 op/s 2024-05-14T09:30:40.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:30:40.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:30:40.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:30:41.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T09:30:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:30:42.229 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:42 smithi120 ceph-mon[31085]: pgmap v770: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 638 op/s 2024-05-14T09:30:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:42 smithi152 ceph-mon[34868]: pgmap v770: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 638 op/s 2024-05-14T09:30:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:42 smithi175 ceph-mon[35353]: pgmap v770: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 638 op/s 2024-05-14T09:30:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1138393371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10b4c0 msgr2=0x7f8cdc10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1138393371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10b4c0 0x7f8cdc10b8d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009900 tx=0x7f8cc802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1138393371 shutdown_connections 2024-05-14T09:30:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1138393371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cdc1101c0 0x7f8cdc1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1138393371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10b4c0 0x7f8cdc10b8d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1138393371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc10a280 0x7f8cdc10af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1138393371 >> 172.21.15.120:0/1138393371 conn(0x7f8cdc078f10 msgr2=0x7f8cdc107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1138393371 shutdown_connections 2024-05-14T09:30:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.736+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1138393371 wait complete. 2024-05-14T09:30:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.738+0000 7f8ce3e00640 1 Processor -- start 2024-05-14T09:30:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.738+0000 7f8ce3e00640 1 -- start start 2024-05-14T09:30:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.739+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10a280 0x7f8cdc1a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.739+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cdc10b4c0 0x7f8cdc1a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.739+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc1101c0 0x7f8cdc1a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.739+0000 7f8ce3e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc115ca0 con 0x7f8cdc10a280 2024-05-14T09:30:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.739+0000 7f8ce3e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc115b20 con 0x7f8cdc10b4c0 2024-05-14T09:30:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.739+0000 7f8ce3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc115e20 con 0x7f8cdc1101c0 2024-05-14T09:30:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.739+0000 7f8ce1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10a280 0x7f8cdc1a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.740+0000 7f8ce1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc1101c0 0x7f8cdc1a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.740+0000 7f8ce1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc1101c0 0x7f8cdc1a7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44046/0 (socket says 172.21.15.120:44046) 2024-05-14T09:30:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.740+0000 7f8ce1e00640 1 -- 172.21.15.120:0/1314966581 learned_addr learned my addr 172.21.15.120:0/1314966581 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.740+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cdc10b4c0 0x7f8cdc1a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.741+0000 7f8ce1e00640 1 -- 172.21.15.120:0/1314966581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cdc10b4c0 msgr2=0x7f8cdc1a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.741+0000 7f8ce1e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cdc10b4c0 0x7f8cdc1a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.741+0000 7f8ce1e00640 1 -- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10a280 msgr2=0x7f8cdc1a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.741+0000 7f8ce1e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10a280 0x7f8cdc1a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.741+0000 7f8ce1e00640 1 -- 172.21.15.120:0/1314966581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc1a83b0 con 0x7f8cdc1101c0 2024-05-14T09:30:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.741+0000 7f8ce1400640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10a280 0x7f8cdc1a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.742+0000 7f8ce1e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc1101c0 0x7f8cdc1a7d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400eaa0 tx=0x7f8cd400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.743+0000 7f8cda000640 1 -- 172.21.15.120:0/1314966581 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd400cdb0 con 0x7f8cdc1101c0 2024-05-14T09:30:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.743+0000 7f8cda000640 1 -- 172.21.15.120:0/1314966581 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cd4005020 con 0x7f8cdc1101c0 2024-05-14T09:30:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.743+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cdc1a86a0 con 0x7f8cdc1101c0 2024-05-14T09:30:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.743+0000 7f8cda000640 1 -- 172.21.15.120:0/1314966581 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40116d0 con 0x7f8cdc1101c0 2024-05-14T09:30:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.743+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cdc1a8b70 con 0x7f8cdc1101c0 2024-05-14T09:30:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.748+0000 7f8ceae6c740 1 Processor -- start 2024-05-14T09:30:43.750 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.749+0000 7f8cda000640 1 -- 172.21.15.120:0/1314966581 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8cd40051d0 con 0x7f8cdc1101c0 2024-05-14T09:30:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.750+0000 7f8ceae6c740 1 -- start start 2024-05-14T09:30:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.751+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 0x5619b3da1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.751+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39d62f0 0x5619b3da1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.751+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39de4d0 0x5619b3da8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.751+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5619b3d05550 con 0x5619b39d62f0 2024-05-14T09:30:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.751+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5619b3caabc0 con 0x5619b39ff1b0 2024-05-14T09:30:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.751+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619b3d01510 con 0x5619b39de4d0 2024-05-14T09:30:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.751+0000 7f8ce1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39d62f0 0x5619b3da1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.752+0000 7f8ce1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39d62f0 0x5619b3da1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52912/0 (socket says 172.21.15.120:52912) 2024-05-14T09:30:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.752+0000 7f8ce1400640 1 -- 172.21.15.120:0/905523009 learned_addr learned my addr 172.21.15.120:0/905523009 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.752+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 0x5619b3da1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.752+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39de4d0 0x5619b3da8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8cda000640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cc40b28b0 0x7f8cc40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8ce1400640 1 -- 172.21.15.120:0/905523009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39de4d0 msgr2=0x5619b3da8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8ce1400640 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39de4d0 0x5619b3da8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8ce1400640 1 -- 172.21.15.120:0/905523009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 msgr2=0x5619b3da1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8ce1400640 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 0x5619b3da1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8ce1400640 1 -- 172.21.15.120:0/905523009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b3a17210 con 0x5619b39d62f0 2024-05-14T09:30:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8cda000640 1 -- 172.21.15.120:0/1314966581 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8cd40e2ab0 con 0x7f8cdc1101c0 2024-05-14T09:30:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.753+0000 7f8ce1e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cc40b28b0 0x7f8cc40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.754+0000 7f8ce1400640 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39d62f0 0x5619b3da1680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0010480 tx=0x7f8cd0010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f149779c57757260 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:43.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.754+0000 7f8ce1e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cc40b28b0 0x7f8cc40b4dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40a9a80 tx=0x7f8cd40057c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:43.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.754+0000 7f8cce600640 1 -- 172.21.15.120:0/905523009 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0011760 con 0x5619b39d62f0 2024-05-14T09:30:43.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.755+0000 7f8cce600640 1 -- 172.21.15.120:0/905523009 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cd0011d90 con 0x5619b39d62f0 2024-05-14T09:30:43.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.755+0000 7f8cce600640 1 -- 172.21.15.120:0/905523009 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000e430 con 0x5619b39d62f0 2024-05-14T09:30:43.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.756+0000 7f8ceae6c740 1 -- 172.21.15.120:0/905523009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39d62f0 msgr2=0x5619b3da1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.756+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39d62f0 0x5619b3da1680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0010480 tx=0x7f8cd0010940 comp rx=0 tx=0).stop 2024-05-14T09:30:43.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.756+0000 7f8ceae6c740 1 -- 172.21.15.120:0/905523009 shutdown_connections 2024-05-14T09:30:43.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.756+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39de4d0 0x5619b3da8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.756+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39d62f0 0x5619b3da1680 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.756+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/905523009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 0x5619b3da1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.756+0000 7f8ceae6c740 1 -- 172.21.15.120:0/905523009 >> 172.21.15.120:0/905523009 conn(0x5619b39f3300 msgr2=0x5619b3d9ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.757+0000 7f8ceae6c740 1 -- 172.21.15.120:0/905523009 shutdown_connections 2024-05-14T09:30:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.757+0000 7f8ceae6c740 1 -- 172.21.15.120:0/905523009 wait complete. 2024-05-14T09:30:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.757+0000 7f8ceae6c740 1 -- start start 2024-05-14T09:30:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.758+0000 7f8ceae6c740 1 Processor -- start 2024-05-14T09:30:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.759+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.759+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39de4d0 0x5619b3dab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.759+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 0x5619b3db20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.759+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5619b3da9020 con 0x5619b39de4d0 2024-05-14T09:30:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.759+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5619b3cbe660 con 0x5619b39ff1b0 2024-05-14T09:30:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.759+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619b3da91a0 con 0x5619b39d62f0 2024-05-14T09:30:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.759+0000 7f8ceae6c740 10 client.0 _ll_register_callbacks cb 0x5619b3c88400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.760+0000 7f8ce1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39de4d0 0x5619b3dab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.760+0000 7f8ce1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39de4d0 0x5619b3dab1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52928/0 (socket says 172.21.15.120:52928) 2024-05-14T09:30:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.760+0000 7f8ce1400640 1 -- 172.21.15.120:0/321100281 learned_addr learned my addr 172.21.15.120:0/321100281 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.761+0000 7f8ce1400640 1 -- 172.21.15.120:0/321100281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 msgr2=0x5619b3daaca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:30:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.761+0000 7f8ce1400640 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daaca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.761+0000 7f8ce1400640 1 -- 172.21.15.120:0/321100281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 msgr2=0x5619b3db20d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:30:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.761+0000 7f8ce1400640 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 0x5619b3db20d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.761+0000 7f8ce1400640 1 -- 172.21.15.120:0/321100281 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b3ae3620 con 0x5619b39de4d0 2024-05-14T09:30:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.762+0000 7f8ce1400640 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39de4d0 0x5619b3dab1e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c010 tx=0x7f8cd001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd08163447ba323 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.762+0000 7f8cc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.762+0000 7f8cc2a00640 1 -- 172.21.15.120:0/321100281 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd002b060 con 0x5619b39de4d0 2024-05-14T09:30:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.762+0000 7f8cc2a00640 1 -- 172.21.15.120:0/321100281 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8cd0005250 con 0x5619b39de4d0 2024-05-14T09:30:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.763+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cd0011d90 con 0x5619b39de4d0 2024-05-14T09:30:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.763+0000 7f8cc2a00640 1 -- 172.21.15.120:0/321100281 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8cd0005450 con 0x5619b39de4d0 2024-05-14T09:30:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.763+0000 7f8ceae6c740 10 client.16644 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.764+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5619b3db5070 con 0x5619b39de4d0 2024-05-14T09:30:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.765+0000 7f8cc2a00640 1 -- 172.21.15.120:0/321100281 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cd0011d90 con 0x5619b39de4d0 2024-05-14T09:30:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.765+0000 7f8cc2a00640 1 -- 172.21.15.120:0/321100281 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f8cd0004850 con 0x5619b39de4d0 2024-05-14T09:30:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.766+0000 7f8ceae6c740 10 client.16644 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.766+0000 7f8ceae6c740 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.766+0000 7f8ceae6c740 20 client.16644 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.766+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b39bdd80 0x5619b3db8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.766+0000 7f8ceae6c740 4 client.16644 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.766+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619b3d13160 con 0x5619b39bdd80 2024-05-14T09:30:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.766+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b39bdd80 0x5619b3db8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.768+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b39bdd80 0x5619b3db8490 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6255c1274ea27762 server_cookie=dafa288bcf12cd93 in_seq=0 out_seq=0 2024-05-14T09:30:43.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.768+0000 7f8cc2a00640 10 client.16644 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.771+0000 7f8cc2a00640 1 -- 172.21.15.120:0/321100281 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5619b3d13160 con 0x5619b39bdd80 2024-05-14T09:30:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.771+0000 7f8cc2a00640 10 client.16644 handle_command_reply: tid=0 2024-05-14T09:30:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.771+0000 7f8ceae6c740 1 client.16644 shutdown 2024-05-14T09:30:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39de4d0 msgr2=0x5619b3dab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39de4d0 0x5619b3dab1e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c010 tx=0x7f8cd001c7f0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 shutdown_connections 2024-05-14T09:30:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b39bdd80 0x5619b3db8490 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39ff1b0 0x5619b3db20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39de4d0 0x5619b3dab1e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/321100281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.772+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 >> 172.21.15.120:0/321100281 conn(0x5619b39f3300 msgr2=0x5619b3d9f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.773+0000 7f8cc2a00640 0 client.16644 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.773+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 shutdown_connections 2024-05-14T09:30:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.773+0000 7f8ceae6c740 1 -- 172.21.15.120:0/321100281 wait complete. 2024-05-14T09:30:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.773+0000 7f8ceae6c740 20 client.16644 trim_cache size 0 max 16384 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 Processor -- start 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 -- start start 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3da9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3da9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39ff1b0 0x5619b3db1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b3040 con 0x5619b39ff1b0 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b4c10 con 0x5619b39de4d0 2024-05-14T09:30:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.801+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b3710 con 0x5619b39d62f0 2024-05-14T09:30:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.802+0000 7f8ce0a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39ff1b0 0x5619b3db1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.802+0000 7f8ce0a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39ff1b0 0x5619b3db1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52940/0 (socket says 172.21.15.120:52940) 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.802+0000 7f8ce0a00640 1 -- 172.21.15.120:0/32437187 learned_addr learned my addr 172.21.15.120:0/32437187 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.803+0000 7f8ce0a00640 1 -- 172.21.15.120:0/32437187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 msgr2=0x5619b3da9540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.803+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3da9540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.803+0000 7f8ce0a00640 1 -- 172.21.15.120:0/32437187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 msgr2=0x5619b3da9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.803+0000 7f8ce1400640 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3da9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.803+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3da9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.803+0000 7f8ce0a00640 1 -- 172.21.15.120:0/32437187 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b3da8480 con 0x5619b39ff1b0 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.803+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39ff1b0 0x5619b3db1ff0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8031460 tx=0x7f8cc8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffd45be19ea7d49 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.804+0000 7f8ccdc00640 1 -- 172.21.15.120:0/32437187 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8035040 con 0x5619b39ff1b0 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.804+0000 7f8ccdc00640 1 -- 172.21.15.120:0/32437187 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc804d070 con 0x5619b39ff1b0 2024-05-14T09:30:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.804+0000 7f8ccdc00640 1 -- 172.21.15.120:0/32437187 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8003d80 con 0x5619b39ff1b0 2024-05-14T09:30:43.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.804+0000 7f8ce1400640 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3da9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:43.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 -- 172.21.15.120:0/32437187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39ff1b0 msgr2=0x5619b3db1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39ff1b0 0x5619b3db1ff0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8031460 tx=0x7f8cc8005fd0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 -- 172.21.15.120:0/32437187 shutdown_connections 2024-05-14T09:30:43.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39ff1b0 0x5619b3db1ff0 secure :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8031460 tx=0x7f8cc8005fd0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3da9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/32437187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3da9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 -- 172.21.15.120:0/32437187 >> 172.21.15.120:0/32437187 conn(0x5619b39f3300 msgr2=0x5619b3da50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:43.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 -- 172.21.15.120:0/32437187 shutdown_connections 2024-05-14T09:30:43.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.805+0000 7f8ceae6c740 1 -- 172.21.15.120:0/32437187 wait complete. 2024-05-14T09:30:43.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.806+0000 7f8ceae6c740 1 -- start start 2024-05-14T09:30:43.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.806+0000 7f8ceae6c740 1 Processor -- start 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3dafd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ceae6c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39931c0 0x5619b3e2f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b44e0 con 0x5619b39931c0 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b3e10 con 0x5619b39de4d0 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ceae6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b1000 con 0x5619b39d62f0 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ceae6c740 10 client.0 _ll_register_callbacks cb 0x7f8cd000beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ce1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3dafd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ce1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3dafd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:35052/0 (socket says 172.21.15.120:35052) 2024-05-14T09:30:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.807+0000 7f8ce1400640 1 -- 172.21.15.120:0/2814939838 learned_addr learned my addr 172.21.15.120:0/2814939838 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39931c0 0x5619b3e2f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce1400640 1 -- 172.21.15.120:0/2814939838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 msgr2=0x5619b3daf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce1400640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce1400640 1 -- 172.21.15.120:0/2814939838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39931c0 msgr2=0x5619b3e2f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce1400640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39931c0 0x5619b3e2f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce1400640 1 -- 172.21.15.120:0/2814939838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b3db03e0 con 0x5619b39de4d0 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.808+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.809+0000 7f8ce1400640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3dafd70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0010980 tx=0x7f8cd0001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4e2b334ab3f6797 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.809+0000 7f8cc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.809+0000 7f8cc2a00640 1 -- 172.21.15.120:0/2814939838 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0035080 con 0x5619b39de4d0 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.809+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cc804d070 con 0x5619b39de4d0 2024-05-14T09:30:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.809+0000 7f8cc2a00640 1 -- 172.21.15.120:0/2814939838 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8cd0005250 con 0x5619b39de4d0 2024-05-14T09:30:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.810+0000 7f8cc2a00640 1 -- 172.21.15.120:0/2814939838 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8cd0005450 con 0x5619b39de4d0 2024-05-14T09:30:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.810+0000 7f8ceae6c740 10 client.36137 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.810+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5619b3e30d40 con 0x5619b39de4d0 2024-05-14T09:30:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8cc2a00640 1 -- 172.21.15.120:0/2814939838 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc804d070 con 0x5619b39de4d0 2024-05-14T09:30:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8cc2a00640 1 -- 172.21.15.120:0/2814939838 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f8cd0004850 con 0x5619b39de4d0 2024-05-14T09:30:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8ceae6c740 10 client.36137 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8ceae6c740 10 client.36137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8ceae6c740 20 client.36137 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b3e31530 0x5619b3e33950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8ceae6c740 4 client.36137 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:30:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.811+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619b3d0cfd0 con 0x5619b3e31530 2024-05-14T09:30:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.812+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b3e31530 0x5619b3e33950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.813+0000 7f8ce0a00640 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b3e31530 0x5619b3e33950 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33592810f746ffe2 server_cookie=f66aa6a8ce2076c0 in_seq=0 out_seq=0 2024-05-14T09:30:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.813+0000 7f8cc2a00640 10 client.36137 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.858+0000 7f8cc2a00640 1 -- 172.21.15.120:0/2814939838 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619b3d0cfd0 con 0x5619b3e31530 2024-05-14T09:30:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.858+0000 7f8cc2a00640 10 client.36137 handle_command_reply: tid=0 2024-05-14T09:30:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.858+0000 7f8ceae6c740 1 client.36137 shutdown 2024-05-14T09:30:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 msgr2=0x5619b3dafd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3dafd70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0010980 tx=0x7f8cd0001e50 comp rx=0 tx=0).stop 2024-05-14T09:30:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 shutdown_connections 2024-05-14T09:30:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5619b3e31530 0x5619b3e33950 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619b39931c0 0x5619b3e2f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619b39de4d0 0x5619b3dafd70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 --2- 172.21.15.120:0/2814939838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619b39d62f0 0x5619b3daf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8cc2a00640 0 client.36137 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.859+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 >> 172.21.15.120:0/2814939838 conn(0x5619b39f3300 msgr2=0x5619b3da50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.860+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 shutdown_connections 2024-05-14T09:30:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.860+0000 7f8ceae6c740 1 -- 172.21.15.120:0/2814939838 wait complete. 2024-05-14T09:30:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.860+0000 7f8ceae6c740 20 client.36137 trim_cache size 0 max 16384 2024-05-14T09:30:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:30:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:30:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:30:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.861+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cc40b28b0 msgr2=0x7f8cc40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.861+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cc40b28b0 0x7f8cc40b4dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40a9a80 tx=0x7f8cd40057c0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.861+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc1101c0 msgr2=0x7f8cdc1a7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.861+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc1101c0 0x7f8cdc1a7d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400eaa0 tx=0x7f8cd400ef60 comp rx=0 tx=0).stop 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 shutdown_connections 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cc40b28b0 0x7f8cc40b4dc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cdc1101c0 0x7f8cdc1a7d40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cdc10b4c0 0x7f8cdc1a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 --2- 172.21.15.120:0/1314966581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cdc10a280 0x7f8cdc1a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 >> 172.21.15.120:0/1314966581 conn(0x7f8cdc078f10 msgr2=0x7f8cdc10c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 shutdown_connections 2024-05-14T09:30:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:43.862+0000 7f8ce3e00640 1 -- 172.21.15.120:0/1314966581 wait complete. 2024-05-14T09:30:44.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 190.0 s, 508.6 tps, lat 196.908 ms stddev 257.217 2024-05-14T09:30:44.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:44 smithi120 ceph-mon[31085]: pgmap v771: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 607 op/s 2024-05-14T09:30:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:44 smithi152 ceph-mon[34868]: pgmap v771: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 607 op/s 2024-05-14T09:30:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:44 smithi175 ceph-mon[35353]: pgmap v771: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 607 op/s 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 -- 172.21.15.120:0/3254814561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080108f20 msgr2=0x7f7080109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 --2- 172.21.15.120:0/3254814561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080108f20 0x7f7080109330 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f706c009920 tx=0x7f706c009c30 comp rx=0 tx=0).stop 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 -- 172.21.15.120:0/3254814561 shutdown_connections 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 --2- 172.21.15.120:0/3254814561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7080109870 0x7f70801111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 --2- 172.21.15.120:0/3254814561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 0x7f7080104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 --2- 172.21.15.120:0/3254814561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080108f20 0x7f7080109330 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 -- 172.21.15.120:0/3254814561 >> 172.21.15.120:0/3254814561 conn(0x7f7080100040 msgr2=0x7f7080102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 -- 172.21.15.120:0/3254814561 shutdown_connections 2024-05-14T09:30:44.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.717+0000 7f7087e00700 1 -- 172.21.15.120:0/3254814561 wait complete. 2024-05-14T09:30:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.719+0000 7f7087e00700 1 Processor -- start 2024-05-14T09:30:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.719+0000 7f7087e00700 1 -- start start 2024-05-14T09:30:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7087e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 0x7f7080075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7087e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080109870 0x7f7080076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7087e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7080076540 0x7f70801a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7087e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7080114380 con 0x7f7080109870 2024-05-14T09:30:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7087e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7080114200 con 0x7f7080076540 2024-05-14T09:30:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7087e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7080114500 con 0x7f70801045f0 2024-05-14T09:30:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7085400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 0x7f7080075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7085400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 0x7f7080075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44078/0 (socket says 172.21.15.120:44078) 2024-05-14T09:30:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7085400700 1 -- 172.21.15.120:0/4256799571 learned_addr learned my addr 172.21.15.120:0/4256799571 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7084a00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080109870 0x7f7080076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.720+0000 7f7085e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7080076540 0x7f70801a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.721+0000 7f7085400700 1 -- 172.21.15.120:0/4256799571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7080076540 msgr2=0x7f70801a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.721+0000 7f7085400700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7080076540 0x7f70801a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.721+0000 7f7085400700 1 -- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080109870 msgr2=0x7f7080076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.721+0000 7f7085400700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080109870 0x7f7080076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.721+0000 7f7085400700 1 -- 172.21.15.120:0/4256799571 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70801a9780 con 0x7f70801045f0 2024-05-14T09:30:44.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.722+0000 7f7085400700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 0x7f7080075ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f707400eb60 tx=0x7f707400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:44.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.722+0000 7f707e000700 1 -- 172.21.15.120:0/4256799571 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707400cbd0 con 0x7f70801045f0 2024-05-14T09:30:44.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.722+0000 7f707e000700 1 -- 172.21.15.120:0/4256799571 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70740044b0 con 0x7f70801045f0 2024-05-14T09:30:44.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.722+0000 7f707e000700 1 -- 172.21.15.120:0/4256799571 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074003d60 con 0x7f70801045f0 2024-05-14T09:30:44.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.722+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70801a9a70 con 0x7f70801045f0 2024-05-14T09:30:44.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.723+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70801a9ed0 con 0x7f70801045f0 2024-05-14T09:30:44.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.727+0000 7f707e000700 1 -- 172.21.15.120:0/4256799571 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7074003f00 con 0x7f70801045f0 2024-05-14T09:30:44.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 Processor -- start 2024-05-14T09:30:44.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 -- start start 2024-05-14T09:30:44.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f707e000700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70680b2880 0x7f70680b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79bde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5613c78dfa20 con 0x5613c79c3830 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5613c787d760 con 0x5613c79bd9f0 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f70968f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5613c78db9e0 con 0x5613c783fe40 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.729+0000 7f707e000700 1 -- 172.21.15.120:0/4256799571 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f70740e27f0 con 0x7f70801045f0 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.730+0000 7f7084a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.730+0000 7f7084a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79bd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52978/0 (socket says 172.21.15.120:52978) 2024-05-14T09:30:44.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.730+0000 7f7084a00700 1 -- 172.21.15.120:0/3981154284 learned_addr learned my addr 172.21.15.120:0/3981154284 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:44.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.730+0000 7f7085400700 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.730+0000 7f7085e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70680b2880 0x7f70680b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7085e00700 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7084a00700 1 -- 172.21.15.120:0/3981154284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 msgr2=0x5613c79c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:44.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7084a00700 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7084a00700 1 -- 172.21.15.120:0/3981154284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 msgr2=0x5613c79bde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7084a00700 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79bde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7084a00700 1 -- 172.21.15.120:0/3981154284 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c782c8d0 con 0x5613c79c3830 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7085e00700 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79bde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.731+0000 7f7084a00700 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79bd4b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f706c009230 tx=0x7f706c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a088e9b87748075 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.732+0000 7f7085e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70680b2880 0x7f70680b4d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f70780085d0 tx=0x7f70780099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.732+0000 7f7072a00700 1 -- 172.21.15.120:0/3981154284 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c026070 con 0x5613c79c3830 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.732+0000 7f7072a00700 1 -- 172.21.15.120:0/3981154284 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f706c00f8f0 con 0x5613c79c3830 2024-05-14T09:30:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.732+0000 7f7072a00700 1 -- 172.21.15.120:0/3981154284 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c003680 con 0x5613c79c3830 2024-05-14T09:30:44.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.733+0000 7f70968f8b80 1 -- 172.21.15.120:0/3981154284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 msgr2=0x5613c79bd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.733+0000 7f70968f8b80 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79bd4b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f706c009230 tx=0x7f706c00bf60 comp rx=0 tx=0).stop 2024-05-14T09:30:44.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.734+0000 7f70968f8b80 1 -- 172.21.15.120:0/3981154284 shutdown_connections 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.734+0000 7f70968f8b80 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79bde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.734+0000 7f70968f8b80 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.734+0000 7f70968f8b80 1 --2- 172.21.15.120:0/3981154284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79bd4b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.734+0000 7f70968f8b80 1 -- 172.21.15.120:0/3981154284 >> 172.21.15.120:0/3981154284 conn(0x5613c7884f70 msgr2=0x5613c79b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.734+0000 7f70968f8b80 1 -- 172.21.15.120:0/3981154284 shutdown_connections 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.734+0000 7f70968f8b80 1 -- 172.21.15.120:0/3981154284 wait complete. 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.735+0000 7f70968f8b80 1 -- start start 2024-05-14T09:30:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.735+0000 7f70968f8b80 1 Processor -- start 2024-05-14T09:30:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79bd9f0 0x5613c79c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79c3830 0x5613c79c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f70968f8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5613c79ca2b0 con 0x5613c79bd9f0 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f70968f8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5613c7845b20 con 0x5613c79c3830 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f70968f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5613c79ca430 con 0x5613c783fe40 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f7084a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79bd9f0 0x5613c79c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f7084a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79bd9f0 0x5613c79c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52986/0 (socket says 172.21.15.120:52986) 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f70968f8b80 10 client.0 _ll_register_callbacks cb 0x5613c7886c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f7084a00700 1 -- 172.21.15.120:0/388092302 learned_addr learned my addr 172.21.15.120:0/388092302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f7085400700 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.736+0000 7f7085e00700 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79c3830 0x5613c79c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.737+0000 7f7085e00700 1 -- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 msgr2=0x5613c79c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.737+0000 7f7085e00700 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.737+0000 7f7085e00700 1 -- 172.21.15.120:0/388092302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79bd9f0 msgr2=0x5613c79c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.737+0000 7f7085e00700 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79bd9f0 0x5613c79c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.737+0000 7f7085e00700 1 -- 172.21.15.120:0/388092302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c78a5420 con 0x5613c79c3830 2024-05-14T09:30:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.738+0000 7f7085e00700 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79c3830 0x5613c79c7a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7078008d20 tx=0x7f7078004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a07886f88feadf20 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.738+0000 7f7067400700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:30:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.738+0000 7f7067400700 1 -- 172.21.15.120:0/388092302 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078028060 con 0x5613c79c3830 2024-05-14T09:30:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.738+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706c00f8f0 con 0x5613c79c3830 2024-05-14T09:30:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.738+0000 7f7067400700 1 -- 172.21.15.120:0/388092302 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7078018c30 con 0x5613c79c3830 2024-05-14T09:30:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.739+0000 7f7067400700 1 -- 172.21.15.120:0/388092302 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f707802f050 con 0x5613c79c3830 2024-05-14T09:30:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.739+0000 7f70968f8b80 10 client.36146 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.739+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5613c79d4d50 con 0x5613c79c3830 2024-05-14T09:30:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.739+0000 7f7067400700 1 -- 172.21.15.120:0/388092302 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f706c00f8f0 con 0x5613c79c3830 2024-05-14T09:30:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.740+0000 7f7067400700 1 -- 172.21.15.120:0/388092302 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f70780163c0 con 0x5613c79c3830 2024-05-14T09:30:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.740+0000 7f70968f8b80 10 client.36146 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.740+0000 7f70968f8b80 10 client.36146 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:30:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.740+0000 7f70968f8b80 20 client.36146 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.740+0000 7f70968f8b80 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c79d72e0 0x5613c79d9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.740+0000 7f70968f8b80 4 client.36146 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.740+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613c798a1c0 con 0x5613c79d72e0 2024-05-14T09:30:44.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.741+0000 7f7085400700 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c79d72e0 0x5613c79d9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.743+0000 7f7067400700 10 client.36146 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:30:44.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.743+0000 7f7085400700 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c79d72e0 0x5613c79d9740 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=750d713c36d6714d server_cookie=b036e6b987f26010 in_seq=0 out_seq=0 2024-05-14T09:30:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f7067400700 1 -- 172.21.15.120:0/388092302 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5613c798a1c0 con 0x5613c79d72e0 2024-05-14T09:30:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f7067400700 10 client.36146 handle_command_reply: tid=0 2024-05-14T09:30:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 client.36146 shutdown 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79c3830 msgr2=0x5613c79c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79c3830 0x5613c79c7a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7078008d20 tx=0x7f7078004ad0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 shutdown_connections 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79c3830 0x5613c79c7a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c79d72e0 0x5613c79d9740 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f7067400700 0 client.36146 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 --2- 172.21.15.120:0/388092302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79bd9f0 0x5613c79c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.745+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 >> 172.21.15.120:0/388092302 conn(0x5613c7884f70 msgr2=0x5613c79bc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:44.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.746+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 shutdown_connections 2024-05-14T09:30:44.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.746+0000 7f70968f8b80 1 -- 172.21.15.120:0/388092302 wait complete. 2024-05-14T09:30:44.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.746+0000 7f70968f8b80 20 client.36146 trim_cache size 0 max 16384 2024-05-14T09:30:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.768+0000 7f70968f8b80 1 Processor -- start 2024-05-14T09:30:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.768+0000 7f70968f8b80 1 -- start start 2024-05-14T09:30:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79def00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f70968f8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f70801b2bf0 con 0x5613c79c3830 2024-05-14T09:30:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f70968f8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f70801b47c0 con 0x5613c79bd9f0 2024-05-14T09:30:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f70968f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f70801b32c0 con 0x5613c783fe40 2024-05-14T09:30:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f7085e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79def00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f7085e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79def00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52988/0 (socket says 172.21.15.120:52988) 2024-05-14T09:30:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.769+0000 7f7085e00700 1 -- 172.21.15.120:0/2444946247 learned_addr learned my addr 172.21.15.120:0/2444946247 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.770+0000 7f7085400700 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.770+0000 7f7085e00700 1 -- 172.21.15.120:0/2444946247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 msgr2=0x5613c79bd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:44.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.770+0000 7f7085e00700 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79bd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.770+0000 7f7085e00700 1 -- 172.21.15.120:0/2444946247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 msgr2=0x5613c79d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:44.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.770+0000 7f7085e00700 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.770+0000 7f7085e00700 1 -- 172.21.15.120:0/2444946247 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c79b9b70 con 0x5613c79c3830 2024-05-14T09:30:44.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.770+0000 7f7085e00700 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79def00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f707802d040 tx=0x7f7078009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2a6fb47b706577 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.771+0000 7f7072000700 1 -- 172.21.15.120:0/2444946247 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707801e050 con 0x5613c79c3830 2024-05-14T09:30:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.771+0000 7f7072000700 1 -- 172.21.15.120:0/2444946247 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f707801f040 con 0x5613c79c3830 2024-05-14T09:30:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.771+0000 7f7072000700 1 -- 172.21.15.120:0/2444946247 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078023650 con 0x5613c79c3830 2024-05-14T09:30:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.772+0000 7f70968f8b80 1 -- 172.21.15.120:0/2444946247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 msgr2=0x5613c79def00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.772+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79def00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f707802d040 tx=0x7f7078009880 comp rx=0 tx=0).stop 2024-05-14T09:30:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.772+0000 7f70968f8b80 1 -- 172.21.15.120:0/2444946247 shutdown_connections 2024-05-14T09:30:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.772+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79def00 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.772+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c783fe40 0x5613c79bd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.772+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2444946247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c79bd9f0 0x5613c79d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.772+0000 7f70968f8b80 1 -- 172.21.15.120:0/2444946247 >> 172.21.15.120:0/2444946247 conn(0x5613c7884f70 msgr2=0x5613c79c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.773+0000 7f70968f8b80 1 -- 172.21.15.120:0/2444946247 shutdown_connections 2024-05-14T09:30:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.773+0000 7f70968f8b80 1 -- 172.21.15.120:0/2444946247 wait complete. 2024-05-14T09:30:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.773+0000 7f70968f8b80 1 -- start start 2024-05-14T09:30:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 1 Processor -- start 2024-05-14T09:30:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c783fe40 0x5613c79cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c79bd9f0 0x5613c79de4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79dea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f70801b4090 con 0x5613c79c3830 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f70801b39c0 con 0x5613c783fe40 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f70801b0bb0 con 0x5613c79bd9f0 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.774+0000 7f70968f8b80 10 client.0 _ll_register_callbacks cb 0x5613c7886c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7085400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c783fe40 0x5613c79cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7085400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c783fe40 0x5613c79cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:35114/0 (socket says 172.21.15.120:35114) 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7085400700 1 -- 172.21.15.120:0/2227239945 learned_addr learned my addr 172.21.15.120:0/2227239945 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7084a00700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c79bd9f0 0x5613c79de4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7085400700 1 -- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c79bd9f0 msgr2=0x5613c79de4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7085400700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c79bd9f0 0x5613c79de4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7085400700 1 -- 172.21.15.120:0/2227239945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 msgr2=0x5613c79dea30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.775+0000 7f7085e00700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f7085400700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79dea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f7085400700 1 -- 172.21.15.120:0/2227239945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c79df1b0 con 0x5613c783fe40 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f7085e00700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79dea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f7085400700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c783fe40 0x5613c79cfc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70740a99a0 tx=0x7f70740dfdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3230ec198b3038e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f7067400700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f7067400700 1 -- 172.21.15.120:0/2227239945 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70740c3060 con 0x5613c783fe40 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f7067400700 1 -- 172.21.15.120:0/2227239945 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f70740041f0 con 0x5613c783fe40 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.776+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f707801f040 con 0x5613c783fe40 2024-05-14T09:30:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.777+0000 7f7067400700 1 -- 172.21.15.120:0/2227239945 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f70740bee60 con 0x5613c783fe40 2024-05-14T09:30:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.777+0000 7f70968f8b80 10 client.36149 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.777+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5613c7a4a250 con 0x5613c783fe40 2024-05-14T09:30:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.777+0000 7f7067400700 1 -- 172.21.15.120:0/2227239945 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f707801f040 con 0x5613c783fe40 2024-05-14T09:30:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.778+0000 7f7067400700 1 -- 172.21.15.120:0/2227239945 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f7074016330 con 0x5613c783fe40 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.778+0000 7f70968f8b80 10 client.36149 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.778+0000 7f70968f8b80 10 client.36149 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.778+0000 7f70968f8b80 20 client.36149 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.778+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c7a4a890 0x5613c7a4ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.778+0000 7f70968f8b80 4 client.36149 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.778+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 --> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613c78ed400 con 0x5613c7a4a890 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.779+0000 7f7084a00700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c7a4a890 0x5613c7a4ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.780+0000 7f7084a00700 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c7a4a890 0x5613c7a4ccb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d70d843f1497e44a server_cookie=882d721e9e8aef8b in_seq=0 out_seq=0 2024-05-14T09:30:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.780+0000 7f7067400700 10 client.36149 ms_handle_connect on v2:172.21.15.175:6838/339294041 2024-05-14T09:30:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.780+0000 7f7067400700 1 -- 172.21.15.120:0/2227239945 <== mds.3 v2:172.21.15.175:6838/339294041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613c78ed400 con 0x5613c7a4a890 2024-05-14T09:30:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.780+0000 7f7067400700 10 client.36149 handle_command_reply: tid=0 2024-05-14T09:30:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.780+0000 7f70968f8b80 1 client.36149 shutdown 2024-05-14T09:30:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c783fe40 msgr2=0x5613c79cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c783fe40 0x5613c79cfc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70740a99a0 tx=0x7f70740dfdc0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 shutdown_connections 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613c783fe40 0x5613c79cfc00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:6838/339294041,v1:172.21.15.175:6839/339294041] conn(0x5613c7a4a890 0x5613c7a4ccb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613c79c3830 0x5613c79dea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 --2- 172.21.15.120:0/2227239945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613c79bd9f0 0x5613c79de4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 >> 172.21.15.120:0/2227239945 conn(0x5613c7884f70 msgr2=0x5613c79c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f7067400700 0 client.36149 ms_handle_reset on v2:172.21.15.175:6838/339294041 2024-05-14T09:30:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.781+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 shutdown_connections 2024-05-14T09:30:44.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.782+0000 7f70968f8b80 1 -- 172.21.15.120:0/2227239945 wait complete. 2024-05-14T09:30:44.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.782+0000 7f70968f8b80 20 client.36149 trim_cache size 0 max 16384 2024-05-14T09:30:44.783 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70680b2880 msgr2=0x7f70680b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70680b2880 0x7f70680b4d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f70780085d0 tx=0x7f70780099e0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 msgr2=0x7f7080075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 0x7f7080075ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f707400eb60 tx=0x7f707400ee70 comp rx=0 tx=0).stop 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 shutdown_connections 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f70680b2880 0x7f70680b4d90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7080076540 0x7f70801a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70801045f0 0x7f7080075ac0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 --2- 172.21.15.120:0/4256799571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7080109870 0x7f7080076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.783+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 >> 172.21.15.120:0/4256799571 conn(0x7f7080100040 msgr2=0x7f7080102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.784+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 shutdown_connections 2024-05-14T09:30:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:44.784+0000 7f7087e00700 1 -- 172.21.15.120:0/4256799571 wait complete. 2024-05-14T09:30:46.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:46 smithi120 ceph-mon[31085]: pgmap v772: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 619 op/s 2024-05-14T09:30:46.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:46 smithi152 ceph-mon[34868]: pgmap v772: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 619 op/s 2024-05-14T09:30:46.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:46 smithi175 ceph-mon[35353]: pgmap v772: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 619 op/s 2024-05-14T09:30:47.289 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T09:30:48.013 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:30:48.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:48 smithi120 ceph-mon[31085]: pgmap v773: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 636 op/s 2024-05-14T09:30:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:48 smithi152 ceph-mon[34868]: pgmap v773: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 636 op/s 2024-05-14T09:30:48.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:48 smithi175 ceph-mon[35353]: pgmap v773: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 636 op/s 2024-05-14T09:30:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 195.0 s, 529.4 tps, lat 187.946 ms stddev 240.299 2024-05-14T09:30:50.327 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:50 smithi120 ceph-mon[31085]: pgmap v774: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 682 op/s 2024-05-14T09:30:50.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:50 smithi152 ceph-mon[34868]: pgmap v774: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 682 op/s 2024-05-14T09:30:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:50 smithi175 ceph-mon[35353]: pgmap v774: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 682 op/s 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 -- 172.21.15.120:0/2221754922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 msgr2=0x7ff3e8113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 --2- 172.21.15.120:0/2221754922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 0x7ff3e8113000 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800b0a0 tx=0x7ff3d800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 -- 172.21.15.120:0/2221754922 shutdown_connections 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 --2- 172.21.15.120:0/2221754922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e8075d30 0x7ff3e8076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 --2- 172.21.15.120:0/2221754922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 0x7ff3e8113000 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 --2- 172.21.15.120:0/2221754922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e8076680 0x7ff3e8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 -- 172.21.15.120:0/2221754922 >> 172.21.15.120:0/2221754922 conn(0x7ff3e8100040 msgr2=0x7ff3e8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.842+0000 7ff3eca00700 1 -- 172.21.15.120:0/2221754922 shutdown_connections 2024-05-14T09:30:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.843+0000 7ff3eca00700 1 -- 172.21.15.120:0/2221754922 wait complete. 2024-05-14T09:30:50.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.844+0000 7ff3eca00700 1 Processor -- start 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.844+0000 7ff3eca00700 1 -- start start 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.845+0000 7ff3eca00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e8075d30 0x7ff3e810b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.845+0000 7ff3eca00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e8076680 0x7ff3e810ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.845+0000 7ff3eca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 0x7ff3e8106730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.845+0000 7ff3eca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8104ea0 con 0x7ff3e8110ba0 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.845+0000 7ff3eca00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8104d20 con 0x7ff3e8076680 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.845+0000 7ff3eca00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8105020 con 0x7ff3e8075d30 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.845+0000 7ff3e5e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e8075d30 0x7ff3e810b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.846+0000 7ff3e6800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 0x7ff3e8106730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.846+0000 7ff3e6800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 0x7ff3e8106730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50710/0 (socket says 172.21.15.120:50710) 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.846+0000 7ff3e6800700 1 -- 172.21.15.120:0/306186045 learned_addr learned my addr 172.21.15.120:0/306186045 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.846+0000 7ff3e5400700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e8076680 0x7ff3e810ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.847+0000 7ff3e5e00700 1 -- 172.21.15.120:0/306186045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e8076680 msgr2=0x7ff3e810ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.847+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e8076680 0x7ff3e810ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.847+0000 7ff3e5e00700 1 -- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 msgr2=0x7ff3e8106730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.847+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 0x7ff3e8106730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.847+0000 7ff3e5e00700 1 -- 172.21.15.120:0/306186045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e8106f60 con 0x7ff3e8075d30 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.847+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e8075d30 0x7ff3e810b520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000e9f0 tx=0x7ff3e000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.847+0000 7ff3dea00700 1 -- 172.21.15.120:0/306186045 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e000c9c0 con 0x7ff3e8075d30 2024-05-14T09:30:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.848+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e81071f0 con 0x7ff3e8075d30 2024-05-14T09:30:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.848+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e810f400 con 0x7ff3e8075d30 2024-05-14T09:30:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.848+0000 7ff3dea00700 1 -- 172.21.15.120:0/306186045 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3e0010430 con 0x7ff3e8075d30 2024-05-14T09:30:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.849+0000 7ff3dea00700 1 -- 172.21.15.120:0/306186045 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0026060 con 0x7ff3e8075d30 2024-05-14T09:30:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.855+0000 7ff3dea00700 1 -- 172.21.15.120:0/306186045 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff3e0018680 con 0x7ff3e8075d30 2024-05-14T09:30:50.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.857+0000 7ff3fb52cb80 1 Processor -- start 2024-05-14T09:30:50.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.857+0000 7ff3fb52cb80 1 -- start start 2024-05-14T09:30:50.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.858+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbeea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbee44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbee4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5579dbe06a20 con 0x5579dbeea830 2024-05-14T09:30:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3e6800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbeea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3e6800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbeea2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48430/0 (socket says 172.21.15.120:48430) 2024-05-14T09:30:50.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3e6800700 1 -- 172.21.15.120:0/565712617 learned_addr learned my addr 172.21.15.120:0/565712617 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:50.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/565712617 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5579dbda4760 con 0x5579dbd66e40 2024-05-14T09:30:50.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.859+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/565712617 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5579dbe029e0 con 0x5579dbee49f0 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.860+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbee44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.860+0000 7ff3e5400700 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbee4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.861+0000 7ff3dea00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3cc0b2940 0x7ff3cc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.861+0000 7ff3e6800700 1 -- 172.21.15.120:0/565712617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 msgr2=0x5579dbee4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.861+0000 7ff3e6800700 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbee4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.861+0000 7ff3e6800700 1 -- 172.21.15.120:0/565712617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 msgr2=0x5579dbee44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.861+0000 7ff3e6800700 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbee44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.861+0000 7ff3e6800700 1 -- 172.21.15.120:0/565712617 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579dbd538d0 con 0x5579dbd66e40 2024-05-14T09:30:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.861+0000 7ff3dea00700 1 -- 172.21.15.120:0/306186045 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff3e00e2580 con 0x7ff3e8075d30 2024-05-14T09:30:50.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.862+0000 7ff3e6800700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3cc0b2940 0x7ff3cc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.864+0000 7ff3e6800700 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbeea2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800b070 tx=0x7ff3d8009390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=892c9a1479bf5fad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:50.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.867+0000 7ff3e6800700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3cc0b2940 0x7ff3cc0b4e50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009850 tx=0x7ff3d8025000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:50.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.867+0000 7ff3d7400700 1 -- 172.21.15.120:0/565712617 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8022040 con 0x5579dbd66e40 2024-05-14T09:30:50.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.867+0000 7ff3d7400700 1 -- 172.21.15.120:0/565712617 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3d8023030 con 0x5579dbd66e40 2024-05-14T09:30:50.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.867+0000 7ff3d7400700 1 -- 172.21.15.120:0/565712617 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80296f0 con 0x5579dbd66e40 2024-05-14T09:30:50.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.868+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/565712617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 msgr2=0x5579dbeea2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.868+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbeea2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800b070 tx=0x7ff3d8009390 comp rx=0 tx=0).stop 2024-05-14T09:30:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.869+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/565712617 shutdown_connections 2024-05-14T09:30:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.869+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbeea2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.869+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbee4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.869+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/565712617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbee44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.869+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/565712617 >> 172.21.15.120:0/565712617 conn(0x5579dbdabf70 msgr2=0x5579dbedf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.869+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/565712617 shutdown_connections 2024-05-14T09:30:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.869+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/565712617 wait complete. 2024-05-14T09:30:50.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.871+0000 7ff3fb52cb80 1 -- start start 2024-05-14T09:30:50.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.871+0000 7ff3fb52cb80 1 Processor -- start 2024-05-14T09:30:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.872+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.872+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbeedef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.872+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbeee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.872+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5579dbef1250 con 0x5579dbeea830 2024-05-14T09:30:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.872+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5579dbd6cb20 con 0x5579dbd66e40 2024-05-14T09:30:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.872+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5579dbef13d0 con 0x5579dbee49f0 2024-05-14T09:30:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.872+0000 7ff3fb52cb80 10 client.0 _ll_register_callbacks cb 0x5579dbdadc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.873+0000 7ff3e5e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.873+0000 7ff3e5e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48434/0 (socket says 172.21.15.120:48434) 2024-05-14T09:30:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.873+0000 7ff3e5e00700 1 -- 172.21.15.120:0/3135441706 learned_addr learned my addr 172.21.15.120:0/3135441706 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.873+0000 7ff3e5400700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbeedef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.874+0000 7ff3e5e00700 1 -- 172.21.15.120:0/3135441706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 msgr2=0x5579dbeedef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.876+0000 7ff3e6800700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbeee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.876+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbeedef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.876+0000 7ff3e5e00700 1 -- 172.21.15.120:0/3135441706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 msgr2=0x5579dbeee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.876+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbeee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.876+0000 7ff3e5e00700 1 -- 172.21.15.120:0/3135441706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579dbdcc420 con 0x5579dbd66e40 2024-05-14T09:30:50.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.877+0000 7ff3e6800700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbeee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:50.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.877+0000 7ff3e5400700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbeedef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:50.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.877+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef0b70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0010cf0 tx=0x7ff3e00b24b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd9202ac839bc0f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:50.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.877+0000 7ff3cbe00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:30:50.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.877+0000 7ff3cbe00700 1 -- 172.21.15.120:0/3135441706 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00a56c0 con 0x5579dbd66e40 2024-05-14T09:30:50.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.878+0000 7ff3cbe00700 1 -- 172.21.15.120:0/3135441706 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff3e0091110 con 0x5579dbd66e40 2024-05-14T09:30:50.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.878+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d8023030 con 0x5579dbd66e40 2024-05-14T09:30:50.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.878+0000 7ff3cbe00700 1 -- 172.21.15.120:0/3135441706 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7ff3e00a8f70 con 0x5579dbd66e40 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.878+0000 7ff3fb52cb80 10 client.36161 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.878+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5579dbefbd50 con 0x5579dbd66e40 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3cbe00700 1 -- 172.21.15.120:0/3135441706 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3e00a9310 con 0x5579dbd66e40 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3cbe00700 1 -- 172.21.15.120:0/3135441706 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7ff3e00a8a60 con 0x5579dbd66e40 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3fb52cb80 10 client.36161 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3fb52cb80 10 client.36161 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3fb52cb80 20 client.36161 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:50.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbefe390 0x5579dbf007f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3fb52cb80 4 client.36161 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:50.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.879+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff3d8023030 con 0x5579dbefe390 2024-05-14T09:30:50.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.880+0000 7ff3e5400700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbefe390 0x5579dbf007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.883+0000 7ff3cbe00700 10 client.36161 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:30:50.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.883+0000 7ff3e5400700 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbefe390 0x5579dbf007f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cdde1e252ba5095a server_cookie=c1c547caf6c6b748 in_seq=0 out_seq=0 2024-05-14T09:30:50.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.885+0000 7ff3cbe00700 1 -- 172.21.15.120:0/3135441706 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7ff3d8023030 con 0x5579dbefe390 2024-05-14T09:30:50.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.885+0000 7ff3cbe00700 10 client.36161 handle_command_reply: tid=0 2024-05-14T09:30:50.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.885+0000 7ff3fb52cb80 1 client.36161 shutdown 2024-05-14T09:30:50.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.886+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 msgr2=0x5579dbef0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.886+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef0b70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0010cf0 tx=0x7ff3e00b24b0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.887+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 shutdown_connections 2024-05-14T09:30:50.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.887+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef0b70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.887+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbefe390 0x5579dbf007f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.887+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbeee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.887+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/3135441706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbeedef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.887+0000 7ff3cbe00700 0 client.36161 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:30:50.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.887+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 >> 172.21.15.120:0/3135441706 conn(0x5579dbdabf70 msgr2=0x5579dbee34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:50.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.888+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 shutdown_connections 2024-05-14T09:30:50.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.888+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/3135441706 wait complete. 2024-05-14T09:30:50.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.888+0000 7ff3fb52cb80 20 client.36161 trim_cache size 0 max 16384 2024-05-14T09:30:50.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.919+0000 7ff3fb52cb80 1 Processor -- start 2024-05-14T09:30:50.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.919+0000 7ff3fb52cb80 1 -- start start 2024-05-14T09:30:50.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.919+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbd66e40 0x5579dbee44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.920+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbee49f0 0x5579dbeedeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.920+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbeea830 0x5579dbefa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.920+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c400ebb0 con 0x5579dbee49f0 2024-05-14T09:30:50.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.920+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4010780 con 0x5579dbeea830 2024-05-14T09:30:50.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.920+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c400f280 con 0x5579dbd66e40 2024-05-14T09:30:50.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.920+0000 7ff3e5e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbd66e40 0x5579dbee44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.920+0000 7ff3e5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbee49f0 0x5579dbeedeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.921+0000 7ff3e5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbee49f0 0x5579dbeedeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50728/0 (socket says 172.21.15.120:50728) 2024-05-14T09:30:50.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.921+0000 7ff3e5400700 1 -- 172.21.15.120:0/2617908583 learned_addr learned my addr 172.21.15.120:0/2617908583 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:50.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.921+0000 7ff3e6800700 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbeea830 0x5579dbefa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.922+0000 7ff3e6800700 1 -- 172.21.15.120:0/2617908583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbd66e40 msgr2=0x5579dbee44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.922+0000 7ff3e6800700 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbd66e40 0x5579dbee44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.922+0000 7ff3e6800700 1 -- 172.21.15.120:0/2617908583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbee49f0 msgr2=0x5579dbeedeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.922+0000 7ff3e6800700 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbee49f0 0x5579dbeedeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.922+0000 7ff3e6800700 1 -- 172.21.15.120:0/2617908583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579dbee0920 con 0x5579dbeea830 2024-05-14T09:30:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.922+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbd66e40 0x5579dbee44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:30:50.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.923+0000 7ff3e6800700 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbeea830 0x5579dbefa300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8029040 tx=0x7ff3d8029600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a9ecfca5670c9a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:50.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.924+0000 7ff3d6a00700 1 -- 172.21.15.120:0/2617908583 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8035070 con 0x5579dbeea830 2024-05-14T09:30:50.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.924+0000 7ff3d6a00700 1 -- 172.21.15.120:0/2617908583 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3d8029e40 con 0x5579dbeea830 2024-05-14T09:30:50.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.924+0000 7ff3d6a00700 1 -- 172.21.15.120:0/2617908583 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8022040 con 0x5579dbeea830 2024-05-14T09:30:50.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.925+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/2617908583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbeea830 msgr2=0x5579dbefa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.925+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbeea830 0x5579dbefa300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8029040 tx=0x7ff3d8029600 comp rx=0 tx=0).stop 2024-05-14T09:30:50.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.925+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/2617908583 shutdown_connections 2024-05-14T09:30:50.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.925+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbeea830 0x5579dbefa300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.925+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbd66e40 0x5579dbee44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.925+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/2617908583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbee49f0 0x5579dbeedeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.925+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/2617908583 >> 172.21.15.120:0/2617908583 conn(0x5579dbdabf70 msgr2=0x5579dbeed7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:50.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.926+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/2617908583 shutdown_connections 2024-05-14T09:30:50.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.926+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/2617908583 wait complete. 2024-05-14T09:30:50.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.926+0000 7ff3fb52cb80 1 -- start start 2024-05-14T09:30:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.927+0000 7ff3fb52cb80 1 Processor -- start 2024-05-14T09:30:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.927+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.927+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbef6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.927+0000 7ff3fb52cb80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbf63dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.927+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4010050 con 0x5579dbeea830 2024-05-14T09:30:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.927+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c400f980 con 0x5579dbd66e40 2024-05-14T09:30:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.927+0000 7ff3fb52cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c400cb70 con 0x5579dbee49f0 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.928+0000 7ff3fb52cb80 10 client.0 _ll_register_callbacks cb 0x5579dbdadc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.928+0000 7ff3e5e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.928+0000 7ff3e5e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48440/0 (socket says 172.21.15.120:48440) 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.928+0000 7ff3e5e00700 1 -- 172.21.15.120:0/146118914 learned_addr learned my addr 172.21.15.120:0/146118914 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.928+0000 7ff3e6800700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbf63dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.928+0000 7ff3e5400700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbef6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.929+0000 7ff3e6800700 1 -- 172.21.15.120:0/146118914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 msgr2=0x5579dbef6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.929+0000 7ff3e6800700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbef6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.929+0000 7ff3e6800700 1 -- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 msgr2=0x5579dbef6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:50.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.929+0000 7ff3e6800700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.929+0000 7ff3e6800700 1 -- 172.21.15.120:0/146118914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579dbf64510 con 0x5579dbeea830 2024-05-14T09:30:50.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.929+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:50.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.930+0000 7ff3e6800700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbf63dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009900 tx=0x7ff3d8029db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28109f46164f88a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:50.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.930+0000 7ff3cbe00700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:50.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.930+0000 7ff3cbe00700 1 -- 172.21.15.120:0/146118914 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8022040 con 0x5579dbeea830 2024-05-14T09:30:50.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.930+0000 7ff3cbe00700 1 -- 172.21.15.120:0/146118914 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff3d800bdd0 con 0x5579dbeea830 2024-05-14T09:30:50.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.931+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579dbeb11c0 con 0x5579dbeea830 2024-05-14T09:30:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.931+0000 7ff3cbe00700 1 -- 172.21.15.120:0/146118914 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7ff3d8022040 con 0x5579dbeea830 2024-05-14T09:30:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.931+0000 7ff3fb52cb80 10 client.16680 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.931+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5579dbf05db0 con 0x5579dbeea830 2024-05-14T09:30:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.932+0000 7ff3cbe00700 1 -- 172.21.15.120:0/146118914 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5579dbeb11c0 con 0x5579dbeea830 2024-05-14T09:30:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.932+0000 7ff3cbe00700 1 -- 172.21.15.120:0/146118914 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7ff3d8011070 con 0x5579dbeea830 2024-05-14T09:30:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.933+0000 7ff3fb52cb80 10 client.16680 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.933+0000 7ff3fb52cb80 10 client.16680 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.k 2024-05-14T09:30:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.933+0000 7ff3fb52cb80 20 client.16680 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.933+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbf79c00 0x5579dbf7c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.933+0000 7ff3fb52cb80 4 client.16680 mds_command: new command op to 34388 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:30:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.933+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 --> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579dbe14400 con 0x5579dbf79c00 2024-05-14T09:30:50.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.933+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbf79c00 0x5579dbf7c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.934+0000 7ff3e5e00700 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbf79c00 0x5579dbf7c020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33a50523df55a0ae server_cookie=f0775d5117453535 in_seq=0 out_seq=0 2024-05-14T09:30:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.934+0000 7ff3cbe00700 10 client.16680 ms_handle_connect on v2:172.21.15.152:6832/2515790469 2024-05-14T09:30:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.935+0000 7ff3cbe00700 1 -- 172.21.15.120:0/146118914 <== mds.2 v2:172.21.15.152:6832/2515790469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579dbe14400 con 0x5579dbf79c00 2024-05-14T09:30:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.935+0000 7ff3cbe00700 10 client.16680 handle_command_reply: tid=0 2024-05-14T09:30:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.935+0000 7ff3fb52cb80 1 client.16680 shutdown 2024-05-14T09:30:50.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.935+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 msgr2=0x5579dbf63dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.935+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbf63dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009900 tx=0x7ff3d8029db0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 shutdown_connections 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579dbd66e40 0x5579dbef6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.152:6832/2515790469,v1:172.21.15.152:6833/2515790469] conn(0x5579dbf79c00 0x5579dbf7c020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5579dbeea830 0x5579dbf63dd0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 --2- 172.21.15.120:0/146118914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579dbee49f0 0x5579dbef6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 >> 172.21.15.120:0/146118914 conn(0x5579dbdabf70 msgr2=0x5579dbee7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3cbe00700 0 client.16680 ms_handle_reset on v2:172.21.15.152:6832/2515790469 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 shutdown_connections 2024-05-14T09:30:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.936+0000 7ff3fb52cb80 1 -- 172.21.15.120:0/146118914 wait complete. 2024-05-14T09:30:50.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.938+0000 7ff3fb52cb80 20 client.16680 trim_cache size 0 max 16384 2024-05-14T09:30:50.939 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:30:50.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3cc0b2940 msgr2=0x7ff3cc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3cc0b2940 0x7ff3cc0b4e50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009850 tx=0x7ff3d8025000 comp rx=0 tx=0).stop 2024-05-14T09:30:50.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e8075d30 msgr2=0x7ff3e810b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:50.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e8075d30 0x7ff3e810b520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000e9f0 tx=0x7ff3e000ed00 comp rx=0 tx=0).stop 2024-05-14T09:30:50.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 shutdown_connections 2024-05-14T09:30:50.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff3cc0b2940 0x7ff3cc0b4e50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e8110ba0 0x7ff3e8106730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e8075d30 0x7ff3e810b520 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 --2- 172.21.15.120:0/306186045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e8076680 0x7ff3e810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:50.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.940+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 >> 172.21.15.120:0/306186045 conn(0x7ff3e8100040 msgr2=0x7ff3e8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:50.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.941+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 shutdown_connections 2024-05-14T09:30:50.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:50.941+0000 7ff3eca00700 1 -- 172.21.15.120:0/306186045 wait complete. 2024-05-14T09:30:51.835 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T09:30:52.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:52 smithi120 ceph-mon[31085]: pgmap v775: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2024-05-14T09:30:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:52 smithi152 ceph-mon[34868]: pgmap v775: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2024-05-14T09:30:52.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:52 smithi175 ceph-mon[35353]: pgmap v775: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2024-05-14T09:30:52.598 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:30:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 200.0 s, 720.0 tps, lat 139.897 ms stddev 64.800 2024-05-14T09:30:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:54 smithi120 ceph-mon[31085]: pgmap v776: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 633 op/s 2024-05-14T09:30:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:54 smithi152 ceph-mon[34868]: pgmap v776: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 633 op/s 2024-05-14T09:30:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:54 smithi175 ceph-mon[35353]: pgmap v776: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 633 op/s 2024-05-14T09:30:56.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:56 smithi120 ceph-mon[31085]: pgmap v777: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.9 MiB/s wr, 633 op/s 2024-05-14T09:30:56.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:56 smithi152 ceph-mon[34868]: pgmap v777: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.9 MiB/s wr, 633 op/s 2024-05-14T09:30:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:56 smithi175 ceph-mon[35353]: pgmap v777: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.9 MiB/s wr, 633 op/s 2024-05-14T09:30:56.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.533+0000 7f7b7be00700 1 -- 172.21.15.120:0/2336146681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b741086c0 msgr2=0x7f7b74108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.533+0000 7f7b7be00700 1 --2- 172.21.15.120:0/2336146681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b741086c0 0x7f7b74108b90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009f90 tx=0x7f7b6c00b330 comp rx=0 tx=0).stop 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.534+0000 7f7b7be00700 1 -- 172.21.15.120:0/2336146681 shutdown_connections 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.534+0000 7f7b7be00700 1 --2- 172.21.15.120:0/2336146681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b741086c0 0x7f7b74108b90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.534+0000 7f7b7be00700 1 --2- 172.21.15.120:0/2336146681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b74103270 0x7f7b74103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.534+0000 7f7b7be00700 1 --2- 172.21.15.120:0/2336146681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b74103bc0 0x7f7b741080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.534+0000 7f7b7be00700 1 -- 172.21.15.120:0/2336146681 >> 172.21.15.120:0/2336146681 conn(0x7f7b740fef30 msgr2=0x7f7b74101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.534+0000 7f7b7be00700 1 -- 172.21.15.120:0/2336146681 shutdown_connections 2024-05-14T09:30:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.534+0000 7f7b7be00700 1 -- 172.21.15.120:0/2336146681 wait complete. 2024-05-14T09:30:56.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.536+0000 7f7b7be00700 1 Processor -- start 2024-05-14T09:30:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.536+0000 7f7b7be00700 1 -- start start 2024-05-14T09:30:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.537+0000 7f7b7be00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b74103270 0x7f7b741a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.537+0000 7f7b7be00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b74103bc0 0x7f7b741a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.537+0000 7f7b7be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b741086c0 0x7f7b741a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.537+0000 7f7b7be00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7411a8f0 con 0x7f7b741086c0 2024-05-14T09:30:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.537+0000 7f7b7be00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7411a770 con 0x7f7b74103270 2024-05-14T09:30:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.537+0000 7f7b7be00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7411aa70 con 0x7f7b74103bc0 2024-05-14T09:30:56.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.538+0000 7f7b79400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b74103270 0x7f7b741a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.538+0000 7f7b79400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b74103270 0x7f7b741a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48460/0 (socket says 172.21.15.120:48460) 2024-05-14T09:30:56.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.538+0000 7f7b78a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b74103bc0 0x7f7b741a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.538+0000 7f7b79400700 1 -- 172.21.15.120:0/76899862 learned_addr learned my addr 172.21.15.120:0/76899862 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.538+0000 7f7b79e00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b741086c0 0x7f7b741a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.539+0000 7f7b78a00700 1 -- 172.21.15.120:0/76899862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b74103270 msgr2=0x7f7b741a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.539+0000 7f7b78a00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b74103270 0x7f7b741a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.539+0000 7f7b78a00700 1 -- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b741086c0 msgr2=0x7f7b741a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.539+0000 7f7b78a00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b741086c0 0x7f7b741a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.539+0000 7f7b78a00700 1 -- 172.21.15.120:0/76899862 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b741a6190 con 0x7f7b74103bc0 2024-05-14T09:30:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.540+0000 7f7b79e00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b741086c0 0x7f7b741a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.541+0000 7f7b78a00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b74103bc0 0x7f7b741a1860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e9c0 tx=0x7f7b6000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.541+0000 7f7b72000700 1 -- 172.21.15.120:0/76899862 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000c9c0 con 0x7f7b74103bc0 2024-05-14T09:30:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.541+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b741a6480 con 0x7f7b74103bc0 2024-05-14T09:30:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.541+0000 7f7b72000700 1 -- 172.21.15.120:0/76899862 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b60010430 con 0x7f7b74103bc0 2024-05-14T09:30:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.541+0000 7f7b72000700 1 -- 172.21.15.120:0/76899862 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60018680 con 0x7f7b74103bc0 2024-05-14T09:30:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.541+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b741adda0 con 0x7f7b74103bc0 2024-05-14T09:30:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.550+0000 7f7b72000700 1 -- 172.21.15.120:0/76899862 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7b6000cb60 con 0x7f7b74103bc0 2024-05-14T09:30:56.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.551+0000 7f7b8a8bab80 1 Processor -- start 2024-05-14T09:30:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.551+0000 7f7b8a8bab80 1 -- start start 2024-05-14T09:30:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.551+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff7e0e40 0x55b1ff9646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.551+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff964bf0 0x55b1ff95e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.551+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff95f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.552+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b1ff880a20 con 0x55b1ff7e0e40 2024-05-14T09:30:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.552+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b1ff81e760 con 0x55b1ff95ec50 2024-05-14T09:30:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.552+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b1ff87c9e0 con 0x55b1ff964bf0 2024-05-14T09:30:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.552+0000 7f7b79e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff7e0e40 0x55b1ff9646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.552+0000 7f7b79e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff7e0e40 0x55b1ff9646b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50780/0 (socket says 172.21.15.120:50780) 2024-05-14T09:30:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.552+0000 7f7b79e00700 1 -- 172.21.15.120:0/1236759480 learned_addr learned my addr 172.21.15.120:0/1236759480 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.552+0000 7f7b72000700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b5c0b2a80 0x7f7b5c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.553+0000 7f7b72000700 1 -- 172.21.15.120:0/76899862 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7b60018420 con 0x7f7b74103bc0 2024-05-14T09:30:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.553+0000 7f7b79e00700 1 -- 172.21.15.120:0/1236759480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff964bf0 msgr2=0x55b1ff95e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:30:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.553+0000 7f7b79e00700 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff964bf0 0x55b1ff95e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.553+0000 7f7b79e00700 1 -- 172.21.15.120:0/1236759480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 msgr2=0x55b1ff95f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:56.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.553+0000 7f7b78a00700 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff95f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.553+0000 7f7b79e00700 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff95f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.553+0000 7f7b79e00700 1 -- 172.21.15.120:0/1236759480 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ff7cd8d0 con 0x55b1ff7e0e40 2024-05-14T09:30:56.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.554+0000 7f7b79e00700 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff7e0e40 0x55b1ff9646b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c004df0 tx=0x7f7b6c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1407e833d61c113b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:56.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.554+0000 7f7b79e00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b5c0b2a80 0x7f7b5c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.555+0000 7f7b66a00700 1 -- 172.21.15.120:0/1236759480 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c020070 con 0x55b1ff7e0e40 2024-05-14T09:30:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.555+0000 7f7b66a00700 1 -- 172.21.15.120:0/1236759480 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b6c007b70 con 0x55b1ff7e0e40 2024-05-14T09:30:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.555+0000 7f7b66a00700 1 -- 172.21.15.120:0/1236759480 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c020070 con 0x55b1ff7e0e40 2024-05-14T09:30:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.556+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1236759480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff7e0e40 msgr2=0x55b1ff9646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.556+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff7e0e40 0x55b1ff9646b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c004df0 tx=0x7f7b6c004e20 comp rx=0 tx=0).stop 2024-05-14T09:30:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.558+0000 7f7b79e00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b5c0b2a80 0x7f7b5c0b4f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0061e0 tx=0x7f7b6c005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.558+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1236759480 shutdown_connections 2024-05-14T09:30:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.558+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff95f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.558+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff7e0e40 0x55b1ff9646b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.558+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1236759480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff964bf0 0x55b1ff95e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.558+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1236759480 >> 172.21.15.120:0/1236759480 conn(0x55b1ff81fa80 msgr2=0x55b1ff959790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.559+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1236759480 shutdown_connections 2024-05-14T09:30:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.559+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1236759480 wait complete. 2024-05-14T09:30:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.560+0000 7f7b8a8bab80 1 -- start start 2024-05-14T09:30:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.560+0000 7f7b8a8bab80 1 Processor -- start 2024-05-14T09:30:56.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.561+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.561+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff968890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.561+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff964bf0 0x55b1ff968dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.561+0000 7f7b78a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff968890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.561+0000 7f7b78a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff968890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37972/0 (socket says 172.21.15.120:37972) 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.562+0000 7f7b79400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.562+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b1ff96b660 con 0x55b1ff964bf0 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.562+0000 7f7b78a00700 1 -- 172.21.15.120:0/939258843 learned_addr learned my addr 172.21.15.120:0/939258843 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.562+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b1ff7e6b20 con 0x55b1ff7e0e40 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.562+0000 7f7b79e00700 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff964bf0 0x55b1ff968dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.562+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b1ff96b7e0 con 0x55b1ff95ec50 2024-05-14T09:30:56.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.562+0000 7f7b8a8bab80 10 client.0 _ll_register_callbacks cb 0x55b1ff814380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:56.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.563+0000 7f7b79e00700 1 -- 172.21.15.120:0/939258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 msgr2=0x55b1ff968890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:56.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.563+0000 7f7b79e00700 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff968890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.563+0000 7f7b79e00700 1 -- 172.21.15.120:0/939258843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 msgr2=0x55b1ff968350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:56.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.563+0000 7f7b79e00700 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.563+0000 7f7b79e00700 1 -- 172.21.15.120:0/939258843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ff846420 con 0x55b1ff964bf0 2024-05-14T09:30:56.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.563+0000 7f7b78a00700 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff968890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:56.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.564+0000 7f7b79e00700 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff964bf0 0x55b1ff968dd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c004dc0 tx=0x7f7b6c025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1587eb6a46c1e406 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:56.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.564+0000 7f7b5b400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:56.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.564+0000 7f7b5b400700 1 -- 172.21.15.120:0/939258843 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c038070 con 0x55b1ff964bf0 2024-05-14T09:30:56.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.564+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b6c007b70 con 0x55b1ff964bf0 2024-05-14T09:30:56.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.565+0000 7f7b5b400700 1 -- 172.21.15.120:0/939258843 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7b6c007830 con 0x55b1ff964bf0 2024-05-14T09:30:56.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.565+0000 7f7b5b400700 1 -- 172.21.15.120:0/939258843 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f7b6c020040 con 0x55b1ff964bf0 2024-05-14T09:30:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.565+0000 7f7b8a8bab80 10 client.16692 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:56.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.565+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55b1ff976230 con 0x55b1ff964bf0 2024-05-14T09:30:56.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b5b400700 1 -- 172.21.15.120:0/939258843 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b6c007b70 con 0x55b1ff964bf0 2024-05-14T09:30:56.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b5b400700 1 -- 172.21.15.120:0/939258843 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f7b6c011070 con 0x55b1ff964bf0 2024-05-14T09:30:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b8a8bab80 10 client.16692 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b8a8bab80 10 client.16692 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:30:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b8a8bab80 20 client.16692 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff978700 0x55b1ff97ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b8a8bab80 4 client.16692 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:56.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.566+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1ff92b070 con 0x55b1ff978700 2024-05-14T09:30:56.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.567+0000 7f7b79400700 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff978700 0x55b1ff97ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.568+0000 7f7b79400700 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff978700 0x55b1ff97ab20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d32374a32cf2892e server_cookie=d2402e9c9e6af6e4 in_seq=0 out_seq=0 2024-05-14T09:30:56.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.568+0000 7f7b5b400700 10 client.16692 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:30:56.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.570+0000 7f7b5b400700 1 -- 172.21.15.120:0/939258843 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b1ff92b070 con 0x55b1ff978700 2024-05-14T09:30:56.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.570+0000 7f7b5b400700 10 client.16692 handle_command_reply: tid=0 2024-05-14T09:30:56.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.570+0000 7f7b8a8bab80 1 client.16692 shutdown 2024-05-14T09:30:56.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.571+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff964bf0 msgr2=0x55b1ff968dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.571+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff964bf0 0x55b1ff968dd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c004dc0 tx=0x7f7b6c025000 comp rx=0 tx=0).stop 2024-05-14T09:30:56.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 shutdown_connections 2024-05-14T09:30:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff978700 0x55b1ff97ab20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff964bf0 0x55b1ff968dd0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/939258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff968890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 >> 172.21.15.120:0/939258843 conn(0x55b1ff81fa80 msgr2=0x55b1ff95d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b5b400700 0 client.16692 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:30:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 shutdown_connections 2024-05-14T09:30:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.572+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/939258843 wait complete. 2024-05-14T09:30:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.573+0000 7f7b8a8bab80 20 client.16692 trim_cache size 0 max 16384 2024-05-14T09:30:56.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.600+0000 7f7b8a8bab80 1 Processor -- start 2024-05-14T09:30:56.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.600+0000 7f7b8a8bab80 1 -- start start 2024-05-14T09:30:56.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff95e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff974ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5400eac0 con 0x55b1ff81fa80 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54010690 con 0x55b1ff95ec50 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5400f190 con 0x55b1ff7e0e40 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b79400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff95e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b78a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b78a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37982/0 (socket says 172.21.15.120:37982) 2024-05-14T09:30:56.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.601+0000 7f7b78a00700 1 -- 172.21.15.120:0/1861181014 learned_addr learned my addr 172.21.15.120:0/1861181014 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:56.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.602+0000 7f7b79e00700 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff974ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.603+0000 7f7b79e00700 1 -- 172.21.15.120:0/1861181014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff7e0e40 msgr2=0x55b1ff968d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:56.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.603+0000 7f7b79e00700 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.603+0000 7f7b79e00700 1 -- 172.21.15.120:0/1861181014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 msgr2=0x55b1ff95e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:56.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.603+0000 7f7b79e00700 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff95e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.603+0000 7f7b79e00700 1 -- 172.21.15.120:0/1861181014 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ff955d90 con 0x55b1ff95ec50 2024-05-14T09:30:56.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.603+0000 7f7b78a00700 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:30:56.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.603+0000 7f7b79400700 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff95e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:30:56.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.604+0000 7f7b79e00700 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff974ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c030670 tx=0x7f7b6c0060a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8de1ec3f1f34e44a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:56.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.605+0000 7f7b66000700 1 -- 172.21.15.120:0/1861181014 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c038040 con 0x55b1ff95ec50 2024-05-14T09:30:56.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.606+0000 7f7b66000700 1 -- 172.21.15.120:0/1861181014 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b6c00b9f0 con 0x55b1ff95ec50 2024-05-14T09:30:56.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.606+0000 7f7b66000700 1 -- 172.21.15.120:0/1861181014 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c005440 con 0x55b1ff95ec50 2024-05-14T09:30:56.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1861181014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 msgr2=0x55b1ff974ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff974ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c030670 tx=0x7f7b6c0060a0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1861181014 shutdown_connections 2024-05-14T09:30:56.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff95ec50 0x55b1ff974ae0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff95e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/1861181014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff7e0e40 0x55b1ff968d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1861181014 >> 172.21.15.120:0/1861181014 conn(0x55b1ff962c60 msgr2=0x55b1ff963b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:56.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.607+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1861181014 shutdown_connections 2024-05-14T09:30:56.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.608+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/1861181014 wait complete. 2024-05-14T09:30:56.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.608+0000 7f7b8a8bab80 1 -- start start 2024-05-14T09:30:56.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.608+0000 7f7b8a8bab80 1 Processor -- start 2024-05-14T09:30:56.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.609+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff97dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.609+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff97b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.609+0000 7f7b8a8bab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff97b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.609+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5400ff60 con 0x55b1ff81fa80 2024-05-14T09:30:56.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.609+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5400f890 con 0x55b1ff7e0e40 2024-05-14T09:30:56.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.609+0000 7f7b8a8bab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5400ca80 con 0x55b1ff95ec50 2024-05-14T09:30:56.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.609+0000 7f7b8a8bab80 10 client.0 _ll_register_callbacks cb 0x55b1ff814380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff97b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff97b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50806/0 (socket says 172.21.15.120:50806) 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 -- 172.21.15.120:0/2508849606 learned_addr learned my addr 172.21.15.120:0/2508849606 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b79400700 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff97dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b79e00700 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff97b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 -- 172.21.15.120:0/2508849606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 msgr2=0x55b1ff97b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff97b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 -- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 msgr2=0x55b1ff97dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:56.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff97dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.610+0000 7f7b78a00700 1 -- 172.21.15.120:0/2508849606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ff97bd00 con 0x55b1ff81fa80 2024-05-14T09:30:56.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.611+0000 7f7b78a00700 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff97b040 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7b600df9d0 tx=0x7f7b600a9a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d18a27ba444dbc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:56.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.611+0000 7f7b5b400700 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:56.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.611+0000 7f7b5b400700 1 -- 172.21.15.120:0/2508849606 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600a9000 con 0x55b1ff81fa80 2024-05-14T09:30:56.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.612+0000 7f7b5b400700 1 -- 172.21.15.120:0/2508849606 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7b600a8750 con 0x55b1ff81fa80 2024-05-14T09:30:56.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.612+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b6c00b9f0 con 0x55b1ff81fa80 2024-05-14T09:30:56.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.612+0000 7f7b5b400700 1 -- 172.21.15.120:0/2508849606 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f7b600a9bf0 con 0x55b1ff81fa80 2024-05-14T09:30:56.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.612+0000 7f7b8a8bab80 10 client.16698 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:56.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.613+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55b1ff9e2b60 con 0x55b1ff81fa80 2024-05-14T09:30:56.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b5b400700 1 -- 172.21.15.120:0/2508849606 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b6c00b9f0 con 0x55b1ff81fa80 2024-05-14T09:30:56.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b5b400700 1 -- 172.21.15.120:0/2508849606 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f7b600a81c0 con 0x55b1ff81fa80 2024-05-14T09:30:56.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b8a8bab80 10 client.16698 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:56.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b8a8bab80 10 client.16698 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.e 2024-05-14T09:30:56.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b8a8bab80 20 client.16698 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:56.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff964bf0 0x55b1ff9e5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:56.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b8a8bab80 4 client.16698 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:30:56.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.614+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 --> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1ff88e400 con 0x55b1ff964bf0 2024-05-14T09:30:56.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.615+0000 7f7b79400700 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff964bf0 0x55b1ff9e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.617+0000 7f7b5b400700 10 client.16698 ms_handle_connect on v2:172.21.15.152:6834/2913976247 2024-05-14T09:30:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.617+0000 7f7b79400700 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff964bf0 0x55b1ff9e5290 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55e546f9a7998f53 server_cookie=dc0c5f867078e295 in_seq=0 out_seq=0 2024-05-14T09:30:56.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.617+0000 7f7b5b400700 1 -- 172.21.15.120:0/2508849606 <== mds.1 v2:172.21.15.152:6834/2913976247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1ff88e400 con 0x55b1ff964bf0 2024-05-14T09:30:56.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.617+0000 7f7b5b400700 10 client.16698 handle_command_reply: tid=0 2024-05-14T09:30:56.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.618+0000 7f7b8a8bab80 1 client.16698 shutdown 2024-05-14T09:30:56.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.618+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 msgr2=0x55b1ff97b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.618+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff97b040 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7b600df9d0 tx=0x7f7b600a9a30 comp rx=0 tx=0).stop 2024-05-14T09:30:56.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.619+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 shutdown_connections 2024-05-14T09:30:56.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.619+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:6834/2913976247,v1:172.21.15.152:6835/2913976247] conn(0x55b1ff964bf0 0x55b1ff9e5290 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.619+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b1ff7e0e40 0x55b1ff97dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.619+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b1ff95ec50 0x55b1ff97b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.619+0000 7f7b8a8bab80 1 --2- 172.21.15.120:0/2508849606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b1ff81fa80 0x55b1ff97b040 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.619+0000 7f7b5b400700 0 client.16698 ms_handle_reset on v2:172.21.15.152:6834/2913976247 2024-05-14T09:30:56.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.619+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 >> 172.21.15.120:0/2508849606 conn(0x55b1ff962c60 msgr2=0x55b1ff958e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:56.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.620+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 shutdown_connections 2024-05-14T09:30:56.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.620+0000 7f7b8a8bab80 1 -- 172.21.15.120:0/2508849606 wait complete. 2024-05-14T09:30:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.620+0000 7f7b8a8bab80 20 client.16698 trim_cache size 0 max 16384 2024-05-14T09:30:56.622 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.621+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b5c0b2a80 msgr2=0x7f7b5c0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.621+0000 7f7b7be00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b5c0b2a80 0x7f7b5c0b4f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0061e0 tx=0x7f7b6c005040 comp rx=0 tx=0).stop 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.621+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b74103bc0 msgr2=0x7f7b741a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.621+0000 7f7b7be00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b74103bc0 0x7f7b741a1860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e9c0 tx=0x7f7b6000ecd0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 shutdown_connections 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7b5c0b2a80 0x7f7b5c0b4f90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b74103270 0x7f7b741a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b741086c0 0x7f7b741a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 --2- 172.21.15.120:0/76899862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b74103bc0 0x7f7b741a1860 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 >> 172.21.15.120:0/76899862 conn(0x7f7b740fef30 msgr2=0x7f7b741060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 shutdown_connections 2024-05-14T09:30:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:30:56.622+0000 7f7b7be00700 1 -- 172.21.15.120:0/76899862 wait complete. 2024-05-14T09:30:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.200+0000 7f6e13e00640 1 -- 172.21.15.120:0/1998201981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 msgr2=0x7f6e141092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.200+0000 7f6e13e00640 1 --2- 172.21.15.120:0/1998201981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 0x7f6e141092e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009900 tx=0x7f6e0002a3f0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.201+0000 7f6e13e00640 1 -- 172.21.15.120:0/1998201981 shutdown_connections 2024-05-14T09:30:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.201+0000 7f6e13e00640 1 --2- 172.21.15.120:0/1998201981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e14109820 0x7f6e1410bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.201+0000 7f6e13e00640 1 --2- 172.21.15.120:0/1998201981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 0x7f6e141092e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.201+0000 7f6e13e00640 1 --2- 172.21.15.120:0/1998201981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14104560 0x7f6e14106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.201+0000 7f6e13e00640 1 -- 172.21.15.120:0/1998201981 >> 172.21.15.120:0/1998201981 conn(0x7f6e140fdb60 msgr2=0x7f6e14100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.201+0000 7f6e13e00640 1 -- 172.21.15.120:0/1998201981 shutdown_connections 2024-05-14T09:30:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.202+0000 7f6e13e00640 1 -- 172.21.15.120:0/1998201981 wait complete. 2024-05-14T09:30:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.204+0000 7f6e13e00640 1 Processor -- start 2024-05-14T09:30:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.204+0000 7f6e13e00640 1 -- start start 2024-05-14T09:30:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.205+0000 7f6e13e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e14104560 0x7f6e1419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.205+0000 7f6e13e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 0x7f6e1419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.206+0000 7f6e13e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14109820 0x7f6e141a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.206+0000 7f6e13e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1410f510 con 0x7f6e14106ec0 2024-05-14T09:30:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.206+0000 7f6e13e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1410f390 con 0x7f6e14109820 2024-05-14T09:30:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.206+0000 7f6e13e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1410f690 con 0x7f6e14104560 2024-05-14T09:30:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.206+0000 7f6e12a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e14104560 0x7f6e1419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.206+0000 7f6e13400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14109820 0x7f6e141a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.207+0000 7f6e13400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14109820 0x7f6e141a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48518/0 (socket says 172.21.15.120:48518) 2024-05-14T09:30:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.207+0000 7f6e13400640 1 -- 172.21.15.120:0/4039892368 learned_addr learned my addr 172.21.15.120:0/4039892368 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.207+0000 7f6e12000640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 0x7f6e1419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.208+0000 7f6e13400640 1 -- 172.21.15.120:0/4039892368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e14104560 msgr2=0x7f6e1419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.208+0000 7f6e13400640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e14104560 0x7f6e1419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.208+0000 7f6e13400640 1 -- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 msgr2=0x7f6e1419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.208+0000 7f6e13400640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 0x7f6e1419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.208+0000 7f6e13400640 1 -- 172.21.15.120:0/4039892368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e141a1bb0 con 0x7f6e14109820 2024-05-14T09:30:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.208+0000 7f6e13400640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14109820 0x7f6e141a15f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00b9e0 tx=0x7f6e0c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.209+0000 7f6e18a00640 1 -- 172.21.15.120:0/4039892368 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c019070 con 0x7f6e14109820 2024-05-14T09:30:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.209+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e141a1ea0 con 0x7f6e14109820 2024-05-14T09:30:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.209+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e141a2380 con 0x7f6e14109820 2024-05-14T09:30:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.209+0000 7f6e18a00640 1 -- 172.21.15.120:0/4039892368 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e0c014440 con 0x7f6e14109820 2024-05-14T09:30:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.209+0000 7f6e18a00640 1 -- 172.21.15.120:0/4039892368 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0125a0 con 0x7f6e14109820 2024-05-14T09:30:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.214+0000 7f6e20e03740 1 Processor -- start 2024-05-14T09:30:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e18a00640 1 -- 172.21.15.120:0/4039892368 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6e0c01c070 con 0x7f6e14109820 2024-05-14T09:30:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e20e03740 1 -- start start 2024-05-14T09:30:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cf11b0 0x55f35709e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cd04d0 0x55f3570a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e20e03740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f356ff7550 con 0x55f356cf11b0 2024-05-14T09:30:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e20e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f356f9cbc0 con 0x55f356cd04d0 2024-05-14T09:30:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.216+0000 7f6e20e03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f356ff3510 con 0x55f356cc82f0 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.217+0000 7f6e12000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cf11b0 0x55f35709e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.217+0000 7f6e12000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cf11b0 0x55f35709e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50820/0 (socket says 172.21.15.120:50820) 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.217+0000 7f6e12000640 1 -- 172.21.15.120:0/3362699028 learned_addr learned my addr 172.21.15.120:0/3362699028 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.218+0000 7f6e18a00640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6df80b2860 0x7f6df80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.218+0000 7f6e12000640 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cd04d0 0x55f3570a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.218+0000 7f6e13400640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6df80b2860 0x7f6df80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.218+0000 7f6e12000640 1 -- 172.21.15.120:0/3362699028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 msgr2=0x55f3570a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.218+0000 7f6e12a00640 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.219+0000 7f6e18a00640 1 -- 172.21.15.120:0/4039892368 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6e0c0e1aa0 con 0x7f6e14109820 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.219+0000 7f6e12000640 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.219+0000 7f6e12000640 1 -- 172.21.15.120:0/3362699028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cd04d0 msgr2=0x55f3570a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.219+0000 7f6e12000640 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cd04d0 0x55f3570a2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.219+0000 7f6e12000640 1 -- 172.21.15.120:0/3362699028 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f356d09210 con 0x55f356cf11b0 2024-05-14T09:30:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.219+0000 7f6e12a00640 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.219+0000 7f6e13400640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6df80b2860 0x7f6df80b4d70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0a8cb0 tx=0x7f6e0c021000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.220+0000 7f6e12000640 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cf11b0 0x55f35709e160 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6e00005760 tx=0x7f6e00009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df44d3e742582ced server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.220+0000 7f6dffe00640 1 -- 172.21.15.120:0/3362699028 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00046070 con 0x55f356cf11b0 2024-05-14T09:30:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.220+0000 7f6dffe00640 1 -- 172.21.15.120:0/3362699028 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e00003d80 con 0x55f356cf11b0 2024-05-14T09:30:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.220+0000 7f6dffe00640 1 -- 172.21.15.120:0/3362699028 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00035030 con 0x55f356cf11b0 2024-05-14T09:30:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.221+0000 7f6e20e03740 1 -- 172.21.15.120:0/3362699028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cf11b0 msgr2=0x55f35709e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.221+0000 7f6e20e03740 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cf11b0 0x55f35709e160 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6e00005760 tx=0x7f6e00009640 comp rx=0 tx=0).stop 2024-05-14T09:30:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.222+0000 7f6e20e03740 1 -- 172.21.15.120:0/3362699028 shutdown_connections 2024-05-14T09:30:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.222+0000 7f6e20e03740 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cd04d0 0x55f3570a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.222+0000 7f6e20e03740 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.222+0000 7f6e20e03740 1 --2- 172.21.15.120:0/3362699028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cf11b0 0x55f35709e160 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.222+0000 7f6e20e03740 1 -- 172.21.15.120:0/3362699028 >> 172.21.15.120:0/3362699028 conn(0x55f356ce5300 msgr2=0x55f35708ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.222+0000 7f6e20e03740 1 -- 172.21.15.120:0/3362699028 shutdown_connections 2024-05-14T09:30:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.222+0000 7f6e20e03740 1 -- 172.21.15.120:0/3362699028 wait complete. 2024-05-14T09:30:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.223+0000 7f6e20e03740 1 -- start start 2024-05-14T09:30:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.223+0000 7f6e20e03740 1 Processor -- start 2024-05-14T09:30:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 0x55f3570acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e20e03740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f3570a3960 con 0x55f356cd04d0 2024-05-14T09:30:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e20e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f356fb0660 con 0x55f356cafd80 2024-05-14T09:30:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e20e03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f3570a3ae0 con 0x55f356cc82f0 2024-05-14T09:30:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e20e03740 10 client.0 _ll_register_callbacks cb 0x55f356f7a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.225+0000 7f6e12000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.226+0000 7f6e12000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:38030/0 (socket says 172.21.15.120:38030) 2024-05-14T09:30:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.226+0000 7f6e12000640 1 -- 172.21.15.120:0/397727969 learned_addr learned my addr 172.21.15.120:0/397727969 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.226+0000 7f6e12000640 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 0x55f3570acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.226+0000 7f6e12a00640 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.228+0000 7f6e12000640 1 -- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 msgr2=0x55f3570acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.228+0000 7f6e12000640 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 0x55f3570acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.228+0000 7f6e12000640 1 -- 172.21.15.120:0/397727969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 msgr2=0x55f3570a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.228+0000 7f6e12000640 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.228+0000 7f6e12000640 1 -- 172.21.15.120:0/397727969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f356dd5620 con 0x55f356cc82f0 2024-05-14T09:30:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.229+0000 7f6e12000640 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a57c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e00031460 tx=0x7f6e00004120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4613cfe1e51bca29 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.230+0000 7f6dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:30:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.231+0000 7f6dfcc00640 1 -- 172.21.15.120:0/397727969 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00046040 con 0x55f356cc82f0 2024-05-14T09:30:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.231+0000 7f6dfcc00640 1 -- 172.21.15.120:0/397727969 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6e000036f0 con 0x55f356cc82f0 2024-05-14T09:30:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.232+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e00003d80 con 0x55f356cc82f0 2024-05-14T09:30:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.233+0000 7f6dfcc00640 1 -- 172.21.15.120:0/397727969 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f6e00035040 con 0x55f356cc82f0 2024-05-14T09:30:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.233+0000 7f6e20e03740 10 client.26239 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.233+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55f3570a3990 con 0x55f356cc82f0 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.234+0000 7f6dfcc00640 1 -- 172.21.15.120:0/397727969 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e0003b480 con 0x55f356cc82f0 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.234+0000 7f6dfcc00640 1 -- 172.21.15.120:0/397727969 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f6e0004c070 con 0x55f356cc82f0 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.235+0000 7f6e20e03740 10 client.26239 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.235+0000 7f6e20e03740 10 client.26239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.235+0000 7f6e20e03740 20 client.26239 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.235+0000 7f6e20e03740 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f356c851c0 0x55f3570b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.235+0000 7f6e20e03740 4 client.26239 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:30:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.235+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6e00003d80 con 0x55f356c851c0 2024-05-14T09:30:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.235+0000 7f6e12a00640 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f356c851c0 0x55f3570b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.237+0000 7f6e12a00640 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f356c851c0 0x55f3570b2c80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df915439fe45f3e server_cookie=19539e291c1b5021 in_seq=0 out_seq=0 2024-05-14T09:30:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.238+0000 7f6dfcc00640 10 client.26239 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.239+0000 7f6dfcc00640 1 -- 172.21.15.120:0/397727969 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f6e00003d80 con 0x55f356c851c0 2024-05-14T09:30:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.239+0000 7f6dfcc00640 10 client.26239 handle_command_reply: tid=0 2024-05-14T09:30:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.239+0000 7f6e20e03740 1 client.26239 shutdown 2024-05-14T09:30:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 msgr2=0x55f3570a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a57c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e00031460 tx=0x7f6e00004120 comp rx=0 tx=0).stop 2024-05-14T09:30:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 shutdown_connections 2024-05-14T09:30:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f356c851c0 0x55f3570b2c80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 0x55f3570acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 --2- 172.21.15.120:0/397727969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cc82f0 0x55f3570a57c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 >> 172.21.15.120:0/397727969 conn(0x55f356ce5300 msgr2=0x55f35708dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6dfcc00640 0 client.26239 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 shutdown_connections 2024-05-14T09:30:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 1 -- 172.21.15.120:0/397727969 wait complete. 2024-05-14T09:30:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.240+0000 7f6e20e03740 20 client.26239 trim_cache size 0 max 16384 2024-05-14T09:30:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.266+0000 7f6e20e03740 1 Processor -- start 2024-05-14T09:30:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.266+0000 7f6e20e03740 1 -- start start 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.266+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cafd80 0x55f35709be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.266+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.267+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3570b8b30 0x55f35709c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.267+0000 7f6e20e03740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6df400fc90 con 0x55f356cd04d0 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.267+0000 7f6e20e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4011860 con 0x55f3570b8b30 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.267+0000 7f6e20e03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4010360 con 0x55f356cafd80 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.267+0000 7f6e12a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.267+0000 7f6e12a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570acbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50840/0 (socket says 172.21.15.120:50840) 2024-05-14T09:30:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.267+0000 7f6e12a00640 1 -- 172.21.15.120:0/1349885150 learned_addr learned my addr 172.21.15.120:0/1349885150 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.268+0000 7f6e12000640 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cafd80 0x55f35709be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.269+0000 7f6e12a00640 1 -- 172.21.15.120:0/1349885150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cafd80 msgr2=0x55f35709be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:30:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.269+0000 7f6e12a00640 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cafd80 0x55f35709be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.269+0000 7f6e12a00640 1 -- 172.21.15.120:0/1349885150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3570b8b30 msgr2=0x55f35709c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:30:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.269+0000 7f6e12a00640 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3570b8b30 0x55f35709c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.269+0000 7f6e12a00640 1 -- 172.21.15.120:0/1349885150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f35708a4a0 con 0x55f356cd04d0 2024-05-14T09:30:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.270+0000 7f6e12000640 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cafd80 0x55f35709be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:30:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.272+0000 7f6e12a00640 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570acbb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55f3570b33c0 tx=0x7f6e0401f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781626af8c34c0a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.273+0000 7f6dff400640 1 -- 172.21.15.120:0/1349885150 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04005020 con 0x55f356cd04d0 2024-05-14T09:30:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.273+0000 7f6dff400640 1 -- 172.21.15.120:0/1349885150 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e0402de50 con 0x55f356cd04d0 2024-05-14T09:30:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.273+0000 7f6dff400640 1 -- 172.21.15.120:0/1349885150 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04004a00 con 0x55f356cd04d0 2024-05-14T09:30:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.273+0000 7f6e20e03740 1 -- 172.21.15.120:0/1349885150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 msgr2=0x55f3570acbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570acbb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55f3570b33c0 tx=0x7f6e0401f7f0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 -- 172.21.15.120:0/1349885150 shutdown_connections 2024-05-14T09:30:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3570b8b30 0x55f35709c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f356cd04d0 0x55f3570acbb0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 --2- 172.21.15.120:0/1349885150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f356cafd80 0x55f35709be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 -- 172.21.15.120:0/1349885150 >> 172.21.15.120:0/1349885150 conn(0x55f356ce5300 msgr2=0x55f3570b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 -- 172.21.15.120:0/1349885150 shutdown_connections 2024-05-14T09:30:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 -- 172.21.15.120:0/1349885150 wait complete. 2024-05-14T09:30:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.274+0000 7f6e20e03740 1 -- start start 2024-05-14T09:30:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 1 Processor -- start 2024-05-14T09:30:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 0x55f357112240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f3570b8b30 0x55f357112780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3571176d0 0x55f357119af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4011130 con 0x55f3570b8b30 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4010a60 con 0x55f356cafd80 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6df400dc90 con 0x55f3571176d0 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.275+0000 7f6e20e03740 10 client.0 _ll_register_callbacks cb 0x7f6e00044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.276+0000 7f6e12a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f3570b8b30 0x55f357112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.276+0000 7f6e12a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f3570b8b30 0x55f357112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50844/0 (socket says 172.21.15.120:50844) 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.276+0000 7f6e12a00640 1 -- 172.21.15.120:0/340180365 learned_addr learned my addr 172.21.15.120:0/340180365 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.277+0000 7f6e12a00640 1 -- 172.21.15.120:0/340180365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3571176d0 msgr2=0x55f357119af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.277+0000 7f6e12a00640 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3571176d0 0x55f357119af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.277+0000 7f6e12a00640 1 -- 172.21.15.120:0/340180365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 msgr2=0x55f357112240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.277+0000 7f6e12a00640 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 0x55f357112240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.277+0000 7f6e12a00640 1 -- 172.21.15.120:0/340180365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f35711a0b0 con 0x55f3570b8b30 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.277+0000 7f6e12a00640 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f3570b8b30 0x55f357112780 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55f3570a4250 tx=0x7f6e0402d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b915d0fbaaee7c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:30:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.278+0000 7f6dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:30:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.278+0000 7f6dfcc00640 1 -- 172.21.15.120:0/340180365 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04005230 con 0x55f3570b8b30 2024-05-14T09:30:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.278+0000 7f6dfcc00640 1 -- 172.21.15.120:0/340180365 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6e040053d0 con 0x55f3570b8b30 2024-05-14T09:30:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.279+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e0402de50 con 0x55f3570b8b30 2024-05-14T09:30:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.279+0000 7f6dfcc00640 1 -- 172.21.15.120:0/340180365 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f6e04047050 con 0x55f3570b8b30 2024-05-14T09:30:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.279+0000 7f6e20e03740 10 client.16713 fetch_fsmap learned FSMap version 45 2024-05-14T09:30:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.279+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55f35711b2e0 con 0x55f3570b8b30 2024-05-14T09:30:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.280+0000 7f6dfcc00640 1 -- 172.21.15.120:0/340180365 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e0402de50 con 0x55f3570b8b30 2024-05-14T09:30:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.280+0000 7f6dfcc00640 1 -- 172.21.15.120:0/340180365 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f6e04037690 con 0x55f3570b8b30 2024-05-14T09:30:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.281+0000 7f6e20e03740 10 client.16713 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:30:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.281+0000 7f6e20e03740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:30:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.281+0000 7f6e20e03740 20 client.16713 populate_metadata read hostname 'smithi120' 2024-05-14T09:30:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.281+0000 7f6e20e03740 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f35711bc20 0x55f35711e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:30:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.281+0000 7f6e20e03740 4 client.16713 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:30:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.281+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f357005160 con 0x55f35711bc20 2024-05-14T09:30:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.282+0000 7f6e12000640 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f35711bc20 0x55f35711e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:30:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.285+0000 7f6e12000640 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f35711bc20 0x55f35711e040 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d8c7082682cb3c7 server_cookie=894e57f4c7a9e28f in_seq=0 out_seq=0 2024-05-14T09:30:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.285+0000 7f6dfcc00640 10 client.16713 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.325+0000 7f6dfcc00640 1 -- 172.21.15.120:0/340180365 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f357005160 con 0x55f35711bc20 2024-05-14T09:30:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.325+0000 7f6dfcc00640 10 client.16713 handle_command_reply: tid=0 2024-05-14T09:30:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 client.16713 shutdown 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f3570b8b30 msgr2=0x55f357112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f3570b8b30 0x55f357112780 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55f3570a4250 tx=0x7f6e0402d4c0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 shutdown_connections 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f35711bc20 0x55f35711e040 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3571176d0 0x55f357119af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f3570b8b30 0x55f357112780 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 --2- 172.21.15.120:0/340180365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f356cafd80 0x55f357112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 >> 172.21.15.120:0/340180365 conn(0x55f356ce5300 msgr2=0x55f3570b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.326+0000 7f6dfcc00640 0 client.16713 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:30:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.327+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 shutdown_connections 2024-05-14T09:30:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.327+0000 7f6e20e03740 1 -- 172.21.15.120:0/340180365 wait complete. 2024-05-14T09:30:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.327+0000 7f6e20e03740 20 client.16713 trim_cache size 0 max 16384 2024-05-14T09:30:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:30:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:30:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:30:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.328+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6df80b2860 msgr2=0x7f6df80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.328+0000 7f6e13e00640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6df80b2860 0x7f6df80b4d70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0a8cb0 tx=0x7f6e0c021000 comp rx=0 tx=0).stop 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.328+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14109820 msgr2=0x7f6e141a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.328+0000 7f6e13e00640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14109820 0x7f6e141a15f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00b9e0 tx=0x7f6e0c00bea0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 shutdown_connections 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6df80b2860 0x7f6df80b4d70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e14109820 0x7f6e141a15f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e14106ec0 0x7f6e1419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 --2- 172.21.15.120:0/4039892368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e14104560 0x7f6e1419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 >> 172.21.15.120:0/4039892368 conn(0x7f6e140fdb60 msgr2=0x7f6e14106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 shutdown_connections 2024-05-14T09:30:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:30:57.329+0000 7f6e13e00640 1 -- 172.21.15.120:0/4039892368 wait complete. 2024-05-14T09:30:57.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T09:30:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:30:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:30:58 smithi120 ceph-mon[31085]: pgmap v778: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 659 op/s 2024-05-14T09:30:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:30:58 smithi152 ceph-mon[34868]: pgmap v778: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 659 op/s 2024-05-14T09:30:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:30:58 smithi175 ceph-mon[35353]: pgmap v778: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 659 op/s 2024-05-14T09:30:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 205.0 s, 537.0 tps, lat 186.158 ms stddev 258.936 2024-05-14T09:31:00.325 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:00 smithi120 ceph-mon[31085]: pgmap v779: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.1 MiB/s wr, 657 op/s 2024-05-14T09:31:00.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:00 smithi152 ceph-mon[34868]: pgmap v779: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.1 MiB/s wr, 657 op/s 2024-05-14T09:31:00.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:00 smithi175 ceph-mon[35353]: pgmap v779: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.1 MiB/s wr, 657 op/s 2024-05-14T09:31:01.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.030+0000 7f1ef9000700 1 -- 172.21.15.120:0/475547177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 msgr2=0x7f1ef4104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.030+0000 7f1ef9000700 1 --2- 172.21.15.120:0/475547177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 0x7f1ef4104a00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40099c0 tx=0x7f1ee4009cd0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.031+0000 7f1ef9000700 1 -- 172.21.15.120:0/475547177 shutdown_connections 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.031+0000 7f1ef9000700 1 --2- 172.21.15.120:0/475547177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4109870 0x7f1ef41111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.031+0000 7f1ef9000700 1 --2- 172.21.15.120:0/475547177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 0x7f1ef4104a00 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.031+0000 7f1ef9000700 1 --2- 172.21.15.120:0/475547177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ef4108f20 0x7f1ef4109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.031+0000 7f1ef9000700 1 -- 172.21.15.120:0/475547177 >> 172.21.15.120:0/475547177 conn(0x7f1ef4100040 msgr2=0x7f1ef4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.031+0000 7f1ef9000700 1 -- 172.21.15.120:0/475547177 shutdown_connections 2024-05-14T09:31:01.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.031+0000 7f1ef9000700 1 -- 172.21.15.120:0/475547177 wait complete. 2024-05-14T09:31:01.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.035+0000 7f1ef9000700 1 Processor -- start 2024-05-14T09:31:01.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.036+0000 7f1ef9000700 1 -- start start 2024-05-14T09:31:01.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.036+0000 7f1ef9000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 0x7f1ef419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.036+0000 7f1ef9000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4108f20 0x7f1ef419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.036+0000 7f1ef9000700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ef4109870 0x7f1ef419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.036+0000 7f1ef9000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef41143c0 con 0x7f1ef41045f0 2024-05-14T09:31:01.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.036+0000 7f1ef9000700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef4114240 con 0x7f1ef4109870 2024-05-14T09:31:01.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.036+0000 7f1ef9000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef4114540 con 0x7f1ef4108f20 2024-05-14T09:31:01.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.037+0000 7f1ef1e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 0x7f1ef419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.037+0000 7f1ef1400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4108f20 0x7f1ef419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.037+0000 7f1ef1400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4108f20 0x7f1ef419b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53486/0 (socket says 172.21.15.120:53486) 2024-05-14T09:31:01.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.037+0000 7f1ef1400700 1 -- 172.21.15.120:0/3334703737 learned_addr learned my addr 172.21.15.120:0/3334703737 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef2800700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ef4109870 0x7f1ef419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef1400700 1 -- 172.21.15.120:0/3334703737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ef4109870 msgr2=0x7f1ef419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef1400700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ef4109870 0x7f1ef419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef1400700 1 -- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 msgr2=0x7f1ef419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef1400700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 0x7f1ef419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef1400700 1 -- 172.21.15.120:0/3334703737 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef419fc50 con 0x7f1ef4108f20 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 0x7f1ef419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.038+0000 7f1ef2800700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ef4109870 0x7f1ef419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:31:01.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.039+0000 7f1ef1400700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4108f20 0x7f1ef419b3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000b500 tx=0x7f1ee000b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:01.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.039+0000 7f1eeaa00700 1 -- 172.21.15.120:0/3334703737 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0015020 con 0x7f1ef4108f20 2024-05-14T09:31:01.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.039+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef419ff40 con 0x7f1ef4108f20 2024-05-14T09:31:01.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.039+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef40759f0 con 0x7f1ef4108f20 2024-05-14T09:31:01.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.039+0000 7f1eeaa00700 1 -- 172.21.15.120:0/3334703737 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ee0011cc0 con 0x7f1ef4108f20 2024-05-14T09:31:01.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.040+0000 7f1eeaa00700 1 -- 172.21.15.120:0/3334703737 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee001ac70 con 0x7f1ef4108f20 2024-05-14T09:31:01.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.047+0000 7f1eeaa00700 1 -- 172.21.15.120:0/3334703737 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1ee0018020 con 0x7f1ef4108f20 2024-05-14T09:31:01.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.047+0000 7f1f07bc6b80 1 Processor -- start 2024-05-14T09:31:01.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.048+0000 7f1f07bc6b80 1 -- start start 2024-05-14T09:31:01.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.049+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9643a9e40 0x55a96452d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.049+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a9645274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.049+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9645279f0 0x55a964527e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.049+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a964449a20 con 0x55a9643a9e40 2024-05-14T09:31:01.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.049+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9643e7760 con 0x55a96452d830 2024-05-14T09:31:01.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.049+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a9644459e0 con 0x55a9645279f0 2024-05-14T09:31:01.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.050+0000 7f1ef1400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9645279f0 0x55a964527e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.050+0000 7f1ef1400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9645279f0 0x55a964527e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53488/0 (socket says 172.21.15.120:53488) 2024-05-14T09:31:01.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.050+0000 7f1ef1400700 1 -- 172.21.15.120:0/2076701180 learned_addr learned my addr 172.21.15.120:0/2076701180 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:01.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.050+0000 7f1ef2800700 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9643a9e40 0x55a96452d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.051+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a9645274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.051+0000 7f1ef1400700 1 -- 172.21.15.120:0/2076701180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 msgr2=0x55a9645274b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.051+0000 7f1ef1400700 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a9645274b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.051+0000 7f1ef1400700 1 -- 172.21.15.120:0/2076701180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9643a9e40 msgr2=0x55a96452d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.051+0000 7f1ef1400700 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9643a9e40 0x55a96452d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.051+0000 7f1ef1400700 1 -- 172.21.15.120:0/2076701180 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9643968d0 con 0x55a9645279f0 2024-05-14T09:31:01.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.051+0000 7f1eeaa00700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1ed80b2900 0x7f1ed80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.052+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a9645274b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:31:01.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.052+0000 7f1eeaa00700 1 -- 172.21.15.120:0/3334703737 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1ee00e1c70 con 0x7f1ef4108f20 2024-05-14T09:31:01.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.053+0000 7f1ef2800700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1ed80b2900 0x7f1ed80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.053+0000 7f1ef1400700 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9645279f0 0x55a964527e00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00e5da0 tx=0x7f1ee00ea5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=617ad2f187743a8b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:01.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.055+0000 7f1ef2800700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1ed80b2900 0x7f1ed80b4e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0104d0 tx=0x7f1eec009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:01.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.056+0000 7f1edf400700 1 -- 172.21.15.120:0/2076701180 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00a8c60 con 0x55a9645279f0 2024-05-14T09:31:01.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.056+0000 7f1edf400700 1 -- 172.21.15.120:0/2076701180 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ee00a89a0 con 0x55a9645279f0 2024-05-14T09:31:01.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.056+0000 7f1edf400700 1 -- 172.21.15.120:0/2076701180 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00a8600 con 0x55a9645279f0 2024-05-14T09:31:01.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.058+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2076701180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9645279f0 msgr2=0x55a964527e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.058+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9645279f0 0x55a964527e00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00e5da0 tx=0x7f1ee00ea5d0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.058+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2076701180 shutdown_connections 2024-05-14T09:31:01.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.058+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9645279f0 0x55a964527e00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.058+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9643a9e40 0x55a96452d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.058+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2076701180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a9645274b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.058+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2076701180 >> 172.21.15.120:0/2076701180 conn(0x55a9643eef70 msgr2=0x55a9645222d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:01.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.059+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2076701180 shutdown_connections 2024-05-14T09:31:01.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.059+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2076701180 wait complete. 2024-05-14T09:31:01.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.059+0000 7f1f07bc6b80 1 -- start start 2024-05-14T09:31:01.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.060+0000 7f1f07bc6b80 1 Processor -- start 2024-05-14T09:31:01.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964530f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9645279f0 0x55a9645314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a964531a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a964534310 con 0x55a9645279f0 2024-05-14T09:31:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9643afb20 con 0x55a96452d830 2024-05-14T09:31:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a964534490 con 0x55a9643a9e40 2024-05-14T09:31:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1f07bc6b80 10 client.0 _ll_register_callbacks cb 0x55a9643f0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1ef1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964530f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1ef1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964530f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53500/0 (socket says 172.21.15.120:53500) 2024-05-14T09:31:01.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.061+0000 7f1ef1e00700 1 -- 172.21.15.120:0/1895424608 learned_addr learned my addr 172.21.15.120:0/1895424608 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:01.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.062+0000 7f1ef1400700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9645279f0 0x55a9645314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.062+0000 7f1ef2800700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a964531a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.062+0000 7f1ef1e00700 1 -- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 msgr2=0x55a964531a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.063+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a964531a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.063+0000 7f1ef1e00700 1 -- 172.21.15.120:0/1895424608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9645279f0 msgr2=0x55a9645314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.063+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9645279f0 0x55a9645314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.063+0000 7f1ef1e00700 1 -- 172.21.15.120:0/1895424608 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a96440f420 con 0x55a9643a9e40 2024-05-14T09:31:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.063+0000 7f1ef2800700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a964531a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:31:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.063+0000 7f1ef1400700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9645279f0 0x55a9645314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:31:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.064+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964530f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400b580 tx=0x7f1ee4009670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4059ef7d1f8d79bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.064+0000 7f1ed3e00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:31:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.065+0000 7f1ed3e00700 1 -- 172.21.15.120:0/1895424608 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4005490 con 0x55a9643a9e40 2024-05-14T09:31:01.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.065+0000 7f1ed3e00700 1 -- 172.21.15.120:0/1895424608 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1ee4005630 con 0x55a9643a9e40 2024-05-14T09:31:01.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.065+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ee00a89a0 con 0x55a9643a9e40 2024-05-14T09:31:01.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.066+0000 7f1ed3e00700 1 -- 172.21.15.120:0/1895424608 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1ee400b790 con 0x55a9643a9e40 2024-05-14T09:31:01.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.066+0000 7f1f07bc6b80 10 client.26248 fetch_fsmap learned FSMap version 45 2024-05-14T09:31:01.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.066+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a96453ed80 con 0x55a9643a9e40 2024-05-14T09:31:01.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.067+0000 7f1ed3e00700 1 -- 172.21.15.120:0/1895424608 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ee00a89a0 con 0x55a9643a9e40 2024-05-14T09:31:01.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.067+0000 7f1ed3e00700 1 -- 172.21.15.120:0/1895424608 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f1ee402d030 con 0x55a9643a9e40 2024-05-14T09:31:01.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.068+0000 7f1f07bc6b80 10 client.26248 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:31:01.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.068+0000 7f1f07bc6b80 10 client.26248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:01.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.068+0000 7f1f07bc6b80 20 client.26248 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:01.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.068+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645413b0 0x55a964543850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.068+0000 7f1f07bc6b80 4 client.26248 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:31:01.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.068+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9644f41c0 con 0x55a9645413b0 2024-05-14T09:31:01.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.069+0000 7f1ef1400700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645413b0 0x55a964543850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.070+0000 7f1ed3e00700 10 client.26248 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:01.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.070+0000 7f1ef1400700 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645413b0 0x55a964543850 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1cea8ba2616b757 server_cookie=908afa99e66b9e53 in_seq=0 out_seq=0 2024-05-14T09:31:01.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.074+0000 7f1ed3e00700 1 -- 172.21.15.120:0/1895424608 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a9644f41c0 con 0x55a9645413b0 2024-05-14T09:31:01.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.074+0000 7f1ed3e00700 10 client.26248 handle_command_reply: tid=0 2024-05-14T09:31:01.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.074+0000 7f1f07bc6b80 1 client.26248 shutdown 2024-05-14T09:31:01.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 msgr2=0x55a964530f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964530f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400b580 tx=0x7f1ee4009670 comp rx=0 tx=0).stop 2024-05-14T09:31:01.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 shutdown_connections 2024-05-14T09:31:01.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645413b0 0x55a964543850 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a96452d830 0x55a964531a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964530f80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/1895424608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9645279f0 0x55a9645314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 >> 172.21.15.120:0/1895424608 conn(0x55a9643eef70 msgr2=0x55a9645264a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:01.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.075+0000 7f1ed3e00700 0 client.26248 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:01.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.076+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 shutdown_connections 2024-05-14T09:31:01.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.076+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/1895424608 wait complete. 2024-05-14T09:31:01.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.077+0000 7f1f07bc6b80 20 client.26248 trim_cache size 0 max 16384 2024-05-14T09:31:01.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.106+0000 7f1f07bc6b80 1 Processor -- start 2024-05-14T09:31:01.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.107+0000 7f1f07bc6b80 1 -- start start 2024-05-14T09:31:01.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.107+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a9645274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.108+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a9645302a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.108+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964531840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.108+0000 7f1ef1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a9645274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1ef2800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964531840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1ef1400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a9645302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed400eba0 con 0x55a96452d830 2024-05-14T09:31:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed4010770 con 0x55a9645279f0 2024-05-14T09:31:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed400f270 con 0x55a9643a9e40 2024-05-14T09:31:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1ef2800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964531840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46478/0 (socket says 172.21.15.120:46478) 2024-05-14T09:31:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1ef2800700 1 -- 172.21.15.120:0/2866884879 learned_addr learned my addr 172.21.15.120:0/2866884879 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.109+0000 7f1ef1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a9645274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53510/0 (socket says 172.21.15.120:53510) 2024-05-14T09:31:01.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.110+0000 7f1ef2800700 1 -- 172.21.15.120:0/2866884879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 msgr2=0x55a9645274b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.110+0000 7f1ef2800700 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a9645274b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.110+0000 7f1ef2800700 1 -- 172.21.15.120:0/2866884879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 msgr2=0x55a9645302a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.110+0000 7f1ef2800700 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a9645302a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.110+0000 7f1ef2800700 1 -- 172.21.15.120:0/2866884879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a96452f4f0 con 0x55a96452d830 2024-05-14T09:31:01.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.110+0000 7f1ef1400700 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a9645302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:31:01.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.111+0000 7f1ef2800700 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964531840 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1eec016810 tx=0x7f1eec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cb7fb3192edf25 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:01.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.112+0000 7f1edea00700 1 -- 172.21.15.120:0/2866884879 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec01c030 con 0x55a96452d830 2024-05-14T09:31:01.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.112+0000 7f1edea00700 1 -- 172.21.15.120:0/2866884879 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1eec027070 con 0x55a96452d830 2024-05-14T09:31:01.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.112+0000 7f1edea00700 1 -- 172.21.15.120:0/2866884879 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec014890 con 0x55a96452d830 2024-05-14T09:31:01.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.113+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2866884879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 msgr2=0x55a964531840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.113+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964531840 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1eec016810 tx=0x7f1eec013000 comp rx=0 tx=0).stop 2024-05-14T09:31:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.114+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2866884879 shutdown_connections 2024-05-14T09:31:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.114+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964531840 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.114+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a9645274b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.114+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2866884879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a9645302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.114+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2866884879 >> 172.21.15.120:0/2866884879 conn(0x55a9643eef70 msgr2=0x55a96452c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.114+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2866884879 shutdown_connections 2024-05-14T09:31:01.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.114+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2866884879 wait complete. 2024-05-14T09:31:01.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.115+0000 7f1f07bc6b80 1 -- start start 2024-05-14T09:31:01.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.116+0000 7f1f07bc6b80 1 Processor -- start 2024-05-14T09:31:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.116+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964539b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.116+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a964548440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.116+0000 7f1f07bc6b80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964548980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.116+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed4010040 con 0x55a96452d830 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.116+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed400f970 con 0x55a9645279f0 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.116+0000 7f1f07bc6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed400cb60 con 0x55a9643a9e40 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.117+0000 7f1f07bc6b80 10 client.0 _ll_register_callbacks cb 0x55a9643f0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.117+0000 7f1ef1400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a964548440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.117+0000 7f1ef1400700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a964548440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:59946/0 (socket says 172.21.15.120:59946) 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.117+0000 7f1ef1400700 1 -- 172.21.15.120:0/2966115818 learned_addr learned my addr 172.21.15.120:0/2966115818 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.117+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964539b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.117+0000 7f1ef2800700 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964548980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.118+0000 7f1ef1400700 1 -- 172.21.15.120:0/2966115818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 msgr2=0x55a964539b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.118+0000 7f1ef1400700 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964539b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.118+0000 7f1ef1400700 1 -- 172.21.15.120:0/2966115818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 msgr2=0x55a964548980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.118+0000 7f1ef1400700 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964548980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.118+0000 7f1ef1400700 1 -- 172.21.15.120:0/2966115818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a964548f40 con 0x55a9645279f0 2024-05-14T09:31:01.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.119+0000 7f1ef1400700 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a964548440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000bfd0 tx=0x7f1ee00a8d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=296980e57575609e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:01.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.119+0000 7f1ed3e00700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:31:01.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.121+0000 7f1ed3e00700 1 -- 172.21.15.120:0/2966115818 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00c8060 con 0x55a9645279f0 2024-05-14T09:31:01.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.121+0000 7f1ed3e00700 1 -- 172.21.15.120:0/2966115818 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1ee00a5120 con 0x55a9645279f0 2024-05-14T09:31:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.121+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eec027070 con 0x55a9645279f0 2024-05-14T09:31:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.122+0000 7f1ed3e00700 1 -- 172.21.15.120:0/2966115818 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1ee00a87e0 con 0x55a9645279f0 2024-05-14T09:31:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.122+0000 7f1f07bc6b80 10 client.36200 fetch_fsmap learned FSMap version 45 2024-05-14T09:31:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.122+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a9645b41c0 con 0x55a9645279f0 2024-05-14T09:31:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.123+0000 7f1ed3e00700 1 -- 172.21.15.120:0/2966115818 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1eec027070 con 0x55a9645279f0 2024-05-14T09:31:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.124+0000 7f1ed3e00700 1 -- 172.21.15.120:0/2966115818 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f1ee00c1070 con 0x55a9645279f0 2024-05-14T09:31:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.125+0000 7f1f07bc6b80 10 client.36200 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:31:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.125+0000 7f1f07bc6b80 10 client.36200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.125+0000 7f1f07bc6b80 20 client.36200 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.125+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645b4450 0x55a9645b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.125+0000 7f1f07bc6b80 4 client.36200 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T09:31:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.125+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a964457400 con 0x55a9645b4450 2024-05-14T09:31:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.126+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645b4450 0x55a9645b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.128+0000 7f1ef1e00700 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645b4450 0x55a9645b6870 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c5aea3d38373ed server_cookie=9ae154081324ccb9 in_seq=0 out_seq=0 2024-05-14T09:31:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.128+0000 7f1ed3e00700 10 client.36200 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.129+0000 7f1ed3e00700 1 -- 172.21.15.120:0/2966115818 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a964457400 con 0x55a9645b4450 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.129+0000 7f1ed3e00700 10 client.36200 handle_command_reply: tid=0 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.129+0000 7f1f07bc6b80 1 client.36200 shutdown 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 msgr2=0x55a964548440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a964548440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000bfd0 tx=0x7f1ee00a8d50 comp rx=0 tx=0).stop 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 shutdown_connections 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55a9645b4450 0x55a9645b6870 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a96452d830 0x55a964548980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9643a9e40 0x55a964539b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 --2- 172.21.15.120:0/2966115818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9645279f0 0x55a964548440 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1ed3e00700 0 client.36200 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.130+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 >> 172.21.15.120:0/2966115818 conn(0x55a9643eef70 msgr2=0x55a96452acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.131+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 shutdown_connections 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.131+0000 7f1f07bc6b80 1 -- 172.21.15.120:0/2966115818 wait complete. 2024-05-14T09:31:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.131+0000 7f1f07bc6b80 20 client.36200 trim_cache size 0 max 16384 2024-05-14T09:31:01.132 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-05-14T09:31:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.133+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1ed80b2900 msgr2=0x7f1ed80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.133+0000 7f1ef9000700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1ed80b2900 0x7f1ed80b4e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0104d0 tx=0x7f1eec009040 comp rx=0 tx=0).stop 2024-05-14T09:31:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.133+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4108f20 msgr2=0x7f1ef419b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.133+0000 7f1ef9000700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4108f20 0x7f1ef419b3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000b500 tx=0x7f1ee000b8c0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 shutdown_connections 2024-05-14T09:31:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f1ed80b2900 0x7f1ed80b4e10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ef4109870 0x7f1ef419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ef41045f0 0x7f1ef419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 --2- 172.21.15.120:0/3334703737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ef4108f20 0x7f1ef419b3d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 >> 172.21.15.120:0/3334703737 conn(0x7f1ef4100040 msgr2=0x7f1ef410a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 shutdown_connections 2024-05-14T09:31:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:31:01.134+0000 7f1ef9000700 1 -- 172.21.15.120:0/3334703737 wait complete. 2024-05-14T09:31:01.974 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 4045307680, 'ino': 1099511629246, 'path': '/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_subtrans/0001'}] 2024-05-14T09:31:01.975 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-05-14T09:31:02.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:02 smithi120 ceph-mon[31085]: pgmap v780: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 651 op/s 2024-05-14T09:31:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:02 smithi152 ceph-mon[34868]: pgmap v780: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 651 op/s 2024-05-14T09:31:02.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:02 smithi175 ceph-mon[35353]: pgmap v780: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 651 op/s 2024-05-14T09:31:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 210.0 s, 593.8 tps, lat 168.351 ms stddev 243.025 2024-05-14T09:31:04.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:04 smithi120 ceph-mon[31085]: pgmap v781: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 606 op/s 2024-05-14T09:31:04.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:04 smithi152 ceph-mon[34868]: pgmap v781: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 606 op/s 2024-05-14T09:31:04.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:04 smithi175 ceph-mon[35353]: pgmap v781: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 606 op/s 2024-05-14T09:31:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:06 smithi120 ceph-mon[31085]: pgmap v782: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.4 MiB/s wr, 629 op/s 2024-05-14T09:31:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:06 smithi152 ceph-mon[34868]: pgmap v782: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.4 MiB/s wr, 629 op/s 2024-05-14T09:31:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:06 smithi175 ceph-mon[35353]: pgmap v782: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.4 MiB/s wr, 629 op/s 2024-05-14T09:31:08.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:08 smithi120 ceph-mon[31085]: pgmap v783: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 651 op/s 2024-05-14T09:31:08.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:08 smithi152 ceph-mon[34868]: pgmap v783: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 651 op/s 2024-05-14T09:31:08.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:08 smithi175 ceph-mon[35353]: pgmap v783: 129 pgs: 129 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 651 op/s 2024-05-14T09:31:09.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 215.0 s, 625.6 tps, lat 151.681 ms stddev 40.557 2024-05-14T09:31:10.383 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:10 smithi120 ceph-mon[31085]: pgmap v784: 129 pgs: 129 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 670 op/s 2024-05-14T09:31:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:10 smithi152 ceph-mon[34868]: pgmap v784: 129 pgs: 129 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 670 op/s 2024-05-14T09:31:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:10 smithi175 ceph-mon[35353]: pgmap v784: 129 pgs: 129 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 670 op/s 2024-05-14T09:31:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.648+0000 7f1357200640 1 -- 172.21.15.120:0/1883469967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358106ec0 msgr2=0x7f13581092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.648+0000 7f1357200640 1 --2- 172.21.15.120:0/1883469967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358106ec0 0x7f13581092e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1344009860 tx=0x7f134402a340 comp rx=0 tx=0).stop 2024-05-14T09:31:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.649+0000 7f1357200640 1 -- 172.21.15.120:0/1883469967 shutdown_connections 2024-05-14T09:31:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.649+0000 7f1357200640 1 --2- 172.21.15.120:0/1883469967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1358109820 0x7f135810bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.649+0000 7f1357200640 1 --2- 172.21.15.120:0/1883469967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358106ec0 0x7f13581092e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.649+0000 7f1357200640 1 --2- 172.21.15.120:0/1883469967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1358104560 0x7f1358106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.649+0000 7f1357200640 1 -- 172.21.15.120:0/1883469967 >> 172.21.15.120:0/1883469967 conn(0x7f13580fdb60 msgr2=0x7f1358100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.649+0000 7f1357200640 1 -- 172.21.15.120:0/1883469967 shutdown_connections 2024-05-14T09:31:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.650+0000 7f1357200640 1 -- 172.21.15.120:0/1883469967 wait complete. 2024-05-14T09:31:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.651+0000 7f1357200640 1 Processor -- start 2024-05-14T09:31:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.652+0000 7f1357200640 1 -- start start 2024-05-14T09:31:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.652+0000 7f1357200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1358104560 0x7f13581039b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.652+0000 7f1357200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1358106ec0 0x7f1358102050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.652+0000 7f1357200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358109820 0x7f1358102590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.653+0000 7f1356800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358109820 0x7f1358102590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.653+0000 7f1357200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f135810f450 con 0x7f1358104560 2024-05-14T09:31:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.653+0000 7f1357200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f135810f2d0 con 0x7f1358109820 2024-05-14T09:31:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.653+0000 7f1357200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f135810f5d0 con 0x7f1358106ec0 2024-05-14T09:31:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.653+0000 7f1356800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358109820 0x7f1358102590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56912/0 (socket says 172.21.15.120:56912) 2024-05-14T09:31:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.653+0000 7f1356800640 1 -- 172.21.15.120:0/3610411983 learned_addr learned my addr 172.21.15.120:0/3610411983 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.653+0000 7f1355400640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1358106ec0 0x7f1358102050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1355e00640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1358104560 0x7f13581039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1356800640 1 -- 172.21.15.120:0/3610411983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1358106ec0 msgr2=0x7f1358102050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1356800640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1358106ec0 0x7f1358102050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1356800640 1 -- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1358104560 msgr2=0x7f13581039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1356800640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1358104560 0x7f13581039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1356800640 1 -- 172.21.15.120:0/3610411983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1358102cc0 con 0x7f1358109820 2024-05-14T09:31:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1355400640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1358106ec0 0x7f1358102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:31:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.654+0000 7f1355e00640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1358104560 0x7f13581039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:31:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.655+0000 7f1356800640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358109820 0x7f1358102590 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f135000eb40 tx=0x7f135000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.655+0000 7f134ea00640 1 -- 172.21.15.120:0/3610411983 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350004b20 con 0x7f1358109820 2024-05-14T09:31:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.655+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1358073910 con 0x7f1358109820 2024-05-14T09:31:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.656+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1358073e60 con 0x7f1358109820 2024-05-14T09:31:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.656+0000 7f134ea00640 1 -- 172.21.15.120:0/3610411983 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1350004cc0 con 0x7f1358109820 2024-05-14T09:31:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.656+0000 7f134ea00640 1 -- 172.21.15.120:0/3610411983 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350010690 con 0x7f1358109820 2024-05-14T09:31:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.660+0000 7f1363c17740 1 Processor -- start 2024-05-14T09:31:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.664+0000 7f134ea00640 1 -- 172.21.15.120:0/3610411983 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1350005020 con 0x7f1358109820 2024-05-14T09:31:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.664+0000 7f1363c17740 1 -- start start 2024-05-14T09:31:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.665+0000 7f1363c17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7e94300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.665+0000 7f1363c17740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ac92f0 0x560dd7e94880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.665+0000 7f1363c17740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.666+0000 7f1363c17740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560dd7df8550 con 0x560dd7ad14d0 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.666+0000 7f1355e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ac92f0 0x560dd7e94880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.666+0000 7f1363c17740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dd7d9dbc0 con 0x560dd7ac92f0 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.666+0000 7f1355e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ac92f0 0x560dd7e94880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56914/0 (socket says 172.21.15.120:56914) 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.666+0000 7f1355e00640 1 -- 172.21.15.120:0/1349818851 learned_addr learned my addr 172.21.15.120:0/1349818851 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.666+0000 7f1363c17740 1 -- 172.21.15.120:0/1349818851 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560dd7df4510 con 0x560dd7af21b0 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f134ea00640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f133c0b2860 0x7f133c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.666+0000 7f1355400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7e94300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f1355400640 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f134ea00640 1 -- 172.21.15.120:0/3610411983 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f13500e2e60 con 0x7f1358109820 2024-05-14T09:31:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f1355e00640 1 -- 172.21.15.120:0/1349818851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 msgr2=0x560dd7e94300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f1355e00640 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7e94300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f1355e00640 1 -- 172.21.15.120:0/1349818851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 msgr2=0x560dd7e9b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f1355e00640 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.667+0000 7f1355e00640 1 -- 172.21.15.120:0/1349818851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd7b0a210 con 0x560dd7ac92f0 2024-05-14T09:31:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.668+0000 7f1356800640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f133c0b2860 0x7f133c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.668+0000 7f1355400640 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7e94300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:31:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.669+0000 7f1356800640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f133c0b2860 0x7f133c0b4d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f13500aa010 tx=0x7f1350004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.669+0000 7f1355e00640 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ac92f0 0x560dd7e94880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1348009bf0 tx=0x7f1348010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df07a98963fc988 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.670+0000 7f1343000640 1 -- 172.21.15.120:0/1349818851 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348004030 con 0x560dd7ac92f0 2024-05-14T09:31:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.670+0000 7f1343000640 1 -- 172.21.15.120:0/1349818851 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1348003610 con 0x560dd7ac92f0 2024-05-14T09:31:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.670+0000 7f1343000640 1 -- 172.21.15.120:0/1349818851 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480126b0 con 0x560dd7ac92f0 2024-05-14T09:31:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 -- 172.21.15.120:0/1349818851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ac92f0 msgr2=0x560dd7e94880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ac92f0 0x560dd7e94880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1348009bf0 tx=0x7f1348010740 comp rx=0 tx=0).stop 2024-05-14T09:31:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 -- 172.21.15.120:0/1349818851 shutdown_connections 2024-05-14T09:31:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ac92f0 0x560dd7e94880 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 --2- 172.21.15.120:0/1349818851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7e94300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 -- 172.21.15.120:0/1349818851 >> 172.21.15.120:0/1349818851 conn(0x560dd7ae6300 msgr2=0x560dd7e8fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.671+0000 7f1363c17740 1 -- 172.21.15.120:0/1349818851 shutdown_connections 2024-05-14T09:31:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.672+0000 7f1363c17740 1 -- 172.21.15.120:0/1349818851 wait complete. 2024-05-14T09:31:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.672+0000 7f1363c17740 1 -- start start 2024-05-14T09:31:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.672+0000 7f1363c17740 1 Processor -- start 2024-05-14T09:31:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.673+0000 7f1363c17740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ac92f0 0x560dd7e9de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.673+0000 7f1363c17740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.673+0000 7f1363c17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.673+0000 7f1363c17740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560dd7e9c1d0 con 0x560dd7ac92f0 2024-05-14T09:31:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.673+0000 7f1363c17740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dd7db1660 con 0x560dd7ad14d0 2024-05-14T09:31:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.673+0000 7f1363c17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560dd7e9c350 con 0x560dd7af21b0 2024-05-14T09:31:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.673+0000 7f1363c17740 10 client.0 _ll_register_callbacks cb 0x560dd7d7b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.674+0000 7f1355e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.674+0000 7f1355e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56930/0 (socket says 172.21.15.120:56930) 2024-05-14T09:31:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.674+0000 7f1355e00640 1 -- 172.21.15.120:0/2654955596 learned_addr learned my addr 172.21.15.120:0/2654955596 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.674+0000 7f1355400640 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ac92f0 0x560dd7e9de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.675+0000 7f1355400640 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.675+0000 7f1355400640 1 -- 172.21.15.120:0/2654955596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 msgr2=0x560dd7ea52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.675+0000 7f1355400640 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.675+0000 7f1355400640 1 -- 172.21.15.120:0/2654955596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 msgr2=0x560dd7e9e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.675+0000 7f1355400640 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.675+0000 7f1355400640 1 -- 172.21.15.120:0/2654955596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd7bd6620 con 0x560dd7ac92f0 2024-05-14T09:31:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.676+0000 7f1355400640 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ac92f0 0x560dd7e9de30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1344035040 tx=0x7f1344005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e8ebb27df432f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.676+0000 7f1337400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:31:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.676+0000 7f1337400640 1 -- 172.21.15.120:0/2654955596 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344049070 con 0x560dd7ac92f0 2024-05-14T09:31:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.676+0000 7f1337400640 1 -- 172.21.15.120:0/2654955596 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1344030550 con 0x560dd7ac92f0 2024-05-14T09:31:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.677+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1348003610 con 0x560dd7ac92f0 2024-05-14T09:31:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.677+0000 7f1337400640 1 -- 172.21.15.120:0/2654955596 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1344037030 con 0x560dd7ac92f0 2024-05-14T09:31:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.677+0000 7f1363c17740 10 client.16740 fetch_fsmap learned FSMap version 45 2024-05-14T09:31:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.678+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x560dd7ea8270 con 0x560dd7ac92f0 2024-05-14T09:31:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.678+0000 7f1337400640 1 -- 172.21.15.120:0/2654955596 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1348003610 con 0x560dd7ac92f0 2024-05-14T09:31:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.680+0000 7f1337400640 1 -- 172.21.15.120:0/2654955596 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f134404c020 con 0x560dd7ac92f0 2024-05-14T09:31:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.680+0000 7f1363c17740 10 client.16740 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:31:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.680+0000 7f1363c17740 10 client.16740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.680+0000 7f1363c17740 20 client.16740 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.680+0000 7f1363c17740 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7ab0d80 0x560dd7eab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.680+0000 7f1363c17740 4 client.16740 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:31:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.680+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dd7e06160 con 0x560dd7ab0d80 2024-05-14T09:31:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.682+0000 7f1355e00640 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7ab0d80 0x560dd7eab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.684+0000 7f1337400640 10 client.16740 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.684+0000 7f1355e00640 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7ab0d80 0x560dd7eab980 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ae96b6e1974b1d4 server_cookie=c6b7b60df347265f in_seq=0 out_seq=0 2024-05-14T09:31:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.686+0000 7f1337400640 1 -- 172.21.15.120:0/2654955596 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560dd7e06160 con 0x560dd7ab0d80 2024-05-14T09:31:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.686+0000 7f1337400640 10 client.16740 handle_command_reply: tid=0 2024-05-14T09:31:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.687+0000 7f1363c17740 1 client.16740 shutdown 2024-05-14T09:31:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ac92f0 msgr2=0x560dd7e9de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ac92f0 0x560dd7e9de30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1344035040 tx=0x7f1344005f90 comp rx=0 tx=0).stop 2024-05-14T09:31:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 shutdown_connections 2024-05-14T09:31:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7ab0d80 0x560dd7eab980 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 --2- 172.21.15.120:0/2654955596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ac92f0 0x560dd7e9de30 secure :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1344035040 tx=0x7f1344005f90 comp rx=0 tx=0).stop 2024-05-14T09:31:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 >> 172.21.15.120:0/2654955596 conn(0x560dd7ae6300 msgr2=0x560dd7e92ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.688+0000 7f1337400640 0 client.16740 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.689+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 shutdown_connections 2024-05-14T09:31:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.689+0000 7f1363c17740 1 -- 172.21.15.120:0/2654955596 wait complete. 2024-05-14T09:31:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.689+0000 7f1363c17740 20 client.16740 trim_cache size 0 max 16384 2024-05-14T09:31:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.723+0000 7f1363c17740 1 Processor -- start 2024-05-14T09:31:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.723+0000 7f1363c17740 1 -- start start 2024-05-14T09:31:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1363c17740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1363c17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1363c17740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7a861c0 0x560dd7e8e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1363c17740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f133800fb20 con 0x560dd7ad14d0 2024-05-14T09:31:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1363c17740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f13380116f0 con 0x560dd7a861c0 2024-05-14T09:31:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1363c17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13380101f0 con 0x560dd7af21b0 2024-05-14T09:31:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1355400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1355400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51412/0 (socket says 172.21.15.120:51412) 2024-05-14T09:31:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.724+0000 7f1355400640 1 -- 172.21.15.120:0/2662555927 learned_addr learned my addr 172.21.15.120:0/2662555927 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.725+0000 7f1355e00640 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.725+0000 7f1355400640 1 -- 172.21.15.120:0/2662555927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 msgr2=0x560dd7ea5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.725+0000 7f1355400640 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.725+0000 7f1355400640 1 -- 172.21.15.120:0/2662555927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7a861c0 msgr2=0x560dd7e8e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.725+0000 7f1355400640 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7a861c0 0x560dd7e8e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.725+0000 7f1355400640 1 -- 172.21.15.120:0/2662555927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd7e8b4a0 con 0x560dd7ad14d0 2024-05-14T09:31:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.725+0000 7f1355400640 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e110 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1344005d00 tx=0x7f13440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee79e455cf17c99d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.726+0000 7f1342600640 1 -- 172.21.15.120:0/2662555927 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344049070 con 0x560dd7ad14d0 2024-05-14T09:31:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.726+0000 7f1342600640 1 -- 172.21.15.120:0/2662555927 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1344030550 con 0x560dd7ad14d0 2024-05-14T09:31:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.726+0000 7f1342600640 1 -- 172.21.15.120:0/2662555927 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13440307b0 con 0x560dd7ad14d0 2024-05-14T09:31:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.728+0000 7f1363c17740 1 -- 172.21.15.120:0/2662555927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 msgr2=0x560dd7e9e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.728+0000 7f1363c17740 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e110 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1344005d00 tx=0x7f13440057f0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 -- 172.21.15.120:0/2662555927 shutdown_connections 2024-05-14T09:31:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7a861c0 0x560dd7e8e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 --2- 172.21.15.120:0/2662555927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7ad14d0 0x560dd7e9e110 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 -- 172.21.15.120:0/2662555927 >> 172.21.15.120:0/2662555927 conn(0x560dd7ae6300 msgr2=0x560dd7e9da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 -- 172.21.15.120:0/2662555927 shutdown_connections 2024-05-14T09:31:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 -- 172.21.15.120:0/2662555927 wait complete. 2024-05-14T09:31:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.729+0000 7f1363c17740 1 -- start start 2024-05-14T09:31:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.730+0000 7f1363c17740 1 Processor -- start 2024-05-14T09:31:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.731+0000 7f1363c17740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7a861c0 0x560dd7ea2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.731+0000 7f1363c17740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7ea2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.731+0000 7f1363c17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.731+0000 7f1363c17740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1338010fc0 con 0x560dd7a861c0 2024-05-14T09:31:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.731+0000 7f1363c17740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f13380108f0 con 0x560dd7ad14d0 2024-05-14T09:31:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.731+0000 7f1363c17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f133800dbb0 con 0x560dd7af21b0 2024-05-14T09:31:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.731+0000 7f1363c17740 10 client.0 _ll_register_callbacks cb 0x7f1344035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.732+0000 7f1355400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7a861c0 0x560dd7ea2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.732+0000 7f1355e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7ea2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.732+0000 7f1355400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7a861c0 0x560dd7ea2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51420/0 (socket says 172.21.15.120:51420) 2024-05-14T09:31:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.732+0000 7f1355400640 1 -- 172.21.15.120:0/1083740218 learned_addr learned my addr 172.21.15.120:0/1083740218 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.733+0000 7f1355400640 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.733+0000 7f1355400640 1 -- 172.21.15.120:0/1083740218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 msgr2=0x560dd7ea3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.733+0000 7f1355400640 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.733+0000 7f1355400640 1 -- 172.21.15.120:0/1083740218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 msgr2=0x560dd7ea2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.733+0000 7f1355400640 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7ea2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.733+0000 7f1355400640 1 -- 172.21.15.120:0/1083740218 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd7ea4180 con 0x560dd7a861c0 2024-05-14T09:31:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.734+0000 7f1355400640 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7a861c0 0x560dd7ea2750 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f13440041e0 tx=0x7f1344000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44003fd9c8f49fb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.734+0000 7f1337400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:31:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.735+0000 7f1337400640 1 -- 172.21.15.120:0/1083740218 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344049040 con 0x560dd7a861c0 2024-05-14T09:31:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.735+0000 7f1337400640 1 -- 172.21.15.120:0/1083740218 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1344005320 con 0x560dd7a861c0 2024-05-14T09:31:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.735+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1344030550 con 0x560dd7a861c0 2024-05-14T09:31:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.736+0000 7f1337400640 1 -- 172.21.15.120:0/1083740218 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1344005520 con 0x560dd7a861c0 2024-05-14T09:31:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.736+0000 7f1363c17740 10 client.16746 fetch_fsmap learned FSMap version 45 2024-05-14T09:31:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.736+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x560dd7ea5410 con 0x560dd7a861c0 2024-05-14T09:31:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.737+0000 7f1337400640 1 -- 172.21.15.120:0/1083740218 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1344030550 con 0x560dd7a861c0 2024-05-14T09:31:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.737+0000 7f1337400640 1 -- 172.21.15.120:0/1083740218 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 45) ==== 8374+0+0 (secure 0 0 0) 0x7f1344056030 con 0x560dd7a861c0 2024-05-14T09:31:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.738+0000 7f1363c17740 10 client.16746 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T09:31:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.738+0000 7f1363c17740 10 client.16746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.738+0000 7f1363c17740 20 client.16746 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.738+0000 7f1363c17740 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7f1caa0 0x560dd7f1eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.738+0000 7f1363c17740 4 client.16746 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:31:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.738+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560dd7dfffd0 con 0x560dd7f1caa0 2024-05-14T09:31:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.740+0000 7f1355e00640 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7f1caa0 0x560dd7f1eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.741+0000 7f1355e00640 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7f1caa0 0x560dd7f1eec0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1ea33cc4637624d server_cookie=fdca09a0bf580200 in_seq=0 out_seq=0 2024-05-14T09:31:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.741+0000 7f1337400640 10 client.16746 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.782+0000 7f1337400640 1 -- 172.21.15.120:0/1083740218 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560dd7dfffd0 con 0x560dd7f1caa0 2024-05-14T09:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.782+0000 7f1337400640 10 client.16746 handle_command_reply: tid=0 2024-05-14T09:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 client.16746 shutdown 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7a861c0 msgr2=0x560dd7ea2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7a861c0 0x560dd7ea2750 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f13440041e0 tx=0x7f1344000bc0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 shutdown_connections 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560dd7f1caa0 0x560dd7f1eec0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560dd7af21b0 0x560dd7ea3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dd7ad14d0 0x560dd7ea2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 --2- 172.21.15.120:0/1083740218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560dd7a861c0 0x560dd7ea2750 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1337400640 0 client.16746 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.783+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 >> 172.21.15.120:0/1083740218 conn(0x560dd7ae6300 msgr2=0x560dd7e92a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.784+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 shutdown_connections 2024-05-14T09:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.784+0000 7f1363c17740 1 -- 172.21.15.120:0/1083740218 wait complete. 2024-05-14T09:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.784+0000 7f1363c17740 20 client.16746 trim_cache size 0 max 16384 2024-05-14T09:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:31:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:31:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f133c0b2860 msgr2=0x7f133c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f133c0b2860 0x7f133c0b4d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f13500aa010 tx=0x7f1350004a40 comp rx=0 tx=0).stop 2024-05-14T09:31:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358109820 msgr2=0x7f1358102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358109820 0x7f1358102590 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f135000eb40 tx=0x7f135000c2d0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 shutdown_connections 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f133c0b2860 0x7f133c0b4d70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1358109820 0x7f1358102590 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1358106ec0 0x7f1358102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 --2- 172.21.15.120:0/3610411983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1358104560 0x7f13581039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 >> 172.21.15.120:0/3610411983 conn(0x7f13580fdb60 msgr2=0x7f1358105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.787+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 shutdown_connections 2024-05-14T09:31:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:10.788+0000 7f1357200640 1 -- 172.21.15.120:0/3610411983 wait complete. 2024-05-14T09:31:11.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:11 smithi175 ceph-mon[35353]: pgmap v785: 129 pgs: 129 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-05-14T09:31:11.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:11 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:11 smithi120 ceph-mon[31085]: pgmap v785: 129 pgs: 129 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-05-14T09:31:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:11 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:11.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:11 smithi152 ceph-mon[34868]: pgmap v785: 129 pgs: 129 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-05-14T09:31:11.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:11 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:13 smithi120 ceph-mon[31085]: pgmap v786: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 658 op/s 2024-05-14T09:31:14.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:13 smithi152 ceph-mon[34868]: pgmap v786: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 658 op/s 2024-05-14T09:31:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:13 smithi175 ceph-mon[35353]: pgmap v786: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 658 op/s 2024-05-14T09:31:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 220.0 s, 633.0 tps, lat 165.722 ms stddev 234.014 2024-05-14T09:31:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:15 smithi120 ceph-mon[31085]: pgmap v787: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.5 MiB/s wr, 691 op/s 2024-05-14T09:31:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:15 smithi152 ceph-mon[34868]: pgmap v787: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.5 MiB/s wr, 691 op/s 2024-05-14T09:31:16.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:15 smithi175 ceph-mon[35353]: pgmap v787: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.5 MiB/s wr, 691 op/s 2024-05-14T09:31:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:17 smithi120 ceph-mon[31085]: pgmap v788: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.5 MiB/s wr, 661 op/s 2024-05-14T09:31:18.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:17 smithi152 ceph-mon[34868]: pgmap v788: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.5 MiB/s wr, 661 op/s 2024-05-14T09:31:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:17 smithi175 ceph-mon[35353]: pgmap v788: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.5 MiB/s wr, 661 op/s 2024-05-14T09:31:19.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:18 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:19.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:18 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:19.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:18 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 225.0 s, 654.4 tps, lat 153.283 ms stddev 44.023 2024-05-14T09:31:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:19 smithi120 ceph-mon[31085]: pgmap v789: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.2 MiB/s wr, 721 op/s 2024-05-14T09:31:20.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:19 smithi152 ceph-mon[34868]: pgmap v789: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.2 MiB/s wr, 721 op/s 2024-05-14T09:31:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:19 smithi175 ceph-mon[35353]: pgmap v789: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.2 MiB/s wr, 721 op/s 2024-05-14T09:31:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:21 smithi120 ceph-mon[31085]: pgmap v790: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.4 MiB/s wr, 708 op/s 2024-05-14T09:31:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:21 smithi152 ceph-mon[34868]: pgmap v790: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.4 MiB/s wr, 708 op/s 2024-05-14T09:31:22.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:21 smithi175 ceph-mon[35353]: pgmap v790: 129 pgs: 129 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.4 MiB/s wr, 708 op/s 2024-05-14T09:31:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.105+0000 7f851cc00640 1 -- 172.21.15.120:0/4184056595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a6930 msgr2=0x7f85100a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.105+0000 7f851cc00640 1 --2- 172.21.15.120:0/4184056595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a6930 0x7f85100a6d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f850c009930 tx=0x7f850c02a480 comp rx=0 tx=0).stop 2024-05-14T09:31:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.106+0000 7f851cc00640 1 -- 172.21.15.120:0/4184056595 shutdown_connections 2024-05-14T09:31:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.106+0000 7f851cc00640 1 --2- 172.21.15.120:0/4184056595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a7280 0x7f85100aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.106+0000 7f851cc00640 1 --2- 172.21.15.120:0/4184056595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a6930 0x7f85100a6d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.106+0000 7f851cc00640 1 --2- 172.21.15.120:0/4184056595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85100a5810 0x7f85100a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.106+0000 7f851cc00640 1 -- 172.21.15.120:0/4184056595 >> 172.21.15.120:0/4184056595 conn(0x7f85100a0e00 msgr2=0x7f85100a32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.106+0000 7f851cc00640 1 -- 172.21.15.120:0/4184056595 shutdown_connections 2024-05-14T09:31:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.107+0000 7f851cc00640 1 -- 172.21.15.120:0/4184056595 wait complete. 2024-05-14T09:31:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.110+0000 7f851cc00640 1 Processor -- start 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.112+0000 7f851cc00640 1 -- start start 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.112+0000 7f851cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a5810 0x7f85100ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.112+0000 7f851cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a6930 0x7f85100ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.112+0000 7f851cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85100a7280 0x7f85100a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.112+0000 7f851cc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f85100b34e0 con 0x7f85100a7280 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.112+0000 7f851cc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85100b3360 con 0x7f85100a6930 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.112+0000 7f851cc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85100b3660 con 0x7f85100a5810 2024-05-14T09:31:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.113+0000 7f8516a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a6930 0x7f85100ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.113+0000 7f8517e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85100a7280 0x7f85100a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.113+0000 7f8516a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a6930 0x7f85100ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42758/0 (socket says 172.21.15.120:42758) 2024-05-14T09:31:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.113+0000 7f8516a00640 1 -- 172.21.15.120:0/2749665306 learned_addr learned my addr 172.21.15.120:0/2749665306 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8517400640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a5810 0x7f85100ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8516a00640 1 -- 172.21.15.120:0/2749665306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a5810 msgr2=0x7f85100ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8516a00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a5810 0x7f85100ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8516a00640 1 -- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85100a7280 msgr2=0x7f85100a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8516a00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85100a7280 0x7f85100a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8516a00640 1 -- 172.21.15.120:0/2749665306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85100a9800 con 0x7f85100a6930 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8517e00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85100a7280 0x7f85100a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.114+0000 7f8517400640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a5810 0x7f85100ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:31:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.115+0000 7f8516a00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a6930 0x7f85100ac9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f850c02a9a0 tx=0x7f850c005320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.116+0000 7f850be00640 1 -- 172.21.15.120:0/2749665306 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c03f070 con 0x7f85100a6930 2024-05-14T09:31:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.116+0000 7f850be00640 1 -- 172.21.15.120:0/2749665306 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f850c003c80 con 0x7f85100a6930 2024-05-14T09:31:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.116+0000 7f850be00640 1 -- 172.21.15.120:0/2749665306 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c035030 con 0x7f85100a6930 2024-05-14T09:31:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.117+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85100a9a90 con 0x7f85100a6930 2024-05-14T09:31:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.117+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85101401b0 con 0x7f85100a6930 2024-05-14T09:31:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.121+0000 7f85251d4740 1 Processor -- start 2024-05-14T09:31:24.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.121+0000 7f85251d4740 1 -- start start 2024-05-14T09:31:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.123+0000 7f85251d4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef38d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.123+0000 7f85251d4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefc22f0 0x55bfef38d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.124+0000 7f850be00640 1 -- 172.21.15.120:0/2749665306 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f850c042070 con 0x7f85100a6930 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.124+0000 7f85251d4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefca4d0 0x55bfef394770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.124+0000 7f85251d4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bfef2f1550 con 0x55bfeefca4d0 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.124+0000 7f85251d4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bfef296bc0 con 0x55bfeefeb1b0 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.124+0000 7f85251d4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bfef2ed510 con 0x55bfeefc22f0 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.124+0000 7f8516a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefca4d0 0x55bfef394770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.124+0000 7f8517e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef38d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.125+0000 7f8516a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefca4d0 0x55bfef394770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43616/0 (socket says 172.21.15.120:43616) 2024-05-14T09:31:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.125+0000 7f8516a00640 1 -- 172.21.15.120:0/396574173 learned_addr learned my addr 172.21.15.120:0/396574173 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.126+0000 7f8517e00640 1 -- 172.21.15.120:0/396574173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefc22f0 msgr2=0x55bfef38d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.126+0000 7f8517400640 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefc22f0 0x55bfef38d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.127+0000 7f8517e00640 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefc22f0 0x55bfef38d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.127+0000 7f8517e00640 1 -- 172.21.15.120:0/396574173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefca4d0 msgr2=0x55bfef394770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.127+0000 7f8517e00640 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefca4d0 0x55bfef394770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.127+0000 7f8517e00640 1 -- 172.21.15.120:0/396574173 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfef003210 con 0x55bfeefeb1b0 2024-05-14T09:31:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.127+0000 7f8516a00640 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefca4d0 0x55bfef394770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:31:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.128+0000 7f8517e00640 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef38d2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8518052170 tx=0x7f851806cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=120f67fa1aa95071 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.128+0000 7f84ffe00640 1 -- 172.21.15.120:0/396574173 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518073920 con 0x55bfeefeb1b0 2024-05-14T09:31:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.129+0000 7f84ffe00640 1 -- 172.21.15.120:0/396574173 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8518079480 con 0x55bfeefeb1b0 2024-05-14T09:31:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f850be00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f85000b2940 0x7f85000b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f85251d4740 1 -- 172.21.15.120:0/396574173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 msgr2=0x55bfef38d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f85251d4740 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef38d2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8518052170 tx=0x7f851806cd80 comp rx=0 tx=0).stop 2024-05-14T09:31:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f850be00640 1 -- 172.21.15.120:0/2749665306 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f850c1031b0 con 0x7f85100a6930 2024-05-14T09:31:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f85251d4740 1 -- 172.21.15.120:0/396574173 shutdown_connections 2024-05-14T09:31:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f85251d4740 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefca4d0 0x55bfef394770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f85251d4740 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefc22f0 0x55bfef38d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f85251d4740 1 --2- 172.21.15.120:0/396574173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef38d2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.130+0000 7f85251d4740 1 -- 172.21.15.120:0/396574173 >> 172.21.15.120:0/396574173 conn(0x55bfeefdf300 msgr2=0x55bfef388c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.131+0000 7f8517400640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f85000b2940 0x7f85000b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.131+0000 7f85251d4740 1 -- 172.21.15.120:0/396574173 shutdown_connections 2024-05-14T09:31:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.132+0000 7f85251d4740 1 -- 172.21.15.120:0/396574173 wait complete. 2024-05-14T09:31:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.132+0000 7f8517400640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f85000b2940 0x7f85000b4e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55bfef389a10 tx=0x7f8504008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.133+0000 7f85251d4740 1 -- start start 2024-05-14T09:31:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:23 smithi120 ceph-mon[31085]: pgmap v791: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.9 MiB/s wr, 643 op/s 2024-05-14T09:31:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:23 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.134+0000 7f85251d4740 1 Processor -- start 2024-05-14T09:31:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.134+0000 7f85251d4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefc22f0 0x55bfef396df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.134+0000 7f85251d4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefca4d0 0x55bfef397330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.134+0000 7f85251d4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.134+0000 7f85251d4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bfef3951c0 con 0x55bfeefc22f0 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.134+0000 7f85251d4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bfef2aa660 con 0x55bfeefeb1b0 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.134+0000 7f85251d4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bfef395340 con 0x55bfeefca4d0 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.135+0000 7f85251d4740 10 client.0 _ll_register_callbacks cb 0x55bfef274400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.135+0000 7f8517400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefc22f0 0x55bfef396df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.135+0000 7f8517400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefc22f0 0x55bfef396df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43618/0 (socket says 172.21.15.120:43618) 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.135+0000 7f8517400640 1 -- 172.21.15.120:0/542633051 learned_addr learned my addr 172.21.15.120:0/542633051 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.135+0000 7f8517e00640 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.135+0000 7f8516a00640 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefca4d0 0x55bfef397330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.136+0000 7f8516a00640 1 -- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 msgr2=0x55bfef39e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.136+0000 7f8516a00640 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.136+0000 7f8516a00640 1 -- 172.21.15.120:0/542633051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefc22f0 msgr2=0x55bfef396df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.136+0000 7f8516a00640 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefc22f0 0x55bfef396df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.136+0000 7f8516a00640 1 -- 172.21.15.120:0/542633051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfef0cf620 con 0x55bfeefca4d0 2024-05-14T09:31:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.136+0000 7f8516a00640 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefca4d0 0x55bfef397330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f850c0c76a0 tx=0x7f850c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51cceca40255ade9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.136+0000 7f84fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:31:24.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.137+0000 7f84fcc00640 1 -- 172.21.15.120:0/542633051 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c049040 con 0x55bfeefca4d0 2024-05-14T09:31:24.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.137+0000 7f84fcc00640 1 -- 172.21.15.120:0/542633051 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f850c0ce440 con 0x55bfeefca4d0 2024-05-14T09:31:24.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.138+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8518079480 con 0x55bfeefca4d0 2024-05-14T09:31:24.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.139+0000 7f84fcc00640 1 -- 172.21.15.120:0/542633051 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f850c0ca200 con 0x55bfeefca4d0 2024-05-14T09:31:24.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.140+0000 7f85251d4740 10 client.26275 fetch_fsmap learned FSMap version 48 2024-05-14T09:31:24.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.140+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55bfef3952e0 con 0x55bfeefca4d0 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f84fcc00640 1 -- 172.21.15.120:0/542633051 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8518079480 con 0x55bfeefca4d0 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f84fcc00640 1 -- 172.21.15.120:0/542633051 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f850c031500 con 0x55bfeefca4d0 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f85251d4740 10 client.26275 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f85251d4740 10 client.26275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f85251d4740 20 client.26275 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f85251d4740 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfeefa9d80 0x55bfef3a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f85251d4740 4 client.26275 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:31:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.141+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfef2ff160 con 0x55bfeefa9d80 2024-05-14T09:31:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.142+0000 7f8517400640 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfeefa9d80 0x55bfef3a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.143+0000 7f8517400640 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfeefa9d80 0x55bfef3a49a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce7311ba8f58f3aa server_cookie=348740eee553cb44 in_seq=0 out_seq=0 2024-05-14T09:31:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.143+0000 7f84fcc00640 10 client.26275 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.146+0000 7f84fcc00640 1 -- 172.21.15.120:0/542633051 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bfef2ff160 con 0x55bfeefa9d80 2024-05-14T09:31:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.146+0000 7f84fcc00640 10 client.26275 handle_command_reply: tid=0 2024-05-14T09:31:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.146+0000 7f85251d4740 1 client.26275 shutdown 2024-05-14T09:31:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefca4d0 msgr2=0x55bfef397330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefca4d0 0x55bfef397330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f850c0c76a0 tx=0x7f850c009260 comp rx=0 tx=0).stop 2024-05-14T09:31:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 shutdown_connections 2024-05-14T09:31:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfeefa9d80 0x55bfef3a49a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefca4d0 0x55bfef397330 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f850c0c76a0 tx=0x7f850c009260 comp rx=0 tx=0).stop 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 --2- 172.21.15.120:0/542633051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeefc22f0 0x55bfef396df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 >> 172.21.15.120:0/542633051 conn(0x55bfeefdf300 msgr2=0x55bfef387c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f84fcc00640 0 client.26275 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 shutdown_connections 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.147+0000 7f85251d4740 1 -- 172.21.15.120:0/542633051 wait complete. 2024-05-14T09:31:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.148+0000 7f85251d4740 20 client.26275 trim_cache size 0 max 16384 2024-05-14T09:31:24.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.178+0000 7f85251d4740 1 Processor -- start 2024-05-14T09:31:24.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.178+0000 7f85251d4740 1 -- start start 2024-05-14T09:31:24.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.179+0000 7f85251d4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef3a9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.179+0000 7f85251d4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.179+0000 7f85251d4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.179+0000 7f85251d4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f851015f7e0 con 0x55bfeef7f1c0 2024-05-14T09:31:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.179+0000 7f85251d4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85101613e0 con 0x55bfeefc22f0 2024-05-14T09:31:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.179+0000 7f85251d4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f851015ff10 con 0x55bfeefeb1b0 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43622/0 (socket says 172.21.15.120:43622) 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 -- 172.21.15.120:0/3867396792 learned_addr learned my addr 172.21.15.120:0/3867396792 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8516a00640 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517400640 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef3a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 -- 172.21.15.120:0/3867396792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 msgr2=0x55bfef39e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 -- 172.21.15.120:0/3867396792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 msgr2=0x55bfef3a9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef3a9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.180+0000 7f8517e00640 1 -- 172.21.15.120:0/3867396792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfef384470 con 0x55bfeef7f1c0 2024-05-14T09:31:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.181+0000 7f8517e00640 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39e790 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8518051ae0 tx=0x7f8518068f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42b5dcec58dd76e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.181+0000 7f84ff400640 1 -- 172.21.15.120:0/3867396792 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518074c20 con 0x55bfeef7f1c0 2024-05-14T09:31:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.182+0000 7f84ff400640 1 -- 172.21.15.120:0/3867396792 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8518074dc0 con 0x55bfeef7f1c0 2024-05-14T09:31:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.182+0000 7f84ff400640 1 -- 172.21.15.120:0/3867396792 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518079850 con 0x55bfeef7f1c0 2024-05-14T09:31:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.183+0000 7f85251d4740 1 -- 172.21.15.120:0/3867396792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 msgr2=0x55bfef39e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.183+0000 7f85251d4740 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39e790 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8518051ae0 tx=0x7f8518068f90 comp rx=0 tx=0).stop 2024-05-14T09:31:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.183+0000 7f85251d4740 1 -- 172.21.15.120:0/3867396792 shutdown_connections 2024-05-14T09:31:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.183+0000 7f85251d4740 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39e790 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.183+0000 7f85251d4740 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef39e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.183+0000 7f85251d4740 1 --2- 172.21.15.120:0/3867396792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef3a9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.184+0000 7f85251d4740 1 -- 172.21.15.120:0/3867396792 >> 172.21.15.120:0/3867396792 conn(0x55bfeefdf300 msgr2=0x55bfef3911f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.184+0000 7f85251d4740 1 -- 172.21.15.120:0/3867396792 shutdown_connections 2024-05-14T09:31:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.184+0000 7f85251d4740 1 -- 172.21.15.120:0/3867396792 wait complete. 2024-05-14T09:31:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.185+0000 7f85251d4740 1 -- start start 2024-05-14T09:31:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.185+0000 7f85251d4740 1 Processor -- start 2024-05-14T09:31:24.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.186+0000 7f85251d4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.186+0000 7f85251d4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef39dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.186+0000 7f85251d4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef40ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.186+0000 7f85251d4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8510160cb0 con 0x55bfeef7f1c0 2024-05-14T09:31:24.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.186+0000 7f85251d4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85101605e0 con 0x55bfeefc22f0 2024-05-14T09:31:24.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.186+0000 7f85251d4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f851015d810 con 0x55bfeefeb1b0 2024-05-14T09:31:24.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.186+0000 7f85251d4740 10 client.0 _ll_register_callbacks cb 0x7f850c003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.187+0000 7f8517400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.187+0000 7f8517e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef40ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.187+0000 7f8517e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef40ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50278/0 (socket says 172.21.15.120:50278) 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.187+0000 7f8517e00640 1 -- 172.21.15.120:0/2164521859 learned_addr learned my addr 172.21.15.120:0/2164521859 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.187+0000 7f8516a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef39dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.187+0000 7f8517e00640 1 -- 172.21.15.120:0/2164521859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 msgr2=0x55bfef39dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.187+0000 7f8517e00640 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef39dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.188+0000 7f8517e00640 1 -- 172.21.15.120:0/2164521859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 msgr2=0x55bfef39da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.188+0000 7f8517e00640 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.188+0000 7f8517e00640 1 -- 172.21.15.120:0/2164521859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfef40b3f0 con 0x55bfeefeb1b0 2024-05-14T09:31:24.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.189+0000 7f8517400640 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:31:24.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.189+0000 7f8517e00640 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef40ae00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8518065d90 tx=0x7f8518065e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d639d2e403a50e23 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.189+0000 7f84fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:31:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.190+0000 7f84fcc00640 1 -- 172.21.15.120:0/2164521859 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518092020 con 0x55bfeefeb1b0 2024-05-14T09:31:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.190+0000 7f84fcc00640 1 -- 172.21.15.120:0/2164521859 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8518073de0 con 0x55bfeefeb1b0 2024-05-14T09:31:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.191+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8518074dc0 con 0x55bfeefeb1b0 2024-05-14T09:31:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.191+0000 7f84fcc00640 1 -- 172.21.15.120:0/2164521859 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8518074c20 con 0x55bfeefeb1b0 2024-05-14T09:31:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.191+0000 7f85251d4740 10 client.26281 fetch_fsmap learned FSMap version 48 2024-05-14T09:31:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.191+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55bfef40c680 con 0x55bfeefeb1b0 2024-05-14T09:31:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.192+0000 7f84fcc00640 1 -- 172.21.15.120:0/2164521859 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8518074dc0 con 0x55bfeefeb1b0 2024-05-14T09:31:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.193+0000 7f84fcc00640 1 -- 172.21.15.120:0/2164521859 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f8518069b10 con 0x55bfeefeb1b0 2024-05-14T09:31:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.193+0000 7f85251d4740 10 client.26281 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T09:31:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.193+0000 7f85251d4740 10 client.26281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.193+0000 7f85251d4740 20 client.26281 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.193+0000 7f85251d4740 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfef40cdb0 0x55bfef40f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.193+0000 7f85251d4740 4 client.26281 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:31:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.193+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bfef2f8fd0 con 0x55bfef40cdb0 2024-05-14T09:31:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.194+0000 7f8517400640 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfef40cdb0 0x55bfef40f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.195+0000 7f8517400640 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfef40cdb0 0x55bfef40f1d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b59c1ecf6300bde server_cookie=f9881c6a47e68861 in_seq=0 out_seq=0 2024-05-14T09:31:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.195+0000 7f84fcc00640 10 client.26281 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:23 smithi152 ceph-mon[34868]: pgmap v791: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.9 MiB/s wr, 643 op/s 2024-05-14T09:31:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:23 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:24.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:23 smithi175 ceph-mon[35353]: pgmap v791: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.9 MiB/s wr, 643 op/s 2024-05-14T09:31:24.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:23 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.231+0000 7f84fcc00640 1 -- 172.21.15.120:0/2164521859 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bfef2f8fd0 con 0x55bfef40cdb0 2024-05-14T09:31:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.231+0000 7f84fcc00640 10 client.26281 handle_command_reply: tid=0 2024-05-14T09:31:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.231+0000 7f85251d4740 1 client.26281 shutdown 2024-05-14T09:31:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 msgr2=0x55bfef40ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef40ae00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8518065d90 tx=0x7f8518065e90 comp rx=0 tx=0).stop 2024-05-14T09:31:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 shutdown_connections 2024-05-14T09:31:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bfef40cdb0 0x55bfef40f1d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfeefeb1b0 0x55bfef40ae00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bfeefc22f0 0x55bfef39dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 --2- 172.21.15.120:0/2164521859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bfeef7f1c0 0x55bfef39da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.232+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 >> 172.21.15.120:0/2164521859 conn(0x55bfeefdf300 msgr2=0x55bfef38ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.233+0000 7f84fcc00640 0 client.26281 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.233+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 shutdown_connections 2024-05-14T09:31:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.233+0000 7f85251d4740 1 -- 172.21.15.120:0/2164521859 wait complete. 2024-05-14T09:31:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.234+0000 7f85251d4740 20 client.26281 trim_cache size 0 max 16384 2024-05-14T09:31:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:31:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:31:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:31:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:31:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.236+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f85000b2940 msgr2=0x7f85000b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.236+0000 7f851cc00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f85000b2940 0x7f85000b4e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55bfef389a10 tx=0x7f8504008040 comp rx=0 tx=0).stop 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.236+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a6930 msgr2=0x7f85100ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.236+0000 7f851cc00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a6930 0x7f85100ac9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f850c02a9a0 tx=0x7f850c005320 comp rx=0 tx=0).stop 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 shutdown_connections 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f85000b2940 0x7f85000b4e50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85100a7280 0x7f85100a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85100a6930 0x7f85100ac9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 --2- 172.21.15.120:0/2749665306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85100a5810 0x7f85100ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 >> 172.21.15.120:0/2749665306 conn(0x7f85100a0e00 msgr2=0x7f85100af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 shutdown_connections 2024-05-14T09:31:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:24.237+0000 7f851cc00640 1 -- 172.21.15.120:0/2749665306 wait complete. 2024-05-14T09:31:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 230.0 s, 650.5 tps, lat 152.262 ms stddev 55.714 2024-05-14T09:31:26.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:25 smithi120 ceph-mon[31085]: pgmap v792: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.0 MiB/s wr, 702 op/s 2024-05-14T09:31:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:25 smithi152 ceph-mon[34868]: pgmap v792: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.0 MiB/s wr, 702 op/s 2024-05-14T09:31:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:25 smithi175 ceph-mon[35353]: pgmap v792: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.0 MiB/s wr, 702 op/s 2024-05-14T09:31:28.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:27 smithi120 ceph-mon[31085]: pgmap v793: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.2 MiB/s wr, 705 op/s 2024-05-14T09:31:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:27 smithi152 ceph-mon[34868]: pgmap v793: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.2 MiB/s wr, 705 op/s 2024-05-14T09:31:28.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:27 smithi175 ceph-mon[35353]: pgmap v793: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.2 MiB/s wr, 705 op/s 2024-05-14T09:31:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 235.0 s, 712.8 tps, lat 140.351 ms stddev 48.836 2024-05-14T09:31:30.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:29 smithi120 ceph-mon[31085]: pgmap v794: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.5 MiB/s wr, 770 op/s 2024-05-14T09:31:30.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:29 smithi152 ceph-mon[34868]: pgmap v794: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.5 MiB/s wr, 770 op/s 2024-05-14T09:31:30.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:29 smithi175 ceph-mon[35353]: pgmap v794: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.5 MiB/s wr, 770 op/s 2024-05-14T09:31:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:31 smithi152 ceph-mon[34868]: pgmap v795: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.5 MiB/s wr, 741 op/s 2024-05-14T09:31:32.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:31 smithi175 ceph-mon[35353]: pgmap v795: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.5 MiB/s wr, 741 op/s 2024-05-14T09:31:32.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:31 smithi120 ceph-mon[31085]: pgmap v795: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.5 MiB/s wr, 741 op/s 2024-05-14T09:31:34.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:33 smithi152 ceph-mon[34868]: pgmap v796: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.2 MiB/s wr, 695 op/s 2024-05-14T09:31:34.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:33 smithi175 ceph-mon[35353]: pgmap v796: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.2 MiB/s wr, 695 op/s 2024-05-14T09:31:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 240.0 s, 679.6 tps, lat 147.600 ms stddev 39.957 2024-05-14T09:31:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:33 smithi120 ceph-mon[31085]: pgmap v796: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.2 MiB/s wr, 695 op/s 2024-05-14T09:31:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:35 smithi152 ceph-mon[34868]: pgmap v797: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 760 op/s 2024-05-14T09:31:36.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:35 smithi175 ceph-mon[35353]: pgmap v797: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 760 op/s 2024-05-14T09:31:36.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:35 smithi120 ceph-mon[31085]: pgmap v797: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 760 op/s 2024-05-14T09:31:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.604+0000 7ff1fc800640 1 -- 172.21.15.120:0/2006563348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4104ea0 msgr2=0x7ff1f41052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.604+0000 7ff1fc800640 1 --2- 172.21.15.120:0/2006563348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4104ea0 0x7ff1f41052b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009900 tx=0x7ff1e002a3f0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.604+0000 7ff1fc800640 1 -- 172.21.15.120:0/2006563348 shutdown_connections 2024-05-14T09:31:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.604+0000 7ff1fc800640 1 --2- 172.21.15.120:0/2006563348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1f4109ba0 0x7ff1f410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.604+0000 7ff1fc800640 1 --2- 172.21.15.120:0/2006563348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4104ea0 0x7ff1f41052b0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009900 tx=0x7ff1e002a3f0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.604+0000 7ff1fc800640 1 --2- 172.21.15.120:0/2006563348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 0x7ff1f4104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.604+0000 7ff1fc800640 1 -- 172.21.15.120:0/2006563348 >> 172.21.15.120:0/2006563348 conn(0x7ff1f40fee30 msgr2=0x7ff1f4101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.606+0000 7ff1fc800640 1 -- 172.21.15.120:0/2006563348 shutdown_connections 2024-05-14T09:31:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.606+0000 7ff1fc800640 1 -- 172.21.15.120:0/2006563348 wait complete. 2024-05-14T09:31:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.608+0000 7ff1fc800640 1 Processor -- start 2024-05-14T09:31:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.609+0000 7ff1fc800640 1 -- start start 2024-05-14T09:31:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.610+0000 7ff1fc800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 0x7ff1f4198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.610+0000 7ff1fc800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4109ba0 0x7ff1f4198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.610+0000 7ff1fc800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1f419d600 0x7ff1f419da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.610+0000 7ff1fc800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4076920 con 0x7ff1f419d600 2024-05-14T09:31:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.611+0000 7ff1fc800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f40767a0 con 0x7ff1f4103c60 2024-05-14T09:31:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.611+0000 7ff1fc800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4076aa0 con 0x7ff1f4109ba0 2024-05-14T09:31:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.611+0000 7ff1fa800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1f419d600 0x7ff1f419da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.611+0000 7ff1f9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 0x7ff1f4198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.611+0000 7ff1f9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 0x7ff1f4198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39310/0 (socket says 172.21.15.120:39310) 2024-05-14T09:31:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.611+0000 7ff1f9e00640 1 -- 172.21.15.120:0/1725435721 learned_addr learned my addr 172.21.15.120:0/1725435721 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.611+0000 7ff1f9400640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4109ba0 0x7ff1f4198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.612+0000 7ff1f9e00640 1 -- 172.21.15.120:0/1725435721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4109ba0 msgr2=0x7ff1f4198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.612+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4109ba0 0x7ff1f4198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.612+0000 7ff1f9e00640 1 -- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1f419d600 msgr2=0x7ff1f419da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.612+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1f419d600 0x7ff1f419da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.612+0000 7ff1f9e00640 1 -- 172.21.15.120:0/1725435721 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f419e0b0 con 0x7ff1f4103c60 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.612+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 0x7ff1f4198140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000ead0 tx=0x7ff1f000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.613+0000 7ff1eea00640 1 -- 172.21.15.120:0/1725435721 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000cde0 con 0x7ff1f4103c60 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.613+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f419e3a0 con 0x7ff1f4103c60 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.613+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f419e8f0 con 0x7ff1f4103c60 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.613+0000 7ff1eea00640 1 -- 172.21.15.120:0/1725435721 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1f0003e00 con 0x7ff1f4103c60 2024-05-14T09:31:37.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.613+0000 7ff1eea00640 1 -- 172.21.15.120:0/1725435721 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0004860 con 0x7ff1f4103c60 2024-05-14T09:31:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 Processor -- start 2024-05-14T09:31:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 -- start start 2024-05-14T09:31:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f136f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f136f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fac4d0 0x5634f1376580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634f12d3550 con 0x5634f0fac4d0 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5634f1278bc0 con 0x5634f0fa42f0 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.617+0000 7ff203773740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634f12cf510 con 0x5634f0fcd1b0 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.618+0000 7ff1fa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f136f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.618+0000 7ff1fa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f136f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:41770/0 (socket says 172.21.15.120:41770) 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.618+0000 7ff1fa800640 1 -- 172.21.15.120:0/2884747048 learned_addr learned my addr 172.21.15.120:0/2884747048 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.618+0000 7ff1f9400640 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fac4d0 0x5634f1376580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.619+0000 7ff1fa800640 1 -- 172.21.15.120:0/2884747048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 msgr2=0x5634f136f680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:31:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.619+0000 7ff1fa800640 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f136f680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.619+0000 7ff1fa800640 1 -- 172.21.15.120:0/2884747048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fac4d0 msgr2=0x5634f1376580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.619+0000 7ff1fa800640 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fac4d0 0x5634f1376580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.619+0000 7ff1fa800640 1 -- 172.21.15.120:0/2884747048 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f0fe5210 con 0x5634f0fcd1b0 2024-05-14T09:31:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.620+0000 7ff1fa800640 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f136f100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800cbe0 tx=0x7ff1e800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71bb8e395a004607 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.621+0000 7ff1e7000640 1 -- 172.21.15.120:0/2884747048 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8005220 con 0x5634f0fcd1b0 2024-05-14T09:31:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.621+0000 7ff1e7000640 1 -- 172.21.15.120:0/2884747048 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1e8004c30 con 0x5634f0fcd1b0 2024-05-14T09:31:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.621+0000 7ff1e7000640 1 -- 172.21.15.120:0/2884747048 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8010720 con 0x5634f0fcd1b0 2024-05-14T09:31:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.622+0000 7ff1eea00640 1 -- 172.21.15.120:0/1725435721 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff1f0004290 con 0x7ff1f4103c60 2024-05-14T09:31:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.622+0000 7ff203773740 1 -- 172.21.15.120:0/2884747048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 msgr2=0x5634f136f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.622+0000 7ff203773740 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f136f100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800cbe0 tx=0x7ff1e800e720 comp rx=0 tx=0).stop 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff203773740 1 -- 172.21.15.120:0/2884747048 shutdown_connections 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff203773740 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fac4d0 0x5634f1376580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff203773740 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f136f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff203773740 1 --2- 172.21.15.120:0/2884747048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f136f100 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff203773740 1 -- 172.21.15.120:0/2884747048 >> 172.21.15.120:0/2884747048 conn(0x5634f0fc1300 msgr2=0x5634f136aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff203773740 1 -- 172.21.15.120:0/2884747048 shutdown_connections 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff203773740 1 -- 172.21.15.120:0/2884747048 wait complete. 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff1eea00640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff1dc0b2770 0x7ff1dc0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.624+0000 7ff1eea00640 1 -- 172.21.15.120:0/1725435721 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff1f00e2db0 con 0x7ff1f4103c60 2024-05-14T09:31:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.625+0000 7ff203773740 1 -- start start 2024-05-14T09:31:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.625+0000 7ff1f9400640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff1dc0b2770 0x7ff1dc0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.625+0000 7ff203773740 1 Processor -- start 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff203773740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f1378ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff203773740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f13791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff203773740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fcd1b0 0x5634f1380140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff1f9400640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff1dc0b2770 0x7ff1dc0b4c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009230 tx=0x7ff1e0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff203773740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634f1376fd0 con 0x5634f0fa42f0 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff203773740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5634f128c660 con 0x5634f0fcd1b0 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff203773740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634f1377150 con 0x5634f0fac4d0 2024-05-14T09:31:37.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.626+0000 7ff203773740 10 client.0 _ll_register_callbacks cb 0x5634f1256400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:37.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.627+0000 7ff1f9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f13791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.627+0000 7ff1f9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f13791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:41776/0 (socket says 172.21.15.120:41776) 2024-05-14T09:31:37.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.627+0000 7ff1f9400640 1 -- 172.21.15.120:0/3410090472 learned_addr learned my addr 172.21.15.120:0/3410090472 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:37.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.627+0000 7ff1fa800640 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fcd1b0 0x5634f1380140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.628+0000 7ff1f9400640 1 -- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fcd1b0 msgr2=0x5634f1380140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:37.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.628+0000 7ff1f9400640 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fcd1b0 0x5634f1380140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.628+0000 7ff1f9400640 1 -- 172.21.15.120:0/3410090472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 msgr2=0x5634f1378ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:37.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.628+0000 7ff1f9400640 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f1378ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.628+0000 7ff1f9400640 1 -- 172.21.15.120:0/3410090472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634f10b1620 con 0x5634f0fac4d0 2024-05-14T09:31:37.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.628+0000 7ff1f9400640 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f13791e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009900 tx=0x7ff1e0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fbe8290e9e5c97 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:37.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.628+0000 7ff1db400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:31:37.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.629+0000 7ff1db400640 1 -- 172.21.15.120:0/3410090472 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0035040 con 0x5634f0fac4d0 2024-05-14T09:31:37.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.629+0000 7ff1db400640 1 -- 172.21.15.120:0/3410090472 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff1e00037f0 con 0x5634f0fac4d0 2024-05-14T09:31:37.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.629+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1e8004c30 con 0x5634f0fac4d0 2024-05-14T09:31:37.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.629+0000 7ff1db400640 1 -- 172.21.15.120:0/3410090472 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff1e0032e50 con 0x5634f0fac4d0 2024-05-14T09:31:37.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.629+0000 7ff203773740 10 client.26293 fetch_fsmap learned FSMap version 48 2024-05-14T09:31:37.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.629+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5634f13830e0 con 0x5634f0fac4d0 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff1db400640 1 -- 172.21.15.120:0/3410090472 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1e8004c30 con 0x5634f0fac4d0 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff1db400640 1 -- 172.21.15.120:0/3410090472 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ff1e0044070 con 0x5634f0fac4d0 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff203773740 10 client.26293 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff203773740 10 client.26293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff203773740 20 client.26293 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff203773740 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f8bd80 0x5634f1386970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff203773740 4 client.26293 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:31:37.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.630+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634f12e1160 con 0x5634f0f8bd80 2024-05-14T09:31:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.631+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f8bd80 0x5634f1386970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.633+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f8bd80 0x5634f1386970 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53c9ac3eeb7163c1 server_cookie=881781cfde3b0b9e in_seq=0 out_seq=0 2024-05-14T09:31:37.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.633+0000 7ff1db400640 10 client.26293 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:37.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.635+0000 7ff1db400640 1 -- 172.21.15.120:0/3410090472 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5634f12e1160 con 0x5634f0f8bd80 2024-05-14T09:31:37.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.635+0000 7ff1db400640 10 client.26293 handle_command_reply: tid=0 2024-05-14T09:31:37.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 client.26293 shutdown 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 msgr2=0x5634f13791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f13791e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009900 tx=0x7ff1e0009260 comp rx=0 tx=0).stop 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 shutdown_connections 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f8bd80 0x5634f1386970 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fcd1b0 0x5634f1380140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f13791e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 --2- 172.21.15.120:0/3410090472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f1378ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 >> 172.21.15.120:0/3410090472 conn(0x5634f0fc1300 msgr2=0x5634f1369a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:37.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.636+0000 7ff1db400640 0 client.26293 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:37.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.637+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 shutdown_connections 2024-05-14T09:31:37.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.637+0000 7ff203773740 1 -- 172.21.15.120:0/3410090472 wait complete. 2024-05-14T09:31:37.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.638+0000 7ff203773740 20 client.26293 trim_cache size 0 max 16384 2024-05-14T09:31:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.669+0000 7ff203773740 1 Processor -- start 2024-05-14T09:31:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.669+0000 7ff203773740 1 -- start start 2024-05-14T09:31:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.669+0000 7ff203773740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f138b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.669+0000 7ff203773740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fac4d0 0x5634f1380060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.669+0000 7ff203773740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f13805a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff203773740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41bbe30 con 0x5634f0fa42f0 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff203773740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41bda30 con 0x5634f0fac4d0 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff203773740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41bc560 con 0x5634f0fcd1b0 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff1f9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f138b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff1fa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f13805a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff1fa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f13805a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:41780/0 (socket says 172.21.15.120:41780) 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff1fa800640 1 -- 172.21.15.120:0/1642675445 learned_addr learned my addr 172.21.15.120:0/1642675445 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff1f9400640 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fac4d0 0x5634f1380060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.670+0000 7ff1f9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f138b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44424/0 (socket says 172.21.15.120:44424) 2024-05-14T09:31:37.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.671+0000 7ff1f9400640 1 -- 172.21.15.120:0/1642675445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 msgr2=0x5634f13805a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:37.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.671+0000 7ff1f9400640 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f13805a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.671+0000 7ff1f9400640 1 -- 172.21.15.120:0/1642675445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 msgr2=0x5634f138b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:37.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.671+0000 7ff1f9400640 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f138b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.671+0000 7ff1f9400640 1 -- 172.21.15.120:0/1642675445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f1366280 con 0x5634f0fac4d0 2024-05-14T09:31:37.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.672+0000 7ff1f9400640 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fac4d0 0x5634f1380060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff1e003dc60 tx=0x7ff1e002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fedafa27b96a787 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.675+0000 7ff1e6600640 1 -- 172.21.15.120:0/1642675445 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0062070 con 0x5634f0fac4d0 2024-05-14T09:31:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.675+0000 7ff1e6600640 1 -- 172.21.15.120:0/1642675445 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1e003de50 con 0x5634f0fac4d0 2024-05-14T09:31:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.675+0000 7ff1e6600640 1 -- 172.21.15.120:0/1642675445 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0003c50 con 0x5634f0fac4d0 2024-05-14T09:31:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.676+0000 7ff203773740 1 -- 172.21.15.120:0/1642675445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fac4d0 msgr2=0x5634f1380060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.676+0000 7ff203773740 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fac4d0 0x5634f1380060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff1e003dc60 tx=0x7ff1e002a3f0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.677+0000 7ff203773740 1 -- 172.21.15.120:0/1642675445 shutdown_connections 2024-05-14T09:31:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.677+0000 7ff203773740 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fcd1b0 0x5634f13805a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.677+0000 7ff203773740 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fac4d0 0x5634f1380060 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.677+0000 7ff203773740 1 --2- 172.21.15.120:0/1642675445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fa42f0 0x5634f138b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.677+0000 7ff203773740 1 -- 172.21.15.120:0/1642675445 >> 172.21.15.120:0/1642675445 conn(0x5634f0fc1300 msgr2=0x5634f13730c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.677+0000 7ff203773740 1 -- 172.21.15.120:0/1642675445 shutdown_connections 2024-05-14T09:31:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.678+0000 7ff203773740 1 -- 172.21.15.120:0/1642675445 wait complete. 2024-05-14T09:31:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.678+0000 7ff203773740 1 -- start start 2024-05-14T09:31:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 1 Processor -- start 2024-05-14T09:31:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f137fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f137ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fcd1b0 0x5634f13ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41bd300 con 0x5634f0fcd1b0 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41bcc30 con 0x5634f0fa42f0 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41b9e30 con 0x5634f0fac4d0 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.679+0000 7ff203773740 10 client.0 _ll_register_callbacks cb 0x7ff1e0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.680+0000 7ff1f9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f137fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.680+0000 7ff1f9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f137fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39350/0 (socket says 172.21.15.120:39350) 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.680+0000 7ff1f9e00640 1 -- 172.21.15.120:0/2797355319 learned_addr learned my addr 172.21.15.120:0/2797355319 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.680+0000 7ff1f9400640 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f137ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.681+0000 7ff1f9e00640 1 -- 172.21.15.120:0/2797355319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 msgr2=0x5634f137ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.681+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f137ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.681+0000 7ff1f9e00640 1 -- 172.21.15.120:0/2797355319 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fcd1b0 msgr2=0x5634f13ecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.681+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fcd1b0 0x5634f13ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.681+0000 7ff1f9e00640 1 -- 172.21.15.120:0/2797355319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634f13ed340 con 0x5634f0fa42f0 2024-05-14T09:31:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.682+0000 7ff1f9e00640 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f137fa20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00a7240 tx=0x7ff1f00aa790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8505b387de868fa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.682+0000 7ff1db400640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:31:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.682+0000 7ff1db400640 1 -- 172.21.15.120:0/2797355319 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00b2e30 con 0x5634f0fa42f0 2024-05-14T09:31:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.683+0000 7ff1db400640 1 -- 172.21.15.120:0/2797355319 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff1f00a6260 con 0x5634f0fa42f0 2024-05-14T09:31:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.683+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1e003de50 con 0x5634f0fa42f0 2024-05-14T09:31:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff1db400640 1 -- 172.21.15.120:0/2797355319 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff1f00b29a0 con 0x5634f0fa42f0 2024-05-14T09:31:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff203773740 10 client.36245 fetch_fsmap learned FSMap version 48 2024-05-14T09:31:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5634f13ee660 con 0x5634f0fa42f0 2024-05-14T09:31:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff1db400640 1 -- 172.21.15.120:0/2797355319 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1e003de50 con 0x5634f0fa42f0 2024-05-14T09:31:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff1db400640 1 -- 172.21.15.120:0/2797355319 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ff1f000f040 con 0x5634f0fa42f0 2024-05-14T09:31:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff203773740 10 client.36245 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T09:31:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff203773740 10 client.36245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.684+0000 7ff203773740 20 client.36245 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.685+0000 7ff203773740 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f611c0 0x5634f13f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:37.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.685+0000 7ff203773740 4 client.36245 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:31:37.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.685+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5634f12dafd0 con 0x5634f0f611c0 2024-05-14T09:31:37.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.685+0000 7ff1f9400640 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f611c0 0x5634f13f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:37.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.687+0000 7ff1f9400640 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f611c0 0x5634f13f10b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba3b7c1445e9438 server_cookie=17a21b3948caa504 in_seq=0 out_seq=0 2024-05-14T09:31:37.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.687+0000 7ff1db400640 10 client.36245 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.723+0000 7ff1db400640 1 -- 172.21.15.120:0/2797355319 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5634f12dafd0 con 0x5634f0f611c0 2024-05-14T09:31:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.723+0000 7ff1db400640 10 client.36245 handle_command_reply: tid=0 2024-05-14T09:31:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.723+0000 7ff203773740 1 client.36245 shutdown 2024-05-14T09:31:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.723+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 msgr2=0x5634f137fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.723+0000 7ff203773740 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f137fa20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00a7240 tx=0x7ff1f00aa790 comp rx=0 tx=0).stop 2024-05-14T09:31:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.724+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 shutdown_connections 2024-05-14T09:31:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.724+0000 7ff203773740 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5634f0f611c0 0x5634f13f10b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.724+0000 7ff203773740 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634f0fcd1b0 0x5634f13ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.724+0000 7ff203773740 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634f0fac4d0 0x5634f137ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.724+0000 7ff1db400640 0 client.36245 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.724+0000 7ff203773740 1 --2- 172.21.15.120:0/2797355319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634f0fa42f0 0x5634f137fa20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.725+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 >> 172.21.15.120:0/2797355319 conn(0x5634f0fc1300 msgr2=0x5634f136d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.725+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 shutdown_connections 2024-05-14T09:31:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.725+0000 7ff203773740 1 -- 172.21.15.120:0/2797355319 wait complete. 2024-05-14T09:31:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.726+0000 7ff203773740 20 client.36245 trim_cache size 0 max 16384 2024-05-14T09:31:37.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:31:37.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:31:37.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:31:37.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:31:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.727+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff1dc0b2770 msgr2=0x7ff1dc0b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.727+0000 7ff1fc800640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff1dc0b2770 0x7ff1dc0b4c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009230 tx=0x7ff1e0031400 comp rx=0 tx=0).stop 2024-05-14T09:31:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.727+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 msgr2=0x7ff1f4198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.727+0000 7ff1fc800640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 0x7ff1f4198140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000ead0 tx=0x7ff1f000ef90 comp rx=0 tx=0).stop 2024-05-14T09:31:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.728+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 shutdown_connections 2024-05-14T09:31:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.728+0000 7ff1fc800640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff1dc0b2770 0x7ff1dc0b4c80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.728+0000 7ff1fc800640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1f419d600 0x7ff1f419da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.728+0000 7ff1fc800640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f4109ba0 0x7ff1f4198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.728+0000 7ff1fc800640 1 --2- 172.21.15.120:0/1725435721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1f4103c60 0x7ff1f4198140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.729+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 >> 172.21.15.120:0/1725435721 conn(0x7ff1f40fee30 msgr2=0x7ff1f4105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.729+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 shutdown_connections 2024-05-14T09:31:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:37.729+0000 7ff1fc800640 1 -- 172.21.15.120:0/1725435721 wait complete. 2024-05-14T09:31:38.185 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:37 smithi120 ceph-mon[31085]: pgmap v798: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.7 MiB/s wr, 736 op/s 2024-05-14T09:31:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:37 smithi152 ceph-mon[34868]: pgmap v798: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.7 MiB/s wr, 736 op/s 2024-05-14T09:31:38.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:37 smithi175 ceph-mon[35353]: pgmap v798: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.7 MiB/s wr, 736 op/s 2024-05-14T09:31:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 245.0 s, 643.4 tps, lat 155.673 ms stddev 54.888 2024-05-14T09:31:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:39 smithi152 ceph-mon[34868]: pgmap v799: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.8 MiB/s wr, 776 op/s 2024-05-14T09:31:40.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:39 smithi175 ceph-mon[35353]: pgmap v799: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.8 MiB/s wr, 776 op/s 2024-05-14T09:31:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:39 smithi120 ceph-mon[31085]: pgmap v799: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.8 MiB/s wr, 776 op/s 2024-05-14T09:31:41.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:40 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:31:41.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:40 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:31:41.388 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:40 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:31:42.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:41 smithi152 ceph-mon[34868]: pgmap v800: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.5 MiB/s wr, 758 op/s 2024-05-14T09:31:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:41 smithi175 ceph-mon[35353]: pgmap v800: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.5 MiB/s wr, 758 op/s 2024-05-14T09:31:42.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:41 smithi120 ceph-mon[31085]: pgmap v800: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.5 MiB/s wr, 758 op/s 2024-05-14T09:31:43.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:31:43.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:31:43.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:31:43.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:31:43.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:31:43.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:31:43.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:31:43.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:31:43.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:31:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 250.0 s, 614.6 tps, lat 162.138 ms stddev 50.210 2024-05-14T09:31:44.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:44 smithi120 ceph-mon[31085]: pgmap v801: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.1 MiB/s wr, 695 op/s 2024-05-14T09:31:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:44 smithi152 ceph-mon[34868]: pgmap v801: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.1 MiB/s wr, 695 op/s 2024-05-14T09:31:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:44 smithi175 ceph-mon[35353]: pgmap v801: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.1 MiB/s wr, 695 op/s 2024-05-14T09:31:46.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:46 smithi120 ceph-mon[31085]: pgmap v802: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.5 MiB/s wr, 734 op/s 2024-05-14T09:31:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:46 smithi152 ceph-mon[34868]: pgmap v802: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.5 MiB/s wr, 734 op/s 2024-05-14T09:31:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:46 smithi175 ceph-mon[35353]: pgmap v802: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.5 MiB/s wr, 734 op/s 2024-05-14T09:31:48.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:48 smithi120 ceph-mon[31085]: pgmap v803: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.2 MiB/s wr, 710 op/s 2024-05-14T09:31:48.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:48 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:48 smithi152 ceph-mon[34868]: pgmap v803: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.2 MiB/s wr, 710 op/s 2024-05-14T09:31:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:48 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:48 smithi175 ceph-mon[35353]: pgmap v803: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.2 MiB/s wr, 710 op/s 2024-05-14T09:31:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:48 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:49.334 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 255.0 s, 670.6 tps, lat 149.585 ms stddev 98.438 2024-05-14T09:31:50.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:50 smithi152 ceph-mon[34868]: pgmap v804: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-05-14T09:31:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:50 smithi175 ceph-mon[35353]: pgmap v804: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-05-14T09:31:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:50 smithi120 ceph-mon[31085]: pgmap v804: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-05-14T09:31:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.078+0000 7fd89ee00640 1 -- 172.21.15.120:0/489127283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd898105e70 msgr2=0x7fd898106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.078+0000 7fd89ee00640 1 --2- 172.21.15.120:0/489127283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd898105e70 0x7fd898106b70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd888009900 tx=0x7fd88802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.078+0000 7fd89ee00640 1 -- 172.21.15.120:0/489127283 shutdown_connections 2024-05-14T09:31:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.078+0000 7fd89ee00640 1 --2- 172.21.15.120:0/489127283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd89810bdb0 0x7fd89810e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.078+0000 7fd89ee00640 1 --2- 172.21.15.120:0/489127283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8981070b0 0x7fd8981074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.078+0000 7fd89ee00640 1 --2- 172.21.15.120:0/489127283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd898105e70 0x7fd898106b70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.078+0000 7fd89ee00640 1 -- 172.21.15.120:0/489127283 >> 172.21.15.120:0/489127283 conn(0x7fd898101040 msgr2=0x7fd898103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.079+0000 7fd89ee00640 1 -- 172.21.15.120:0/489127283 shutdown_connections 2024-05-14T09:31:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.079+0000 7fd89ee00640 1 -- 172.21.15.120:0/489127283 wait complete. 2024-05-14T09:31:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.081+0000 7fd89ee00640 1 Processor -- start 2024-05-14T09:31:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.082+0000 7fd89ee00640 1 -- start start 2024-05-14T09:31:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.083+0000 7fd89ee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8981070b0 0x7fd89819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.083+0000 7fd89ee00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd89810bdb0 0x7fd89819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd89ee00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8981a1ac0 0x7fd8981a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd89ee00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd898111820 con 0x7fd89810bdb0 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd89ee00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8981116a0 con 0x7fd8981a1ac0 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd89ee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8981119a0 con 0x7fd8981070b0 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd897e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8981070b0 0x7fd89819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd897e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8981070b0 0x7fd89819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:38506/0 (socket says 172.21.15.120:38506) 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd897400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd89810bdb0 0x7fd89819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd897e00640 1 -- 172.21.15.120:0/1475582597 learned_addr learned my addr 172.21.15.120:0/1475582597 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.084+0000 7fd89ce00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8981a1ac0 0x7fd8981a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.085+0000 7fd897400640 1 -- 172.21.15.120:0/1475582597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8981070b0 msgr2=0x7fd89819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.085+0000 7fd897400640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8981070b0 0x7fd89819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.085+0000 7fd897400640 1 -- 172.21.15.120:0/1475582597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8981a1ac0 msgr2=0x7fd8981a3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.085+0000 7fd897400640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8981a1ac0 0x7fd8981a3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.085+0000 7fd897400640 1 -- 172.21.15.120:0/1475582597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8981a4580 con 0x7fd89810bdb0 2024-05-14T09:31:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.085+0000 7fd897e00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8981070b0 0x7fd89819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:31:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.086+0000 7fd897400640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd89810bdb0 0x7fd89819cbc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd88400c970 tx=0x7fd88400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.086+0000 7fd894c00640 1 -- 172.21.15.120:0/1475582597 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884007bb0 con 0x7fd89810bdb0 2024-05-14T09:31:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.086+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8981a4870 con 0x7fd89810bdb0 2024-05-14T09:31:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.086+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8981a4e10 con 0x7fd89810bdb0 2024-05-14T09:31:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.088+0000 7fd894c00640 1 -- 172.21.15.120:0/1475582597 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd884007d50 con 0x7fd89810bdb0 2024-05-14T09:31:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.088+0000 7fd894c00640 1 -- 172.21.15.120:0/1475582597 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8840186f0 con 0x7fd89810bdb0 2024-05-14T09:31:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.092+0000 7fd8a5e5a740 1 Processor -- start 2024-05-14T09:31:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.093+0000 7fd8a5e5a740 1 -- start start 2024-05-14T09:31:51.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.094+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6084100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.094+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a6084680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.094+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cc14d0 0x5587a608b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.094+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5587a5fe8550 con 0x5587a5cc14d0 2024-05-14T09:31:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.094+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5587a5f8dbc0 con 0x5587a5ce21b0 2024-05-14T09:31:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.094+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5587a5fe4510 con 0x5587a5cb92f0 2024-05-14T09:31:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.095+0000 7fd897e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a6084680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.095+0000 7fd897e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a6084680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:38510/0 (socket says 172.21.15.120:38510) 2024-05-14T09:31:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.095+0000 7fd897e00640 1 -- 172.21.15.120:0/1694711332 learned_addr learned my addr 172.21.15.120:0/1694711332 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.095+0000 7fd89ce00640 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6084100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.095+0000 7fd894c00640 1 -- 172.21.15.120:0/1475582597 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd884018890 con 0x7fd89810bdb0 2024-05-14T09:31:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.096+0000 7fd897e00640 1 -- 172.21.15.120:0/1694711332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 msgr2=0x5587a6084100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.096+0000 7fd897e00640 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6084100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.096+0000 7fd897e00640 1 -- 172.21.15.120:0/1694711332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cc14d0 msgr2=0x5587a608b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.096+0000 7fd897400640 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cc14d0 0x5587a608b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.096+0000 7fd897e00640 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cc14d0 0x5587a608b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.096+0000 7fd897e00640 1 -- 172.21.15.120:0/1694711332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a5cfa210 con 0x5587a5cb92f0 2024-05-14T09:31:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.096+0000 7fd897400640 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cc14d0 0x5587a608b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:31:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.097+0000 7fd897e00640 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a6084680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd888009900 tx=0x7fd888005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f074fa656116b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:51.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.097+0000 7fd88d600640 1 -- 172.21.15.120:0/1694711332 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888035030 con 0x5587a5cb92f0 2024-05-14T09:31:51.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.097+0000 7fd88d600640 1 -- 172.21.15.120:0/1694711332 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd888040070 con 0x5587a5cb92f0 2024-05-14T09:31:51.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.097+0000 7fd88d600640 1 -- 172.21.15.120:0/1694711332 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888003c10 con 0x5587a5cb92f0 2024-05-14T09:31:51.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.099+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/1694711332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 msgr2=0x5587a6084680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.099+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a6084680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd888009900 tx=0x7fd888005f10 comp rx=0 tx=0).stop 2024-05-14T09:31:51.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.099+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/1694711332 shutdown_connections 2024-05-14T09:31:51.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.099+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cc14d0 0x5587a608b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.099+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a6084680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.099+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/1694711332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6084100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.099+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/1694711332 >> 172.21.15.120:0/1694711332 conn(0x5587a5cd6300 msgr2=0x5587a607fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.100+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/1694711332 shutdown_connections 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.100+0000 7fd894c00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd87c0b27f0 0x7fd87c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.100+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/1694711332 wait complete. 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.100+0000 7fd894c00640 1 -- 172.21.15.120:0/1475582597 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd8840e24c0 con 0x7fd89810bdb0 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.101+0000 7fd8a5e5a740 1 -- start start 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.101+0000 7fd897e00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd87c0b27f0 0x7fd87c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.101+0000 7fd8a5e5a740 1 Processor -- start 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a608db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a608e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5ce21b0 0x5587a6094fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5587a608bf70 con 0x5587a5ce21b0 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5587a5fa1660 con 0x5587a5cc14d0 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5587a608c0f0 con 0x5587a5cb92f0 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd8a5e5a740 10 client.0 _ll_register_callbacks cb 0x5587a5f6b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd897e00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd87c0b27f0 0x7fd87c0b4d00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd888005ab0 tx=0x7fd888046040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd897e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a608db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.102+0000 7fd897400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a608e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd897400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a608e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40824/0 (socket says 172.21.15.120:40824) 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd897400640 1 -- 172.21.15.120:0/3242275089 learned_addr learned my addr 172.21.15.120:0/3242275089 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd89ce00640 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5ce21b0 0x5587a6094fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd897e00640 1 -- 172.21.15.120:0/3242275089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 msgr2=0x5587a608e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd897e00640 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a608e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd897e00640 1 -- 172.21.15.120:0/3242275089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5ce21b0 msgr2=0x5587a6094fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd897e00640 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5ce21b0 0x5587a6094fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.103+0000 7fd897e00640 1 -- 172.21.15.120:0/3242275089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a5dc6620 con 0x5587a5cb92f0 2024-05-14T09:31:51.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.104+0000 7fd897e00640 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a608db40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5587a6080820 tx=0x7fd8880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc259740df476e18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:51.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.104+0000 7fd882000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:31:51.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.104+0000 7fd882000640 1 -- 172.21.15.120:0/3242275089 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88803c650 con 0x5587a5cb92f0 2024-05-14T09:31:51.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.104+0000 7fd882000640 1 -- 172.21.15.120:0/3242275089 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd88803c7f0 con 0x5587a5cb92f0 2024-05-14T09:31:51.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.105+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd888040070 con 0x5587a5cb92f0 2024-05-14T09:31:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.105+0000 7fd882000640 1 -- 172.21.15.120:0/3242275089 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd88803c9f0 con 0x5587a5cb92f0 2024-05-14T09:31:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.105+0000 7fd8a5e5a740 10 client.26311 fetch_fsmap learned FSMap version 49 2024-05-14T09:31:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.105+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5587a608bfa0 con 0x5587a5cb92f0 2024-05-14T09:31:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.106+0000 7fd882000640 1 -- 172.21.15.120:0/3242275089 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd888040070 con 0x5587a5cb92f0 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.106+0000 7fd882000640 1 -- 172.21.15.120:0/3242275089 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) ==== 8374+0+0 (secure 0 0 0) 0x7fd88804d070 con 0x5587a5cb92f0 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.106+0000 7fd8a5e5a740 10 client.26311 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.106+0000 7fd8a5e5a740 10 client.26311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.106+0000 7fd8a5e5a740 20 client.26311 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.106+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5ca0d80 0x5587a609b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.107+0000 7fd8a5e5a740 4 client.26311 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.107+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587a5ff6160 con 0x5587a5ca0d80 2024-05-14T09:31:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.107+0000 7fd897400640 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5ca0d80 0x5587a609b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.110+0000 7fd897400640 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5ca0d80 0x5587a609b5b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b679765466ac3a4a server_cookie=bb058a3ce559f9a9 in_seq=0 out_seq=0 2024-05-14T09:31:51.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.110+0000 7fd882000640 10 client.26311 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:51.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.111+0000 7fd882000640 1 -- 172.21.15.120:0/3242275089 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5587a5ff6160 con 0x5587a5ca0d80 2024-05-14T09:31:51.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.111+0000 7fd882000640 10 client.26311 handle_command_reply: tid=0 2024-05-14T09:31:51.111 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.112+0000 7fd8a5e5a740 1 client.26311 shutdown 2024-05-14T09:31:51.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 msgr2=0x5587a608db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.112 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a608db40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5587a6080820 tx=0x7fd8880046c0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 shutdown_connections 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5ca0d80 0x5587a609b5b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5ce21b0 0x5587a6094fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a608e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/3242275089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cb92f0 0x5587a608db40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 >> 172.21.15.120:0/3242275089 conn(0x5587a5cd6300 msgr2=0x5587a60829a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd882000640 0 client.26311 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 shutdown_connections 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.113+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/3242275089 wait complete. 2024-05-14T09:31:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.114+0000 7fd8a5e5a740 20 client.26311 trim_cache size 0 max 16384 2024-05-14T09:31:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.148+0000 7fd8a5e5a740 1 Processor -- start 2024-05-14T09:31:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.148+0000 7fd8a5e5a740 1 -- start start 2024-05-14T09:31:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.149+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a607fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cc14d0 0x5587a607e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd897e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a607fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6094f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd87800fcd0 con 0x5587a5cb92f0 2024-05-14T09:31:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8780118a0 con 0x5587a5ce21b0 2024-05-14T09:31:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd878010400 con 0x5587a5cc14d0 2024-05-14T09:31:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd897e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a607fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47220/0 (socket says 172.21.15.120:47220) 2024-05-14T09:31:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.150+0000 7fd897e00640 1 -- 172.21.15.120:0/2151690711 learned_addr learned my addr 172.21.15.120:0/2151690711 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.151+0000 7fd89ce00640 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6094f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.151+0000 7fd897400640 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cc14d0 0x5587a607e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.152+0000 7fd897e00640 1 -- 172.21.15.120:0/2151690711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cc14d0 msgr2=0x5587a607e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.152+0000 7fd897e00640 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cc14d0 0x5587a607e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.152+0000 7fd897e00640 1 -- 172.21.15.120:0/2151690711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 msgr2=0x5587a6094f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.152+0000 7fd897e00640 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6094f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.152+0000 7fd897e00640 1 -- 172.21.15.120:0/2151690711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a5ca0fb0 con 0x5587a5cb92f0 2024-05-14T09:31:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.152+0000 7fd897e00640 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a607fb40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd8880057c0 tx=0x7fd888000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c30b06c305af3d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.153+0000 7fd88cc00640 1 -- 172.21.15.120:0/2151690711 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88803c9f0 con 0x5587a5cb92f0 2024-05-14T09:31:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.153+0000 7fd88cc00640 1 -- 172.21.15.120:0/2151690711 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd888040030 con 0x5587a5cb92f0 2024-05-14T09:31:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.153+0000 7fd88cc00640 1 -- 172.21.15.120:0/2151690711 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880037f0 con 0x5587a5cb92f0 2024-05-14T09:31:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.154+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2151690711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 msgr2=0x5587a607fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.154+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a607fb40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd8880057c0 tx=0x7fd888000bc0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.154+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2151690711 shutdown_connections 2024-05-14T09:31:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.155+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5ce21b0 0x5587a6094f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.155+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5cc14d0 0x5587a607e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.155+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2151690711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a607fb40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.155+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2151690711 >> 172.21.15.120:0/2151690711 conn(0x5587a5cd6300 msgr2=0x5587a607e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.155+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2151690711 shutdown_connections 2024-05-14T09:31:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.155+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2151690711 wait complete. 2024-05-14T09:31:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.156+0000 7fd8a5e5a740 1 -- start start 2024-05-14T09:31:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.156+0000 7fd8a5e5a740 1 Processor -- start 2024-05-14T09:31:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.157+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a60952f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.157+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a60939d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.158+0000 7fd8a5e5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5ce21b0 0x5587a6093f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.158+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd8780111a0 con 0x5587a5cb92f0 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.158+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd878010ad0 con 0x5587a5cc14d0 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.158+0000 7fd8a5e5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd87800dc90 con 0x5587a5ce21b0 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.158+0000 7fd8a5e5a740 10 client.0 _ll_register_callbacks cb 0x7fd890009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.158+0000 7fd897e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a60952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.159+0000 7fd897400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a60939d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.159+0000 7fd897400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a60939d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40840/0 (socket says 172.21.15.120:40840) 2024-05-14T09:31:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.159+0000 7fd897400640 1 -- 172.21.15.120:0/2719990939 learned_addr learned my addr 172.21.15.120:0/2719990939 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:31:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.159+0000 7fd89ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5ce21b0 0x5587a6093f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.160+0000 7fd897e00640 1 -- 172.21.15.120:0/2719990939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5ce21b0 msgr2=0x5587a6093f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.160+0000 7fd897e00640 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5ce21b0 0x5587a6093f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.160+0000 7fd897e00640 1 -- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 msgr2=0x5587a60939d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:31:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.160+0000 7fd897e00640 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a60939d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.160+0000 7fd897e00640 1 -- 172.21.15.120:0/2719990939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a6094450 con 0x5587a5cb92f0 2024-05-14T09:31:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.160+0000 7fd897400640 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a60939d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:31:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.161+0000 7fd897e00640 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a60952f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd8880057c0 tx=0x7fd888030fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5481ab8d48465caf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:31:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.161+0000 7fd882000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:31:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.161+0000 7fd882000640 1 -- 172.21.15.120:0/2719990939 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88806e060 con 0x5587a5cb92f0 2024-05-14T09:31:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.161+0000 7fd882000640 1 -- 172.21.15.120:0/2719990939 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd88805d730 con 0x5587a5cb92f0 2024-05-14T09:31:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.162+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd888040030 con 0x5587a5cb92f0 2024-05-14T09:31:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.162+0000 7fd882000640 1 -- 172.21.15.120:0/2719990939 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd8880037f0 con 0x5587a5cb92f0 2024-05-14T09:31:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.162+0000 7fd8a5e5a740 10 client.16782 fetch_fsmap learned FSMap version 49 2024-05-14T09:31:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.162+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5587a610ad10 con 0x5587a5cb92f0 2024-05-14T09:31:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd882000640 1 -- 172.21.15.120:0/2719990939 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd888040030 con 0x5587a5cb92f0 2024-05-14T09:31:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd882000640 1 -- 172.21.15.120:0/2719990939 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 49) ==== 8374+0+0 (secure 0 0 0) 0x7fd88804d070 con 0x5587a5cb92f0 2024-05-14T09:31:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd8a5e5a740 10 client.16782 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T09:31:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd8a5e5a740 10 client.16782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:31:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd8a5e5a740 20 client.16782 populate_metadata read hostname 'smithi120' 2024-05-14T09:31:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5c761c0 0x5587a610d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:31:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd8a5e5a740 4 client.16782 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:31:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.163+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5587a5feffd0 con 0x5587a5c761c0 2024-05-14T09:31:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.164+0000 7fd897400640 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5c761c0 0x5587a610d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:31:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.168+0000 7fd897400640 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5c761c0 0x5587a610d5c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b7a021fe05d6846 server_cookie=25d634278c9fccd in_seq=0 out_seq=0 2024-05-14T09:31:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.169+0000 7fd882000640 10 client.16782 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.202+0000 7fd882000640 1 -- 172.21.15.120:0/2719990939 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5587a5feffd0 con 0x5587a5c761c0 2024-05-14T09:31:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.202+0000 7fd882000640 10 client.16782 handle_command_reply: tid=0 2024-05-14T09:31:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.202+0000 7fd8a5e5a740 1 client.16782 shutdown 2024-05-14T09:31:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.203+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 msgr2=0x5587a60952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.203+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a60952f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd8880057c0 tx=0x7fd888030fc0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 shutdown_connections 2024-05-14T09:31:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5587a5c761c0 0x5587a610d5c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd882000640 0 client.16782 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:31:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587a5ce21b0 0x5587a6093f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587a5cc14d0 0x5587a60939d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd8a5e5a740 1 --2- 172.21.15.120:0/2719990939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5587a5cb92f0 0x5587a60952f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 >> 172.21.15.120:0/2719990939 conn(0x5587a5cd6300 msgr2=0x5587a607e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.204+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 shutdown_connections 2024-05-14T09:31:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.205+0000 7fd8a5e5a740 1 -- 172.21.15.120:0/2719990939 wait complete. 2024-05-14T09:31:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.205+0000 7fd8a5e5a740 20 client.16782 trim_cache size 0 max 16384 2024-05-14T09:31:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:31:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:31:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:31:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:31:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.206+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd87c0b27f0 msgr2=0x7fd87c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.206+0000 7fd89ee00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd87c0b27f0 0x7fd87c0b4d00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd888005ab0 tx=0x7fd888046040 comp rx=0 tx=0).stop 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.206+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd89810bdb0 msgr2=0x7fd89819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.206+0000 7fd89ee00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd89810bdb0 0x7fd89819cbc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd88400c970 tx=0x7fd88400ce30 comp rx=0 tx=0).stop 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 shutdown_connections 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd87c0b27f0 0x7fd87c0b4d00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8981a1ac0 0x7fd8981a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd89810bdb0 0x7fd89819cbc0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 --2- 172.21.15.120:0/1475582597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8981070b0 0x7fd89819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:31:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 >> 172.21.15.120:0/1475582597 conn(0x7fd898101040 msgr2=0x7fd898107d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:31:51.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 shutdown_connections 2024-05-14T09:31:51.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:31:51.207+0000 7fd89ee00640 1 -- 172.21.15.120:0/1475582597 wait complete. 2024-05-14T09:31:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:52 smithi152 ceph-mon[34868]: pgmap v805: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.3 MiB/s wr, 739 op/s 2024-05-14T09:31:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:52 smithi175 ceph-mon[35353]: pgmap v805: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.3 MiB/s wr, 739 op/s 2024-05-14T09:31:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:52 smithi120 ceph-mon[31085]: pgmap v805: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.3 MiB/s wr, 739 op/s 2024-05-14T09:31:54.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 260.0 s, 676.8 tps, lat 147.554 ms stddev 82.301 2024-05-14T09:31:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:54 smithi152 ceph-mon[34868]: pgmap v806: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 714 op/s 2024-05-14T09:31:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:54 smithi175 ceph-mon[35353]: pgmap v806: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 714 op/s 2024-05-14T09:31:54.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:54 smithi120 ceph-mon[31085]: pgmap v806: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 714 op/s 2024-05-14T09:31:56.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:56 smithi152 ceph-mon[34868]: pgmap v807: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.0 MiB/s wr, 776 op/s 2024-05-14T09:31:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:56 smithi175 ceph-mon[35353]: pgmap v807: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.0 MiB/s wr, 776 op/s 2024-05-14T09:31:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:56 smithi120 ceph-mon[31085]: pgmap v807: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.0 MiB/s wr, 776 op/s 2024-05-14T09:31:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:58 smithi152 ceph-mon[34868]: pgmap v808: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.4 MiB/s wr, 731 op/s 2024-05-14T09:31:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:31:58 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:58 smithi175 ceph-mon[35353]: pgmap v808: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.4 MiB/s wr, 731 op/s 2024-05-14T09:31:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:31:58 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:58 smithi120 ceph-mon[31085]: pgmap v808: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.4 MiB/s wr, 731 op/s 2024-05-14T09:31:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:31:58 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:31:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 265.0 s, 701.2 tps, lat 142.912 ms stddev 39.499 2024-05-14T09:32:00.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:00 smithi152 ceph-mon[34868]: pgmap v809: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 788 op/s 2024-05-14T09:32:00.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:00 smithi175 ceph-mon[35353]: pgmap v809: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 788 op/s 2024-05-14T09:32:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:00 smithi120 ceph-mon[31085]: pgmap v809: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 788 op/s 2024-05-14T09:32:01.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:01 smithi152 ceph-mon[34868]: pgmap v810: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.7 MiB/s wr, 781 op/s 2024-05-14T09:32:01.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:01 smithi175 ceph-mon[35353]: pgmap v810: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.7 MiB/s wr, 781 op/s 2024-05-14T09:32:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:01 smithi120 ceph-mon[31085]: pgmap v810: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.7 MiB/s wr, 781 op/s 2024-05-14T09:32:04.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:03 smithi120 ceph-mon[31085]: pgmap v811: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.1 MiB/s wr, 713 op/s 2024-05-14T09:32:04.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:03 smithi152 ceph-mon[34868]: pgmap v811: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.1 MiB/s wr, 713 op/s 2024-05-14T09:32:04.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:03 smithi175 ceph-mon[35353]: pgmap v811: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.1 MiB/s wr, 713 op/s 2024-05-14T09:32:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 270.0 s, 790.2 tps, lat 126.242 ms stddev 35.430 2024-05-14T09:32:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.524+0000 7f8290800640 1 -- 172.21.15.120:0/2066283655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 msgr2=0x7f828807a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.524+0000 7f8290800640 1 --2- 172.21.15.120:0/2066283655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 0x7f828807a1f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f827c009860 tx=0x7f827c02a340 comp rx=0 tx=0).stop 2024-05-14T09:32:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.524+0000 7f8290800640 1 -- 172.21.15.120:0/2066283655 shutdown_connections 2024-05-14T09:32:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.524+0000 7f8290800640 1 --2- 172.21.15.120:0/2066283655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f828807aae0 0x7f828807aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.524+0000 7f8290800640 1 --2- 172.21.15.120:0/2066283655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 0x7f828807a1f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.524+0000 7f8290800640 1 --2- 172.21.15.120:0/2066283655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 0x7f82880798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.524+0000 7f8290800640 1 -- 172.21.15.120:0/2066283655 >> 172.21.15.120:0/2066283655 conn(0x7f8288101070 msgr2=0x7f8288103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.527+0000 7f8290800640 1 -- 172.21.15.120:0/2066283655 shutdown_connections 2024-05-14T09:32:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.528+0000 7f8290800640 1 -- 172.21.15.120:0/2066283655 wait complete. 2024-05-14T09:32:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.529+0000 7f8290800640 1 Processor -- start 2024-05-14T09:32:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.529+0000 7f8290800640 1 -- start start 2024-05-14T09:32:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.530+0000 7f8290800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 0x7f82881a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.530+0000 7f8290800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 0x7f82881a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f828de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 0x7f82881a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f8290800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f828807aae0 0x7f82881a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f828de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 0x7f82881a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50058/0 (socket says 172.21.15.120:50058) 2024-05-14T09:32:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f8290800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8288115c40 con 0x7f8288079de0 2024-05-14T09:32:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f828de00640 1 -- 172.21.15.120:0/2848750142 learned_addr learned my addr 172.21.15.120:0/2848750142 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8288115ac0 con 0x7f828807aae0 2024-05-14T09:32:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8288115dc0 con 0x7f8288078b50 2024-05-14T09:32:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f828d400640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 0x7f82881a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.531+0000 7f828e800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f828807aae0 0x7f82881a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.532+0000 7f828de00640 1 -- 172.21.15.120:0/2848750142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f828807aae0 msgr2=0x7f82881a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.532+0000 7f828de00640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f828807aae0 0x7f82881a7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.532+0000 7f828de00640 1 -- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 msgr2=0x7f82881a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.532+0000 7f828de00640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 0x7f82881a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.532+0000 7f828de00640 1 -- 172.21.15.120:0/2848750142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82881a8410 con 0x7f8288078b50 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.533+0000 7f828de00640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 0x7f82881a0920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f827800e9c0 tx=0x7f827800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.533+0000 7f8282a00640 1 -- 172.21.15.120:0/2848750142 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827800cd80 con 0x7f8288078b50 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.533+0000 7f8282a00640 1 -- 172.21.15.120:0/2848750142 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82780054b0 con 0x7f8288078b50 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.533+0000 7f8282a00640 1 -- 172.21.15.120:0/2848750142 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278010430 con 0x7f8288078b50 2024-05-14T09:32:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.533+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82881a8700 con 0x7f8288078b50 2024-05-14T09:32:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.534+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82881a8bd0 con 0x7f8288078b50 2024-05-14T09:32:04.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.539+0000 7f82977fe740 1 Processor -- start 2024-05-14T09:32:04.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.540+0000 7f82977fe740 1 -- start start 2024-05-14T09:32:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.540+0000 7f82977fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4008100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.540+0000 7f8282a00640 1 -- 172.21.15.120:0/2848750142 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8278004f20 con 0x7f8288078b50 2024-05-14T09:32:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f82977fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f82977fe740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede400f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f82977fe740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ede3f6c550 con 0x55ede3c454d0 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f82977fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ede3f11bc0 con 0x55ede3c661b0 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f82977fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ede3f68510 con 0x55ede3c3d2f0 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f828e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4008100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f828e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4008100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55642/0 (socket says 172.21.15.120:55642) 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f828e800640 1 -- 172.21.15.120:0/2396169392 learned_addr learned my addr 172.21.15.120:0/2396169392 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.541+0000 7f828de00640 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f828d400640 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede400f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f8282a00640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82700b2930 0x7f82700b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f828e800640 1 -- 172.21.15.120:0/2396169392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 msgr2=0x55ede4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f828e800640 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f828e800640 1 -- 172.21.15.120:0/2396169392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 msgr2=0x55ede400f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f828e800640 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede400f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f8282a00640 1 -- 172.21.15.120:0/2848750142 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f82780e2a30 con 0x7f8288078b50 2024-05-14T09:32:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f828e800640 1 -- 172.21.15.120:0/2396169392 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede3c7e210 con 0x55ede3c661b0 2024-05-14T09:32:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.542+0000 7f828d400640 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede400f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.543+0000 7f828e800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82700b2930 0x7f82700b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.543+0000 7f828e800640 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4008100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f828400e450 tx=0x7f82840095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceef74ddda08c6ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.544+0000 7f8277000640 1 -- 172.21.15.120:0/2396169392 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828400ddd0 con 0x55ede3c661b0 2024-05-14T09:32:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.544+0000 7f8277000640 1 -- 172.21.15.120:0/2396169392 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82840248c0 con 0x55ede3c661b0 2024-05-14T09:32:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.544+0000 7f8277000640 1 -- 172.21.15.120:0/2396169392 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840235d0 con 0x55ede3c661b0 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 -- 172.21.15.120:0/2396169392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 msgr2=0x55ede4008100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4008100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f828400e450 tx=0x7f82840095c0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f828e800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82700b2930 0x7f82700b4e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8284021000 tx=0x7f8284024000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 -- 172.21.15.120:0/2396169392 shutdown_connections 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede400f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4008680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 --2- 172.21.15.120:0/2396169392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4008100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 -- 172.21.15.120:0/2396169392 >> 172.21.15.120:0/2396169392 conn(0x55ede3c5a300 msgr2=0x55ede4003a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.545+0000 7f82977fe740 1 -- 172.21.15.120:0/2396169392 shutdown_connections 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.546+0000 7f82977fe740 1 -- 172.21.15.120:0/2396169392 wait complete. 2024-05-14T09:32:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.546+0000 7f82977fe740 1 -- start start 2024-05-14T09:32:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.546+0000 7f82977fe740 1 Processor -- start 2024-05-14T09:32:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.547+0000 7f82977fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.547+0000 7f82977fe740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.547+0000 7f82977fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4019120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.547+0000 7f82977fe740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ede400ffd0 con 0x55ede3c454d0 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.547+0000 7f82977fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ede3f25660 con 0x55ede3c661b0 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.547+0000 7f82977fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ede4010150 con 0x55ede3c3d2f0 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.547+0000 7f82977fe740 10 client.0 _ll_register_callbacks cb 0x55ede3eef400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.548+0000 7f828de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.548+0000 7f828de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50070/0 (socket says 172.21.15.120:50070) 2024-05-14T09:32:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.548+0000 7f828de00640 1 -- 172.21.15.120:0/829684007 learned_addr learned my addr 172.21.15.120:0/829684007 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.548+0000 7f828d400640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.548+0000 7f828e800640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4019120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.549+0000 7f828de00640 1 -- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 msgr2=0x55ede4019120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.549+0000 7f828de00640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4019120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.549+0000 7f828de00640 1 -- 172.21.15.120:0/829684007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 msgr2=0x55ede40121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.549+0000 7f828de00640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.549+0000 7f828de00640 1 -- 172.21.15.120:0/829684007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede3d4a620 con 0x55ede3c3d2f0 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.549+0000 7f828d400640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.549+0000 7f828e800640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4019120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.550+0000 7f828de00640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f82780a99b0 tx=0x7f82780a9b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62462e2c5228d3c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.550+0000 7f826b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:32:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.550+0000 7f826b400640 1 -- 172.21.15.120:0/829684007 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780a97c0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.550+0000 7f826b400640 1 -- 172.21.15.120:0/829684007 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8278005210 con 0x55ede3c3d2f0 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.551+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82840248c0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.551+0000 7f826b400640 1 -- 172.21.15.120:0/829684007 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f82780aa3b0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.551+0000 7f82977fe740 10 client.26329 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.551+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ede401c0c0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f826b400640 1 -- 172.21.15.120:0/829684007 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82840248c0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f826b400640 1 -- 172.21.15.120:0/829684007 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f82780a5620 con 0x55ede3c3d2f0 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f82977fe740 10 client.26329 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f82977fe740 10 client.26329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f82977fe740 20 client.26329 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f82977fe740 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3c24d80 0x55ede401f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f82977fe740 4 client.26329 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:32:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.552+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ede3f7a160 con 0x55ede3c24d80 2024-05-14T09:32:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.553+0000 7f828d400640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3c24d80 0x55ede401f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.555+0000 7f826b400640 10 client.26329 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.555+0000 7f828d400640 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3c24d80 0x55ede401f730 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca51ee81e8bed799 server_cookie=168896f1e8b9d0b8 in_seq=0 out_seq=0 2024-05-14T09:32:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.556+0000 7f826b400640 1 -- 172.21.15.120:0/829684007 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ede3f7a160 con 0x55ede3c24d80 2024-05-14T09:32:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.556+0000 7f826b400640 10 client.26329 handle_command_reply: tid=0 2024-05-14T09:32:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 client.26329 shutdown 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 msgr2=0x55ede4011c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f82780a99b0 tx=0x7f82780a9b40 comp rx=0 tx=0).stop 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 shutdown_connections 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3c24d80 0x55ede401f730 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4019120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 --2- 172.21.15.120:0/829684007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011c80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 >> 172.21.15.120:0/829684007 conn(0x55ede3c5a300 msgr2=0x55ede4002a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f826b400640 0 client.26329 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.557+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 shutdown_connections 2024-05-14T09:32:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.558+0000 7f82977fe740 1 -- 172.21.15.120:0/829684007 wait complete. 2024-05-14T09:32:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.558+0000 7f82977fe740 20 client.26329 trim_cache size 0 max 16384 2024-05-14T09:32:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.586+0000 7f82977fe740 1 Processor -- start 2024-05-14T09:32:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.586+0000 7f82977fe740 1 -- start start 2024-05-14T09:32:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f82977fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f82977fe740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40190b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f82977fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4002000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f82977fe740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f82881b31f0 con 0x55ede3c454d0 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f82977fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82881b4d90 con 0x55ede3c661b0 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f82977fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82881b3920 con 0x55ede3c3d2f0 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f828d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f828de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f828d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58632/0 (socket says 172.21.15.120:58632) 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f828d400640 1 -- 172.21.15.120:0/4022769411 learned_addr learned my addr 172.21.15.120:0/4022769411 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.587+0000 7f828e800640 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828de00640 1 -- 172.21.15.120:0/4022769411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 msgr2=0x55ede4002000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828de00640 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4002000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828de00640 1 -- 172.21.15.120:0/4022769411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 msgr2=0x55ede40190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828de00640 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828de00640 1 -- 172.21.15.120:0/4022769411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede4007c90 con 0x55ede3c3d2f0 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828e800640 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4002000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828d400640 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.588+0000 7f828de00640 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011f60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82780058c0 tx=0x7f827800efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ba7b1f30e8989bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.589+0000 7f8276600640 1 -- 172.21.15.120:0/4022769411 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780aa3b0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.589+0000 7f8276600640 1 -- 172.21.15.120:0/4022769411 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82780ae060 con 0x55ede3c3d2f0 2024-05-14T09:32:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.589+0000 7f8276600640 1 -- 172.21.15.120:0/4022769411 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780a9cb0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 -- 172.21.15.120:0/4022769411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 msgr2=0x55ede4011f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011f60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82780058c0 tx=0x7f827800efb0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 -- 172.21.15.120:0/4022769411 shutdown_connections 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c661b0 0x55ede4002000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c454d0 0x55ede40190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 --2- 172.21.15.120:0/4022769411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4011f60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 -- 172.21.15.120:0/4022769411 >> 172.21.15.120:0/4022769411 conn(0x55ede3c5a300 msgr2=0x55ede4011850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 -- 172.21.15.120:0/4022769411 shutdown_connections 2024-05-14T09:32:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.590+0000 7f82977fe740 1 -- 172.21.15.120:0/4022769411 wait complete. 2024-05-14T09:32:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.591+0000 7f82977fe740 1 -- start start 2024-05-14T09:32:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.591+0000 7f82977fe740 1 Processor -- start 2024-05-14T09:32:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f82977fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4014970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f82977fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c454d0 0x55ede4014eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f82977fe740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c661b0 0x55ede4017df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f82977fe740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f82881b46c0 con 0x55ede3c661b0 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f82977fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82881b3ff0 con 0x55ede3c454d0 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f82977fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82881b11b0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f82977fe740 10 client.0 _ll_register_callbacks cb 0x7f8278004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f828de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4014970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f828de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4014970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50088/0 (socket says 172.21.15.120:50088) 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f828de00640 1 -- 172.21.15.120:0/4064236843 learned_addr learned my addr 172.21.15.120:0/4064236843 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f828e800640 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c661b0 0x55ede4017df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.592+0000 7f828d400640 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c454d0 0x55ede4014eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f828de00640 1 -- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c454d0 msgr2=0x55ede4014eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f828de00640 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c454d0 0x55ede4014eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f828de00640 1 -- 172.21.15.120:0/4064236843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c661b0 msgr2=0x55ede4017df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f828de00640 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c661b0 0x55ede4017df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f828de00640 1 -- 172.21.15.120:0/4064236843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede40183b0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f828de00640 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4014970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82780e6170 tx=0x7f82780a5a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d154af59d839253a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f826b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.593+0000 7f826b400640 1 -- 172.21.15.120:0/4064236843 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780a9420 con 0x55ede3c3d2f0 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.594+0000 7f826b400640 1 -- 172.21.15.120:0/4064236843 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f82780a8af0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.594+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82780ae060 con 0x55ede3c3d2f0 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.594+0000 7f826b400640 1 -- 172.21.15.120:0/4064236843 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f82780aa3b0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.594+0000 7f82977fe740 10 client.26335 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.594+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ede40183b0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.595+0000 7f826b400640 1 -- 172.21.15.120:0/4064236843 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82780a9cb0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.596+0000 7f826b400640 1 -- 172.21.15.120:0/4064236843 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f82780cc0b0 con 0x55ede3c3d2f0 2024-05-14T09:32:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.596+0000 7f82977fe740 10 client.26335 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.596+0000 7f82977fe740 10 client.26335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.596+0000 7f82977fe740 20 client.26335 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.596+0000 7f82977fe740 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3bfa1c0 0x55ede408a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.596+0000 7f82977fe740 4 client.26335 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:32:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.596+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f82780ae060 con 0x55ede3bfa1c0 2024-05-14T09:32:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.597+0000 7f828d400640 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3bfa1c0 0x55ede408a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:04.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.598+0000 7f826b400640 10 client.26335 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:04.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.598+0000 7f828d400640 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3bfa1c0 0x55ede408a030 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea76dcb79951762e server_cookie=79328797e40290b in_seq=0 out_seq=0 2024-05-14T09:32:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.619+0000 7f826b400640 1 -- 172.21.15.120:0/4064236843 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f82780ae060 con 0x55ede3bfa1c0 2024-05-14T09:32:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.619+0000 7f826b400640 10 client.26335 handle_command_reply: tid=0 2024-05-14T09:32:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.619+0000 7f82977fe740 1 client.26335 shutdown 2024-05-14T09:32:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 msgr2=0x55ede4014970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4014970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82780e6170 tx=0x7f82780a5a80 comp rx=0 tx=0).stop 2024-05-14T09:32:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 shutdown_connections 2024-05-14T09:32:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ede3bfa1c0 0x55ede408a030 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ede3c661b0 0x55ede4017df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ede3c454d0 0x55ede4014eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 --2- 172.21.15.120:0/4064236843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ede3c3d2f0 0x55ede4014970 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 >> 172.21.15.120:0/4064236843 conn(0x55ede3c5a300 msgr2=0x55ede4003160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.620+0000 7f826b400640 0 client.26335 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.621+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 shutdown_connections 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.621+0000 7f82977fe740 1 -- 172.21.15.120:0/4064236843 wait complete. 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.621+0000 7f82977fe740 20 client.26335 trim_cache size 0 max 16384 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:32:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:32:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.622+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82700b2930 msgr2=0x7f82700b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.622+0000 7f8290800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82700b2930 0x7f82700b4e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8284021000 tx=0x7f8284024000 comp rx=0 tx=0).stop 2024-05-14T09:32:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.622+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 msgr2=0x7f82881a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 0x7f82881a0920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f827800e9c0 tx=0x7f827800ee80 comp rx=0 tx=0).stop 2024-05-14T09:32:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 shutdown_connections 2024-05-14T09:32:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f82700b2930 0x7f82700b4e40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f828807aae0 0x7f82881a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8288079de0 0x7f82881a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 --2- 172.21.15.120:0/2848750142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8288078b50 0x7f82881a0920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 >> 172.21.15.120:0/2848750142 conn(0x7f8288101070 msgr2=0x7f82881028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 shutdown_connections 2024-05-14T09:32:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:04.623+0000 7f8290800640 1 -- 172.21.15.120:0/2848750142 wait complete. 2024-05-14T09:32:06.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:05 smithi120 ceph-mon[31085]: pgmap v812: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 733 op/s 2024-05-14T09:32:06.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:05 smithi152 ceph-mon[34868]: pgmap v812: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 733 op/s 2024-05-14T09:32:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:05 smithi175 ceph-mon[35353]: pgmap v812: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 733 op/s 2024-05-14T09:32:08.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:07 smithi120 ceph-mon[31085]: pgmap v813: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.7 MiB/s wr, 779 op/s 2024-05-14T09:32:08.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:07 smithi152 ceph-mon[34868]: pgmap v813: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.7 MiB/s wr, 779 op/s 2024-05-14T09:32:08.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:07 smithi175 ceph-mon[35353]: pgmap v813: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.7 MiB/s wr, 779 op/s 2024-05-14T09:32:09.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 275.0 s, 705.0 tps, lat 137.379 ms stddev 40.472 2024-05-14T09:32:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:09 smithi120 ceph-mon[31085]: pgmap v814: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 837 op/s 2024-05-14T09:32:10.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:09 smithi152 ceph-mon[34868]: pgmap v814: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 837 op/s 2024-05-14T09:32:10.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:09 smithi175 ceph-mon[35353]: pgmap v814: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 837 op/s 2024-05-14T09:32:12.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:11 smithi120 ceph-mon[31085]: pgmap v815: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 850 op/s 2024-05-14T09:32:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:11 smithi152 ceph-mon[34868]: pgmap v815: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 850 op/s 2024-05-14T09:32:12.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:11 smithi175 ceph-mon[35353]: pgmap v815: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 850 op/s 2024-05-14T09:32:14.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:13 smithi120 ceph-mon[31085]: pgmap v816: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.1 MiB/s wr, 760 op/s 2024-05-14T09:32:14.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:13 smithi152 ceph-mon[34868]: pgmap v816: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.1 MiB/s wr, 760 op/s 2024-05-14T09:32:14.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:13 smithi175 ceph-mon[35353]: pgmap v816: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.1 MiB/s wr, 760 op/s 2024-05-14T09:32:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 280.0 s, 678.0 tps, lat 152.233 ms stddev 83.821 2024-05-14T09:32:16.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:15 smithi120 ceph-mon[31085]: pgmap v817: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 831 op/s 2024-05-14T09:32:16.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:15 smithi152 ceph-mon[34868]: pgmap v817: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 831 op/s 2024-05-14T09:32:16.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:15 smithi175 ceph-mon[35353]: pgmap v817: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 831 op/s 2024-05-14T09:32:17.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.976+0000 7f6ac9600640 1 -- 172.21.15.120:0/3553932854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 msgr2=0x7f6ac410b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:17.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.976+0000 7f6ac9600640 1 --2- 172.21.15.120:0/3553932854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 0x7f6ac410b780 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400aa10 tx=0x7f6ab402b730 comp rx=0 tx=0).stop 2024-05-14T09:32:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.977+0000 7f6ac9600640 1 -- 172.21.15.120:0/3553932854 shutdown_connections 2024-05-14T09:32:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.977+0000 7f6ac9600640 1 --2- 172.21.15.120:0/3553932854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac41109c0 0x7f6ac4112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.977+0000 7f6ac9600640 1 --2- 172.21.15.120:0/3553932854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ac410bcc0 0x7f6ac410c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.977+0000 7f6ac9600640 1 --2- 172.21.15.120:0/3553932854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 0x7f6ac410b780 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.977+0000 7f6ac9600640 1 -- 172.21.15.120:0/3553932854 >> 172.21.15.120:0/3553932854 conn(0x7f6ac4070a90 msgr2=0x7f6ac4072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.978+0000 7f6ac9600640 1 -- 172.21.15.120:0/3553932854 shutdown_connections 2024-05-14T09:32:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.979+0000 7f6ac9600640 1 -- 172.21.15.120:0/3553932854 wait complete. 2024-05-14T09:32:17.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.980+0000 7f6ac9600640 1 Processor -- start 2024-05-14T09:32:17.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.981+0000 7f6ac9600640 1 -- start start 2024-05-14T09:32:17.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.981+0000 7f6ac9600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 0x7f6ac41a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac410bcc0 0x7f6ac41a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac9600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ac41109c0 0x7f6ac41b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac9600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4115cc0 con 0x7f6ac410ae50 2024-05-14T09:32:17.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac9600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4115b40 con 0x7f6ac41109c0 2024-05-14T09:32:17.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4115e40 con 0x7f6ac410bcc0 2024-05-14T09:32:17.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 0x7f6ac41a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ac41109c0 0x7f6ac41b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac410bcc0 0x7f6ac41a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 0x7f6ac41a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38242/0 (socket says 172.21.15.120:38242) 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac2a00640 1 -- 172.21.15.120:0/669560137 learned_addr learned my addr 172.21.15.120:0/669560137 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.982+0000 7f6ac2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac410bcc0 0x7f6ac41a9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:59722/0 (socket says 172.21.15.120:59722) 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.983+0000 7f6ac2000640 1 -- 172.21.15.120:0/669560137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ac41109c0 msgr2=0x7f6ac41b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.983+0000 7f6ac2000640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ac41109c0 0x7f6ac41b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.983+0000 7f6ac2000640 1 -- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 msgr2=0x7f6ac41a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.983+0000 7f6ac2000640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 0x7f6ac41a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.983+0000 7f6ac2000640 1 -- 172.21.15.120:0/669560137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac41b0c90 con 0x7f6ac410bcc0 2024-05-14T09:32:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.983+0000 7f6ac2000640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac410bcc0 0x7f6ac41a9700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e9f0 tx=0x7f6ab000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.984+0000 7f6abb400640 1 -- 172.21.15.120:0/669560137 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000ccc0 con 0x7f6ac410bcc0 2024-05-14T09:32:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.984+0000 7f6abb400640 1 -- 172.21.15.120:0/669560137 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab00108c0 con 0x7f6ac410bcc0 2024-05-14T09:32:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.984+0000 7f6abb400640 1 -- 172.21.15.120:0/669560137 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00187e0 con 0x7f6ac410bcc0 2024-05-14T09:32:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.984+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41b0f80 con 0x7f6ac410bcc0 2024-05-14T09:32:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.984+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac41b1390 con 0x7f6ac410bcc0 2024-05-14T09:32:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 Processor -- start 2024-05-14T09:32:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 -- start start 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fd0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 0x557671fd7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557671f34550 con 0x557671c052f0 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557671ed9bc0 con 0x557671c0d4d0 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.989+0000 7f6ad064c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557671f30510 con 0x557671c2e1b0 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.990+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.990+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38254/0 (socket says 172.21.15.120:38254) 2024-05-14T09:32:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.990+0000 7f6ac2a00640 1 -- 172.21.15.120:0/2327812373 learned_addr learned my addr 172.21.15.120:0/2327812373 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.990+0000 7f6ac3400640 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fd0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.991+0000 7f6ac2a00640 1 -- 172.21.15.120:0/2327812373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 msgr2=0x557671fd0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.991+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fd0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.991+0000 7f6ac2a00640 1 -- 172.21.15.120:0/2327812373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 msgr2=0x557671fd7580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:32:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.991+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 0x557671fd7580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.991+0000 7f6ac2a00640 1 -- 172.21.15.120:0/2327812373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557671c46210 con 0x557671c052f0 2024-05-14T09:32:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.992+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd0680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40057c0 tx=0x7f6ab4004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17613d1d84945fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.992+0000 7f6aaf400640 1 -- 172.21.15.120:0/2327812373 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4036040 con 0x557671c052f0 2024-05-14T09:32:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.992+0000 7f6aaf400640 1 -- 172.21.15.120:0/2327812373 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab4003a80 con 0x557671c052f0 2024-05-14T09:32:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.992+0000 7f6aaf400640 1 -- 172.21.15.120:0/2327812373 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4030c80 con 0x557671c052f0 2024-05-14T09:32:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.993+0000 7f6abb400640 1 -- 172.21.15.120:0/669560137 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6ab0010430 con 0x7f6ac410bcc0 2024-05-14T09:32:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.993+0000 7f6ad064c740 1 -- 172.21.15.120:0/2327812373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 msgr2=0x557671fd0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.993+0000 7f6ad064c740 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd0680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40057c0 tx=0x7f6ab4004260 comp rx=0 tx=0).stop 2024-05-14T09:32:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.994+0000 7f6ad064c740 1 -- 172.21.15.120:0/2327812373 shutdown_connections 2024-05-14T09:32:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.994+0000 7f6ad064c740 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 0x557671fd7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.994+0000 7f6ad064c740 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd0680 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.994+0000 7f6ad064c740 1 --2- 172.21.15.120:0/2327812373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fd0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.994+0000 7f6ad064c740 1 -- 172.21.15.120:0/2327812373 >> 172.21.15.120:0/2327812373 conn(0x557671c22300 msgr2=0x557671fcba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.995+0000 7f6ad064c740 1 -- 172.21.15.120:0/2327812373 shutdown_connections 2024-05-14T09:32:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.995+0000 7f6abb400640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6aa80b2830 0x7f6aa80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.995+0000 7f6ad064c740 1 -- 172.21.15.120:0/2327812373 wait complete. 2024-05-14T09:32:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.996+0000 7f6abb400640 1 -- 172.21.15.120:0/669560137 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6ab00e2820 con 0x7f6ac410bcc0 2024-05-14T09:32:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.996+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6aa80b2830 0x7f6aa80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.996+0000 7f6ad064c740 1 -- start start 2024-05-14T09:32:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.997+0000 7f6ad064c740 1 Processor -- start 2024-05-14T09:32:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.997+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6aa80b2830 0x7f6aa80b4d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40041a0 tx=0x7f6ab4005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.998+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 0x557671fda190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fe1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ad064c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557671fd8010 con 0x557671c052f0 2024-05-14T09:32:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ad064c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557671eed660 con 0x557671c0d4d0 2024-05-14T09:32:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ad064c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557671fd8190 con 0x557671c2e1b0 2024-05-14T09:32:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ad064c740 10 client.0 _ll_register_callbacks cb 0x557671eb7400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38256/0 (socket says 172.21.15.120:38256) 2024-05-14T09:32:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ac2a00640 1 -- 172.21.15.120:0/1811260520 learned_addr learned my addr 172.21.15.120:0/1811260520 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ac3400640 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fe1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:17.999+0000 7f6ac2000640 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 0x557671fda190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.000+0000 7f6ac3400640 1 -- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 msgr2=0x557671fda190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.000+0000 7f6ac3400640 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 0x557671fda190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.000+0000 7f6ac3400640 1 -- 172.21.15.120:0/1811260520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 msgr2=0x557671fd9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.000+0000 7f6ac3400640 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.000+0000 7f6ac3400640 1 -- 172.21.15.120:0/1811260520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557671d12620 con 0x557671c2e1b0 2024-05-14T09:32:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.001+0000 7f6ac3400640 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fe1080 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005fd0 tx=0x7f6abc00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da4d9fd4d36189d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.001+0000 7f6aa3e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:32:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.001+0000 7f6aa3e00640 1 -- 172.21.15.120:0/1811260520 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc004b20 con 0x557671c2e1b0 2024-05-14T09:32:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.001+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ab4003a80 con 0x557671c2e1b0 2024-05-14T09:32:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.001+0000 7f6aa3e00640 1 -- 172.21.15.120:0/1811260520 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6abc004cc0 con 0x557671c2e1b0 2024-05-14T09:32:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.002+0000 7f6aa3e00640 1 -- 172.21.15.120:0/1811260520 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f6abc025050 con 0x557671c2e1b0 2024-05-14T09:32:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.002+0000 7f6ad064c740 10 client.26347 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.002+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557671fe4020 con 0x557671c2e1b0 2024-05-14T09:32:18.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.002+0000 7f6aa3e00640 1 -- 172.21.15.120:0/1811260520 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab4003a80 con 0x557671c2e1b0 2024-05-14T09:32:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.003+0000 7f6aa3e00640 1 -- 172.21.15.120:0/1811260520 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f6abc019070 con 0x557671c2e1b0 2024-05-14T09:32:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.003+0000 7f6ad064c740 10 client.26347 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.003+0000 7f6ad064c740 10 client.26347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.003+0000 7f6ad064c740 20 client.26347 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.004+0000 7f6ad064c740 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671becd80 0x557671fe7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.004+0000 7f6ad064c740 4 client.26347 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:32:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.004+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557671f42160 con 0x557671becd80 2024-05-14T09:32:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.004+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671becd80 0x557671fe7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.006+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671becd80 0x557671fe7780 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363d84052857b507 server_cookie=ffde845c541170d5 in_seq=0 out_seq=0 2024-05-14T09:32:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.006+0000 7f6aa3e00640 10 client.26347 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.008+0000 7f6aa3e00640 1 -- 172.21.15.120:0/1811260520 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557671f42160 con 0x557671becd80 2024-05-14T09:32:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.008+0000 7f6aa3e00640 10 client.26347 handle_command_reply: tid=0 2024-05-14T09:32:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.008+0000 7f6ad064c740 1 client.26347 shutdown 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.008+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 msgr2=0x557671fe1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.008+0000 7f6ad064c740 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fe1080 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005fd0 tx=0x7f6abc00f790 comp rx=0 tx=0).stop 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 shutdown_connections 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671becd80 0x557671fe7780 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c2e1b0 0x557671fe1080 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c0d4d0 0x557671fda190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6aa3e00640 0 client.26347 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 --2- 172.21.15.120:0/1811260520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fd9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 >> 172.21.15.120:0/1811260520 conn(0x557671c22300 msgr2=0x557671fce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 shutdown_connections 2024-05-14T09:32:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.009+0000 7f6ad064c740 1 -- 172.21.15.120:0/1811260520 wait complete. 2024-05-14T09:32:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.010+0000 7f6ad064c740 20 client.26347 trim_cache size 0 max 16384 2024-05-14T09:32:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 Processor -- start 2024-05-14T09:32:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 -- start start 2024-05-14T09:32:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c052f0 0x557671fda360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fe0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c2e1b0 0x557671fe14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41bb890 con 0x557671c2e1b0 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41bd430 con 0x557671c052f0 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.050+0000 7f6ad064c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41bbfc0 con 0x557671c0d4d0 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.051+0000 7f6ac3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c2e1b0 0x557671fe14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.051+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c052f0 0x557671fda360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.051+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c052f0 0x557671fda360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37974/0 (socket says 172.21.15.120:37974) 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.051+0000 7f6ac2a00640 1 -- 172.21.15.120:0/987120052 learned_addr learned my addr 172.21.15.120:0/987120052 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.051+0000 7f6ac2000640 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fe0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.052+0000 7f6ac2a00640 1 -- 172.21.15.120:0/987120052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 msgr2=0x557671fe0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.052+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fe0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.052+0000 7f6ac2a00640 1 -- 172.21.15.120:0/987120052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c2e1b0 msgr2=0x557671fe14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.052+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c2e1b0 0x557671fe14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.052+0000 7f6ac2a00640 1 -- 172.21.15.120:0/987120052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557671fd7470 con 0x557671c052f0 2024-05-14T09:32:18.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.052+0000 7f6ac2000640 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fe0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:18.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.053+0000 7f6ac3400640 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c2e1b0 0x557671fe14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:32:18.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.053+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c052f0 0x557671fda360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400a340 tx=0x7f6ab4004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c840a884f91510c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:18.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.053+0000 7f6aaea00640 1 -- 172.21.15.120:0/987120052 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40035f0 con 0x557671c052f0 2024-05-14T09:32:18.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.053+0000 7f6aaea00640 1 -- 172.21.15.120:0/987120052 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab40308d0 con 0x557671c052f0 2024-05-14T09:32:18.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.053+0000 7f6aaea00640 1 -- 172.21.15.120:0/987120052 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab405e710 con 0x557671c052f0 2024-05-14T09:32:18.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 -- 172.21.15.120:0/987120052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c052f0 msgr2=0x557671fda360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:18.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c052f0 0x557671fda360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400a340 tx=0x7f6ab4004260 comp rx=0 tx=0).stop 2024-05-14T09:32:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 -- 172.21.15.120:0/987120052 shutdown_connections 2024-05-14T09:32:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c2e1b0 0x557671fe14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fe0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 --2- 172.21.15.120:0/987120052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c052f0 0x557671fda360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 -- 172.21.15.120:0/987120052 >> 172.21.15.120:0/987120052 conn(0x557671c22300 msgr2=0x557671fd9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 -- 172.21.15.120:0/987120052 shutdown_connections 2024-05-14T09:32:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.055+0000 7f6ad064c740 1 -- 172.21.15.120:0/987120052 wait complete. 2024-05-14T09:32:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.056+0000 7f6ad064c740 1 -- start start 2024-05-14T09:32:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.056+0000 7f6ad064c740 1 Processor -- start 2024-05-14T09:32:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.057+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fde730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.057+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fdec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.057+0000 7f6ad064c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c2e1b0 0x55767204dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.058+0000 7f6ad064c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41bcd60 con 0x557671c052f0 2024-05-14T09:32:18.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.058+0000 7f6ad064c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41bc690 con 0x557671c2e1b0 2024-05-14T09:32:18.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.058+0000 7f6ad064c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41b9890 con 0x557671c0d4d0 2024-05-14T09:32:18.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.058+0000 7f6ad064c740 10 client.0 _ll_register_callbacks cb 0x7f6abc009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:18.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.059+0000 7f6ac3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c2e1b0 0x55767204dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.059+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fde730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.059+0000 7f6ac2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fde730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38270/0 (socket says 172.21.15.120:38270) 2024-05-14T09:32:18.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.059+0000 7f6ac2a00640 1 -- 172.21.15.120:0/3012932501 learned_addr learned my addr 172.21.15.120:0/3012932501 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:18.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.059+0000 7f6ac2000640 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fdec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.060+0000 7f6ac2a00640 1 -- 172.21.15.120:0/3012932501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 msgr2=0x557671fdec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:18.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.060+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fdec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.060+0000 7f6ac2a00640 1 -- 172.21.15.120:0/3012932501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c2e1b0 msgr2=0x55767204dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:18.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.060+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c2e1b0 0x55767204dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.060+0000 7f6ac2a00640 1 -- 172.21.15.120:0/3012932501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55767204e000 con 0x557671c052f0 2024-05-14T09:32:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.062+0000 7f6ac2a00640 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fde730 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4004370 tx=0x7f6ab400a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b0b95d7bf42f5f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.063+0000 7f6aa3e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:32:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.063+0000 7f6aa3e00640 1 -- 172.21.15.120:0/3012932501 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab406c060 con 0x557671c052f0 2024-05-14T09:32:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.063+0000 7f6aa3e00640 1 -- 172.21.15.120:0/3012932501 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6ab4030c80 con 0x557671c052f0 2024-05-14T09:32:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.063+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ab40308d0 con 0x557671c052f0 2024-05-14T09:32:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.064+0000 7f6aa3e00640 1 -- 172.21.15.120:0/3012932501 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f6ab4073050 con 0x557671c052f0 2024-05-14T09:32:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.064+0000 7f6ad064c740 10 client.16818 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.064+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55767204f140 con 0x557671c052f0 2024-05-14T09:32:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6aa3e00640 1 -- 172.21.15.120:0/3012932501 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab40308d0 con 0x557671c052f0 2024-05-14T09:32:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6aa3e00640 1 -- 172.21.15.120:0/3012932501 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f6ab405b070 con 0x557671c052f0 2024-05-14T09:32:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6ad064c740 10 client.16818 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6ad064c740 10 client.16818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6ad064c740 20 client.16818 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6ad064c740 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671bc21c0 0x5576720516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6ad064c740 4 client.16818 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:32:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.065+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557671f3bfd0 con 0x557671bc21c0 2024-05-14T09:32:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.066+0000 7f6ac2000640 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671bc21c0 0x5576720516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.066+0000 7f6ac2000640 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671bc21c0 0x5576720516f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a60c5b88526bc4d3 server_cookie=e6b4e014bef70235 in_seq=0 out_seq=0 2024-05-14T09:32:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.066+0000 7f6aa3e00640 10 client.16818 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6aa3e00640 1 -- 172.21.15.120:0/3012932501 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557671f3bfd0 con 0x557671bc21c0 2024-05-14T09:32:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6aa3e00640 10 client.16818 handle_command_reply: tid=0 2024-05-14T09:32:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 client.16818 shutdown 2024-05-14T09:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 msgr2=0x557671fde730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fde730 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4004370 tx=0x7f6ab400a370 comp rx=0 tx=0).stop 2024-05-14T09:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 shutdown_connections 2024-05-14T09:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557671bc21c0 0x5576720516f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557671c2e1b0 0x55767204dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557671c0d4d0 0x557671fdec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 --2- 172.21.15.120:0/3012932501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557671c052f0 0x557671fde730 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.091+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 >> 172.21.15.120:0/3012932501 conn(0x557671c22300 msgr2=0x557671fce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.092+0000 7f6aa3e00640 0 client.16818 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.092+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 shutdown_connections 2024-05-14T09:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.092+0000 7f6ad064c740 1 -- 172.21.15.120:0/3012932501 wait complete. 2024-05-14T09:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.092+0000 7f6ad064c740 20 client.16818 trim_cache size 0 max 16384 2024-05-14T09:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:32:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:32:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:32:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:32:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.093+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6aa80b2830 msgr2=0x7f6aa80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.093+0000 7f6ac9600640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6aa80b2830 0x7f6aa80b4d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40041a0 tx=0x7f6ab4005720 comp rx=0 tx=0).stop 2024-05-14T09:32:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.093+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac410bcc0 msgr2=0x7f6ac41a9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.093+0000 7f6ac9600640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac410bcc0 0x7f6ac41a9700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e9f0 tx=0x7f6ab000eeb0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 shutdown_connections 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6aa80b2830 0x7f6aa80b4d40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ac41109c0 0x7f6ac41b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac410bcc0 0x7f6ac41a9700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 --2- 172.21.15.120:0/669560137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ac410ae50 0x7f6ac41a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 >> 172.21.15.120:0/669560137 conn(0x7f6ac4070a90 msgr2=0x7f6ac410c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 shutdown_connections 2024-05-14T09:32:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:18.094+0000 7f6ac9600640 1 -- 172.21.15.120:0/669560137 wait complete. 2024-05-14T09:32:18.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:17 smithi120 ceph-mon[31085]: pgmap v818: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.1 MiB/s wr, 821 op/s 2024-05-14T09:32:18.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:17 smithi152 ceph-mon[34868]: pgmap v818: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.1 MiB/s wr, 821 op/s 2024-05-14T09:32:18.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:17 smithi175 ceph-mon[35353]: pgmap v818: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.1 MiB/s wr, 821 op/s 2024-05-14T09:32:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 285.0 s, 746.6 tps, lat 134.058 ms stddev 38.416 2024-05-14T09:32:20.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:19 smithi120 ceph-mon[31085]: pgmap v819: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-05-14T09:32:20.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:19 smithi152 ceph-mon[34868]: pgmap v819: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-05-14T09:32:20.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:19 smithi175 ceph-mon[35353]: pgmap v819: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-05-14T09:32:22.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:21 smithi120 ceph-mon[31085]: pgmap v820: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-05-14T09:32:22.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:21 smithi152 ceph-mon[34868]: pgmap v820: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-05-14T09:32:22.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:21 smithi175 ceph-mon[35353]: pgmap v820: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-05-14T09:32:24.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:23 smithi120 ceph-mon[31085]: pgmap v821: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 724 op/s 2024-05-14T09:32:24.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:23 smithi152 ceph-mon[34868]: pgmap v821: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 724 op/s 2024-05-14T09:32:24.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:23 smithi175 ceph-mon[35353]: pgmap v821: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 724 op/s 2024-05-14T09:32:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 290.0 s, 642.0 tps, lat 155.582 ms stddev 46.344 2024-05-14T09:32:26.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:25 smithi120 ceph-mon[31085]: pgmap v822: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 763 op/s 2024-05-14T09:32:26.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:25 smithi152 ceph-mon[34868]: pgmap v822: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 763 op/s 2024-05-14T09:32:26.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:25 smithi175 ceph-mon[35353]: pgmap v822: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 763 op/s 2024-05-14T09:32:28.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:27 smithi152 ceph-mon[34868]: pgmap v823: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 712 op/s 2024-05-14T09:32:28.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:27 smithi175 ceph-mon[35353]: pgmap v823: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 712 op/s 2024-05-14T09:32:28.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:27 smithi120 ceph-mon[31085]: pgmap v823: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 712 op/s 2024-05-14T09:32:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 295.0 s, 647.8 tps, lat 153.787 ms stddev 50.150 2024-05-14T09:32:30.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:29 smithi152 ceph-mon[34868]: pgmap v824: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 732 op/s 2024-05-14T09:32:30.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:29 smithi175 ceph-mon[35353]: pgmap v824: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 732 op/s 2024-05-14T09:32:30.383 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:29 smithi120 ceph-mon[31085]: pgmap v824: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 732 op/s 2024-05-14T09:32:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.457+0000 7fbb92200640 1 -- 172.21.15.120:0/1588124960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 msgr2=0x7fbb8c10be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.457+0000 7fbb92200640 1 --2- 172.21.15.120:0/1588124960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c10be20 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009ca0 tx=0x7fbb8402a8c0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.458+0000 7fbb92200640 1 -- 172.21.15.120:0/1588124960 shutdown_connections 2024-05-14T09:32:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.458+0000 7fbb92200640 1 --2- 172.21.15.120:0/1588124960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c10be20 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.458+0000 7fbb92200640 1 --2- 172.21.15.120:0/1588124960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c1070a0 0x7fbb8c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.458+0000 7fbb92200640 1 --2- 172.21.15.120:0/1588124960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb8c104740 0x7fbb8c106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.458+0000 7fbb92200640 1 -- 172.21.15.120:0/1588124960 >> 172.21.15.120:0/1588124960 conn(0x7fbb8c0fdd40 msgr2=0x7fbb8c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.458+0000 7fbb92200640 1 -- 172.21.15.120:0/1588124960 shutdown_connections 2024-05-14T09:32:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.458+0000 7fbb92200640 1 -- 172.21.15.120:0/1588124960 wait complete. 2024-05-14T09:32:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 Processor -- start 2024-05-14T09:32:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 -- start start 2024-05-14T09:32:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c104740 0x7fbb8c1a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb8c1070a0 0x7fbb8c1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c1a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c1118b0 con 0x7fbb8c109a00 2024-05-14T09:32:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c111730 con 0x7fbb8c104740 2024-05-14T09:32:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.460+0000 7fbb92200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c111a30 con 0x7fbb8c1070a0 2024-05-14T09:32:31.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.461+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c1a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.461+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c1a7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37486/0 (socket says 172.21.15.120:37486) 2024-05-14T09:32:31.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.461+0000 7fbb8be00640 1 -- 172.21.15.120:0/1091565393 learned_addr learned my addr 172.21.15.120:0/1091565393 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:31.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.461+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb8c1070a0 0x7fbb8c1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.461+0000 7fbb8b400640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c104740 0x7fbb8c1a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.462+0000 7fbb8aa00640 1 -- 172.21.15.120:0/1091565393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c104740 msgr2=0x7fbb8c1a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.462+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c104740 0x7fbb8c1a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.462+0000 7fbb8aa00640 1 -- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 msgr2=0x7fbb8c1a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.462+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c1a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.462+0000 7fbb8aa00640 1 -- 172.21.15.120:0/1091565393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c1a8360 con 0x7fbb8c1070a0 2024-05-14T09:32:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.462+0000 7fbb8be00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c1a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:32:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.462+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb8c1070a0 0x7fbb8c1a0d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800d6d0 tx=0x7fbb7800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.463+0000 7fbb83e00640 1 -- 172.21.15.120:0/1091565393 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78017070 con 0x7fbb8c1070a0 2024-05-14T09:32:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.463+0000 7fbb83e00640 1 -- 172.21.15.120:0/1091565393 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb78009820 con 0x7fbb8c1070a0 2024-05-14T09:32:31.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.463+0000 7fbb83e00640 1 -- 172.21.15.120:0/1091565393 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78004bc0 con 0x7fbb8c1070a0 2024-05-14T09:32:31.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.463+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c1a8650 con 0x7fbb8c1070a0 2024-05-14T09:32:31.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.463+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c1a8b50 con 0x7fbb8c1070a0 2024-05-14T09:32:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.469+0000 7fbb991bc740 1 Processor -- start 2024-05-14T09:32:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.470+0000 7fbb991bc740 1 -- start start 2024-05-14T09:32:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.471+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6aca2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.471+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8d72f0 0x55ea6aca2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.471+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8df4d0 0x55ea6aca9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.471+0000 7fbb991bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ea6ac06550 con 0x55ea6a8df4d0 2024-05-14T09:32:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.471+0000 7fbb991bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea6ababbc0 con 0x55ea6a8d72f0 2024-05-14T09:32:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.471+0000 7fbb991bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea6ac02510 con 0x55ea6a9001b0 2024-05-14T09:32:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.472+0000 7fbb8b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8d72f0 0x55ea6aca2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.472+0000 7fbb8b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8d72f0 0x55ea6aca2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41732/0 (socket says 172.21.15.120:41732) 2024-05-14T09:32:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.472+0000 7fbb8b400640 1 -- 172.21.15.120:0/2135503473 learned_addr learned my addr 172.21.15.120:0/2135503473 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.473+0000 7fbb8be00640 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6aca2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.474+0000 7fbb8b400640 1 -- 172.21.15.120:0/2135503473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 msgr2=0x55ea6aca2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.474+0000 7fbb8b400640 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6aca2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.474+0000 7fbb8b400640 1 -- 172.21.15.120:0/2135503473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8df4d0 msgr2=0x55ea6aca9580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:32:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.474+0000 7fbb8b400640 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8df4d0 0x55ea6aca9580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.474+0000 7fbb8b400640 1 -- 172.21.15.120:0/2135503473 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea6a918210 con 0x55ea6a8d72f0 2024-05-14T09:32:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.474+0000 7fbb8b400640 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8d72f0 0x55ea6aca2680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00bd10 tx=0x7fbb7c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e9d2805c4fa74f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.475+0000 7fbb77e00640 1 -- 172.21.15.120:0/2135503473 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c005220 con 0x55ea6a8d72f0 2024-05-14T09:32:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.475+0000 7fbb77e00640 1 -- 172.21.15.120:0/2135503473 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb7c004c30 con 0x55ea6a8d72f0 2024-05-14T09:32:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.475+0000 7fbb77e00640 1 -- 172.21.15.120:0/2135503473 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0116a0 con 0x55ea6a8d72f0 2024-05-14T09:32:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.479+0000 7fbb991bc740 1 -- 172.21.15.120:0/2135503473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8d72f0 msgr2=0x55ea6aca2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.479+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8d72f0 0x55ea6aca2680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00bd10 tx=0x7fbb7c0107a0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.479+0000 7fbb991bc740 1 -- 172.21.15.120:0/2135503473 shutdown_connections 2024-05-14T09:32:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.479+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8df4d0 0x55ea6aca9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.479+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8d72f0 0x55ea6aca2680 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00bd10 tx=0x7fbb7c0107a0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.479+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2135503473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6aca2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.479+0000 7fbb991bc740 1 -- 172.21.15.120:0/2135503473 >> 172.21.15.120:0/2135503473 conn(0x55ea6a8f4300 msgr2=0x55ea6ac9da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.480+0000 7fbb83e00640 1 -- 172.21.15.120:0/1091565393 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fbb78005220 con 0x7fbb8c1070a0 2024-05-14T09:32:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.481+0000 7fbb991bc740 1 -- 172.21.15.120:0/2135503473 shutdown_connections 2024-05-14T09:32:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.481+0000 7fbb991bc740 1 -- 172.21.15.120:0/2135503473 wait complete. 2024-05-14T09:32:31.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.482+0000 7fbb991bc740 1 -- start start 2024-05-14T09:32:31.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.483+0000 7fbb991bc740 1 Processor -- start 2024-05-14T09:32:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.484+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a9001b0 0x55ea6acabec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.484+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8bed80 0x55ea6acac400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.485+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acb3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.485+0000 7fbb991bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ea6aca9fd0 con 0x55ea6a8bed80 2024-05-14T09:32:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.485+0000 7fbb991bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea6abbf660 con 0x55ea6a9001b0 2024-05-14T09:32:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.485+0000 7fbb991bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea6acaa150 con 0x55ea6a8941c0 2024-05-14T09:32:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.485+0000 7fbb991bc740 10 client.0 _ll_register_callbacks cb 0x55ea6ab89400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.486+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a9001b0 0x55ea6acabec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.486+0000 7fbb83e00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb700b27f0 0x7fbb700b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.486+0000 7fbb8aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acb3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.486+0000 7fbb8aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acb3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44096/0 (socket says 172.21.15.120:44096) 2024-05-14T09:32:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.486+0000 7fbb8aa00640 1 -- 172.21.15.120:0/1021214775 learned_addr learned my addr 172.21.15.120:0/1021214775 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.486+0000 7fbb8b400640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8bed80 0x55ea6acac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.487+0000 7fbb8be00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb700b27f0 0x7fbb700b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.487+0000 7fbb8b400640 1 -- 172.21.15.120:0/1021214775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 msgr2=0x55ea6acb3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.487+0000 7fbb8b400640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acb3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.487+0000 7fbb8b400640 1 -- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a9001b0 msgr2=0x55ea6acabec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.487+0000 7fbb8b400640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a9001b0 0x55ea6acabec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.487+0000 7fbb8b400640 1 -- 172.21.15.120:0/1021214775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea6a9e4620 con 0x55ea6a8bed80 2024-05-14T09:32:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.488+0000 7fbb83e00640 1 -- 172.21.15.120:0/1091565393 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fbb780e1f90 con 0x7fbb8c1070a0 2024-05-14T09:32:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.488+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acb3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:32:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.488+0000 7fbb8b400640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8bed80 0x55ea6acac400 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55ea6aca2f00 tx=0x7fbb7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24a0e0c6e9b392f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.488+0000 7fbb8be00640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a9001b0 0x55ea6acabec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.488+0000 7fbb74c00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:32:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.489+0000 7fbb74c00640 1 -- 172.21.15.120:0/1021214775 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c02a060 con 0x55ea6a8bed80 2024-05-14T09:32:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.489+0000 7fbb74c00640 1 -- 172.21.15.120:0/1021214775 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fbb7c004ff0 con 0x55ea6a8bed80 2024-05-14T09:32:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.490+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb7c004c30 con 0x55ea6a8bed80 2024-05-14T09:32:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.490+0000 7fbb8be00640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb700b27f0 0x7fbb700b4d00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbb84031840 tx=0x7fbb840095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.491+0000 7fbb74c00640 1 -- 172.21.15.120:0/1021214775 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbb7c02a060 con 0x55ea6a8bed80 2024-05-14T09:32:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.491+0000 7fbb991bc740 10 client.16827 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.491+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ea6acb6290 con 0x55ea6a8bed80 2024-05-14T09:32:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.491+0000 7fbb74c00640 1 -- 172.21.15.120:0/1021214775 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb7c004c30 con 0x55ea6a8bed80 2024-05-14T09:32:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.491+0000 7fbb74c00640 1 -- 172.21.15.120:0/1021214775 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fbb7c003790 con 0x55ea6a8bed80 2024-05-14T09:32:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.492+0000 7fbb991bc740 10 client.16827 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.492+0000 7fbb991bc740 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.492+0000 7fbb991bc740 20 client.16827 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.492+0000 7fbb991bc740 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6acb76a0 0x55ea6acb9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.492+0000 7fbb991bc740 4 client.16827 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:32:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.492+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea6ac14160 con 0x55ea6acb76a0 2024-05-14T09:32:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.493+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6acb76a0 0x55ea6acb9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.496+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6acb76a0 0x55ea6acb9ac0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b8bef55f213375 server_cookie=7bf0163daec9ef4c in_seq=0 out_seq=0 2024-05-14T09:32:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.496+0000 7fbb74c00640 10 client.16827 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.497+0000 7fbb74c00640 1 -- 172.21.15.120:0/1021214775 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ea6ac14160 con 0x55ea6acb76a0 2024-05-14T09:32:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.497+0000 7fbb74c00640 10 client.16827 handle_command_reply: tid=0 2024-05-14T09:32:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.497+0000 7fbb991bc740 1 client.16827 shutdown 2024-05-14T09:32:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.498+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8bed80 msgr2=0x55ea6acac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.498+0000 7fbb991bc740 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8bed80 0x55ea6acac400 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55ea6aca2f00 tx=0x7fbb7c0048f0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.499+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 shutdown_connections 2024-05-14T09:32:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.499+0000 7fbb991bc740 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6acb76a0 0x55ea6acb9ac0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.499+0000 7fbb991bc740 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acb3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.499+0000 7fbb991bc740 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8bed80 0x55ea6acac400 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.499+0000 7fbb74c00640 0 client.16827 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.499+0000 7fbb991bc740 1 --2- 172.21.15.120:0/1021214775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a9001b0 0x55ea6acabec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.499+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 >> 172.21.15.120:0/1021214775 conn(0x55ea6a8f4300 msgr2=0x55ea6aca09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:31.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.500+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 shutdown_connections 2024-05-14T09:32:31.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.500+0000 7fbb991bc740 1 -- 172.21.15.120:0/1021214775 wait complete. 2024-05-14T09:32:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.500+0000 7fbb991bc740 20 client.16827 trim_cache size 0 max 16384 2024-05-14T09:32:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.537+0000 7fbb991bc740 1 Processor -- start 2024-05-14T09:32:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.537+0000 7fbb991bc740 1 -- start start 2024-05-14T09:32:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.537+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8941c0 0x55ea6acaab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.537+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6aca5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.537+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6acb32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.537+0000 7fbb991bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c1b30a0 con 0x55ea6a8941c0 2024-05-14T09:32:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.537+0000 7fbb991bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c1b4c40 con 0x55ea6a8bed80 2024-05-14T09:32:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.538+0000 7fbb991bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c1b37d0 con 0x55ea6a9001b0 2024-05-14T09:32:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.538+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6acb32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.538+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6acb32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44100/0 (socket says 172.21.15.120:44100) 2024-05-14T09:32:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.538+0000 7fbb8be00640 1 -- 172.21.15.120:0/2826468064 learned_addr learned my addr 172.21.15.120:0/2826468064 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.538+0000 7fbb8b400640 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8941c0 0x55ea6acaab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.539+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6aca5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.539+0000 7fbb8be00640 1 -- 172.21.15.120:0/2826468064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 msgr2=0x55ea6aca5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.539+0000 7fbb8be00640 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6aca5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.539+0000 7fbb8be00640 1 -- 172.21.15.120:0/2826468064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8941c0 msgr2=0x55ea6acaab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.539+0000 7fbb8be00640 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8941c0 0x55ea6acaab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.539+0000 7fbb8be00640 1 -- 172.21.15.120:0/2826468064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea6aca9eb0 con 0x55ea6a9001b0 2024-05-14T09:32:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.539+0000 7fbb8b400640 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8941c0 0x55ea6acaab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:32:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.540+0000 7fbb8be00640 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6acb32f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb8402ade0 tx=0x7fbb84005d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c6938f32ec82c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.540+0000 7fbb77400640 1 -- 172.21.15.120:0/2826468064 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84045040 con 0x55ea6a9001b0 2024-05-14T09:32:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.540+0000 7fbb77400640 1 -- 172.21.15.120:0/2826468064 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb84036040 con 0x55ea6a9001b0 2024-05-14T09:32:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.540+0000 7fbb77400640 1 -- 172.21.15.120:0/2826468064 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8404b680 con 0x55ea6a9001b0 2024-05-14T09:32:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.541+0000 7fbb991bc740 1 -- 172.21.15.120:0/2826468064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 msgr2=0x55ea6acb32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.541+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6acb32f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb8402ade0 tx=0x7fbb84005d80 comp rx=0 tx=0).stop 2024-05-14T09:32:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.541+0000 7fbb991bc740 1 -- 172.21.15.120:0/2826468064 shutdown_connections 2024-05-14T09:32:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.541+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a9001b0 0x55ea6acb32f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.541+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6aca5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.542+0000 7fbb991bc740 1 --2- 172.21.15.120:0/2826468064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a8941c0 0x55ea6acaab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.542+0000 7fbb991bc740 1 -- 172.21.15.120:0/2826468064 >> 172.21.15.120:0/2826468064 conn(0x55ea6a8f4300 msgr2=0x55ea6aca5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.542+0000 7fbb991bc740 1 -- 172.21.15.120:0/2826468064 shutdown_connections 2024-05-14T09:32:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.542+0000 7fbb991bc740 1 -- 172.21.15.120:0/2826468064 wait complete. 2024-05-14T09:32:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.543+0000 7fbb991bc740 1 -- start start 2024-05-14T09:32:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.543+0000 7fbb991bc740 1 Processor -- start 2024-05-14T09:32:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6acaedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb991bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a9001b0 0x55ea6ad30c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb991bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c1b4570 con 0x55ea6a9001b0 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb991bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c1b3ea0 con 0x55ea6a8bed80 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb991bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c1b10a0 con 0x55ea6a8941c0 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb991bc740 10 client.0 _ll_register_callbacks cb 0x7fbb84004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb8b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb8b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44106/0 (socket says 172.21.15.120:44106) 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb8b400640 1 -- 172.21.15.120:0/226404765 learned_addr learned my addr 172.21.15.120:0/226404765 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6acaedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.544+0000 7fbb8be00640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a9001b0 0x55ea6ad30c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.545+0000 7fbb8b400640 1 -- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 msgr2=0x55ea6acaedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.545+0000 7fbb8b400640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6acaedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.545+0000 7fbb8b400640 1 -- 172.21.15.120:0/226404765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a9001b0 msgr2=0x55ea6ad30c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.545+0000 7fbb8b400640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a9001b0 0x55ea6ad30c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.545+0000 7fbb8b400640 1 -- 172.21.15.120:0/226404765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea6acb3d80 con 0x55ea6a8941c0 2024-05-14T09:32:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.545+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6acaedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.546+0000 7fbb8b400640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acae870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00b6c0 tx=0x7fbb7c004b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fbcb1adbb78cf19 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.546+0000 7fbb74c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:32:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.547+0000 7fbb74c00640 1 -- 172.21.15.120:0/226404765 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c004c30 con 0x55ea6a8941c0 2024-05-14T09:32:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.547+0000 7fbb74c00640 1 -- 172.21.15.120:0/226404765 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fbb7c034040 con 0x55ea6a8941c0 2024-05-14T09:32:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.547+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb84036040 con 0x55ea6a8941c0 2024-05-14T09:32:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.548+0000 7fbb74c00640 1 -- 172.21.15.120:0/226404765 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbb7c00b410 con 0x55ea6a8941c0 2024-05-14T09:32:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.548+0000 7fbb991bc740 10 client.26371 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.548+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ea6ad32120 con 0x55ea6a8941c0 2024-05-14T09:32:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.548+0000 7fbb74c00640 1 -- 172.21.15.120:0/226404765 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb84036040 con 0x55ea6a8941c0 2024-05-14T09:32:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb74c00640 1 -- 172.21.15.120:0/226404765 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fbb7c004000 con 0x55ea6a8941c0 2024-05-14T09:32:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb991bc740 10 client.26371 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb991bc740 10 client.26371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb991bc740 20 client.26371 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb991bc740 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6ad32ad0 0x55ea6ad34ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb991bc740 4 client.26371 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:32:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea6ac0dfd0 con 0x55ea6ad32ad0 2024-05-14T09:32:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.549+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6ad32ad0 0x55ea6ad34ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.551+0000 7fbb8aa00640 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6ad32ad0 0x55ea6ad34ef0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e4267d63a573562 server_cookie=13379bf982e417fc in_seq=0 out_seq=0 2024-05-14T09:32:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.551+0000 7fbb74c00640 10 client.26371 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.571+0000 7fbb74c00640 1 -- 172.21.15.120:0/226404765 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ea6ac0dfd0 con 0x55ea6ad32ad0 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.571+0000 7fbb74c00640 10 client.26371 handle_command_reply: tid=0 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.571+0000 7fbb991bc740 1 client.26371 shutdown 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.571+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 msgr2=0x55ea6acae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.571+0000 7fbb991bc740 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acae870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00b6c0 tx=0x7fbb7c004b90 comp rx=0 tx=0).stop 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 shutdown_connections 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ea6ad32ad0 0x55ea6ad34ef0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb74c00640 0 client.26371 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ea6a9001b0 0x55ea6ad30c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea6a8bed80 0x55ea6acaedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 --2- 172.21.15.120:0/226404765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea6a8941c0 0x55ea6acae870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 >> 172.21.15.120:0/226404765 conn(0x55ea6a8f4300 msgr2=0x55ea6ac9d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 shutdown_connections 2024-05-14T09:32:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 1 -- 172.21.15.120:0/226404765 wait complete. 2024-05-14T09:32:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.572+0000 7fbb991bc740 20 client.26371 trim_cache size 0 max 16384 2024-05-14T09:32:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:32:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:32:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:32:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:32:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.574+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb700b27f0 msgr2=0x7fbb700b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.574+0000 7fbb92200640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb700b27f0 0x7fbb700b4d00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbb84031840 tx=0x7fbb840095c0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.574+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb8c1070a0 msgr2=0x7fbb8c1a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.574+0000 7fbb92200640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb8c1070a0 0x7fbb8c1a0d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800d6d0 tx=0x7fbb7800db90 comp rx=0 tx=0).stop 2024-05-14T09:32:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.575+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 shutdown_connections 2024-05-14T09:32:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.575+0000 7fbb92200640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fbb700b27f0 0x7fbb700b4d00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.575+0000 7fbb92200640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb8c109a00 0x7fbb8c1a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.575+0000 7fbb92200640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb8c1070a0 0x7fbb8c1a0d60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.575+0000 7fbb92200640 1 --2- 172.21.15.120:0/1091565393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c104740 0x7fbb8c1a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.575+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 >> 172.21.15.120:0/1091565393 conn(0x7fbb8c0fdd40 msgr2=0x7fbb8c105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.576+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 shutdown_connections 2024-05-14T09:32:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:31.576+0000 7fbb92200640 1 -- 172.21.15.120:0/1091565393 wait complete. 2024-05-14T09:32:32.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:31 smithi152 ceph-mon[34868]: pgmap v825: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-05-14T09:32:32.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:31 smithi175 ceph-mon[35353]: pgmap v825: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-05-14T09:32:32.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:31 smithi120 ceph-mon[31085]: pgmap v825: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-05-14T09:32:34.209 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:33 smithi152 ceph-mon[34868]: pgmap v826: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 616 op/s 2024-05-14T09:32:34.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:33 smithi175 ceph-mon[35353]: pgmap v826: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 616 op/s 2024-05-14T09:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 300.0 s, 594.6 tps, lat 168.660 ms stddev 86.388 2024-05-14T09:32:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:33 smithi120 ceph-mon[31085]: pgmap v826: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 616 op/s 2024-05-14T09:32:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:35 smithi152 ceph-mon[34868]: pgmap v827: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 639 op/s 2024-05-14T09:32:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:35 smithi175 ceph-mon[35353]: pgmap v827: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 639 op/s 2024-05-14T09:32:36.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:35 smithi120 ceph-mon[31085]: pgmap v827: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 639 op/s 2024-05-14T09:32:38.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:37 smithi152 ceph-mon[34868]: pgmap v828: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 635 op/s 2024-05-14T09:32:38.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:37 smithi175 ceph-mon[35353]: pgmap v828: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 635 op/s 2024-05-14T09:32:38.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:37 smithi120 ceph-mon[31085]: pgmap v828: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 635 op/s 2024-05-14T09:32:39.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 305.0 s, 627.4 tps, lat 158.466 ms stddev 57.701 2024-05-14T09:32:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:39 smithi152 ceph-mon[34868]: pgmap v829: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 689 op/s 2024-05-14T09:32:40.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:39 smithi175 ceph-mon[35353]: pgmap v829: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 689 op/s 2024-05-14T09:32:40.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:39 smithi120 ceph-mon[31085]: pgmap v829: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 689 op/s 2024-05-14T09:32:42.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:41 smithi152 ceph-mon[34868]: pgmap v830: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-05-14T09:32:42.231 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:41 smithi175 ceph-mon[35353]: pgmap v830: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-05-14T09:32:42.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:41 smithi120 ceph-mon[31085]: pgmap v830: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-05-14T09:32:43.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:42 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:32:43.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:42 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:32:43.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:42 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:32:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:43 smithi175 ceph-mon[35353]: pgmap v831: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2024-05-14T09:32:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 310.0 s, 590.0 tps, lat 170.256 ms stddev 48.362 2024-05-14T09:32:44.358 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:43 smithi152 ceph-mon[34868]: pgmap v831: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2024-05-14T09:32:44.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:43 smithi120 ceph-mon[31085]: pgmap v831: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2024-05-14T09:32:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.884+0000 7f4c76800640 1 -- 172.21.15.120:0/1964662937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 msgr2=0x7f4c701052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.884+0000 7f4c76800640 1 --2- 172.21.15.120:0/1964662937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701052c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009900 tx=0x7f4c5c02e810 comp rx=0 tx=0).stop 2024-05-14T09:32:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.885+0000 7f4c76800640 1 -- 172.21.15.120:0/1964662937 shutdown_connections 2024-05-14T09:32:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.885+0000 7f4c76800640 1 --2- 172.21.15.120:0/1964662937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c70109bb0 0x7f4c7010bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.885+0000 7f4c76800640 1 --2- 172.21.15.120:0/1964662937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701052c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.885+0000 7f4c76800640 1 --2- 172.21.15.120:0/1964662937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c70103c70 0x7f4c70104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.885+0000 7f4c76800640 1 -- 172.21.15.120:0/1964662937 >> 172.21.15.120:0/1964662937 conn(0x7f4c700fee60 msgr2=0x7f4c70101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.885+0000 7f4c76800640 1 -- 172.21.15.120:0/1964662937 shutdown_connections 2024-05-14T09:32:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.885+0000 7f4c76800640 1 -- 172.21.15.120:0/1964662937 wait complete. 2024-05-14T09:32:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 Processor -- start 2024-05-14T09:32:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 -- start start 2024-05-14T09:32:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c70103c70 0x7f4c70198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c70109bb0 0x7f4c7019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7010d4a0 con 0x7f4c70103c70 2024-05-14T09:32:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7010d320 con 0x7f4c70109bb0 2024-05-14T09:32:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.887+0000 7f4c76800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7010d620 con 0x7f4c70104eb0 2024-05-14T09:32:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.888+0000 7f4c6f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c70103c70 0x7f4c70198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.888+0000 7f4c6ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.888+0000 7f4c6ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56684/0 (socket says 172.21.15.120:56684) 2024-05-14T09:32:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.888+0000 7f4c6f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c70103c70 0x7f4c70198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35038/0 (socket says 172.21.15.120:35038) 2024-05-14T09:32:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.888+0000 7f4c6ea00640 1 -- 172.21.15.120:0/2683730290 learned_addr learned my addr 172.21.15.120:0/2683730290 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.888+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c70109bb0 0x7f4c7019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.889+0000 7f4c6ea00640 1 -- 172.21.15.120:0/2683730290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c70109bb0 msgr2=0x7f4c7019f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.889+0000 7f4c6ea00640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c70109bb0 0x7f4c7019f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.889+0000 7f4c6ea00640 1 -- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c70103c70 msgr2=0x7f4c70198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.889+0000 7f4c6ea00640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c70103c70 0x7f4c70198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.889+0000 7f4c6ea00640 1 -- 172.21.15.120:0/2683730290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7019fbc0 con 0x7f4c70104eb0 2024-05-14T09:32:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.889+0000 7f4c6ea00640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701985c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009a20 tx=0x7f4c5c0042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.890+0000 7f4c67e00640 1 -- 172.21.15.120:0/2683730290 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c044030 con 0x7f4c70104eb0 2024-05-14T09:32:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.890+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7019fe50 con 0x7f4c70104eb0 2024-05-14T09:32:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.890+0000 7f4c67e00640 1 -- 172.21.15.120:0/2683730290 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c5c036400 con 0x7f4c70104eb0 2024-05-14T09:32:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.890+0000 7f4c67e00640 1 -- 172.21.15.120:0/2683730290 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c004920 con 0x7f4c70104eb0 2024-05-14T09:32:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.890+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c701a02b0 con 0x7f4c70104eb0 2024-05-14T09:32:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.895+0000 7f4c7d82c740 1 Processor -- start 2024-05-14T09:32:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.895+0000 7f4c7d82c740 1 -- start start 2024-05-14T09:32:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c128e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3183f2f0 0x55df31c12e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c19d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55df31b6e550 con 0x55df318474d0 2024-05-14T09:32:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df31b13bc0 con 0x55df318681b0 2024-05-14T09:32:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df31b6a510 con 0x55df3183f2f0 2024-05-14T09:32:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c6f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3183f2f0 0x55df31c12e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c6f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3183f2f0 0x55df31c12e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56692/0 (socket says 172.21.15.120:56692) 2024-05-14T09:32:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.896+0000 7f4c6f400640 1 -- 172.21.15.120:0/3289290442 learned_addr learned my addr 172.21.15.120:0/3289290442 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c6f400640 1 -- 172.21.15.120:0/3289290442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 msgr2=0x55df31c128e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c128e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c6f400640 1 -- 172.21.15.120:0/3289290442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 msgr2=0x55df31c19d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:32:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c19d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c6f400640 1 -- 172.21.15.120:0/3289290442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df31880210 con 0x55df3183f2f0 2024-05-14T09:32:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c67e00640 1 -- 172.21.15.120:0/2683730290 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4c5c047030 con 0x7f4c70104eb0 2024-05-14T09:32:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.897+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3183f2f0 0x55df31c12e60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000bc70 tx=0x7f4c600107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf8889003bcfe38 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.898+0000 7f4c64c00640 1 -- 172.21.15.120:0/3289290442 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6001c680 con 0x55df3183f2f0 2024-05-14T09:32:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.898+0000 7f4c64c00640 1 -- 172.21.15.120:0/3289290442 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c6000be20 con 0x55df3183f2f0 2024-05-14T09:32:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.898+0000 7f4c64c00640 1 -- 172.21.15.120:0/3289290442 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60011a60 con 0x55df3183f2f0 2024-05-14T09:32:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.900+0000 7f4c67e00640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c540b2860 0x7f4c540b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.900+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3289290442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3183f2f0 msgr2=0x55df31c12e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.900+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3183f2f0 0x55df31c12e60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000bc70 tx=0x7f4c600107a0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.900+0000 7f4c67e00640 1 -- 172.21.15.120:0/2683730290 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4c5c102ae0 con 0x7f4c70104eb0 2024-05-14T09:32:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.900+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c540b2860 0x7f4c540b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.901+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3289290442 shutdown_connections 2024-05-14T09:32:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.901+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c19d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.901+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3183f2f0 0x55df31c12e60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.901+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3289290442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c128e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.901+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3289290442 >> 172.21.15.120:0/3289290442 conn(0x55df3185c300 msgr2=0x55df31c05a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.901+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3289290442 shutdown_connections 2024-05-14T09:32:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.901+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3289290442 wait complete. 2024-05-14T09:32:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.902+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c540b2860 0x7f4c540b4d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55df31c13ab0 tx=0x7f4c68009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.902+0000 7f4c7d82c740 1 -- start start 2024-05-14T09:32:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.902+0000 7f4c7d82c740 1 Processor -- start 2024-05-14T09:32:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df3183f2f0 0x55df31c1c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c1ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318681b0 0x55df31c23960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55df31c1a7b0 con 0x55df318474d0 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df31b27660 con 0x55df3183f2f0 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df31c1a930 con 0x55df318681b0 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c7d82c740 10 client.0 _ll_register_callbacks cb 0x55df31af1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c6f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df3183f2f0 0x55df31c1c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c6f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df3183f2f0 0x55df31c1c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41882/0 (socket says 172.21.15.120:41882) 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c6f400640 1 -- 172.21.15.120:0/3622421206 learned_addr learned my addr 172.21.15.120:0/3622421206 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.905+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318681b0 0x55df31c23960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.906+0000 7f4c6ea00640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c1ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.907+0000 7f4c6ea00640 1 -- 172.21.15.120:0/3622421206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318681b0 msgr2=0x55df31c23960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.907+0000 7f4c6ea00640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318681b0 0x55df31c23960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.907+0000 7f4c6ea00640 1 -- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df3183f2f0 msgr2=0x55df31c1c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.907+0000 7f4c6ea00640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df3183f2f0 0x55df31c1c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.907+0000 7f4c6ea00640 1 -- 172.21.15.120:0/3622421206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3194c620 con 0x55df318474d0 2024-05-14T09:32:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.907+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df3183f2f0 0x55df31c1c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:32:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.908+0000 7f4c6ea00640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c1ca00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c1005b0 tx=0x7f4c5c0c9590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6eb9f25d28ee9bf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.908+0000 7f4c59600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:32:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.908+0000 7f4c59600640 1 -- 172.21.15.120:0/3622421206 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c04e030 con 0x55df318474d0 2024-05-14T09:32:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.909+0000 7f4c59600640 1 -- 172.21.15.120:0/3622421206 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4c5c0c5ff0 con 0x55df318474d0 2024-05-14T09:32:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.909+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6000be20 con 0x55df318474d0 2024-05-14T09:32:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.910+0000 7f4c59600640 1 -- 172.21.15.120:0/3622421206 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4c5c00f0e0 con 0x55df318474d0 2024-05-14T09:32:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.910+0000 7f4c7d82c740 10 client.16842 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.910+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55df31c26890 con 0x55df318474d0 2024-05-14T09:32:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.911+0000 7f4c59600640 1 -- 172.21.15.120:0/3622421206 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c6000be20 con 0x55df318474d0 2024-05-14T09:32:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.911+0000 7f4c59600640 1 -- 172.21.15.120:0/3622421206 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f4c5c0c9fc0 con 0x55df318474d0 2024-05-14T09:32:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.912+0000 7f4c7d82c740 10 client.16842 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.912+0000 7f4c7d82c740 10 client.16842 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.912+0000 7f4c7d82c740 20 client.16842 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.912+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df31826d80 0x55df31c29f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.912+0000 7f4c7d82c740 4 client.16842 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:32:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.912+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df31b7c160 con 0x55df31826d80 2024-05-14T09:32:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.913+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df31826d80 0x55df31c29f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.915+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df31826d80 0x55df31c29f30 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf2e1fe3fdaa48e9 server_cookie=b839b7d849c5b83e in_seq=0 out_seq=0 2024-05-14T09:32:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.915+0000 7f4c59600640 10 client.16842 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.917+0000 7f4c59600640 1 -- 172.21.15.120:0/3622421206 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55df31b7c160 con 0x55df31826d80 2024-05-14T09:32:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.917+0000 7f4c59600640 10 client.16842 handle_command_reply: tid=0 2024-05-14T09:32:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.917+0000 7f4c7d82c740 1 client.16842 shutdown 2024-05-14T09:32:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.918+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 msgr2=0x55df31c1ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.918+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c1ca00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c1005b0 tx=0x7f4c5c0c9590 comp rx=0 tx=0).stop 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 shutdown_connections 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df31826d80 0x55df31c29f30 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318681b0 0x55df31c23960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df318474d0 0x55df31c1ca00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3622421206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df3183f2f0 0x55df31c1c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 >> 172.21.15.120:0/3622421206 conn(0x55df3185c300 msgr2=0x55df31c08970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c59600640 0 client.16842 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 shutdown_connections 2024-05-14T09:32:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.919+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3622421206 wait complete. 2024-05-14T09:32:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.920+0000 7f4c7d82c740 20 client.16842 trim_cache size 0 max 16384 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.956+0000 7f4c7d82c740 1 Processor -- start 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.956+0000 7f4c7d82c740 1 -- start start 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.956+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c1b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.956+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c23880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701a2030 con 0x55df3183f2f0 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701a3bd0 con 0x55df318681b0 2024-05-14T09:32:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701a2760 con 0x55df318474d0 2024-05-14T09:32:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c6ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c23880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c6ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c23880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56706/0 (socket says 172.21.15.120:56706) 2024-05-14T09:32:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c6ea00640 1 -- 172.21.15.120:0/3142476264 learned_addr learned my addr 172.21.15.120:0/3142476264 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c1b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.957+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.958+0000 7f4c6f400640 1 -- 172.21.15.120:0/3142476264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 msgr2=0x55df31c23880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.958+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c23880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.958+0000 7f4c6f400640 1 -- 172.21.15.120:0/3142476264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 msgr2=0x55df31c051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.958+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.958+0000 7f4c6f400640 1 -- 172.21.15.120:0/3142476264 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df31c01280 con 0x55df3183f2f0 2024-05-14T09:32:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.958+0000 7f4c6f400640 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c1b030 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4c60005cd0 tx=0x7f4c6000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c08874657b28910 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.959+0000 7f4c5be00640 1 -- 172.21.15.120:0/3142476264 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60031070 con 0x55df3183f2f0 2024-05-14T09:32:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.959+0000 7f4c5be00640 1 -- 172.21.15.120:0/3142476264 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c60004660 con 0x55df3183f2f0 2024-05-14T09:32:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.959+0000 7f4c5be00640 1 -- 172.21.15.120:0/3142476264 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60011760 con 0x55df3183f2f0 2024-05-14T09:32:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.960+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3142476264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 msgr2=0x55df31c1b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.960+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c1b030 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4c60005cd0 tx=0x7f4c6000b390 comp rx=0 tx=0).stop 2024-05-14T09:32:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.961+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3142476264 shutdown_connections 2024-05-14T09:32:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.961+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.961+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c23880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.961+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/3142476264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c1b030 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.961+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3142476264 >> 172.21.15.120:0/3142476264 conn(0x55df3185c300 msgr2=0x55df31c12860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.961+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3142476264 shutdown_connections 2024-05-14T09:32:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.961+0000 7f4c7d82c740 1 -- 172.21.15.120:0/3142476264 wait complete. 2024-05-14T09:32:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.962+0000 7f4c7d82c740 1 -- start start 2024-05-14T09:32:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 1 Processor -- start 2024-05-14T09:32:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c20d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c22160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701a3500 con 0x55df3183f2f0 2024-05-14T09:32:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701a2e30 con 0x55df318681b0 2024-05-14T09:32:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c70074960 con 0x55df318474d0 2024-05-14T09:32:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.963+0000 7f4c7d82c740 10 client.0 _ll_register_callbacks cb 0x7f4c5c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.964+0000 7f4c6ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.964+0000 7f4c6fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c22160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.964+0000 7f4c6ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c212a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:56718/0 (socket says 172.21.15.120:56718) 2024-05-14T09:32:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.964+0000 7f4c6ea00640 1 -- 172.21.15.120:0/4139367089 learned_addr learned my addr 172.21.15.120:0/4139367089 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.965+0000 7f4c6fe00640 1 -- 172.21.15.120:0/4139367089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 msgr2=0x55df31c212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.965+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.965+0000 7f4c6fe00640 1 -- 172.21.15.120:0/4139367089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 msgr2=0x55df31c20d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.965+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c20d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.965+0000 7f4c6fe00640 1 -- 172.21.15.120:0/4139367089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df31c22720 con 0x55df318681b0 2024-05-14T09:32:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.966+0000 7f4c6fe00640 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c22160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009fd0 tx=0x7f4c68004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc36a746df727e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.966+0000 7f4c59600640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:32:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.967+0000 7f4c59600640 1 -- 172.21.15.120:0/4139367089 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68031be0 con 0x55df318681b0 2024-05-14T09:32:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.967+0000 7f4c59600640 1 -- 172.21.15.120:0/4139367089 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f4c68031d80 con 0x55df318681b0 2024-05-14T09:32:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.968+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c60004660 con 0x55df318681b0 2024-05-14T09:32:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.979+0000 7f4c59600640 1 -- 172.21.15.120:0/4139367089 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4c68004b20 con 0x55df318681b0 2024-05-14T09:32:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.980+0000 7f4c7d82c740 10 client.36329 fetch_fsmap learned FSMap version 50 2024-05-14T09:32:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.980+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55df31c23a20 con 0x55df318681b0 2024-05-14T09:32:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.981+0000 7f4c59600640 1 -- 172.21.15.120:0/4139367089 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c60004660 con 0x55df318681b0 2024-05-14T09:32:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c59600640 1 -- 172.21.15.120:0/4139367089 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f4c68003970 con 0x55df318681b0 2024-05-14T09:32:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c7d82c740 10 client.36329 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T09:32:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c7d82c740 10 client.36329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c7d82c740 20 client.36329 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df317fc1c0 0x55df31c94830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c7d82c740 4 client.36329 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:32:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df31b75fd0 con 0x55df317fc1c0 2024-05-14T09:32:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.983+0000 7f4c6f400640 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df317fc1c0 0x55df31c94830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.985+0000 7f4c6f400640 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df317fc1c0 0x55df31c94830 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd5bc79df3c3fb4 server_cookie=5a48251703d6e0da in_seq=0 out_seq=0 2024-05-14T09:32:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:44.985+0000 7f4c59600640 10 client.36329 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.013+0000 7f4c59600640 1 -- 172.21.15.120:0/4139367089 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df31b75fd0 con 0x55df317fc1c0 2024-05-14T09:32:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.013+0000 7f4c59600640 10 client.36329 handle_command_reply: tid=0 2024-05-14T09:32:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.013+0000 7f4c7d82c740 1 client.36329 shutdown 2024-05-14T09:32:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.014+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 msgr2=0x55df31c22160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.014+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c22160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009fd0 tx=0x7f4c68004a40 comp rx=0 tx=0).stop 2024-05-14T09:32:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.014+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 shutdown_connections 2024-05-14T09:32:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55df317fc1c0 0x55df31c94830 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df318681b0 0x55df31c22160 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df318474d0 0x55df31c212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 1 --2- 172.21.15.120:0/4139367089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55df3183f2f0 0x55df31c20d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 >> 172.21.15.120:0/4139367089 conn(0x55df3185c300 msgr2=0x55df31c08860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c59600640 0 client.36329 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 shutdown_connections 2024-05-14T09:32:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 1 -- 172.21.15.120:0/4139367089 wait complete. 2024-05-14T09:32:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.015+0000 7f4c7d82c740 20 client.36329 trim_cache size 0 max 16384 2024-05-14T09:32:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:32:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:32:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:32:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:32:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c540b2860 msgr2=0x7f4c540b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c540b2860 0x7f4c540b4d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55df31c13ab0 tx=0x7f4c68009600 comp rx=0 tx=0).stop 2024-05-14T09:32:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 msgr2=0x7f4c701985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701985c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009a20 tx=0x7f4c5c0042e0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 shutdown_connections 2024-05-14T09:32:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f4c540b2860 0x7f4c540b4d70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c70109bb0 0x7f4c7019f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70104eb0 0x7f4c701985c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 --2- 172.21.15.120:0/2683730290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c70103c70 0x7f4c70198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.017+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 >> 172.21.15.120:0/2683730290 conn(0x7f4c700fee60 msgr2=0x7f4c70105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.018+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 shutdown_connections 2024-05-14T09:32:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:45.018+0000 7f4c76800640 1 -- 172.21.15.120:0/2683730290 wait complete. 2024-05-14T09:32:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:32:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:32:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:32:45.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:32:45.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:32:45.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:32:45.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:32:45.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:32:45.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:32:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:45 smithi175 ceph-mon[35353]: pgmap v832: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 652 op/s 2024-05-14T09:32:46.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:45 smithi120 ceph-mon[31085]: pgmap v832: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 652 op/s 2024-05-14T09:32:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:45 smithi152 ceph-mon[34868]: pgmap v832: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 652 op/s 2024-05-14T09:32:48.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:47 smithi120 ceph-mon[31085]: pgmap v833: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-05-14T09:32:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:47 smithi152 ceph-mon[34868]: pgmap v833: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-05-14T09:32:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:47 smithi175 ceph-mon[35353]: pgmap v833: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-05-14T09:32:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 315.0 s, 715.4 tps, lat 139.311 ms stddev 69.238 2024-05-14T09:32:50.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:49 smithi120 ceph-mon[31085]: pgmap v834: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 703 op/s 2024-05-14T09:32:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:49 smithi152 ceph-mon[34868]: pgmap v834: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 703 op/s 2024-05-14T09:32:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:49 smithi175 ceph-mon[35353]: pgmap v834: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 703 op/s 2024-05-14T09:32:52.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:51 smithi120 ceph-mon[31085]: pgmap v835: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 680 op/s 2024-05-14T09:32:52.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:51 smithi152 ceph-mon[34868]: pgmap v835: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 680 op/s 2024-05-14T09:32:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:51 smithi175 ceph-mon[35353]: pgmap v835: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 680 op/s 2024-05-14T09:32:54.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 320.0 s, 699.0 tps, lat 143.377 ms stddev 40.232 2024-05-14T09:32:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:53 smithi120 ceph-mon[31085]: pgmap v836: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 713 op/s 2024-05-14T09:32:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:54 smithi152 ceph-mon[34868]: pgmap v836: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 713 op/s 2024-05-14T09:32:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:53 smithi175 ceph-mon[35353]: pgmap v836: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 713 op/s 2024-05-14T09:32:56.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:56 smithi120 ceph-mon[31085]: pgmap v837: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 732 op/s 2024-05-14T09:32:56.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:56 smithi152 ceph-mon[34868]: pgmap v837: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 732 op/s 2024-05-14T09:32:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:56 smithi175 ceph-mon[35353]: pgmap v837: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 732 op/s 2024-05-14T09:32:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.357+0000 7fb5bb800640 1 -- 172.21.15.120:0/3314416310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410a450 msgr2=0x7fb5b410af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.357+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3314416310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410a450 0x7fb5b410af50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009900 tx=0x7fb5a802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.358+0000 7fb5bb800640 1 -- 172.21.15.120:0/3314416310 shutdown_connections 2024-05-14T09:32:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.358+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3314416310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5b4110190 0x7fb5b41125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.358+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3314416310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b410b490 0x7fb5b410b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.358+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3314416310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410a450 0x7fb5b410af50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.358+0000 7fb5bb800640 1 -- 172.21.15.120:0/3314416310 >> 172.21.15.120:0/3314416310 conn(0x7fb5b4078f10 msgr2=0x7fb5b407b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.358+0000 7fb5bb800640 1 -- 172.21.15.120:0/3314416310 shutdown_connections 2024-05-14T09:32:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.359+0000 7fb5bb800640 1 -- 172.21.15.120:0/3314416310 wait complete. 2024-05-14T09:32:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.360+0000 7fb5bb800640 1 Processor -- start 2024-05-14T09:32:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.360+0000 7fb5bb800640 1 -- start start 2024-05-14T09:32:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.361+0000 7fb5bb800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5b410a450 0x7fb5b41a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.361+0000 7fb5bb800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410b490 0x7fb5b41a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.361+0000 7fb5bb800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b4110190 0x7fb5b41a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.361+0000 7fb5bb800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b4115c60 con 0x7fb5b4110190 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.361+0000 7fb5bb800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b4115ae0 con 0x7fb5b410a450 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.361+0000 7fb5bb800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b4115de0 con 0x7fb5b410b490 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410b490 0x7fb5b41a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410b490 0x7fb5b41a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43162/0 (socket says 172.21.15.120:43162) 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b3e00640 1 -- 172.21.15.120:0/3305422214 learned_addr learned my addr 172.21.15.120:0/3305422214 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b9800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b4110190 0x7fb5b41a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5b410a450 0x7fb5b41a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b9800640 1 -- 172.21.15.120:0/3305422214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410b490 msgr2=0x7fb5b41a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b9800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410b490 0x7fb5b41a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b9800640 1 -- 172.21.15.120:0/3305422214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5b410a450 msgr2=0x7fb5b41a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.362+0000 7fb5b9800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5b410a450 0x7fb5b41a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.363+0000 7fb5b9800640 1 -- 172.21.15.120:0/3305422214 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b41a8380 con 0x7fb5b4110190 2024-05-14T09:32:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.363+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5b410a450 0x7fb5b41a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:32:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.363+0000 7fb5b9800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b4110190 0x7fb5b41a7dc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac005fd0 tx=0x7fb5ac00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.364+0000 7fb5b1600640 1 -- 172.21.15.120:0/3305422214 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00cdf0 con 0x7fb5b4110190 2024-05-14T09:32:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.365+0000 7fb5b1600640 1 -- 172.21.15.120:0/3305422214 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5ac005020 con 0x7fb5b4110190 2024-05-14T09:32:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.365+0000 7fb5b1600640 1 -- 172.21.15.120:0/3305422214 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0296d0 con 0x7fb5b4110190 2024-05-14T09:32:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.365+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b407c690 con 0x7fb5b4110190 2024-05-14T09:32:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.365+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b407cb90 con 0x7fb5b4110190 2024-05-14T09:32:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.376+0000 7fb5b1600640 1 -- 172.21.15.120:0/3305422214 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb5ac004a40 con 0x7fb5b4110190 2024-05-14T09:32:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.378+0000 7fb5c2851740 1 Processor -- start 2024-05-14T09:32:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.379+0000 7fb5c2851740 1 -- start start 2024-05-14T09:32:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.379+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698ca71b0 0x55d699049100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.379+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699049680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.380+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699050580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.380+0000 7fb5c2851740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d698fad550 con 0x55d698ca71b0 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.380+0000 7fb5c2851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d698f52bc0 con 0x55d698c7e2f0 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.380+0000 7fb5c2851740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d698fa9510 con 0x55d698c864d0 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.380+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698ca71b0 0x55d699049100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.380+0000 7fb5b1600640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb59c0b28e0 0x7fb59c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.380+0000 7fb5b8e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699049680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.381+0000 7fb5b8e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699049680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55588/0 (socket says 172.21.15.120:55588) 2024-05-14T09:32:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.381+0000 7fb5b8e00640 1 -- 172.21.15.120:0/4271052792 learned_addr learned my addr 172.21.15.120:0/4271052792 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.381+0000 7fb5b1600640 1 -- 172.21.15.120:0/3305422214 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb5ac0f3c00 con 0x7fb5b4110190 2024-05-14T09:32:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.381+0000 7fb5b9800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb59c0b28e0 0x7fb59c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.382+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699050580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.382+0000 7fb5b8e00640 1 -- 172.21.15.120:0/4271052792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 msgr2=0x55d699050580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.382+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699050580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.382+0000 7fb5b8e00640 1 -- 172.21.15.120:0/4271052792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698ca71b0 msgr2=0x55d699049100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.382+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698ca71b0 0x55d699049100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.382+0000 7fb5b8e00640 1 -- 172.21.15.120:0/4271052792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d698cbf210 con 0x55d698c7e2f0 2024-05-14T09:32:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.383+0000 7fb5b9800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb59c0b28e0 0x7fb59c0b4df0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c8f0 tx=0x7fb5ac00c860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.383+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699049680 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8005760 tx=0x7fb5a80040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=841d8b3f4ecdd045 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:58 smithi120 ceph-mon[31085]: pgmap v838: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 740 op/s 2024-05-14T09:32:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:32:58 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:32:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.384+0000 7fb5a2000640 1 -- 172.21.15.120:0/4271052792 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8040070 con 0x55d698c7e2f0 2024-05-14T09:32:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.384+0000 7fb5a2000640 1 -- 172.21.15.120:0/4271052792 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a80044b0 con 0x55d698c7e2f0 2024-05-14T09:32:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.385+0000 7fb5a2000640 1 -- 172.21.15.120:0/4271052792 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8035030 con 0x55d698c7e2f0 2024-05-14T09:32:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.385+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271052792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 msgr2=0x55d699049680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.385+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699049680 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8005760 tx=0x7fb5a80040c0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.386+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271052792 shutdown_connections 2024-05-14T09:32:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.386+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699050580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.386+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699049680 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.386+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271052792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698ca71b0 0x55d699049100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.386+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271052792 >> 172.21.15.120:0/4271052792 conn(0x55d698c9b300 msgr2=0x55d699044a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.386+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271052792 shutdown_connections 2024-05-14T09:32:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.386+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271052792 wait complete. 2024-05-14T09:32:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.387+0000 7fb5c2851740 1 -- start start 2024-05-14T09:32:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.387+0000 7fb5c2851740 1 Processor -- start 2024-05-14T09:32:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c7e2f0 0x55d699052bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699053110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5c2851740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d699050fc0 con 0x55d698c7e2f0 2024-05-14T09:32:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5c2851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d698f66660 con 0x55d698ca71b0 2024-05-14T09:32:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5c2851740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d699051140 con 0x55d698c864d0 2024-05-14T09:32:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5c2851740 10 client.0 _ll_register_callbacks cb 0x55d698f30400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c7e2f0 0x55d699052bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c7e2f0 0x55d699052bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53366/0 (socket says 172.21.15.120:53366) 2024-05-14T09:32:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.388+0000 7fb5b3e00640 1 -- 172.21.15.120:0/1550309210 learned_addr learned my addr 172.21.15.120:0/1550309210 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.389+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699053110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.389+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.389+0000 7fb5b3e00640 1 -- 172.21.15.120:0/1550309210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 msgr2=0x55d699053110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.389+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699053110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.389+0000 7fb5b3e00640 1 -- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 msgr2=0x55d69905a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.389+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.389+0000 7fb5b3e00640 1 -- 172.21.15.120:0/1550309210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d698d8b620 con 0x55d698c7e2f0 2024-05-14T09:32:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.390+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c7e2f0 0x55d699052bd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4012fb0 tx=0x7fb5a400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1fadc56b32ae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.390+0000 7fb596a00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:32:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.391+0000 7fb596a00640 1 -- 172.21.15.120:0/1550309210 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4019070 con 0x55d698c7e2f0 2024-05-14T09:32:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.391+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a80044b0 con 0x55d698c7e2f0 2024-05-14T09:32:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.391+0000 7fb596a00640 1 -- 172.21.15.120:0/1550309210 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb5a4005220 con 0x55d698c7e2f0 2024-05-14T09:32:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.392+0000 7fb596a00640 1 -- 172.21.15.120:0/1550309210 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb5a4028050 con 0x55d698c7e2f0 2024-05-14T09:32:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.392+0000 7fb5c2851740 10 client.16854 fetch_fsmap learned FSMap version 51 2024-05-14T09:32:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.393+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d69905d0c0 con 0x55d698c7e2f0 2024-05-14T09:32:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.394+0000 7fb596a00640 1 -- 172.21.15.120:0/1550309210 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a80044b0 con 0x55d698c7e2f0 2024-05-14T09:32:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.394+0000 7fb596a00640 1 -- 172.21.15.120:0/1550309210 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7fb5a4010430 con 0x55d698c7e2f0 2024-05-14T09:32:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.396+0000 7fb5c2851740 10 client.16854 fetch_fsmap finished waiting for FSMap version 51 2024-05-14T09:32:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.396+0000 7fb5c2851740 10 client.16854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.396+0000 7fb5c2851740 20 client.16854 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.396+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c65d80 0x55d699060720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.396+0000 7fb5c2851740 4 client.16854 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:32:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.396+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d698fbb160 con 0x55d698c65d80 2024-05-14T09:32:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.397+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c65d80 0x55d699060720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.400+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c65d80 0x55d699060720 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4daac3f5d5a4dd60 server_cookie=852f7862ca558821 in_seq=0 out_seq=0 2024-05-14T09:32:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.400+0000 7fb596a00640 10 client.16854 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.401+0000 7fb596a00640 1 -- 172.21.15.120:0/1550309210 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d698fbb160 con 0x55d698c65d80 2024-05-14T09:32:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.401+0000 7fb596a00640 10 client.16854 handle_command_reply: tid=0 2024-05-14T09:32:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.401+0000 7fb5c2851740 1 client.16854 shutdown 2024-05-14T09:32:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.402+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c7e2f0 msgr2=0x55d699052bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.402+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c7e2f0 0x55d699052bd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4012fb0 tx=0x7fb5a400a900 comp rx=0 tx=0).stop 2024-05-14T09:32:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.403+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 shutdown_connections 2024-05-14T09:32:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.403+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c65d80 0x55d699060720 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.403+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.403+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c864d0 0x55d699053110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.403+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1550309210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c7e2f0 0x55d699052bd0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.403+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 >> 172.21.15.120:0/1550309210 conn(0x55d698c9b300 msgr2=0x55d6990479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.403+0000 7fb596a00640 0 client.16854 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.404+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 shutdown_connections 2024-05-14T09:32:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.405+0000 7fb5c2851740 1 -- 172.21.15.120:0/1550309210 wait complete. 2024-05-14T09:32:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.405+0000 7fb5c2851740 20 client.16854 trim_cache size 0 max 16384 2024-05-14T09:32:58.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.440+0000 7fb5c2851740 1 Processor -- start 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.441+0000 7fb5c2851740 1 -- start start 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c7e2f0 0x55d699044450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699044990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5c2851740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41aa7b0 con 0x55d698c864d0 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5c2851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41ac350 con 0x55d698ca71b0 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5c2851740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41aaee0 con 0x55d698c7e2f0 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5b8e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699044990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.442+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c7e2f0 0x55d699044450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.443+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c7e2f0 0x55d699044450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43200/0 (socket says 172.21.15.120:43200) 2024-05-14T09:32:58.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.443+0000 7fb5b3e00640 1 -- 172.21.15.120:0/1219607960 learned_addr learned my addr 172.21.15.120:0/1219607960 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:58.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.443+0000 7fb5b8e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699044990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53370/0 (socket says 172.21.15.120:53370) 2024-05-14T09:32:58.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.443+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.443+0000 7fb5b8e00640 1 -- 172.21.15.120:0/1219607960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c7e2f0 msgr2=0x55d699044450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.444+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c7e2f0 0x55d699044450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.444+0000 7fb5b8e00640 1 -- 172.21.15.120:0/1219607960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 msgr2=0x55d69905a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.444+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.444+0000 7fb5b8e00640 1 -- 172.21.15.120:0/1219607960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d699040280 con 0x55d698c864d0 2024-05-14T09:32:58.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.444+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:32:58.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.445+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699044990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009900 tx=0x7fb5a8004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611bcd5ccc215e17 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:58.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.446+0000 7fb5a1600640 1 -- 172.21.15.120:0/1219607960 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8040040 con 0x55d698c864d0 2024-05-14T09:32:58.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.446+0000 7fb5a1600640 1 -- 172.21.15.120:0/1219607960 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a8031540 con 0x55d698c864d0 2024-05-14T09:32:58.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.446+0000 7fb5a1600640 1 -- 172.21.15.120:0/1219607960 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8035040 con 0x55d698c864d0 2024-05-14T09:32:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.448+0000 7fb5c2851740 1 -- 172.21.15.120:0/1219607960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 msgr2=0x55d699044990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.448+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699044990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009900 tx=0x7fb5a8004480 comp rx=0 tx=0).stop 2024-05-14T09:32:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.448+0000 7fb5c2851740 1 -- 172.21.15.120:0/1219607960 shutdown_connections 2024-05-14T09:32:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.448+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698ca71b0 0x55d69905a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.448+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699044990 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.448+0000 7fb5c2851740 1 --2- 172.21.15.120:0/1219607960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698c7e2f0 0x55d699044450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.448+0000 7fb5c2851740 1 -- 172.21.15.120:0/1219607960 >> 172.21.15.120:0/1219607960 conn(0x55d698c9b300 msgr2=0x55d69904d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.449+0000 7fb5c2851740 1 -- 172.21.15.120:0/1219607960 shutdown_connections 2024-05-14T09:32:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.449+0000 7fb5c2851740 1 -- 172.21.15.120:0/1219607960 wait complete. 2024-05-14T09:32:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.449+0000 7fb5c2851740 1 -- start start 2024-05-14T09:32:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.450+0000 7fb5c2851740 1 Processor -- start 2024-05-14T09:32:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.451+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699057ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.451+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699058220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5c2851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698ca71b0 0x55d699059150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5c2851740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41abc80 con 0x55d698c864d0 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5c2851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41ab5b0 con 0x55d698c7e2f0 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5c2851740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41a87b0 con 0x55d698ca71b0 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5c2851740 10 client.0 _ll_register_callbacks cb 0x7fb5a400aea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699057ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5b3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699057ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55606/0 (socket says 172.21.15.120:55606) 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5b3e00640 1 -- 172.21.15.120:0/4271243382 learned_addr learned my addr 172.21.15.120:0/4271243382 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:32:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.452+0000 7fb5b8e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699058220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.453+0000 7fb5b3e00640 1 -- 172.21.15.120:0/4271243382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698ca71b0 msgr2=0x55d699059150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.453+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698ca71b0 0x55d699059150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.453+0000 7fb5b3e00640 1 -- 172.21.15.120:0/4271243382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 msgr2=0x55d699058220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:32:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.453+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699058220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.453+0000 7fb5b3e00640 1 -- 172.21.15.120:0/4271243382 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d699059710 con 0x55d698c7e2f0 2024-05-14T09:32:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.454+0000 7fb5b3e00640 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699057ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4012560 tx=0x7fb5a40128a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36ab87e714213926 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:32:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.454+0000 7fb596a00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:32:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.455+0000 7fb596a00640 1 -- 172.21.15.120:0/4271243382 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4032020 con 0x55d698c7e2f0 2024-05-14T09:32:58.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.455+0000 7fb596a00640 1 -- 172.21.15.120:0/4271243382 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb5a4010630 con 0x55d698c7e2f0 2024-05-14T09:32:58.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.456+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a8031540 con 0x55d698c7e2f0 2024-05-14T09:32:58.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.456+0000 7fb596a00640 1 -- 172.21.15.120:0/4271243382 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb5a403d050 con 0x55d698c7e2f0 2024-05-14T09:32:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.456+0000 7fb5c2851740 10 client.36344 fetch_fsmap learned FSMap version 51 2024-05-14T09:32:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.456+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d69905aa70 con 0x55d698c7e2f0 2024-05-14T09:32:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb596a00640 1 -- 172.21.15.120:0/4271243382 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a8031540 con 0x55d698c7e2f0 2024-05-14T09:32:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb596a00640 1 -- 172.21.15.120:0/4271243382 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7fb5a4021ce0 con 0x55d698c7e2f0 2024-05-14T09:32:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:58 smithi152 ceph-mon[34868]: pgmap v838: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 740 op/s 2024-05-14T09:32:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:32:58 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:32:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb5c2851740 10 client.36344 fetch_fsmap finished waiting for FSMap version 51 2024-05-14T09:32:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb5c2851740 10 client.36344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:32:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb5c2851740 20 client.36344 populate_metadata read hostname 'smithi120' 2024-05-14T09:32:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c3b1c0 0x55d6990cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:32:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb5c2851740 4 client.36344 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:32:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.457+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d698fb4fd0 con 0x55d698c3b1c0 2024-05-14T09:32:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.458+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c3b1c0 0x55d6990cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:32:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.459+0000 7fb5b8e00640 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c3b1c0 0x55d6990cb250 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d418a066e9367cd2 server_cookie=3ba700de33b8dc4e in_seq=0 out_seq=0 2024-05-14T09:32:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.459+0000 7fb596a00640 10 client.36344 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:58 smithi175 ceph-mon[35353]: pgmap v838: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 740 op/s 2024-05-14T09:32:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:32:58 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:32:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.484+0000 7fb596a00640 1 -- 172.21.15.120:0/4271243382 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d698fb4fd0 con 0x55d698c3b1c0 2024-05-14T09:32:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.484+0000 7fb596a00640 10 client.36344 handle_command_reply: tid=0 2024-05-14T09:32:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.484+0000 7fb5c2851740 1 client.36344 shutdown 2024-05-14T09:32:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 msgr2=0x55d699057ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699057ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4012560 tx=0x7fb5a40128a0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 shutdown_connections 2024-05-14T09:32:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d698c3b1c0 0x55d6990cb250 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d698ca71b0 0x55d699059150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d698c864d0 0x55d699058220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 --2- 172.21.15.120:0/4271243382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d698c7e2f0 0x55d699057ce0 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4012560 tx=0x7fb5a40128a0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 >> 172.21.15.120:0/4271243382 conn(0x55d698c9b300 msgr2=0x55d699044430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.485+0000 7fb596a00640 0 client.36344 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:32:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.486+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 shutdown_connections 2024-05-14T09:32:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.486+0000 7fb5c2851740 1 -- 172.21.15.120:0/4271243382 wait complete. 2024-05-14T09:32:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.486+0000 7fb5c2851740 20 client.36344 trim_cache size 0 max 16384 2024-05-14T09:32:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:32:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:32:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:32:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.487+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb59c0b28e0 msgr2=0x7fb59c0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.487+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb59c0b28e0 0x7fb59c0b4df0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c8f0 tx=0x7fb5ac00c860 comp rx=0 tx=0).stop 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.487+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b4110190 msgr2=0x7fb5b41a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.487+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b4110190 0x7fb5b41a7dc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac005fd0 tx=0x7fb5ac00ef10 comp rx=0 tx=0).stop 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 shutdown_connections 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb59c0b28e0 0x7fb59c0b4df0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b4110190 0x7fb5b41a7dc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5b410b490 0x7fb5b41a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 --2- 172.21.15.120:0/3305422214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5b410a450 0x7fb5b41a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 >> 172.21.15.120:0/3305422214 conn(0x7fb5b4078f10 msgr2=0x7fb5b410c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 shutdown_connections 2024-05-14T09:32:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:32:58.488+0000 7fb5bb800640 1 -- 172.21.15.120:0/3305422214 wait complete. 2024-05-14T09:32:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 325.0 s, 595.0 tps, lat 167.519 ms stddev 107.052 2024-05-14T09:33:00.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:00 smithi120 ceph-mon[31085]: pgmap v839: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 739 op/s 2024-05-14T09:33:00.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:00 smithi152 ceph-mon[34868]: pgmap v839: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 739 op/s 2024-05-14T09:33:00.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:00 smithi175 ceph-mon[35353]: pgmap v839: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 739 op/s 2024-05-14T09:33:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:02 smithi120 ceph-mon[31085]: pgmap v840: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.7 MiB/s wr, 723 op/s 2024-05-14T09:33:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:02 smithi152 ceph-mon[34868]: pgmap v840: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.7 MiB/s wr, 723 op/s 2024-05-14T09:33:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:02 smithi175 ceph-mon[35353]: pgmap v840: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.7 MiB/s wr, 723 op/s 2024-05-14T09:33:03.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:03 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:03.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:03 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:03.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:03 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 330.0 s, 644.4 tps, lat 155.410 ms stddev 42.243 2024-05-14T09:33:04.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:04 smithi120 ceph-mon[31085]: pgmap v841: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 683 op/s 2024-05-14T09:33:04.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:04 smithi152 ceph-mon[34868]: pgmap v841: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 683 op/s 2024-05-14T09:33:04.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:04 smithi175 ceph-mon[35353]: pgmap v841: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 683 op/s 2024-05-14T09:33:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:06 smithi120 ceph-mon[31085]: pgmap v842: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 715 op/s 2024-05-14T09:33:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:06 smithi152 ceph-mon[34868]: pgmap v842: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 715 op/s 2024-05-14T09:33:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:06 smithi175 ceph-mon[35353]: pgmap v842: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 715 op/s 2024-05-14T09:33:08.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:08 smithi120 ceph-mon[31085]: pgmap v843: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 691 op/s 2024-05-14T09:33:08.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:08 smithi152 ceph-mon[34868]: pgmap v843: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 691 op/s 2024-05-14T09:33:08.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:08 smithi175 ceph-mon[35353]: pgmap v843: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 691 op/s 2024-05-14T09:33:09.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 335.0 s, 612.4 tps, lat 163.489 ms stddev 75.278 2024-05-14T09:33:09.383 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:09 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:09.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:09 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:09.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:09 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:10.379 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:10 smithi175 ceph-mon[35353]: pgmap v844: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 696 op/s 2024-05-14T09:33:10.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:10 smithi120 ceph-mon[31085]: pgmap v844: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 696 op/s 2024-05-14T09:33:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:10 smithi152 ceph-mon[34868]: pgmap v844: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 696 op/s 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.853+0000 7f3354a00640 1 -- 172.21.15.120:0/2805948896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f335010bcc0 msgr2=0x7f335010c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.853+0000 7f3354a00640 1 --2- 172.21.15.120:0/2805948896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f335010bcc0 0x7f335010c0d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f333c00aa10 tx=0x7f333c02b720 comp rx=0 tx=0).stop 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.853+0000 7f3354a00640 1 -- 172.21.15.120:0/2805948896 shutdown_connections 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.853+0000 7f3354a00640 1 --2- 172.21.15.120:0/2805948896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33501109c0 0x7f3350112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.853+0000 7f3354a00640 1 --2- 172.21.15.120:0/2805948896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f335010bcc0 0x7f335010c0d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.853+0000 7f3354a00640 1 --2- 172.21.15.120:0/2805948896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335010ae50 0x7f335010b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.853+0000 7f3354a00640 1 -- 172.21.15.120:0/2805948896 >> 172.21.15.120:0/2805948896 conn(0x7f3350070a90 msgr2=0x7f3350072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.854+0000 7f3354a00640 1 -- 172.21.15.120:0/2805948896 shutdown_connections 2024-05-14T09:33:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.854+0000 7f3354a00640 1 -- 172.21.15.120:0/2805948896 wait complete. 2024-05-14T09:33:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.856+0000 7f3354a00640 1 Processor -- start 2024-05-14T09:33:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.856+0000 7f3354a00640 1 -- start start 2024-05-14T09:33:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f3354a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335010ae50 0x7f335011bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f3354a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f335010bcc0 0x7f335011c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f3354a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33501109c0 0x7f335011a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f3354a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3350114960 con 0x7f335010bcc0 2024-05-14T09:33:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f3354a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f33501147e0 con 0x7f335010ae50 2024-05-14T09:33:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f3354a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3350114ae0 con 0x7f33501109c0 2024-05-14T09:33:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f334e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33501109c0 0x7f335011a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f334e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33501109c0 0x7f335011a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:50880/0 (socket says 172.21.15.120:50880) 2024-05-14T09:33:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f334d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f335010bcc0 0x7f335011c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.857+0000 7f334e800640 1 -- 172.21.15.120:0/2391581966 learned_addr learned my addr 172.21.15.120:0/2391581966 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.858+0000 7f334de00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335010ae50 0x7f335011bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334d400640 1 -- 172.21.15.120:0/2391581966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33501109c0 msgr2=0x7f335011a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334d400640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33501109c0 0x7f335011a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334d400640 1 -- 172.21.15.120:0/2391581966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335010ae50 msgr2=0x7f335011bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334d400640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335010ae50 0x7f335011bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334d400640 1 -- 172.21.15.120:0/2391581966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335011af90 con 0x7f335010bcc0 2024-05-14T09:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334de00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335010ae50 0x7f335011bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:33:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334e800640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33501109c0 0x7f335011a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:33:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.859+0000 7f334d400640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f335010bcc0 0x7f335011c500 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f333c02bc40 tx=0x7f333c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.860+0000 7f3346a00640 1 -- 172.21.15.120:0/2391581966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c03f070 con 0x7f335010bcc0 2024-05-14T09:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.861+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335011b1c0 con 0x7f335010bcc0 2024-05-14T09:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.861+0000 7f3346a00640 1 -- 172.21.15.120:0/2391581966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f333c030cb0 con 0x7f335010bcc0 2024-05-14T09:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.861+0000 7f3346a00640 1 -- 172.21.15.120:0/2391581966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c03f070 con 0x7f335010bcc0 2024-05-14T09:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.861+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33501b9db0 con 0x7f335010bcc0 2024-05-14T09:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.868+0000 7f335b9dc740 1 Processor -- start 2024-05-14T09:33:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.868+0000 7f335b9dc740 1 -- start start 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.869+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0901100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.870+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f0901680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.870+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0908580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.870+0000 7f335b9dc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f1f0865550 con 0x55f1f055f1b0 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.870+0000 7f335b9dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f1f080abc0 con 0x55f1f05362f0 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.870+0000 7f335b9dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1f0861510 con 0x55f1f053e4d0 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.870+0000 7f3346a00640 1 -- 172.21.15.120:0/2391581966 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f333c042070 con 0x7f335010bcc0 2024-05-14T09:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.870+0000 7f334e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0901100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.871+0000 7f334e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0901100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48044/0 (socket says 172.21.15.120:48044) 2024-05-14T09:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.871+0000 7f334de00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f0901680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.871+0000 7f334de00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f0901680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33110/0 (socket says 172.21.15.120:33110) 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.871+0000 7f334de00640 1 -- 172.21.15.120:0/3664862444 learned_addr learned my addr 172.21.15.120:0/3664862444 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.872+0000 7f334e800640 1 -- 172.21.15.120:0/3664862444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 msgr2=0x55f1f0908580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.872+0000 7f334d400640 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0908580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.872+0000 7f334e800640 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0908580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.872+0000 7f334e800640 1 -- 172.21.15.120:0/3664862444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 msgr2=0x55f1f0901680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.872+0000 7f334e800640 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f0901680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.872+0000 7f334e800640 1 -- 172.21.15.120:0/3664862444 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f0577210 con 0x55f1f055f1b0 2024-05-14T09:33:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.873+0000 7f334e800640 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0901100 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f33480117e0 tx=0x7f3348011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1313a79695112d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.873+0000 7f333b000640 1 -- 172.21.15.120:0/3664862444 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3348011310 con 0x55f1f055f1b0 2024-05-14T09:33:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.874+0000 7f333b000640 1 -- 172.21.15.120:0/3664862444 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f334800f9a0 con 0x55f1f055f1b0 2024-05-14T09:33:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.875+0000 7f3346a00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f33340b2ad0 0x7f33340b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.875+0000 7f335b9dc740 1 -- 172.21.15.120:0/3664862444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 msgr2=0x55f1f0901100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.875+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0901100 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f33480117e0 tx=0x7f3348011ca0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f3346a00640 1 -- 172.21.15.120:0/2391581966 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f333c1027a0 con 0x7f335010bcc0 2024-05-14T09:33:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f335b9dc740 1 -- 172.21.15.120:0/3664862444 shutdown_connections 2024-05-14T09:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0908580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f0901680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3664862444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0901100 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f334de00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f33340b2ad0 0x7f33340b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f335b9dc740 1 -- 172.21.15.120:0/3664862444 >> 172.21.15.120:0/3664862444 conn(0x55f1f0553300 msgr2=0x55f1f08fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.876+0000 7f335b9dc740 1 -- 172.21.15.120:0/3664862444 shutdown_connections 2024-05-14T09:33:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.877+0000 7f335b9dc740 1 -- 172.21.15.120:0/3664862444 wait complete. 2024-05-14T09:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.877+0000 7f335b9dc740 1 -- start start 2024-05-14T09:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.878+0000 7f335b9dc740 1 Processor -- start 2024-05-14T09:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.878+0000 7f334de00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f33340b2ad0 0x7f33340b4fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55f1f08fd820 tx=0x7f3340005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.879+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.879+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f090b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.879+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.879+0000 7f335b9dc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f1f0909070 con 0x55f1f05362f0 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f334de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f334de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48058/0 (socket says 172.21.15.120:48058) 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f334de00640 1 -- 172.21.15.120:0/3670933821 learned_addr learned my addr 172.21.15.120:0/3670933821 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f1f081e660 con 0x55f1f053e4d0 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1f09091f0 con 0x55f1f055f1b0 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f335b9dc740 10 client.0 _ll_register_callbacks cb 0x55f1f07e8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f334e800640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.880+0000 7f334d400640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f090b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.881+0000 7f334e800640 1 -- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 msgr2=0x55f1f090b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.881+0000 7f334e800640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f090b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.881+0000 7f334e800640 1 -- 172.21.15.120:0/3670933821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 msgr2=0x55f1f090ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.881+0000 7f334e800640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.881+0000 7f334e800640 1 -- 172.21.15.120:0/3670933821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f0643620 con 0x55f1f055f1b0 2024-05-14T09:33:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.881+0000 7f334de00640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:33:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.882+0000 7f334e800640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09120a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3348009a70 tx=0x7f33480113c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa0e33bb8ca27e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.882+0000 7f332f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:33:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.883+0000 7f332f400640 1 -- 172.21.15.120:0/3670933821 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3348028020 con 0x55f1f055f1b0 2024-05-14T09:33:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.883+0000 7f332f400640 1 -- 172.21.15.120:0/3670933821 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3348004de0 con 0x55f1f055f1b0 2024-05-14T09:33:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.883+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f334800f9a0 con 0x55f1f055f1b0 2024-05-14T09:33:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.884+0000 7f332f400640 1 -- 172.21.15.120:0/3670933821 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f3348004fe0 con 0x55f1f055f1b0 2024-05-14T09:33:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.884+0000 7f335b9dc740 10 client.26413 fetch_fsmap learned FSMap version 53 2024-05-14T09:33:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.884+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55f1f0914fd0 con 0x55f1f055f1b0 2024-05-14T09:33:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.884+0000 7f332f400640 1 -- 172.21.15.120:0/3670933821 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f334800f9a0 con 0x55f1f055f1b0 2024-05-14T09:33:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.884+0000 7f332f400640 1 -- 172.21.15.120:0/3670933821 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 53) ==== 8374+0+0 (secure 0 0 0) 0x7f3348018070 con 0x55f1f055f1b0 2024-05-14T09:33:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.885+0000 7f335b9dc740 10 client.26413 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T09:33:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.885+0000 7f335b9dc740 10 client.26413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.885+0000 7f335b9dc740 20 client.26413 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.885+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f051dd80 0x55f1f0918460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.885+0000 7f335b9dc740 4 client.26413 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:33:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.885+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1f0873160 con 0x55f1f051dd80 2024-05-14T09:33:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.885+0000 7f334de00640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f051dd80 0x55f1f0918460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.887+0000 7f334de00640 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f051dd80 0x55f1f0918460 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be4a98d12dcc9ab server_cookie=7b90a0b2ba0bd3bc in_seq=0 out_seq=0 2024-05-14T09:33:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.887+0000 7f332f400640 10 client.26413 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.888+0000 7f332f400640 1 -- 172.21.15.120:0/3670933821 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f1f0873160 con 0x55f1f051dd80 2024-05-14T09:33:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.888+0000 7f332f400640 10 client.26413 handle_command_reply: tid=0 2024-05-14T09:33:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.888+0000 7f335b9dc740 1 client.26413 shutdown 2024-05-14T09:33:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.889+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 msgr2=0x55f1f09120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.889+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09120a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3348009a70 tx=0x7f33480113c0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 shutdown_connections 2024-05-14T09:33:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f051dd80 0x55f1f0918460 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09120a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f090b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 --2- 172.21.15.120:0/3670933821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 >> 172.21.15.120:0/3670933821 conn(0x55f1f0553300 msgr2=0x55f1f08fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f332f400640 0 client.26413 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 shutdown_connections 2024-05-14T09:33:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.890+0000 7f335b9dc740 1 -- 172.21.15.120:0/3670933821 wait complete. 2024-05-14T09:33:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.891+0000 7f335b9dc740 20 client.26413 trim_cache size 0 max 16384 2024-05-14T09:33:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.924+0000 7f335b9dc740 1 Processor -- start 2024-05-14T09:33:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.925+0000 7f335b9dc740 1 -- start start 2024-05-14T09:33:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.925+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f091cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.925+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0911fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.926+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0912500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.926+0000 7f335b9dc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f33501c4000 con 0x55f1f055f1b0 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.926+0000 7f335b9dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f33501c5b70 con 0x55f1f05362f0 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.926+0000 7f335b9dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f33501c4700 con 0x55f1f053e4d0 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.926+0000 7f334de00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f091cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.926+0000 7f334de00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f091cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33126/0 (socket says 172.21.15.120:33126) 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.926+0000 7f334de00640 1 -- 172.21.15.120:0/2661311205 learned_addr learned my addr 172.21.15.120:0/2661311205 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.927+0000 7f334d400640 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0911fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.927+0000 7f334e800640 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0912500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.927+0000 7f334de00640 1 -- 172.21.15.120:0/2661311205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 msgr2=0x55f1f0911fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.927+0000 7f334de00640 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0911fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.927+0000 7f334de00640 1 -- 172.21.15.120:0/2661311205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 msgr2=0x55f1f0912500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.927+0000 7f334de00640 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0912500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.927+0000 7f334de00640 1 -- 172.21.15.120:0/2661311205 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f08fd010 con 0x55f1f05362f0 2024-05-14T09:33:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.928+0000 7f334e800640 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0912500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:33:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.929+0000 7f334de00640 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f091cc10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33400058c0 tx=0x7f3340016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a76e6675e47e9fe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.929+0000 7f333a600640 1 -- 172.21.15.120:0/2661311205 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334001fe00 con 0x55f1f05362f0 2024-05-14T09:33:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.930+0000 7f333a600640 1 -- 172.21.15.120:0/2661311205 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33400054b0 con 0x55f1f05362f0 2024-05-14T09:33:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.930+0000 7f333a600640 1 -- 172.21.15.120:0/2661311205 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334001fe00 con 0x55f1f05362f0 2024-05-14T09:33:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.932+0000 7f335b9dc740 1 -- 172.21.15.120:0/2661311205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 msgr2=0x55f1f091cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.932+0000 7f335b9dc740 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f091cc10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33400058c0 tx=0x7f3340016000 comp rx=0 tx=0).stop 2024-05-14T09:33:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.932+0000 7f335b9dc740 1 -- 172.21.15.120:0/2661311205 shutdown_connections 2024-05-14T09:33:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.932+0000 7f335b9dc740 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f055f1b0 0x55f1f0912500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.932+0000 7f335b9dc740 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f053e4d0 0x55f1f0911fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.932+0000 7f335b9dc740 1 --2- 172.21.15.120:0/2661311205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f05362f0 0x55f1f091cc10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.932+0000 7f335b9dc740 1 -- 172.21.15.120:0/2661311205 >> 172.21.15.120:0/2661311205 conn(0x55f1f0553300 msgr2=0x55f1f0904f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.933+0000 7f335b9dc740 1 -- 172.21.15.120:0/2661311205 shutdown_connections 2024-05-14T09:33:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.933+0000 7f335b9dc740 1 -- 172.21.15.120:0/2661311205 wait complete. 2024-05-14T09:33:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.933+0000 7f335b9dc740 1 -- start start 2024-05-14T09:33:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.934+0000 7f335b9dc740 1 Processor -- start 2024-05-14T09:33:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.934+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f09101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f335b9dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f334de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f334de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48070/0 (socket says 172.21.15.120:48070) 2024-05-14T09:33:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f335b9dc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f33501c54a0 con 0x55f1f05362f0 2024-05-14T09:33:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f335b9dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f33501c4dd0 con 0x55f1f053e4d0 2024-05-14T09:33:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f335b9dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f33501c2000 con 0x55f1f055f1b0 2024-05-14T09:33:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f335b9dc740 10 client.0 _ll_register_callbacks cb 0x7f334800fef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f334de00640 1 -- 172.21.15.120:0/485416934 learned_addr learned my addr 172.21.15.120:0/485416934 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.935+0000 7f334d400640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f09101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.936+0000 7f334e800640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.936+0000 7f334de00640 1 -- 172.21.15.120:0/485416934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 msgr2=0x55f1f09110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.936+0000 7f334de00640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.936+0000 7f334de00640 1 -- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 msgr2=0x55f1f09101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.937+0000 7f334de00640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f09101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.937+0000 7f334de00640 1 -- 172.21.15.120:0/485416934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f0911670 con 0x55f1f05362f0 2024-05-14T09:33:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.937+0000 7f334d400640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f09101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:33:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.938+0000 7f334de00640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090fc90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f33400048d0 tx=0x7f3340004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ee8e3809be7b95 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.938+0000 7f332f400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:33:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.939+0000 7f332f400640 1 -- 172.21.15.120:0/485416934 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334003c060 con 0x55f1f05362f0 2024-05-14T09:33:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.939+0000 7f332f400640 1 -- 172.21.15.120:0/485416934 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f33400051d0 con 0x55f1f05362f0 2024-05-14T09:33:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.939+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33400054b0 con 0x55f1f05362f0 2024-05-14T09:33:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.940+0000 7f332f400640 1 -- 172.21.15.120:0/485416934 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f33400272d0 con 0x55f1f05362f0 2024-05-14T09:33:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.940+0000 7f335b9dc740 10 client.16875 fetch_fsmap learned FSMap version 53 2024-05-14T09:33:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.940+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55f1f0912900 con 0x55f1f05362f0 2024-05-14T09:33:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.941+0000 7f332f400640 1 -- 172.21.15.120:0/485416934 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33400054b0 con 0x55f1f05362f0 2024-05-14T09:33:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f332f400640 1 -- 172.21.15.120:0/485416934 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 53) ==== 8374+0+0 (secure 0 0 0) 0x7f3340027ce0 con 0x55f1f05362f0 2024-05-14T09:33:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f335b9dc740 10 client.16875 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T09:33:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f335b9dc740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f335b9dc740 20 client.16875 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f335b9dc740 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f04f31c0 0x55f1f0982c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f335b9dc740 4 client.16875 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:33:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1f086cfd0 con 0x55f1f04f31c0 2024-05-14T09:33:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.942+0000 7f334d400640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f04f31c0 0x55f1f0982c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.946+0000 7f334d400640 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f04f31c0 0x55f1f0982c50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1111864ae6fe17d server_cookie=78ae740027cb8dae in_seq=0 out_seq=0 2024-05-14T09:33:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.946+0000 7f332f400640 10 client.16875 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.976+0000 7f332f400640 1 -- 172.21.15.120:0/485416934 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1f086cfd0 con 0x55f1f04f31c0 2024-05-14T09:33:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.976+0000 7f332f400640 10 client.16875 handle_command_reply: tid=0 2024-05-14T09:33:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.976+0000 7f335b9dc740 1 client.16875 shutdown 2024-05-14T09:33:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.977+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 msgr2=0x55f1f090fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.977+0000 7f335b9dc740 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090fc90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f33400048d0 tx=0x7f3340004900 comp rx=0 tx=0).stop 2024-05-14T09:33:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 shutdown_connections 2024-05-14T09:33:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f335b9dc740 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f1f04f31c0 0x55f1f0982c50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f335b9dc740 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1f055f1b0 0x55f1f09110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f335b9dc740 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1f053e4d0 0x55f1f09101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f335b9dc740 1 --2- 172.21.15.120:0/485416934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1f05362f0 0x55f1f090fc90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f332f400640 0 client.16875 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 >> 172.21.15.120:0/485416934 conn(0x55f1f0553300 msgr2=0x55f1f08ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.978+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 shutdown_connections 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.979+0000 7f335b9dc740 1 -- 172.21.15.120:0/485416934 wait complete. 2024-05-14T09:33:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.979+0000 7f335b9dc740 20 client.16875 trim_cache size 0 max 16384 2024-05-14T09:33:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:33:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:33:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:33:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f33340b2ad0 msgr2=0x7f33340b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f33340b2ad0 0x7f33340b4fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55f1f08fd820 tx=0x7f3340005f90 comp rx=0 tx=0).stop 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f335010bcc0 msgr2=0x7f335011c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f335010bcc0 0x7f335011c500 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f333c02bc40 tx=0x7f333c003c10 comp rx=0 tx=0).stop 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 shutdown_connections 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f33340b2ad0 0x7f33340b4fe0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33501109c0 0x7f335011a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f335010bcc0 0x7f335011c500 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 --2- 172.21.15.120:0/2391581966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335010ae50 0x7f335011bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.982+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 >> 172.21.15.120:0/2391581966 conn(0x7f3350070a90 msgr2=0x7f335010c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.983+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 shutdown_connections 2024-05-14T09:33:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:11.983+0000 7f3354a00640 1 -- 172.21.15.120:0/2391581966 wait complete. 2024-05-14T09:33:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:12 smithi120 ceph-mon[31085]: pgmap v845: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 643 op/s 2024-05-14T09:33:12.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:12 smithi152 ceph-mon[34868]: pgmap v845: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 643 op/s 2024-05-14T09:33:12.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:12 smithi175 ceph-mon[35353]: pgmap v845: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 643 op/s 2024-05-14T09:33:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 340.0 s, 649.4 tps, lat 153.343 ms stddev 40.665 2024-05-14T09:33:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:14 smithi120 ceph-mon[31085]: pgmap v846: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.8 MiB/s wr, 645 op/s 2024-05-14T09:33:14.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:14 smithi152 ceph-mon[34868]: pgmap v846: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.8 MiB/s wr, 645 op/s 2024-05-14T09:33:14.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:14 smithi175 ceph-mon[35353]: pgmap v846: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.8 MiB/s wr, 645 op/s 2024-05-14T09:33:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:16 smithi152 ceph-mon[34868]: pgmap v847: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-05-14T09:33:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:16 smithi175 ceph-mon[35353]: pgmap v847: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-05-14T09:33:16.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:16 smithi120 ceph-mon[31085]: pgmap v847: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-05-14T09:33:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:18 smithi152 ceph-mon[34868]: pgmap v848: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 610 op/s 2024-05-14T09:33:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:18 smithi175 ceph-mon[35353]: pgmap v848: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 610 op/s 2024-05-14T09:33:18.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:18 smithi120 ceph-mon[31085]: pgmap v848: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 610 op/s 2024-05-14T09:33:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 345.0 s, 599.0 tps, lat 167.183 ms stddev 66.452 2024-05-14T09:33:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:20 smithi152 ceph-mon[34868]: pgmap v849: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 672 op/s 2024-05-14T09:33:20.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:20 smithi175 ceph-mon[35353]: pgmap v849: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 672 op/s 2024-05-14T09:33:20.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:20 smithi120 ceph-mon[31085]: pgmap v849: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 672 op/s 2024-05-14T09:33:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:22 smithi152 ceph-mon[34868]: pgmap v850: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2024-05-14T09:33:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:22 smithi175 ceph-mon[35353]: pgmap v850: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2024-05-14T09:33:22.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:22 smithi120 ceph-mon[31085]: pgmap v850: 129 pgs: 129 active+clean; 1.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2024-05-14T09:33:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 350.0 s, 617.2 tps, lat 162.703 ms stddev 68.608 2024-05-14T09:33:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:24 smithi152 ceph-mon[34868]: pgmap v851: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 654 op/s 2024-05-14T09:33:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:24 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:24 smithi175 ceph-mon[35353]: pgmap v851: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 654 op/s 2024-05-14T09:33:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:24 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:24.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:24 smithi120 ceph-mon[31085]: pgmap v851: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 654 op/s 2024-05-14T09:33:24.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:24 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.324+0000 7f0a4c000640 1 -- 172.21.15.120:0/3161056142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 msgr2=0x7f0a4410af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.324+0000 7f0a4c000640 1 --2- 172.21.15.120:0/3161056142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 0x7f0a4410af80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009860 tx=0x7f0a3802a340 comp rx=0 tx=0).stop 2024-05-14T09:33:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.326+0000 7f0a4c000640 1 -- 172.21.15.120:0/3161056142 shutdown_connections 2024-05-14T09:33:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.326+0000 7f0a4c000640 1 --2- 172.21.15.120:0/3161056142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a441101c0 0x7f0a441125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.326+0000 7f0a4c000640 1 --2- 172.21.15.120:0/3161056142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4410b4c0 0x7f0a4410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.326+0000 7f0a4c000640 1 --2- 172.21.15.120:0/3161056142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 0x7f0a4410af80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.326+0000 7f0a4c000640 1 -- 172.21.15.120:0/3161056142 >> 172.21.15.120:0/3161056142 conn(0x7f0a44078f10 msgr2=0x7f0a44107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.326+0000 7f0a4c000640 1 -- 172.21.15.120:0/3161056142 shutdown_connections 2024-05-14T09:33:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.327+0000 7f0a4c000640 1 -- 172.21.15.120:0/3161056142 wait complete. 2024-05-14T09:33:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.328+0000 7f0a4c000640 1 Processor -- start 2024-05-14T09:33:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.329+0000 7f0a4c000640 1 -- start start 2024-05-14T09:33:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.329+0000 7f0a4c000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 0x7f0a441a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.330+0000 7f0a4c000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a4410b4c0 0x7f0a441a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.330+0000 7f0a4c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a441101c0 0x7f0a441a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.330+0000 7f0a4c000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44115c50 con 0x7f0a4410a280 2024-05-14T09:33:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.330+0000 7f0a4c000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44115ad0 con 0x7f0a4410b4c0 2024-05-14T09:33:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.330+0000 7f0a4c000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44115dd0 con 0x7f0a441101c0 2024-05-14T09:33:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.330+0000 7f0a49600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 0x7f0a441a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.330+0000 7f0a48c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a4410b4c0 0x7f0a441a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.331+0000 7f0a4a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a441101c0 0x7f0a441a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.331+0000 7f0a4a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a441101c0 0x7f0a441a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:58872/0 (socket says 172.21.15.120:58872) 2024-05-14T09:33:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.331+0000 7f0a4a000640 1 -- 172.21.15.120:0/2879432325 learned_addr learned my addr 172.21.15.120:0/2879432325 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.331+0000 7f0a49600640 1 -- 172.21.15.120:0/2879432325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a441101c0 msgr2=0x7f0a441a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.331+0000 7f0a49600640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a441101c0 0x7f0a441a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.331+0000 7f0a49600640 1 -- 172.21.15.120:0/2879432325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a4410b4c0 msgr2=0x7f0a441a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.331+0000 7f0a49600640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a4410b4c0 0x7f0a441a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.332+0000 7f0a49600640 1 -- 172.21.15.120:0/2879432325 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a441a83e0 con 0x7f0a4410a280 2024-05-14T09:33:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.334+0000 7f0a49600640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 0x7f0a441a08a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0a4410ae80 tx=0x7f0a3802ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.334+0000 7f0a42000640 1 -- 172.21.15.120:0/2879432325 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38037040 con 0x7f0a4410a280 2024-05-14T09:33:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.334+0000 7f0a42000640 1 -- 172.21.15.120:0/2879432325 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a380305b0 con 0x7f0a4410a280 2024-05-14T09:33:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.334+0000 7f0a42000640 1 -- 172.21.15.120:0/2879432325 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38003850 con 0x7f0a4410a280 2024-05-14T09:33:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.335+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a441a8670 con 0x7f0a4410a280 2024-05-14T09:33:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.335+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a441a8a80 con 0x7f0a4410a280 2024-05-14T09:33:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.341+0000 7f0a42000640 1 -- 172.21.15.120:0/2879432325 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f0a38043020 con 0x7f0a4410a280 2024-05-14T09:33:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.341+0000 7f0a5306a740 1 Processor -- start 2024-05-14T09:33:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.342+0000 7f0a5306a740 1 -- start start 2024-05-14T09:33:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.342+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb7b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb7b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb82580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a5306a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee2cadf550 con 0x55ee2c7b02f0 2024-05-14T09:33:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a5306a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ee2ca84bc0 con 0x55ee2c7d91b0 2024-05-14T09:33:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a5306a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ee2cadb510 con 0x55ee2c7b84d0 2024-05-14T09:33:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a4a000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb7b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a4a000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb7b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48238/0 (socket says 172.21.15.120:48238) 2024-05-14T09:33:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a4a000640 1 -- 172.21.15.120:0/3644505309 learned_addr learned my addr 172.21.15.120:0/3644505309 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.343+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb82580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.344+0000 7f0a48c00640 1 -- 172.21.15.120:0/3644505309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 msgr2=0x55ee2cb7b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.344+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb7b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.344+0000 7f0a48c00640 1 -- 172.21.15.120:0/3644505309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b02f0 msgr2=0x55ee2cb7b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.345+0000 7f0a42000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0a2c0b28e0 0x7f0a2c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.346+0000 7f0a42000640 1 -- 172.21.15.120:0/2879432325 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0a38101a90 con 0x7f0a4410a280 2024-05-14T09:33:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.346+0000 7f0a4a000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0a2c0b28e0 0x7f0a2c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.346+0000 7f0a49600640 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb7b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.346+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb7b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.346+0000 7f0a48c00640 1 -- 172.21.15.120:0/3644505309 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2c7f1210 con 0x55ee2c7b84d0 2024-05-14T09:33:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.346+0000 7f0a49600640 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb7b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:33:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.347+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb82580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009530 tx=0x7f0a30011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f859e8d5cc28efa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.348+0000 7f0a36600640 1 -- 172.21.15.120:0/3644505309 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3001e070 con 0x55ee2c7b84d0 2024-05-14T09:33:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.348+0000 7f0a36600640 1 -- 172.21.15.120:0/3644505309 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a30019ac0 con 0x55ee2c7b84d0 2024-05-14T09:33:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.348+0000 7f0a36600640 1 -- 172.21.15.120:0/3644505309 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3001e070 con 0x55ee2c7b84d0 2024-05-14T09:33:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.349+0000 7f0a5306a740 1 -- 172.21.15.120:0/3644505309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b84d0 msgr2=0x55ee2cb82580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.349+0000 7f0a4a000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0a2c0b28e0 0x7f0a2c0b4df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55ee2cb7c2d0 tx=0x7f0a3c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.349+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb82580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009530 tx=0x7f0a30011810 comp rx=0 tx=0).stop 2024-05-14T09:33:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.350+0000 7f0a5306a740 1 -- 172.21.15.120:0/3644505309 shutdown_connections 2024-05-14T09:33:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.350+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb82580 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.350+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb7b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.350+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3644505309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb7b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.350+0000 7f0a5306a740 1 -- 172.21.15.120:0/3644505309 >> 172.21.15.120:0/3644505309 conn(0x55ee2c7cd300 msgr2=0x55ee2cb76a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.350+0000 7f0a5306a740 1 -- 172.21.15.120:0/3644505309 shutdown_connections 2024-05-14T09:33:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.350+0000 7f0a5306a740 1 -- 172.21.15.120:0/3644505309 wait complete. 2024-05-14T09:33:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.351+0000 7f0a5306a740 1 -- start start 2024-05-14T09:33:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.351+0000 7f0a5306a740 1 Processor -- start 2024-05-14T09:33:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.352+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb84bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.352+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb85110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.352+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb8c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.352+0000 7f0a5306a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee2cb82fd0 con 0x55ee2c7d91b0 2024-05-14T09:33:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.352+0000 7f0a5306a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ee2ca98660 con 0x55ee2c7b84d0 2024-05-14T09:33:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.352+0000 7f0a5306a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ee2cb83150 con 0x55ee2c7b02f0 2024-05-14T09:33:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.352+0000 7f0a5306a740 10 client.0 _ll_register_callbacks cb 0x55ee2ca62400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.353+0000 7f0a49600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb84bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.353+0000 7f0a49600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb84bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:58896/0 (socket says 172.21.15.120:58896) 2024-05-14T09:33:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.353+0000 7f0a49600640 1 -- 172.21.15.120:0/2488437426 learned_addr learned my addr 172.21.15.120:0/2488437426 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.353+0000 7f0a4a000640 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb8c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.353+0000 7f0a48c00640 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb85110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.354+0000 7f0a49600640 1 -- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b84d0 msgr2=0x55ee2cb85110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.354+0000 7f0a49600640 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb85110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.354+0000 7f0a49600640 1 -- 172.21.15.120:0/2488437426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7d91b0 msgr2=0x55ee2cb8c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.354+0000 7f0a49600640 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb8c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.354+0000 7f0a49600640 1 -- 172.21.15.120:0/2488437426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2c8bd620 con 0x55ee2c7b02f0 2024-05-14T09:33:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.355+0000 7f0a49600640 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb84bd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009230 tx=0x7f0a380c92d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=572ad4241cf2251 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.355+0000 7f0a2aa00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:33:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.355+0000 7f0a2aa00640 1 -- 172.21.15.120:0/2488437426 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a380c8420 con 0x55ee2c7b02f0 2024-05-14T09:33:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.355+0000 7f0a2aa00640 1 -- 172.21.15.120:0/2488437426 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0a380c8120 con 0x55ee2c7b02f0 2024-05-14T09:33:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.356+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a30019ac0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.356+0000 7f0a2aa00640 1 -- 172.21.15.120:0/2488437426 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0a380c4440 con 0x55ee2c7b02f0 2024-05-14T09:33:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.357+0000 7f0a5306a740 10 client.26431 fetch_fsmap learned FSMap version 54 2024-05-14T09:33:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.357+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55ee2cb83090 con 0x55ee2c7b02f0 2024-05-14T09:33:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.357+0000 7f0a2aa00640 1 -- 172.21.15.120:0/2488437426 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a30019ac0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.358+0000 7f0a2aa00640 1 -- 172.21.15.120:0/2488437426 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 54) ==== 8370+0+0 (secure 0 0 0) 0x7f0a380e31b0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.358+0000 7f0a5306a740 10 client.26431 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T09:33:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.358+0000 7f0a5306a740 10 client.26431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.358+0000 7f0a5306a740 20 client.26431 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.358+0000 7f0a5306a740 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c797d80 0x55ee2cba36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.358+0000 7f0a5306a740 4 client.26431 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:33:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.358+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee2caed160 con 0x55ee2c797d80 2024-05-14T09:33:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.359+0000 7f0a48c00640 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c797d80 0x55ee2cba36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.361+0000 7f0a48c00640 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c797d80 0x55ee2cba36d0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb5dba9fbfc3b7d server_cookie=ab275de99e725ebf in_seq=0 out_seq=0 2024-05-14T09:33:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.361+0000 7f0a2aa00640 10 client.26431 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.363+0000 7f0a2aa00640 1 -- 172.21.15.120:0/2488437426 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ee2caed160 con 0x55ee2c797d80 2024-05-14T09:33:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.363+0000 7f0a2aa00640 10 client.26431 handle_command_reply: tid=0 2024-05-14T09:33:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.363+0000 7f0a5306a740 1 client.26431 shutdown 2024-05-14T09:33:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 msgr2=0x55ee2cb84bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb84bd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009230 tx=0x7f0a380c92d0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 shutdown_connections 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c797d80 0x55ee2cba36d0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb8c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb85110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 --2- 172.21.15.120:0/2488437426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb84bd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a2aa00640 0 client.26431 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 >> 172.21.15.120:0/2488437426 conn(0x55ee2c7cd300 msgr2=0x55ee2cb75a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 shutdown_connections 2024-05-14T09:33:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 1 -- 172.21.15.120:0/2488437426 wait complete. 2024-05-14T09:33:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.364+0000 7f0a5306a740 20 client.26431 trim_cache size 0 max 16384 2024-05-14T09:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.398+0000 7f0a5306a740 1 Processor -- start 2024-05-14T09:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.398+0000 7f0a5306a740 1 -- start start 2024-05-14T09:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.399+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb851d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb8c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a49600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb851d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a49600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb851d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:58910/0 (socket says 172.21.15.120:58910) 2024-05-14T09:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a49600640 1 -- 172.21.15.120:0/3272117639 learned_addr learned my addr 172.21.15.120:0/3272117639 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0a441aa870 con 0x55ee2c7b84d0 2024-05-14T09:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a441ac3b0 con 0x55ee2c7d91b0 2024-05-14T09:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.400+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a441aaf40 con 0x55ee2c7b02f0 2024-05-14T09:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.401+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb8c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.401+0000 7f0a4a000640 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.401+0000 7f0a49600640 1 -- 172.21.15.120:0/3272117639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 msgr2=0x55ee2cb79fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.401+0000 7f0a49600640 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb79fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.401+0000 7f0a49600640 1 -- 172.21.15.120:0/3272117639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 msgr2=0x55ee2cb8c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.402+0000 7f0a49600640 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb8c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.402+0000 7f0a49600640 1 -- 172.21.15.120:0/3272117639 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2cb72280 con 0x55ee2c7b02f0 2024-05-14T09:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.402+0000 7f0a4a000640 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb79fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.402+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb8c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.402+0000 7f0a49600640 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb851d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a380c4d30 tx=0x7f0a380c8d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe25d86cd4ce972 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.403+0000 7f0a35c00640 1 -- 172.21.15.120:0/3272117639 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a380c8420 con 0x55ee2c7b02f0 2024-05-14T09:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.403+0000 7f0a35c00640 1 -- 172.21.15.120:0/3272117639 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a380d1450 con 0x55ee2c7b02f0 2024-05-14T09:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.403+0000 7f0a35c00640 1 -- 172.21.15.120:0/3272117639 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a380c8120 con 0x55ee2c7b02f0 2024-05-14T09:33:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.405+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 msgr2=0x55ee2cb851d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.405+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb851d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a380c4d30 tx=0x7f0a380c8d80 comp rx=0 tx=0).stop 2024-05-14T09:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.405+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 shutdown_connections 2024-05-14T09:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.405+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7d91b0 0x55ee2cb79fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.405+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cb8c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.405+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3272117639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb851d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.405+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 >> 172.21.15.120:0/3272117639 conn(0x55ee2c7cd300 msgr2=0x55ee2cb79890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.406+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 shutdown_connections 2024-05-14T09:33:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.406+0000 7f0a5306a740 1 -- 172.21.15.120:0/3272117639 wait complete. 2024-05-14T09:33:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.407+0000 7f0a5306a740 1 -- start start 2024-05-14T09:33:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.407+0000 7f0a5306a740 1 Processor -- start 2024-05-14T09:33:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.409+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb8bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.409+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cc07a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.409+0000 7f0a5306a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7d91b0 0x55ee2cc0a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.409+0000 7f0a5306a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0a441abce0 con 0x55ee2c7b84d0 2024-05-14T09:33:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.409+0000 7f0a5306a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a441ab610 con 0x55ee2c7b02f0 2024-05-14T09:33:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.409+0000 7f0a5306a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a440749c0 con 0x55ee2c7d91b0 2024-05-14T09:33:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.409+0000 7f0a5306a740 10 client.0 _ll_register_callbacks cb 0x7f0a380057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.410+0000 7f0a49600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb8bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.410+0000 7f0a48c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cc07a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.410+0000 7f0a49600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb8bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48268/0 (socket says 172.21.15.120:48268) 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.410+0000 7f0a49600640 1 -- 172.21.15.120:0/3408935236 learned_addr learned my addr 172.21.15.120:0/3408935236 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.410+0000 7f0a49600640 1 -- 172.21.15.120:0/3408935236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7d91b0 msgr2=0x55ee2cc0a000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.410+0000 7f0a49600640 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7d91b0 0x55ee2cc0a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.411+0000 7f0a49600640 1 -- 172.21.15.120:0/3408935236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 msgr2=0x55ee2cc07a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.411+0000 7f0a49600640 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cc07a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.411+0000 7f0a49600640 1 -- 172.21.15.120:0/3408935236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2cc0a760 con 0x55ee2c7b02f0 2024-05-14T09:33:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.411+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cc07a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:33:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.412+0000 7f0a49600640 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb8bf90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0a38035040 tx=0x7f0a38030960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb30fbc82d04fa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.412+0000 7f0a2aa00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:33:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.412+0000 7f0a2aa00640 1 -- 172.21.15.120:0/3408935236 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a380c87c0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.412+0000 7f0a2aa00640 1 -- 172.21.15.120:0/3408935236 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0a380c52a0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.413+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee2cae6fd0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.413+0000 7f0a2aa00640 1 -- 172.21.15.120:0/3408935236 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0a38030760 con 0x55ee2c7b02f0 2024-05-14T09:33:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.413+0000 7f0a5306a740 10 client.36380 fetch_fsmap learned FSMap version 54 2024-05-14T09:33:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.413+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55ee2cc0a760 con 0x55ee2c7b02f0 2024-05-14T09:33:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.414+0000 7f0a2aa00640 1 -- 172.21.15.120:0/3408935236 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ee2cae6fd0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.414+0000 7f0a2aa00640 1 -- 172.21.15.120:0/3408935236 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 54) ==== 8370+0+0 (secure 0 0 0) 0x7f0a380ce1f0 con 0x55ee2c7b02f0 2024-05-14T09:33:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.415+0000 7f0a5306a740 10 client.36380 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T09:33:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.415+0000 7f0a5306a740 10 client.36380 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.415+0000 7f0a5306a740 20 client.36380 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.415+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c76d1c0 0x55ee2cc0df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.415+0000 7f0a5306a740 4 client.36380 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:33:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.415+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee2ca624b0 con 0x55ee2c76d1c0 2024-05-14T09:33:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.416+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c76d1c0 0x55ee2cc0df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.417+0000 7f0a48c00640 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c76d1c0 0x55ee2cc0df80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c669c12178695432 server_cookie=6e01c45233fa6ec9 in_seq=0 out_seq=0 2024-05-14T09:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.417+0000 7f0a2aa00640 10 client.36380 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.448+0000 7f0a2aa00640 1 -- 172.21.15.120:0/3408935236 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee2ca624b0 con 0x55ee2c76d1c0 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.448+0000 7f0a2aa00640 10 client.36380 handle_command_reply: tid=0 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 client.36380 shutdown 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b02f0 msgr2=0x55ee2cb8bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb8bf90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0a38035040 tx=0x7f0a38030960 comp rx=0 tx=0).stop 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 shutdown_connections 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55ee2c76d1c0 0x55ee2cc0df80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee2c7d91b0 0x55ee2cc0a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee2c7b84d0 0x55ee2cc07a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 --2- 172.21.15.120:0/3408935236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee2c7b02f0 0x55ee2cb8bf90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 >> 172.21.15.120:0/3408935236 conn(0x55ee2c7cd300 msgr2=0x55ee2cb7a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:25.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.449+0000 7f0a2aa00640 0 client.36380 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:25.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.450+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 shutdown_connections 2024-05-14T09:33:25.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.450+0000 7f0a5306a740 1 -- 172.21.15.120:0/3408935236 wait complete. 2024-05-14T09:33:25.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.450+0000 7f0a5306a740 20 client.36380 trim_cache size 0 max 16384 2024-05-14T09:33:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:33:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:33:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:33:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:33:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.451+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0a2c0b28e0 msgr2=0x7f0a2c0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.451+0000 7f0a4c000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0a2c0b28e0 0x7f0a2c0b4df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55ee2cb7c2d0 tx=0x7f0a3c009500 comp rx=0 tx=0).stop 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.451+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 msgr2=0x7f0a441a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.451+0000 7f0a4c000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 0x7f0a441a08a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0a4410ae80 tx=0x7f0a3802ada0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 shutdown_connections 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f0a2c0b28e0 0x7f0a2c0b4df0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a441101c0 0x7f0a441a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a4410b4c0 0x7f0a441a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 --2- 172.21.15.120:0/2879432325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a4410a280 0x7f0a441a08a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 >> 172.21.15.120:0/2879432325 conn(0x7f0a44078f10 msgr2=0x7f0a4410c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 shutdown_connections 2024-05-14T09:33:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:25.452+0000 7f0a4c000640 1 -- 172.21.15.120:0/2879432325 wait complete. 2024-05-14T09:33:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:26 smithi152 ceph-mon[34868]: pgmap v852: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 646 op/s 2024-05-14T09:33:26.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:26 smithi175 ceph-mon[35353]: pgmap v852: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 646 op/s 2024-05-14T09:33:26.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:26 smithi120 ceph-mon[31085]: pgmap v852: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 646 op/s 2024-05-14T09:33:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:28 smithi152 ceph-mon[34868]: pgmap v853: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T09:33:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:28 smithi175 ceph-mon[35353]: pgmap v853: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T09:33:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:28 smithi120 ceph-mon[31085]: pgmap v853: 129 pgs: 129 active+clean; 1.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T09:33:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 355.0 s, 699.2 tps, lat 142.814 ms stddev 40.122 2024-05-14T09:33:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:30 smithi152 ceph-mon[34868]: pgmap v854: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 668 op/s 2024-05-14T09:33:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:30 smithi175 ceph-mon[35353]: pgmap v854: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 668 op/s 2024-05-14T09:33:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:30 smithi120 ceph-mon[31085]: pgmap v854: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 668 op/s 2024-05-14T09:33:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:32 smithi152 ceph-mon[34868]: pgmap v855: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 669 op/s 2024-05-14T09:33:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:32 smithi175 ceph-mon[35353]: pgmap v855: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 669 op/s 2024-05-14T09:33:32.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:32 smithi120 ceph-mon[31085]: pgmap v855: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 669 op/s 2024-05-14T09:33:33.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:33 smithi120 ceph-mon[31085]: pgmap v856: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.8 MiB/s wr, 663 op/s 2024-05-14T09:33:33.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:33 smithi152 ceph-mon[34868]: pgmap v856: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.8 MiB/s wr, 663 op/s 2024-05-14T09:33:33.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:33 smithi175 ceph-mon[35353]: pgmap v856: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.8 MiB/s wr, 663 op/s 2024-05-14T09:33:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 360.0 s, 650.6 tps, lat 153.824 ms stddev 55.130 2024-05-14T09:33:36.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:35 smithi120 ceph-mon[31085]: pgmap v857: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 683 op/s 2024-05-14T09:33:36.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:35 smithi152 ceph-mon[34868]: pgmap v857: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 683 op/s 2024-05-14T09:33:36.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:35 smithi175 ceph-mon[35353]: pgmap v857: 129 pgs: 129 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 683 op/s 2024-05-14T09:33:38.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:37 smithi120 ceph-mon[31085]: pgmap v858: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 724 op/s 2024-05-14T09:33:38.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:37 smithi152 ceph-mon[34868]: pgmap v858: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 724 op/s 2024-05-14T09:33:38.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:37 smithi175 ceph-mon[35353]: pgmap v858: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 724 op/s 2024-05-14T09:33:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 365.0 s, 716.8 tps, lat 139.360 ms stddev 56.138 2024-05-14T09:33:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.954+0000 7f8eb8a00640 1 -- 172.21.15.120:0/756661834 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac031800 con 0x7f8ebc1121f0 2024-05-14T09:33:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 -- 172.21.15.120:0/756661834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc1121f0 msgr2=0x7f8ebc114690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 --2- 172.21.15.120:0/756661834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc1121f0 0x7f8ebc114690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009900 tx=0x7f8eac02a400 comp rx=0 tx=0).stop 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 -- 172.21.15.120:0/756661834 shutdown_connections 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 --2- 172.21.15.120:0/756661834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc1121f0 0x7f8ebc114690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 --2- 172.21.15.120:0/756661834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ebc10f890 0x7f8ebc111cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 --2- 172.21.15.120:0/756661834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ebc10a0f0 0x7f8ebc10a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 -- 172.21.15.120:0/756661834 >> 172.21.15.120:0/756661834 conn(0x7f8ebc070670 msgr2=0x7f8ebc072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 -- 172.21.15.120:0/756661834 shutdown_connections 2024-05-14T09:33:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.956+0000 7f8ec1200640 1 -- 172.21.15.120:0/756661834 wait complete. 2024-05-14T09:33:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.958+0000 7f8ec1200640 1 Processor -- start 2024-05-14T09:33:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.958+0000 7f8ec1200640 1 -- start start 2024-05-14T09:33:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.958+0000 7f8ec1200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ebc10a0f0 0x7f8ebc1a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8ec1200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc10f890 0x7f8ebc1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8ec1200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ebc1121f0 0x7f8ebc1b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8ec1200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc117eb0 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8ec1200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc117d30 con 0x7f8ebc10f890 2024-05-14T09:33:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8ec1200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc118030 con 0x7f8ebc1121f0 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8eb9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc10f890 0x7f8ebc1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8eb9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc10f890 0x7f8ebc1a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:36746/0 (socket says 172.21.15.120:36746) 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8eb9400640 1 -- 172.21.15.120:0/2826521266 learned_addr learned my addr 172.21.15.120:0/2826521266 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ebc10a0f0 0x7f8ebc1a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.959+0000 7f8eba800640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ebc1121f0 0x7f8ebc1b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.960+0000 7f8eb9e00640 1 -- 172.21.15.120:0/2826521266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ebc1121f0 msgr2=0x7f8ebc1b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.960+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ebc1121f0 0x7f8ebc1b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.960+0000 7f8eb9e00640 1 -- 172.21.15.120:0/2826521266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc10f890 msgr2=0x7f8ebc1a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.960+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc10f890 0x7f8ebc1a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.960+0000 7f8eb9e00640 1 -- 172.21.15.120:0/2826521266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc1b0c00 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.961+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ebc10a0f0 0x7f8ebc1a08b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4005fd0 tx=0x7f8eb400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.961+0000 7f8eb2a00640 1 -- 172.21.15.120:0/2826521266 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4003b70 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.961+0000 7f8eb2a00640 1 -- 172.21.15.120:0/2826521266 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8eb4003d10 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.961+0000 7f8eb2a00640 1 -- 172.21.15.120:0/2826521266 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40107f0 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.961+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc1b0ef0 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.961+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc1b1300 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.968+0000 7f8eb2a00640 1 -- 172.21.15.120:0/2826521266 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8eb4003ec0 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.971+0000 7f8eb2a00640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ea00b28e0 0x7f8ea00b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.971+0000 7f8eb2a00640 1 -- 172.21.15.120:0/2826521266 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8eb40e2950 con 0x7f8ebc10a0f0 2024-05-14T09:33:39.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.971+0000 7f8eb9400640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ea00b28e0 0x7f8ea00b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.973+0000 7f8eb9400640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ea00b28e0 0x7f8ea00b4df0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8005fd0 tx=0x7f8ea800b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.978+0000 7f8ec81a2740 1 Processor -- start 2024-05-14T09:33:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.979+0000 7f8ec81a2740 1 -- start start 2024-05-14T09:33:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.979+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3c21b0 0x55926c764100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.979+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3992f0 0x55926c764680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.979+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c76b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.979+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55926c6c8550 con 0x55926c3992f0 2024-05-14T09:33:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.979+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55926c66dbc0 con 0x55926c3c21b0 2024-05-14T09:33:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.979+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55926c6c4510 con 0x55926c3a14d0 2024-05-14T09:33:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.980+0000 7f8eba800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c76b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.980+0000 7f8eba800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c76b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37546/0 (socket says 172.21.15.120:37546) 2024-05-14T09:33:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.980+0000 7f8eba800640 1 -- 172.21.15.120:0/2334659048 learned_addr learned my addr 172.21.15.120:0/2334659048 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.980+0000 7f8eba800640 1 -- 172.21.15.120:0/2334659048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3c21b0 msgr2=0x55926c764100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.980+0000 7f8eba800640 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3c21b0 0x55926c764100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.980+0000 7f8eba800640 1 -- 172.21.15.120:0/2334659048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3992f0 msgr2=0x55926c764680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.981+0000 7f8eb9400640 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3992f0 0x55926c764680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.981+0000 7f8eba800640 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3992f0 0x55926c764680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.981+0000 7f8eba800640 1 -- 172.21.15.120:0/2334659048 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55926c3da210 con 0x55926c3a14d0 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.981+0000 7f8eba800640 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c76b580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009900 tx=0x7f8eac031500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815089d997d4758f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.982+0000 7f8ea7400640 1 -- 172.21.15.120:0/2334659048 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac035030 con 0x55926c3a14d0 2024-05-14T09:33:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.982+0000 7f8ea7400640 1 -- 172.21.15.120:0/2334659048 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8eac040070 con 0x55926c3a14d0 2024-05-14T09:33:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.982+0000 7f8ea7400640 1 -- 172.21.15.120:0/2334659048 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0038c0 con 0x55926c3a14d0 2024-05-14T09:33:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.983+0000 7f8ec81a2740 1 -- 172.21.15.120:0/2334659048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 msgr2=0x55926c76b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.983+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c76b580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009900 tx=0x7f8eac031500 comp rx=0 tx=0).stop 2024-05-14T09:33:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.983+0000 7f8ec81a2740 1 -- 172.21.15.120:0/2334659048 shutdown_connections 2024-05-14T09:33:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.983+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c76b580 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.984+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3992f0 0x55926c764680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.984+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/2334659048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3c21b0 0x55926c764100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.984+0000 7f8ec81a2740 1 -- 172.21.15.120:0/2334659048 >> 172.21.15.120:0/2334659048 conn(0x55926c3b6300 msgr2=0x55926c75fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.984+0000 7f8ec81a2740 1 -- 172.21.15.120:0/2334659048 shutdown_connections 2024-05-14T09:33:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.984+0000 7f8ec81a2740 1 -- 172.21.15.120:0/2334659048 wait complete. 2024-05-14T09:33:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.985+0000 7f8ec81a2740 1 -- start start 2024-05-14T09:33:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.985+0000 7f8ec81a2740 1 Processor -- start 2024-05-14T09:33:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.985+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c76dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c76e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c775100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55926c76bf70 con 0x55926c3c21b0 2024-05-14T09:33:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55926c681660 con 0x55926c3a14d0 2024-05-14T09:33:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55926c76c0f0 con 0x55926c3992f0 2024-05-14T09:33:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8ec81a2740 10 client.0 _ll_register_callbacks cb 0x55926c64b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8eb9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c76e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.986+0000 7f8eb9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c76dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.987+0000 7f8eb9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c76dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37562/0 (socket says 172.21.15.120:37562) 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.987+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4059500631 learned_addr learned my addr 172.21.15.120:0/4059500631 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.987+0000 7f8eba800640 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c775100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4059500631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 msgr2=0x55926c76e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c76e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4059500631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 msgr2=0x55926c775100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c775100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4059500631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55926c4a6620 con 0x55926c3992f0 2024-05-14T09:33:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8eba800640 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c775100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:33:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c76dc60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40a6de0 tx=0x7f8eb40a92e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2910e8ee86160ddd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.988+0000 7f8e9be00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:33:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.989+0000 7f8e9be00640 1 -- 172.21.15.120:0/4059500631 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40c3060 con 0x55926c3992f0 2024-05-14T09:33:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.989+0000 7f8e9be00640 1 -- 172.21.15.120:0/4059500631 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8eb40a8fe0 con 0x55926c3992f0 2024-05-14T09:33:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.989+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eac040070 con 0x55926c3992f0 2024-05-14T09:33:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.989+0000 7f8e9be00640 1 -- 172.21.15.120:0/4059500631 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8eb40c4250 con 0x55926c3992f0 2024-05-14T09:33:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.989+0000 7f8ec81a2740 10 client.26446 fetch_fsmap learned FSMap version 54 2024-05-14T09:33:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.989+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55926c7780a0 con 0x55926c3992f0 2024-05-14T09:33:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.990+0000 7f8e9be00640 1 -- 172.21.15.120:0/4059500631 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8eac040070 con 0x55926c3992f0 2024-05-14T09:33:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.991+0000 7f8e9be00640 1 -- 172.21.15.120:0/4059500631 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 54) ==== 8370+0+0 (secure 0 0 0) 0x7f8eb401f020 con 0x55926c3992f0 2024-05-14T09:33:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.991+0000 7f8ec81a2740 10 client.26446 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T09:33:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.991+0000 7f8ec81a2740 10 client.26446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.991+0000 7f8ec81a2740 20 client.26446 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.991+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c380d80 0x55926c77b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.991+0000 7f8ec81a2740 4 client.26446 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:33:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.991+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55926c6d6160 con 0x55926c380d80 2024-05-14T09:33:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.992+0000 7f8eb9400640 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c380d80 0x55926c77b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.993+0000 7f8eb9400640 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c380d80 0x55926c77b7d0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec09253ae8d128b server_cookie=caeedfed65a6a3cd in_seq=0 out_seq=0 2024-05-14T09:33:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.993+0000 7f8e9be00640 10 client.26446 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.994+0000 7f8e9be00640 1 -- 172.21.15.120:0/4059500631 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55926c6d6160 con 0x55926c380d80 2024-05-14T09:33:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.994+0000 7f8e9be00640 10 client.26446 handle_command_reply: tid=0 2024-05-14T09:33:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.994+0000 7f8ec81a2740 1 client.26446 shutdown 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 msgr2=0x55926c76dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c76dc60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40a6de0 tx=0x7f8eb40a92e0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 shutdown_connections 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c380d80 0x55926c77b7d0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c775100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c76e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4059500631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c76dc60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 >> 172.21.15.120:0/4059500631 conn(0x55926c3b6300 msgr2=0x55926c75ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8e9be00640 0 client.26446 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 shutdown_connections 2024-05-14T09:33:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.995+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4059500631 wait complete. 2024-05-14T09:33:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:39.996+0000 7f8ec81a2740 20 client.26446 trim_cache size 0 max 16384 2024-05-14T09:33:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.033+0000 7f8ec81a2740 1 Processor -- start 2024-05-14T09:33:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.033+0000 7f8ec81a2740 1 -- start start 2024-05-14T09:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.033+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c768790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.033+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c775090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.034+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.034+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc1bb7b0 con 0x55926c3c21b0 2024-05-14T09:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.034+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc1bd2f0 con 0x55926c3a14d0 2024-05-14T09:33:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.034+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc1bbe80 con 0x55926c3992f0 2024-05-14T09:33:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.034+0000 7f8eb9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c768790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.035+0000 7f8eb9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c768790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37566/0 (socket says 172.21.15.120:37566) 2024-05-14T09:33:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.035+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4232431993 learned_addr learned my addr 172.21.15.120:0/4232431993 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.034+0000 7f8eb9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c775090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.035+0000 7f8eba800640 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.035+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4232431993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 msgr2=0x55926c775090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.035+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c775090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.036+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4232431993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 msgr2=0x55926c7632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.036+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.036+0000 7f8eb9e00640 1 -- 172.21.15.120:0/4232431993 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55926c75b280 con 0x55926c3992f0 2024-05-14T09:33:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.036+0000 7f8eba800640 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:33:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.036+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c768790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4000f80 tx=0x7f8eb40a9410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c615e110f4821d97 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.037+0000 7f8ea6a00640 1 -- 172.21.15.120:0/4232431993 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40c4250 con 0x55926c3992f0 2024-05-14T09:33:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.037+0000 7f8ea6a00640 1 -- 172.21.15.120:0/4232431993 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8eb40aa270 con 0x55926c3992f0 2024-05-14T09:33:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.037+0000 7f8ea6a00640 1 -- 172.21.15.120:0/4232431993 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40af100 con 0x55926c3992f0 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4232431993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 msgr2=0x55926c768790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c768790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4000f80 tx=0x7f8eb40a9410 comp rx=0 tx=0).stop 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4232431993 shutdown_connections 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3a14d0 0x55926c775090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/4232431993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3992f0 0x55926c768790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4232431993 >> 172.21.15.120:0/4232431993 conn(0x55926c3b6300 msgr2=0x55926c76d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4232431993 shutdown_connections 2024-05-14T09:33:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.039+0000 7f8ec81a2740 1 -- 172.21.15.120:0/4232431993 wait complete. 2024-05-14T09:33:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.040+0000 7f8ec81a2740 1 -- start start 2024-05-14T09:33:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.040+0000 7f8ec81a2740 1 Processor -- start 2024-05-14T09:33:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3992f0 0x55926c773c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c774160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8ec81a2740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7e1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc1bcc20 con 0x55926c3c21b0 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc1bc550 con 0x55926c3992f0 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8ec81a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc1b97b0 con 0x55926c3a14d0 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8ec81a2740 10 client.0 _ll_register_callbacks cb 0x7f8eb40a9940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8eb9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c774160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8eb9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3992f0 0x55926c773c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8eb9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c774160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37568/0 (socket says 172.21.15.120:37568) 2024-05-14T09:33:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.041+0000 7f8eb9400640 1 -- 172.21.15.120:0/870271592 learned_addr learned my addr 172.21.15.120:0/870271592 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.042+0000 7f8eba800640 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7e1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.042+0000 7f8eba800640 1 -- 172.21.15.120:0/870271592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 msgr2=0x55926c774160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.042+0000 7f8eba800640 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c774160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.042+0000 7f8eba800640 1 -- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3992f0 msgr2=0x55926c773c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.042+0000 7f8eba800640 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3992f0 0x55926c773c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.042+0000 7f8eba800640 1 -- 172.21.15.120:0/870271592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55926c7749b0 con 0x55926c3c21b0 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.042+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3992f0 0x55926c773c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.043+0000 7f8eba800640 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7e1a70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0057c0 tx=0x7f8eac031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd071995c64d258 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.043+0000 7f8e9be00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.043+0000 7f8e9be00640 1 -- 172.21.15.120:0/870271592 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac035040 con 0x55926c3c21b0 2024-05-14T09:33:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.044+0000 7f8e9be00640 1 -- 172.21.15.120:0/870271592 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8eac03c440 con 0x55926c3c21b0 2024-05-14T09:33:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.044+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eb40aa270 con 0x55926c3c21b0 2024-05-14T09:33:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.045+0000 7f8e9be00640 1 -- 172.21.15.120:0/870271592 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8eac054050 con 0x55926c3c21b0 2024-05-14T09:33:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.045+0000 7f8ec81a2740 10 client.16905 fetch_fsmap learned FSMap version 54 2024-05-14T09:33:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.045+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55926c7e3040 con 0x55926c3c21b0 2024-05-14T09:33:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8e9be00640 1 -- 172.21.15.120:0/870271592 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8eb40aa270 con 0x55926c3c21b0 2024-05-14T09:33:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8e9be00640 1 -- 172.21.15.120:0/870271592 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 54) ==== 8370+0+0 (secure 0 0 0) 0x7f8eac0446a0 con 0x55926c3c21b0 2024-05-14T09:33:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8ec81a2740 10 client.16905 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T09:33:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8ec81a2740 10 client.16905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8ec81a2740 20 client.16905 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c3561c0 0x55926c7e5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8ec81a2740 4 client.16905 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.046+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55926c6cffd0 con 0x55926c3561c0 2024-05-14T09:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.047+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c3561c0 0x55926c7e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.048+0000 7f8eb9e00640 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c3561c0 0x55926c7e5570 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca7fa02fd7f95fa server_cookie=a2a29e0db9e54c6a in_seq=0 out_seq=0 2024-05-14T09:33:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.048+0000 7f8e9be00640 10 client.16905 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.075+0000 7f8e9be00640 1 -- 172.21.15.120:0/870271592 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55926c6cffd0 con 0x55926c3561c0 2024-05-14T09:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.075+0000 7f8e9be00640 10 client.16905 handle_command_reply: tid=0 2024-05-14T09:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.076+0000 7f8ec81a2740 1 client.16905 shutdown 2024-05-14T09:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.076+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 msgr2=0x55926c7e1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.076+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7e1a70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0057c0 tx=0x7f8eac031ca0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 shutdown_connections 2024-05-14T09:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55926c3561c0 0x55926c7e5570 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55926c3c21b0 0x55926c7e1a70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8e9be00640 0 client.16905 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55926c3a14d0 0x55926c774160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 --2- 172.21.15.120:0/870271592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55926c3992f0 0x55926c773c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 >> 172.21.15.120:0/870271592 conn(0x55926c3b6300 msgr2=0x55926c763020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 shutdown_connections 2024-05-14T09:33:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.077+0000 7f8ec81a2740 1 -- 172.21.15.120:0/870271592 wait complete. 2024-05-14T09:33:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.078+0000 7f8ec81a2740 20 client.16905 trim_cache size 0 max 16384 2024-05-14T09:33:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:33:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:33:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:33:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:33:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ea00b28e0 msgr2=0x7f8ea00b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ea00b28e0 0x7f8ea00b4df0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8005fd0 tx=0x7f8ea800b480 comp rx=0 tx=0).stop 2024-05-14T09:33:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ebc10a0f0 msgr2=0x7f8ebc1a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ebc10a0f0 0x7f8ebc1a08b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4005fd0 tx=0x7f8eb400c6a0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 shutdown_connections 2024-05-14T09:33:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ea00b28e0 0x7f8ea00b4df0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ebc1121f0 0x7f8ebc1b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ebc10f890 0x7f8ebc1a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 --2- 172.21.15.120:0/2826521266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ebc10a0f0 0x7f8ebc1a08b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 >> 172.21.15.120:0/2826521266 conn(0x7f8ebc070670 msgr2=0x7f8ebc10c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 shutdown_connections 2024-05-14T09:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:40.079+0000 7f8ec1200640 1 -- 172.21.15.120:0/2826521266 wait complete. 2024-05-14T09:33:40.142 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:39 smithi120 ceph-mon[31085]: pgmap v859: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.8 MiB/s wr, 778 op/s 2024-05-14T09:33:40.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:39 smithi152 ceph-mon[34868]: pgmap v859: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.8 MiB/s wr, 778 op/s 2024-05-14T09:33:40.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:39 smithi175 ceph-mon[35353]: pgmap v859: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.8 MiB/s wr, 778 op/s 2024-05-14T09:33:42.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:41 smithi120 ceph-mon[31085]: pgmap v860: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 755 op/s 2024-05-14T09:33:42.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:41 smithi152 ceph-mon[34868]: pgmap v860: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 755 op/s 2024-05-14T09:33:42.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:41 smithi175 ceph-mon[35353]: pgmap v860: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 755 op/s 2024-05-14T09:33:44.198 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:43 smithi120 ceph-mon[31085]: pgmap v861: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 773 op/s 2024-05-14T09:33:44.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:43 smithi152 ceph-mon[34868]: pgmap v861: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 773 op/s 2024-05-14T09:33:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:43 smithi175 ceph-mon[35353]: pgmap v861: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 773 op/s 2024-05-14T09:33:44.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 370.0 s, 650.7 tps, lat 153.147 ms stddev 52.109 2024-05-14T09:33:45.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:44 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:33:45.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:44 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:33:45.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:44 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:33:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:45 smithi152 ceph-mon[34868]: pgmap v862: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 768 op/s 2024-05-14T09:33:46.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:45 smithi175 ceph-mon[35353]: pgmap v862: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 768 op/s 2024-05-14T09:33:46.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:45 smithi120 ceph-mon[31085]: pgmap v862: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 768 op/s 2024-05-14T09:33:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:47 smithi152 ceph-mon[34868]: pgmap v863: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 752 op/s 2024-05-14T09:33:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:33:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:33:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:33:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:47 smithi175 ceph-mon[35353]: pgmap v863: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 752 op/s 2024-05-14T09:33:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:33:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:33:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:33:48.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:47 smithi120 ceph-mon[31085]: pgmap v863: 129 pgs: 129 active+clean; 1.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 752 op/s 2024-05-14T09:33:48.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:33:48.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:33:48.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:33:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 375.0 s, 642.5 tps, lat 155.328 ms stddev 42.954 2024-05-14T09:33:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:49 smithi175 ceph-mon[35353]: pgmap v864: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 757 op/s 2024-05-14T09:33:50.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:49 smithi120 ceph-mon[31085]: pgmap v864: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 757 op/s 2024-05-14T09:33:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:49 smithi152 ceph-mon[34868]: pgmap v864: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 757 op/s 2024-05-14T09:33:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:51 smithi175 ceph-mon[35353]: pgmap v865: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 696 op/s 2024-05-14T09:33:52.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:51 smithi120 ceph-mon[31085]: pgmap v865: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 696 op/s 2024-05-14T09:33:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:51 smithi152 ceph-mon[34868]: pgmap v865: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 696 op/s 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 -- 172.21.15.120:0/155719313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 msgr2=0x7fa1f81041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 --2- 172.21.15.120:0/155719313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 0x7fa1f81041a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009900 tx=0x7fa1e402c650 comp rx=0 tx=0).stop 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 -- 172.21.15.120:0/155719313 shutdown_connections 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 --2- 172.21.15.120:0/155719313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8108a90 0x7fa1f810aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 --2- 172.21.15.120:0/155719313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 0x7fa1f81041a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 --2- 172.21.15.120:0/155719313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1f8102b50 0x7fa1f8103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 -- 172.21.15.120:0/155719313 >> 172.21.15.120:0/155719313 conn(0x7fa1f80fdd40 msgr2=0x7fa1f81001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 -- 172.21.15.120:0/155719313 shutdown_connections 2024-05-14T09:33:53.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.600+0000 7fa1fea00640 1 -- 172.21.15.120:0/155719313 wait complete. 2024-05-14T09:33:53.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 Processor -- start 2024-05-14T09:33:53.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 -- start start 2024-05-14T09:33:53.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8102b50 0x7fa1f819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 0x7fa1f819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1f8108a90 0x7fa1f81a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f810d460 con 0x7fa1f8103d90 2024-05-14T09:33:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f810d2e0 con 0x7fa1f8108a90 2024-05-14T09:33:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.602+0000 7fa1fea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f810d5e0 con 0x7fa1f8102b50 2024-05-14T09:33:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.603+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8102b50 0x7fa1f819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.603+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8102b50 0x7fa1f819c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:52456/0 (socket says 172.21.15.120:52456) 2024-05-14T09:33:53.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.603+0000 7fa1f7e00640 1 -- 172.21.15.120:0/1870257108 learned_addr learned my addr 172.21.15.120:0/1870257108 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:53.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.603+0000 7fa1f7400640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 0x7fa1f819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.603+0000 7fa1fca00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1f8108a90 0x7fa1f81a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.604+0000 7fa1f7e00640 1 -- 172.21.15.120:0/1870257108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1f8108a90 msgr2=0x7fa1f81a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.604+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1f8108a90 0x7fa1f81a3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.604+0000 7fa1f7e00640 1 -- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 msgr2=0x7fa1f819c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.604+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 0x7fa1f819c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.604+0000 7fa1f7e00640 1 -- 172.21.15.120:0/1870257108 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f81a3fc0 con 0x7fa1f8102b50 2024-05-14T09:33:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.604+0000 7fa1f7400640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 0x7fa1f819c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:33:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.605+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8102b50 0x7fa1f819c480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e9f0 tx=0x7fa1e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.606+0000 7fa1f4c00640 1 -- 172.21.15.120:0/1870257108 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800ccc0 con 0x7fa1f8102b50 2024-05-14T09:33:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.606+0000 7fa1f4c00640 1 -- 172.21.15.120:0/1870257108 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1e80044b0 con 0x7fa1f8102b50 2024-05-14T09:33:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.606+0000 7fa1f4c00640 1 -- 172.21.15.120:0/1870257108 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8010430 con 0x7fa1f8102b50 2024-05-14T09:33:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.606+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f81a42b0 con 0x7fa1f8102b50 2024-05-14T09:33:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.606+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f81a4780 con 0x7fa1f8102b50 2024-05-14T09:33:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.616+0000 7fa1f4c00640 1 -- 172.21.15.120:0/1870257108 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa1e8003f90 con 0x7fa1f8102b50 2024-05-14T09:33:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.619+0000 7fa1f4c00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1dc0b2930 0x7fa1dc0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.621+0000 7fa205a2f740 1 Processor -- start 2024-05-14T09:33:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.621+0000 7fa1f4c00640 1 -- 172.21.15.120:0/1870257108 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa1e80e2960 con 0x7fa1f8102b50 2024-05-14T09:33:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.621+0000 7fa205a2f740 1 -- start start 2024-05-14T09:33:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa1f7400640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1dc0b2930 0x7fa1dc0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f13910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b402f0 0x55e689f13e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b484d0 0x55e689f1ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa205a2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e689e6f550 con 0x55e689b402f0 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa205a2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e689e14bc0 con 0x55e689b484d0 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa205a2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e689e6b510 con 0x55e689b691b0 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa1fca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b484d0 0x55e689f1ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa1fca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b484d0 0x55e689f1ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:34356/0 (socket says 172.21.15.120:34356) 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.622+0000 7fa1fca00640 1 -- 172.21.15.120:0/1477897215 learned_addr learned my addr 172.21.15.120:0/1477897215 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f13910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1f7400640 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b402f0 0x55e689f13e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1fca00640 1 -- 172.21.15.120:0/1477897215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 msgr2=0x55e689f13910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1fca00640 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f13910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1fca00640 1 -- 172.21.15.120:0/1477897215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b402f0 msgr2=0x55e689f13e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1fca00640 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b402f0 0x55e689f13e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1fca00640 1 -- 172.21.15.120:0/1477897215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e689b81210 con 0x55e689b484d0 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.623+0000 7fa1f7400640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1dc0b2930 0x7fa1dc0b4e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4000c00 tx=0x7fa1e4009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.624+0000 7fa1fca00640 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b484d0 0x55e689f1ad90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0008dc0 tx=0x7fa1f000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fbdd2314f6f7f9d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.624+0000 7fa1ed200640 1 -- 172.21.15.120:0/1477897215 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0014070 con 0x55e689b484d0 2024-05-14T09:33:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.625+0000 7fa1ed200640 1 -- 172.21.15.120:0/1477897215 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1f0004020 con 0x55e689b484d0 2024-05-14T09:33:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.625+0000 7fa1ed200640 1 -- 172.21.15.120:0/1477897215 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0010690 con 0x55e689b484d0 2024-05-14T09:33:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.626+0000 7fa205a2f740 1 -- 172.21.15.120:0/1477897215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b484d0 msgr2=0x55e689f1ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.627+0000 7fa205a2f740 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b484d0 0x55e689f1ad90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0008dc0 tx=0x7fa1f000e720 comp rx=0 tx=0).stop 2024-05-14T09:33:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.627+0000 7fa205a2f740 1 -- 172.21.15.120:0/1477897215 shutdown_connections 2024-05-14T09:33:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.627+0000 7fa205a2f740 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b484d0 0x55e689f1ad90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.627+0000 7fa205a2f740 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b402f0 0x55e689f13e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.627+0000 7fa205a2f740 1 --2- 172.21.15.120:0/1477897215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f13910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.627+0000 7fa205a2f740 1 -- 172.21.15.120:0/1477897215 >> 172.21.15.120:0/1477897215 conn(0x55e689b5d300 msgr2=0x55e689f0f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.628+0000 7fa205a2f740 1 -- 172.21.15.120:0/1477897215 shutdown_connections 2024-05-14T09:33:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.628+0000 7fa205a2f740 1 -- 172.21.15.120:0/1477897215 wait complete. 2024-05-14T09:33:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.628+0000 7fa205a2f740 1 -- start start 2024-05-14T09:33:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.629+0000 7fa205a2f740 1 Processor -- start 2024-05-14T09:33:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.630+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f08460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.630+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b484d0 0x55e689f089a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.630+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b691b0 0x55e689f0d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.631+0000 7fa1fca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b691b0 0x55e689f0d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.631+0000 7fa205a2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e689f06750 con 0x55e689b691b0 2024-05-14T09:33:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.631+0000 7fa205a2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e689e28660 con 0x55e689b402f0 2024-05-14T09:33:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.631+0000 7fa205a2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e689f068d0 con 0x55e689b484d0 2024-05-14T09:33:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.631+0000 7fa205a2f740 10 client.0 _ll_register_callbacks cb 0x55e689df2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.631+0000 7fa1fca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b691b0 0x55e689f0d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47102/0 (socket says 172.21.15.120:47102) 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.631+0000 7fa1fca00640 1 -- 172.21.15.120:0/3865484859 learned_addr learned my addr 172.21.15.120:0/3865484859 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.632+0000 7fa1f7400640 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b484d0 0x55e689f089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.632+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f08460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.632+0000 7fa1fca00640 1 -- 172.21.15.120:0/3865484859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b484d0 msgr2=0x55e689f089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.632+0000 7fa1fca00640 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b484d0 0x55e689f089a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.632+0000 7fa1fca00640 1 -- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 msgr2=0x55e689f08460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.632+0000 7fa1fca00640 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f08460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.632+0000 7fa1fca00640 1 -- 172.21.15.120:0/3865484859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e689c4d620 con 0x55e689b691b0 2024-05-14T09:33:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.633+0000 7fa1fca00640 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b691b0 0x55e689f0d8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006010 tx=0x7fa1f0004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d577b9bb78aa0e27 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.633+0000 7fa1e1600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:33:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.634+0000 7fa1e1600640 1 -- 172.21.15.120:0/3865484859 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0014070 con 0x55e689b691b0 2024-05-14T09:33:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.634+0000 7fa1e1600640 1 -- 172.21.15.120:0/3865484859 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa1f0004c40 con 0x55e689b691b0 2024-05-14T09:33:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.634+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f0004020 con 0x55e689b691b0 2024-05-14T09:33:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.635+0000 7fa1e1600640 1 -- 172.21.15.120:0/3865484859 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fa1f0004e40 con 0x55e689b691b0 2024-05-14T09:33:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.635+0000 7fa205a2f740 10 client.16917 fetch_fsmap learned FSMap version 55 2024-05-14T09:33:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.635+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55e689f2fda0 con 0x55e689b691b0 2024-05-14T09:33:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.636+0000 7fa1e1600640 1 -- 172.21.15.120:0/3865484859 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1f0004020 con 0x55e689b691b0 2024-05-14T09:33:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.636+0000 7fa1e1600640 1 -- 172.21.15.120:0/3865484859 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 55) ==== 8374+0+0 (secure 0 0 0) 0x7fa1f00226e0 con 0x55e689b691b0 2024-05-14T09:33:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.636+0000 7fa205a2f740 10 client.16917 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T09:33:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.636+0000 7fa205a2f740 10 client.16917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.636+0000 7fa205a2f740 20 client.16917 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.636+0000 7fa205a2f740 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689b27d80 0x55e689f331c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.636+0000 7fa205a2f740 4 client.16917 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:33:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.637+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e689e7d160 con 0x55e689b27d80 2024-05-14T09:33:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.637+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689b27d80 0x55e689f331c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.638+0000 7fa1e1600640 10 client.16917 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.638+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689b27d80 0x55e689f331c0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4943a799cc53509e server_cookie=2771957e86559dd3 in_seq=0 out_seq=0 2024-05-14T09:33:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.639+0000 7fa1e1600640 1 -- 172.21.15.120:0/3865484859 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e689e7d160 con 0x55e689b27d80 2024-05-14T09:33:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.639+0000 7fa1e1600640 10 client.16917 handle_command_reply: tid=0 2024-05-14T09:33:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.639+0000 7fa205a2f740 1 client.16917 shutdown 2024-05-14T09:33:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b691b0 msgr2=0x55e689f0d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b691b0 0x55e689f0d8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006010 tx=0x7fa1f0004400 comp rx=0 tx=0).stop 2024-05-14T09:33:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 shutdown_connections 2024-05-14T09:33:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689b27d80 0x55e689f331c0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b691b0 0x55e689f0d8f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b484d0 0x55e689f089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 --2- 172.21.15.120:0/3865484859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f08460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa1e1600640 0 client.16917 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.640+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 >> 172.21.15.120:0/3865484859 conn(0x55e689b5d300 msgr2=0x55e689f05a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.641+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 shutdown_connections 2024-05-14T09:33:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.641+0000 7fa205a2f740 1 -- 172.21.15.120:0/3865484859 wait complete. 2024-05-14T09:33:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.641+0000 7fa205a2f740 20 client.16917 trim_cache size 0 max 16384 2024-05-14T09:33:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.670+0000 7fa205a2f740 1 Processor -- start 2024-05-14T09:33:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.671+0000 7fa205a2f740 1 -- start start 2024-05-14T09:33:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.671+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b402f0 0x55e689f0df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.671+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f08460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.671+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b691b0 0x55e689f089a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.671+0000 7fa205a2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81aaa10 con 0x55e689b484d0 2024-05-14T09:33:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.671+0000 7fa205a2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81ac580 con 0x55e689b691b0 2024-05-14T09:33:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.671+0000 7fa205a2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81ab0e0 con 0x55e689b402f0 2024-05-14T09:33:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.672+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b402f0 0x55e689f0df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.672+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b402f0 0x55e689f0df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:52494/0 (socket says 172.21.15.120:52494) 2024-05-14T09:33:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.672+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2652211962 learned_addr learned my addr 172.21.15.120:0/2652211962 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1fca00640 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b691b0 0x55e689f089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7400640 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f08460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2652211962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b691b0 msgr2=0x55e689f089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b691b0 0x55e689f089a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2652211962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 msgr2=0x55e689f08460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f08460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2652211962 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e689f02280 con 0x55e689b402f0 2024-05-14T09:33:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7400640 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f08460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:33:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b402f0 0x55e689f0df20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80a5c00 tx=0x7fa1e80ac040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99451586a7feb6c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.673+0000 7fa1e3e00640 1 -- 172.21.15.120:0/2652211962 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80a9690 con 0x55e689b402f0 2024-05-14T09:33:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.674+0000 7fa1e3e00640 1 -- 172.21.15.120:0/2652211962 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1e80aa280 con 0x55e689b402f0 2024-05-14T09:33:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.674+0000 7fa1e3e00640 1 -- 172.21.15.120:0/2652211962 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8003680 con 0x55e689b402f0 2024-05-14T09:33:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.675+0000 7fa205a2f740 1 -- 172.21.15.120:0/2652211962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b402f0 msgr2=0x55e689f0df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.676+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b402f0 0x55e689f0df20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80a5c00 tx=0x7fa1e80ac040 comp rx=0 tx=0).stop 2024-05-14T09:33:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.676+0000 7fa205a2f740 1 -- 172.21.15.120:0/2652211962 shutdown_connections 2024-05-14T09:33:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.676+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b691b0 0x55e689f089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.677+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f08460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.677+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2652211962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b402f0 0x55e689f0df20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.677+0000 7fa205a2f740 1 -- 172.21.15.120:0/2652211962 >> 172.21.15.120:0/2652211962 conn(0x55e689b5d300 msgr2=0x55e689f0d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.677+0000 7fa205a2f740 1 -- 172.21.15.120:0/2652211962 shutdown_connections 2024-05-14T09:33:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.677+0000 7fa205a2f740 1 -- 172.21.15.120:0/2652211962 wait complete. 2024-05-14T09:33:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.678+0000 7fa205a2f740 1 -- start start 2024-05-14T09:33:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.678+0000 7fa205a2f740 1 Processor -- start 2024-05-14T09:33:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.679+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f42040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.679+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f42580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.679+0000 7fa205a2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.679+0000 7fa205a2f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81abe80 con 0x55e689b484d0 2024-05-14T09:33:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.679+0000 7fa205a2f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81ab7b0 con 0x55e689b402f0 2024-05-14T09:33:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.679+0000 7fa205a2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81a8a10 con 0x55e689b691b0 2024-05-14T09:33:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.679+0000 7fa205a2f740 10 client.0 _ll_register_callbacks cb 0x7fa1e8003950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:33:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.680+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f42040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.680+0000 7fa1f7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f42580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.680+0000 7fa1f7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f42040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:34400/0 (socket says 172.21.15.120:34400) 2024-05-14T09:33:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.680+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2119235798 learned_addr learned my addr 172.21.15.120:0/2119235798 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:33:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.680+0000 7fa1fca00640 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2119235798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 msgr2=0x55e689f434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2119235798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 msgr2=0x55e689f42580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:33:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f42580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1f7e00640 1 -- 172.21.15.120:0/2119235798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e689f43a70 con 0x55e689b402f0 2024-05-14T09:33:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1f7e00640 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f42040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80a9880 tx=0x7fa1e80b2a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1f1719bfd26cc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:33:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1e1600640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:33:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa1e1600640 1 -- 172.21.15.120:0/2119235798 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80c4030 con 0x55e689b402f0 2024-05-14T09:33:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.681+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e80aa280 con 0x55e689b402f0 2024-05-14T09:33:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.682+0000 7fa1e1600640 1 -- 172.21.15.120:0/2119235798 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa1e8003680 con 0x55e689b402f0 2024-05-14T09:33:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.682+0000 7fa1e1600640 1 -- 172.21.15.120:0/2119235798 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fa1e80a9b80 con 0x55e689b402f0 2024-05-14T09:33:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.682+0000 7fa205a2f740 10 client.36413 fetch_fsmap learned FSMap version 55 2024-05-14T09:33:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.682+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55e689f9b090 con 0x55e689b402f0 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa1e1600640 1 -- 172.21.15.120:0/2119235798 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1e80aa280 con 0x55e689b402f0 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa1e1600640 1 -- 172.21.15.120:0/2119235798 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 55) ==== 8374+0+0 (secure 0 0 0) 0x7fa1e80a8850 con 0x55e689b402f0 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa205a2f740 10 client.36413 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa205a2f740 10 client.36413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa205a2f740 20 client.36413 populate_metadata read hostname 'smithi120' 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689afd1c0 0x55e689f9d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa205a2f740 4 client.36413 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:33:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.683+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e689e76fd0 con 0x55e689afd1c0 2024-05-14T09:33:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.684+0000 7fa1f7400640 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689afd1c0 0x55e689f9d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:33:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.685+0000 7fa1e1600640 10 client.36413 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.685+0000 7fa1f7400640 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689afd1c0 0x55e689f9d950 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc003e7c780f9a1d server_cookie=4babacd83913d2a7 in_seq=0 out_seq=0 2024-05-14T09:33:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.716+0000 7fa1e1600640 1 -- 172.21.15.120:0/2119235798 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e689e76fd0 con 0x55e689afd1c0 2024-05-14T09:33:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.717+0000 7fa1e1600640 10 client.36413 handle_command_reply: tid=0 2024-05-14T09:33:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.717+0000 7fa205a2f740 1 client.36413 shutdown 2024-05-14T09:33:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.717+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 msgr2=0x55e689f42040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.717+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f42040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80a9880 tx=0x7fa1e80b2a60 comp rx=0 tx=0).stop 2024-05-14T09:33:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.718+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 shutdown_connections 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.718+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e689afd1c0 0x55e689f9d950 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.718+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e689b691b0 0x55e689f434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.718+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e689b484d0 0x55e689f42580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.718+0000 7fa205a2f740 1 --2- 172.21.15.120:0/2119235798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e689b402f0 0x55e689f42040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.718+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 >> 172.21.15.120:0/2119235798 conn(0x55e689b5d300 msgr2=0x55e689f0d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.718+0000 7fa1e1600640 0 client.36413 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.719+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 shutdown_connections 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.719+0000 7fa205a2f740 1 -- 172.21.15.120:0/2119235798 wait complete. 2024-05-14T09:33:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.719+0000 7fa205a2f740 20 client.36413 trim_cache size 0 max 16384 2024-05-14T09:33:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:33:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:33:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:33:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:33:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1dc0b2930 msgr2=0x7fa1dc0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1dc0b2930 0x7fa1dc0b4e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4000c00 tx=0x7fa1e4009570 comp rx=0 tx=0).stop 2024-05-14T09:33:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8102b50 msgr2=0x7fa1f819c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:33:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8102b50 0x7fa1f819c480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e9f0 tx=0x7fa1e800eeb0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 shutdown_connections 2024-05-14T09:33:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1dc0b2930 0x7fa1dc0b4e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1f8108a90 0x7fa1f81a3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1f8103d90 0x7fa1f819c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 --2- 172.21.15.120:0/1870257108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f8102b50 0x7fa1f819c480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:33:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.721+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 >> 172.21.15.120:0/1870257108 conn(0x7fa1f80fdd40 msgr2=0x7fa1f8104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:33:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.722+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 shutdown_connections 2024-05-14T09:33:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:33:53.722+0000 7fa1fea00640 1 -- 172.21.15.120:0/1870257108 wait complete. 2024-05-14T09:33:54.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 380.0 s, 661.8 tps, lat 151.376 ms stddev 60.291 2024-05-14T09:33:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:53 smithi120 ceph-mon[31085]: pgmap v866: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 697 op/s 2024-05-14T09:33:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:53 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:54.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:53 smithi152 ceph-mon[34868]: pgmap v866: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 697 op/s 2024-05-14T09:33:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:53 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:53 smithi175 ceph-mon[35353]: pgmap v866: 129 pgs: 129 active+clean; 1.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 697 op/s 2024-05-14T09:33:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:53 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:56.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:55 smithi120 ceph-mon[31085]: pgmap v867: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 672 op/s 2024-05-14T09:33:56.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:55 smithi152 ceph-mon[34868]: pgmap v867: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 672 op/s 2024-05-14T09:33:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:55 smithi175 ceph-mon[35353]: pgmap v867: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 672 op/s 2024-05-14T09:33:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:57 smithi120 ceph-mon[31085]: pgmap v868: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2024-05-14T09:33:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:57 smithi152 ceph-mon[34868]: pgmap v868: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2024-05-14T09:33:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:57 smithi175 ceph-mon[35353]: pgmap v868: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2024-05-14T09:33:59.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 385.0 s, 691.0 tps, lat 144.851 ms stddev 41.801 2024-05-14T09:33:59.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:33:59 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:59.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:33:59 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:33:59.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:33:59 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:34:00.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:00 smithi120 ceph-mon[31085]: pgmap v869: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.9 MiB/s wr, 671 op/s 2024-05-14T09:34:00.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:00 smithi152 ceph-mon[34868]: pgmap v869: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.9 MiB/s wr, 671 op/s 2024-05-14T09:34:00.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:00 smithi175 ceph-mon[35353]: pgmap v869: 129 pgs: 129 active+clean; 1.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.9 MiB/s wr, 671 op/s 2024-05-14T09:34:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:02 smithi120 ceph-mon[31085]: pgmap v870: 129 pgs: 129 active+clean; 1.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.5 MiB/s wr, 639 op/s 2024-05-14T09:34:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:02 smithi152 ceph-mon[34868]: pgmap v870: 129 pgs: 129 active+clean; 1.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.5 MiB/s wr, 639 op/s 2024-05-14T09:34:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:02 smithi175 ceph-mon[35353]: pgmap v870: 129 pgs: 129 active+clean; 1.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.5 MiB/s wr, 639 op/s 2024-05-14T09:34:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 390.0 s, 608.6 tps, lat 163.553 ms stddev 51.214 2024-05-14T09:34:04.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:04 smithi120 ceph-mon[31085]: pgmap v871: 129 pgs: 129 active+clean; 1.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T09:34:04.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:04 smithi152 ceph-mon[34868]: pgmap v871: 129 pgs: 129 active+clean; 1.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T09:34:04.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:04 smithi175 ceph-mon[35353]: pgmap v871: 129 pgs: 129 active+clean; 1.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T09:34:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:06 smithi120 ceph-mon[31085]: pgmap v872: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 665 op/s 2024-05-14T09:34:06.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:06 smithi152 ceph-mon[34868]: pgmap v872: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 665 op/s 2024-05-14T09:34:06.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:06 smithi175 ceph-mon[35353]: pgmap v872: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 665 op/s 2024-05-14T09:34:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.104+0000 7fea80200640 1 -- 172.21.15.120:0/3746734999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea7810a0f0 msgr2=0x7fea7810a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.104+0000 7fea80200640 1 --2- 172.21.15.120:0/3746734999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea7810a0f0 0x7fea7810a500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009860 tx=0x7fea6c02a340 comp rx=0 tx=0).stop 2024-05-14T09:34:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.105+0000 7fea80200640 1 -- 172.21.15.120:0/3746734999 shutdown_connections 2024-05-14T09:34:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.105+0000 7fea80200640 1 --2- 172.21.15.120:0/3746734999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea781121f0 0x7fea78114690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.105+0000 7fea80200640 1 --2- 172.21.15.120:0/3746734999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810f890 0x7fea78111cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.105+0000 7fea80200640 1 --2- 172.21.15.120:0/3746734999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea7810a0f0 0x7fea7810a500 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.105+0000 7fea80200640 1 -- 172.21.15.120:0/3746734999 >> 172.21.15.120:0/3746734999 conn(0x7fea78070a90 msgr2=0x7fea78072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.106+0000 7fea80200640 1 -- 172.21.15.120:0/3746734999 shutdown_connections 2024-05-14T09:34:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.106+0000 7fea80200640 1 -- 172.21.15.120:0/3746734999 wait complete. 2024-05-14T09:34:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.107+0000 7fea80200640 1 Processor -- start 2024-05-14T09:34:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.108+0000 7fea80200640 1 -- start start 2024-05-14T09:34:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.108+0000 7fea80200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810a0f0 0x7fea781a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.108+0000 7fea80200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7810f890 0x7fea781a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.108+0000 7fea80200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea781121f0 0x7fea781b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.108+0000 7fea80200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea78117f00 con 0x7fea7810f890 2024-05-14T09:34:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.108+0000 7fea80200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea78117d80 con 0x7fea781121f0 2024-05-14T09:34:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.108+0000 7fea80200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea78118080 con 0x7fea7810a0f0 2024-05-14T09:34:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.109+0000 7fea7d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810a0f0 0x7fea781a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.109+0000 7fea7d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810a0f0 0x7fea781a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:59630/0 (socket says 172.21.15.120:59630) 2024-05-14T09:34:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.109+0000 7fea7d800640 1 -- 172.21.15.120:0/3837862419 learned_addr learned my addr 172.21.15.120:0/3837862419 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.109+0000 7fea7e200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea781121f0 0x7fea781b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.109+0000 7fea7d800640 1 -- 172.21.15.120:0/3837862419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea781121f0 msgr2=0x7fea781b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.109+0000 7fea7d800640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea781121f0 0x7fea781b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.109+0000 7fea7d800640 1 -- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7810f890 msgr2=0x7fea781a0f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:34:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.110+0000 7fea7d800640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7810f890 0x7fea781a0f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.110+0000 7fea7d800640 1 -- 172.21.15.120:0/3837862419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea781b0d10 con 0x7fea7810a0f0 2024-05-14T09:34:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.110+0000 7fea7d800640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810a0f0 0x7fea781a09c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fea6c02a930 tx=0x7fea6c0306e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.111+0000 7fea76000640 1 -- 172.21.15.120:0/3837862419 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c040020 con 0x7fea7810a0f0 2024-05-14T09:34:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.111+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea781b0fa0 con 0x7fea7810a0f0 2024-05-14T09:34:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.111+0000 7fea76000640 1 -- 172.21.15.120:0/3837862419 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea6c030850 con 0x7fea7810a0f0 2024-05-14T09:34:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.111+0000 7fea76000640 1 -- 172.21.15.120:0/3837862419 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c037040 con 0x7fea7810a0f0 2024-05-14T09:34:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.111+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea781b13b0 con 0x7fea7810a0f0 2024-05-14T09:34:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.115+0000 7fea8716b740 1 Processor -- start 2024-05-14T09:34:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.115+0000 7fea8716b740 1 -- start start 2024-05-14T09:34:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.116+0000 7fea8716b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd2b1b0 0x560f2d0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.116+0000 7fea8716b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd022f0 0x560f2d0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea8716b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea8716b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f2d031550 con 0x560f2cd0a4d0 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea8716b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f2cfd6bc0 con 0x560f2cd2b1b0 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea8716b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560f2d02d510 con 0x560f2cd022f0 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea7e200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd2b1b0 0x560f2d0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea7e200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd2b1b0 0x560f2d0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33710/0 (socket says 172.21.15.120:33710) 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea7e200640 1 -- 172.21.15.120:0/3634627894 learned_addr learned my addr 172.21.15.120:0/3634627894 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.119+0000 7fea76000640 1 -- 172.21.15.120:0/3837862419 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fea6c043070 con 0x7fea7810a0f0 2024-05-14T09:34:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.120+0000 7fea7e200640 1 -- 172.21.15.120:0/3634627894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd022f0 msgr2=0x560f2d0cd6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.120+0000 7fea7e200640 1 --2- 172.21.15.120:0/3634627894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd022f0 0x560f2d0cd6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.120+0000 7fea7e200640 1 -- 172.21.15.120:0/3634627894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 msgr2=0x560f2d0d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.120+0000 7fea7e200640 1 --2- 172.21.15.120:0/3634627894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.120+0000 7fea7e200640 1 -- 172.21.15.120:0/3634627894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f2cd43210 con 0x560f2cd2b1b0 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.120+0000 7fea7e200640 1 --2- 172.21.15.120:0/3634627894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd2b1b0 0x560f2d0cd120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea7000e480 tx=0x7fea700095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d7486c424be807 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.121+0000 7fea6aa00640 1 -- 172.21.15.120:0/3634627894 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70003970 con 0x560f2cd2b1b0 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.121+0000 7fea6aa00640 1 -- 172.21.15.120:0/3634627894 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea7000d7d0 con 0x560f2cd2b1b0 2024-05-14T09:34:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.121+0000 7fea6aa00640 1 -- 172.21.15.120:0/3634627894 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70004480 con 0x560f2cd2b1b0 2024-05-14T09:34:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.122+0000 7fea8716b740 1 -- 172.21.15.120:0/3634627894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd2b1b0 msgr2=0x560f2d0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.122+0000 7fea8716b740 1 --2- 172.21.15.120:0/3634627894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd2b1b0 0x560f2d0cd120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea7000e480 tx=0x7fea700095c0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.123+0000 7fea8716b740 1 -- 172.21.15.120:0/3634627894 shutdown_connections 2024-05-14T09:34:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.123+0000 7fea8716b740 1 --2- 172.21.15.120:0/3634627894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.123+0000 7fea8716b740 1 --2- 172.21.15.120:0/3634627894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd022f0 0x560f2d0cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.123+0000 7fea8716b740 1 --2- 172.21.15.120:0/3634627894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd2b1b0 0x560f2d0cd120 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.123+0000 7fea8716b740 1 -- 172.21.15.120:0/3634627894 >> 172.21.15.120:0/3634627894 conn(0x560f2cd1f300 msgr2=0x560f2d0c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.123+0000 7fea8716b740 1 -- 172.21.15.120:0/3634627894 shutdown_connections 2024-05-14T09:34:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.123+0000 7fea8716b740 1 -- 172.21.15.120:0/3634627894 wait complete. 2024-05-14T09:34:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.124+0000 7fea76000640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea600b27c0 0x7fea600b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.124+0000 7fea8716b740 1 -- start start 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.125+0000 7fea8716b740 1 Processor -- start 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.125+0000 7fea7e200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea600b27c0 0x7fea600b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.125+0000 7fea8716b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.125+0000 7fea8716b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.126+0000 7fea8716b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.126+0000 7fea8716b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f2d0d4ff0 con 0x560f2cd0a4d0 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.126+0000 7fea8716b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f2cfea660 con 0x560f2cd022f0 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.126+0000 7fea8716b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560f2d0d5170 con 0x560f2cd2b1b0 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.126+0000 7fea8716b740 10 client.0 _ll_register_callbacks cb 0x560f2cfb4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.126+0000 7fea7ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.127+0000 7fea7d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.127+0000 7fea76000640 1 -- 172.21.15.120:0/3837862419 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fea6c101630 con 0x7fea7810a0f0 2024-05-14T09:34:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.127+0000 7fea7ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47174/0 (socket says 172.21.15.120:47174) 2024-05-14T09:34:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.127+0000 7fea7ce00640 1 -- 172.21.15.120:0/1225880825 learned_addr learned my addr 172.21.15.120:0/1225880825 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.127+0000 7fea7e200640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7ce00640 1 -- 172.21.15.120:0/1225880825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 msgr2=0x560f2d0de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7ce00640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7ce00640 1 -- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 msgr2=0x560f2d0d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7ce00640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7ce00640 1 -- 172.21.15.120:0/1225880825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2ce0f620 con 0x560f2cd0a4d0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7d800640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7e200640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.128+0000 7fea7e200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea600b27c0 0x7fea600b4cd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea70009e40 tx=0x7fea70005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.129+0000 7fea7ce00640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d7280 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fea64004790 tx=0x7fea6400d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526d8a24615bf733 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.129+0000 7fea5f400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.129+0000 7fea5f400640 1 -- 172.21.15.120:0/1225880825 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64016070 con 0x560f2cd0a4d0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.129+0000 7fea5f400640 1 -- 172.21.15.120:0/1225880825 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fea64004220 con 0x560f2cd0a4d0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.129+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea7000d7d0 con 0x560f2cd0a4d0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.130+0000 7fea5f400640 1 -- 172.21.15.120:0/1225880825 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fea6401f050 con 0x560f2cd0a4d0 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.130+0000 7fea8716b740 10 client.16926 fetch_fsmap learned FSMap version 56 2024-05-14T09:34:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.130+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x560f2d0e0fb0 con 0x560f2cd0a4d0 2024-05-14T09:34:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.131+0000 7fea5f400640 1 -- 172.21.15.120:0/1225880825 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea7000d7d0 con 0x560f2cd0a4d0 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea5f400640 1 -- 172.21.15.120:0/1225880825 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7fea64010460 con 0x560f2cd0a4d0 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea8716b740 10 client.16926 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea8716b740 10 client.16926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea8716b740 20 client.16926 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea8716b740 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2cce9d80 0x560f2d0e4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea8716b740 4 client.16926 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f2d03f160 con 0x560f2cce9d80 2024-05-14T09:34:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.132+0000 7fea7d800640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2cce9d80 0x560f2d0e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.134+0000 7fea5f400640 10 client.16926 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.134+0000 7fea7d800640 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2cce9d80 0x560f2d0e4730 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20483632489be4dd server_cookie=5ab540dcf897bde in_seq=0 out_seq=0 2024-05-14T09:34:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea5f400640 1 -- 172.21.15.120:0/1225880825 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560f2d03f160 con 0x560f2cce9d80 2024-05-14T09:34:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea5f400640 10 client.16926 handle_command_reply: tid=0 2024-05-14T09:34:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea8716b740 1 client.16926 shutdown 2024-05-14T09:34:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 msgr2=0x560f2d0d7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea8716b740 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d7280 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fea64004790 tx=0x7fea6400d6b0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 shutdown_connections 2024-05-14T09:34:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea8716b740 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2cce9d80 0x560f2d0e4730 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.136+0000 7fea5f400640 0 client.16926 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.137+0000 7fea8716b740 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.137+0000 7fea8716b740 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0d7280 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.137+0000 7fea8716b740 1 --2- 172.21.15.120:0/1225880825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.137+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 >> 172.21.15.120:0/1225880825 conn(0x560f2cd1f300 msgr2=0x560f2d0c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.137+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 shutdown_connections 2024-05-14T09:34:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.137+0000 7fea8716b740 1 -- 172.21.15.120:0/1225880825 wait complete. 2024-05-14T09:34:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.138+0000 7fea8716b740 20 client.16926 trim_cache size 0 max 16384 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.167+0000 7fea8716b740 1 Processor -- start 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.167+0000 7fea8716b740 1 -- start start 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea8716b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea8716b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd0a4d0 0x560f2d0c7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea8716b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea8716b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea781bb940 con 0x560f2cd2b1b0 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea8716b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea781bd540 con 0x560f2cd022f0 2024-05-14T09:34:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea8716b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea781bc010 con 0x560f2cd0a4d0 2024-05-14T09:34:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea7d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea7d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33720/0 (socket says 172.21.15.120:33720) 2024-05-14T09:34:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.168+0000 7fea7d800640 1 -- 172.21.15.120:0/2128656289 learned_addr learned my addr 172.21.15.120:0/2128656289 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.170+0000 7fea7d800640 1 -- 172.21.15.120:0/2128656289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd0a4d0 msgr2=0x560f2d0c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.170+0000 7fea7ce00640 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd0a4d0 0x560f2d0c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.170+0000 7fea7d800640 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd0a4d0 0x560f2d0c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.170+0000 7fea7d800640 1 -- 172.21.15.120:0/2128656289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd2b1b0 msgr2=0x560f2d0de150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.170+0000 7fea7d800640 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.170+0000 7fea7d800640 1 -- 172.21.15.120:0/2128656289 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f2d0cdf20 con 0x560f2cd022f0 2024-05-14T09:34:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.171+0000 7fea7ce00640 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd0a4d0 0x560f2d0c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:34:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.172+0000 7fea7d800640 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d17b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea6c02a900 tx=0x7fea6c0cf040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16d54c423fae6bcc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.172+0000 7fea6a000640 1 -- 172.21.15.120:0/2128656289 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0c40d0 con 0x560f2cd022f0 2024-05-14T09:34:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.172+0000 7fea6a000640 1 -- 172.21.15.120:0/2128656289 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea6c0c8450 con 0x560f2cd022f0 2024-05-14T09:34:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.172+0000 7fea6a000640 1 -- 172.21.15.120:0/2128656289 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c101330 con 0x560f2cd022f0 2024-05-14T09:34:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.174+0000 7fea8716b740 1 -- 172.21.15.120:0/2128656289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 msgr2=0x560f2d0d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.174+0000 7fea8716b740 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d17b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea6c02a900 tx=0x7fea6c0cf040 comp rx=0 tx=0).stop 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.174+0000 7fea8716b740 1 -- 172.21.15.120:0/2128656289 shutdown_connections 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.174+0000 7fea8716b740 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd2b1b0 0x560f2d0de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.174+0000 7fea8716b740 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd0a4d0 0x560f2d0c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.174+0000 7fea8716b740 1 --2- 172.21.15.120:0/2128656289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0d17b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.174+0000 7fea8716b740 1 -- 172.21.15.120:0/2128656289 >> 172.21.15.120:0/2128656289 conn(0x560f2cd1f300 msgr2=0x560f2d0c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.175+0000 7fea8716b740 1 -- 172.21.15.120:0/2128656289 shutdown_connections 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.175+0000 7fea8716b740 1 -- 172.21.15.120:0/2128656289 wait complete. 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.176+0000 7fea8716b740 1 -- start start 2024-05-14T09:34:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.176+0000 7fea8716b740 1 Processor -- start 2024-05-14T09:34:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.177+0000 7fea8716b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0db650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.177+0000 7fea8716b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.177+0000 7fea8716b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea8716b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea781bcdb0 con 0x560f2cd0a4d0 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea8716b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea781bc6e0 con 0x560f2cd022f0 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea7d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0db650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea8716b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea781b9940 con 0x560f2cd2b1b0 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea8716b740 10 client.0 _ll_register_callbacks cb 0x7fea6400b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea7e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea7e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d14aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:59646/0 (socket says 172.21.15.120:59646) 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea7e200640 1 -- 172.21.15.120:0/1071726487 learned_addr learned my addr 172.21.15.120:0/1071726487 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.178+0000 7fea7ce00640 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.179+0000 7fea7ce00640 1 -- 172.21.15.120:0/1071726487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 msgr2=0x560f2d14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.179+0000 7fea7ce00640 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.179+0000 7fea7ce00640 1 -- 172.21.15.120:0/1071726487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 msgr2=0x560f2d0db650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.179+0000 7fea7ce00640 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0db650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.179+0000 7fea7ce00640 1 -- 172.21.15.120:0/1071726487 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2d0deb00 con 0x560f2cd0a4d0 2024-05-14T09:34:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.181+0000 7fea7ce00640 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0dbb90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x560f2d0ba5e0 tx=0x7fea64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322c175110ade72d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.181+0000 7fea5f400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:34:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.184+0000 7fea5f400640 1 -- 172.21.15.120:0/1071726487 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64004240 con 0x560f2cd0a4d0 2024-05-14T09:34:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.184+0000 7fea5f400640 1 -- 172.21.15.120:0/1071726487 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fea640043e0 con 0x560f2cd0a4d0 2024-05-14T09:34:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.184+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea6c0c8450 con 0x560f2cd0a4d0 2024-05-14T09:34:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.188+0000 7fea5f400640 1 -- 172.21.15.120:0/1071726487 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fea64005020 con 0x560f2cd0a4d0 2024-05-14T09:34:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.188+0000 7fea8716b740 10 client.16929 fetch_fsmap learned FSMap version 56 2024-05-14T09:34:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.188+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x560f2d14bef0 con 0x560f2cd0a4d0 2024-05-14T09:34:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.189+0000 7fea5f400640 1 -- 172.21.15.120:0/1071726487 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea6c0c8450 con 0x560f2cd0a4d0 2024-05-14T09:34:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.189+0000 7fea5f400640 1 -- 172.21.15.120:0/1071726487 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7fea64004a90 con 0x560f2cd0a4d0 2024-05-14T09:34:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.189+0000 7fea8716b740 10 client.16929 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T09:34:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.189+0000 7fea8716b740 10 client.16929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.189+0000 7fea8716b740 20 client.16929 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.190+0000 7fea8716b740 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2ccbf1c0 0x560f2d14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.190+0000 7fea8716b740 4 client.16929 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:34:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.190+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560f2d038fd0 con 0x560f2ccbf1c0 2024-05-14T09:34:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.190+0000 7fea7d800640 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2ccbf1c0 0x560f2d14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.193+0000 7fea7d800640 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2ccbf1c0 0x560f2d14e9a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f3065c4c8119b97 server_cookie=4fe4982111f0c5a in_seq=0 out_seq=0 2024-05-14T09:34:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.193+0000 7fea5f400640 10 client.16929 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.225+0000 7fea5f400640 1 -- 172.21.15.120:0/1071726487 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560f2d038fd0 con 0x560f2ccbf1c0 2024-05-14T09:34:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.225+0000 7fea5f400640 10 client.16929 handle_command_reply: tid=0 2024-05-14T09:34:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.225+0000 7fea8716b740 1 client.16929 shutdown 2024-05-14T09:34:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.226+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 msgr2=0x560f2d0dbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.226+0000 7fea8716b740 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0dbb90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x560f2d0ba5e0 tx=0x7fea64014000 comp rx=0 tx=0).stop 2024-05-14T09:34:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.227+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 shutdown_connections 2024-05-14T09:34:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.227+0000 7fea8716b740 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560f2ccbf1c0 0x560f2d14e9a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.227+0000 7fea8716b740 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560f2cd2b1b0 0x560f2d14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.227+0000 7fea8716b740 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f2cd0a4d0 0x560f2d0dbb90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.227+0000 7fea8716b740 1 --2- 172.21.15.120:0/1071726487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f2cd022f0 0x560f2d0db650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.227+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 >> 172.21.15.120:0/1071726487 conn(0x560f2cd1f300 msgr2=0x560f2d0cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.227+0000 7fea5f400640 0 client.16929 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.228+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 shutdown_connections 2024-05-14T09:34:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.228+0000 7fea8716b740 1 -- 172.21.15.120:0/1071726487 wait complete. 2024-05-14T09:34:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.228+0000 7fea8716b740 20 client.16929 trim_cache size 0 max 16384 2024-05-14T09:34:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:34:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:34:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:34:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:34:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea600b27c0 msgr2=0x7fea600b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea600b27c0 0x7fea600b4cd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea70009e40 tx=0x7fea70005bd0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810a0f0 msgr2=0x7fea781a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810a0f0 0x7fea781a09c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fea6c02a930 tx=0x7fea6c0306e0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 shutdown_connections 2024-05-14T09:34:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fea600b27c0 0x7fea600b4cd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea781121f0 0x7fea781b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7810f890 0x7fea781a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 --2- 172.21.15.120:0/3837862419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7810a0f0 0x7fea781a09c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 >> 172.21.15.120:0/3837862419 conn(0x7fea78070a90 msgr2=0x7fea7810c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.232+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 shutdown_connections 2024-05-14T09:34:07.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:07.233+0000 7fea80200640 1 -- 172.21.15.120:0/3837862419 wait complete. 2024-05-14T09:34:08.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:08 smithi120 ceph-mon[31085]: pgmap v873: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 605 op/s 2024-05-14T09:34:08.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:08 smithi152 ceph-mon[34868]: pgmap v873: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 605 op/s 2024-05-14T09:34:08.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:08 smithi175 ceph-mon[35353]: pgmap v873: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 605 op/s 2024-05-14T09:34:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 395.0 s, 673.9 tps, lat 149.419 ms stddev 48.794 2024-05-14T09:34:10.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:10 smithi120 ceph-mon[31085]: pgmap v874: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 671 op/s 2024-05-14T09:34:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:10 smithi152 ceph-mon[34868]: pgmap v874: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 671 op/s 2024-05-14T09:34:10.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:10 smithi175 ceph-mon[35353]: pgmap v874: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 671 op/s 2024-05-14T09:34:12.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:12 smithi120 ceph-mon[31085]: pgmap v875: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 674 op/s 2024-05-14T09:34:12.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:12 smithi152 ceph-mon[34868]: pgmap v875: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 674 op/s 2024-05-14T09:34:12.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:12 smithi175 ceph-mon[35353]: pgmap v875: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 674 op/s 2024-05-14T09:34:14.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 400.0 s, 664.1 tps, lat 150.413 ms stddev 42.980 2024-05-14T09:34:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:14 smithi120 ceph-mon[31085]: pgmap v876: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T09:34:14.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:14 smithi152 ceph-mon[34868]: pgmap v876: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T09:34:14.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:14 smithi175 ceph-mon[35353]: pgmap v876: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T09:34:16.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:16 smithi120 ceph-mon[31085]: pgmap v877: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 690 op/s 2024-05-14T09:34:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:16 smithi152 ceph-mon[34868]: pgmap v877: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 690 op/s 2024-05-14T09:34:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:16 smithi175 ceph-mon[35353]: pgmap v877: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 690 op/s 2024-05-14T09:34:18.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:18 smithi120 ceph-mon[31085]: pgmap v878: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 MiB/s wr, 654 op/s 2024-05-14T09:34:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:18 smithi152 ceph-mon[34868]: pgmap v878: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 MiB/s wr, 654 op/s 2024-05-14T09:34:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:18 smithi175 ceph-mon[35353]: pgmap v878: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 MiB/s wr, 654 op/s 2024-05-14T09:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 405.0 s, 549.0 tps, lat 180.899 ms stddev 139.786 2024-05-14T09:34:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:20 smithi120 ceph-mon[31085]: pgmap v879: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 709 op/s 2024-05-14T09:34:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:20 smithi152 ceph-mon[34868]: pgmap v879: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 709 op/s 2024-05-14T09:34:20.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:20 smithi175 ceph-mon[35353]: pgmap v879: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 709 op/s 2024-05-14T09:34:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.568+0000 7f3756800640 1 -- 172.21.15.120:0/823114832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37501101a0 msgr2=0x7f37501105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.568+0000 7f3756800640 1 --2- 172.21.15.120:0/823114832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37501101a0 0x7f37501105b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f373c009900 tx=0x7f373c02a3f0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.570+0000 7f3756800640 1 -- 172.21.15.120:0/823114832 shutdown_connections 2024-05-14T09:34:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.570+0000 7f3756800640 1 --2- 172.21.15.120:0/823114832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37501101a0 0x7f37501105b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.570+0000 7f3756800640 1 --2- 172.21.15.120:0/823114832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f375010b480 0x7f375010b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.570+0000 7f3756800640 1 --2- 172.21.15.120:0/823114832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010a550 0x7f375010af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.570+0000 7f3756800640 1 -- 172.21.15.120:0/823114832 >> 172.21.15.120:0/823114832 conn(0x7f3750070670 msgr2=0x7f3750072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.571+0000 7f3756800640 1 -- 172.21.15.120:0/823114832 shutdown_connections 2024-05-14T09:34:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.573+0000 7f3756800640 1 -- 172.21.15.120:0/823114832 wait complete. 2024-05-14T09:34:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.576+0000 7f3756800640 1 Processor -- start 2024-05-14T09:34:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.576+0000 7f3756800640 1 -- start start 2024-05-14T09:34:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f3756800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375010a550 0x7f37501a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f3756800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010b480 0x7f37501a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f3756800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37501101a0 0x7f37501b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f3756800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f375011e4b0 con 0x7f375010b480 2024-05-14T09:34:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f3756800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f375011e330 con 0x7f37501101a0 2024-05-14T09:34:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f3756800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f375011e630 con 0x7f375010a550 2024-05-14T09:34:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f374ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010b480 0x7f37501a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.577+0000 7f374f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375010a550 0x7f37501a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375010a550 0x7f37501a90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55626/0 (socket says 172.21.15.120:55626) 2024-05-14T09:34:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010b480 0x7f37501a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45440/0 (socket says 172.21.15.120:45440) 2024-05-14T09:34:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374ea00640 1 -- 172.21.15.120:0/3371666759 learned_addr learned my addr 172.21.15.120:0/3371666759 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374fe00640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37501101a0 0x7f37501b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374ea00640 1 -- 172.21.15.120:0/3371666759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375010a550 msgr2=0x7f37501a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374ea00640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375010a550 0x7f37501a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374ea00640 1 -- 172.21.15.120:0/3371666759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37501101a0 msgr2=0x7f37501b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.578+0000 7f374ea00640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37501101a0 0x7f37501b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.579+0000 7f374ea00640 1 -- 172.21.15.120:0/3371666759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37501b0b70 con 0x7f375010b480 2024-05-14T09:34:20.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.579+0000 7f374ea00640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010b480 0x7f37501a9620 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f374000eb90 tx=0x7f374000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.580+0000 7f3747e00640 1 -- 172.21.15.120:0/3371666759 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740004d20 con 0x7f375010b480 2024-05-14T09:34:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.580+0000 7f3747e00640 1 -- 172.21.15.120:0/3371666759 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f374000ee90 con 0x7f375010b480 2024-05-14T09:34:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.580+0000 7f3747e00640 1 -- 172.21.15.120:0/3371666759 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740010690 con 0x7f375010b480 2024-05-14T09:34:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.581+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37501b0e60 con 0x7f375010b480 2024-05-14T09:34:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.581+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37501b1270 con 0x7f375010b480 2024-05-14T09:34:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.590+0000 7f3747e00640 1 -- 172.21.15.120:0/3371666759 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3740005020 con 0x7f375010b480 2024-05-14T09:34:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.591+0000 7f375d79e740 1 Processor -- start 2024-05-14T09:34:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.592+0000 7f375d79e740 1 -- start start 2024-05-14T09:34:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.592+0000 7f375d79e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95881b0 0x558cc992a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.592+0000 7f375d79e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc992a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.592+0000 7f375d79e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc9931580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.592+0000 7f375d79e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558cc988e550 con 0x558cc95881b0 2024-05-14T09:34:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.592+0000 7f375d79e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558cc9833bc0 con 0x558cc95674d0 2024-05-14T09:34:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.592+0000 7f375d79e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558cc988a510 con 0x558cc955f2f0 2024-05-14T09:34:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.593+0000 7f374ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc9931580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.593+0000 7f374ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc9931580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48700/0 (socket says 172.21.15.120:48700) 2024-05-14T09:34:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.593+0000 7f374ea00640 1 -- 172.21.15.120:0/3010292952 learned_addr learned my addr 172.21.15.120:0/3010292952 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.594+0000 7f374f400640 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc992a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.594+0000 7f374ea00640 1 -- 172.21.15.120:0/3010292952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 msgr2=0x558cc992a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.595+0000 7f374ea00640 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc992a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.595+0000 7f374ea00640 1 -- 172.21.15.120:0/3010292952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95881b0 msgr2=0x558cc992a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.595+0000 7f374ea00640 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95881b0 0x558cc992a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.595+0000 7f374ea00640 1 -- 172.21.15.120:0/3010292952 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc95a0210 con 0x558cc95674d0 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.595+0000 7f374f400640 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc992a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:34:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.595+0000 7f374ea00640 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc9931580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f37400e6bc0 tx=0x7f37400e6cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1052a93304a39d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.596+0000 7f3744c00640 1 -- 172.21.15.120:0/3010292952 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37400f2070 con 0x558cc95674d0 2024-05-14T09:34:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.596+0000 7f3747e00640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37340b2970 0x7f37340b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.596+0000 7f3747e00640 1 -- 172.21.15.120:0/3371666759 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f37400e2c20 con 0x7f375010b480 2024-05-14T09:34:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.598+0000 7f3744c00640 1 -- 172.21.15.120:0/3010292952 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37400a9950 con 0x558cc95674d0 2024-05-14T09:34:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.598+0000 7f3744c00640 1 -- 172.21.15.120:0/3010292952 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37400a95b0 con 0x558cc95674d0 2024-05-14T09:34:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.601+0000 7f375d79e740 1 -- 172.21.15.120:0/3010292952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 msgr2=0x558cc9931580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.601+0000 7f375d79e740 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc9931580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f37400e6bc0 tx=0x7f37400e6cb0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.601+0000 7f374fe00640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37340b2970 0x7f37340b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.602+0000 7f375d79e740 1 -- 172.21.15.120:0/3010292952 shutdown_connections 2024-05-14T09:34:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.602+0000 7f375d79e740 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc9931580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.602+0000 7f375d79e740 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc992a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.602+0000 7f375d79e740 1 --2- 172.21.15.120:0/3010292952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95881b0 0x558cc992a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.602+0000 7f375d79e740 1 -- 172.21.15.120:0/3010292952 >> 172.21.15.120:0/3010292952 conn(0x558cc957c300 msgr2=0x558cc9925a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.602+0000 7f375d79e740 1 -- 172.21.15.120:0/3010292952 shutdown_connections 2024-05-14T09:34:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.602+0000 7f375d79e740 1 -- 172.21.15.120:0/3010292952 wait complete. 2024-05-14T09:34:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.603+0000 7f374fe00640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37340b2970 0x7f37340b4e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f373c006010 tx=0x7f373c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:20.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.603+0000 7f375d79e740 1 -- start start 2024-05-14T09:34:20.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.604+0000 7f375d79e740 1 Processor -- start 2024-05-14T09:34:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.604+0000 7f375d79e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc9933bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.604+0000 7f375d79e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95674d0 0x558cc9934130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f375d79e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f375d79e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558cc9931fd0 con 0x558cc95674d0 2024-05-14T09:34:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f375d79e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558cc9847660 con 0x558cc95881b0 2024-05-14T09:34:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f375d79e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558cc9932150 con 0x558cc955f2f0 2024-05-14T09:34:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f375d79e740 10 client.0 _ll_register_callbacks cb 0x558cc9811400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f374f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc9933bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f374f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc9933bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55648/0 (socket says 172.21.15.120:55648) 2024-05-14T09:34:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.605+0000 7f374f400640 1 -- 172.21.15.120:0/815232897 learned_addr learned my addr 172.21.15.120:0/815232897 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374fe00640 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374ea00640 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95674d0 0x558cc9934130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374f400640 1 -- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 msgr2=0x558cc993b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374f400640 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374f400640 1 -- 172.21.15.120:0/815232897 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95674d0 msgr2=0x558cc9934130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374f400640 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95674d0 0x558cc9934130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374f400640 1 -- 172.21.15.120:0/815232897 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc966c620 con 0x558cc955f2f0 2024-05-14T09:34:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f374f400640 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc9933bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f374800f3e0 tx=0x7f374800f8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b22ddafa78523fde server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.606+0000 7f3739600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:34:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.607+0000 7f3739600640 1 -- 172.21.15.120:0/815232897 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748004220 con 0x558cc955f2f0 2024-05-14T09:34:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.607+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37400a9950 con 0x558cc955f2f0 2024-05-14T09:34:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.607+0000 7f3739600640 1 -- 172.21.15.120:0/815232897 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f37480043c0 con 0x558cc955f2f0 2024-05-14T09:34:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.608+0000 7f3739600640 1 -- 172.21.15.120:0/815232897 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f3748011710 con 0x558cc955f2f0 2024-05-14T09:34:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.608+0000 7f375d79e740 10 client.26488 fetch_fsmap learned FSMap version 56 2024-05-14T09:34:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.608+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x558cc993de40 con 0x558cc955f2f0 2024-05-14T09:34:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.609+0000 7f3739600640 1 -- 172.21.15.120:0/815232897 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37400a9950 con 0x558cc955f2f0 2024-05-14T09:34:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.610+0000 7f3739600640 1 -- 172.21.15.120:0/815232897 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f3748003b20 con 0x558cc955f2f0 2024-05-14T09:34:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.610+0000 7f375d79e740 10 client.26488 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T09:34:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.610+0000 7f375d79e740 10 client.26488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.610+0000 7f375d79e740 20 client.26488 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.610+0000 7f375d79e740 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc9546d80 0x558cc9941650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.610+0000 7f375d79e740 4 client.26488 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:34:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.610+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cc989c160 con 0x558cc9546d80 2024-05-14T09:34:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.611+0000 7f374ea00640 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc9546d80 0x558cc9941650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.613+0000 7f374ea00640 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc9546d80 0x558cc9941650 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819a7cbf84805e57 server_cookie=d4ff5f04bf74716b in_seq=0 out_seq=0 2024-05-14T09:34:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.613+0000 7f3739600640 10 client.26488 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.615+0000 7f3739600640 1 -- 172.21.15.120:0/815232897 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558cc989c160 con 0x558cc9546d80 2024-05-14T09:34:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.615+0000 7f3739600640 10 client.26488 handle_command_reply: tid=0 2024-05-14T09:34:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.615+0000 7f375d79e740 1 client.26488 shutdown 2024-05-14T09:34:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 msgr2=0x558cc9933bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc9933bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f374800f3e0 tx=0x7f374800f8a0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 shutdown_connections 2024-05-14T09:34:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc9546d80 0x558cc9941650 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc95674d0 0x558cc9934130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 --2- 172.21.15.120:0/815232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc955f2f0 0x558cc9933bf0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f374800f3e0 tx=0x7f374800f8a0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 >> 172.21.15.120:0/815232897 conn(0x558cc957c300 msgr2=0x558cc9924a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.616+0000 7f3739600640 0 client.26488 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.617+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 shutdown_connections 2024-05-14T09:34:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.617+0000 7f375d79e740 1 -- 172.21.15.120:0/815232897 wait complete. 2024-05-14T09:34:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.617+0000 7f375d79e740 20 client.26488 trim_cache size 0 max 16384 2024-05-14T09:34:20.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 Processor -- start 2024-05-14T09:34:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 -- start start 2024-05-14T09:34:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc992e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95881b0 0x558cc9928fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc99294e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f37501bb6e0 con 0x558cc951c1c0 2024-05-14T09:34:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37501bd2e0 con 0x558cc95674d0 2024-05-14T09:34:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.648+0000 7f375d79e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37501bbdb0 con 0x558cc95881b0 2024-05-14T09:34:20.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.649+0000 7f374ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95881b0 0x558cc9928fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.650+0000 7f374ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95881b0 0x558cc9928fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55650/0 (socket says 172.21.15.120:55650) 2024-05-14T09:34:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.650+0000 7f374ea00640 1 -- 172.21.15.120:0/98934609 learned_addr learned my addr 172.21.15.120:0/98934609 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.650+0000 7f374f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc992e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.650+0000 7f374fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc99294e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.652+0000 7f374ea00640 1 -- 172.21.15.120:0/98934609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 msgr2=0x558cc992e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.652+0000 7f374ea00640 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc992e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.652+0000 7f374ea00640 1 -- 172.21.15.120:0/98934609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 msgr2=0x558cc99294e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.652+0000 7f374ea00640 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc99294e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.652+0000 7f374ea00640 1 -- 172.21.15.120:0/98934609 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc9932f20 con 0x558cc95881b0 2024-05-14T09:34:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.652+0000 7f374fe00640 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc99294e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:34:20.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.653+0000 7f374ea00640 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95881b0 0x558cc9928fa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37400e6100 tx=0x7f374000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe2425ef761908e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:20.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.654+0000 7f373be00640 1 -- 172.21.15.120:0/98934609 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37400d5cc0 con 0x558cc95881b0 2024-05-14T09:34:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.654+0000 7f373be00640 1 -- 172.21.15.120:0/98934609 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37400a9950 con 0x558cc95881b0 2024-05-14T09:34:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.654+0000 7f373be00640 1 -- 172.21.15.120:0/98934609 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37400d5e90 con 0x558cc95881b0 2024-05-14T09:34:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.656+0000 7f375d79e740 1 -- 172.21.15.120:0/98934609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95881b0 msgr2=0x558cc9928fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.656+0000 7f375d79e740 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95881b0 0x558cc9928fa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37400e6100 tx=0x7f374000cf90 comp rx=0 tx=0).stop 2024-05-14T09:34:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.657+0000 7f375d79e740 1 -- 172.21.15.120:0/98934609 shutdown_connections 2024-05-14T09:34:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.657+0000 7f375d79e740 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc99294e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.657+0000 7f375d79e740 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95881b0 0x558cc9928fa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.657+0000 7f375d79e740 1 --2- 172.21.15.120:0/98934609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95674d0 0x558cc992e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.657+0000 7f375d79e740 1 -- 172.21.15.120:0/98934609 >> 172.21.15.120:0/98934609 conn(0x558cc957c300 msgr2=0x558cc9928890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.657+0000 7f375d79e740 1 -- 172.21.15.120:0/98934609 shutdown_connections 2024-05-14T09:34:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.657+0000 7f375d79e740 1 -- 172.21.15.120:0/98934609 wait complete. 2024-05-14T09:34:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.658+0000 7f375d79e740 1 -- start start 2024-05-14T09:34:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.658+0000 7f375d79e740 1 Processor -- start 2024-05-14T09:34:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.660+0000 7f375d79e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc993b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.660+0000 7f375d79e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95674d0 0x558cc9939df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.660+0000 7f375d79e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.660+0000 7f375d79e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f37501bcb50 con 0x558cc951c1c0 2024-05-14T09:34:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.660+0000 7f375d79e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37501bc480 con 0x558cc95881b0 2024-05-14T09:34:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.660+0000 7f375d79e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37501b96e0 con 0x558cc95674d0 2024-05-14T09:34:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.660+0000 7f375d79e740 10 client.0 _ll_register_callbacks cb 0x7f374800a390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.661+0000 7f374f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc993b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.661+0000 7f374f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc993b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45466/0 (socket says 172.21.15.120:45466) 2024-05-14T09:34:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.661+0000 7f374fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.661+0000 7f374f400640 1 -- 172.21.15.120:0/3384547414 learned_addr learned my addr 172.21.15.120:0/3384547414 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.661+0000 7f374ea00640 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95674d0 0x558cc9939df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.662+0000 7f374f400640 1 -- 172.21.15.120:0/3384547414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95674d0 msgr2=0x558cc9939df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.662+0000 7f374f400640 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95674d0 0x558cc9939df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.662+0000 7f374f400640 1 -- 172.21.15.120:0/3384547414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 msgr2=0x558cc993a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.662+0000 7f374f400640 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.662+0000 7f374f400640 1 -- 172.21.15.120:0/3384547414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc993ab10 con 0x558cc951c1c0 2024-05-14T09:34:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.663+0000 7f374f400640 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc993b780 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3748000c00 tx=0x7f374800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d1de1609501d6d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.663+0000 7f3739600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:34:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.664+0000 7f3739600640 1 -- 172.21.15.120:0/3384547414 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37480054d0 con 0x558cc951c1c0 2024-05-14T09:34:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.664+0000 7f3739600640 1 -- 172.21.15.120:0/3384547414 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f37480035f0 con 0x558cc951c1c0 2024-05-14T09:34:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.664+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37400a9950 con 0x558cc951c1c0 2024-05-14T09:34:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.665+0000 7f3739600640 1 -- 172.21.15.120:0/3384547414 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f37480037f0 con 0x558cc951c1c0 2024-05-14T09:34:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.666+0000 7f375d79e740 10 client.16941 fetch_fsmap learned FSMap version 56 2024-05-14T09:34:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.666+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x558cc99a8a50 con 0x558cc951c1c0 2024-05-14T09:34:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.667+0000 7f3739600640 1 -- 172.21.15.120:0/3384547414 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37400a9950 con 0x558cc951c1c0 2024-05-14T09:34:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f3739600640 1 -- 172.21.15.120:0/3384547414 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f3748019ac0 con 0x558cc951c1c0 2024-05-14T09:34:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f375d79e740 10 client.16941 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T09:34:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f375d79e740 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f375d79e740 20 client.16941 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f375d79e740 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc99a94f0 0x558cc99ab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f375d79e740 4 client.16941 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:34:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558cc9895fd0 con 0x558cc99a94f0 2024-05-14T09:34:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.668+0000 7f374ea00640 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc99a94f0 0x558cc99ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:20.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.670+0000 7f374ea00640 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc99a94f0 0x558cc99ab910 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d87425c100e81b4e server_cookie=716973793e944a33 in_seq=0 out_seq=0 2024-05-14T09:34:20.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.670+0000 7f3739600640 10 client.16941 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.724+0000 7f3739600640 1 -- 172.21.15.120:0/3384547414 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558cc9895fd0 con 0x558cc99a94f0 2024-05-14T09:34:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.724+0000 7f3739600640 10 client.16941 handle_command_reply: tid=0 2024-05-14T09:34:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.724+0000 7f375d79e740 1 client.16941 shutdown 2024-05-14T09:34:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.726+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 msgr2=0x558cc993b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.726+0000 7f375d79e740 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc993b780 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3748000c00 tx=0x7f374800a620 comp rx=0 tx=0).stop 2024-05-14T09:34:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.726+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 shutdown_connections 2024-05-14T09:34:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.726+0000 7f375d79e740 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558cc99a94f0 0x558cc99ab910 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.727+0000 7f375d79e740 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cc95881b0 0x558cc993a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.727+0000 7f375d79e740 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cc95674d0 0x558cc9939df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.727+0000 7f3739600640 0 client.16941 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.727+0000 7f375d79e740 1 --2- 172.21.15.120:0/3384547414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558cc951c1c0 0x558cc993b780 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.727+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 >> 172.21.15.120:0/3384547414 conn(0x558cc957c300 msgr2=0x558cc99292c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.727+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 shutdown_connections 2024-05-14T09:34:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.727+0000 7f375d79e740 1 -- 172.21.15.120:0/3384547414 wait complete. 2024-05-14T09:34:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.728+0000 7f375d79e740 20 client.16941 trim_cache size 0 max 16384 2024-05-14T09:34:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:34:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:34:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:34:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:34:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37340b2970 msgr2=0x7f37340b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37340b2970 0x7f37340b4e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f373c006010 tx=0x7f373c031400 comp rx=0 tx=0).stop 2024-05-14T09:34:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010b480 msgr2=0x7f37501a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010b480 0x7f37501a9620 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f374000eb90 tx=0x7f374000c6a0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 shutdown_connections 2024-05-14T09:34:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37340b2970 0x7f37340b4e80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37501101a0 0x7f37501b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f375010b480 0x7f37501a9620 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 --2- 172.21.15.120:0/3371666759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375010a550 0x7f37501a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.729+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 >> 172.21.15.120:0/3371666759 conn(0x7f3750070670 msgr2=0x7f375010c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.730+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 shutdown_connections 2024-05-14T09:34:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:20.730+0000 7f3756800640 1 -- 172.21.15.120:0/3371666759 wait complete. 2024-05-14T09:34:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:22 smithi120 ceph-mon[31085]: pgmap v880: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.7 MiB/s wr, 661 op/s 2024-05-14T09:34:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:22 smithi152 ceph-mon[34868]: pgmap v880: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.7 MiB/s wr, 661 op/s 2024-05-14T09:34:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:22 smithi175 ceph-mon[35353]: pgmap v880: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.7 MiB/s wr, 661 op/s 2024-05-14T09:34:24.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 410.0 s, 679.6 tps, lat 147.650 ms stddev 64.320 2024-05-14T09:34:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:24 smithi152 ceph-mon[34868]: pgmap v881: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.7 MiB/s wr, 660 op/s 2024-05-14T09:34:24.481 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:24 smithi175 ceph-mon[35353]: pgmap v881: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.7 MiB/s wr, 660 op/s 2024-05-14T09:34:24.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:24 smithi120 ceph-mon[31085]: pgmap v881: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.7 MiB/s wr, 660 op/s 2024-05-14T09:34:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:26 smithi152 ceph-mon[34868]: pgmap v882: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 679 op/s 2024-05-14T09:34:26.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:26 smithi175 ceph-mon[35353]: pgmap v882: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 679 op/s 2024-05-14T09:34:26.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:26 smithi120 ceph-mon[31085]: pgmap v882: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 679 op/s 2024-05-14T09:34:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:28 smithi152 ceph-mon[34868]: pgmap v883: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 614 op/s 2024-05-14T09:34:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:28 smithi175 ceph-mon[35353]: pgmap v883: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 614 op/s 2024-05-14T09:34:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:28 smithi120 ceph-mon[31085]: pgmap v883: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 614 op/s 2024-05-14T09:34:29.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 415.0 s, 675.0 tps, lat 148.534 ms stddev 58.932 2024-05-14T09:34:30.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:30 smithi152 ceph-mon[34868]: pgmap v884: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 678 op/s 2024-05-14T09:34:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:30 smithi175 ceph-mon[35353]: pgmap v884: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 678 op/s 2024-05-14T09:34:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:30 smithi120 ceph-mon[31085]: pgmap v884: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 678 op/s 2024-05-14T09:34:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:32 smithi152 ceph-mon[34868]: pgmap v885: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-05-14T09:34:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:32 smithi175 ceph-mon[35353]: pgmap v885: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-05-14T09:34:32.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:32 smithi120 ceph-mon[31085]: pgmap v885: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-05-14T09:34:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.120+0000 7f46f2600640 1 -- 172.21.15.120:0/2517431758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec0750c0 msgr2=0x7f46ec0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.120+0000 7f46f2600640 1 --2- 172.21.15.120:0/2517431758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec0750c0 0x7f46ec0754d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009ca0 tx=0x7f46e402a8c0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.121+0000 7f46f2600640 1 -- 172.21.15.120:0/2517431758 shutdown_connections 2024-05-14T09:34:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.121+0000 7f46f2600640 1 --2- 172.21.15.120:0/2517431758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec1103d0 0x7f46ec1127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.121+0000 7f46f2600640 1 --2- 172.21.15.120:0/2517431758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec075a10 0x7f46ec10fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.121+0000 7f46f2600640 1 --2- 172.21.15.120:0/2517431758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec0750c0 0x7f46ec0754d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.121+0000 7f46f2600640 1 -- 172.21.15.120:0/2517431758 >> 172.21.15.120:0/2517431758 conn(0x7f46ec0fee60 msgr2=0x7f46ec101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:34.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.121+0000 7f46f2600640 1 -- 172.21.15.120:0/2517431758 shutdown_connections 2024-05-14T09:34:34.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.121+0000 7f46f2600640 1 -- 172.21.15.120:0/2517431758 wait complete. 2024-05-14T09:34:34.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 Processor -- start 2024-05-14T09:34:34.124 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 -- start start 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec0750c0 0x7f46ec1a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec075a10 0x7f46ec1a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec1103d0 0x7f46ec1a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec115cf0 con 0x7f46ec075a10 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec115b70 con 0x7f46ec0750c0 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.123+0000 7f46f2600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec115e70 con 0x7f46ec1103d0 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.124+0000 7f46eaa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec075a10 0x7f46ec1a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.124+0000 7f46eb400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec0750c0 0x7f46ec1a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.124+0000 7f46eb400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec0750c0 0x7f46ec1a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:38008/0 (socket says 172.21.15.120:38008) 2024-05-14T09:34:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.124+0000 7f46eb400640 1 -- 172.21.15.120:0/2831160123 learned_addr learned my addr 172.21.15.120:0/2831160123 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.124+0000 7f46ebe00640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec1103d0 0x7f46ec1a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.125+0000 7f46eaa00640 1 -- 172.21.15.120:0/2831160123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec1103d0 msgr2=0x7f46ec1a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.125+0000 7f46eaa00640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec1103d0 0x7f46ec1a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.125+0000 7f46eaa00640 1 -- 172.21.15.120:0/2831160123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec0750c0 msgr2=0x7f46ec1a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.125+0000 7f46eaa00640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec0750c0 0x7f46ec1a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.125+0000 7f46eaa00640 1 -- 172.21.15.120:0/2831160123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec107700 con 0x7f46ec075a10 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.125+0000 7f46eb400640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec0750c0 0x7f46ec1a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:34:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.125+0000 7f46eaa00640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec075a10 0x7f46ec1a0e40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c970 tx=0x7f46d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.126+0000 7f46e3e00640 1 -- 172.21.15.120:0/2831160123 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8007bb0 con 0x7f46ec075a10 2024-05-14T09:34:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.126+0000 7f46e3e00640 1 -- 172.21.15.120:0/2831160123 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46d8007d50 con 0x7f46ec075a10 2024-05-14T09:34:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.126+0000 7f46e3e00640 1 -- 172.21.15.120:0/2831160123 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d80186f0 con 0x7f46ec075a10 2024-05-14T09:34:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.127+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec1079f0 con 0x7f46ec075a10 2024-05-14T09:34:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.127+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec107f70 con 0x7f46ec075a10 2024-05-14T09:34:34.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.131+0000 7f46f95a9740 1 Processor -- start 2024-05-14T09:34:34.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.135+0000 7f46f95a9740 1 -- start start 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.135+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c80c61b0 0x5563c8468100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.135+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c8468680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.135+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80a54d0 0x5563c846f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.135+0000 7f46f95a9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5563c83cc550 con 0x5563c80c61b0 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.135+0000 7f46f95a9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563c8371bc0 con 0x5563c80a54d0 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.135+0000 7f46f95a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5563c83c8510 con 0x5563c809d2f0 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.136+0000 7f46eb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c8468680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.136+0000 7f46eb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c8468680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:42402/0 (socket says 172.21.15.120:42402) 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.136+0000 7f46eb400640 1 -- 172.21.15.120:0/1843562118 learned_addr learned my addr 172.21.15.120:0/1843562118 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.136+0000 7f46eb400640 1 -- 172.21.15.120:0/1843562118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80a54d0 msgr2=0x5563c846f580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:34:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.136+0000 7f46eb400640 1 --2- 172.21.15.120:0/1843562118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80a54d0 0x5563c846f580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.136+0000 7f46eb400640 1 -- 172.21.15.120:0/1843562118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c80c61b0 msgr2=0x5563c8468100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:34:34.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.136+0000 7f46eb400640 1 --2- 172.21.15.120:0/1843562118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c80c61b0 0x5563c8468100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.137+0000 7f46eb400640 1 -- 172.21.15.120:0/1843562118 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c80de210 con 0x5563c809d2f0 2024-05-14T09:34:34.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.137+0000 7f46eb400640 1 --2- 172.21.15.120:0/1843562118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c8468680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46e4031c20 tx=0x7f46e40099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7a822f8a09fce2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:34.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.138+0000 7f46e0c00640 1 -- 172.21.15.120:0/1843562118 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e405a070 con 0x5563c809d2f0 2024-05-14T09:34:34.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.138+0000 7f46e0c00640 1 -- 172.21.15.120:0/1843562118 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46e4036070 con 0x5563c809d2f0 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.138+0000 7f46e0c00640 1 -- 172.21.15.120:0/1843562118 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4030820 con 0x5563c809d2f0 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.139+0000 7f46f95a9740 1 -- 172.21.15.120:0/1843562118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 msgr2=0x5563c8468680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.139+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1843562118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c8468680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46e4031c20 tx=0x7f46e40099c0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.139+0000 7f46f95a9740 1 -- 172.21.15.120:0/1843562118 shutdown_connections 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.139+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1843562118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80a54d0 0x5563c846f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.139+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1843562118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c8468680 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.139+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1843562118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c80c61b0 0x5563c8468100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.139+0000 7f46f95a9740 1 -- 172.21.15.120:0/1843562118 >> 172.21.15.120:0/1843562118 conn(0x5563c80ba300 msgr2=0x5563c8463a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.140+0000 7f46e3e00640 1 -- 172.21.15.120:0/2831160123 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f46d800f450 con 0x7f46ec075a10 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.140+0000 7f46f95a9740 1 -- 172.21.15.120:0/1843562118 shutdown_connections 2024-05-14T09:34:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.140+0000 7f46f95a9740 1 -- 172.21.15.120:0/1843562118 wait complete. 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.142+0000 7f46e3e00640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f46d00b2770 0x7f46d00b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.142+0000 7f46f95a9740 1 -- start start 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.142+0000 7f46e3e00640 1 -- 172.21.15.120:0/2831160123 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f46d80e2510 con 0x7f46ec075a10 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.142+0000 7f46f95a9740 1 Processor -- start 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.142+0000 7f46ebe00640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f46d00b2770 0x7f46d00b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.143+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c8471d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.143+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8472240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.143+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c84791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.143+0000 7f46f95a9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5563c846ff70 con 0x5563c809d2f0 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.143+0000 7f46f95a9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5563c8385660 con 0x5563c80c61b0 2024-05-14T09:34:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.143+0000 7f46f95a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5563c84700f0 con 0x5563c8084d80 2024-05-14T09:34:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.144+0000 7f46f95a9740 10 client.0 _ll_register_callbacks cb 0x5563c834f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.144+0000 7f46eaa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8472240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.144+0000 7f46eaa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8472240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:38016/0 (socket says 172.21.15.120:38016) 2024-05-14T09:34:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.144+0000 7f46eaa00640 1 -- 172.21.15.120:0/1340708270 learned_addr learned my addr 172.21.15.120:0/1340708270 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.144+0000 7f46eb400640 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c8471d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.145+0000 7f46ebe00640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f46d00b2770 0x7f46d00b4c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x5563c84692d0 tx=0x7f46dc0090e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.145+0000 7f46ebe00640 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c84791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.145+0000 7f46eaa00640 1 -- 172.21.15.120:0/1340708270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 msgr2=0x5563c84791a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.145+0000 7f46eaa00640 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c84791a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.145+0000 7f46eaa00640 1 -- 172.21.15.120:0/1340708270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 msgr2=0x5563c8471d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.145+0000 7f46eaa00640 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c8471d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.145+0000 7f46eaa00640 1 -- 172.21.15.120:0/1340708270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c81aa620 con 0x5563c80c61b0 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.146+0000 7f46eaa00640 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8472240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46d80a9490 tx=0x7f46d80a9360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4057dd498fd86e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.146+0000 7f46d5600640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:34:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.146+0000 7f46d5600640 1 -- 172.21.15.120:0/1340708270 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d80a9790 con 0x5563c80c61b0 2024-05-14T09:34:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.146+0000 7f46d5600640 1 -- 172.21.15.120:0/1340708270 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f46d80e2230 con 0x5563c80c61b0 2024-05-14T09:34:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.146+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e4036070 con 0x5563c80c61b0 2024-05-14T09:34:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.147+0000 7f46d5600640 1 -- 172.21.15.120:0/1340708270 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f46d80adb40 con 0x5563c80c61b0 2024-05-14T09:34:34.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.147+0000 7f46f95a9740 10 client.36455 fetch_fsmap learned FSMap version 56 2024-05-14T09:34:34.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.147+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5563c847c1f0 con 0x5563c80c61b0 2024-05-14T09:34:34.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.147+0000 7f46d5600640 1 -- 172.21.15.120:0/1340708270 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46d80c7020 con 0x5563c80c61b0 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46d5600640 1 -- 172.21.15.120:0/1340708270 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f46d80911a0 con 0x5563c80c61b0 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46f95a9740 10 client.36455 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46f95a9740 10 client.36455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46f95a9740 20 client.36455 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c805a1c0 0x5563c847f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46f95a9740 4 client.36455 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563c83da160 con 0x5563c805a1c0 2024-05-14T09:34:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.148+0000 7f46eb400640 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c805a1c0 0x5563c847f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.150+0000 7f46eb400640 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c805a1c0 0x5563c847f8b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9ad588a206de74f server_cookie=1f5008a2018dc699 in_seq=0 out_seq=0 2024-05-14T09:34:34.150 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.150+0000 7f46d5600640 10 client.36455 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.151+0000 7f46d5600640 1 -- 172.21.15.120:0/1340708270 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5563c83da160 con 0x5563c805a1c0 2024-05-14T09:34:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.151+0000 7f46d5600640 10 client.36455 handle_command_reply: tid=0 2024-05-14T09:34:34.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.152+0000 7f46f95a9740 1 client.36455 shutdown 2024-05-14T09:34:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 msgr2=0x5563c8472240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8472240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46d80a9490 tx=0x7f46d80a9360 comp rx=0 tx=0).stop 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 shutdown_connections 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c805a1c0 0x5563c847f8b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c84791a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8472240 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 --2- 172.21.15.120:0/1340708270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c8471d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 >> 172.21.15.120:0/1340708270 conn(0x5563c80ba300 msgr2=0x5563c84669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46d5600640 0 client.36455 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 shutdown_connections 2024-05-14T09:34:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.153+0000 7f46f95a9740 1 -- 172.21.15.120:0/1340708270 wait complete. 2024-05-14T09:34:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.154+0000 7f46f95a9740 20 client.36455 trim_cache size 0 max 16384 2024-05-14T09:34:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.195+0000 7f46f95a9740 1 Processor -- start 2024-05-14T09:34:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.195+0000 7f46f95a9740 1 -- start start 2024-05-14T09:34:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c846c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c846c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8463450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46f95a9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec06eb70 con 0x5563c809d2f0 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46f95a9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec070770 con 0x5563c80c61b0 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46f95a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec06f240 con 0x5563c8084d80 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46ebe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8463450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46ebe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8463450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:38030/0 (socket says 172.21.15.120:38030) 2024-05-14T09:34:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46ebe00640 1 -- 172.21.15.120:0/2559886661 learned_addr learned my addr 172.21.15.120:0/2559886661 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46eb400640 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c846c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.196+0000 7f46eaa00640 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c846c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.197+0000 7f46ebe00640 1 -- 172.21.15.120:0/2559886661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 msgr2=0x5563c846c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.197+0000 7f46ebe00640 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c846c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.197+0000 7f46ebe00640 1 -- 172.21.15.120:0/2559886661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 msgr2=0x5563c846c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.197+0000 7f46ebe00640 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c846c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.197+0000 7f46ebe00640 1 -- 172.21.15.120:0/2559886661 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c846f940 con 0x5563c80c61b0 2024-05-14T09:34:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.199+0000 7f46ebe00640 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8463450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46dc006b90 tx=0x7f46dc011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4504816341845d02 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.201+0000 7f46d7e00640 1 -- 172.21.15.120:0/2559886661 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc01b040 con 0x5563c80c61b0 2024-05-14T09:34:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.201+0000 7f46d7e00640 1 -- 172.21.15.120:0/2559886661 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46dc026070 con 0x5563c80c61b0 2024-05-14T09:34:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.201+0000 7f46d7e00640 1 -- 172.21.15.120:0/2559886661 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc021e50 con 0x5563c80c61b0 2024-05-14T09:34:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 -- 172.21.15.120:0/2559886661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 msgr2=0x5563c8463450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8463450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46dc006b90 tx=0x7f46dc011000 comp rx=0 tx=0).stop 2024-05-14T09:34:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 -- 172.21.15.120:0/2559886661 shutdown_connections 2024-05-14T09:34:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c8463450 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c809d2f0 0x5563c846c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 --2- 172.21.15.120:0/2559886661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c8084d80 0x5563c846c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 -- 172.21.15.120:0/2559886661 >> 172.21.15.120:0/2559886661 conn(0x5563c80ba300 msgr2=0x5563c8468080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 -- 172.21.15.120:0/2559886661 shutdown_connections 2024-05-14T09:34:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.204+0000 7f46f95a9740 1 -- 172.21.15.120:0/2559886661 wait complete. 2024-05-14T09:34:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.207+0000 7f46f95a9740 1 -- start start 2024-05-14T09:34:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.207+0000 7f46f95a9740 1 Processor -- start 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c8084d80 0x5563c84754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c84759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46f95a9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c84e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46f95a9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec06ffe0 con 0x5563c8084d80 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46f95a9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec06f910 con 0x5563c80c61b0 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46f95a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec10fa00 con 0x5563c809d2f0 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46f95a9740 10 client.0 _ll_register_callbacks cb 0x7f46d800fcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46eaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c84759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46eaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c84759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:42416/0 (socket says 172.21.15.120:42416) 2024-05-14T09:34:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.208+0000 7f46eaa00640 1 -- 172.21.15.120:0/4152359290 learned_addr learned my addr 172.21.15.120:0/4152359290 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.209+0000 7f46eb400640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c8084d80 0x5563c84754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.209+0000 7f46ebe00640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c84e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.209+0000 7f46eaa00640 1 -- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 msgr2=0x5563c84e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.209+0000 7f46eaa00640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c84e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.209+0000 7f46eaa00640 1 -- 172.21.15.120:0/4152359290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c8084d80 msgr2=0x5563c84754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.210+0000 7f46eaa00640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c8084d80 0x5563c84754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.210+0000 7f46eaa00640 1 -- 172.21.15.120:0/4152359290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c84789b0 con 0x5563c809d2f0 2024-05-14T09:34:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.210+0000 7f46ebe00640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c84e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:34:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.210+0000 7f46eb400640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c8084d80 0x5563c84754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:34:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.210+0000 7f46eaa00640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c84759f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f46d80a6a00 tx=0x7f46d80a52c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35e163c1e936673 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.210+0000 7f46d5600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:34:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.211+0000 7f46d5600640 1 -- 172.21.15.120:0/4152359290 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d80a8f00 con 0x5563c809d2f0 2024-05-14T09:34:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.211+0000 7f46d5600640 1 -- 172.21.15.120:0/4152359290 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f46d80a5d80 con 0x5563c809d2f0 2024-05-14T09:34:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.211+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46dc026070 con 0x5563c809d2f0 2024-05-14T09:34:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.211+0000 7f46d5600640 1 -- 172.21.15.120:0/4152359290 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f46d80a9790 con 0x5563c809d2f0 2024-05-14T09:34:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.211+0000 7f46f95a9740 10 client.26509 fetch_fsmap learned FSMap version 56 2024-05-14T09:34:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.211+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5563c84e7070 con 0x5563c809d2f0 2024-05-14T09:34:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.212+0000 7f46d5600640 1 -- 172.21.15.120:0/4152359290 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46dc026070 con 0x5563c809d2f0 2024-05-14T09:34:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.213+0000 7f46d5600640 1 -- 172.21.15.120:0/4152359290 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f46d80bebe0 con 0x5563c809d2f0 2024-05-14T09:34:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.213+0000 7f46f95a9740 10 client.26509 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T09:34:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.213+0000 7f46f95a9740 10 client.26509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.213+0000 7f46f95a9740 20 client.26509 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.213+0000 7f46f95a9740 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c84e7910 0x5563c84e9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.213+0000 7f46f95a9740 4 client.26509 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:34:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.213+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5563c846bcf0 con 0x5563c84e7910 2024-05-14T09:34:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.215+0000 7f46eb400640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c84e7910 0x5563c84e9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.215+0000 7f46eb400640 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c84e7910 0x5563c84e9d30 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e7f59d33bc8fba3 server_cookie=476f4ed29b859bd in_seq=0 out_seq=0 2024-05-14T09:34:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.216+0000 7f46d5600640 10 client.26509 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.259+0000 7f46d5600640 1 -- 172.21.15.120:0/4152359290 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5563c846bcf0 con 0x5563c84e7910 2024-05-14T09:34:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.259+0000 7f46d5600640 10 client.26509 handle_command_reply: tid=0 2024-05-14T09:34:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.259+0000 7f46f95a9740 1 client.26509 shutdown 2024-05-14T09:34:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.260+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 msgr2=0x5563c84759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.260+0000 7f46f95a9740 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c84759f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f46d80a6a00 tx=0x7f46d80a52c0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.261+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 shutdown_connections 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.261+0000 7f46f95a9740 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5563c84e7910 0x5563c84e9d30 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.261+0000 7f46f95a9740 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5563c80c61b0 0x5563c84e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.261+0000 7f46f95a9740 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5563c809d2f0 0x5563c84759f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.261+0000 7f46f95a9740 1 --2- 172.21.15.120:0/4152359290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563c8084d80 0x5563c84754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.261+0000 7f46d5600640 0 client.26509 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.261+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 >> 172.21.15.120:0/4152359290 conn(0x5563c80ba300 msgr2=0x5563c8468080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.262+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 shutdown_connections 2024-05-14T09:34:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.262+0000 7f46f95a9740 1 -- 172.21.15.120:0/4152359290 wait complete. 2024-05-14T09:34:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.262+0000 7f46f95a9740 20 client.26509 trim_cache size 0 max 16384 2024-05-14T09:34:34.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:34:34.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:34:34.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:34:34.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:34:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.264+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f46d00b2770 msgr2=0x7f46d00b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.264+0000 7f46f2600640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f46d00b2770 0x7f46d00b4c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x5563c84692d0 tx=0x7f46dc0090e0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.264+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec075a10 msgr2=0x7f46ec1a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.264+0000 7f46f2600640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec075a10 0x7f46ec1a0e40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c970 tx=0x7f46d800ce30 comp rx=0 tx=0).stop 2024-05-14T09:34:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.265+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 shutdown_connections 2024-05-14T09:34:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.265+0000 7f46f2600640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f46d00b2770 0x7f46d00b4c80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.265+0000 7f46f2600640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec1103d0 0x7f46ec1a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.265+0000 7f46f2600640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46ec075a10 0x7f46ec1a0e40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.265+0000 7f46f2600640 1 --2- 172.21.15.120:0/2831160123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46ec0750c0 0x7f46ec1a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.265+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 >> 172.21.15.120:0/2831160123 conn(0x7f46ec0fee60 msgr2=0x7f46ec103230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.266+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 shutdown_connections 2024-05-14T09:34:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:34.266+0000 7f46f2600640 1 -- 172.21.15.120:0/2831160123 wait complete. 2024-05-14T09:34:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 420.0 s, 563.8 tps, lat 176.371 ms stddev 99.075 2024-05-14T09:34:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:34 smithi152 ceph-mon[34868]: pgmap v886: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 589 op/s 2024-05-14T09:34:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:34 smithi175 ceph-mon[35353]: pgmap v886: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 589 op/s 2024-05-14T09:34:34.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:34 smithi120 ceph-mon[31085]: pgmap v886: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 589 op/s 2024-05-14T09:34:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:36 smithi152 ceph-mon[34868]: pgmap v887: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 602 op/s 2024-05-14T09:34:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:36 smithi175 ceph-mon[35353]: pgmap v887: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 602 op/s 2024-05-14T09:34:36.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:36 smithi120 ceph-mon[31085]: pgmap v887: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 602 op/s 2024-05-14T09:34:37.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:37 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:34:37.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:37 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:34:37.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:37 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:34:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:38 smithi175 ceph-mon[35353]: pgmap v888: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-14T09:34:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:38 smithi120 ceph-mon[31085]: pgmap v888: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-14T09:34:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:38 smithi152 ceph-mon[34868]: pgmap v888: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-14T09:34:39.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 425.0 s, 721.3 tps, lat 139.129 ms stddev 47.414 2024-05-14T09:34:39.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:39 smithi120 ceph-mon[31085]: pgmap v889: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.5 MiB/s wr, 666 op/s 2024-05-14T09:34:39.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:39 smithi152 ceph-mon[34868]: pgmap v889: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.5 MiB/s wr, 666 op/s 2024-05-14T09:34:39.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:39 smithi175 ceph-mon[35353]: pgmap v889: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.5 MiB/s wr, 666 op/s 2024-05-14T09:34:41.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:41 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:34:41.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:41 smithi120 ceph-mon[31085]: pgmap v890: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.7 MiB/s wr, 615 op/s 2024-05-14T09:34:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:41 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:34:41.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:41 smithi152 ceph-mon[34868]: pgmap v890: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.7 MiB/s wr, 615 op/s 2024-05-14T09:34:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:41 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:34:41.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:41 smithi175 ceph-mon[35353]: pgmap v890: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.7 MiB/s wr, 615 op/s 2024-05-14T09:34:44.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:43 smithi152 ceph-mon[34868]: pgmap v891: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.1 MiB/s wr, 614 op/s 2024-05-14T09:34:44.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:43 smithi175 ceph-mon[35353]: pgmap v891: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.1 MiB/s wr, 614 op/s 2024-05-14T09:34:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 430.0 s, 658.8 tps, lat 151.327 ms stddev 62.337 2024-05-14T09:34:44.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:43 smithi120 ceph-mon[31085]: pgmap v891: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.1 MiB/s wr, 614 op/s 2024-05-14T09:34:46.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:45 smithi152 ceph-mon[34868]: pgmap v892: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.9 MiB/s wr, 685 op/s 2024-05-14T09:34:46.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:45 smithi175 ceph-mon[35353]: pgmap v892: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.9 MiB/s wr, 685 op/s 2024-05-14T09:34:46.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:45 smithi120 ceph-mon[31085]: pgmap v892: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.9 MiB/s wr, 685 op/s 2024-05-14T09:34:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:47 smithi152 ceph-mon[34868]: pgmap v893: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 667 op/s 2024-05-14T09:34:48.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:47 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:34:48.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:47 smithi175 ceph-mon[35353]: pgmap v893: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 667 op/s 2024-05-14T09:34:48.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:47 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:34:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 -- 172.21.15.120:0/145910486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8104740 msgr2=0x7f11d8106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 --2- 172.21.15.120:0/145910486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8104740 0x7f11d8106b60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009900 tx=0x7f11c802a410 comp rx=0 tx=0).stop 2024-05-14T09:34:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 -- 172.21.15.120:0/145910486 shutdown_connections 2024-05-14T09:34:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 --2- 172.21.15.120:0/145910486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11d8109a00 0x7f11d810be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 --2- 172.21.15.120:0/145910486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81070a0 0x7f11d81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 --2- 172.21.15.120:0/145910486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8104740 0x7f11d8106b60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 -- 172.21.15.120:0/145910486 >> 172.21.15.120:0/145910486 conn(0x7f11d80fdd40 msgr2=0x7f11d81001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.275+0000 7f11dde00640 1 -- 172.21.15.120:0/145910486 shutdown_connections 2024-05-14T09:34:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.276+0000 7f11dde00640 1 -- 172.21.15.120:0/145910486 wait complete. 2024-05-14T09:34:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.277+0000 7f11dde00640 1 Processor -- start 2024-05-14T09:34:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.277+0000 7f11dde00640 1 -- start start 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.277+0000 7f11dde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11d81070a0 0x7f11d8198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.277+0000 7f11dde00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8109a00 0x7f11d8198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.277+0000 7f11dde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81a5e50 0x7f11d81a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.278+0000 7f11dde00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f11d810f650 con 0x7f11d8109a00 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.278+0000 7f11d6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11d81070a0 0x7f11d8198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.278+0000 7f11dde00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11d810f4d0 con 0x7f11d81a5e50 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.278+0000 7f11dde00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11d810f7d0 con 0x7f11d81070a0 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.278+0000 7f11d7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81a5e50 0x7f11d81a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.278+0000 7f11d7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81a5e50 0x7f11d81a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42394/0 (socket says 172.21.15.120:42394) 2024-05-14T09:34:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.278+0000 7f11d7400640 1 -- 172.21.15.120:0/64550286 learned_addr learned my addr 172.21.15.120:0/64550286 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.279+0000 7f11d6000640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8109a00 0x7f11d8198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.279+0000 7f11d7400640 1 -- 172.21.15.120:0/64550286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11d81070a0 msgr2=0x7f11d8198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.279+0000 7f11d7400640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11d81070a0 0x7f11d8198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.279+0000 7f11d7400640 1 -- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8109a00 msgr2=0x7f11d8198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.279+0000 7f11d7400640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8109a00 0x7f11d8198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.279+0000 7f11d7400640 1 -- 172.21.15.120:0/64550286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d81a89a0 con 0x7f11d81a5e50 2024-05-14T09:34:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.279+0000 7f11d7400640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81a5e50 0x7f11d81a8270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11d000eb40 tx=0x7f11d000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.280+0000 7f11dca00640 1 -- 172.21.15.120:0/64550286 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0004b20 con 0x7f11d81a5e50 2024-05-14T09:34:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.280+0000 7f11dca00640 1 -- 172.21.15.120:0/64550286 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11d0004cc0 con 0x7f11d81a5e50 2024-05-14T09:34:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.280+0000 7f11dca00640 1 -- 172.21.15.120:0/64550286 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0010690 con 0x7f11d81a5e50 2024-05-14T09:34:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.280+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d81a8c90 con 0x7f11d81a5e50 2024-05-14T09:34:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.280+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d81a9190 con 0x7f11d81a5e50 2024-05-14T09:34:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.284+0000 7f11e4f65740 1 Processor -- start 2024-05-14T09:34:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.288+0000 7f11e4f65740 1 -- start start 2024-05-14T09:34:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.288+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 0x557b9156a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.288+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b9156a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.288+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b91571580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.288+0000 7f11e4f65740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557b914ce550 con 0x557b9119f2f0 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.288+0000 7f11e4f65740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557b91473bc0 con 0x557b911a74d0 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.288+0000 7f11e4f65740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557b914ca510 con 0x557b911c81b0 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b9156a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11dca00640 1 -- 172.21.15.120:0/64550286 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f11d0010830 con 0x7f11d81a5e50 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b9156a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46726/0 (socket says 172.21.15.120:46726) 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 -- 172.21.15.120:0/1046995707 learned_addr learned my addr 172.21.15.120:0/1046995707 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 -- 172.21.15.120:0/1046995707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 msgr2=0x557b9156a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 --2- 172.21.15.120:0/1046995707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 0x557b9156a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 -- 172.21.15.120:0/1046995707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 msgr2=0x557b91571580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:34:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 --2- 172.21.15.120:0/1046995707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b91571580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.289+0000 7f11d6a00640 1 -- 172.21.15.120:0/1046995707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b911e0210 con 0x557b9119f2f0 2024-05-14T09:34:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.290+0000 7f11d6a00640 1 --2- 172.21.15.120:0/1046995707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b9156a680 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005760 tx=0x7f11c8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea93df257df2ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.290+0000 7f11c3e00640 1 -- 172.21.15.120:0/1046995707 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8040070 con 0x557b9119f2f0 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.290+0000 7f11c3e00640 1 -- 172.21.15.120:0/1046995707 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c8004440 con 0x557b9119f2f0 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.290+0000 7f11c3e00640 1 -- 172.21.15.120:0/1046995707 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8035030 con 0x557b9119f2f0 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.291+0000 7f11e4f65740 1 -- 172.21.15.120:0/1046995707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 msgr2=0x557b9156a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.291+0000 7f11e4f65740 1 --2- 172.21.15.120:0/1046995707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b9156a680 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005760 tx=0x7f11c8009680 comp rx=0 tx=0).stop 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11dca00640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f11bc0b28e0 0x7f11bc0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11e4f65740 1 -- 172.21.15.120:0/1046995707 shutdown_connections 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11e4f65740 1 --2- 172.21.15.120:0/1046995707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b91571580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11e4f65740 1 --2- 172.21.15.120:0/1046995707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b9156a680 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11e4f65740 1 --2- 172.21.15.120:0/1046995707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 0x557b9156a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11e4f65740 1 -- 172.21.15.120:0/1046995707 >> 172.21.15.120:0/1046995707 conn(0x557b911bc300 msgr2=0x557b91565a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11dca00640 1 -- 172.21.15.120:0/64550286 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f11d00e2e70 con 0x7f11d81a5e50 2024-05-14T09:34:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11d6000640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f11bc0b28e0 0x7f11bc0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.292+0000 7f11e4f65740 1 -- 172.21.15.120:0/1046995707 shutdown_connections 2024-05-14T09:34:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.294+0000 7f11e4f65740 1 -- 172.21.15.120:0/1046995707 wait complete. 2024-05-14T09:34:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.294+0000 7f11d6000640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f11bc0b28e0 0x7f11bc0b4df0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x557b9156b2d0 tx=0x7f11c40046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.295+0000 7f11e4f65740 1 -- start start 2024-05-14T09:34:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.295+0000 7f11e4f65740 1 Processor -- start 2024-05-14T09:34:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.297+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b91584b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.297+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b915850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 0x557b9158c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11e4f65740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557b91582f80 con 0x557b9119f2f0 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11e4f65740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557b91487660 con 0x557b911a74d0 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11e4f65740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557b91583100 con 0x557b911c81b0 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11d6a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b91584b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11d6a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b91584b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46738/0 (socket says 172.21.15.120:46738) 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11d6a00640 1 -- 172.21.15.120:0/2023036210 learned_addr learned my addr 172.21.15.120:0/2023036210 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11e4f65740 10 client.0 _ll_register_callbacks cb 0x557b91451400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:48.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.298+0000 7f11d6000640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b915850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.299+0000 7f11d7400640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 0x557b9158c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.300+0000 7f11d6a00640 1 -- 172.21.15.120:0/2023036210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 msgr2=0x557b9158c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.300+0000 7f11d6a00640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 0x557b9158c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.300+0000 7f11d6a00640 1 -- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 msgr2=0x557b915850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.300+0000 7f11d6a00640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b915850b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.300+0000 7f11d6a00640 1 -- 172.21.15.120:0/2023036210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b912ac620 con 0x557b9119f2f0 2024-05-14T09:34:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.301+0000 7f11d6000640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b915850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:34:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.301+0000 7f11c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:34:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.302+0000 7f11d6a00640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b91584b70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005f70 tx=0x7f11c8003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f3688b52dbf0f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.302+0000 7f11c0c00640 1 -- 172.21.15.120:0/2023036210 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8040030 con 0x557b9119f2f0 2024-05-14T09:34:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.302+0000 7f11c0c00640 1 -- 172.21.15.120:0/2023036210 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f11c8003c00 con 0x557b9119f2f0 2024-05-14T09:34:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.302+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c8004440 con 0x557b9119f2f0 2024-05-14T09:34:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.303+0000 7f11c0c00640 1 -- 172.21.15.120:0/2023036210 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f11c8057050 con 0x557b9119f2f0 2024-05-14T09:34:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.303+0000 7f11e4f65740 10 client.16962 fetch_fsmap learned FSMap version 58 2024-05-14T09:34:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.303+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x557b9158ef40 con 0x557b9119f2f0 2024-05-14T09:34:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.304+0000 7f11c0c00640 1 -- 172.21.15.120:0/2023036210 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c8004440 con 0x557b9119f2f0 2024-05-14T09:34:48.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11c0c00640 1 -- 172.21.15.120:0/2023036210 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 58) ==== 8394+0+0 (secure 0 0 0) 0x7f11c803a040 con 0x557b9119f2f0 2024-05-14T09:34:48.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11e4f65740 10 client.16962 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T09:34:48.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11e4f65740 10 client.16962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:48.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11e4f65740 20 client.16962 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:48.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b91186d80 0x557b915923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11e4f65740 4 client.16962 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:34:48.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b914dc160 con 0x557b91186d80 2024-05-14T09:34:48.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.305+0000 7f11d6000640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b91186d80 0x557b915923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.307+0000 7f11d6000640 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b91186d80 0x557b915923b0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4109182ef402123f server_cookie=7549528e6c76206 in_seq=0 out_seq=0 2024-05-14T09:34:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.307+0000 7f11c0c00640 10 client.16962 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.308+0000 7f11c0c00640 1 -- 172.21.15.120:0/2023036210 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557b914dc160 con 0x557b91186d80 2024-05-14T09:34:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.308+0000 7f11c0c00640 10 client.16962 handle_command_reply: tid=0 2024-05-14T09:34:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.308+0000 7f11e4f65740 1 client.16962 shutdown 2024-05-14T09:34:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.309+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 msgr2=0x557b91584b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.309+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b91584b70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005f70 tx=0x7f11c8003800 comp rx=0 tx=0).stop 2024-05-14T09:34:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.310+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 shutdown_connections 2024-05-14T09:34:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.310+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b91186d80 0x557b915923b0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.310+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911c81b0 0x557b9158c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.310+0000 7f11c0c00640 0 client.16962 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.310+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b911a74d0 0x557b915850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.310+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2023036210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b9119f2f0 0x557b91584b70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.310+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 >> 172.21.15.120:0/2023036210 conn(0x557b911bc300 msgr2=0x557b915689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.311+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 shutdown_connections 2024-05-14T09:34:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.311+0000 7f11e4f65740 1 -- 172.21.15.120:0/2023036210 wait complete. 2024-05-14T09:34:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.311+0000 7f11e4f65740 20 client.16962 trim_cache size 0 max 16384 2024-05-14T09:34:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.348+0000 7f11e4f65740 1 Processor -- start 2024-05-14T09:34:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.348+0000 7f11e4f65740 1 -- start start 2024-05-14T09:34:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.349+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b91186d80 0x557b91565b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.349+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b9119f2f0 0x557b91564710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.349+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b911a74d0 0x557b9158bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.349+0000 7f11e4f65740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f11d81aad80 con 0x557b911a74d0 2024-05-14T09:34:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.349+0000 7f11e4f65740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11d81ac9e0 con 0x557b91186d80 2024-05-14T09:34:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.349+0000 7f11e4f65740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11d81ab450 con 0x557b9119f2f0 2024-05-14T09:34:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.349+0000 7f11d7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b911a74d0 0x557b9158bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b911a74d0 0x557b9158bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46744/0 (socket says 172.21.15.120:46744) 2024-05-14T09:34:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d7400640 1 -- 172.21.15.120:0/2851307900 learned_addr learned my addr 172.21.15.120:0/2851307900 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d6000640 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b9119f2f0 0x557b91564710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d6a00640 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b91186d80 0x557b91565b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d7400640 1 -- 172.21.15.120:0/2851307900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b9119f2f0 msgr2=0x557b91564710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d7400640 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b9119f2f0 0x557b91564710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d7400640 1 -- 172.21.15.120:0/2851307900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b91186d80 msgr2=0x557b91565b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d7400640 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b91186d80 0x557b91565b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d7400640 1 -- 172.21.15.120:0/2851307900 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b91561280 con 0x557b911a74d0 2024-05-14T09:34:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.350+0000 7f11d6a00640 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b91186d80 0x557b91565b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:34:48.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.351+0000 7f11d7400640 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b911a74d0 0x557b9158bf30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f11d00a7300 tx=0x7f11d00a9c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6303ad2200aa1fa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:48.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.352+0000 7f11c3400640 1 -- 172.21.15.120:0/2851307900 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d00c3020 con 0x557b911a74d0 2024-05-14T09:34:48.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.352+0000 7f11c3400640 1 -- 172.21.15.120:0/2851307900 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11d00ae440 con 0x557b911a74d0 2024-05-14T09:34:48.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.352+0000 7f11c3400640 1 -- 172.21.15.120:0/2851307900 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d00b2a60 con 0x557b911a74d0 2024-05-14T09:34:48.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.354+0000 7f11e4f65740 1 -- 172.21.15.120:0/2851307900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b911a74d0 msgr2=0x557b9158bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.354+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b911a74d0 0x557b9158bf30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f11d00a7300 tx=0x7f11d00a9c60 comp rx=0 tx=0).stop 2024-05-14T09:34:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.355+0000 7f11e4f65740 1 -- 172.21.15.120:0/2851307900 shutdown_connections 2024-05-14T09:34:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.355+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b911a74d0 0x557b9158bf30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.355+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b9119f2f0 0x557b91564710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.355+0000 7f11e4f65740 1 --2- 172.21.15.120:0/2851307900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b91186d80 0x557b91565b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.355+0000 7f11e4f65740 1 -- 172.21.15.120:0/2851307900 >> 172.21.15.120:0/2851307900 conn(0x557b911bc300 msgr2=0x557b91564000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.356+0000 7f11e4f65740 1 -- 172.21.15.120:0/2851307900 shutdown_connections 2024-05-14T09:34:48.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.356+0000 7f11e4f65740 1 -- 172.21.15.120:0/2851307900 wait complete. 2024-05-14T09:34:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.358+0000 7f11e4f65740 1 -- start start 2024-05-14T09:34:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.358+0000 7f11e4f65740 1 Processor -- start 2024-05-14T09:34:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.361+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b91186d80 0x557b91589440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.361+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b9119f2f0 0x557b91589980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.361+0000 7f11e4f65740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911a74d0 0x557b915f8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.361+0000 7f11e4f65740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f11d81ac250 con 0x557b91186d80 2024-05-14T09:34:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.361+0000 7f11e4f65740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11d81abb80 con 0x557b9119f2f0 2024-05-14T09:34:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.361+0000 7f11e4f65740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11d80748c0 con 0x557b911a74d0 2024-05-14T09:34:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.361+0000 7f11e4f65740 10 client.0 _ll_register_callbacks cb 0x7f11d00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:34:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.362+0000 7f11d6a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b91186d80 0x557b91589440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.362+0000 7f11d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911a74d0 0x557b915f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.362+0000 7f11d6a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b91186d80 0x557b91589440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46760/0 (socket says 172.21.15.120:46760) 2024-05-14T09:34:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.362+0000 7f11d6a00640 1 -- 172.21.15.120:0/3032034333 learned_addr learned my addr 172.21.15.120:0/3032034333 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:34:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.362+0000 7f11d6000640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b9119f2f0 0x557b91589980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.363+0000 7f11d6a00640 1 -- 172.21.15.120:0/3032034333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911a74d0 msgr2=0x557b915f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.363+0000 7f11d6a00640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911a74d0 0x557b915f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.363+0000 7f11d6a00640 1 -- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b9119f2f0 msgr2=0x557b91589980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:34:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.363+0000 7f11d6a00640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b9119f2f0 0x557b91589980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.364+0000 7f11d6a00640 1 -- 172.21.15.120:0/3032034333 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9158c8d0 con 0x557b91186d80 2024-05-14T09:34:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.364+0000 7f11d7400640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911a74d0 0x557b915f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:34:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.364+0000 7f11d6000640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b9119f2f0 0x557b91589980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:34:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.365+0000 7f11d6a00640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b91186d80 0x557b91589440 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f11c803c7a0 tx=0x7f11c80058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d735bc46b7729e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:34:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.366+0000 7f11c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:34:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.366+0000 7f11c0c00640 1 -- 172.21.15.120:0/3032034333 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8040040 con 0x557b91186d80 2024-05-14T09:34:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.366+0000 7f11c0c00640 1 -- 172.21.15.120:0/3032034333 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f11c803c990 con 0x557b91186d80 2024-05-14T09:34:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.366+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11d00ae440 con 0x557b91186d80 2024-05-14T09:34:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.367+0000 7f11c0c00640 1 -- 172.21.15.120:0/3032034333 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f11c8035040 con 0x557b91186d80 2024-05-14T09:34:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.367+0000 7f11e4f65740 10 client.16968 fetch_fsmap learned FSMap version 58 2024-05-14T09:34:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.367+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x557b9160aae0 con 0x557b91186d80 2024-05-14T09:34:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.367+0000 7f11c0c00640 1 -- 172.21.15.120:0/3032034333 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11d00ae440 con 0x557b91186d80 2024-05-14T09:34:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.368+0000 7f11c0c00640 1 -- 172.21.15.120:0/3032034333 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 58) ==== 8394+0+0 (secure 0 0 0) 0x7f11c8031990 con 0x557b91186d80 2024-05-14T09:34:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.368+0000 7f11e4f65740 10 client.16968 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T09:34:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.368+0000 7f11e4f65740 10 client.16968 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:34:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.368+0000 7f11e4f65740 20 client.16968 populate_metadata read hostname 'smithi120' 2024-05-14T09:34:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.368+0000 7f11e4f65740 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b911c81b0 0x557b9160d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:34:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.368+0000 7f11e4f65740 4 client.16968 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:34:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.368+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b914d5fd0 con 0x557b911c81b0 2024-05-14T09:34:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.369+0000 7f11d6000640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b911c81b0 0x557b9160d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:34:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.370+0000 7f11d6000640 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b911c81b0 0x557b9160d590 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4955f5942f850a9a server_cookie=811ec6db92aa1df0 in_seq=0 out_seq=0 2024-05-14T09:34:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.370+0000 7f11c0c00640 10 client.16968 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:48.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:47 smithi120 ceph-mon[31085]: pgmap v893: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 667 op/s 2024-05-14T09:34:48.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:47 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:34:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.405+0000 7f11c0c00640 1 -- 172.21.15.120:0/3032034333 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b914d5fd0 con 0x557b911c81b0 2024-05-14T09:34:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.405+0000 7f11c0c00640 10 client.16968 handle_command_reply: tid=0 2024-05-14T09:34:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.405+0000 7f11e4f65740 1 client.16968 shutdown 2024-05-14T09:34:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.406+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b91186d80 msgr2=0x557b91589440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.406+0000 7f11e4f65740 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b91186d80 0x557b91589440 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f11c803c7a0 tx=0x7f11c80058f0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 shutdown_connections 2024-05-14T09:34:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11e4f65740 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557b911c81b0 0x557b9160d590 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11e4f65740 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b911a74d0 0x557b915f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11e4f65740 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557b9119f2f0 0x557b91589980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11e4f65740 1 --2- 172.21.15.120:0/3032034333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557b91186d80 0x557b91589440 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 >> 172.21.15.120:0/3032034333 conn(0x557b911bc300 msgr2=0x557b91565800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11c0c00640 0 client.16968 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:34:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.407+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 shutdown_connections 2024-05-14T09:34:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.408+0000 7f11e4f65740 1 -- 172.21.15.120:0/3032034333 wait complete. 2024-05-14T09:34:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.408+0000 7f11e4f65740 20 client.16968 trim_cache size 0 max 16384 2024-05-14T09:34:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:34:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:34:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:34:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:34:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.410+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f11bc0b28e0 msgr2=0x7f11bc0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.410+0000 7f11dde00640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f11bc0b28e0 0x7f11bc0b4df0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x557b9156b2d0 tx=0x7f11c40046c0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.410+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81a5e50 msgr2=0x7f11d81a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:34:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.410+0000 7f11dde00640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81a5e50 0x7f11d81a8270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11d000eb40 tx=0x7f11d000c2d0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.410+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 shutdown_connections 2024-05-14T09:34:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.411+0000 7f11dde00640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f11bc0b28e0 0x7f11bc0b4df0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.411+0000 7f11dde00640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d81a5e50 0x7f11d81a8270 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.411+0000 7f11dde00640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d8109a00 0x7f11d8198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.411+0000 7f11dde00640 1 --2- 172.21.15.120:0/64550286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11d81070a0 0x7f11d8198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:34:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.411+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 >> 172.21.15.120:0/64550286 conn(0x7f11d80fdd40 msgr2=0x7f11d8102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:34:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.413+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 shutdown_connections 2024-05-14T09:34:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:34:48.413+0000 7f11dde00640 1 -- 172.21.15.120:0/64550286 wait complete. 2024-05-14T09:34:49.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 435.0 s, 619.2 tps, lat 162.618 ms stddev 67.162 2024-05-14T09:34:50.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:49 smithi152 ceph-mon[34868]: pgmap v894: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 715 op/s 2024-05-14T09:34:50.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:49 smithi175 ceph-mon[35353]: pgmap v894: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 715 op/s 2024-05-14T09:34:50.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:49 smithi120 ceph-mon[31085]: pgmap v894: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 715 op/s 2024-05-14T09:34:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:34:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:34:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:34:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:34:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:34:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:34:51.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:34:51.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:34:51.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:34:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:51 smithi152 ceph-mon[34868]: pgmap v895: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.9 MiB/s wr, 674 op/s 2024-05-14T09:34:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:51 smithi175 ceph-mon[35353]: pgmap v895: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.9 MiB/s wr, 674 op/s 2024-05-14T09:34:52.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:51 smithi120 ceph-mon[31085]: pgmap v895: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.9 MiB/s wr, 674 op/s 2024-05-14T09:34:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:53 smithi152 ceph-mon[34868]: pgmap v896: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.6 MiB/s wr, 659 op/s 2024-05-14T09:34:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:53 smithi175 ceph-mon[35353]: pgmap v896: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.6 MiB/s wr, 659 op/s 2024-05-14T09:34:54.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 440.0 s, 724.0 tps, lat 137.498 ms stddev 49.851 2024-05-14T09:34:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:53 smithi120 ceph-mon[31085]: pgmap v896: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.6 MiB/s wr, 659 op/s 2024-05-14T09:34:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:55 smithi152 ceph-mon[34868]: pgmap v897: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 723 op/s 2024-05-14T09:34:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:55 smithi175 ceph-mon[35353]: pgmap v897: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 723 op/s 2024-05-14T09:34:56.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:55 smithi120 ceph-mon[31085]: pgmap v897: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 723 op/s 2024-05-14T09:34:58.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:57 smithi152 ceph-mon[34868]: pgmap v898: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 678 op/s 2024-05-14T09:34:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:57 smithi175 ceph-mon[35353]: pgmap v898: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 678 op/s 2024-05-14T09:34:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:57 smithi120 ceph-mon[31085]: pgmap v898: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 678 op/s 2024-05-14T09:34:59.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 445.0 s, 729.2 tps, lat 137.299 ms stddev 53.554 2024-05-14T09:35:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:34:59 smithi175 ceph-mon[35353]: pgmap v899: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 10 MiB/s wr, 698 op/s 2024-05-14T09:35:00.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:34:59 smithi120 ceph-mon[31085]: pgmap v899: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 10 MiB/s wr, 698 op/s 2024-05-14T09:35:00.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:34:59 smithi152 ceph-mon[34868]: pgmap v899: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 10 MiB/s wr, 698 op/s 2024-05-14T09:35:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.873+0000 7f9d52600640 1 -- 172.21.15.120:0/1065962336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c110190 msgr2=0x7f9d4c1125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.873+0000 7f9d52600640 1 --2- 172.21.15.120:0/1065962336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c110190 0x7f9d4c1125b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009be0 tx=0x7f9d4402a6c0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.874+0000 7f9d52600640 1 -- 172.21.15.120:0/1065962336 shutdown_connections 2024-05-14T09:35:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.874+0000 7f9d52600640 1 --2- 172.21.15.120:0/1065962336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c110190 0x7f9d4c1125b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.874+0000 7f9d52600640 1 --2- 172.21.15.120:0/1065962336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d4c10b490 0x7f9d4c10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.874+0000 7f9d52600640 1 --2- 172.21.15.120:0/1065962336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4c10a450 0x7f9d4c10af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.874+0000 7f9d52600640 1 -- 172.21.15.120:0/1065962336 >> 172.21.15.120:0/1065962336 conn(0x7f9d4c078f10 msgr2=0x7f9d4c07b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.874+0000 7f9d52600640 1 -- 172.21.15.120:0/1065962336 shutdown_connections 2024-05-14T09:35:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.874+0000 7f9d52600640 1 -- 172.21.15.120:0/1065962336 wait complete. 2024-05-14T09:35:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.875+0000 7f9d52600640 1 Processor -- start 2024-05-14T09:35:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.876+0000 7f9d52600640 1 -- start start 2024-05-14T09:35:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.876+0000 7f9d52600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d4c10a450 0x7f9d4c1a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.876+0000 7f9d52600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c10b490 0x7f9d4c1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.876+0000 7f9d52600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4c110190 0x7f9d4c1a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.876+0000 7f9d52600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c115c50 con 0x7f9d4c10b490 2024-05-14T09:35:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.876+0000 7f9d52600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c115ad0 con 0x7f9d4c10a450 2024-05-14T09:35:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.876+0000 7f9d52600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c115dd0 con 0x7f9d4c110190 2024-05-14T09:35:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c10b490 0x7f9d4c1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c10b490 0x7f9d4c1a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54028/0 (socket says 172.21.15.120:54028) 2024-05-14T09:35:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 -- 172.21.15.120:0/3785102623 learned_addr learned my addr 172.21.15.120:0/3785102623 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4b400640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d4c10a450 0x7f9d4c1a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4be00640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4c110190 0x7f9d4c1a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 -- 172.21.15.120:0/3785102623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4c110190 msgr2=0x7f9d4c1a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4c110190 0x7f9d4c1a7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 -- 172.21.15.120:0/3785102623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d4c10a450 msgr2=0x7f9d4c1a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d4c10a450 0x7f9d4c1a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.877+0000 7f9d4aa00640 1 -- 172.21.15.120:0/3785102623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c1a83f0 con 0x7f9d4c10b490 2024-05-14T09:35:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.878+0000 7f9d4aa00640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c10b490 0x7f9d4c1a0df0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00d950 tx=0x7f9d3c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.879+0000 7f9d43e00640 1 -- 172.21.15.120:0/3785102623 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c017070 con 0x7f9d4c10b490 2024-05-14T09:35:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.879+0000 7f9d43e00640 1 -- 172.21.15.120:0/3785102623 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d3c00de80 con 0x7f9d4c10b490 2024-05-14T09:35:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.879+0000 7f9d43e00640 1 -- 172.21.15.120:0/3785102623 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00f620 con 0x7f9d4c10b490 2024-05-14T09:35:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.879+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c1a86e0 con 0x7f9d4c10b490 2024-05-14T09:35:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.879+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4c1a8c30 con 0x7f9d4c10b490 2024-05-14T09:35:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.887+0000 7f9d595ae740 1 Processor -- start 2024-05-14T09:35:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.888+0000 7f9d595ae740 1 -- start start 2024-05-14T09:35:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.888+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37671100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.888+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37671680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.888+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372ae4d0 0x560d37678580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.888+0000 7f9d595ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560d375d5550 con 0x560d372ae4d0 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.888+0000 7f9d595ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560d3757abc0 con 0x560d372a62f0 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.889+0000 7f9d595ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d375d1510 con 0x560d372cf1b0 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.889+0000 7f9d43e00640 1 -- 172.21.15.120:0/3785102623 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f9d3c009c30 con 0x7f9d4c10b490 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.889+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37671100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.889+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37671100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37842/0 (socket says 172.21.15.120:37842) 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.889+0000 7f9d4be00640 1 -- 172.21.15.120:0/3227673878 learned_addr learned my addr 172.21.15.120:0/3227673878 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.891+0000 7f9d4b400640 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37671680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.891+0000 7f9d4aa00640 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372ae4d0 0x560d37678580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.892+0000 7f9d4be00640 1 -- 172.21.15.120:0/3227673878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 msgr2=0x560d37671680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.892+0000 7f9d4be00640 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37671680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.892+0000 7f9d4be00640 1 -- 172.21.15.120:0/3227673878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372ae4d0 msgr2=0x560d37678580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.892+0000 7f9d4be00640 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372ae4d0 0x560d37678580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.892+0000 7f9d4be00640 1 -- 172.21.15.120:0/3227673878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d372e7210 con 0x560d372cf1b0 2024-05-14T09:35:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.893+0000 7f9d43e00640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d300b2970 0x7f9d300b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.893+0000 7f9d43e00640 1 -- 172.21.15.120:0/3785102623 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9d3c0e1a60 con 0x7f9d4c10b490 2024-05-14T09:35:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.893+0000 7f9d4b400640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d300b2970 0x7f9d300b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.893+0000 7f9d4be00640 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37671100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006010 tx=0x7f9d44009390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd620040e4792bd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.894+0000 7f9d40c00640 1 -- 172.21.15.120:0/3227673878 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44041020 con 0x560d372cf1b0 2024-05-14T09:35:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.894+0000 7f9d40c00640 1 -- 172.21.15.120:0/3227673878 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d44037040 con 0x560d372cf1b0 2024-05-14T09:35:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.894+0000 7f9d40c00640 1 -- 172.21.15.120:0/3227673878 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44036070 con 0x560d372cf1b0 2024-05-14T09:35:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.894+0000 7f9d4b400640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d300b2970 0x7f9d300b4e80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x560d376724e0 tx=0x7f9d34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.895+0000 7f9d595ae740 1 -- 172.21.15.120:0/3227673878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 msgr2=0x560d37671100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.895+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37671100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006010 tx=0x7f9d44009390 comp rx=0 tx=0).stop 2024-05-14T09:35:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.896+0000 7f9d595ae740 1 -- 172.21.15.120:0/3227673878 shutdown_connections 2024-05-14T09:35:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.896+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372ae4d0 0x560d37678580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.896+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37671680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.896+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3227673878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37671100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.896+0000 7f9d595ae740 1 -- 172.21.15.120:0/3227673878 >> 172.21.15.120:0/3227673878 conn(0x560d372c3300 msgr2=0x560d3766ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.896+0000 7f9d595ae740 1 -- 172.21.15.120:0/3227673878 shutdown_connections 2024-05-14T09:35:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.897+0000 7f9d595ae740 1 -- 172.21.15.120:0/3227673878 wait complete. 2024-05-14T09:35:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.897+0000 7f9d595ae740 1 -- start start 2024-05-14T09:35:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.898+0000 7f9d595ae740 1 Processor -- start 2024-05-14T09:35:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.899+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372a62f0 0x560d3768bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.899+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.899+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37693130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.899+0000 7f9d4b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372a62f0 0x560d3768bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.900+0000 7f9d4aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.900+0000 7f9d4aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48580/0 (socket says 172.21.15.120:48580) 2024-05-14T09:35:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.900+0000 7f9d4b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372a62f0 0x560d3768bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54052/0 (socket says 172.21.15.120:54052) 2024-05-14T09:35:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.901+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37693130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.901+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37693130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37858/0 (socket says 172.21.15.120:37858) 2024-05-14T09:35:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.901+0000 7f9d595ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560d37689f80 con 0x560d372a62f0 2024-05-14T09:35:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.901+0000 7f9d595ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560d3758e660 con 0x560d372ae4d0 2024-05-14T09:35:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.901+0000 7f9d595ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d3768a100 con 0x560d372cf1b0 2024-05-14T09:35:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.901+0000 7f9d595ae740 10 client.0 _ll_register_callbacks cb 0x560d37558400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.901+0000 7f9d4aa00640 1 -- 172.21.15.120:0/4280043226 learned_addr learned my addr 172.21.15.120:0/4280043226 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.902+0000 7f9d4be00640 1 -- 172.21.15.120:0/4280043226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 msgr2=0x560d3768c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.902+0000 7f9d4be00640 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.902+0000 7f9d4be00640 1 -- 172.21.15.120:0/4280043226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372a62f0 msgr2=0x560d3768bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.902+0000 7f9d4be00640 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372a62f0 0x560d3768bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.902+0000 7f9d4be00640 1 -- 172.21.15.120:0/4280043226 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d373b3620 con 0x560d372cf1b0 2024-05-14T09:35:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.902+0000 7f9d4b400640 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372a62f0 0x560d3768bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:35:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.903+0000 7f9d4be00640 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37693130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009420 tx=0x7f9d44003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ee41d1d68dd6e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.903+0000 7f9d39600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:35:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.903+0000 7f9d39600640 1 -- 172.21.15.120:0/4280043226 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44036070 con 0x560d372cf1b0 2024-05-14T09:35:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.903+0000 7f9d39600640 1 -- 172.21.15.120:0/4280043226 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9d44030b60 con 0x560d372cf1b0 2024-05-14T09:35:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.904+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d44037040 con 0x560d372cf1b0 2024-05-14T09:35:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.904+0000 7f9d39600640 1 -- 172.21.15.120:0/4280043226 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f9d44058050 con 0x560d372cf1b0 2024-05-14T09:35:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.904+0000 7f9d595ae740 10 client.26530 fetch_fsmap learned FSMap version 59 2024-05-14T09:35:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.904+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x560d37689fd0 con 0x560d372cf1b0 2024-05-14T09:35:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.905+0000 7f9d39600640 1 -- 172.21.15.120:0/4280043226 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d44037040 con 0x560d372cf1b0 2024-05-14T09:35:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.906+0000 7f9d39600640 1 -- 172.21.15.120:0/4280043226 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) ==== 8402+0+0 (secure 0 0 0) 0x7f9d440045d0 con 0x560d372cf1b0 2024-05-14T09:35:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.906+0000 7f9d595ae740 10 client.26530 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T09:35:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.906+0000 7f9d595ae740 10 client.26530 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.906+0000 7f9d595ae740 20 client.26530 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.906+0000 7f9d595ae740 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d3728dd80 0x560d376992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.906+0000 7f9d595ae740 4 client.26530 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:35:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.906+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d375e3160 con 0x560d3728dd80 2024-05-14T09:35:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.907+0000 7f9d4b400640 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d3728dd80 0x560d376992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.908+0000 7f9d4b400640 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d3728dd80 0x560d376992f0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daf46395599dbacc server_cookie=badc48b4bce3ecf in_seq=0 out_seq=0 2024-05-14T09:35:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.908+0000 7f9d39600640 10 client.26530 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.909+0000 7f9d39600640 1 -- 172.21.15.120:0/4280043226 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560d375e3160 con 0x560d3728dd80 2024-05-14T09:35:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d39600640 10 client.26530 handle_command_reply: tid=0 2024-05-14T09:35:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d595ae740 1 client.26530 shutdown 2024-05-14T09:35:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 msgr2=0x560d37693130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d595ae740 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37693130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009420 tx=0x7f9d44003970 comp rx=0 tx=0).stop 2024-05-14T09:35:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 shutdown_connections 2024-05-14T09:35:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d595ae740 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d3728dd80 0x560d376992f0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d595ae740 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372cf1b0 0x560d37693130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d39600640 0 client.26530 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.910+0000 7f9d595ae740 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.911+0000 7f9d595ae740 1 --2- 172.21.15.120:0/4280043226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372a62f0 0x560d3768bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.911+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 >> 172.21.15.120:0/4280043226 conn(0x560d372c3300 msgr2=0x560d3766f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.911+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 shutdown_connections 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.911+0000 7f9d595ae740 1 -- 172.21.15.120:0/4280043226 wait complete. 2024-05-14T09:35:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.911+0000 7f9d595ae740 20 client.26530 trim_cache size 0 max 16384 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 Processor -- start 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 -- start start 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d3728dd80 0x560d3768bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37693050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c1aa720 con 0x560d3728dd80 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c1ac3e0 con 0x560d372a62f0 2024-05-14T09:35:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.938+0000 7f9d595ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c1aadf0 con 0x560d372ae4d0 2024-05-14T09:35:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.939+0000 7f9d4b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d3728dd80 0x560d3768bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.939+0000 7f9d4b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d3728dd80 0x560d3768bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54066/0 (socket says 172.21.15.120:54066) 2024-05-14T09:35:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.939+0000 7f9d4b400640 1 -- 172.21.15.120:0/3748554778 learned_addr learned my addr 172.21.15.120:0/3748554778 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.939+0000 7f9d4be00640 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.940+0000 7f9d4aa00640 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37693050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.940+0000 7f9d4b400640 1 -- 172.21.15.120:0/3748554778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372ae4d0 msgr2=0x560d3768c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.940+0000 7f9d4b400640 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.940+0000 7f9d4b400640 1 -- 172.21.15.120:0/3748554778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 msgr2=0x560d37693050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.940+0000 7f9d4b400640 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37693050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.940+0000 7f9d4b400640 1 -- 172.21.15.120:0/3748554778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3766c250 con 0x560d3728dd80 2024-05-14T09:35:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.940+0000 7f9d4aa00640 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37693050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:35:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.941+0000 7f9d4b400640 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d3728dd80 0x560d3768bc90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c10aec0 tx=0x7f9d3401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74f912a744c2321 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.942+0000 7f9d3be00640 1 -- 172.21.15.120:0/3748554778 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3402b4e0 con 0x560d3728dd80 2024-05-14T09:35:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.942+0000 7f9d3be00640 1 -- 172.21.15.120:0/3748554778 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d34005020 con 0x560d3728dd80 2024-05-14T09:35:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.944+0000 7f9d595ae740 1 -- 172.21.15.120:0/3748554778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d3728dd80 msgr2=0x560d3768bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.944+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d3728dd80 0x560d3768bc90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c10aec0 tx=0x7f9d3401b000 comp rx=0 tx=0).stop 2024-05-14T09:35:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.944+0000 7f9d595ae740 1 -- 172.21.15.120:0/3748554778 shutdown_connections 2024-05-14T09:35:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.944+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372ae4d0 0x560d3768c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.944+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372a62f0 0x560d37693050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.944+0000 7f9d595ae740 1 --2- 172.21.15.120:0/3748554778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d3728dd80 0x560d3768bc90 secure :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c10aec0 tx=0x7f9d3401b000 comp rx=0 tx=0).stop 2024-05-14T09:35:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.944+0000 7f9d595ae740 1 -- 172.21.15.120:0/3748554778 >> 172.21.15.120:0/3748554778 conn(0x560d372c3300 msgr2=0x560d37675100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.946+0000 7f9d595ae740 1 -- 172.21.15.120:0/3748554778 shutdown_connections 2024-05-14T09:35:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.946+0000 7f9d595ae740 1 -- 172.21.15.120:0/3748554778 wait complete. 2024-05-14T09:35:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.947+0000 7f9d595ae740 1 -- start start 2024-05-14T09:35:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.948+0000 7f9d595ae740 1 Processor -- start 2024-05-14T09:35:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372a62f0 0x560d3768ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d37690510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d595ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372cf1b0 0x560d376ff690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d595ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c1abc50 con 0x560d372cf1b0 2024-05-14T09:35:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d595ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c1ab580 con 0x560d372ae4d0 2024-05-14T09:35:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d595ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c0846d0 con 0x560d372a62f0 2024-05-14T09:35:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d595ae740 10 client.0 _ll_register_callbacks cb 0x7f9d340097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.949+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372cf1b0 0x560d376ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372cf1b0 0x560d376ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54068/0 (socket says 172.21.15.120:54068) 2024-05-14T09:35:01.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4be00640 1 -- 172.21.15.120:0/992870646 learned_addr learned my addr 172.21.15.120:0/992870646 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:01.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4aa00640 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d37690510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4b400640 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372a62f0 0x560d3768ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4be00640 1 -- 172.21.15.120:0/992870646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372a62f0 msgr2=0x560d3768ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4be00640 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372a62f0 0x560d3768ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4be00640 1 -- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 msgr2=0x560d37690510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4be00640 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d37690510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.950+0000 7f9d4be00640 1 -- 172.21.15.120:0/992870646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d376ffbd0 con 0x560d372cf1b0 2024-05-14T09:35:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.951+0000 7f9d4be00640 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372cf1b0 0x560d376ff690 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9d44004af0 tx=0x7f9d440095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47411bb1e9ff6724 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.951+0000 7f9d39600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:35:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.952+0000 7f9d39600640 1 -- 172.21.15.120:0/992870646 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44036040 con 0x560d372cf1b0 2024-05-14T09:35:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.952+0000 7f9d39600640 1 -- 172.21.15.120:0/992870646 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9d440045d0 con 0x560d372cf1b0 2024-05-14T09:35:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.953+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d34005020 con 0x560d372cf1b0 2024-05-14T09:35:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.954+0000 7f9d39600640 1 -- 172.21.15.120:0/992870646 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f9d44041050 con 0x560d372cf1b0 2024-05-14T09:35:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.954+0000 7f9d595ae740 10 client.16986 fetch_fsmap learned FSMap version 59 2024-05-14T09:35:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.954+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x560d37700d10 con 0x560d372cf1b0 2024-05-14T09:35:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.955+0000 7f9d39600640 1 -- 172.21.15.120:0/992870646 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d34005020 con 0x560d372cf1b0 2024-05-14T09:35:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.955+0000 7f9d39600640 1 -- 172.21.15.120:0/992870646 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 59) ==== 8402+0+0 (secure 0 0 0) 0x7f9d44004020 con 0x560d372cf1b0 2024-05-14T09:35:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.956+0000 7f9d595ae740 10 client.16986 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T09:35:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.956+0000 7f9d595ae740 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.956+0000 7f9d595ae740 20 client.16986 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.956+0000 7f9d595ae740 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d372631c0 0x560d37703740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.956+0000 7f9d595ae740 4 client.16986 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:35:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.956+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d375dcfd0 con 0x560d372631c0 2024-05-14T09:35:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.956+0000 7f9d4b400640 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d372631c0 0x560d37703740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.958+0000 7f9d4b400640 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d372631c0 0x560d37703740 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=400dcf9b153b9c1b server_cookie=bee4e9d6d1d76e26 in_seq=0 out_seq=0 2024-05-14T09:35:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.958+0000 7f9d39600640 10 client.16986 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.983+0000 7f9d39600640 1 -- 172.21.15.120:0/992870646 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d375dcfd0 con 0x560d372631c0 2024-05-14T09:35:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.983+0000 7f9d39600640 10 client.16986 handle_command_reply: tid=0 2024-05-14T09:35:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.983+0000 7f9d595ae740 1 client.16986 shutdown 2024-05-14T09:35:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.984+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372cf1b0 msgr2=0x560d376ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.984+0000 7f9d595ae740 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372cf1b0 0x560d376ff690 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9d44004af0 tx=0x7f9d440095c0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.985+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 shutdown_connections 2024-05-14T09:35:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.985+0000 7f9d595ae740 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x560d372631c0 0x560d37703740 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.985+0000 7f9d595ae740 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560d372cf1b0 0x560d376ff690 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.985+0000 7f9d595ae740 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d372ae4d0 0x560d37690510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.985+0000 7f9d595ae740 1 --2- 172.21.15.120:0/992870646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d372a62f0 0x560d3768ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.985+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 >> 172.21.15.120:0/992870646 conn(0x560d372c3300 msgr2=0x560d3766c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.985+0000 7f9d39600640 0 client.16986 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.987+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 shutdown_connections 2024-05-14T09:35:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.987+0000 7f9d595ae740 1 -- 172.21.15.120:0/992870646 wait complete. 2024-05-14T09:35:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:35:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:35:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:35:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:35:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.987+0000 7f9d595ae740 20 client.16986 trim_cache size 0 max 16384 2024-05-14T09:35:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.989+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d300b2970 msgr2=0x7f9d300b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.989+0000 7f9d52600640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d300b2970 0x7f9d300b4e80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x560d376724e0 tx=0x7f9d34009260 comp rx=0 tx=0).stop 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.989+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c10b490 msgr2=0x7f9d4c1a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.989+0000 7f9d52600640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c10b490 0x7f9d4c1a0df0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00d950 tx=0x7f9d3c00dd50 comp rx=0 tx=0).stop 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 shutdown_connections 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f9d300b2970 0x7f9d300b4e80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4c110190 0x7f9d4c1a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d4c10b490 0x7f9d4c1a0df0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 --2- 172.21.15.120:0/3785102623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d4c10a450 0x7f9d4c1a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 >> 172.21.15.120:0/3785102623 conn(0x7f9d4c078f10 msgr2=0x7f9d4c10c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 shutdown_connections 2024-05-14T09:35:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:01.990+0000 7f9d52600640 1 -- 172.21.15.120:0/3785102623 wait complete. 2024-05-14T09:35:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:01 smithi120 ceph-mon[31085]: pgmap v900: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 665 op/s 2024-05-14T09:35:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:01 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:01 smithi152 ceph-mon[34868]: pgmap v900: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 665 op/s 2024-05-14T09:35:02.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:01 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:01 smithi175 ceph-mon[35353]: pgmap v900: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 665 op/s 2024-05-14T09:35:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:01 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:03.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:02 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:03.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:03 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:03.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:03 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 450.0 s, 716.6 tps, lat 139.346 ms stddev 45.689 2024-05-14T09:35:04.383 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:04 smithi120 ceph-mon[31085]: pgmap v901: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2024-05-14T09:35:04.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:04 smithi152 ceph-mon[34868]: pgmap v901: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2024-05-14T09:35:04.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:04 smithi175 ceph-mon[35353]: pgmap v901: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2024-05-14T09:35:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:06 smithi120 ceph-mon[31085]: pgmap v902: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 10 MiB/s wr, 700 op/s 2024-05-14T09:35:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:06 smithi152 ceph-mon[34868]: pgmap v902: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 10 MiB/s wr, 700 op/s 2024-05-14T09:35:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:06 smithi175 ceph-mon[35353]: pgmap v902: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 10 MiB/s wr, 700 op/s 2024-05-14T09:35:08.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:08 smithi120 ceph-mon[31085]: pgmap v903: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 678 op/s 2024-05-14T09:35:08.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:08 smithi152 ceph-mon[34868]: pgmap v903: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 678 op/s 2024-05-14T09:35:08.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:08 smithi175 ceph-mon[35353]: pgmap v903: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 678 op/s 2024-05-14T09:35:09.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 455.0 s, 679.4 tps, lat 146.575 ms stddev 51.765 2024-05-14T09:35:10.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:10 smithi120 ceph-mon[31085]: pgmap v904: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 10 MiB/s wr, 718 op/s 2024-05-14T09:35:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:10 smithi152 ceph-mon[34868]: pgmap v904: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 10 MiB/s wr, 718 op/s 2024-05-14T09:35:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:10 smithi175 ceph-mon[35353]: pgmap v904: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 10 MiB/s wr, 718 op/s 2024-05-14T09:35:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:12 smithi120 ceph-mon[31085]: pgmap v905: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.5 MiB/s wr, 687 op/s 2024-05-14T09:35:12.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:12 smithi152 ceph-mon[34868]: pgmap v905: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.5 MiB/s wr, 687 op/s 2024-05-14T09:35:12.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:12 smithi175 ceph-mon[35353]: pgmap v905: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.5 MiB/s wr, 687 op/s 2024-05-14T09:35:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 460.0 s, 687.8 tps, lat 146.029 ms stddev 48.734 2024-05-14T09:35:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:14 smithi120 ceph-mon[31085]: pgmap v906: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.1 MiB/s wr, 686 op/s 2024-05-14T09:35:14.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:14 smithi152 ceph-mon[34868]: pgmap v906: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.1 MiB/s wr, 686 op/s 2024-05-14T09:35:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:14 smithi175 ceph-mon[35353]: pgmap v906: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.1 MiB/s wr, 686 op/s 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 -- 172.21.15.120:0/3686773917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c009d00 msgr2=0x7fe98c00aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 --2- 172.21.15.120:0/3686773917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c009d00 0x7fe98c00aa50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe984009900 tx=0x7fe98402a400 comp rx=0 tx=0).stop 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 -- 172.21.15.120:0/3686773917 shutdown_connections 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 --2- 172.21.15.120:0/3686773917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98c00bc90 0x7fe98c00c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 --2- 172.21.15.120:0/3686773917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe98c00af90 0x7fe98c00b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 --2- 172.21.15.120:0/3686773917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c009d00 0x7fe98c00aa50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 -- 172.21.15.120:0/3686773917 >> 172.21.15.120:0/3686773917 conn(0x7fe98c093dc0 msgr2=0x7fe98c096250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 -- 172.21.15.120:0/3686773917 shutdown_connections 2024-05-14T09:35:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.366+0000 7fe993200640 1 -- 172.21.15.120:0/3686773917 wait complete. 2024-05-14T09:35:15.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.368+0000 7fe993200640 1 Processor -- start 2024-05-14T09:35:15.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.368+0000 7fe993200640 1 -- start start 2024-05-14T09:35:15.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.368+0000 7fe993200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98c009d00 0x7fe98c133640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe993200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe98c00af90 0x7fe98c133b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe993200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c00bc90 0x7fe98c13ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe993200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0a8a00 con 0x7fe98c00af90 2024-05-14T09:35:15.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe993200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0a8880 con 0x7fe98c00bc90 2024-05-14T09:35:15.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe993200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0a8b80 con 0x7fe98c009d00 2024-05-14T09:35:15.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe991400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe98c00af90 0x7fe98c133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe991400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe98c00af90 0x7fe98c133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53538/0 (socket says 172.21.15.120:53538) 2024-05-14T09:35:15.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe991e00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98c009d00 0x7fe98c133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe998e00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c00bc90 0x7fe98c13ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.369+0000 7fe991400640 1 -- 172.21.15.120:0/318286554 learned_addr learned my addr 172.21.15.120:0/318286554 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:15.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.370+0000 7fe991e00640 1 -- 172.21.15.120:0/318286554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c00bc90 msgr2=0x7fe98c13ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.370+0000 7fe991e00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c00bc90 0x7fe98c13ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.370+0000 7fe991e00640 1 -- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe98c00af90 msgr2=0x7fe98c133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.370+0000 7fe991e00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe98c00af90 0x7fe98c133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.370+0000 7fe991e00640 1 -- 172.21.15.120:0/318286554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c13b180 con 0x7fe98c009d00 2024-05-14T09:35:15.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.373+0000 7fe991e00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98c009d00 0x7fe98c133640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe984009230 tx=0x7fe984003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:15.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.374+0000 7fe98aa00640 1 -- 172.21.15.120:0/318286554 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98403f070 con 0x7fe98c009d00 2024-05-14T09:35:15.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.374+0000 7fe98aa00640 1 -- 172.21.15.120:0/318286554 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe984031b90 con 0x7fe98c009d00 2024-05-14T09:35:15.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.374+0000 7fe98aa00640 1 -- 172.21.15.120:0/318286554 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984035030 con 0x7fe98c009d00 2024-05-14T09:35:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.375+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c13b410 con 0x7fe98c009d00 2024-05-14T09:35:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.375+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c13b900 con 0x7fe98c009d00 2024-05-14T09:35:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.381+0000 7fe99fe19740 1 Processor -- start 2024-05-14T09:35:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.381+0000 7fe98aa00640 1 -- 172.21.15.120:0/318286554 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe984042070 con 0x7fe98c009d00 2024-05-14T09:35:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.381+0000 7fe99fe19740 1 -- start start 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd757330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd7578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd75e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe99fe19740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555cfd6bb550 con 0x555cfd3b51b0 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe99fe19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555cfd660bc0 con 0x555cfd3944d0 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe99fe19740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cfd6b7510 con 0x555cfd38c2f0 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe98aa00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9780b2a00 0x7fe9780b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.383+0000 7fe98aa00640 1 -- 172.21.15.120:0/318286554 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe984102a50 con 0x7fe98c009d00 2024-05-14T09:35:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.384+0000 7fe991e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd7578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.384+0000 7fe991e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd7578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55252/0 (socket says 172.21.15.120:55252) 2024-05-14T09:35:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.384+0000 7fe991e00640 1 -- 172.21.15.120:0/1871282235 learned_addr learned my addr 172.21.15.120:0/1871282235 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.385+0000 7fe998e00640 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd757330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.385+0000 7fe991e00640 1 -- 172.21.15.120:0/1871282235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 msgr2=0x555cfd75e7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:35:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.385+0000 7fe991e00640 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd75e7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.385+0000 7fe991e00640 1 -- 172.21.15.120:0/1871282235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 msgr2=0x555cfd757330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.385+0000 7fe991e00640 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd757330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.385+0000 7fe991e00640 1 -- 172.21.15.120:0/1871282235 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cfd3cd210 con 0x555cfd38c2f0 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.385+0000 7fe998e00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9780b2a00 0x7fe9780b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.386+0000 7fe991e00640 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd7578b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c5c10 tx=0x7fe984031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df8207c825b76a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.387+0000 7fe983400640 1 -- 172.21.15.120:0/1871282235 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840ca370 con 0x555cfd38c2f0 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.387+0000 7fe983400640 1 -- 172.21.15.120:0/1871282235 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9840c9c70 con 0x555cfd38c2f0 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.387+0000 7fe983400640 1 -- 172.21.15.120:0/1871282235 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840d2640 con 0x555cfd38c2f0 2024-05-14T09:35:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.387+0000 7fe998e00640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9780b2a00 0x7fe9780b4f10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe994051dc0 tx=0x7fe994068de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:15.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.390+0000 7fe99fe19740 1 -- 172.21.15.120:0/1871282235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 msgr2=0x555cfd7578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.390+0000 7fe99fe19740 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd7578b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c5c10 tx=0x7fe984031400 comp rx=0 tx=0).stop 2024-05-14T09:35:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.390+0000 7fe99fe19740 1 -- 172.21.15.120:0/1871282235 shutdown_connections 2024-05-14T09:35:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.390+0000 7fe99fe19740 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd75e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.390+0000 7fe99fe19740 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd7578b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.390+0000 7fe99fe19740 1 --2- 172.21.15.120:0/1871282235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd757330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.390+0000 7fe99fe19740 1 -- 172.21.15.120:0/1871282235 >> 172.21.15.120:0/1871282235 conn(0x555cfd3a9300 msgr2=0x555cfd752cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:15.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.392+0000 7fe99fe19740 1 -- 172.21.15.120:0/1871282235 shutdown_connections 2024-05-14T09:35:15.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.393+0000 7fe99fe19740 1 -- 172.21.15.120:0/1871282235 wait complete. 2024-05-14T09:35:15.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.394+0000 7fe99fe19740 1 -- start start 2024-05-14T09:35:15.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.394+0000 7fe99fe19740 1 Processor -- start 2024-05-14T09:35:15.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.394+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd38c2f0 0x555cfd760ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.395+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd761010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.395+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd3b51b0 0x555cfd767f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.395+0000 7fe99fe19740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555cfd6b7510 con 0x555cfd38c2f0 2024-05-14T09:35:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.395+0000 7fe99fe19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555cfd674660 con 0x555cfd3944d0 2024-05-14T09:35:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.395+0000 7fe99fe19740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cfd75efc0 con 0x555cfd3b51b0 2024-05-14T09:35:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.396+0000 7fe99fe19740 10 client.0 _ll_register_callbacks cb 0x555cfd63e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd38c2f0 0x555cfd760ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.396+0000 7fe991400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd761010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.396+0000 7fe998e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd3b51b0 0x555cfd767f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd38c2f0 0x555cfd760ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53548/0 (socket says 172.21.15.120:53548) 2024-05-14T09:35:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 -- 172.21.15.120:0/3401198005 learned_addr learned my addr 172.21.15.120:0/3401198005 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 -- 172.21.15.120:0/3401198005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd3b51b0 msgr2=0x555cfd767f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd3b51b0 0x555cfd767f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 -- 172.21.15.120:0/3401198005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 msgr2=0x555cfd761010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd761010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.397+0000 7fe991e00640 1 -- 172.21.15.120:0/3401198005 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cfd499620 con 0x555cfd38c2f0 2024-05-14T09:35:15.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.402+0000 7fe991e00640 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd38c2f0 0x555cfd760ad0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c9bb0 tx=0x7fe984005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48357dd3bedaea4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:15.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.402+0000 7fe977e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:35:15.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.402+0000 7fe977e00640 1 -- 172.21.15.120:0/3401198005 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840ca370 con 0x555cfd38c2f0 2024-05-14T09:35:15.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.403+0000 7fe977e00640 1 -- 172.21.15.120:0/3401198005 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe9840d2850 con 0x555cfd38c2f0 2024-05-14T09:35:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.403+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9840c9c70 con 0x555cfd38c2f0 2024-05-14T09:35:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.404+0000 7fe977e00640 1 -- 172.21.15.120:0/3401198005 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fe984100340 con 0x555cfd38c2f0 2024-05-14T09:35:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.404+0000 7fe99fe19740 10 client.16995 fetch_fsmap learned FSMap version 60 2024-05-14T09:35:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.404+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x555cfd77beb0 con 0x555cfd38c2f0 2024-05-14T09:35:15.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe977e00640 1 -- 172.21.15.120:0/3401198005 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9840c9c70 con 0x555cfd38c2f0 2024-05-14T09:35:15.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe977e00640 1 -- 172.21.15.120:0/3401198005 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 60) ==== 8398+0+0 (secure 0 0 0) 0x7fe9840c8ed0 con 0x555cfd38c2f0 2024-05-14T09:35:15.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe99fe19740 10 client.16995 fetch_fsmap finished waiting for FSMap version 60 2024-05-14T09:35:15.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe99fe19740 10 client.16995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:15.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe99fe19740 20 client.16995 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:15.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe99fe19740 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd373d80 0x555cfd77f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe99fe19740 4 client.16995 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:35:15.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.405+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cfd6c9160 con 0x555cfd373d80 2024-05-14T09:35:15.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.406+0000 7fe991400640 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd373d80 0x555cfd77f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.408+0000 7fe991400640 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd373d80 0x555cfd77f530 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56059abc3bce8ed3 server_cookie=78f3fb125002cf29 in_seq=0 out_seq=0 2024-05-14T09:35:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.408+0000 7fe977e00640 10 client.16995 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:15.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.410+0000 7fe977e00640 1 -- 172.21.15.120:0/3401198005 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555cfd6c9160 con 0x555cfd373d80 2024-05-14T09:35:15.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.410+0000 7fe977e00640 10 client.16995 handle_command_reply: tid=0 2024-05-14T09:35:15.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.410+0000 7fe99fe19740 1 client.16995 shutdown 2024-05-14T09:35:15.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.411+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd38c2f0 msgr2=0x555cfd760ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.411+0000 7fe99fe19740 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd38c2f0 0x555cfd760ad0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c9bb0 tx=0x7fe984005fd0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.413+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 shutdown_connections 2024-05-14T09:35:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.413+0000 7fe99fe19740 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd373d80 0x555cfd77f530 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.413+0000 7fe99fe19740 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd3b51b0 0x555cfd767f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.413+0000 7fe99fe19740 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd761010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.413+0000 7fe99fe19740 1 --2- 172.21.15.120:0/3401198005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd38c2f0 0x555cfd760ad0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.413+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 >> 172.21.15.120:0/3401198005 conn(0x555cfd3a9300 msgr2=0x555cfd755bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.413+0000 7fe977e00640 0 client.16995 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:15.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.415+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 shutdown_connections 2024-05-14T09:35:15.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.415+0000 7fe99fe19740 1 -- 172.21.15.120:0/3401198005 wait complete. 2024-05-14T09:35:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.415+0000 7fe99fe19740 20 client.16995 trim_cache size 0 max 16384 2024-05-14T09:35:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.448+0000 7fe99fe19740 1 Processor -- start 2024-05-14T09:35:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.448+0000 7fe99fe19740 1 -- start start 2024-05-14T09:35:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.448+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd752ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.448+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd755ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.448+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd756000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.449+0000 7fe99fe19740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c13d5c0 con 0x555cfd3b51b0 2024-05-14T09:35:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.449+0000 7fe99fe19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c13f280 con 0x555cfd3944d0 2024-05-14T09:35:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.449+0000 7fe99fe19740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c13dc90 con 0x555cfd38c2f0 2024-05-14T09:35:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.449+0000 7fe991400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd755ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.449+0000 7fe998e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd756000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.450+0000 7fe998e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd756000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53562/0 (socket says 172.21.15.120:53562) 2024-05-14T09:35:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.450+0000 7fe991e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd752ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.451+0000 7fe991e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd752ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55270/0 (socket says 172.21.15.120:55270) 2024-05-14T09:35:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.451+0000 7fe991e00640 1 -- 172.21.15.120:0/2422129581 learned_addr learned my addr 172.21.15.120:0/2422129581 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.451+0000 7fe991400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd755ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41598/0 (socket says 172.21.15.120:41598) 2024-05-14T09:35:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.453+0000 7fe991e00640 1 -- 172.21.15.120:0/2422129581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 msgr2=0x555cfd755ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.453+0000 7fe991e00640 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd755ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.453+0000 7fe991e00640 1 -- 172.21.15.120:0/2422129581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 msgr2=0x555cfd756000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.453+0000 7fe991e00640 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd756000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.453+0000 7fe991e00640 1 -- 172.21.15.120:0/2422129581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cfd761b40 con 0x555cfd38c2f0 2024-05-14T09:35:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.453+0000 7fe998e00640 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd756000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:35:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.454+0000 7fe991400640 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd755ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:35:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.454+0000 7fe991e00640 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd752ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c9c00 tx=0x7fe984005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c2af3bd5f4be74 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.455+0000 7fe982a00640 1 -- 172.21.15.120:0/2422129581 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840c5aa0 con 0x555cfd38c2f0 2024-05-14T09:35:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.455+0000 7fe982a00640 1 -- 172.21.15.120:0/2422129581 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9840d9070 con 0x555cfd38c2f0 2024-05-14T09:35:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.455+0000 7fe982a00640 1 -- 172.21.15.120:0/2422129581 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840d2ad0 con 0x555cfd38c2f0 2024-05-14T09:35:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.457+0000 7fe99fe19740 1 -- 172.21.15.120:0/2422129581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 msgr2=0x555cfd752ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.457+0000 7fe99fe19740 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd752ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c9c00 tx=0x7fe984005720 comp rx=0 tx=0).stop 2024-05-14T09:35:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.458+0000 7fe99fe19740 1 -- 172.21.15.120:0/2422129581 shutdown_connections 2024-05-14T09:35:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.458+0000 7fe99fe19740 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3b51b0 0x555cfd756000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.458+0000 7fe99fe19740 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3944d0 0x555cfd755ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.458+0000 7fe99fe19740 1 --2- 172.21.15.120:0/2422129581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd752ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.459+0000 7fe99fe19740 1 -- 172.21.15.120:0/2422129581 >> 172.21.15.120:0/2422129581 conn(0x555cfd3a9300 msgr2=0x555cfd7523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.459+0000 7fe99fe19740 1 -- 172.21.15.120:0/2422129581 shutdown_connections 2024-05-14T09:35:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.459+0000 7fe99fe19740 1 -- 172.21.15.120:0/2422129581 wait complete. 2024-05-14T09:35:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.460+0000 7fe99fe19740 1 -- start start 2024-05-14T09:35:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.460+0000 7fe99fe19740 1 Processor -- start 2024-05-14T09:35:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.462+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd764b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.462+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3944d0 0x555cfd765090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.462+0000 7fe99fe19740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3b51b0 0x555cfd765fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe99fe19740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c13eaf0 con 0x555cfd3944d0 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe99fe19740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c13e420 con 0x555cfd3b51b0 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe99fe19740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0a0450 con 0x555cfd38c2f0 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe991e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd764b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe991e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd764b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55278/0 (socket says 172.21.15.120:55278) 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe991e00640 1 -- 172.21.15.120:0/392581204 learned_addr learned my addr 172.21.15.120:0/392581204 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe99fe19740 10 client.0 _ll_register_callbacks cb 0x7fe9840c95c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.463+0000 7fe998e00640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3b51b0 0x555cfd765fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.464+0000 7fe991400640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3944d0 0x555cfd765090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.464+0000 7fe991e00640 1 -- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3b51b0 msgr2=0x555cfd765fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.464+0000 7fe991e00640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3b51b0 0x555cfd765fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.465+0000 7fe991e00640 1 -- 172.21.15.120:0/392581204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3944d0 msgr2=0x555cfd765090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.465+0000 7fe991e00640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3944d0 0x555cfd765090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.465+0000 7fe991e00640 1 -- 172.21.15.120:0/392581204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cfd766580 con 0x555cfd38c2f0 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.465+0000 7fe991400640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3944d0 0x555cfd765090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.466+0000 7fe977e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:35:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.466+0000 7fe991e00640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd764b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c9970 tx=0x7fe984005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72c7c9996a25022 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.466+0000 7fe977e00640 1 -- 172.21.15.120:0/392581204 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840ab060 con 0x555cfd38c2f0 2024-05-14T09:35:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.466+0000 7fe977e00640 1 -- 172.21.15.120:0/392581204 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe9840c7bc0 con 0x555cfd38c2f0 2024-05-14T09:35:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.466+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9840d9070 con 0x555cfd38c2f0 2024-05-14T09:35:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.467+0000 7fe977e00640 1 -- 172.21.15.120:0/392581204 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fe9840c5aa0 con 0x555cfd38c2f0 2024-05-14T09:35:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.468+0000 7fe99fe19740 10 client.26554 fetch_fsmap learned FSMap version 60 2024-05-14T09:35:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.468+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x555cfd766580 con 0x555cfd38c2f0 2024-05-14T09:35:15.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.468+0000 7fe977e00640 1 -- 172.21.15.120:0/392581204 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9840d9070 con 0x555cfd38c2f0 2024-05-14T09:35:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.469+0000 7fe977e00640 1 -- 172.21.15.120:0/392581204 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 60) ==== 8398+0+0 (secure 0 0 0) 0x7fe9840ae050 con 0x555cfd38c2f0 2024-05-14T09:35:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.469+0000 7fe99fe19740 10 client.26554 fetch_fsmap finished waiting for FSMap version 60 2024-05-14T09:35:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.469+0000 7fe99fe19740 10 client.26554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.469+0000 7fe99fe19740 20 client.26554 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.469+0000 7fe99fe19740 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd3491c0 0x555cfd7e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.469+0000 7fe99fe19740 4 client.26554 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:35:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.469+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cfd6c2fd0 con 0x555cfd3491c0 2024-05-14T09:35:15.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.470+0000 7fe991400640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd3491c0 0x555cfd7e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.471+0000 7fe991400640 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd3491c0 0x555cfd7e9b80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7232bb3cf8b3b9c server_cookie=eae97d3be297aa71 in_seq=0 out_seq=0 2024-05-14T09:35:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.471+0000 7fe977e00640 10 client.26554 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.500+0000 7fe977e00640 1 -- 172.21.15.120:0/392581204 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cfd6c2fd0 con 0x555cfd3491c0 2024-05-14T09:35:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.500+0000 7fe977e00640 10 client.26554 handle_command_reply: tid=0 2024-05-14T09:35:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.500+0000 7fe99fe19740 1 client.26554 shutdown 2024-05-14T09:35:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.501+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 msgr2=0x555cfd764b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.501+0000 7fe99fe19740 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd764b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c9970 tx=0x7fe984005fd0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.501+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 shutdown_connections 2024-05-14T09:35:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.501+0000 7fe99fe19740 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x555cfd3491c0 0x555cfd7e9b80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe99fe19740 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555cfd3b51b0 0x555cfd765fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe99fe19740 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555cfd3944d0 0x555cfd765090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe99fe19740 1 --2- 172.21.15.120:0/392581204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cfd38c2f0 0x555cfd764b50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 >> 172.21.15.120:0/392581204 conn(0x555cfd3a9300 msgr2=0x555cfd7600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe977e00640 0 client.26554 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 shutdown_connections 2024-05-14T09:35:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe99fe19740 1 -- 172.21.15.120:0/392581204 wait complete. 2024-05-14T09:35:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.502+0000 7fe99fe19740 20 client.26554 trim_cache size 0 max 16384 2024-05-14T09:35:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:35:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:35:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:35:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:35:15.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.505+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9780b2a00 msgr2=0x7fe9780b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.505+0000 7fe993200640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9780b2a00 0x7fe9780b4f10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe994051dc0 tx=0x7fe994068de0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.505+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98c009d00 msgr2=0x7fe98c133640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.505+0000 7fe993200640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98c009d00 0x7fe98c133640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe984009230 tx=0x7fe984003b90 comp rx=0 tx=0).stop 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 shutdown_connections 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe9780b2a00 0x7fe9780b4f10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c00bc90 0x7fe98c13ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe98c00af90 0x7fe98c133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 --2- 172.21.15.120:0/318286554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98c009d00 0x7fe98c133640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 >> 172.21.15.120:0/318286554 conn(0x7fe98c093dc0 msgr2=0x7fe98c094470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 shutdown_connections 2024-05-14T09:35:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:15.506+0000 7fe993200640 1 -- 172.21.15.120:0/318286554 wait complete. 2024-05-14T09:35:16.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:16 smithi120 ceph-mon[31085]: pgmap v907: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-05-14T09:35:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:16 smithi152 ceph-mon[34868]: pgmap v907: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-05-14T09:35:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:16 smithi175 ceph-mon[35353]: pgmap v907: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-05-14T09:35:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:18 smithi120 ceph-mon[31085]: pgmap v908: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 680 op/s 2024-05-14T09:35:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:18 smithi152 ceph-mon[34868]: pgmap v908: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 680 op/s 2024-05-14T09:35:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:18 smithi175 ceph-mon[35353]: pgmap v908: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 680 op/s 2024-05-14T09:35:19.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 465.0 s, 645.2 tps, lat 154.793 ms stddev 49.113 2024-05-14T09:35:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:20 smithi120 ceph-mon[31085]: pgmap v909: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.2 MiB/s wr, 698 op/s 2024-05-14T09:35:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:20 smithi152 ceph-mon[34868]: pgmap v909: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.2 MiB/s wr, 698 op/s 2024-05-14T09:35:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:20 smithi175 ceph-mon[35353]: pgmap v909: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.2 MiB/s wr, 698 op/s 2024-05-14T09:35:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:22 smithi120 ceph-mon[31085]: pgmap v910: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.5 MiB/s wr, 664 op/s 2024-05-14T09:35:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:22 smithi152 ceph-mon[34868]: pgmap v910: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.5 MiB/s wr, 664 op/s 2024-05-14T09:35:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:22 smithi175 ceph-mon[35353]: pgmap v910: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.5 MiB/s wr, 664 op/s 2024-05-14T09:35:23.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:23 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:23.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:23 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:23.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:23 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:24.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 470.0 s, 599.2 tps, lat 166.799 ms stddev 249.937 2024-05-14T09:35:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:24 smithi152 ceph-mon[34868]: pgmap v911: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.5 MiB/s wr, 644 op/s 2024-05-14T09:35:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:24 smithi175 ceph-mon[35353]: pgmap v911: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.5 MiB/s wr, 644 op/s 2024-05-14T09:35:24.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:24 smithi120 ceph-mon[31085]: pgmap v911: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.5 MiB/s wr, 644 op/s 2024-05-14T09:35:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:26 smithi152 ceph-mon[34868]: pgmap v912: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 669 op/s 2024-05-14T09:35:26.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:26 smithi175 ceph-mon[35353]: pgmap v912: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 669 op/s 2024-05-14T09:35:26.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:26 smithi120 ceph-mon[31085]: pgmap v912: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 669 op/s 2024-05-14T09:35:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:28 smithi152 ceph-mon[34868]: pgmap v913: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.2 MiB/s wr, 630 op/s 2024-05-14T09:35:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:28 smithi175 ceph-mon[35353]: pgmap v913: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.2 MiB/s wr, 630 op/s 2024-05-14T09:35:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:28 smithi120 ceph-mon[31085]: pgmap v913: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.2 MiB/s wr, 630 op/s 2024-05-14T09:35:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.861+0000 7fd4ca000640 1 -- 172.21.15.120:0/100711145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4106d90 msgr2=0x7fd4c4109270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.861+0000 7fd4ca000640 1 --2- 172.21.15.120:0/100711145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4106d90 0x7fd4c4109270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009900 tx=0x7fd4b002a440 comp rx=0 tx=0).stop 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.861+0000 7fd4ca000640 1 -- 172.21.15.120:0/100711145 shutdown_connections 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.861+0000 7fd4ca000640 1 --2- 172.21.15.120:0/100711145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4c4109900 0x7fd4c410bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.861+0000 7fd4ca000640 1 --2- 172.21.15.120:0/100711145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4106d90 0x7fd4c4109270 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009900 tx=0x7fd4b002a440 comp rx=0 tx=0).stop 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.861+0000 7fd4ca000640 1 --2- 172.21.15.120:0/100711145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 0x7fd4c41067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.861+0000 7fd4ca000640 1 -- 172.21.15.120:0/100711145 >> 172.21.15.120:0/100711145 conn(0x7fd4c40fdd40 msgr2=0x7fd4c41001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.862+0000 7fd4ca000640 1 -- 172.21.15.120:0/100711145 shutdown_connections 2024-05-14T09:35:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.862+0000 7fd4ca000640 1 -- 172.21.15.120:0/100711145 wait complete. 2024-05-14T09:35:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.863+0000 7fd4ca000640 1 Processor -- start 2024-05-14T09:35:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.864+0000 7fd4ca000640 1 -- start start 2024-05-14T09:35:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.864+0000 7fd4ca000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 0x7fd4c41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.864+0000 7fd4ca000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4c4109900 0x7fd4c4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.864+0000 7fd4ca000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4195030 0x7fd4c4195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.864+0000 7fd4ca000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c410f5d0 con 0x7fd4c4109900 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.864+0000 7fd4ca000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c410f450 con 0x7fd4c41043a0 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.864+0000 7fd4ca000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c410f750 con 0x7fd4c4195030 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.865+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 0x7fd4c41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.865+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 0x7fd4c41984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55968/0 (socket says 172.21.15.120:55968) 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.865+0000 7fd4c3400640 1 -- 172.21.15.120:0/737631701 learned_addr learned my addr 172.21.15.120:0/737631701 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.865+0000 7fd4c3e00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4195030 0x7fd4c4195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.866+0000 7fd4c3e00640 1 -- 172.21.15.120:0/737631701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 msgr2=0x7fd4c41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.866+0000 7fd4c3e00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 0x7fd4c41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.866+0000 7fd4c3e00640 1 -- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4c4109900 msgr2=0x7fd4c4198aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:35:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.866+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4c4109900 0x7fd4c4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.866+0000 7fd4c3e00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4c4109900 0x7fd4c4198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.866+0000 7fd4c3e00640 1 -- 172.21.15.120:0/737631701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c41a89f0 con 0x7fd4c4195030 2024-05-14T09:35:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.866+0000 7fd4c3400640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 0x7fd4c41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:35:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.867+0000 7fd4c3e00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4195030 0x7fd4c4195510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00ca30 tx=0x7fd4bc00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.868+0000 7fd4bbe00640 1 -- 172.21.15.120:0/737631701 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc007d90 con 0x7fd4c4195030 2024-05-14T09:35:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.868+0000 7fd4bbe00640 1 -- 172.21.15.120:0/737631701 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4bc005020 con 0x7fd4c4195030 2024-05-14T09:35:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.868+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c41a8c80 con 0x7fd4c4195030 2024-05-14T09:35:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.868+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41a91a0 con 0x7fd4c4195030 2024-05-14T09:35:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.869+0000 7fd4bbe00640 1 -- 172.21.15.120:0/737631701 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00f6b0 con 0x7fd4c4195030 2024-05-14T09:35:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.873+0000 7fd4d1034740 1 Processor -- start 2024-05-14T09:35:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.874+0000 7fd4bbe00640 1 -- 172.21.15.120:0/737631701 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd4bc00f910 con 0x7fd4c4195030 2024-05-14T09:35:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.875+0000 7fd4d1034740 1 -- start start 2024-05-14T09:35:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.875+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4221b0 0x55bcca7c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.875+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca3f92f0 0x55bcca7c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.875+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca4014d0 0x55bcca7cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.875+0000 7fd4d1034740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bcca728550 con 0x55bcca4221b0 2024-05-14T09:35:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.875+0000 7fd4d1034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bcca6cdbc0 con 0x55bcca4014d0 2024-05-14T09:35:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.875+0000 7fd4d1034740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bcca724510 con 0x55bcca3f92f0 2024-05-14T09:35:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.876+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4221b0 0x55bcca7c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.876+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca3f92f0 0x55bcca7c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.876+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca3f92f0 0x55bcca7c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53518/0 (socket says 172.21.15.120:53518) 2024-05-14T09:35:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.876+0000 7fd4c3400640 1 -- 172.21.15.120:0/2447034431 learned_addr learned my addr 172.21.15.120:0/2447034431 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.877+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca4014d0 0x55bcca7cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.877+0000 7fd4c3400640 1 -- 172.21.15.120:0/2447034431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca4014d0 msgr2=0x55bcca7cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4bbe00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4a80b2930 0x7fd4a80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4c3400640 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca4014d0 0x55bcca7cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4c3400640 1 -- 172.21.15.120:0/2447034431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4221b0 msgr2=0x55bcca7c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4c3400640 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4221b0 0x55bcca7c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4c3400640 1 -- 172.21.15.120:0/2447034431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcca43a210 con 0x55bcca3f92f0 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca4014d0 0x55bcca7cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4bbe00640 1 -- 172.21.15.120:0/737631701 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd4bc0e2ab0 con 0x7fd4c4195030 2024-05-14T09:35:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.878+0000 7fd4c3400640 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca3f92f0 0x55bcca7c4680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009da0 tx=0x7fd4b40117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c986ad442b9b40dc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.879+0000 7fd4c3e00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4a80b2930 0x7fd4a80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.880+0000 7fd4afe00640 1 -- 172.21.15.120:0/2447034431 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4012650 con 0x55bcca3f92f0 2024-05-14T09:35:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.880+0000 7fd4afe00640 1 -- 172.21.15.120:0/2447034431 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4b4012c80 con 0x55bcca3f92f0 2024-05-14T09:35:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.880+0000 7fd4afe00640 1 -- 172.21.15.120:0/2447034431 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400fbd0 con 0x55bcca3f92f0 2024-05-14T09:35:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.880+0000 7fd4c3e00640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4a80b2930 0x7fd4a80b4e40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00ca00 tx=0x7fd4bc005b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.882+0000 7fd4d1034740 1 -- 172.21.15.120:0/2447034431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca3f92f0 msgr2=0x55bcca7c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.882+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca3f92f0 0x55bcca7c4680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009da0 tx=0x7fd4b40117b0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.882+0000 7fd4d1034740 1 -- 172.21.15.120:0/2447034431 shutdown_connections 2024-05-14T09:35:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.882+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca4014d0 0x55bcca7cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.882+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca3f92f0 0x55bcca7c4680 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.882+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2447034431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4221b0 0x55bcca7c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.882+0000 7fd4d1034740 1 -- 172.21.15.120:0/2447034431 >> 172.21.15.120:0/2447034431 conn(0x55bcca416300 msgr2=0x55bcca7bfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.883+0000 7fd4d1034740 1 -- 172.21.15.120:0/2447034431 shutdown_connections 2024-05-14T09:35:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.883+0000 7fd4d1034740 1 -- 172.21.15.120:0/2447034431 wait complete. 2024-05-14T09:35:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.884+0000 7fd4d1034740 1 -- start start 2024-05-14T09:35:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.884+0000 7fd4d1034740 1 Processor -- start 2024-05-14T09:35:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.884+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.884+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4d1034740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bcca7cbfd0 con 0x55bcca4014d0 2024-05-14T09:35:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4d1034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bcca6e1660 con 0x55bcca3f92f0 2024-05-14T09:35:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4d1034740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bcca7cc150 con 0x55bcca4221b0 2024-05-14T09:35:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4d1034740 10 client.0 _ll_register_callbacks cb 0x55bcca6ab400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53524/0 (socket says 172.21.15.120:53524) 2024-05-14T09:35:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4c2a00640 1 -- 172.21.15.120:0/2891449860 learned_addr learned my addr 172.21.15.120:0/2891449860 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.885+0000 7fd4c3400640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.886+0000 7fd4c2a00640 1 -- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 msgr2=0x55bcca7cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.886+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.886+0000 7fd4c2a00640 1 -- 172.21.15.120:0/2891449860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 msgr2=0x55bcca7ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.886+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.886+0000 7fd4c2a00640 1 -- 172.21.15.120:0/2891449860 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcca506620 con 0x55bcca4221b0 2024-05-14T09:35:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.887+0000 7fd4c3400640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:35:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.887+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0004b50 tx=0x7fd4b0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1b795caf0c0a5e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.887+0000 7fd4acc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:35:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.887+0000 7fd4acc00640 1 -- 172.21.15.120:0/2891449860 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0005650 con 0x55bcca4221b0 2024-05-14T09:35:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.887+0000 7fd4acc00640 1 -- 172.21.15.120:0/2891449860 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd4b003f640 con 0x55bcca4221b0 2024-05-14T09:35:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.887+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4b4012c80 con 0x55bcca4221b0 2024-05-14T09:35:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.888+0000 7fd4acc00640 1 -- 172.21.15.120:0/2891449860 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd4b0053050 con 0x55bcca4221b0 2024-05-14T09:35:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.889+0000 7fd4d1034740 10 client.26566 fetch_fsmap learned FSMap version 61 2024-05-14T09:35:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.889+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bcca7d8010 con 0x55bcca4221b0 2024-05-14T09:35:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.889+0000 7fd4acc00640 1 -- 172.21.15.120:0/2891449860 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4b4012c80 con 0x55bcca4221b0 2024-05-14T09:35:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.890+0000 7fd4acc00640 1 -- 172.21.15.120:0/2891449860 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 61) ==== 8394+0+0 (secure 0 0 0) 0x7fd4b0031750 con 0x55bcca4221b0 2024-05-14T09:35:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.890+0000 7fd4d1034740 10 client.26566 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T09:35:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.890+0000 7fd4d1034740 10 client.26566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.890+0000 7fd4d1034740 20 client.26566 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.890+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3e0d80 0x55bcca7db820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.890+0000 7fd4d1034740 4 client.26566 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:35:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.890+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcca736160 con 0x55bcca3e0d80 2024-05-14T09:35:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.891+0000 7fd4c3400640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3e0d80 0x55bcca7db820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.892+0000 7fd4c3400640 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3e0d80 0x55bcca7db820 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589dcbb1dcda58f3 server_cookie=4fcc367690e7ba34 in_seq=0 out_seq=0 2024-05-14T09:35:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.892+0000 7fd4acc00640 10 client.26566 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.893+0000 7fd4acc00640 1 -- 172.21.15.120:0/2891449860 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bcca736160 con 0x55bcca3e0d80 2024-05-14T09:35:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.893+0000 7fd4acc00640 10 client.26566 handle_command_reply: tid=0 2024-05-14T09:35:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.893+0000 7fd4d1034740 1 client.26566 shutdown 2024-05-14T09:35:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.894+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 msgr2=0x55bcca7d50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.894+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0004b50 tx=0x7fd4b0005fd0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.894+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 shutdown_connections 2024-05-14T09:35:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.894+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3e0d80 0x55bcca7db820 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.894+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.894+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.895+0000 7fd4d1034740 1 --2- 172.21.15.120:0/2891449860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.895+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 >> 172.21.15.120:0/2891449860 conn(0x55bcca416300 msgr2=0x55bcca7c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.894+0000 7fd4acc00640 0 client.26566 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.895+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 shutdown_connections 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.895+0000 7fd4d1034740 1 -- 172.21.15.120:0/2891449860 wait complete. 2024-05-14T09:35:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.895+0000 7fd4d1034740 20 client.26566 trim_cache size 0 max 16384 2024-05-14T09:35:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.925+0000 7fd4d1034740 1 Processor -- start 2024-05-14T09:35:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.925+0000 7fd4d1034740 1 -- start start 2024-05-14T09:35:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.926+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.926+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.926+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.926+0000 7fd4d1034740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a400fba0 con 0x55bcca4014d0 2024-05-14T09:35:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.926+0000 7fd4d1034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a4011860 con 0x55bcca3f92f0 2024-05-14T09:35:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.926+0000 7fd4d1034740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a4010270 con 0x55bcca4221b0 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.926+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55994/0 (socket says 172.21.15.120:55994) 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 -- 172.21.15.120:0/3264240634 learned_addr learned my addr 172.21.15.120:0/3264240634 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c3400640 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 -- 172.21.15.120:0/3264240634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 msgr2=0x55bcca7d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 -- 172.21.15.120:0/3264240634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 msgr2=0x55bcca7d5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.927+0000 7fd4c2a00640 1 -- 172.21.15.120:0/3264240634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcca7bb280 con 0x55bcca3f92f0 2024-05-14T09:35:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.928+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cd5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0005d90 tx=0x7fd4b002a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb00e2df6291835 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.928+0000 7fd4af400640 1 -- 172.21.15.120:0/3264240634 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0000e60 con 0x55bcca3f92f0 2024-05-14T09:35:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.929+0000 7fd4af400640 1 -- 172.21.15.120:0/3264240634 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4b00318d0 con 0x55bcca3f92f0 2024-05-14T09:35:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.929+0000 7fd4af400640 1 -- 172.21.15.120:0/3264240634 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b003f820 con 0x55bcca3f92f0 2024-05-14T09:35:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.930+0000 7fd4d1034740 1 -- 172.21.15.120:0/3264240634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 msgr2=0x55bcca7cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.930+0000 7fd4d1034740 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cd5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0005d90 tx=0x7fd4b002a440 comp rx=0 tx=0).stop 2024-05-14T09:35:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.930+0000 7fd4d1034740 1 -- 172.21.15.120:0/3264240634 shutdown_connections 2024-05-14T09:35:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.930+0000 7fd4d1034740 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca7d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.930+0000 7fd4d1034740 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.930+0000 7fd4d1034740 1 --2- 172.21.15.120:0/3264240634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7cd5f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.930+0000 7fd4d1034740 1 -- 172.21.15.120:0/3264240634 >> 172.21.15.120:0/3264240634 conn(0x55bcca416300 msgr2=0x55bcca7ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.931+0000 7fd4d1034740 1 -- 172.21.15.120:0/3264240634 shutdown_connections 2024-05-14T09:35:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.931+0000 7fd4d1034740 1 -- 172.21.15.120:0/3264240634 wait complete. 2024-05-14T09:35:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.931+0000 7fd4d1034740 1 -- start start 2024-05-14T09:35:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.932+0000 7fd4d1034740 1 Processor -- start 2024-05-14T09:35:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4d1034740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca841bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4d1034740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a40110d0 con 0x55bcca4014d0 2024-05-14T09:35:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4d1034740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a4010a00 con 0x55bcca3f92f0 2024-05-14T09:35:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4d1034740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a400dba0 con 0x55bcca4221b0 2024-05-14T09:35:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4d1034740 10 client.0 _ll_register_callbacks cb 0x7fd4b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.933+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.934+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35030/0 (socket says 172.21.15.120:35030) 2024-05-14T09:35:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.934+0000 7fd4c3400640 1 -- 172.21.15.120:0/997460823 learned_addr learned my addr 172.21.15.120:0/997460823 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.934+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.934+0000 7fd4c3400640 1 -- 172.21.15.120:0/997460823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 msgr2=0x55bcca841bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.935+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca841bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.935+0000 7fd4c3400640 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca841bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.935+0000 7fd4c3400640 1 -- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 msgr2=0x55bcca7d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.935+0000 7fd4c3400640 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.935+0000 7fd4c3400640 1 -- 172.21.15.120:0/997460823 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcca7d57a0 con 0x55bcca4014d0 2024-05-14T09:35:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.935+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:35:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.936+0000 7fd4acc00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:35:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.936+0000 7fd4c3400640 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d27e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4014010 tx=0x7fd4b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245db00af42b2cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.936+0000 7fd4acc00640 1 -- 172.21.15.120:0/997460823 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40053c0 con 0x55bcca4014d0 2024-05-14T09:35:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.936+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4b00318d0 con 0x55bcca4014d0 2024-05-14T09:35:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.936+0000 7fd4acc00640 1 -- 172.21.15.120:0/997460823 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd4b4005560 con 0x55bcca4014d0 2024-05-14T09:35:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.937+0000 7fd4acc00640 1 -- 172.21.15.120:0/997460823 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd4b400f710 con 0x55bcca4014d0 2024-05-14T09:35:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.937+0000 7fd4d1034740 10 client.17010 fetch_fsmap learned FSMap version 61 2024-05-14T09:35:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.937+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bcca843090 con 0x55bcca4014d0 2024-05-14T09:35:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.937+0000 7fd4acc00640 1 -- 172.21.15.120:0/997460823 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4b00318d0 con 0x55bcca4014d0 2024-05-14T09:35:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.938+0000 7fd4acc00640 1 -- 172.21.15.120:0/997460823 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 61) ==== 8394+0+0 (secure 0 0 0) 0x7fd4b4012930 con 0x55bcca4014d0 2024-05-14T09:35:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.938+0000 7fd4d1034740 10 client.17010 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T09:35:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.938+0000 7fd4d1034740 10 client.17010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.938+0000 7fd4d1034740 20 client.17010 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.938+0000 7fd4d1034740 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3b61c0 0x55bcca8459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.939+0000 7fd4d1034740 4 client.17010 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:35:28.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.939+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bcca72ffd0 con 0x55bcca3b61c0 2024-05-14T09:35:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.939+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3b61c0 0x55bcca8459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.940+0000 7fd4acc00640 10 client.17010 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.940+0000 7fd4c2a00640 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3b61c0 0x55bcca8459c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff96f5cc216e8aec server_cookie=9a37c8301f931941 in_seq=0 out_seq=0 2024-05-14T09:35:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.968+0000 7fd4acc00640 1 -- 172.21.15.120:0/997460823 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bcca72ffd0 con 0x55bcca3b61c0 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.968+0000 7fd4acc00640 10 client.17010 handle_command_reply: tid=0 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.968+0000 7fd4d1034740 1 client.17010 shutdown 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 msgr2=0x55bcca7d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d27e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4014010 tx=0x7fd4b4009780 comp rx=0 tx=0).stop 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 shutdown_connections 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bcca3b61c0 0x55bcca8459c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcca4221b0 0x55bcca841bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bcca4014d0 0x55bcca7d27e0 secure :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4014010 tx=0x7fd4b4009780 comp rx=0 tx=0).stop 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 --2- 172.21.15.120:0/997460823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcca3f92f0 0x55bcca7d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 >> 172.21.15.120:0/997460823 conn(0x55bcca416300 msgr2=0x55bcca7c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.969+0000 7fd4acc00640 0 client.17010 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:28.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.970+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 shutdown_connections 2024-05-14T09:35:28.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.970+0000 7fd4d1034740 1 -- 172.21.15.120:0/997460823 wait complete. 2024-05-14T09:35:28.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.971+0000 7fd4d1034740 20 client.17010 trim_cache size 0 max 16384 2024-05-14T09:35:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:35:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:35:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:35:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:35:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.972+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4a80b2930 msgr2=0x7fd4a80b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.972+0000 7fd4ca000640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4a80b2930 0x7fd4a80b4e40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00ca00 tx=0x7fd4bc005b40 comp rx=0 tx=0).stop 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.972+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4195030 msgr2=0x7fd4c4195510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.972+0000 7fd4ca000640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4195030 0x7fd4c4195510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00ca30 tx=0x7fd4bc00cef0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.973+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 shutdown_connections 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.973+0000 7fd4ca000640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd4a80b2930 0x7fd4a80b4e40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.973+0000 7fd4ca000640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4c4195030 0x7fd4c4195510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.973+0000 7fd4ca000640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4c4109900 0x7fd4c4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.973+0000 7fd4ca000640 1 --2- 172.21.15.120:0/737631701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c41043a0 0x7fd4c41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:28.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.973+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 >> 172.21.15.120:0/737631701 conn(0x7fd4c40fdd40 msgr2=0x7fd4c4102370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:28.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.974+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 shutdown_connections 2024-05-14T09:35:28.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:28.974+0000 7fd4ca000640 1 -- 172.21.15.120:0/737631701 wait complete. 2024-05-14T09:35:29.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 475.0 s, 556.0 tps, lat 179.328 ms stddev 263.250 2024-05-14T09:35:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:30 smithi152 ceph-mon[34868]: pgmap v914: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 666 op/s 2024-05-14T09:35:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:30 smithi175 ceph-mon[35353]: pgmap v914: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 666 op/s 2024-05-14T09:35:30.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:30 smithi120 ceph-mon[31085]: pgmap v914: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 666 op/s 2024-05-14T09:35:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:32 smithi152 ceph-mon[34868]: pgmap v915: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 614 op/s 2024-05-14T09:35:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:32 smithi175 ceph-mon[35353]: pgmap v915: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 614 op/s 2024-05-14T09:35:32.637 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:32 smithi120 ceph-mon[31085]: pgmap v915: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 614 op/s 2024-05-14T09:35:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 480.0 s, 554.8 tps, lat 181.636 ms stddev 258.040 2024-05-14T09:35:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:34 smithi152 ceph-mon[34868]: pgmap v916: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 571 op/s 2024-05-14T09:35:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:34 smithi175 ceph-mon[35353]: pgmap v916: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 571 op/s 2024-05-14T09:35:34.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:34 smithi120 ceph-mon[31085]: pgmap v916: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 571 op/s 2024-05-14T09:35:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:36 smithi152 ceph-mon[34868]: pgmap v917: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 640 op/s 2024-05-14T09:35:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:36 smithi175 ceph-mon[35353]: pgmap v917: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 640 op/s 2024-05-14T09:35:36.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:36 smithi120 ceph-mon[31085]: pgmap v917: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 640 op/s 2024-05-14T09:35:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:38 smithi152 ceph-mon[34868]: pgmap v918: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.5 MiB/s wr, 596 op/s 2024-05-14T09:35:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:38 smithi175 ceph-mon[35353]: pgmap v918: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.5 MiB/s wr, 596 op/s 2024-05-14T09:35:38.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:38 smithi120 ceph-mon[31085]: pgmap v918: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.5 MiB/s wr, 596 op/s 2024-05-14T09:35:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 485.0 s, 572.3 tps, lat 141.434 ms stddev 60.911 2024-05-14T09:35:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:40 smithi175 ceph-mon[35353]: pgmap v919: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 626 op/s 2024-05-14T09:35:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:40 smithi120 ceph-mon[31085]: pgmap v919: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 626 op/s 2024-05-14T09:35:40.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:40 smithi152 ceph-mon[34868]: pgmap v919: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 626 op/s 2024-05-14T09:35:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.414+0000 7f927d600640 1 -- 172.21.15.120:0/4123557479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 msgr2=0x7f9278103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.414+0000 7f927d600640 1 --2- 172.21.15.120:0/4123557479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 0x7f9278103850 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9268009ca0 tx=0x7f926802a8c0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.414+0000 7f927d600640 1 -- 172.21.15.120:0/4123557479 shutdown_connections 2024-05-14T09:35:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.414+0000 7f927d600640 1 --2- 172.21.15.120:0/4123557479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9278108a90 0x7f927810aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.414+0000 7f927d600640 1 --2- 172.21.15.120:0/4123557479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9278103d90 0x7f92781041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.414+0000 7f927d600640 1 --2- 172.21.15.120:0/4123557479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 0x7f9278103850 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.414+0000 7f927d600640 1 -- 172.21.15.120:0/4123557479 >> 172.21.15.120:0/4123557479 conn(0x7f92780fdd40 msgr2=0x7f92781001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.416+0000 7f927d600640 1 -- 172.21.15.120:0/4123557479 shutdown_connections 2024-05-14T09:35:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.416+0000 7f927d600640 1 -- 172.21.15.120:0/4123557479 wait complete. 2024-05-14T09:35:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.418+0000 7f927d600640 1 Processor -- start 2024-05-14T09:35:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.418+0000 7f927d600640 1 -- start start 2024-05-14T09:35:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.418+0000 7f927d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 0x7f92781a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f927d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9278103d90 0x7f92781a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f927d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9278108a90 0x7f92781a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 0x7f92781a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f927d600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f927810d420 con 0x7f9278103d90 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f927d600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f927810d2a0 con 0x7f9278108a90 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f927d600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f927810d5a0 con 0x7f9278102b50 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 0x7f92781a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:39730/0 (socket says 172.21.15.120:39730) 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f9276a00640 1 -- 172.21.15.120:0/521232933 learned_addr learned my addr 172.21.15.120:0/521232933 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.419+0000 7f9276000640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9278103d90 0x7f92781a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.420+0000 7f9277400640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9278108a90 0x7f92781a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.420+0000 7f9276000640 1 -- 172.21.15.120:0/521232933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 msgr2=0x7f92781a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.420+0000 7f9276000640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 0x7f92781a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.420+0000 7f9276000640 1 -- 172.21.15.120:0/521232933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9278108a90 msgr2=0x7f92781a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.420+0000 7f9276000640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9278108a90 0x7f92781a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.420+0000 7f9276000640 1 -- 172.21.15.120:0/521232933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92781a8330 con 0x7f9278103d90 2024-05-14T09:35:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.421+0000 7f9276000640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9278103d90 0x7f92781a0de0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9264005fd0 tx=0x7f926400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.421+0000 7f926f400640 1 -- 172.21.15.120:0/521232933 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264009c30 con 0x7f9278103d90 2024-05-14T09:35:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.421+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92781a8620 con 0x7f9278103d90 2024-05-14T09:35:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.421+0000 7f926f400640 1 -- 172.21.15.120:0/521232933 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92640044c0 con 0x7f9278103d90 2024-05-14T09:35:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.421+0000 7f926f400640 1 -- 172.21.15.120:0/521232933 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264003d70 con 0x7f9278103d90 2024-05-14T09:35:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.421+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92781a8bc0 con 0x7f9278103d90 2024-05-14T09:35:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.425+0000 7f9284622740 1 Processor -- start 2024-05-14T09:35:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.426+0000 7f9284622740 1 -- start start 2024-05-14T09:35:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.426+0000 7f9284622740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 0x556c2b846100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.426+0000 7f9284622740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b47b2f0 0x556c2b846680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.426+0000 7f9284622740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4834d0 0x556c2b84d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.426+0000 7f9284622740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556c2b7aa550 con 0x556c2b4a41b0 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.426+0000 7f9284622740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556c2b74fbc0 con 0x556c2b4834d0 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.426+0000 7f9284622740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556c2b7a6510 con 0x556c2b47b2f0 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b47b2f0 0x556c2b846680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b47b2f0 0x556c2b846680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:39740/0 (socket says 172.21.15.120:39740) 2024-05-14T09:35:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 -- 172.21.15.120:0/2479427294 learned_addr learned my addr 172.21.15.120:0/2479427294 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 -- 172.21.15.120:0/2479427294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4834d0 msgr2=0x556c2b84d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:35:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 --2- 172.21.15.120:0/2479427294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4834d0 0x556c2b84d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 -- 172.21.15.120:0/2479427294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 msgr2=0x556c2b846100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 --2- 172.21.15.120:0/2479427294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 0x556c2b846100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.427+0000 7f9276a00640 1 -- 172.21.15.120:0/2479427294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2b4bc210 con 0x556c2b47b2f0 2024-05-14T09:35:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.428+0000 7f9276a00640 1 --2- 172.21.15.120:0/2479427294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b47b2f0 0x556c2b846680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9268031580 tx=0x7f9268009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd46b7e3068db3ab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.428+0000 7f9263400640 1 -- 172.21.15.120:0/2479427294 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268031c80 con 0x556c2b47b2f0 2024-05-14T09:35:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.428+0000 7f9263400640 1 -- 172.21.15.120:0/2479427294 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9268036040 con 0x556c2b47b2f0 2024-05-14T09:35:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.428+0000 7f9263400640 1 -- 172.21.15.120:0/2479427294 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92680046b0 con 0x556c2b47b2f0 2024-05-14T09:35:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.430+0000 7f9284622740 1 -- 172.21.15.120:0/2479427294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b47b2f0 msgr2=0x556c2b846680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.430+0000 7f9284622740 1 --2- 172.21.15.120:0/2479427294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b47b2f0 0x556c2b846680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9268031580 tx=0x7f9268009a20 comp rx=0 tx=0).stop 2024-05-14T09:35:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.430+0000 7f9284622740 1 -- 172.21.15.120:0/2479427294 shutdown_connections 2024-05-14T09:35:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.430+0000 7f9284622740 1 --2- 172.21.15.120:0/2479427294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4834d0 0x556c2b84d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.430+0000 7f9284622740 1 --2- 172.21.15.120:0/2479427294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b47b2f0 0x556c2b846680 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9268031580 tx=0x7f9268009a20 comp rx=0 tx=0).stop 2024-05-14T09:35:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.430+0000 7f9284622740 1 --2- 172.21.15.120:0/2479427294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 0x556c2b846100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.430+0000 7f9284622740 1 -- 172.21.15.120:0/2479427294 >> 172.21.15.120:0/2479427294 conn(0x556c2b498300 msgr2=0x556c2b841a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.437+0000 7f926f400640 1 -- 172.21.15.120:0/521232933 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f9264003f10 con 0x7f9278103d90 2024-05-14T09:35:42.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.438+0000 7f9284622740 1 -- 172.21.15.120:0/2479427294 shutdown_connections 2024-05-14T09:35:42.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.438+0000 7f9284622740 1 -- 172.21.15.120:0/2479427294 wait complete. 2024-05-14T09:35:42.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.438+0000 7f9284622740 1 -- start start 2024-05-14T09:35:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.439+0000 7f9284622740 1 Processor -- start 2024-05-14T09:35:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.439+0000 7f9284622740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 0x556c2b84fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9284622740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b462d80 0x556c2b8503b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9284622740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4381c0 0x556c2b857310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9284622740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556c2b84df70 con 0x556c2b4a41b0 2024-05-14T09:35:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9284622740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556c2b763660 con 0x556c2b4381c0 2024-05-14T09:35:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9284622740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556c2b84e0f0 con 0x556c2b462d80 2024-05-14T09:35:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9284622740 10 client.0 _ll_register_callbacks cb 0x556c2b72d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9277400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 0x556c2b84fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b462d80 0x556c2b8503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b462d80 0x556c2b8503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:39754/0 (socket says 172.21.15.120:39754) 2024-05-14T09:35:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f9276a00640 1 -- 172.21.15.120:0/1736020289 learned_addr learned my addr 172.21.15.120:0/1736020289 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.440+0000 7f926f400640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f925c0b2790 0x7f925c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.441+0000 7f9276000640 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4381c0 0x556c2b857310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.441+0000 7f926f400640 1 -- 172.21.15.120:0/521232933 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f92640e2180 con 0x7f9278103d90 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.441+0000 7f9276a00640 1 -- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4381c0 msgr2=0x556c2b857310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.441+0000 7f9276a00640 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4381c0 0x556c2b857310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.441+0000 7f9276a00640 1 -- 172.21.15.120:0/1736020289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 msgr2=0x556c2b84fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.441+0000 7f9276a00640 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 0x556c2b84fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.441+0000 7f9276a00640 1 -- 172.21.15.120:0/1736020289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2b588620 con 0x556c2b462d80 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.442+0000 7f9257e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:35:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.442+0000 7f9276a00640 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b462d80 0x556c2b8503b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9268031920 tx=0x7f9268031b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=343db3a7acc55dcd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.442+0000 7f9277400640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f925c0b2790 0x7f925c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.443+0000 7f9257e00640 1 -- 172.21.15.120:0/1736020289 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926804a040 con 0x556c2b462d80 2024-05-14T09:35:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.443+0000 7f9257e00640 1 -- 172.21.15.120:0/1736020289 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9268004450 con 0x556c2b462d80 2024-05-14T09:35:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.443+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9268036040 con 0x556c2b462d80 2024-05-14T09:35:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.445+0000 7f9257e00640 1 -- 172.21.15.120:0/1736020289 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f9268004670 con 0x556c2b462d80 2024-05-14T09:35:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.445+0000 7f9284622740 10 client.26581 fetch_fsmap learned FSMap version 61 2024-05-14T09:35:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.445+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x556c2b84df70 con 0x556c2b462d80 2024-05-14T09:35:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.445+0000 7f9277400640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f925c0b2790 0x7f925c0b4ca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9270004700 tx=0x7f927000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.446+0000 7f9257e00640 1 -- 172.21.15.120:0/1736020289 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9268036040 con 0x556c2b462d80 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.446+0000 7f9257e00640 1 -- 172.21.15.120:0/1736020289 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 61) ==== 8394+0+0 (secure 0 0 0) 0x7f926804d070 con 0x556c2b462d80 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.447+0000 7f9284622740 10 client.26581 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.447+0000 7f9284622740 10 client.26581 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.447+0000 7f9284622740 20 client.26581 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.447+0000 7f9284622740 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b85b430 0x556c2b85d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.447+0000 7f9284622740 4 client.26581 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.447+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c2b7b8160 con 0x556c2b85b430 2024-05-14T09:35:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.448+0000 7f9276000640 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b85b430 0x556c2b85d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.449+0000 7f9276000640 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b85b430 0x556c2b85d850 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e638acb38ceaf56 server_cookie=57ec63bf61648a2 in_seq=0 out_seq=0 2024-05-14T09:35:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.449+0000 7f9257e00640 10 client.26581 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:42.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.452+0000 7f9257e00640 1 -- 172.21.15.120:0/1736020289 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556c2b7b8160 con 0x556c2b85b430 2024-05-14T09:35:42.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.452+0000 7f9257e00640 10 client.26581 handle_command_reply: tid=0 2024-05-14T09:35:42.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.452+0000 7f9284622740 1 client.26581 shutdown 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b462d80 msgr2=0x556c2b8503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b462d80 0x556c2b8503b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9268031920 tx=0x7f9268031b10 comp rx=0 tx=0).stop 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 shutdown_connections 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b85b430 0x556c2b85d850 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4381c0 0x556c2b857310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b462d80 0x556c2b8503b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 --2- 172.21.15.120:0/1736020289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b4a41b0 0x556c2b84fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9257e00640 0 client.26581 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.453+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 >> 172.21.15.120:0/1736020289 conn(0x556c2b498300 msgr2=0x556c2b8449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:42.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.454+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 shutdown_connections 2024-05-14T09:35:42.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.454+0000 7f9284622740 1 -- 172.21.15.120:0/1736020289 wait complete. 2024-05-14T09:35:42.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.455+0000 7f9284622740 20 client.26581 trim_cache size 0 max 16384 2024-05-14T09:35:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:42 smithi175 ceph-mon[35353]: pgmap v920: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.8 MiB/s wr, 594 op/s 2024-05-14T09:35:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.486+0000 7f9284622740 1 Processor -- start 2024-05-14T09:35:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.486+0000 7f9284622740 1 -- start start 2024-05-14T09:35:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.486+0000 7f9284622740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b840000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.487+0000 7f9284622740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b857230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.487+0000 7f9284622740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b840540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.487+0000 7f9284622740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f92781b3040 con 0x556c2b462d80 2024-05-14T09:35:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.487+0000 7f9284622740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92781b4d00 con 0x556c2b4a41b0 2024-05-14T09:35:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.487+0000 7f9284622740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92781b3710 con 0x556c2b4381c0 2024-05-14T09:35:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.487+0000 7f9277400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b840540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.487+0000 7f9277400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b840540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37956/0 (socket says 172.21.15.120:37956) 2024-05-14T09:35:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.488+0000 7f9277400640 1 -- 172.21.15.120:0/1854790033 learned_addr learned my addr 172.21.15.120:0/1854790033 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.488+0000 7f9276a00640 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b840000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.488+0000 7f9276000640 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b857230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.489+0000 7f9276000640 1 -- 172.21.15.120:0/1854790033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 msgr2=0x556c2b840000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.489+0000 7f9276000640 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b840000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.489+0000 7f9276000640 1 -- 172.21.15.120:0/1854790033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 msgr2=0x556c2b840540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.489+0000 7f9276000640 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b840540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.489+0000 7f9276000640 1 -- 172.21.15.120:0/1854790033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2b841e80 con 0x556c2b462d80 2024-05-14T09:35:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.490+0000 7f9276a00640 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b840000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:35:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.490+0000 7f9277400640 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b840540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:35:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.490+0000 7f9276000640 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b857230 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x556c2b847300 tx=0x7f9264009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc37c25af0cd74f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.491+0000 7f9262a00640 1 -- 172.21.15.120:0/1854790033 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264020040 con 0x556c2b462d80 2024-05-14T09:35:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.491+0000 7f9262a00640 1 -- 172.21.15.120:0/1854790033 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92640a93a0 con 0x556c2b462d80 2024-05-14T09:35:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.491+0000 7f9262a00640 1 -- 172.21.15.120:0/1854790033 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92640a5630 con 0x556c2b462d80 2024-05-14T09:35:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.492+0000 7f9284622740 1 -- 172.21.15.120:0/1854790033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 msgr2=0x556c2b857230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.492+0000 7f9284622740 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b857230 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x556c2b847300 tx=0x7f9264009e60 comp rx=0 tx=0).stop 2024-05-14T09:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 -- 172.21.15.120:0/1854790033 shutdown_connections 2024-05-14T09:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b840540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b857230 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 --2- 172.21.15.120:0/1854790033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b840000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 -- 172.21.15.120:0/1854790033 >> 172.21.15.120:0/1854790033 conn(0x556c2b498300 msgr2=0x556c2b84a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 -- 172.21.15.120:0/1854790033 shutdown_connections 2024-05-14T09:35:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 -- 172.21.15.120:0/1854790033 wait complete. 2024-05-14T09:35:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.493+0000 7f9284622740 1 -- start start 2024-05-14T09:35:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.494+0000 7f9284622740 1 Processor -- start 2024-05-14T09:35:42.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.497+0000 7f9284622740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b854720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.497+0000 7f9284622740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b854c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.497+0000 7f9284622740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b855b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9284622740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f92781b4570 con 0x556c2b462d80 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9284622740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92781b3ea0 con 0x556c2b4a41b0 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9284622740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92781b1040 con 0x556c2b4381c0 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9284622740 10 client.0 _ll_register_callbacks cb 0x7f9268031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b854720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9276a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b854720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:39764/0 (socket says 172.21.15.120:39764) 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9276a00640 1 -- 172.21.15.120:0/2003705517 learned_addr learned my addr 172.21.15.120:0/2003705517 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.498+0000 7f9277400640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b855b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9276000640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b854c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9276a00640 1 -- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 msgr2=0x556c2b855b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9276a00640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b855b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9276a00640 1 -- 172.21.15.120:0/2003705517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 msgr2=0x556c2b854c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9276a00640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b854c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9276a00640 1 -- 172.21.15.120:0/2003705517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2b856150 con 0x556c2b4381c0 2024-05-14T09:35:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9276000640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b854c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:35:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.499+0000 7f9277400640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b855b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:35:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.500+0000 7f9276a00640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b854720 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f926802a900 tx=0x7f9268009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a95241b6098dc25 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.500+0000 7f9257e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.500+0000 7f9257e00640 1 -- 172.21.15.120:0/2003705517 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268060070 con 0x556c2b4381c0 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.501+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92640a93a0 con 0x556c2b4381c0 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.501+0000 7f9257e00640 1 -- 172.21.15.120:0/2003705517 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f9268030ca0 con 0x556c2b4381c0 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.501+0000 7f9257e00640 1 -- 172.21.15.120:0/2003705517 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f9268030ea0 con 0x556c2b4381c0 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.501+0000 7f9284622740 10 client.26587 fetch_fsmap learned FSMap version 61 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.501+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x556c2b857440 con 0x556c2b4381c0 2024-05-14T09:35:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.502+0000 7f9257e00640 1 -- 172.21.15.120:0/2003705517 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92640a93a0 con 0x556c2b4381c0 2024-05-14T09:35:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.502+0000 7f9257e00640 1 -- 172.21.15.120:0/2003705517 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 61) ==== 8394+0+0 (secure 0 0 0) 0x7f9268063020 con 0x556c2b4381c0 2024-05-14T09:35:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.503+0000 7f9284622740 10 client.26587 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T09:35:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.503+0000 7f9284622740 10 client.26587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.503+0000 7f9284622740 20 client.26587 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.503+0000 7f9284622740 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b8c62a0 0x556c2b8c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.503+0000 7f9284622740 4 client.26587 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:35:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.503+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c2b7b1fd0 con 0x556c2b8c62a0 2024-05-14T09:35:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.504+0000 7f9276000640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b8c62a0 0x556c2b8c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:42.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.506+0000 7f9257e00640 10 client.26587 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:42.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.506+0000 7f9276000640 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b8c62a0 0x556c2b8c86c0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4503116c04ce9a9b server_cookie=bf0d269b74918c9c in_seq=0 out_seq=0 2024-05-14T09:35:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.530+0000 7f9257e00640 1 -- 172.21.15.120:0/2003705517 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c2b7b1fd0 con 0x556c2b8c62a0 2024-05-14T09:35:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.530+0000 7f9257e00640 10 client.26587 handle_command_reply: tid=0 2024-05-14T09:35:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.530+0000 7f9284622740 1 client.26587 shutdown 2024-05-14T09:35:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 msgr2=0x556c2b854720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b854720 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f926802a900 tx=0x7f9268009880 comp rx=0 tx=0).stop 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 shutdown_connections 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c2b8c62a0 0x556c2b8c86c0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c2b4a41b0 0x556c2b855b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c2b462d80 0x556c2b854c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 --2- 172.21.15.120:0/2003705517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c2b4381c0 0x556c2b854720 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 >> 172.21.15.120:0/2003705517 conn(0x556c2b498300 msgr2=0x556c2b844910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9257e00640 0 client.26587 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 shutdown_connections 2024-05-14T09:35:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.531+0000 7f9284622740 1 -- 172.21.15.120:0/2003705517 wait complete. 2024-05-14T09:35:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.532+0000 7f9284622740 20 client.26587 trim_cache size 0 max 16384 2024-05-14T09:35:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:35:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:35:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:35:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f925c0b2790 msgr2=0x7f925c0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f925c0b2790 0x7f925c0b4ca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9270004700 tx=0x7f927000a250 comp rx=0 tx=0).stop 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9278103d90 msgr2=0x7f92781a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9278103d90 0x7f92781a0de0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9264005fd0 tx=0x7f926400dde0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 shutdown_connections 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f925c0b2790 0x7f925c0b4ca0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9278108a90 0x7f92781a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9278103d90 0x7f92781a0de0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 --2- 172.21.15.120:0/521232933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9278102b50 0x7f92781a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.533+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 >> 172.21.15.120:0/521232933 conn(0x7f92780fdd40 msgr2=0x7f9278100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.534+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 shutdown_connections 2024-05-14T09:35:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:42.534+0000 7f927d600640 1 -- 172.21.15.120:0/521232933 wait complete. 2024-05-14T09:35:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:42 smithi120 ceph-mon[31085]: pgmap v920: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.8 MiB/s wr, 594 op/s 2024-05-14T09:35:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:42 smithi152 ceph-mon[34868]: pgmap v920: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.8 MiB/s wr, 594 op/s 2024-05-14T09:35:44.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 490.0 s, 687.6 tps, lat 172.022 ms stddev 220.357 2024-05-14T09:35:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:44 smithi175 ceph-mon[35353]: pgmap v921: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.9 MiB/s wr, 604 op/s 2024-05-14T09:35:44.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:44 smithi152 ceph-mon[34868]: pgmap v921: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.9 MiB/s wr, 604 op/s 2024-05-14T09:35:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:44 smithi120 ceph-mon[31085]: pgmap v921: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.9 MiB/s wr, 604 op/s 2024-05-14T09:35:46.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:46 smithi120 ceph-mon[31085]: pgmap v922: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 648 op/s 2024-05-14T09:35:46.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:46 smithi152 ceph-mon[34868]: pgmap v922: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 648 op/s 2024-05-14T09:35:46.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:46 smithi175 ceph-mon[35353]: pgmap v922: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 648 op/s 2024-05-14T09:35:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:48 smithi120 ceph-mon[31085]: pgmap v923: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.4 MiB/s wr, 608 op/s 2024-05-14T09:35:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:48 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:48 smithi152 ceph-mon[34868]: pgmap v923: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.4 MiB/s wr, 608 op/s 2024-05-14T09:35:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:48 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:48.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:48 smithi175 ceph-mon[35353]: pgmap v923: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.4 MiB/s wr, 608 op/s 2024-05-14T09:35:48.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:48 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:35:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 495.0 s, 612.1 tps, lat 163.288 ms stddev 242.829 2024-05-14T09:35:49.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:49 smithi120 ceph-mon[31085]: pgmap v924: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.9 MiB/s wr, 644 op/s 2024-05-14T09:35:49.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:49 smithi152 ceph-mon[34868]: pgmap v924: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.9 MiB/s wr, 644 op/s 2024-05-14T09:35:49.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:49 smithi175 ceph-mon[35353]: pgmap v924: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.9 MiB/s wr, 644 op/s 2024-05-14T09:35:51.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:50 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:35:51.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:50 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:35:51.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:50 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:35:52.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:51 smithi152 ceph-mon[34868]: pgmap v925: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.0 MiB/s wr, 613 op/s 2024-05-14T09:35:52.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:51 smithi175 ceph-mon[35353]: pgmap v925: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.0 MiB/s wr, 613 op/s 2024-05-14T09:35:52.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:51 smithi120 ceph-mon[31085]: pgmap v925: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.0 MiB/s wr, 613 op/s 2024-05-14T09:35:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:52 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:35:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:52 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:35:53.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:52 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:35:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:52 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:35:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:52 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:35:53.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:52 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:35:53.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:52 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:35:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:52 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:35:53.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:52 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:35:54.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:53 smithi152 ceph-mon[34868]: pgmap v926: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.3 MiB/s wr, 570 op/s 2024-05-14T09:35:54.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:53 smithi175 ceph-mon[35353]: pgmap v926: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.3 MiB/s wr, 570 op/s 2024-05-14T09:35:54.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 500.0 s, 518.9 tps, lat 145.988 ms stddev 44.825 2024-05-14T09:35:54.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:53 smithi120 ceph-mon[31085]: pgmap v926: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.3 MiB/s wr, 570 op/s 2024-05-14T09:35:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.862+0000 7f3c82800640 1 -- 172.21.15.120:0/837276233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c104380 msgr2=0x7f3c7c1067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.862+0000 7f3c82800640 1 --2- 172.21.15.120:0/837276233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c104380 0x7f3c7c1067a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009900 tx=0x7f3c6c02a3f0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.862+0000 7f3c82800640 1 -- 172.21.15.120:0/837276233 shutdown_connections 2024-05-14T09:35:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.862+0000 7f3c82800640 1 --2- 172.21.15.120:0/837276233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c7c1098e0 0x7f3c7c10bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.862+0000 7f3c82800640 1 --2- 172.21.15.120:0/837276233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c106d70 0x7f3c7c109250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.862+0000 7f3c82800640 1 --2- 172.21.15.120:0/837276233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c104380 0x7f3c7c1067a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.862+0000 7f3c82800640 1 -- 172.21.15.120:0/837276233 >> 172.21.15.120:0/837276233 conn(0x7f3c7c0fdd40 msgr2=0x7f3c7c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.863+0000 7f3c82800640 1 -- 172.21.15.120:0/837276233 shutdown_connections 2024-05-14T09:35:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.863+0000 7f3c82800640 1 -- 172.21.15.120:0/837276233 wait complete. 2024-05-14T09:35:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.864+0000 7f3c82800640 1 Processor -- start 2024-05-14T09:35:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.865+0000 7f3c82800640 1 -- start start 2024-05-14T09:35:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.865+0000 7f3c82800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c7c104380 0x7f3c7c19c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.865+0000 7f3c82800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c106d70 0x7f3c7c19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.865+0000 7f3c82800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c1098e0 0x7f3c7c1a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.865+0000 7f3c82800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c102c30 con 0x7f3c7c106d70 2024-05-14T09:35:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.865+0000 7f3c82800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c102ab0 con 0x7f3c7c104380 2024-05-14T09:35:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.865+0000 7f3c82800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c102db0 con 0x7f3c7c1098e0 2024-05-14T09:35:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.866+0000 7f3c7aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c106d70 0x7f3c7c19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.866+0000 7f3c7aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c106d70 0x7f3c7c19ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36492/0 (socket says 172.21.15.120:36492) 2024-05-14T09:35:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.866+0000 7f3c7aa00640 1 -- 172.21.15.120:0/100080027 learned_addr learned my addr 172.21.15.120:0/100080027 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.866+0000 7f3c7be00640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c1098e0 0x7f3c7c1a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.866+0000 7f3c7b400640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c7c104380 0x7f3c7c19c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.867+0000 7f3c7aa00640 1 -- 172.21.15.120:0/100080027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c1098e0 msgr2=0x7f3c7c1a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.867+0000 7f3c7aa00640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c1098e0 0x7f3c7c1a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.867+0000 7f3c7aa00640 1 -- 172.21.15.120:0/100080027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c7c104380 msgr2=0x7f3c7c19c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.867+0000 7f3c7aa00640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c7c104380 0x7f3c7c19c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.867+0000 7f3c7aa00640 1 -- 172.21.15.120:0/100080027 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c1a4070 con 0x7f3c7c106d70 2024-05-14T09:35:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.868+0000 7f3c7aa00640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c106d70 0x7f3c7c19ca70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009f20 tx=0x7f3c6800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.868+0000 7f3c73e00640 1 -- 172.21.15.120:0/100080027 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800cd80 con 0x7f3c7c106d70 2024-05-14T09:35:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.868+0000 7f3c73e00640 1 -- 172.21.15.120:0/100080027 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c680218d0 con 0x7f3c7c106d70 2024-05-14T09:35:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.868+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7c06c750 con 0x7f3c7c106d70 2024-05-14T09:35:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.869+0000 7f3c73e00640 1 -- 172.21.15.120:0/100080027 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c680297a0 con 0x7f3c7c106d70 2024-05-14T09:35:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.869+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7c06cca0 con 0x7f3c7c106d70 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.873+0000 7f3c897c8740 1 Processor -- start 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.873+0000 7f3c897c8740 1 -- start start 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.873+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237d71b0 0x562e23b79100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.873+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237ae2f0 0x562e23b79680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.874+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 0x562e23b80580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.874+0000 7f3c897c8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562e23add550 con 0x562e237ae2f0 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.874+0000 7f3c897c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e23a82bc0 con 0x562e237b64d0 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.874+0000 7f3c897c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562e23ad9510 con 0x562e237d71b0 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.874+0000 7f3c7b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237ae2f0 0x562e23b79680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.874+0000 7f3c7b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237ae2f0 0x562e23b79680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36496/0 (socket says 172.21.15.120:36496) 2024-05-14T09:35:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.875+0000 7f3c7b400640 1 -- 172.21.15.120:0/2389655284 learned_addr learned my addr 172.21.15.120:0/2389655284 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.875+0000 7f3c7be00640 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237d71b0 0x562e23b79100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.875+0000 7f3c7b400640 1 -- 172.21.15.120:0/2389655284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237d71b0 msgr2=0x562e23b79100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.875+0000 7f3c7b400640 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237d71b0 0x562e23b79100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.875+0000 7f3c7b400640 1 -- 172.21.15.120:0/2389655284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 msgr2=0x562e23b80580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:35:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.876+0000 7f3c7b400640 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 0x562e23b80580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.876+0000 7f3c73e00640 1 -- 172.21.15.120:0/100080027 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3c68021440 con 0x7f3c7c106d70 2024-05-14T09:35:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.876+0000 7f3c7b400640 1 -- 172.21.15.120:0/2389655284 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e237ef210 con 0x562e237ae2f0 2024-05-14T09:35:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.876+0000 7f3c7b400640 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237ae2f0 0x562e23b79680 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009900 tx=0x7f3c6c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38199f875455e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.877+0000 7f3c70c00640 1 -- 172.21.15.120:0/2389655284 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c035030 con 0x562e237ae2f0 2024-05-14T09:35:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.877+0000 7f3c70c00640 1 -- 172.21.15.120:0/2389655284 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c6c040070 con 0x562e237ae2f0 2024-05-14T09:35:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.877+0000 7f3c70c00640 1 -- 172.21.15.120:0/2389655284 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0317f0 con 0x562e237ae2f0 2024-05-14T09:35:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.878+0000 7f3c73e00640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3c600b29b0 0x7f3c600b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.878+0000 7f3c73e00640 1 -- 172.21.15.120:0/100080027 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3c680f3750 con 0x7f3c7c106d70 2024-05-14T09:35:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.879+0000 7f3c897c8740 1 -- 172.21.15.120:0/2389655284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237ae2f0 msgr2=0x562e23b79680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.879+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237ae2f0 0x562e23b79680 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009900 tx=0x7f3c6c0040c0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.880+0000 7f3c897c8740 1 -- 172.21.15.120:0/2389655284 shutdown_connections 2024-05-14T09:35:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.880+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 0x562e23b80580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.880+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237ae2f0 0x562e23b79680 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.880+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2389655284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237d71b0 0x562e23b79100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.880+0000 7f3c897c8740 1 -- 172.21.15.120:0/2389655284 >> 172.21.15.120:0/2389655284 conn(0x562e237cb300 msgr2=0x562e23b74a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.880+0000 7f3c7be00640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3c600b29b0 0x7f3c600b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.881+0000 7f3c897c8740 1 -- 172.21.15.120:0/2389655284 shutdown_connections 2024-05-14T09:35:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.881+0000 7f3c897c8740 1 -- 172.21.15.120:0/2389655284 wait complete. 2024-05-14T09:35:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.882+0000 7f3c897c8740 1 -- start start 2024-05-14T09:35:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.882+0000 7f3c7be00640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3c600b29b0 0x7f3c600b4ec0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x562e23b7a2d0 tx=0x7f3c74009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.882+0000 7f3c897c8740 1 Processor -- start 2024-05-14T09:35:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237ae2f0 0x562e23b8b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 0x562e23b8b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b92910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c897c8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562e23b80f70 con 0x562e237d71b0 2024-05-14T09:35:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c897c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e23a96660 con 0x562e237b64d0 2024-05-14T09:35:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c897c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562e23b810f0 con 0x562e237ae2f0 2024-05-14T09:35:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c897c8740 10 client.0 _ll_register_callbacks cb 0x562e23a60400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b92910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b92910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36498/0 (socket says 172.21.15.120:36498) 2024-05-14T09:35:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.883+0000 7f3c7be00640 1 -- 172.21.15.120:0/1004601014 learned_addr learned my addr 172.21.15.120:0/1004601014 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.884+0000 7f3c7aa00640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 0x562e23b8b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.884+0000 7f3c7b400640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237ae2f0 0x562e23b8b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.884+0000 7f3c7be00640 1 -- 172.21.15.120:0/1004601014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237ae2f0 msgr2=0x562e23b8b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.884+0000 7f3c7be00640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237ae2f0 0x562e23b8b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.884+0000 7f3c7be00640 1 -- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 msgr2=0x562e23b8b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.884+0000 7f3c7be00640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 0x562e23b8b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.884+0000 7f3c7be00640 1 -- 172.21.15.120:0/1004601014 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e238bb620 con 0x562e237d71b0 2024-05-14T09:35:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.885+0000 7f3c7b400640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237ae2f0 0x562e23b8b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.885+0000 7f3c7be00640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b92910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3c74010950 tx=0x7f3c74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb6172a9a7e22f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.885+0000 7f3c65600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.885+0000 7f3c65600640 1 -- 172.21.15.120:0/1004601014 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400fcf0 con 0x562e237d71b0 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.885+0000 7f3c65600640 1 -- 172.21.15.120:0/1004601014 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3c74027400 con 0x562e237d71b0 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.886+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c6c040070 con 0x562e237d71b0 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.886+0000 7f3c65600640 1 -- 172.21.15.120:0/1004601014 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3c74027600 con 0x562e237d71b0 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.886+0000 7f3c897c8740 10 client.17034 fetch_fsmap learned FSMap version 62 2024-05-14T09:35:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.886+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x562e23b95910 con 0x562e237d71b0 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.887+0000 7f3c65600640 1 -- 172.21.15.120:0/1004601014 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c6c040070 con 0x562e237d71b0 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.887+0000 7f3c65600640 1 -- 172.21.15.120:0/1004601014 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 62) ==== 8382+0+0 (secure 0 0 0) 0x7f3c7400f040 con 0x562e237d71b0 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.887+0000 7f3c897c8740 10 client.17034 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.887+0000 7f3c897c8740 10 client.17034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.888+0000 7f3c897c8740 20 client.17034 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.888+0000 7f3c897c8740 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e23795d80 0x562e23b99110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.888+0000 7f3c897c8740 4 client.17034 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:35:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.888+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e23aeb160 con 0x562e23795d80 2024-05-14T09:35:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.888+0000 7f3c7b400640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e23795d80 0x562e23b99110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.890+0000 7f3c65600640 10 client.17034 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.890+0000 7f3c7b400640 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e23795d80 0x562e23b99110 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4122436d5ca6964 server_cookie=c4796af0ecd5550a in_seq=0 out_seq=0 2024-05-14T09:35:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.892+0000 7f3c65600640 1 -- 172.21.15.120:0/1004601014 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562e23aeb160 con 0x562e23795d80 2024-05-14T09:35:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.892+0000 7f3c65600640 10 client.17034 handle_command_reply: tid=0 2024-05-14T09:35:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 client.17034 shutdown 2024-05-14T09:35:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 msgr2=0x562e23b92910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b92910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3c74010950 tx=0x7f3c74004a40 comp rx=0 tx=0).stop 2024-05-14T09:35:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 shutdown_connections 2024-05-14T09:35:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e23795d80 0x562e23b99110 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b92910 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237b64d0 0x562e23b8b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 --2- 172.21.15.120:0/1004601014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237ae2f0 0x562e23b8b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.893+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 >> 172.21.15.120:0/1004601014 conn(0x562e237cb300 msgr2=0x562e23b779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.894+0000 7f3c65600640 0 client.17034 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.894+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 shutdown_connections 2024-05-14T09:35:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.894+0000 7f3c897c8740 1 -- 172.21.15.120:0/1004601014 wait complete. 2024-05-14T09:35:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.894+0000 7f3c897c8740 20 client.17034 trim_cache size 0 max 16384 2024-05-14T09:35:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.917+0000 7f3c897c8740 1 Processor -- start 2024-05-14T09:35:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.917+0000 7f3c897c8740 1 -- start start 2024-05-14T09:35:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.918+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b77890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.918+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b77dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.918+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b78310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.918+0000 7f3c897c8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c00fbd0 con 0x562e237d71b0 2024-05-14T09:35:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.918+0000 7f3c897c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c011800 con 0x562e237ae2f0 2024-05-14T09:35:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.918+0000 7f3c897c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c0102a0 con 0x562e237b64d0 2024-05-14T09:35:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.919+0000 7f3c7b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b77890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.919+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b78310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.919+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b78310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36504/0 (socket says 172.21.15.120:36504) 2024-05-14T09:35:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.919+0000 7f3c7be00640 1 -- 172.21.15.120:0/3441496227 learned_addr learned my addr 172.21.15.120:0/3441496227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.919+0000 7f3c7b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b77890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42256/0 (socket says 172.21.15.120:42256) 2024-05-14T09:35:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.919+0000 7f3c7aa00640 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b77dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.920+0000 7f3c7be00640 1 -- 172.21.15.120:0/3441496227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 msgr2=0x562e23b77dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.920+0000 7f3c7be00640 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b77dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.920+0000 7f3c7be00640 1 -- 172.21.15.120:0/3441496227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 msgr2=0x562e23b77890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.920+0000 7f3c7be00640 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b77890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.920+0000 7f3c7be00640 1 -- 172.21.15.120:0/3441496227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e23b6fec0 con 0x562e237d71b0 2024-05-14T09:35:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.921+0000 7f3c7be00640 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b78310 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3c74012cc0 tx=0x7f3c74012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854a3a6a035b74e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.921+0000 7f3c67e00640 1 -- 172.21.15.120:0/3441496227 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74036070 con 0x562e237d71b0 2024-05-14T09:35:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.921+0000 7f3c67e00640 1 -- 172.21.15.120:0/3441496227 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c74004ab0 con 0x562e237d71b0 2024-05-14T09:35:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.921+0000 7f3c67e00640 1 -- 172.21.15.120:0/3441496227 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74027a00 con 0x562e237d71b0 2024-05-14T09:35:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 -- 172.21.15.120:0/3441496227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 msgr2=0x562e23b78310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b78310 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3c74012cc0 tx=0x7f3c74012f90 comp rx=0 tx=0).stop 2024-05-14T09:35:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 -- 172.21.15.120:0/3441496227 shutdown_connections 2024-05-14T09:35:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b78310 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b77dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 --2- 172.21.15.120:0/3441496227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b77890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 -- 172.21.15.120:0/3441496227 >> 172.21.15.120:0/3441496227 conn(0x562e237cb300 msgr2=0x562e23b7d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 -- 172.21.15.120:0/3441496227 shutdown_connections 2024-05-14T09:35:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.923+0000 7f3c897c8740 1 -- 172.21.15.120:0/3441496227 wait complete. 2024-05-14T09:35:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.924+0000 7f3c897c8740 1 -- start start 2024-05-14T09:35:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.924+0000 7f3c897c8740 1 Processor -- start 2024-05-14T09:35:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.925+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b93070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.925+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b8fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.925+0000 7f3c897c8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b90220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.925+0000 7f3c897c8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c011100 con 0x562e237d71b0 2024-05-14T09:35:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.925+0000 7f3c897c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c010a30 con 0x562e237ae2f0 2024-05-14T09:35:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.925+0000 7f3c897c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c00dbd0 con 0x562e237b64d0 2024-05-14T09:35:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.925+0000 7f3c897c8740 10 client.0 _ll_register_callbacks cb 0x7f3c74009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:35:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.926+0000 7f3c7aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b8fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.926+0000 7f3c7b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b93070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.926+0000 7f3c7b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b93070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42268/0 (socket says 172.21.15.120:42268) 2024-05-14T09:35:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.926+0000 7f3c7b400640 1 -- 172.21.15.120:0/2461207298 learned_addr learned my addr 172.21.15.120:0/2461207298 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:35:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.926+0000 7f3c7be00640 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b90220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.927+0000 7f3c7be00640 1 -- 172.21.15.120:0/2461207298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 msgr2=0x562e23b8fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.927+0000 7f3c7be00640 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b8fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.927+0000 7f3c7be00640 1 -- 172.21.15.120:0/2461207298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 msgr2=0x562e23b93070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:35:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.927+0000 7f3c7be00640 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b93070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.927+0000 7f3c7be00640 1 -- 172.21.15.120:0/2461207298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e23bff4a0 con 0x562e237d71b0 2024-05-14T09:35:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.927+0000 7f3c7be00640 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b90220 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3c7403c040 tx=0x7f3c740279d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f44a106e88909 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:35:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.927+0000 7f3c65600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:35:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.928+0000 7f3c65600640 1 -- 172.21.15.120:0/2461207298 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74049060 con 0x562e237d71b0 2024-05-14T09:35:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.928+0000 7f3c65600640 1 -- 172.21.15.120:0/2461207298 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3c740111e0 con 0x562e237d71b0 2024-05-14T09:35:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.928+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c74004ab0 con 0x562e237d71b0 2024-05-14T09:35:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.929+0000 7f3c65600640 1 -- 172.21.15.120:0/2461207298 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3c74036050 con 0x562e237d71b0 2024-05-14T09:35:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.929+0000 7f3c897c8740 10 client.17040 fetch_fsmap learned FSMap version 62 2024-05-14T09:35:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.929+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x562e23c00710 con 0x562e237d71b0 2024-05-14T09:35:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.929+0000 7f3c65600640 1 -- 172.21.15.120:0/2461207298 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c74004ab0 con 0x562e237d71b0 2024-05-14T09:35:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.929+0000 7f3c65600640 1 -- 172.21.15.120:0/2461207298 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 62) ==== 8382+0+0 (secure 0 0 0) 0x7f3c7401fcb0 con 0x562e237d71b0 2024-05-14T09:35:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.930+0000 7f3c897c8740 10 client.17040 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T09:35:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.930+0000 7f3c897c8740 10 client.17040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:35:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.930+0000 7f3c897c8740 20 client.17040 populate_metadata read hostname 'smithi120' 2024-05-14T09:35:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.930+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e2376b1c0 0x562e23c03090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:35:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.930+0000 7f3c897c8740 4 client.17040 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:35:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.930+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e23ae4fd0 con 0x562e2376b1c0 2024-05-14T09:35:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.931+0000 7f3c7b400640 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e2376b1c0 0x562e23c03090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:35:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.932+0000 7f3c7b400640 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e2376b1c0 0x562e23c03090 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde3de311e94b0d8 server_cookie=78bc1b36284e8558 in_seq=0 out_seq=0 2024-05-14T09:35:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.932+0000 7f3c65600640 10 client.17040 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.970+0000 7f3c65600640 1 -- 172.21.15.120:0/2461207298 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e23ae4fd0 con 0x562e2376b1c0 2024-05-14T09:35:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.970+0000 7f3c65600640 10 client.17040 handle_command_reply: tid=0 2024-05-14T09:35:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.971+0000 7f3c897c8740 1 client.17040 shutdown 2024-05-14T09:35:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.971+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 msgr2=0x562e23b90220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.971+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b90220 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3c7403c040 tx=0x7f3c740279d0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.972+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 shutdown_connections 2024-05-14T09:35:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.972+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562e2376b1c0 0x562e23c03090 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.972+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e237d71b0 0x562e23b90220 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.972+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e237b64d0 0x562e23b8fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.972+0000 7f3c65600640 0 client.17040 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:35:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.972+0000 7f3c897c8740 1 --2- 172.21.15.120:0/2461207298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e237ae2f0 0x562e23b93070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.972+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 >> 172.21.15.120:0/2461207298 conn(0x562e237cb300 msgr2=0x562e23b77890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.973+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 shutdown_connections 2024-05-14T09:35:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.973+0000 7f3c897c8740 1 -- 172.21.15.120:0/2461207298 wait complete. 2024-05-14T09:35:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.973+0000 7f3c897c8740 20 client.17040 trim_cache size 0 max 16384 2024-05-14T09:35:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:35:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:35:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.974+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3c600b29b0 msgr2=0x7f3c600b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.974+0000 7f3c82800640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3c600b29b0 0x7f3c600b4ec0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x562e23b7a2d0 tx=0x7f3c74009600 comp rx=0 tx=0).stop 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.974+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c106d70 msgr2=0x7f3c7c19ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.974+0000 7f3c82800640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c106d70 0x7f3c7c19ca70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009f20 tx=0x7f3c6800ee80 comp rx=0 tx=0).stop 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.975+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 shutdown_connections 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.975+0000 7f3c82800640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f3c600b29b0 0x7f3c600b4ec0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.975+0000 7f3c82800640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c1098e0 0x7f3c7c1a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.975+0000 7f3c82800640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7c106d70 0x7f3c7c19ca70 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.975+0000 7f3c82800640 1 --2- 172.21.15.120:0/100080027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c7c104380 0x7f3c7c19c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:35:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.975+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 >> 172.21.15.120:0/100080027 conn(0x7f3c7c0fdd40 msgr2=0x7f3c7c109de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:35:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.976+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 shutdown_connections 2024-05-14T09:35:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:35:55.976+0000 7f3c82800640 1 -- 172.21.15.120:0/100080027 wait complete. 2024-05-14T09:35:56.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:55 smithi152 ceph-mon[34868]: pgmap v927: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.0 MiB/s wr, 618 op/s 2024-05-14T09:35:56.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:55 smithi175 ceph-mon[35353]: pgmap v927: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.0 MiB/s wr, 618 op/s 2024-05-14T09:35:56.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:55 smithi120 ceph-mon[31085]: pgmap v927: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.0 MiB/s wr, 618 op/s 2024-05-14T09:35:58.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:57 smithi175 ceph-mon[35353]: pgmap v928: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.7 MiB/s wr, 619 op/s 2024-05-14T09:35:58.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:57 smithi120 ceph-mon[31085]: pgmap v928: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.7 MiB/s wr, 619 op/s 2024-05-14T09:35:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:57 smithi152 ceph-mon[34868]: pgmap v928: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.7 MiB/s wr, 619 op/s 2024-05-14T09:35:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 505.0 s, 730.3 tps, lat 170.171 ms stddev 226.884 2024-05-14T09:36:00.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:35:59 smithi175 ceph-mon[35353]: pgmap v929: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.2 MiB/s wr, 627 op/s 2024-05-14T09:36:00.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:35:59 smithi120 ceph-mon[31085]: pgmap v929: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.2 MiB/s wr, 627 op/s 2024-05-14T09:36:00.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:35:59 smithi152 ceph-mon[34868]: pgmap v929: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.2 MiB/s wr, 627 op/s 2024-05-14T09:36:02.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:01 smithi120 ceph-mon[31085]: pgmap v930: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 579 op/s 2024-05-14T09:36:02.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:01 smithi152 ceph-mon[34868]: pgmap v930: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 579 op/s 2024-05-14T09:36:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:01 smithi175 ceph-mon[35353]: pgmap v930: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 579 op/s 2024-05-14T09:36:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 510.0 s, 610.1 tps, lat 163.692 ms stddev 242.411 2024-05-14T09:36:04.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:03 smithi120 ceph-mon[31085]: pgmap v931: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 576 op/s 2024-05-14T09:36:04.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:03 smithi152 ceph-mon[34868]: pgmap v931: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 576 op/s 2024-05-14T09:36:04.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:03 smithi175 ceph-mon[35353]: pgmap v931: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 576 op/s 2024-05-14T09:36:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:05 smithi120 ceph-mon[31085]: pgmap v932: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.2 MiB/s wr, 669 op/s 2024-05-14T09:36:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:05 smithi152 ceph-mon[34868]: pgmap v932: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.2 MiB/s wr, 669 op/s 2024-05-14T09:36:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:05 smithi175 ceph-mon[35353]: pgmap v932: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.2 MiB/s wr, 669 op/s 2024-05-14T09:36:08.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:08 smithi120 ceph-mon[31085]: pgmap v933: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 622 op/s 2024-05-14T09:36:08.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:08 smithi152 ceph-mon[34868]: pgmap v933: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 622 op/s 2024-05-14T09:36:08.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:08 smithi175 ceph-mon[35353]: pgmap v933: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 622 op/s 2024-05-14T09:36:09.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 515.0 s, 671.1 tps, lat 149.041 ms stddev 59.432 2024-05-14T09:36:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.348+0000 7f8cfe000640 1 -- 172.21.15.120:0/3699576226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806d4a0 msgr2=0x7f8cf8118680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.348+0000 7f8cfe000640 1 --2- 172.21.15.120:0/3699576226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806d4a0 0x7f8cf8118680 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009930 tx=0x7f8ce002a440 comp rx=0 tx=0).stop 2024-05-14T09:36:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.349+0000 7f8cfe000640 1 -- 172.21.15.120:0/3699576226 shutdown_connections 2024-05-14T09:36:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.349+0000 7f8cfe000640 1 --2- 172.21.15.120:0/3699576226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 0x7f8cf811afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.349+0000 7f8cfe000640 1 --2- 172.21.15.120:0/3699576226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806d4a0 0x7f8cf8118680 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.349+0000 7f8cfe000640 1 --2- 172.21.15.120:0/3699576226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf806cb50 0x7f8cf806cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.349+0000 7f8cfe000640 1 -- 172.21.15.120:0/3699576226 >> 172.21.15.120:0/3699576226 conn(0x7f8cf8072870 msgr2=0x7f8cf8109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:09.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.352+0000 7f8cfe000640 1 -- 172.21.15.120:0/3699576226 shutdown_connections 2024-05-14T09:36:09.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.352+0000 7f8cfe000640 1 -- 172.21.15.120:0/3699576226 wait complete. 2024-05-14T09:36:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.354+0000 7f8cfe000640 1 Processor -- start 2024-05-14T09:36:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.355+0000 7f8cfe000640 1 -- start start 2024-05-14T09:36:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.355+0000 7f8cfe000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806cb50 0x7f8cf81154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.356+0000 7f8cfe000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf806d4a0 0x7f8cf8115a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.356+0000 7f8cfe000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 0x7f8cf8116910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.356+0000 7f8cfe000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf811e480 con 0x7f8cf806cb50 2024-05-14T09:36:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.356+0000 7f8cfe000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf811e300 con 0x7f8cf806d4a0 2024-05-14T09:36:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.356+0000 7f8cfe000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf811e600 con 0x7f8cf8118bc0 2024-05-14T09:36:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.356+0000 7f8cf7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 0x7f8cf8116910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.357+0000 7f8cf7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 0x7f8cf8116910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:46066/0 (socket says 172.21.15.120:46066) 2024-05-14T09:36:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.357+0000 7f8cf7e00640 1 -- 172.21.15.120:0/4075355382 learned_addr learned my addr 172.21.15.120:0/4075355382 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.357+0000 7f8cf7400640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806cb50 0x7f8cf81154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.357+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf806d4a0 0x7f8cf8115a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.358+0000 7f8cf7e00640 1 -- 172.21.15.120:0/4075355382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf806d4a0 msgr2=0x7f8cf8115a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.358+0000 7f8cf7e00640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf806d4a0 0x7f8cf8115a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.358+0000 7f8cf7e00640 1 -- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806cb50 msgr2=0x7f8cf81154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.358+0000 7f8cf7e00640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806cb50 0x7f8cf81154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.358+0000 7f8cf7e00640 1 -- 172.21.15.120:0/4075355382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf8116ed0 con 0x7f8cf8118bc0 2024-05-14T09:36:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.359+0000 7f8cf7e00640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 0x7f8cf8116910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c970 tx=0x7f8cf000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.360+0000 7f8cefe00640 1 -- 172.21.15.120:0/4075355382 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0007bb0 con 0x7f8cf8118bc0 2024-05-14T09:36:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.360+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf81171c0 con 0x7f8cf8118bc0 2024-05-14T09:36:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.360+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81176e0 con 0x7f8cf8118bc0 2024-05-14T09:36:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.361+0000 7f8cefe00640 1 -- 172.21.15.120:0/4075355382 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cf0007d50 con 0x7f8cf8118bc0 2024-05-14T09:36:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.361+0000 7f8cefe00640 1 -- 172.21.15.120:0/4075355382 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0018660 con 0x7f8cf8118bc0 2024-05-14T09:36:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.365+0000 7f8d04f9b740 1 Processor -- start 2024-05-14T09:36:09.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.369+0000 7f8cefe00640 1 -- 172.21.15.120:0/4075355382 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8cf000f450 con 0x7f8cf8118bc0 2024-05-14T09:36:09.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.370+0000 7f8d04f9b740 1 -- start start 2024-05-14T09:36:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.370+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.370+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.370+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.370+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560710328550 con 0x5607100221b0 2024-05-14T09:36:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.370+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5607102cdbc0 con 0x5607100014d0 2024-05-14T09:36:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.370+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560710324510 con 0x56070fff92f0 2024-05-14T09:36:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.371+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.371+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:46076/0 (socket says 172.21.15.120:46076) 2024-05-14T09:36:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.371+0000 7f8cf7400640 1 -- 172.21.15.120:0/2215797720 learned_addr learned my addr 172.21.15.120:0/2215797720 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.372+0000 7f8cf7400640 1 -- 172.21.15.120:0/2215797720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 msgr2=0x5607103cb580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:36:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.372+0000 7f8cf7400640 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103cb580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.372+0000 7f8cf7400640 1 -- 172.21.15.120:0/2215797720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 msgr2=0x5607103c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.372+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.372+0000 7f8cf7400640 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.372+0000 7f8cf7400640 1 -- 172.21.15.120:0/2215797720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071003a210 con 0x56070fff92f0 2024-05-14T09:36:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.373+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:36:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.373+0000 7f8cf7400640 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103c4680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f390 tx=0x7f8ce800f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3792f69e44db7ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.374+0000 7f8cefe00640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cdc0b2930 0x7f8cdc0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.374+0000 7f8ce7e00640 1 -- 172.21.15.120:0/2215797720 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8004d20 con 0x56070fff92f0 2024-05-14T09:36:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.374+0000 7f8ce7e00640 1 -- 172.21.15.120:0/2215797720 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ce8011990 con 0x56070fff92f0 2024-05-14T09:36:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.374+0000 7f8ce7e00640 1 -- 172.21.15.120:0/2215797720 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8005480 con 0x56070fff92f0 2024-05-14T09:36:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.375+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cdc0b2930 0x7f8cdc0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.375+0000 7f8cefe00640 1 -- 172.21.15.120:0/4075355382 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8cf00e2500 con 0x7f8cf8118bc0 2024-05-14T09:36:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.376+0000 7f8d04f9b740 1 -- 172.21.15.120:0/2215797720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 msgr2=0x5607103c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.376+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103c4680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f390 tx=0x7f8ce800f850 comp rx=0 tx=0).stop 2024-05-14T09:36:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.376+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cdc0b2930 0x7f8cdc0b4e40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009230 tx=0x7f8ce0005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.377+0000 7f8d04f9b740 1 -- 172.21.15.120:0/2215797720 shutdown_connections 2024-05-14T09:36:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.377+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.377+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103c4680 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.377+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/2215797720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.377+0000 7f8d04f9b740 1 -- 172.21.15.120:0/2215797720 >> 172.21.15.120:0/2215797720 conn(0x560710016300 msgr2=0x5607103bfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.377+0000 7f8d04f9b740 1 -- 172.21.15.120:0/2215797720 shutdown_connections 2024-05-14T09:36:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.377+0000 7f8d04f9b740 1 -- 172.21.15.120:0/2215797720 wait complete. 2024-05-14T09:36:09.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.378+0000 7f8d04f9b740 1 -- start start 2024-05-14T09:36:09.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.379+0000 7f8d04f9b740 1 Processor -- start 2024-05-14T09:36:09.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.381+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.381+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.382+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.382+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:46088/0 (socket says 172.21.15.120:46088) 2024-05-14T09:36:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.383+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103d5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.383+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5607103cbfd0 con 0x5607100221b0 2024-05-14T09:36:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.383+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5607102e1660 con 0x5607100014d0 2024-05-14T09:36:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.383+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5607103cc150 con 0x56070fff92f0 2024-05-14T09:36:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.384+0000 7f8d04f9b740 10 client.0 _ll_register_callbacks cb 0x5607102ab400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.384+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.384+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:54492/0 (socket says 172.21.15.120:54492) 2024-05-14T09:36:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.384+0000 7f8cf6a00640 1 -- 172.21.15.120:0/1349498869 learned_addr learned my addr 172.21.15.120:0/1349498869 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.385+0000 7f8cf7400640 1 -- 172.21.15.120:0/1349498869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 msgr2=0x5607103ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.385+0000 7f8cf7400640 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.385+0000 7f8cf7400640 1 -- 172.21.15.120:0/1349498869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 msgr2=0x5607103d5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.385+0000 7f8cf7400640 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103d5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.385+0000 7f8cf7400640 1 -- 172.21.15.120:0/1349498869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560710106620 con 0x56070fff92f0 2024-05-14T09:36:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.386+0000 7f8cf7400640 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103cdb90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f360 tx=0x7f8ce8011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f0d8ba0c89a126 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.386+0000 7f8ce4c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:36:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.387+0000 7f8ce4c00640 1 -- 172.21.15.120:0/1349498869 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8011dd0 con 0x56070fff92f0 2024-05-14T09:36:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.387+0000 7f8ce4c00640 1 -- 172.21.15.120:0/1349498869 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8ce8004a00 con 0x56070fff92f0 2024-05-14T09:36:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.388+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce8011990 con 0x56070fff92f0 2024-05-14T09:36:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.388+0000 7f8ce4c00640 1 -- 172.21.15.120:0/1349498869 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f8ce8004c00 con 0x56070fff92f0 2024-05-14T09:36:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.388+0000 7f8d04f9b740 10 client.26611 fetch_fsmap learned FSMap version 62 2024-05-14T09:36:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.388+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5607103d7f00 con 0x56070fff92f0 2024-05-14T09:36:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8ce4c00640 1 -- 172.21.15.120:0/1349498869 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ce8011990 con 0x56070fff92f0 2024-05-14T09:36:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8ce4c00640 1 -- 172.21.15.120:0/1349498869 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 62) ==== 8382+0+0 (secure 0 0 0) 0x7f8ce8004450 con 0x56070fff92f0 2024-05-14T09:36:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8d04f9b740 10 client.26611 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T09:36:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8d04f9b740 10 client.26611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8d04f9b740 20 client.26611 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffe0d80 0x5607103db370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8d04f9b740 4 client.26611 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:36:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.389+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560710336160 con 0x56070ffe0d80 2024-05-14T09:36:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.390+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffe0d80 0x5607103db370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.391+0000 7f8ce4c00640 10 client.26611 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.392+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffe0d80 0x5607103db370 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd3eb115c8c041ab server_cookie=eab6b3ad56c57b8c in_seq=0 out_seq=0 2024-05-14T09:36:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.394+0000 7f8ce4c00640 1 -- 172.21.15.120:0/1349498869 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560710336160 con 0x56070ffe0d80 2024-05-14T09:36:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.394+0000 7f8ce4c00640 10 client.26611 handle_command_reply: tid=0 2024-05-14T09:36:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.394+0000 7f8d04f9b740 1 client.26611 shutdown 2024-05-14T09:36:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 msgr2=0x5607103cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103cdb90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f360 tx=0x7f8ce8011900 comp rx=0 tx=0).stop 2024-05-14T09:36:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 shutdown_connections 2024-05-14T09:36:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffe0d80 0x5607103db370 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103d5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5607100014d0 0x5607103ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/1349498869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56070fff92f0 0x5607103cdb90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 >> 172.21.15.120:0/1349498869 conn(0x560710016300 msgr2=0x5607103c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.395+0000 7f8ce4c00640 0 client.26611 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.396+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 shutdown_connections 2024-05-14T09:36:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.396+0000 7f8d04f9b740 1 -- 172.21.15.120:0/1349498869 wait complete. 2024-05-14T09:36:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.396+0000 7f8d04f9b740 20 client.26611 trim_cache size 0 max 16384 2024-05-14T09:36:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.431+0000 7f8d04f9b740 1 Processor -- start 2024-05-14T09:36:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.432+0000 7f8d04f9b740 1 -- start start 2024-05-14T09:36:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.432+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.432+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103bea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.432+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103bf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.432+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd400fc90 con 0x5607100221b0 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.432+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40118c0 con 0x56070fff92f0 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.432+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4010360 con 0x5607100014d0 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.433+0000 7f8cf7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103bf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.433+0000 7f8cf7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103bf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42138/0 (socket says 172.21.15.120:42138) 2024-05-14T09:36:09.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.433+0000 7f8cf7e00640 1 -- 172.21.15.120:0/3008451492 learned_addr learned my addr 172.21.15.120:0/3008451492 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:09.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.433+0000 7f8cf7400640 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.433+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103bea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.434+0000 7f8cf7400640 1 -- 172.21.15.120:0/3008451492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 msgr2=0x5607103bea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.434+0000 7f8cf7400640 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103bea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.434+0000 7f8cf7400640 1 -- 172.21.15.120:0/3008451492 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 msgr2=0x5607103bf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.434+0000 7f8cf7400640 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103bf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.434+0000 7f8cf7400640 1 -- 172.21.15.120:0/3008451492 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607103bb280 con 0x56070fff92f0 2024-05-14T09:36:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.435+0000 7f8cf7400640 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103c8630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f390 tx=0x7f8ce8005450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0db35f1cbfc3726 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.436+0000 7f8ce7400640 1 -- 172.21.15.120:0/3008451492 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8011970 con 0x56070fff92f0 2024-05-14T09:36:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.436+0000 7f8ce7400640 1 -- 172.21.15.120:0/3008451492 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ce8005610 con 0x56070fff92f0 2024-05-14T09:36:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.436+0000 7f8ce7400640 1 -- 172.21.15.120:0/3008451492 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce801b7b0 con 0x56070fff92f0 2024-05-14T09:36:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.438+0000 7f8d04f9b740 1 -- 172.21.15.120:0/3008451492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 msgr2=0x5607103c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.438+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103c8630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f390 tx=0x7f8ce8005450 comp rx=0 tx=0).stop 2024-05-14T09:36:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.439+0000 7f8d04f9b740 1 -- 172.21.15.120:0/3008451492 shutdown_connections 2024-05-14T09:36:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.439+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607103bf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.439+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103bea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.439+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/3008451492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103c8630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.439+0000 7f8d04f9b740 1 -- 172.21.15.120:0/3008451492 >> 172.21.15.120:0/3008451492 conn(0x560710016300 msgr2=0x5607103bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.439+0000 7f8d04f9b740 1 -- 172.21.15.120:0/3008451492 shutdown_connections 2024-05-14T09:36:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.439+0000 7f8d04f9b740 1 -- 172.21.15.120:0/3008451492 wait complete. 2024-05-14T09:36:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.440+0000 7f8d04f9b740 1 -- start start 2024-05-14T09:36:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.440+0000 7f8d04f9b740 1 Processor -- start 2024-05-14T09:36:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8d04f9b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607104416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40111c0 con 0x5607100221b0 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4010af0 con 0x56070fff92f0 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8d04f9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd400dc90 con 0x5607100014d0 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8d04f9b740 10 client.0 _ll_register_callbacks cb 0x7f8ce8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.441+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.442+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.442+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103d2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:54500/0 (socket says 172.21.15.120:54500) 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.442+0000 7f8cf7400640 1 -- 172.21.15.120:0/4076712400 learned_addr learned my addr 172.21.15.120:0/4076712400 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.443+0000 7f8cf7400640 1 -- 172.21.15.120:0/4076712400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 msgr2=0x5607103d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.443+0000 7f8cf7400640 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.443+0000 7f8cf7e00640 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607104416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.443+0000 7f8cf7400640 1 -- 172.21.15.120:0/4076712400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 msgr2=0x5607104416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.443+0000 7f8cf7400640 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607104416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.443+0000 7f8cf7400640 1 -- 172.21.15.120:0/4076712400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607103d5a80 con 0x56070fff92f0 2024-05-14T09:36:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.443+0000 7f8cf7e00640 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607104416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:36:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.444+0000 7f8cf7400640 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103d2580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8006010 tx=0x7f8ce8004fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c0c61be71b02f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.445+0000 7f8ce4c00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:36:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.445+0000 7f8ce4c00640 1 -- 172.21.15.120:0/4076712400 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce801b530 con 0x56070fff92f0 2024-05-14T09:36:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.445+0000 7f8ce4c00640 1 -- 172.21.15.120:0/4076712400 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8ce8023040 con 0x56070fff92f0 2024-05-14T09:36:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.445+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce8005610 con 0x56070fff92f0 2024-05-14T09:36:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.446+0000 7f8ce4c00640 1 -- 172.21.15.120:0/4076712400 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f8ce804c050 con 0x56070fff92f0 2024-05-14T09:36:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.446+0000 7f8d04f9b740 10 client.36551 fetch_fsmap learned FSMap version 62 2024-05-14T09:36:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.446+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x560710442bc0 con 0x56070fff92f0 2024-05-14T09:36:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.446+0000 7f8ce4c00640 1 -- 172.21.15.120:0/4076712400 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ce8005610 con 0x56070fff92f0 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.446+0000 7f8ce4c00640 1 -- 172.21.15.120:0/4076712400 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 62) ==== 8382+0+0 (secure 0 0 0) 0x7f8ce8030480 con 0x56070fff92f0 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.447+0000 7f8d04f9b740 10 client.36551 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.447+0000 7f8d04f9b740 10 client.36551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.447+0000 7f8d04f9b740 20 client.36551 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.447+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffb61c0 0x560710445630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.447+0000 7f8d04f9b740 4 client.36551 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.447+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56071032ffd0 con 0x56070ffb61c0 2024-05-14T09:36:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.447+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffb61c0 0x560710445630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.449+0000 7f8cf6a00640 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffb61c0 0x560710445630 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3d6596f8bbc9dfa server_cookie=bbe96ba543919c48 in_seq=0 out_seq=0 2024-05-14T09:36:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.449+0000 7f8ce4c00640 10 client.36551 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.488+0000 7f8ce4c00640 1 -- 172.21.15.120:0/4076712400 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56071032ffd0 con 0x56070ffb61c0 2024-05-14T09:36:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.488+0000 7f8ce4c00640 10 client.36551 handle_command_reply: tid=0 2024-05-14T09:36:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.489+0000 7f8d04f9b740 1 client.36551 shutdown 2024-05-14T09:36:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.490+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 msgr2=0x5607103d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.490+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103d2580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8006010 tx=0x7f8ce8004fb0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.490+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 shutdown_connections 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.491+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56070ffb61c0 0x560710445630 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.491+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5607100221b0 0x5607104416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.491+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607100014d0 0x5607103d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.491+0000 7f8d04f9b740 1 --2- 172.21.15.120:0/4076712400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56070fff92f0 0x5607103d2580 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.491+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 >> 172.21.15.120:0/4076712400 conn(0x560710016300 msgr2=0x5607103be790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.491+0000 7f8ce4c00640 0 client.36551 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.492+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 shutdown_connections 2024-05-14T09:36:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.492+0000 7f8d04f9b740 1 -- 172.21.15.120:0/4076712400 wait complete. 2024-05-14T09:36:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.494+0000 7f8d04f9b740 20 client.36551 trim_cache size 0 max 16384 2024-05-14T09:36:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:36:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:36:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:36:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:36:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.495+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cdc0b2930 msgr2=0x7f8cdc0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.495+0000 7f8cfe000640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cdc0b2930 0x7f8cdc0b4e40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009230 tx=0x7f8ce0005720 comp rx=0 tx=0).stop 2024-05-14T09:36:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.495+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 msgr2=0x7f8cf8116910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.495+0000 7f8cfe000640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 0x7f8cf8116910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c970 tx=0x7f8cf000ce30 comp rx=0 tx=0).stop 2024-05-14T09:36:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.496+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 shutdown_connections 2024-05-14T09:36:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.496+0000 7f8cfe000640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8cdc0b2930 0x7f8cdc0b4e40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.496+0000 7f8cfe000640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cf8118bc0 0x7f8cf8116910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.496+0000 7f8cfe000640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf806d4a0 0x7f8cf8115a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.496+0000 7f8cfe000640 1 --2- 172.21.15.120:0/4075355382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cf806cb50 0x7f8cf81154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.496+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 >> 172.21.15.120:0/4075355382 conn(0x7f8cf8072870 msgr2=0x7f8cf810b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.497+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 shutdown_connections 2024-05-14T09:36:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:09.497+0000 7f8cfe000640 1 -- 172.21.15.120:0/4075355382 wait complete. 2024-05-14T09:36:10.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:10 smithi120 ceph-mon[31085]: pgmap v934: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.1 MiB/s wr, 626 op/s 2024-05-14T09:36:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:10 smithi152 ceph-mon[34868]: pgmap v934: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.1 MiB/s wr, 626 op/s 2024-05-14T09:36:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:10 smithi175 ceph-mon[35353]: pgmap v934: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.1 MiB/s wr, 626 op/s 2024-05-14T09:36:12.281 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:12 smithi175 ceph-mon[35353]: pgmap v935: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 595 op/s 2024-05-14T09:36:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:12 smithi120 ceph-mon[31085]: pgmap v935: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 595 op/s 2024-05-14T09:36:12.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:12 smithi152 ceph-mon[34868]: pgmap v935: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 595 op/s 2024-05-14T09:36:14.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 520.0 s, 538.2 tps, lat 185.319 ms stddev 271.529 2024-05-14T09:36:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:14 smithi120 ceph-mon[31085]: pgmap v936: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.2 MiB/s wr, 609 op/s 2024-05-14T09:36:14.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:14 smithi152 ceph-mon[34868]: pgmap v936: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.2 MiB/s wr, 609 op/s 2024-05-14T09:36:14.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:14 smithi175 ceph-mon[35353]: pgmap v936: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.2 MiB/s wr, 609 op/s 2024-05-14T09:36:16.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:16 smithi120 ceph-mon[31085]: pgmap v937: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 637 op/s 2024-05-14T09:36:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:16 smithi152 ceph-mon[34868]: pgmap v937: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 637 op/s 2024-05-14T09:36:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:16 smithi175 ceph-mon[35353]: pgmap v937: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 637 op/s 2024-05-14T09:36:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:18 smithi120 ceph-mon[31085]: pgmap v938: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 554 op/s 2024-05-14T09:36:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:18 smithi152 ceph-mon[34868]: pgmap v938: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 554 op/s 2024-05-14T09:36:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:18 smithi175 ceph-mon[35353]: pgmap v938: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 554 op/s 2024-05-14T09:36:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 525.0 s, 651.2 tps, lat 153.982 ms stddev 63.792 2024-05-14T09:36:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:20 smithi120 ceph-mon[31085]: pgmap v939: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 571 op/s 2024-05-14T09:36:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:20 smithi152 ceph-mon[34868]: pgmap v939: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 571 op/s 2024-05-14T09:36:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:20 smithi175 ceph-mon[35353]: pgmap v939: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 571 op/s 2024-05-14T09:36:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:22 smithi120 ceph-mon[31085]: pgmap v940: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 573 op/s 2024-05-14T09:36:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:22 smithi152 ceph-mon[34868]: pgmap v940: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 573 op/s 2024-05-14T09:36:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:22 smithi175 ceph-mon[35353]: pgmap v940: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 573 op/s 2024-05-14T09:36:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.815+0000 7fd95f600640 1 -- 172.21.15.120:0/1939761938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 msgr2=0x7fd9581127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.815+0000 7fd95f600640 1 --2- 172.21.15.120:0/1939761938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 0x7fd9581127e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd950009ca0 tx=0x7fd95002a8c0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.816+0000 7fd95f600640 1 -- 172.21.15.120:0/1939761938 shutdown_connections 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.816+0000 7fd95f600640 1 --2- 172.21.15.120:0/1939761938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 0x7fd9581127e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.816+0000 7fd95f600640 1 --2- 172.21.15.120:0/1939761938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd958075a10 0x7fd95810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.816+0000 7fd95f600640 1 --2- 172.21.15.120:0/1939761938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9580750c0 0x7fd9580754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.816+0000 7fd95f600640 1 -- 172.21.15.120:0/1939761938 >> 172.21.15.120:0/1939761938 conn(0x7fd9580fee50 msgr2=0x7fd958101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.816+0000 7fd95f600640 1 -- 172.21.15.120:0/1939761938 shutdown_connections 2024-05-14T09:36:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.816+0000 7fd95f600640 1 -- 172.21.15.120:0/1939761938 wait complete. 2024-05-14T09:36:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.818+0000 7fd95f600640 1 Processor -- start 2024-05-14T09:36:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.818+0000 7fd95f600640 1 -- start start 2024-05-14T09:36:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95f600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9580750c0 0x7fd9581a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95f600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd958075a10 0x7fd9581a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95f600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 0x7fd9581a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95f600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd958115c50 con 0x7fd9581103c0 2024-05-14T09:36:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95f600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd958115ad0 con 0x7fd9580750c0 2024-05-14T09:36:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95f600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd958115dd0 con 0x7fd958075a10 2024-05-14T09:36:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 0x7fd9581a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 0x7fd9581a7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58776/0 (socket says 172.21.15.120:58776) 2024-05-14T09:36:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.819+0000 7fd95d600640 1 -- 172.21.15.120:0/4031548581 learned_addr learned my addr 172.21.15.120:0/4031548581 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.820+0000 7fd957e00640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd958075a10 0x7fd9581a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.821+0000 7fd95cc00640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9580750c0 0x7fd9581a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.822+0000 7fd957e00640 1 -- 172.21.15.120:0/4031548581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9580750c0 msgr2=0x7fd9581a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.822+0000 7fd957e00640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9580750c0 0x7fd9581a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.822+0000 7fd957e00640 1 -- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 msgr2=0x7fd9581a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.822+0000 7fd957e00640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 0x7fd9581a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.822+0000 7fd957e00640 1 -- 172.21.15.120:0/4031548581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9581a8380 con 0x7fd958075a10 2024-05-14T09:36:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.823+0000 7fd957e00640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd958075a10 0x7fd9581a0d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd94400d6d0 tx=0x7fd94400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.824+0000 7fd955600640 1 -- 172.21.15.120:0/4031548581 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944017070 con 0x7fd958075a10 2024-05-14T09:36:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.824+0000 7fd955600640 1 -- 172.21.15.120:0/4031548581 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd944009820 con 0x7fd958075a10 2024-05-14T09:36:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.824+0000 7fd955600640 1 -- 172.21.15.120:0/4031548581 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944004bc0 con 0x7fd958075a10 2024-05-14T09:36:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.824+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9581a8670 con 0x7fd958075a10 2024-05-14T09:36:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.824+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9581a8b70 con 0x7fd958075a10 2024-05-14T09:36:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.829+0000 7fd9665ae740 1 Processor -- start 2024-05-14T09:36:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.830+0000 7fd9665ae740 1 -- start start 2024-05-14T09:36:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.830+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b34021b0 0x5600b37a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.830+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33d92f0 0x5600b37a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.830+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33e14d0 0x5600b37ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.830+0000 7fd9665ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5600b3708550 con 0x5600b33d92f0 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.830+0000 7fd9665ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5600b36adbc0 con 0x5600b33e14d0 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.830+0000 7fd9665ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5600b3704510 con 0x5600b34021b0 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.831+0000 7fd95d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b34021b0 0x5600b37a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.831+0000 7fd95d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b34021b0 0x5600b37a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53620/0 (socket says 172.21.15.120:53620) 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.831+0000 7fd95d600640 1 -- 172.21.15.120:0/2515502280 learned_addr learned my addr 172.21.15.120:0/2515502280 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.831+0000 7fd95cc00640 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33d92f0 0x5600b37a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.832+0000 7fd95d600640 1 -- 172.21.15.120:0/2515502280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33e14d0 msgr2=0x5600b37ab580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.832+0000 7fd95d600640 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33e14d0 0x5600b37ab580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.832+0000 7fd95d600640 1 -- 172.21.15.120:0/2515502280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33d92f0 msgr2=0x5600b37a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.832+0000 7fd95d600640 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33d92f0 0x5600b37a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.832+0000 7fd95d600640 1 -- 172.21.15.120:0/2515502280 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b341a210 con 0x5600b34021b0 2024-05-14T09:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.833+0000 7fd95d600640 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b34021b0 0x5600b37a4100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd950005d80 tx=0x7fd950005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b58a261c2b87aa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.834+0000 7fd949c00640 1 -- 172.21.15.120:0/2515502280 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950031a80 con 0x5600b34021b0 2024-05-14T09:36:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.834+0000 7fd949c00640 1 -- 172.21.15.120:0/2515502280 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd950036070 con 0x5600b34021b0 2024-05-14T09:36:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.834+0000 7fd949c00640 1 -- 172.21.15.120:0/2515502280 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9500043f0 con 0x5600b34021b0 2024-05-14T09:36:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.836+0000 7fd9665ae740 1 -- 172.21.15.120:0/2515502280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b34021b0 msgr2=0x5600b37a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.836+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b34021b0 0x5600b37a4100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd950005d80 tx=0x7fd950005db0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.837+0000 7fd955600640 1 -- 172.21.15.120:0/4031548581 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd944005220 con 0x7fd958075a10 2024-05-14T09:36:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.838+0000 7fd9665ae740 1 -- 172.21.15.120:0/2515502280 shutdown_connections 2024-05-14T09:36:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.838+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33e14d0 0x5600b37ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.838+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33d92f0 0x5600b37a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.838+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2515502280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b34021b0 0x5600b37a4100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.838+0000 7fd9665ae740 1 -- 172.21.15.120:0/2515502280 >> 172.21.15.120:0/2515502280 conn(0x5600b33f6300 msgr2=0x5600b379fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.838+0000 7fd9665ae740 1 -- 172.21.15.120:0/2515502280 shutdown_connections 2024-05-14T09:36:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.838+0000 7fd9665ae740 1 -- 172.21.15.120:0/2515502280 wait complete. 2024-05-14T09:36:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.839+0000 7fd9665ae740 1 -- start start 2024-05-14T09:36:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.839+0000 7fd9665ae740 1 Processor -- start 2024-05-14T09:36:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.840+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33d92f0 0x5600b37adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.840+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33e14d0 0x5600b37ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b34021b0 0x5600b37b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd9665ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5600b37abdf0 con 0x5600b33e14d0 2024-05-14T09:36:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd9665ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5600b36c1660 con 0x5600b34021b0 2024-05-14T09:36:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd9665ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5600b37abf70 con 0x5600b33d92f0 2024-05-14T09:36:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd955600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9400b2900 0x7fd9400b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd9665ae740 10 client.0 _ll_register_callbacks cb 0x5600b368b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd955600640 1 -- 172.21.15.120:0/4031548581 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd9440e1e20 con 0x7fd958075a10 2024-05-14T09:36:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd95d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33d92f0 0x5600b37adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd95d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33d92f0 0x5600b37adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53628/0 (socket says 172.21.15.120:53628) 2024-05-14T09:36:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd95d600640 1 -- 172.21.15.120:0/393561120 learned_addr learned my addr 172.21.15.120:0/393561120 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd95cc00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33e14d0 0x5600b37ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.841+0000 7fd95d600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9400b2900 0x7fd9400b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.842+0000 7fd957e00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b34021b0 0x5600b37b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.843+0000 7fd95cc00640 1 -- 172.21.15.120:0/393561120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33d92f0 msgr2=0x5600b37adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.843+0000 7fd95cc00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33d92f0 0x5600b37adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.843+0000 7fd95cc00640 1 -- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b34021b0 msgr2=0x5600b37b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.843+0000 7fd95cc00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b34021b0 0x5600b37b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.843+0000 7fd95cc00640 1 -- 172.21.15.120:0/393561120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b34e6620 con 0x5600b33e14d0 2024-05-14T09:36:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.843+0000 7fd957e00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b34021b0 0x5600b37b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:36:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.843+0000 7fd95d600640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33d92f0 0x5600b37adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:36:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.844+0000 7fd95d600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9400b2900 0x7fd9400b4e10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd950009bf0 tx=0x7fd950009820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.844+0000 7fd95cc00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33e14d0 0x5600b37ae010 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5600b37a54e0 tx=0x7fd94c013940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eee08127f08abb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.844+0000 7fd93e000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:36:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.845+0000 7fd93e000640 1 -- 172.21.15.120:0/393561120 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c004230 con 0x5600b33e14d0 2024-05-14T09:36:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.845+0000 7fd93e000640 1 -- 172.21.15.120:0/393561120 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd94c0043d0 con 0x5600b33e14d0 2024-05-14T09:36:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.845+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd950036070 con 0x5600b33e14d0 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.846+0000 7fd93e000640 1 -- 172.21.15.120:0/393561120 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd94c011770 con 0x5600b33e14d0 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.846+0000 7fd9665ae740 10 client.17061 fetch_fsmap learned FSMap version 62 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.846+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5600b37b7f70 con 0x5600b33e14d0 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd93e000640 1 -- 172.21.15.120:0/393561120 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd950036070 con 0x5600b33e14d0 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd93e000640 1 -- 172.21.15.120:0/393561120 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 62) ==== 8382+0+0 (secure 0 0 0) 0x7fd94c003b10 con 0x5600b33e14d0 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd9665ae740 10 client.17061 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd9665ae740 10 client.17061 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd9665ae740 20 client.17061 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd9665ae740 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33c0d80 0x5600b37bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd9665ae740 4 client.17061 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:36:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.847+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600b3716160 con 0x5600b33c0d80 2024-05-14T09:36:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.849+0000 7fd957e00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33c0d80 0x5600b37bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.850+0000 7fd957e00640 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33c0d80 0x5600b37bb5e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dccaaced0916b679 server_cookie=8e0d5482e21bd41f in_seq=0 out_seq=0 2024-05-14T09:36:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.850+0000 7fd93e000640 10 client.17061 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd93e000640 1 -- 172.21.15.120:0/393561120 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5600b3716160 con 0x5600b33c0d80 2024-05-14T09:36:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd93e000640 10 client.17061 handle_command_reply: tid=0 2024-05-14T09:36:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 client.17061 shutdown 2024-05-14T09:36:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33e14d0 msgr2=0x5600b37ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33e14d0 0x5600b37ae010 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5600b37a54e0 tx=0x7fd94c013940 comp rx=0 tx=0).stop 2024-05-14T09:36:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 shutdown_connections 2024-05-14T09:36:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33c0d80 0x5600b37bb5e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b34021b0 0x5600b37b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b33e14d0 0x5600b37ae010 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 --2- 172.21.15.120:0/393561120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33d92f0 0x5600b37adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.852+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 >> 172.21.15.120:0/393561120 conn(0x5600b33f6300 msgr2=0x5600b379ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.853+0000 7fd93e000640 0 client.17061 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.853+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 shutdown_connections 2024-05-14T09:36:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.853+0000 7fd9665ae740 1 -- 172.21.15.120:0/393561120 wait complete. 2024-05-14T09:36:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.853+0000 7fd9665ae740 20 client.17061 trim_cache size 0 max 16384 2024-05-14T09:36:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.882+0000 7fd9665ae740 1 Processor -- start 2024-05-14T09:36:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.883+0000 7fd9665ae740 1 -- start start 2024-05-14T09:36:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.883+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.883+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.883+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.883+0000 7fd9665ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581b3120 con 0x5600b34021b0 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.883+0000 7fd9665ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581b4d50 con 0x5600b33d92f0 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.883+0000 7fd9665ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581b37f0 con 0x5600b33f6300 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.884+0000 7fd95d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.884+0000 7fd95d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58798/0 (socket says 172.21.15.120:58798) 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.884+0000 7fd95d600640 1 -- 172.21.15.120:0/2941682150 learned_addr learned my addr 172.21.15.120:0/2941682150 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.884+0000 7fd957e00640 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.884+0000 7fd95d600640 1 -- 172.21.15.120:0/2941682150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 msgr2=0x5600b37bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.884+0000 7fd95cc00640 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.885+0000 7fd95d600640 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37bfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.885+0000 7fd95d600640 1 -- 172.21.15.120:0/2941682150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 msgr2=0x5600b37b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.885+0000 7fd95d600640 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.885+0000 7fd95d600640 1 -- 172.21.15.120:0/2941682150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b37a8b40 con 0x5600b34021b0 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.885+0000 7fd957e00640 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.885+0000 7fd95cc00640 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.885+0000 7fd95d600640 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b5470 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd950031fb0 tx=0x7fd950005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fbf5434757e24c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.886+0000 7fd949200640 1 -- 172.21.15.120:0/2941682150 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950060070 con 0x5600b34021b0 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.886+0000 7fd949200640 1 -- 172.21.15.120:0/2941682150 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd950036040 con 0x5600b34021b0 2024-05-14T09:36:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.886+0000 7fd949200640 1 -- 172.21.15.120:0/2941682150 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950004830 con 0x5600b34021b0 2024-05-14T09:36:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.888+0000 7fd9665ae740 1 -- 172.21.15.120:0/2941682150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 msgr2=0x5600b37b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.888+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b5470 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd950031fb0 tx=0x7fd950005db0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.889+0000 7fd9665ae740 1 -- 172.21.15.120:0/2941682150 shutdown_connections 2024-05-14T09:36:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.889+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b5470 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.889+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.889+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2941682150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.889+0000 7fd9665ae740 1 -- 172.21.15.120:0/2941682150 >> 172.21.15.120:0/2941682150 conn(0x5600b37bb950 msgr2=0x5600b37a4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.889+0000 7fd9665ae740 1 -- 172.21.15.120:0/2941682150 shutdown_connections 2024-05-14T09:36:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.889+0000 7fd9665ae740 1 -- 172.21.15.120:0/2941682150 wait complete. 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 -- start start 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 Processor -- start 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581b4650 con 0x5600b34021b0 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581b3f80 con 0x5600b33d92f0 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581b1120 con 0x5600b33f6300 2024-05-14T09:36:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.890+0000 7fd9665ae740 10 client.0 _ll_register_callbacks cb 0x7fd94c009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.891+0000 7fd95d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.891+0000 7fd95cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.891+0000 7fd957e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.891+0000 7fd95d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58812/0 (socket says 172.21.15.120:58812) 2024-05-14T09:36:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.891+0000 7fd95d600640 1 -- 172.21.15.120:0/2507516915 learned_addr learned my addr 172.21.15.120:0/2507516915 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.892+0000 7fd95d600640 1 -- 172.21.15.120:0/2507516915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 msgr2=0x5600b37b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.892+0000 7fd95d600640 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.892+0000 7fd95d600640 1 -- 172.21.15.120:0/2507516915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 msgr2=0x5600b37b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.892+0000 7fd95d600640 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.892+0000 7fd95d600640 1 -- 172.21.15.120:0/2507516915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b37b43e0 con 0x5600b34021b0 2024-05-14T09:36:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.893+0000 7fd93e000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:36:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.892+0000 7fd95d600640 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b3e20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd950009a60 tx=0x7fd950000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4528a337c949379 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.893+0000 7fd93e000640 1 -- 172.21.15.120:0/2507516915 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950069060 con 0x5600b34021b0 2024-05-14T09:36:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.893+0000 7fd93e000640 1 -- 172.21.15.120:0/2507516915 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd9500305c0 con 0x5600b34021b0 2024-05-14T09:36:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.894+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd950036040 con 0x5600b34021b0 2024-05-14T09:36:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.894+0000 7fd93e000640 1 -- 172.21.15.120:0/2507516915 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd950060040 con 0x5600b34021b0 2024-05-14T09:36:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.894+0000 7fd9665ae740 10 client.17067 fetch_fsmap learned FSMap version 62 2024-05-14T09:36:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.894+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5600b37b5550 con 0x5600b34021b0 2024-05-14T09:36:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd93e000640 1 -- 172.21.15.120:0/2507516915 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd950036040 con 0x5600b34021b0 2024-05-14T09:36:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd93e000640 1 -- 172.21.15.120:0/2507516915 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 62) ==== 8382+0+0 (secure 0 0 0) 0x7fd950043020 con 0x5600b34021b0 2024-05-14T09:36:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd9665ae740 10 client.17067 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T09:36:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd9665ae740 10 client.17067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd9665ae740 20 client.17067 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33961c0 0x5600b3825b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd9665ae740 4 client.17067 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:36:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.895+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600b370ffd0 con 0x5600b33961c0 2024-05-14T09:36:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.896+0000 7fd95cc00640 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33961c0 0x5600b3825b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.898+0000 7fd95cc00640 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33961c0 0x5600b3825b70 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33ab905bbab074e server_cookie=a5925a44c081dc53 in_seq=0 out_seq=0 2024-05-14T09:36:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:22.898+0000 7fd93e000640 10 client.17067 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.176+0000 7fd93e000640 1 -- 172.21.15.120:0/2507516915 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600b370ffd0 con 0x5600b33961c0 2024-05-14T09:36:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.176+0000 7fd93e000640 10 client.17067 handle_command_reply: tid=0 2024-05-14T09:36:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.176+0000 7fd9665ae740 1 client.17067 shutdown 2024-05-14T09:36:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 msgr2=0x5600b37b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b3e20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd950009a60 tx=0x7fd950000f40 comp rx=0 tx=0).stop 2024-05-14T09:36:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 shutdown_connections 2024-05-14T09:36:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5600b33961c0 0x5600b3825b70 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5600b34021b0 0x5600b37b3e20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600b33f6300 0x5600b37b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 --2- 172.21.15.120:0/2507516915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600b33d92f0 0x5600b37b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 >> 172.21.15.120:0/2507516915 conn(0x5600b37bb950 msgr2=0x5600b37a4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.177+0000 7fd93e000640 0 client.17067 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.178+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 shutdown_connections 2024-05-14T09:36:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.178+0000 7fd9665ae740 1 -- 172.21.15.120:0/2507516915 wait complete. 2024-05-14T09:36:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.178+0000 7fd9665ae740 20 client.17067 trim_cache size 0 max 16384 2024-05-14T09:36:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:36:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:36:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:36:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:36:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9400b2900 msgr2=0x7fd9400b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9400b2900 0x7fd9400b4e10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd950009bf0 tx=0x7fd950009820 comp rx=0 tx=0).stop 2024-05-14T09:36:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd958075a10 msgr2=0x7fd9581a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd958075a10 0x7fd9581a0d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd94400d6d0 tx=0x7fd94400db90 comp rx=0 tx=0).stop 2024-05-14T09:36:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 shutdown_connections 2024-05-14T09:36:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9400b2900 0x7fd9400b4e10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9581103c0 0x7fd9581a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd958075a10 0x7fd9581a0d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 --2- 172.21.15.120:0/4031548581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9580750c0 0x7fd9581a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.180+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 >> 172.21.15.120:0/4031548581 conn(0x7fd9580fee50 msgr2=0x7fd958103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.182+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 shutdown_connections 2024-05-14T09:36:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:23.182+0000 7fd95f600640 1 -- 172.21.15.120:0/4031548581 wait complete. 2024-05-14T09:36:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 530.0 s, 612.8 tps, lat 164.180 ms stddev 248.023 2024-05-14T09:36:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:24 smithi120 ceph-mon[31085]: pgmap v941: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 592 op/s 2024-05-14T09:36:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:24 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:36:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:24 smithi152 ceph-mon[34868]: pgmap v941: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 592 op/s 2024-05-14T09:36:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:24 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:36:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:24 smithi175 ceph-mon[35353]: pgmap v941: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 592 op/s 2024-05-14T09:36:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:24 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:36:26.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:26 smithi120 ceph-mon[31085]: pgmap v942: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.7 MiB/s wr, 649 op/s 2024-05-14T09:36:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:26 smithi152 ceph-mon[34868]: pgmap v942: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.7 MiB/s wr, 649 op/s 2024-05-14T09:36:26.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:26 smithi175 ceph-mon[35353]: pgmap v942: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.7 MiB/s wr, 649 op/s 2024-05-14T09:36:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:28 smithi120 ceph-mon[31085]: pgmap v943: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.8 MiB/s wr, 627 op/s 2024-05-14T09:36:28.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:28 smithi152 ceph-mon[34868]: pgmap v943: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.8 MiB/s wr, 627 op/s 2024-05-14T09:36:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:28 smithi175 ceph-mon[35353]: pgmap v943: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.8 MiB/s wr, 627 op/s 2024-05-14T09:36:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 535.0 s, 658.0 tps, lat 151.119 ms stddev 67.092 2024-05-14T09:36:30.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:30 smithi120 ceph-mon[31085]: pgmap v944: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.6 MiB/s wr, 705 op/s 2024-05-14T09:36:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:30 smithi152 ceph-mon[34868]: pgmap v944: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.6 MiB/s wr, 705 op/s 2024-05-14T09:36:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:30 smithi175 ceph-mon[35353]: pgmap v944: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.6 MiB/s wr, 705 op/s 2024-05-14T09:36:32.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:32 smithi120 ceph-mon[31085]: pgmap v945: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.5 MiB/s wr, 688 op/s 2024-05-14T09:36:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:32 smithi152 ceph-mon[34868]: pgmap v945: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.5 MiB/s wr, 688 op/s 2024-05-14T09:36:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:32 smithi175 ceph-mon[35353]: pgmap v945: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.5 MiB/s wr, 688 op/s 2024-05-14T09:36:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 540.0 s, 633.2 tps, lat 157.242 ms stddev 66.231 2024-05-14T09:36:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:34 smithi120 ceph-mon[31085]: pgmap v946: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.1 MiB/s wr, 653 op/s 2024-05-14T09:36:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:34 smithi152 ceph-mon[34868]: pgmap v946: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.1 MiB/s wr, 653 op/s 2024-05-14T09:36:34.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:34 smithi175 ceph-mon[35353]: pgmap v946: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.1 MiB/s wr, 653 op/s 2024-05-14T09:36:36.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:36 smithi120 ceph-mon[31085]: pgmap v947: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 7.6 MiB/s wr, 664 op/s 2024-05-14T09:36:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:36 smithi152 ceph-mon[34868]: pgmap v947: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 7.6 MiB/s wr, 664 op/s 2024-05-14T09:36:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:36 smithi175 ceph-mon[35353]: pgmap v947: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 7.6 MiB/s wr, 664 op/s 2024-05-14T09:36:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.559+0000 7fa851e00640 1 -- 172.21.15.120:0/3421959216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1101f0 msgr2=0x7fa84c112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.559+0000 7fa851e00640 1 --2- 172.21.15.120:0/3421959216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1101f0 0x7fa84c112610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa844009ca0 tx=0x7fa84402a8d0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.559+0000 7fa851e00640 1 -- 172.21.15.120:0/3421959216 shutdown_connections 2024-05-14T09:36:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.559+0000 7fa851e00640 1 --2- 172.21.15.120:0/3421959216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1101f0 0x7fa84c112610 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.559+0000 7fa851e00640 1 --2- 172.21.15.120:0/3421959216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c075a10 0x7fa84c10fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.559+0000 7fa851e00640 1 --2- 172.21.15.120:0/3421959216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 0x7fa84c0754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.559+0000 7fa851e00640 1 -- 172.21.15.120:0/3421959216 >> 172.21.15.120:0/3421959216 conn(0x7fa84c0fec80 msgr2=0x7fa84c101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.561+0000 7fa851e00640 1 -- 172.21.15.120:0/3421959216 shutdown_connections 2024-05-14T09:36:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.561+0000 7fa851e00640 1 -- 172.21.15.120:0/3421959216 wait complete. 2024-05-14T09:36:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.564+0000 7fa851e00640 1 Processor -- start 2024-05-14T09:36:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.564+0000 7fa851e00640 1 -- start start 2024-05-14T09:36:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 0x7fa84c1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c075a10 0x7fa84c1a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c1101f0 0x7fa84c1a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c115b10 con 0x7fa84c1101f0 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c115990 con 0x7fa84c075a10 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c115c90 con 0x7fa84c0750c0 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa84be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c075a10 0x7fa84c1a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c1101f0 0x7fa84c1a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa850a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 0x7fa84c1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa850a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 0x7fa84c1a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:33984/0 (socket says 172.21.15.120:33984) 2024-05-14T09:36:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa850a00640 1 -- 172.21.15.120:0/1405970532 learned_addr learned my addr 172.21.15.120:0/1405970532 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.567+0000 7fa850a00640 1 -- 172.21.15.120:0/1405970532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c075a10 msgr2=0x7fa84c1a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.567+0000 7fa850a00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c075a10 0x7fa84c1a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.567+0000 7fa850a00640 1 -- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c1101f0 msgr2=0x7fa84c1a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.566+0000 7fa851400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c1101f0 0x7fa84c1a7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56940/0 (socket says 172.21.15.120:56940) 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.569+0000 7fa850a00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c1101f0 0x7fa84c1a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.569+0000 7fa850a00640 1 -- 172.21.15.120:0/1405970532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c1a8220 con 0x7fa84c0750c0 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.569+0000 7fa851400640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c1101f0 0x7fa84c1a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:36:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.570+0000 7fa850a00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 0x7fa84c1a06e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa84000b450 tx=0x7fa84000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.571+0000 7fa849600640 1 -- 172.21.15.120:0/1405970532 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840015020 con 0x7fa84c0750c0 2024-05-14T09:36:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.571+0000 7fa849600640 1 -- 172.21.15.120:0/1405970532 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa840011d20 con 0x7fa84c0750c0 2024-05-14T09:36:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.571+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84c1a8510 con 0x7fa84c0750c0 2024-05-14T09:36:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.571+0000 7fa849600640 1 -- 172.21.15.120:0/1405970532 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840010e10 con 0x7fa84c0750c0 2024-05-14T09:36:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.572+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84c1a8ae0 con 0x7fa84c0750c0 2024-05-14T09:36:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.579+0000 7fa85a3c6740 1 Processor -- start 2024-05-14T09:36:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.580+0000 7fa85a3c6740 1 -- start start 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.580+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8608d1b0 0x561d8642f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.580+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 0x561d8642f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.580+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8606c4d0 0x561d86436780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.580+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561d86393550 con 0x561d8608d1b0 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.580+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561d86338bc0 con 0x561d860642f0 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.580+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561d8638f510 con 0x561d8606c4d0 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.581+0000 7fa849600640 1 -- 172.21.15.120:0/1405970532 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa840018020 con 0x7fa84c0750c0 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.581+0000 7fa84be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8606c4d0 0x561d86436780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.581+0000 7fa84be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8606c4d0 0x561d86436780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:33998/0 (socket says 172.21.15.120:33998) 2024-05-14T09:36:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.581+0000 7fa84be00640 1 -- 172.21.15.120:0/1061809323 learned_addr learned my addr 172.21.15.120:0/1061809323 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.581+0000 7fa851400640 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8608d1b0 0x561d8642f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.582+0000 7fa850a00640 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 0x561d8642f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.582+0000 7fa84be00640 1 -- 172.21.15.120:0/1061809323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 msgr2=0x561d8642f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.582+0000 7fa84be00640 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 0x561d8642f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.582+0000 7fa84be00640 1 -- 172.21.15.120:0/1061809323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8608d1b0 msgr2=0x561d8642f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.583+0000 7fa84be00640 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8608d1b0 0x561d8642f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.583+0000 7fa84be00640 1 -- 172.21.15.120:0/1061809323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d860a5210 con 0x561d8606c4d0 2024-05-14T09:36:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.583+0000 7fa851400640 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8608d1b0 0x561d8642f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:36:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.584+0000 7fa84be00640 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8606c4d0 0x561d86436780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa838009c50 tx=0x7fa838010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bbc9a54077df662 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.585+0000 7fa83dc00640 1 -- 172.21.15.120:0/1061809323 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838005020 con 0x561d8606c4d0 2024-05-14T09:36:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.585+0000 7fa83dc00640 1 -- 172.21.15.120:0/1061809323 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8380047a0 con 0x561d8606c4d0 2024-05-14T09:36:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.585+0000 7fa83dc00640 1 -- 172.21.15.120:0/1061809323 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838005650 con 0x561d8606c4d0 2024-05-14T09:36:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.587+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1061809323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8606c4d0 msgr2=0x561d86436780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.587+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8606c4d0 0x561d86436780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa838009c50 tx=0x7fa838010740 comp rx=0 tx=0).stop 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.588+0000 7fa849600640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8340b2930 0x7fa8340b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.588+0000 7fa849600640 1 -- 172.21.15.120:0/1405970532 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa8400e1f60 con 0x7fa84c0750c0 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.588+0000 7fa851400640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8340b2930 0x7fa8340b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.589+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1061809323 shutdown_connections 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.589+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8606c4d0 0x561d86436780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.589+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 0x561d8642f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.589+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1061809323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8608d1b0 0x561d8642f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.589+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1061809323 >> 172.21.15.120:0/1061809323 conn(0x561d86081300 msgr2=0x561d8642ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.590+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1061809323 shutdown_connections 2024-05-14T09:36:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.590+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1061809323 wait complete. 2024-05-14T09:36:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.590+0000 7fa851400640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8340b2930 0x7fa8340b4e40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561d864304d0 tx=0x7fa844005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.591+0000 7fa85a3c6740 1 -- start start 2024-05-14T09:36:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.591+0000 7fa85a3c6740 1 Processor -- start 2024-05-14T09:36:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86438e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d864393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d864402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561d864371d0 con 0x561d8606c4d0 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561d8634c660 con 0x561d8608d1b0 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561d86437350 con 0x561d860642f0 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa85a3c6740 10 client.0 _ll_register_callbacks cb 0x561d86316400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa850a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86438e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa850a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86438e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:34004/0 (socket says 172.21.15.120:34004) 2024-05-14T09:36:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.592+0000 7fa850a00640 1 -- 172.21.15.120:0/2847279539 learned_addr learned my addr 172.21.15.120:0/2847279539 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa84be00640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d864393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa851400640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d864402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa850a00640 1 -- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 msgr2=0x561d864402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa850a00640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d864402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa850a00640 1 -- 172.21.15.120:0/2847279539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 msgr2=0x561d864393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa850a00640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d864393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa850a00640 1 -- 172.21.15.120:0/2847279539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d86171620 con 0x561d860642f0 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa851400640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d864402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:36:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.593+0000 7fa84be00640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d864393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.594+0000 7fa850a00640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86438e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa8400df6c0 tx=0x7fa8400a9800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d9797ce60a2646 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.594+0000 7fa832000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.594+0000 7fa832000640 1 -- 172.21.15.120:0/2847279539 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8400a8cf0 con 0x561d860642f0 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.594+0000 7fa832000640 1 -- 172.21.15.120:0/2847279539 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa8400dfb80 con 0x561d860642f0 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.594+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8380047a0 con 0x561d860642f0 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.594+0000 7fa832000640 1 -- 172.21.15.120:0/2847279539 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fa8400a98e0 con 0x561d860642f0 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.595+0000 7fa85a3c6740 10 client.26641 fetch_fsmap learned FSMap version 63 2024-05-14T09:36:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.595+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x561d86443250 con 0x561d860642f0 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa832000640 1 -- 172.21.15.120:0/2847279539 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8380047a0 con 0x561d860642f0 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa832000640 1 -- 172.21.15.120:0/2847279539 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 63) ==== 8378+0+0 (secure 0 0 0) 0x7fa8400ad100 con 0x561d860642f0 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa85a3c6740 10 client.26641 fetch_fsmap finished waiting for FSMap version 63 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa85a3c6740 10 client.26641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa85a3c6740 20 client.26641 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d8604bd80 0x561d86446970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa85a3c6740 4 client.26641 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:36:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.596+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d863a1160 con 0x561d8604bd80 2024-05-14T09:36:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.597+0000 7fa84be00640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d8604bd80 0x561d86446970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.598+0000 7fa84be00640 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d8604bd80 0x561d86446970 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d244fee61a2faa server_cookie=a4a617f9164a0f0e in_seq=0 out_seq=0 2024-05-14T09:36:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.598+0000 7fa832000640 10 client.26641 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.599+0000 7fa832000640 1 -- 172.21.15.120:0/2847279539 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561d863a1160 con 0x561d8604bd80 2024-05-14T09:36:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.599+0000 7fa832000640 10 client.26641 handle_command_reply: tid=0 2024-05-14T09:36:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.600+0000 7fa85a3c6740 1 client.26641 shutdown 2024-05-14T09:36:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.600+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 msgr2=0x561d86438e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.600+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86438e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa8400df6c0 tx=0x7fa8400a9800 comp rx=0 tx=0).stop 2024-05-14T09:36:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 shutdown_connections 2024-05-14T09:36:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d8604bd80 0x561d86446970 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d864402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d864393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2847279539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86438e80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 >> 172.21.15.120:0/2847279539 conn(0x561d86081300 msgr2=0x561d8642dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa832000640 0 client.26641 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 shutdown_connections 2024-05-14T09:36:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.601+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2847279539 wait complete. 2024-05-14T09:36:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.602+0000 7fa85a3c6740 20 client.26641 trim_cache size 0 max 16384 2024-05-14T09:36:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 Processor -- start 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 -- start start 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86439160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d8642a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d8642a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c00fc20 con 0x561d8606c4d0 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c011820 con 0x561d8608d1b0 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.633+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0102f0 con 0x561d860642f0 2024-05-14T09:36:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa851400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d8642a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa851400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d8642a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33892/0 (socket says 172.21.15.120:33892) 2024-05-14T09:36:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa851400640 1 -- 172.21.15.120:0/1093046318 learned_addr learned my addr 172.21.15.120:0/1093046318 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa850a00640 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86439160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa84be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d8642a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa84be00640 1 -- 172.21.15.120:0/1093046318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 msgr2=0x561d86439160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa84be00640 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86439160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa84be00640 1 -- 172.21.15.120:0/1093046318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 msgr2=0x561d8642a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa84be00640 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d8642a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.634+0000 7fa84be00640 1 -- 172.21.15.120:0/1093046318 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d8604bfb0 con 0x561d8606c4d0 2024-05-14T09:36:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.635+0000 7fa84be00640 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d8642a360 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa838000c00 tx=0x7fa8380048c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22137641cf58686 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.636+0000 7fa83d200640 1 -- 172.21.15.120:0/1093046318 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838009670 con 0x561d8606c4d0 2024-05-14T09:36:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.636+0000 7fa83d200640 1 -- 172.21.15.120:0/1093046318 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa838009810 con 0x561d8606c4d0 2024-05-14T09:36:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.636+0000 7fa83d200640 1 -- 172.21.15.120:0/1093046318 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838003b80 con 0x561d8606c4d0 2024-05-14T09:36:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.637+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1093046318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 msgr2=0x561d8642a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.637+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d8642a360 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa838000c00 tx=0x7fa8380048c0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.637+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1093046318 shutdown_connections 2024-05-14T09:36:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.637+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d8608d1b0 0x561d8642a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.637+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d8606c4d0 0x561d8642a360 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.637+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/1093046318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d860642f0 0x561d86439160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.637+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1093046318 >> 172.21.15.120:0/1093046318 conn(0x561d86081300 msgr2=0x561d86438a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.638+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1093046318 shutdown_connections 2024-05-14T09:36:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.640+0000 7fa85a3c6740 1 -- 172.21.15.120:0/1093046318 wait complete. 2024-05-14T09:36:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.640+0000 7fa85a3c6740 1 -- start start 2024-05-14T09:36:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.640+0000 7fa85a3c6740 1 Processor -- start 2024-05-14T09:36:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 0x561d864ac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8608d1b0 0x561d864aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa85a3c6740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d860211c0 0x561d864ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c011150 con 0x561d860211c0 2024-05-14T09:36:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c010a80 con 0x561d860642f0 2024-05-14T09:36:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa85a3c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c00dc20 con 0x561d8608d1b0 2024-05-14T09:36:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa85a3c6740 10 client.0 _ll_register_callbacks cb 0x7fa8400a8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.645+0000 7fa851400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d860211c0 0x561d864ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.646+0000 7fa851400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d860211c0 0x561d864ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56984/0 (socket says 172.21.15.120:56984) 2024-05-14T09:36:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.646+0000 7fa851400640 1 -- 172.21.15.120:0/2445702435 learned_addr learned my addr 172.21.15.120:0/2445702435 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.646+0000 7fa84be00640 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8608d1b0 0x561d864aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.647+0000 7fa851400640 1 -- 172.21.15.120:0/2445702435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8608d1b0 msgr2=0x561d864aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.647+0000 7fa851400640 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8608d1b0 0x561d864aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.647+0000 7fa851400640 1 -- 172.21.15.120:0/2445702435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 msgr2=0x561d864ac690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:36:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.647+0000 7fa851400640 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 0x561d864ac690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.647+0000 7fa851400640 1 -- 172.21.15.120:0/2445702435 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d864aba80 con 0x561d860211c0 2024-05-14T09:36:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.648+0000 7fa832000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:36:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.648+0000 7fa851400640 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d860211c0 0x561d864ab320 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa844030800 tx=0x7fa8440095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c6422081276c75 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:36.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.649+0000 7fa832000640 1 -- 172.21.15.120:0/2445702435 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844057060 con 0x561d860211c0 2024-05-14T09:36:36.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.649+0000 7fa832000640 1 -- 172.21.15.120:0/2445702435 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa84404f070 con 0x561d860211c0 2024-05-14T09:36:36.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.650+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa838009810 con 0x561d860211c0 2024-05-14T09:36:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.650+0000 7fa832000640 1 -- 172.21.15.120:0/2445702435 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fa844057060 con 0x561d860211c0 2024-05-14T09:36:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.651+0000 7fa85a3c6740 10 client.17082 fetch_fsmap learned FSMap version 63 2024-05-14T09:36:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.651+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x561d8643f1c0 con 0x561d860211c0 2024-05-14T09:36:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.651+0000 7fa832000640 1 -- 172.21.15.120:0/2445702435 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa838009810 con 0x561d860211c0 2024-05-14T09:36:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.652+0000 7fa832000640 1 -- 172.21.15.120:0/2445702435 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 63) ==== 8378+0+0 (secure 0 0 0) 0x7fa84403c410 con 0x561d860211c0 2024-05-14T09:36:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.652+0000 7fa85a3c6740 10 client.17082 fetch_fsmap finished waiting for FSMap version 63 2024-05-14T09:36:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.652+0000 7fa85a3c6740 10 client.17082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.652+0000 7fa85a3c6740 20 client.17082 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.652+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d864bfd30 0x561d864c2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.654+0000 7fa85a3c6740 4 client.17082 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:36:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.654+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d8639afd0 con 0x561d864bfd30 2024-05-14T09:36:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.656+0000 7fa850a00640 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d864bfd30 0x561d864c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.656+0000 7fa850a00640 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d864bfd30 0x561d864c2150 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e93c8e1ae83ca62f server_cookie=6b2c273d12d944cf in_seq=0 out_seq=0 2024-05-14T09:36:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.656+0000 7fa832000640 10 client.17082 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa832000640 1 -- 172.21.15.120:0/2445702435 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d8639afd0 con 0x561d864bfd30 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa832000640 10 client.17082 handle_command_reply: tid=0 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 client.17082 shutdown 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d860211c0 msgr2=0x561d864ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d860211c0 0x561d864ab320 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa844030800 tx=0x7fa8440095c0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 shutdown_connections 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561d864bfd30 0x561d864c2150 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d860211c0 0x561d864ab320 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8608d1b0 0x561d864aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.841+0000 7fa832000640 0 client.17082 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.840+0000 7fa85a3c6740 1 --2- 172.21.15.120:0/2445702435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561d860642f0 0x561d864ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.841+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 >> 172.21.15.120:0/2445702435 conn(0x561d86081300 msgr2=0x561d86429250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.841+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 shutdown_connections 2024-05-14T09:36:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.841+0000 7fa85a3c6740 1 -- 172.21.15.120:0/2445702435 wait complete. 2024-05-14T09:36:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:36:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:36:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:36:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.842+0000 7fa85a3c6740 20 client.17082 trim_cache size 0 max 16384 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8340b2930 msgr2=0x7fa8340b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8340b2930 0x7fa8340b4e40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561d864304d0 tx=0x7fa844005fd0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 msgr2=0x7fa84c1a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 0x7fa84c1a06e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa84000b450 tx=0x7fa84000b910 comp rx=0 tx=0).stop 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 shutdown_connections 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa8340b2930 0x7fa8340b4e40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa84c1101f0 0x7fa84c1a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c075a10 0x7fa84c1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 --2- 172.21.15.120:0/1405970532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa84c0750c0 0x7fa84c1a06e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.844+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 >> 172.21.15.120:0/1405970532 conn(0x7fa84c0fec80 msgr2=0x7fa84c103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.845+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 shutdown_connections 2024-05-14T09:36:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:36.845+0000 7fa851e00640 1 -- 172.21.15.120:0/1405970532 wait complete. 2024-05-14T09:36:38.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:38 smithi120 ceph-mon[31085]: pgmap v948: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2024-05-14T09:36:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:38 smithi152 ceph-mon[34868]: pgmap v948: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2024-05-14T09:36:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:38 smithi175 ceph-mon[35353]: pgmap v948: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2024-05-14T09:36:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 545.0 s, 614.6 tps, lat 162.446 ms stddev 65.368 2024-05-14T09:36:40.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:40 smithi152 ceph-mon[34868]: pgmap v949: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.4 MiB/s wr, 652 op/s 2024-05-14T09:36:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:40 smithi175 ceph-mon[35353]: pgmap v949: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.4 MiB/s wr, 652 op/s 2024-05-14T09:36:40.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:40 smithi120 ceph-mon[31085]: pgmap v949: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.4 MiB/s wr, 652 op/s 2024-05-14T09:36:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:42 smithi152 ceph-mon[34868]: pgmap v950: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-05-14T09:36:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:42 smithi175 ceph-mon[35353]: pgmap v950: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-05-14T09:36:42.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:42 smithi120 ceph-mon[31085]: pgmap v950: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-05-14T09:36:44.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 550.0 s, 572.7 tps, lat 175.812 ms stddev 90.993 2024-05-14T09:36:44.437 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:44 smithi120 ceph-mon[31085]: pgmap v951: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2024-05-14T09:36:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:44 smithi152 ceph-mon[34868]: pgmap v951: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2024-05-14T09:36:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:44 smithi175 ceph-mon[35353]: pgmap v951: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2024-05-14T09:36:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:46 smithi152 ceph-mon[34868]: pgmap v952: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.5 MiB/s wr, 654 op/s 2024-05-14T09:36:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:46 smithi175 ceph-mon[35353]: pgmap v952: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.5 MiB/s wr, 654 op/s 2024-05-14T09:36:46.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:46 smithi120 ceph-mon[31085]: pgmap v952: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.5 MiB/s wr, 654 op/s 2024-05-14T09:36:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:48 smithi152 ceph-mon[34868]: pgmap v953: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 622 op/s 2024-05-14T09:36:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:48 smithi175 ceph-mon[35353]: pgmap v953: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 622 op/s 2024-05-14T09:36:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:48 smithi120 ceph-mon[31085]: pgmap v953: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 622 op/s 2024-05-14T09:36:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 555.0 s, 583.9 tps, lat 170.346 ms stddev 117.638 2024-05-14T09:36:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.253+0000 7fb09f600640 1 -- 172.21.15.120:0/1841785918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807a190 msgr2=0x7fb098078360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.253+0000 7fb09f600640 1 --2- 172.21.15.120:0/1841785918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807a190 0x7fb098078360 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009900 tx=0x7fb08c02a3f0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.254+0000 7fb09f600640 1 -- 172.21.15.120:0/1841785918 shutdown_connections 2024-05-14T09:36:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.254+0000 7fb09f600640 1 --2- 172.21.15.120:0/1841785918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb09807aae0 0x7fb09807aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.254+0000 7fb09f600640 1 --2- 172.21.15.120:0/1841785918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0980788a0 0x7fb098078cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.254+0000 7fb09f600640 1 --2- 172.21.15.120:0/1841785918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807a190 0x7fb098078360 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.254+0000 7fb09f600640 1 -- 172.21.15.120:0/1841785918 >> 172.21.15.120:0/1841785918 conn(0x7fb0981010c0 msgr2=0x7fb098103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.254+0000 7fb09f600640 1 -- 172.21.15.120:0/1841785918 shutdown_connections 2024-05-14T09:36:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.254+0000 7fb09f600640 1 -- 172.21.15.120:0/1841785918 wait complete. 2024-05-14T09:36:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 Processor -- start 2024-05-14T09:36:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 -- start start 2024-05-14T09:36:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0980788a0 0x7fb0981a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09807a190 0x7fb0981a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807aae0 0x7fb0981a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb098115d50 con 0x7fb09807aae0 2024-05-14T09:36:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb098115bd0 con 0x7fb0980788a0 2024-05-14T09:36:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.255+0000 7fb09f600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb098115ed0 con 0x7fb09807a190 2024-05-14T09:36:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.256+0000 7fb09cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0980788a0 0x7fb0981a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.256+0000 7fb09cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0980788a0 0x7fb0981a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39314/0 (socket says 172.21.15.120:39314) 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.256+0000 7fb09cc00640 1 -- 172.21.15.120:0/2961996972 learned_addr learned my addr 172.21.15.120:0/2961996972 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.256+0000 7fb09d600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807aae0 0x7fb0981a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.256+0000 7fb097e00640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09807a190 0x7fb0981a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.257+0000 7fb09cc00640 1 -- 172.21.15.120:0/2961996972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09807a190 msgr2=0x7fb0981a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.257+0000 7fb09cc00640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09807a190 0x7fb0981a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.257+0000 7fb09cc00640 1 -- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807aae0 msgr2=0x7fb0981a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.257+0000 7fb09cc00640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807aae0 0x7fb0981a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.257+0000 7fb09cc00640 1 -- 172.21.15.120:0/2961996972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0981a84d0 con 0x7fb0980788a0 2024-05-14T09:36:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.257+0000 7fb09d600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807aae0 0x7fb0981a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:36:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.257+0000 7fb09cc00640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0980788a0 0x7fb0981a0990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0057c0 tx=0x7fb08c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.258+0000 7fb095600640 1 -- 172.21.15.120:0/2961996972 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c035030 con 0x7fb0980788a0 2024-05-14T09:36:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.258+0000 7fb095600640 1 -- 172.21.15.120:0/2961996972 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb08c003d50 con 0x7fb0980788a0 2024-05-14T09:36:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.258+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0981a8760 con 0x7fb0980788a0 2024-05-14T09:36:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.258+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0981a8ca0 con 0x7fb0980788a0 2024-05-14T09:36:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.258+0000 7fb095600640 1 -- 172.21.15.120:0/2961996972 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c031800 con 0x7fb0980788a0 2024-05-14T09:36:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.263+0000 7fb0a65d7740 1 Processor -- start 2024-05-14T09:36:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.264+0000 7fb0a65d7740 1 -- start start 2024-05-14T09:36:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.264+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b45a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.264+0000 7fb095600640 1 -- 172.21.15.120:0/2961996972 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb08c03a3c0 con 0x7fb0980788a0 2024-05-14T09:36:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b45a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b461580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56022b3be550 con 0x56022b0b81b0 2024-05-14T09:36:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb09d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b45a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb09d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b45a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45488/0 (socket says 172.21.15.120:45488) 2024-05-14T09:36:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb09d600640 1 -- 172.21.15.120:0/3869397373 learned_addr learned my addr 172.21.15.120:0/3869397373 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3869397373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56022b363bc0 con 0x56022b08f2f0 2024-05-14T09:36:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3869397373 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56022b3ba510 con 0x56022b0974d0 2024-05-14T09:36:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.265+0000 7fb09cc00640 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b45a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.266+0000 7fb09d600640 1 -- 172.21.15.120:0/3869397373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 msgr2=0x56022b461580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.266+0000 7fb09d600640 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b461580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.266+0000 7fb09d600640 1 -- 172.21.15.120:0/3869397373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 msgr2=0x56022b45a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.266+0000 7fb09d600640 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b45a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.266+0000 7fb09d600640 1 -- 172.21.15.120:0/3869397373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56022b0d0210 con 0x56022b0b81b0 2024-05-14T09:36:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.266+0000 7fb09d600640 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b45a100 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb090010830 tx=0x7fb090010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583ff1f83b4f7c74 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.267+0000 7fb095600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb0800b2860 0x7fb0800b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.267+0000 7fb089c00640 1 -- 172.21.15.120:0/3869397373 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090003b70 con 0x56022b0b81b0 2024-05-14T09:36:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.267+0000 7fb089c00640 1 -- 172.21.15.120:0/3869397373 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb09000edc0 con 0x56022b0b81b0 2024-05-14T09:36:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.267+0000 7fb09cc00640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb0800b2860 0x7fb0800b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb089c00640 1 -- 172.21.15.120:0/3869397373 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900046b0 con 0x56022b0b81b0 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb095600640 1 -- 172.21.15.120:0/2961996972 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb08c102d60 con 0x7fb0980788a0 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3869397373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 msgr2=0x56022b45a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b45a100 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb090010830 tx=0x7fb090010cf0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb09cc00640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb0800b2860 0x7fb0800b4d70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb08c042000 tx=0x7fb08c048000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3869397373 shutdown_connections 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b461580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b45a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3869397373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b45a100 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.268+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3869397373 >> 172.21.15.120:0/3869397373 conn(0x56022b0ac300 msgr2=0x56022b455a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.269+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3869397373 shutdown_connections 2024-05-14T09:36:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.269+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3869397373 wait complete. 2024-05-14T09:36:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.270+0000 7fb0a65d7740 1 -- start start 2024-05-14T09:36:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.270+0000 7fb0a65d7740 1 Processor -- start 2024-05-14T09:36:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.271+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b08f2f0 0x56022b463d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.271+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b464240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.271+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b0b81b0 0x56022b46b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.271+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56022b462020 con 0x56022b08f2f0 2024-05-14T09:36:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.271+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56022b377660 con 0x56022b0b81b0 2024-05-14T09:36:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.271+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56022b4621a0 con 0x56022b0974d0 2024-05-14T09:36:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.271+0000 7fb0a65d7740 10 client.0 _ll_register_callbacks cb 0x56022b341400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.272+0000 7fb09d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b08f2f0 0x56022b463d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.272+0000 7fb09d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b08f2f0 0x56022b463d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45492/0 (socket says 172.21.15.120:45492) 2024-05-14T09:36:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.272+0000 7fb097e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b464240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.272+0000 7fb09d600640 1 -- 172.21.15.120:0/3086026154 learned_addr learned my addr 172.21.15.120:0/3086026154 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.272+0000 7fb09d600640 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b0b81b0 0x56022b46b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.273+0000 7fb09d600640 1 -- 172.21.15.120:0/3086026154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 msgr2=0x56022b464240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.273+0000 7fb09d600640 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b464240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.273+0000 7fb09d600640 1 -- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b0b81b0 msgr2=0x56022b46b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.273+0000 7fb09d600640 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b0b81b0 0x56022b46b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.273+0000 7fb09d600640 1 -- 172.21.15.120:0/3086026154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56022b19c620 con 0x56022b08f2f0 2024-05-14T09:36:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.273+0000 7fb09d600640 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b08f2f0 0x56022b463d00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb090009990 tx=0x7fb090004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b36137669989780 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.273+0000 7fb07e000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:36:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.274+0000 7fb07e000640 1 -- 172.21.15.120:0/3086026154 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090023040 con 0x56022b08f2f0 2024-05-14T09:36:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.274+0000 7fb07e000640 1 -- 172.21.15.120:0/3086026154 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb0900047c0 con 0x56022b08f2f0 2024-05-14T09:36:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.274+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb09000edc0 con 0x56022b08f2f0 2024-05-14T09:36:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.274+0000 7fb07e000640 1 -- 172.21.15.120:0/3086026154 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fb090004a40 con 0x56022b08f2f0 2024-05-14T09:36:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.274+0000 7fb0a65d7740 10 client.17094 fetch_fsmap learned FSMap version 63 2024-05-14T09:36:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.274+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x56022b46e100 con 0x56022b08f2f0 2024-05-14T09:36:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.275+0000 7fb07e000640 1 -- 172.21.15.120:0/3086026154 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb09000edc0 con 0x56022b08f2f0 2024-05-14T09:36:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.275+0000 7fb07e000640 1 -- 172.21.15.120:0/3086026154 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 63) ==== 8378+0+0 (secure 0 0 0) 0x7fb0900051d0 con 0x56022b08f2f0 2024-05-14T09:36:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.275+0000 7fb0a65d7740 10 client.17094 fetch_fsmap finished waiting for FSMap version 63 2024-05-14T09:36:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.275+0000 7fb0a65d7740 10 client.17094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.276+0000 7fb0a65d7740 20 client.17094 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.276+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b076d80 0x56022b471520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.276+0000 7fb0a65d7740 4 client.17094 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:36:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.276+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56022b3cc160 con 0x56022b076d80 2024-05-14T09:36:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.276+0000 7fb097e00640 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b076d80 0x56022b471520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.279+0000 7fb097e00640 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b076d80 0x56022b471520 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d1abdfd78f4f977 server_cookie=314e8fbcf443f982 in_seq=0 out_seq=0 2024-05-14T09:36:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.279+0000 7fb07e000640 10 client.17094 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.282+0000 7fb07e000640 1 -- 172.21.15.120:0/3086026154 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56022b3cc160 con 0x56022b076d80 2024-05-14T09:36:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.282+0000 7fb07e000640 10 client.17094 handle_command_reply: tid=0 2024-05-14T09:36:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.282+0000 7fb0a65d7740 1 client.17094 shutdown 2024-05-14T09:36:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.282+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b08f2f0 msgr2=0x56022b463d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.282+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b08f2f0 0x56022b463d00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb090009990 tx=0x7fb090004040 comp rx=0 tx=0).stop 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 shutdown_connections 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b076d80 0x56022b471520 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b0b81b0 0x56022b46b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b464240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3086026154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b08f2f0 0x56022b463d00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 >> 172.21.15.120:0/3086026154 conn(0x56022b0ac300 msgr2=0x56022b454a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb07e000640 0 client.17094 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 shutdown_connections 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3086026154 wait complete. 2024-05-14T09:36:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.283+0000 7fb0a65d7740 20 client.17094 trim_cache size 0 max 16384 2024-05-14T09:36:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.315+0000 7fb0a65d7740 1 Processor -- start 2024-05-14T09:36:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.315+0000 7fb0a65d7740 1 -- start start 2024-05-14T09:36:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.315+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b455b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b46b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb07800fbc0 con 0x56022b0b81b0 2024-05-14T09:36:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb0780117c0 con 0x56022b08f2f0 2024-05-14T09:36:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb078010290 con 0x56022b0974d0 2024-05-14T09:36:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb09d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b455b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb09d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b455b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39334/0 (socket says 172.21.15.120:39334) 2024-05-14T09:36:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb09d600640 1 -- 172.21.15.120:0/3032290278 learned_addr learned my addr 172.21.15.120:0/3032290278 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb09d600640 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.316+0000 7fb097e00640 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b46b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.317+0000 7fb09d600640 1 -- 172.21.15.120:0/3032290278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 msgr2=0x56022b46b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.317+0000 7fb09d600640 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b46b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.317+0000 7fb09d600640 1 -- 172.21.15.120:0/3032290278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 msgr2=0x56022b46b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.317+0000 7fb09d600640 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.317+0000 7fb09d600640 1 -- 172.21.15.120:0/3032290278 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56022b456620 con 0x56022b08f2f0 2024-05-14T09:36:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.317+0000 7fb09d600640 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b455b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb090009700 tx=0x7fb090000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2ff7bb0fa60420 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.318+0000 7fb089200640 1 -- 172.21.15.120:0/3032290278 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090023030 con 0x56022b08f2f0 2024-05-14T09:36:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.318+0000 7fb089200640 1 -- 172.21.15.120:0/3032290278 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb090024040 con 0x56022b08f2f0 2024-05-14T09:36:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.318+0000 7fb089200640 1 -- 172.21.15.120:0/3032290278 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09001a640 con 0x56022b08f2f0 2024-05-14T09:36:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.319+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3032290278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 msgr2=0x56022b455b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.319+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b455b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb090009700 tx=0x7fb090000f40 comp rx=0 tx=0).stop 2024-05-14T09:36:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.319+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3032290278 shutdown_connections 2024-05-14T09:36:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.319+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.319+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b46b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.319+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/3032290278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b455b60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.319+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3032290278 >> 172.21.15.120:0/3032290278 conn(0x56022b0ac300 msgr2=0x56022b455450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.320+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3032290278 shutdown_connections 2024-05-14T09:36:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.320+0000 7fb0a65d7740 1 -- 172.21.15.120:0/3032290278 wait complete. 2024-05-14T09:36:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.320+0000 7fb0a65d7740 1 -- start start 2024-05-14T09:36:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.321+0000 7fb0a65d7740 1 Processor -- start 2024-05-14T09:36:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.322+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b466bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.322+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b467110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.322+0000 7fb09d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b466bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.322+0000 7fb09d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b466bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39350/0 (socket says 172.21.15.120:39350) 2024-05-14T09:36:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb0a65d7740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb0780110f0 con 0x56022b0b81b0 2024-05-14T09:36:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb078010a20 con 0x56022b08f2f0 2024-05-14T09:36:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb0a65d7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb07800dbc0 con 0x56022b0974d0 2024-05-14T09:36:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb09d600640 1 -- 172.21.15.120:0/4099506094 learned_addr learned my addr 172.21.15.120:0/4099506094 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:36:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb0a65d7740 10 client.0 _ll_register_callbacks cb 0x7fb090020040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:36:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb097e00640 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b467110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.323+0000 7fb09d600640 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.324+0000 7fb09d600640 1 -- 172.21.15.120:0/4099506094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 msgr2=0x56022b467110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.324+0000 7fb09d600640 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b467110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.324+0000 7fb09d600640 1 -- 172.21.15.120:0/4099506094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 msgr2=0x56022b46a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:36:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.324+0000 7fb09d600640 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.324+0000 7fb09d600640 1 -- 172.21.15.120:0/4099506094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56022b46a610 con 0x56022b08f2f0 2024-05-14T09:36:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.325+0000 7fb09d600640 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b466bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb090004080 tx=0x7fb0900106f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4303ad30c0b12cdb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:36:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.325+0000 7fb07e000640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:36:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.325+0000 7fb07e000640 1 -- 172.21.15.120:0/4099506094 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090023070 con 0x56022b08f2f0 2024-05-14T09:36:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.326+0000 7fb07e000640 1 -- 172.21.15.120:0/4099506094 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fb090004730 con 0x56022b08f2f0 2024-05-14T09:36:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.326+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb090024040 con 0x56022b08f2f0 2024-05-14T09:36:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.326+0000 7fb07e000640 1 -- 172.21.15.120:0/4099506094 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fb09000e720 con 0x56022b08f2f0 2024-05-14T09:36:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.326+0000 7fb0a65d7740 10 client.36593 fetch_fsmap learned FSMap version 63 2024-05-14T09:36:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.326+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x56022b46b810 con 0x56022b08f2f0 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.327+0000 7fb07e000640 1 -- 172.21.15.120:0/4099506094 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb090024040 con 0x56022b08f2f0 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.327+0000 7fb07e000640 1 -- 172.21.15.120:0/4099506094 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 63) ==== 8378+0+0 (secure 0 0 0) 0x7fb09001a640 con 0x56022b08f2f0 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.327+0000 7fb0a65d7740 10 client.36593 fetch_fsmap finished waiting for FSMap version 63 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.327+0000 7fb0a65d7740 10 client.36593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.328+0000 7fb0a65d7740 20 client.36593 populate_metadata read hostname 'smithi120' 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.328+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b04c1c0 0x56022b4dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.328+0000 7fb0a65d7740 4 client.36593 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.328+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56022b3c5fd0 con 0x56022b04c1c0 2024-05-14T09:36:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.328+0000 7fb097e00640 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b04c1c0 0x56022b4dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:36:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.329+0000 7fb097e00640 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b04c1c0 0x56022b4dbaf0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b75cefd391bc54 server_cookie=3a3f2cc1aa2af520 in_seq=0 out_seq=0 2024-05-14T09:36:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.329+0000 7fb07e000640 10 client.36593 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.359+0000 7fb07e000640 1 -- 172.21.15.120:0/4099506094 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56022b3c5fd0 con 0x56022b04c1c0 2024-05-14T09:36:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.359+0000 7fb07e000640 10 client.36593 handle_command_reply: tid=0 2024-05-14T09:36:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.359+0000 7fb0a65d7740 1 client.36593 shutdown 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.359+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 msgr2=0x56022b466bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.359+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b466bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb090004080 tx=0x7fb0900106f0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 shutdown_connections 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56022b04c1c0 0x56022b4dbaf0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56022b0b81b0 0x56022b46a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56022b0974d0 0x56022b467110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 --2- 172.21.15.120:0/4099506094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56022b08f2f0 0x56022b466bd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 >> 172.21.15.120:0/4099506094 conn(0x56022b0ac300 msgr2=0x56022b4632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb07e000640 0 client.36593 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:36:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 shutdown_connections 2024-05-14T09:36:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 1 -- 172.21.15.120:0/4099506094 wait complete. 2024-05-14T09:36:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.360+0000 7fb0a65d7740 20 client.36593 trim_cache size 0 max 16384 2024-05-14T09:36:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:36:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:36:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:36:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:36:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.362+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb0800b2860 msgr2=0x7fb0800b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.362+0000 7fb09f600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb0800b2860 0x7fb0800b4d70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb08c042000 tx=0x7fb08c048000 comp rx=0 tx=0).stop 2024-05-14T09:36:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.362+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0980788a0 msgr2=0x7fb0981a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:36:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.362+0000 7fb09f600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0980788a0 0x7fb0981a0990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0057c0 tx=0x7fb08c0046c0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.363+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 shutdown_connections 2024-05-14T09:36:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.363+0000 7fb09f600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fb0800b2860 0x7fb0800b4d70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.363+0000 7fb09f600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb09807aae0 0x7fb0981a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.363+0000 7fb09f600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09807a190 0x7fb0981a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.363+0000 7fb09f600640 1 --2- 172.21.15.120:0/2961996972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0980788a0 0x7fb0981a0990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:36:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.364+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 >> 172.21.15.120:0/2961996972 conn(0x7fb0981010c0 msgr2=0x7fb09810fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:36:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.364+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 shutdown_connections 2024-05-14T09:36:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:36:50.364+0000 7fb09f600640 1 -- 172.21.15.120:0/2961996972 wait complete. 2024-05-14T09:36:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:50 smithi152 ceph-mon[34868]: pgmap v954: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-05-14T09:36:50.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:50 smithi175 ceph-mon[35353]: pgmap v954: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-05-14T09:36:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:50 smithi120 ceph-mon[31085]: pgmap v954: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-05-14T09:36:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:52 smithi152 ceph-mon[34868]: pgmap v955: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 638 op/s 2024-05-14T09:36:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:52 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:36:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:52 smithi175 ceph-mon[35353]: pgmap v955: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 638 op/s 2024-05-14T09:36:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:52 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:36:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:52 smithi120 ceph-mon[31085]: pgmap v955: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 638 op/s 2024-05-14T09:36:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:52 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:36:54.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 560.0 s, 629.0 tps, lat 159.702 ms stddev 50.258 2024-05-14T09:36:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:54 smithi175 ceph-mon[35353]: pgmap v956: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 612 op/s 2024-05-14T09:36:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:54 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:36:54.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:54 smithi120 ceph-mon[31085]: pgmap v956: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 612 op/s 2024-05-14T09:36:54.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:54 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:36:54.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:54 smithi152 ceph-mon[34868]: pgmap v956: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 612 op/s 2024-05-14T09:36:54.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:54 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:36:55.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:55 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:55 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:55.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:55 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi152 to 176.4M 2024-05-14T09:36:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: Unable to set osd_memory_target on smithi152 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: pgmap v957: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.9 MiB/s wr, 633 op/s 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:36:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:56 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi152 to 176.4M 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: Unable to set osd_memory_target on smithi152 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: pgmap v957: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.9 MiB/s wr, 633 op/s 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:36:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:56 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi152 to 176.4M 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: Unable to set osd_memory_target on smithi152 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: pgmap v957: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.9 MiB/s wr, 633 op/s 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:36:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:36:56.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:56 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:36:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:57 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi120 to 176.4M 2024-05-14T09:36:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:57 smithi120 ceph-mon[31085]: Unable to set osd_memory_target on smithi120 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:36:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:57 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi120 to 176.4M 2024-05-14T09:36:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:57 smithi152 ceph-mon[34868]: Unable to set osd_memory_target on smithi120 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:36:57.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:57 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi120 to 176.4M 2024-05-14T09:36:57.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:57 smithi175 ceph-mon[35353]: Unable to set osd_memory_target on smithi120 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:36:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:36:58 smithi120 ceph-mon[31085]: pgmap v958: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 606 op/s 2024-05-14T09:36:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:36:58 smithi152 ceph-mon[34868]: pgmap v958: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 606 op/s 2024-05-14T09:36:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:36:58 smithi175 ceph-mon[35353]: pgmap v958: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 606 op/s 2024-05-14T09:36:59.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 565.0 s, 495.4 tps, lat 200.219 ms stddev 178.596 2024-05-14T09:37:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:00 smithi120 ceph-mon[31085]: pgmap v959: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.6 MiB/s wr, 679 op/s 2024-05-14T09:37:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:00 smithi152 ceph-mon[34868]: pgmap v959: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.6 MiB/s wr, 679 op/s 2024-05-14T09:37:00.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:00 smithi175 ceph-mon[35353]: pgmap v959: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.6 MiB/s wr, 679 op/s 2024-05-14T09:37:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:01 smithi120 ceph-mon[31085]: pgmap v960: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 641 op/s 2024-05-14T09:37:01.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:01 smithi152 ceph-mon[34868]: pgmap v960: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 641 op/s 2024-05-14T09:37:01.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:01 smithi175 ceph-mon[35353]: pgmap v960: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 MiB/s wr, 641 op/s 2024-05-14T09:37:02.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:02 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:37:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:02 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:37:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:02 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:37:03.638 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:03 smithi120 ceph-mon[31085]: pgmap v961: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-05-14T09:37:03.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:03 smithi152 ceph-mon[34868]: pgmap v961: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-05-14T09:37:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:03 smithi175 ceph-mon[35353]: pgmap v961: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-05-14T09:37:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.830+0000 7fab2ca00640 1 -- 172.21.15.120:0/4124584212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 msgr2=0x7fab28111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.830+0000 7fab2ca00640 1 --2- 172.21.15.120:0/4124584212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab28111cb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fab18009900 tx=0x7fab1802a410 comp rx=0 tx=0).stop 2024-05-14T09:37:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.830+0000 7fab2ca00640 1 -- 172.21.15.120:0/4124584212 shutdown_connections 2024-05-14T09:37:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.830+0000 7fab2ca00640 1 --2- 172.21.15.120:0/4124584212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab281121f0 0x7fab28114690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.830+0000 7fab2ca00640 1 --2- 172.21.15.120:0/4124584212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab28111cb0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.830+0000 7fab2ca00640 1 --2- 172.21.15.120:0/4124584212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab2810a0f0 0x7fab2810a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.830+0000 7fab2ca00640 1 -- 172.21.15.120:0/4124584212 >> 172.21.15.120:0/4124584212 conn(0x7fab28070670 msgr2=0x7fab28072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.833+0000 7fab2ca00640 1 -- 172.21.15.120:0/4124584212 shutdown_connections 2024-05-14T09:37:03.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.833+0000 7fab2ca00640 1 -- 172.21.15.120:0/4124584212 wait complete. 2024-05-14T09:37:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.836+0000 7fab2ca00640 1 Processor -- start 2024-05-14T09:37:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.836+0000 7fab2ca00640 1 -- start start 2024-05-14T09:37:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.837+0000 7fab2ca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2810a0f0 0x7fab281a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.837+0000 7fab2ca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab281a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.837+0000 7fab2ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab281121f0 0x7fab281aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.837+0000 7fab2ca00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fab28118000 con 0x7fab2810f890 2024-05-14T09:37:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.837+0000 7fab2ca00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab28117e80 con 0x7fab2810a0f0 2024-05-14T09:37:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.837+0000 7fab2ca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab28118180 con 0x7fab281121f0 2024-05-14T09:37:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.838+0000 7fab25400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab281a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.838+0000 7fab25400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab281a3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53636/0 (socket says 172.21.15.120:53636) 2024-05-14T09:37:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.838+0000 7fab25400640 1 -- 172.21.15.120:0/2447207908 learned_addr learned my addr 172.21.15.120:0/2447207908 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.838+0000 7fab26800640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab281121f0 0x7fab281aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.838+0000 7fab25e00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2810a0f0 0x7fab281a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.839+0000 7fab25e00640 1 -- 172.21.15.120:0/2447207908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab281121f0 msgr2=0x7fab281aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.839+0000 7fab25e00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab281121f0 0x7fab281aa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.839+0000 7fab25e00640 1 -- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 msgr2=0x7fab281a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.839+0000 7fab25e00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab281a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.839+0000 7fab25e00640 1 -- 172.21.15.120:0/2447207908 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2810b770 con 0x7fab2810a0f0 2024-05-14T09:37:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.839+0000 7fab25400640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab281a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.840+0000 7fab25e00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2810a0f0 0x7fab281a2d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fab2000bd40 tx=0x7fab2000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.840+0000 7fab1ea00640 1 -- 172.21.15.120:0/2447207908 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20019070 con 0x7fab2810a0f0 2024-05-14T09:37:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.841+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2810ba60 con 0x7fab2810a0f0 2024-05-14T09:37:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.841+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2810c080 con 0x7fab2810a0f0 2024-05-14T09:37:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.841+0000 7fab1ea00640 1 -- 172.21.15.120:0/2447207908 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab200148d0 con 0x7fab2810a0f0 2024-05-14T09:37:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.841+0000 7fab1ea00640 1 -- 172.21.15.120:0/2447207908 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab200127a0 con 0x7fab2810a0f0 2024-05-14T09:37:03.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.851+0000 7fab1ea00640 1 -- 172.21.15.120:0/2447207908 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fab2001c070 con 0x7fab2810a0f0 2024-05-14T09:37:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.853+0000 7fab33a2e740 1 Processor -- start 2024-05-14T09:37:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.854+0000 7fab33a2e740 1 -- start start 2024-05-14T09:37:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.855+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb623910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.855+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb623e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.855+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb62ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.855+0000 7fab33a2e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bebb57f550 con 0x55bebb2791b0 2024-05-14T09:37:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.855+0000 7fab33a2e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bebb524bc0 con 0x55bebb2502f0 2024-05-14T09:37:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.855+0000 7fab33a2e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bebb57b510 con 0x55bebb2584d0 2024-05-14T09:37:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.856+0000 7fab25400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb62ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.856+0000 7fab25e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb623e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.856+0000 7fab26800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb623910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.856+0000 7fab26800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb623910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53652/0 (socket says 172.21.15.120:53652) 2024-05-14T09:37:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.856+0000 7fab25e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb623e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:57910/0 (socket says 172.21.15.120:57910) 2024-05-14T09:37:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.856+0000 7fab26800640 1 -- 172.21.15.120:0/3144825550 learned_addr learned my addr 172.21.15.120:0/3144825550 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.857+0000 7fab1ea00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fab0c0b2860 0x7fab0c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.857+0000 7fab25e00640 1 -- 172.21.15.120:0/3144825550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 msgr2=0x55bebb62ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.857+0000 7fab25e00640 1 --2- 172.21.15.120:0/3144825550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb62ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.857+0000 7fab25e00640 1 -- 172.21.15.120:0/3144825550 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 msgr2=0x55bebb623910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.857+0000 7fab25e00640 1 --2- 172.21.15.120:0/3144825550 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb623910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.857+0000 7fab25e00640 1 -- 172.21.15.120:0/3144825550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebb291210 con 0x55bebb2502f0 2024-05-14T09:37:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.858+0000 7fab25e00640 1 --2- 172.21.15.120:0/3144825550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb623e90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab200df3d0 tx=0x7fab2006e5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99471f9333ba03e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.858+0000 7fab1ea00640 1 -- 172.21.15.120:0/2447207908 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fab200e1ca0 con 0x7fab2810a0f0 2024-05-14T09:37:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.858+0000 7fab17000640 1 -- 172.21.15.120:0/3144825550 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab200a8da0 con 0x55bebb2502f0 2024-05-14T09:37:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.858+0000 7fab17000640 1 -- 172.21.15.120:0/3144825550 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab200a8ae0 con 0x55bebb2502f0 2024-05-14T09:37:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.858+0000 7fab17000640 1 -- 172.21.15.120:0/3144825550 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab200a8da0 con 0x55bebb2502f0 2024-05-14T09:37:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.859+0000 7fab26800640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fab0c0b2860 0x7fab0c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.860+0000 7fab33a2e740 1 -- 172.21.15.120:0/3144825550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 msgr2=0x55bebb623e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.860+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3144825550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb623e90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab200df3d0 tx=0x7fab2006e5c0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.861+0000 7fab33a2e740 1 -- 172.21.15.120:0/3144825550 shutdown_connections 2024-05-14T09:37:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.861+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3144825550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb62ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.861+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3144825550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb623e90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.861+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3144825550 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb623910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.861+0000 7fab33a2e740 1 -- 172.21.15.120:0/3144825550 >> 172.21.15.120:0/3144825550 conn(0x55bebb26d300 msgr2=0x55bebb616a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.861+0000 7fab33a2e740 1 -- 172.21.15.120:0/3144825550 shutdown_connections 2024-05-14T09:37:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.862+0000 7fab33a2e740 1 -- 172.21.15.120:0/3144825550 wait complete. 2024-05-14T09:37:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.862+0000 7fab33a2e740 1 -- start start 2024-05-14T09:37:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.863+0000 7fab33a2e740 1 Processor -- start 2024-05-14T09:37:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.865+0000 7fab26800640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fab0c0b2860 0x7fab0c0b4d70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55bebb624ae0 tx=0x7fab10008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.865+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb61c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.865+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb61ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.866+0000 7fab25e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb61c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.866+0000 7fab25e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb61c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:57912/0 (socket says 172.21.15.120:57912) 2024-05-14T09:37:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.866+0000 7fab25e00640 1 -- 172.21.15.120:0/808416075 learned_addr learned my addr 172.21.15.120:0/808416075 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.866+0000 7fab33a2e740 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb621dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.867+0000 7fab25400640 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb61ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.867+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bebb617d20 con 0x55bebb2791b0 2024-05-14T09:37:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.867+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bebb538660 con 0x55bebb2502f0 2024-05-14T09:37:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.867+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bebb617ea0 con 0x55bebb2584d0 2024-05-14T09:37:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.867+0000 7fab33a2e740 10 client.0 _ll_register_callbacks cb 0x55bebb502400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.868+0000 7fab26800640 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb621dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.869+0000 7fab25400640 1 -- 172.21.15.120:0/808416075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 msgr2=0x55bebb61c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.869+0000 7fab25400640 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb61c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.869+0000 7fab25400640 1 -- 172.21.15.120:0/808416075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 msgr2=0x55bebb621dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.869+0000 7fab25400640 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb621dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.869+0000 7fab25400640 1 -- 172.21.15.120:0/808416075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bebb35d620 con 0x55bebb2584d0 2024-05-14T09:37:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.870+0000 7fab25400640 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb61ce80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab18000c00 tx=0x7fab18003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc96b34da15493c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.871+0000 7fab0b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:37:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.871+0000 7fab0b400640 1 -- 172.21.15.120:0/808416075 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab18035070 con 0x55bebb2584d0 2024-05-14T09:37:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.871+0000 7fab0b400640 1 -- 172.21.15.120:0/808416075 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fab18003da0 con 0x55bebb2584d0 2024-05-14T09:37:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.872+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab200a8ae0 con 0x55bebb2584d0 2024-05-14T09:37:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.872+0000 7fab0b400640 1 -- 172.21.15.120:0/808416075 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fab18031500 con 0x55bebb2584d0 2024-05-14T09:37:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.872+0000 7fab33a2e740 10 client.26671 fetch_fsmap learned FSMap version 65 2024-05-14T09:37:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.872+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55bebb63fdf0 con 0x55bebb2584d0 2024-05-14T09:37:03.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.873+0000 7fab0b400640 1 -- 172.21.15.120:0/808416075 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab200a8ae0 con 0x55bebb2584d0 2024-05-14T09:37:03.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.873+0000 7fab0b400640 1 -- 172.21.15.120:0/808416075 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) ==== 8366+0+0 (secure 0 0 0) 0x7fab1803c780 con 0x55bebb2584d0 2024-05-14T09:37:03.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.874+0000 7fab33a2e740 10 client.26671 fetch_fsmap finished waiting for FSMap version 65 2024-05-14T09:37:03.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.874+0000 7fab33a2e740 10 client.26671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.874+0000 7fab33a2e740 20 client.26671 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.874+0000 7fab33a2e740 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb237d80 0x55bebb6434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.874+0000 7fab33a2e740 4 client.26671 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:37:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.874+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bebb58d160 con 0x55bebb237d80 2024-05-14T09:37:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.875+0000 7fab25e00640 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb237d80 0x55bebb6434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.877+0000 7fab25e00640 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb237d80 0x55bebb6434f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f391082c1f1eacb1 server_cookie=1d07ebd671f94eef in_seq=0 out_seq=0 2024-05-14T09:37:03.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.878+0000 7fab0b400640 10 client.26671 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:03.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.878+0000 7fab0b400640 1 -- 172.21.15.120:0/808416075 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bebb58d160 con 0x55bebb237d80 2024-05-14T09:37:03.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.878+0000 7fab0b400640 10 client.26671 handle_command_reply: tid=0 2024-05-14T09:37:03.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.879+0000 7fab33a2e740 1 client.26671 shutdown 2024-05-14T09:37:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 msgr2=0x55bebb61ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb61ce80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab18000c00 tx=0x7fab18003960 comp rx=0 tx=0).stop 2024-05-14T09:37:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 shutdown_connections 2024-05-14T09:37:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb237d80 0x55bebb6434f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2791b0 0x55bebb621dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb61ce80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 --2- 172.21.15.120:0/808416075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb61c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.880+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 >> 172.21.15.120:0/808416075 conn(0x55bebb26d300 msgr2=0x55bebb615a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.881+0000 7fab0b400640 0 client.26671 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.881+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 shutdown_connections 2024-05-14T09:37:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.882+0000 7fab33a2e740 1 -- 172.21.15.120:0/808416075 wait complete. 2024-05-14T09:37:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.882+0000 7fab33a2e740 20 client.26671 trim_cache size 0 max 16384 2024-05-14T09:37:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.915+0000 7fab33a2e740 1 Processor -- start 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.915+0000 7fab33a2e740 1 -- start start 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.916+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb622400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.916+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2584d0 0x55bebb648cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.916+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2791b0 0x55bebb649230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.916+0000 7fab33a2e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fab0400fc20 con 0x55bebb2584d0 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.916+0000 7fab33a2e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab04011790 con 0x55bebb2502f0 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.916+0000 7fab33a2e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab040102f0 con 0x55bebb2791b0 2024-05-14T09:37:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.917+0000 7fab25e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb622400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.918+0000 7fab25e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb622400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:57922/0 (socket says 172.21.15.120:57922) 2024-05-14T09:37:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.918+0000 7fab26800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2791b0 0x55bebb649230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.918+0000 7fab26800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2791b0 0x55bebb649230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:35516/0 (socket says 172.21.15.120:35516) 2024-05-14T09:37:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.918+0000 7fab26800640 1 -- 172.21.15.120:0/3234884769 learned_addr learned my addr 172.21.15.120:0/3234884769 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.919+0000 7fab26800640 1 -- 172.21.15.120:0/3234884769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 msgr2=0x55bebb622400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.919+0000 7fab26800640 1 --2- 172.21.15.120:0/3234884769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb622400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.919+0000 7fab26800640 1 -- 172.21.15.120:0/3234884769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2584d0 msgr2=0x55bebb648cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.919+0000 7fab26800640 1 --2- 172.21.15.120:0/3234884769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2584d0 0x55bebb648cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.919+0000 7fab26800640 1 -- 172.21.15.120:0/3234884769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebb617620 con 0x55bebb2791b0 2024-05-14T09:37:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.922+0000 7fab26800640 1 --2- 172.21.15.120:0/3234884769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2791b0 0x55bebb649230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fab10011d10 tx=0x7fab10014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de97bf077ea1837b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.923+0000 7fab16600640 1 -- 172.21.15.120:0/3234884769 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10026070 con 0x55bebb2791b0 2024-05-14T09:37:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.924+0000 7fab16600640 1 -- 172.21.15.120:0/3234884769 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab10022890 con 0x55bebb2791b0 2024-05-14T09:37:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.924+0000 7fab16600640 1 -- 172.21.15.120:0/3234884769 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10014780 con 0x55bebb2791b0 2024-05-14T09:37:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.925+0000 7fab33a2e740 1 -- 172.21.15.120:0/3234884769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2791b0 msgr2=0x55bebb649230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.925+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3234884769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2791b0 0x55bebb649230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fab10011d10 tx=0x7fab10014000 comp rx=0 tx=0).stop 2024-05-14T09:37:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.926+0000 7fab33a2e740 1 -- 172.21.15.120:0/3234884769 shutdown_connections 2024-05-14T09:37:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.926+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3234884769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2791b0 0x55bebb649230 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.926+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3234884769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2584d0 0x55bebb648cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.926+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3234884769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2502f0 0x55bebb622400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.926+0000 7fab33a2e740 1 -- 172.21.15.120:0/3234884769 >> 172.21.15.120:0/3234884769 conn(0x55bebb26d300 msgr2=0x55bebb621cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.927+0000 7fab33a2e740 1 -- 172.21.15.120:0/3234884769 shutdown_connections 2024-05-14T09:37:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.927+0000 7fab33a2e740 1 -- 172.21.15.120:0/3234884769 wait complete. 2024-05-14T09:37:03.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.929+0000 7fab33a2e740 1 -- start start 2024-05-14T09:37:03.929 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.929+0000 7fab33a2e740 1 Processor -- start 2024-05-14T09:37:03.930 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.930+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2502f0 0x55bebb6540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.931+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb654620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.931+0000 7fab33a2e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2791b0 0x55bebb6a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.931+0000 7fab33a2e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fab040110c0 con 0x55bebb2502f0 2024-05-14T09:37:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.931+0000 7fab33a2e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab040109f0 con 0x55bebb2791b0 2024-05-14T09:37:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.931+0000 7fab33a2e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab0400dc20 con 0x55bebb2584d0 2024-05-14T09:37:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.931+0000 7fab33a2e740 10 client.0 _ll_register_callbacks cb 0x7fab180043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.931+0000 7fab25e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2502f0 0x55bebb6540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.932+0000 7fab26800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2791b0 0x55bebb6a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.932+0000 7fab26800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2791b0 0x55bebb6a97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:57924/0 (socket says 172.21.15.120:57924) 2024-05-14T09:37:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.933+0000 7fab26800640 1 -- 172.21.15.120:0/3004674968 learned_addr learned my addr 172.21.15.120:0/3004674968 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.932+0000 7fab25400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb654620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.932+0000 7fab25e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2502f0 0x55bebb6540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53674/0 (socket says 172.21.15.120:53674) 2024-05-14T09:37:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.934+0000 7fab26800640 1 -- 172.21.15.120:0/3004674968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 msgr2=0x55bebb654620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.934+0000 7fab26800640 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb654620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.934+0000 7fab26800640 1 -- 172.21.15.120:0/3004674968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2502f0 msgr2=0x55bebb6540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:03.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.934+0000 7fab26800640 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2502f0 0x55bebb6540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:03.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.934+0000 7fab26800640 1 -- 172.21.15.120:0/3004674968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bebb6a9db0 con 0x55bebb2791b0 2024-05-14T09:37:03.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.934+0000 7fab25400640 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb654620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.935+0000 7fab26800640 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2791b0 0x55bebb6a97c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab10011f70 tx=0x7fab10011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a846041cf85ac12e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.935+0000 7fab0b400640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:37:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.936+0000 7fab0b400640 1 -- 172.21.15.120:0/3004674968 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1003a060 con 0x55bebb2791b0 2024-05-14T09:37:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.936+0000 7fab0b400640 1 -- 172.21.15.120:0/3004674968 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fab10022c50 con 0x55bebb2791b0 2024-05-14T09:37:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.936+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab10022890 con 0x55bebb2791b0 2024-05-14T09:37:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.937+0000 7fab0b400640 1 -- 172.21.15.120:0/3004674968 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fab10026050 con 0x55bebb2791b0 2024-05-14T09:37:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.937+0000 7fab33a2e740 10 client.36608 fetch_fsmap learned FSMap version 65 2024-05-14T09:37:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.937+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55bebb6ab040 con 0x55bebb2791b0 2024-05-14T09:37:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab0b400640 1 -- 172.21.15.120:0/3004674968 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab10022890 con 0x55bebb2791b0 2024-05-14T09:37:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab0b400640 1 -- 172.21.15.120:0/3004674968 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 65) ==== 8366+0+0 (secure 0 0 0) 0x7fab1002b4b0 con 0x55bebb2791b0 2024-05-14T09:37:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab33a2e740 10 client.36608 fetch_fsmap finished waiting for FSMap version 65 2024-05-14T09:37:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab33a2e740 10 client.36608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab33a2e740 20 client.36608 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb20d1c0 0x55bebb6ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab33a2e740 4 client.36608 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:37:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.938+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bebb611ee0 con 0x55bebb20d1c0 2024-05-14T09:37:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.939+0000 7fab25e00640 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb20d1c0 0x55bebb6ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.940+0000 7fab0b400640 10 client.36608 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:03.940+0000 7fab25e00640 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb20d1c0 0x55bebb6ad910 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6944ab84119fd461 server_cookie=b73af01a1fe97ea7 in_seq=0 out_seq=0 2024-05-14T09:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.012+0000 7fab0b400640 1 -- 172.21.15.120:0/3004674968 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bebb611ee0 con 0x55bebb20d1c0 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.012+0000 7fab0b400640 10 client.36608 handle_command_reply: tid=0 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.012+0000 7fab33a2e740 1 client.36608 shutdown 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2791b0 msgr2=0x55bebb6a97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2791b0 0x55bebb6a97c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab10011f70 tx=0x7fab10011980 comp rx=0 tx=0).stop 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 shutdown_connections 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bebb20d1c0 0x55bebb6ad910 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bebb2791b0 0x55bebb6a97c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bebb2584d0 0x55bebb654620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 --2- 172.21.15.120:0/3004674968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bebb2502f0 0x55bebb6540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 >> 172.21.15.120:0/3004674968 conn(0x55bebb26d300 msgr2=0x55bebb61bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab0b400640 0 client.36608 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.013+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 shutdown_connections 2024-05-14T09:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.015+0000 7fab33a2e740 1 -- 172.21.15.120:0/3004674968 wait complete. 2024-05-14T09:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.015+0000 7fab33a2e740 20 client.36608 trim_cache size 0 max 16384 2024-05-14T09:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fab0c0b2860 msgr2=0x7fab0c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fab0c0b2860 0x7fab0c0b4d70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55bebb624ae0 tx=0x7fab10008040 comp rx=0 tx=0).stop 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2810a0f0 msgr2=0x7fab281a2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2810a0f0 0x7fab281a2d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fab2000bd40 tx=0x7fab2000be30 comp rx=0 tx=0).stop 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 shutdown_connections 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fab0c0b2860 0x7fab0c0b4d70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab281121f0 0x7fab281aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab2810f890 0x7fab281a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 --2- 172.21.15.120:0/2447207908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2810a0f0 0x7fab281a2d40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.021+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 >> 172.21.15.120:0/2447207908 conn(0x7fab28070670 msgr2=0x7fab28110850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.022+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 shutdown_connections 2024-05-14T09:37:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:04.023+0000 7fab2ca00640 1 -- 172.21.15.120:0/2447207908 wait complete. 2024-05-14T09:37:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 570.0 s, 483.4 tps, lat 198.198 ms stddev 321.613 2024-05-14T09:37:06.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:05 smithi175 ceph-mon[35353]: pgmap v962: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-14T09:37:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:05 smithi120 ceph-mon[31085]: pgmap v962: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-14T09:37:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:05 smithi152 ceph-mon[34868]: pgmap v962: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-14T09:37:08.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:07 smithi120 ceph-mon[31085]: pgmap v963: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.8 MiB/s wr, 668 op/s 2024-05-14T09:37:08.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:07 smithi152 ceph-mon[34868]: pgmap v963: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.8 MiB/s wr, 668 op/s 2024-05-14T09:37:08.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:07 smithi175 ceph-mon[35353]: pgmap v963: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.8 MiB/s wr, 668 op/s 2024-05-14T09:37:09.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 575.0 s, 701.2 tps, lat 149.517 ms stddev 126.281 2024-05-14T09:37:10.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:10 smithi120 ceph-mon[31085]: pgmap v964: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 699 op/s 2024-05-14T09:37:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:10 smithi152 ceph-mon[34868]: pgmap v964: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 699 op/s 2024-05-14T09:37:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:10 smithi175 ceph-mon[35353]: pgmap v964: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 699 op/s 2024-05-14T09:37:12.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:12 smithi175 ceph-mon[35353]: pgmap v965: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.7 MiB/s wr, 641 op/s 2024-05-14T09:37:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:12 smithi120 ceph-mon[31085]: pgmap v965: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.7 MiB/s wr, 641 op/s 2024-05-14T09:37:12.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:12 smithi152 ceph-mon[34868]: pgmap v965: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.7 MiB/s wr, 641 op/s 2024-05-14T09:37:14.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 580.0 s, 642.7 tps, lat 155.297 ms stddev 52.751 2024-05-14T09:37:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:14 smithi120 ceph-mon[31085]: pgmap v966: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 600 op/s 2024-05-14T09:37:14.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:14 smithi152 ceph-mon[34868]: pgmap v966: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 600 op/s 2024-05-14T09:37:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:14 smithi175 ceph-mon[35353]: pgmap v966: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 600 op/s 2024-05-14T09:37:16.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:16 smithi120 ceph-mon[31085]: pgmap v967: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 646 op/s 2024-05-14T09:37:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:16 smithi152 ceph-mon[34868]: pgmap v967: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 646 op/s 2024-05-14T09:37:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:16 smithi175 ceph-mon[35353]: pgmap v967: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 646 op/s 2024-05-14T09:37:17.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.421+0000 7f897f600640 1 -- 172.21.15.120:0/2289673021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810b370 msgr2=0x7f897810b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.421+0000 7f897f600640 1 --2- 172.21.15.120:0/2289673021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810b370 0x7f897810b780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8964009930 tx=0x7f896402a420 comp rx=0 tx=0).stop 2024-05-14T09:37:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.421+0000 7f897f600640 1 -- 172.21.15.120:0/2289673021 shutdown_connections 2024-05-14T09:37:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.421+0000 7f897f600640 1 --2- 172.21.15.120:0/2289673021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810bcc0 0x7f89781136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.421+0000 7f897f600640 1 --2- 172.21.15.120:0/2289673021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810b370 0x7f897810b780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.421+0000 7f897f600640 1 --2- 172.21.15.120:0/2289673021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f897810a250 0x7f897810a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.421+0000 7f897f600640 1 -- 172.21.15.120:0/2289673021 >> 172.21.15.120:0/2289673021 conn(0x7f8978070a90 msgr2=0x7f8978072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:17.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.423+0000 7f897f600640 1 -- 172.21.15.120:0/2289673021 shutdown_connections 2024-05-14T09:37:17.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.423+0000 7f897f600640 1 -- 172.21.15.120:0/2289673021 wait complete. 2024-05-14T09:37:17.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 Processor -- start 2024-05-14T09:37:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 -- start start 2024-05-14T09:37:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810a250 0x7f89781a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f897810b370 0x7f89781a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810bcc0 0x7f89781a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8978115c50 con 0x7f897810b370 2024-05-14T09:37:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8978115ad0 con 0x7f897810a250 2024-05-14T09:37:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.425+0000 7f897f600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8978115dd0 con 0x7f897810bcc0 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.426+0000 7f897d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810bcc0 0x7f89781a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.426+0000 7f897cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810a250 0x7f89781a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.426+0000 7f8977e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f897810b370 0x7f89781a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.426+0000 7f897cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810a250 0x7f89781a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33682/0 (socket says 172.21.15.120:33682) 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.426+0000 7f897cc00640 1 -- 172.21.15.120:0/3538351576 learned_addr learned my addr 172.21.15.120:0/3538351576 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.427+0000 7f897cc00640 1 -- 172.21.15.120:0/3538351576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810bcc0 msgr2=0x7f89781a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.427+0000 7f897cc00640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810bcc0 0x7f89781a7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.427+0000 7f897cc00640 1 -- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f897810b370 msgr2=0x7f89781a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.427+0000 7f897cc00640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f897810b370 0x7f89781a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.427+0000 7f897cc00640 1 -- 172.21.15.120:0/3538351576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89781b0c20 con 0x7f897810a250 2024-05-14T09:37:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.428+0000 7f897cc00640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810a250 0x7f89781a08d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f896c00e9f0 tx=0x7f896c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.428+0000 7f8975600640 1 -- 172.21.15.120:0/3538351576 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c00ccc0 con 0x7f897810a250 2024-05-14T09:37:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.428+0000 7f8975600640 1 -- 172.21.15.120:0/3538351576 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f896c0108c0 con 0x7f897810a250 2024-05-14T09:37:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.428+0000 7f8975600640 1 -- 172.21.15.120:0/3538351576 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c018680 con 0x7f897810a250 2024-05-14T09:37:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.428+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89781b0f10 con 0x7f897810a250 2024-05-14T09:37:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.429+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89781b12c0 con 0x7f897810a250 2024-05-14T09:37:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.435+0000 7f89865bf740 1 Processor -- start 2024-05-14T09:37:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f89865bf740 1 -- start start 2024-05-14T09:37:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f89865bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f81100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f89865bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f89865bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f89865bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e476ee5550 con 0x55e476bdf1b0 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f89865bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e476e8abc0 con 0x55e476bbe4d0 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f89865bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e476ee1510 con 0x55e476bb62f0 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.436+0000 7f8975600640 1 -- 172.21.15.120:0/3538351576 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f896c010430 con 0x7f897810a250 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f88580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:33690/0 (socket says 172.21.15.120:33690) 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 -- 172.21.15.120:0/2461724389 learned_addr learned my addr 172.21.15.120:0/2461724389 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f897d600640 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f81100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f897cc00640 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f81680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 -- 172.21.15.120:0/2461724389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 msgr2=0x55e476f81680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f81680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 -- 172.21.15.120:0/2461724389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 msgr2=0x55e476f81100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f81100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.437+0000 7f8977e00640 1 -- 172.21.15.120:0/2461724389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e476bf7210 con 0x55e476bbe4d0 2024-05-14T09:37:17.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.438+0000 7f8977e00640 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f88580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8964005ab0 tx=0x7f8964009640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c661371b176bccd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:17.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.438+0000 7f8969c00640 1 -- 172.21.15.120:0/2461724389 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964035030 con 0x55e476bbe4d0 2024-05-14T09:37:17.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.438+0000 7f8969c00640 1 -- 172.21.15.120:0/2461724389 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8964040070 con 0x55e476bbe4d0 2024-05-14T09:37:17.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.438+0000 7f8969c00640 1 -- 172.21.15.120:0/2461724389 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964031760 con 0x55e476bbe4d0 2024-05-14T09:37:17.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.439+0000 7f8975600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89600b28d0 0x7f89600b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.439+0000 7f8975600640 1 -- 172.21.15.120:0/3538351576 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f896c0e28f0 con 0x7f897810a250 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.439+0000 7f897d600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89600b28d0 0x7f89600b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.439+0000 7f89865bf740 1 -- 172.21.15.120:0/2461724389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 msgr2=0x55e476f88580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.439+0000 7f89865bf740 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f88580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8964005ab0 tx=0x7f8964009640 comp rx=0 tx=0).stop 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f89865bf740 1 -- 172.21.15.120:0/2461724389 shutdown_connections 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f89865bf740 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f88580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f89865bf740 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f81680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f89865bf740 1 --2- 172.21.15.120:0/2461724389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f81100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f89865bf740 1 -- 172.21.15.120:0/2461724389 >> 172.21.15.120:0/2461724389 conn(0x55e476bd3300 msgr2=0x55e476f7ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f897d600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89600b28d0 0x7f89600b4de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55e476f822d0 tx=0x7f8970009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f89865bf740 1 -- 172.21.15.120:0/2461724389 shutdown_connections 2024-05-14T09:37:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.440+0000 7f89865bf740 1 -- 172.21.15.120:0/2461724389 wait complete. 2024-05-14T09:37:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.441+0000 7f89865bf740 1 -- start start 2024-05-14T09:37:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.441+0000 7f89865bf740 1 Processor -- start 2024-05-14T09:37:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.442+0000 7f89865bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f8ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.442+0000 7f89865bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f8b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.442+0000 7f89865bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f92010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.442+0000 7f89865bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e476f88f70 con 0x55e476bdf1b0 2024-05-14T09:37:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.442+0000 7f89865bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e476e9e660 con 0x55e476bbe4d0 2024-05-14T09:37:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.442+0000 7f89865bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e476f890f0 con 0x55e476bb62f0 2024-05-14T09:37:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.442+0000 7f89865bf740 10 client.0 _ll_register_callbacks cb 0x55e476e68400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.443+0000 7f897cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f8ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.443+0000 7f897cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f8ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:42148/0 (socket says 172.21.15.120:42148) 2024-05-14T09:37:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.443+0000 7f897cc00640 1 -- 172.21.15.120:0/178874706 learned_addr learned my addr 172.21.15.120:0/178874706 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.443+0000 7f8977e00640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f8b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.443+0000 7f897d600640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f92010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.444+0000 7f897cc00640 1 -- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 msgr2=0x55e476f8b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.444+0000 7f897cc00640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f8b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.444+0000 7f897cc00640 1 -- 172.21.15.120:0/178874706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 msgr2=0x55e476f92010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.444+0000 7f897cc00640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f92010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.444+0000 7f897cc00640 1 -- 172.21.15.120:0/178874706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e476cc3620 con 0x55e476bb62f0 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.444+0000 7f8977e00640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f8b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.444+0000 7f897d600640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f92010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.445+0000 7f897cc00640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f8ab70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f896c0a9810 tx=0x7f896c0a99d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d49d103f54ba9b6f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.445+0000 7f895e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:37:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.446+0000 7f895e000640 1 -- 172.21.15.120:0/178874706 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c0b22b0 con 0x55e476bb62f0 2024-05-14T09:37:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.446+0000 7f895e000640 1 -- 172.21.15.120:0/178874706 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f896c0a8d70 con 0x55e476bb62f0 2024-05-14T09:37:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.446+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8964040070 con 0x55e476bb62f0 2024-05-14T09:37:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.447+0000 7f895e000640 1 -- 172.21.15.120:0/178874706 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f896c0a9620 con 0x55e476bb62f0 2024-05-14T09:37:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.447+0000 7f89865bf740 10 client.26689 fetch_fsmap learned FSMap version 65 2024-05-14T09:37:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.447+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55e476f94fb0 con 0x55e476bb62f0 2024-05-14T09:37:17.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.447+0000 7f895e000640 1 -- 172.21.15.120:0/178874706 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8964040070 con 0x55e476bb62f0 2024-05-14T09:37:17.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.448+0000 7f895e000640 1 -- 172.21.15.120:0/178874706 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) ==== 8366+0+0 (secure 0 0 0) 0x7f896c0a87e0 con 0x55e476bb62f0 2024-05-14T09:37:17.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.448+0000 7f89865bf740 10 client.26689 fetch_fsmap finished waiting for FSMap version 65 2024-05-14T09:37:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.448+0000 7f89865bf740 10 client.26689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.448+0000 7f89865bf740 20 client.26689 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.448+0000 7f89865bf740 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e476b9dd80 0x55e476f986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.448+0000 7f89865bf740 4 client.26689 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:37:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.448+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e476ef3160 con 0x55e476b9dd80 2024-05-14T09:37:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.450+0000 7f8977e00640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e476b9dd80 0x55e476f986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.451+0000 7f8977e00640 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e476b9dd80 0x55e476f986a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a4865abc4f5db56 server_cookie=1a2ed336079e0c1e in_seq=0 out_seq=0 2024-05-14T09:37:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.451+0000 7f895e000640 10 client.26689 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.453+0000 7f895e000640 1 -- 172.21.15.120:0/178874706 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e476ef3160 con 0x55e476b9dd80 2024-05-14T09:37:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.453+0000 7f895e000640 10 client.26689 handle_command_reply: tid=0 2024-05-14T09:37:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.453+0000 7f89865bf740 1 client.26689 shutdown 2024-05-14T09:37:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 msgr2=0x55e476f8ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f8ab70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f896c0a9810 tx=0x7f896c0a99d0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 shutdown_connections 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e476b9dd80 0x55e476f986a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bdf1b0 0x55e476f92010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bbe4d0 0x55e476f8b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 --2- 172.21.15.120:0/178874706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f8ab70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f895e000640 0 client.26689 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.454+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 >> 172.21.15.120:0/178874706 conn(0x55e476bd3300 msgr2=0x55e476f7f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.455+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 shutdown_connections 2024-05-14T09:37:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.455+0000 7f89865bf740 1 -- 172.21.15.120:0/178874706 wait complete. 2024-05-14T09:37:17.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.455+0000 7f89865bf740 20 client.26689 trim_cache size 0 max 16384 2024-05-14T09:37:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.489+0000 7f89865bf740 1 Processor -- start 2024-05-14T09:37:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.490+0000 7f89865bf740 1 -- start start 2024-05-14T09:37:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.490+0000 7f89865bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.490+0000 7f89865bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bbe4d0 0x55e476f8ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.490+0000 7f89865bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bdf1b0 0x55e476f91fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f89865bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f89781bb920 con 0x55e476bbe4d0 2024-05-14T09:37:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f89865bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89781bd490 con 0x55e476bdf1b0 2024-05-14T09:37:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f89865bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89781bbff0 con 0x55e476bb62f0 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f8977e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bbe4d0 0x55e476f8ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f8977e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bbe4d0 0x55e476f8ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47320/0 (socket says 172.21.15.120:47320) 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f8977e00640 1 -- 172.21.15.120:0/2799499673 learned_addr learned my addr 172.21.15.120:0/2799499673 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f897cc00640 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.491+0000 7f897d600640 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bdf1b0 0x55e476f91fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.492+0000 7f8977e00640 1 -- 172.21.15.120:0/2799499673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 msgr2=0x55e476f856d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.492+0000 7f8977e00640 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f856d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.492+0000 7f8977e00640 1 -- 172.21.15.120:0/2799499673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bdf1b0 msgr2=0x55e476f91fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.492+0000 7f8977e00640 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bdf1b0 0x55e476f91fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.492+0000 7f8977e00640 1 -- 172.21.15.120:0/2799499673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e476f78280 con 0x55e476bbe4d0 2024-05-14T09:37:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.492+0000 7f8977e00640 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bbe4d0 0x55e476f8ae50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8964005ab0 tx=0x7f8964005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07f233713c81521 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.493+0000 7f8969200640 1 -- 172.21.15.120:0/2799499673 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964059070 con 0x55e476bbe4d0 2024-05-14T09:37:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.493+0000 7f8969200640 1 -- 172.21.15.120:0/2799499673 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8964040040 con 0x55e476bbe4d0 2024-05-14T09:37:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.493+0000 7f8969200640 1 -- 172.21.15.120:0/2799499673 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964035040 con 0x55e476bbe4d0 2024-05-14T09:37:17.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.494+0000 7f89865bf740 1 -- 172.21.15.120:0/2799499673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bbe4d0 msgr2=0x55e476f8ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.494+0000 7f89865bf740 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bbe4d0 0x55e476f8ae50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8964005ab0 tx=0x7f8964005fd0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.495+0000 7f89865bf740 1 -- 172.21.15.120:0/2799499673 shutdown_connections 2024-05-14T09:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.495+0000 7f89865bf740 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bdf1b0 0x55e476f91fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.495+0000 7f89865bf740 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476bbe4d0 0x55e476f8ae50 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.495+0000 7f89865bf740 1 --2- 172.21.15.120:0/2799499673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bb62f0 0x55e476f856d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.495+0000 7f89865bf740 1 -- 172.21.15.120:0/2799499673 >> 172.21.15.120:0/2799499673 conn(0x55e476bd3300 msgr2=0x55e476f8a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.495+0000 7f89865bf740 1 -- 172.21.15.120:0/2799499673 shutdown_connections 2024-05-14T09:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.495+0000 7f89865bf740 1 -- 172.21.15.120:0/2799499673 wait complete. 2024-05-14T09:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.497+0000 7f89865bf740 1 -- start start 2024-05-14T09:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.498+0000 7f89865bf740 1 Processor -- start 2024-05-14T09:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.499+0000 7f89865bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bb62f0 0x55e476f8fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.499+0000 7f89865bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bdf1b0 0x55e476f90230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.499+0000 7f89865bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476b731c0 0x55e476f91160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.499+0000 7f89865bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f89781bcdc0 con 0x55e476b731c0 2024-05-14T09:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.499+0000 7f89865bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89781bc6f0 con 0x55e476bb62f0 2024-05-14T09:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.499+0000 7f89865bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89781b9920 con 0x55e476bdf1b0 2024-05-14T09:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.500+0000 7f89865bf740 10 client.0 _ll_register_callbacks cb 0x7f896c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.500+0000 7f8977e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bdf1b0 0x55e476f90230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.500+0000 7f897d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476b731c0 0x55e476f91160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.500+0000 7f897cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bb62f0 0x55e476f8fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.501+0000 7f8977e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bdf1b0 0x55e476f90230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:42170/0 (socket says 172.21.15.120:42170) 2024-05-14T09:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.501+0000 7f8977e00640 1 -- 172.21.15.120:0/3983467545 learned_addr learned my addr 172.21.15.120:0/3983467545 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.502+0000 7f8977e00640 1 -- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bb62f0 msgr2=0x55e476f8fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.502+0000 7f8977e00640 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bb62f0 0x55e476f8fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.502+0000 7f8977e00640 1 -- 172.21.15.120:0/3983467545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476b731c0 msgr2=0x55e476f91160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.502+0000 7f8977e00640 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476b731c0 0x55e476f91160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.502+0000 7f8977e00640 1 -- 172.21.15.120:0/3983467545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e476f91720 con 0x55e476bdf1b0 2024-05-14T09:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.502+0000 7f897cc00640 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bb62f0 0x55e476f8fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.502+0000 7f897d600640 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476b731c0 0x55e476f91160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.503+0000 7f8977e00640 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bdf1b0 0x55e476f90230 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f896402aa10 tx=0x7f89640044e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155b076e411e0900 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.503+0000 7f895e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:37:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.505+0000 7f895e000640 1 -- 172.21.15.120:0/3983467545 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964035070 con 0x55e476bdf1b0 2024-05-14T09:37:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.505+0000 7f895e000640 1 -- 172.21.15.120:0/3983467545 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8964031780 con 0x55e476bdf1b0 2024-05-14T09:37:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.505+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8964040040 con 0x55e476bdf1b0 2024-05-14T09:37:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.506+0000 7f895e000640 1 -- 172.21.15.120:0/3983467545 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f8964059040 con 0x55e476bdf1b0 2024-05-14T09:37:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.506+0000 7f89865bf740 10 client.26695 fetch_fsmap learned FSMap version 65 2024-05-14T09:37:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.506+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55e476f929b0 con 0x55e476bdf1b0 2024-05-14T09:37:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.506+0000 7f895e000640 1 -- 172.21.15.120:0/3983467545 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8964040040 con 0x55e476bdf1b0 2024-05-14T09:37:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.507+0000 7f895e000640 1 -- 172.21.15.120:0/3983467545 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) ==== 8366+0+0 (secure 0 0 0) 0x7f896405c070 con 0x55e476bdf1b0 2024-05-14T09:37:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.507+0000 7f89865bf740 10 client.26695 fetch_fsmap finished waiting for FSMap version 65 2024-05-14T09:37:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.507+0000 7f89865bf740 10 client.26695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.507+0000 7f89865bf740 20 client.26695 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.508+0000 7f89865bf740 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e477000bc0 0x55e477002fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.508+0000 7f89865bf740 4 client.26695 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:37:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.508+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e476f81a80 con 0x55e477000bc0 2024-05-14T09:37:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.508+0000 7f897cc00640 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e477000bc0 0x55e477002fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:17.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.510+0000 7f897cc00640 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e477000bc0 0x55e477002fe0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3077c7094dc1a7 server_cookie=38f645ed7cf97ce1 in_seq=0 out_seq=0 2024-05-14T09:37:17.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.510+0000 7f895e000640 10 client.26695 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:17.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.532+0000 7f895e000640 1 -- 172.21.15.120:0/3983467545 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e476f81a80 con 0x55e477000bc0 2024-05-14T09:37:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.532+0000 7f895e000640 10 client.26695 handle_command_reply: tid=0 2024-05-14T09:37:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.532+0000 7f89865bf740 1 client.26695 shutdown 2024-05-14T09:37:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.532+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bdf1b0 msgr2=0x55e476f90230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.532+0000 7f89865bf740 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bdf1b0 0x55e476f90230 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f896402aa10 tx=0x7f89640044e0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.532+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 shutdown_connections 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f89865bf740 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55e477000bc0 0x55e477002fe0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f89865bf740 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e476b731c0 0x55e476f91160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f89865bf740 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e476bdf1b0 0x55e476f90230 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f89865bf740 1 --2- 172.21.15.120:0/3983467545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e476bb62f0 0x55e476f8fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 >> 172.21.15.120:0/3983467545 conn(0x55e476bd3300 msgr2=0x55e476f7f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f895e000640 0 client.26695 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 shutdown_connections 2024-05-14T09:37:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.533+0000 7f89865bf740 1 -- 172.21.15.120:0/3983467545 wait complete. 2024-05-14T09:37:17.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.534+0000 7f89865bf740 20 client.26695 trim_cache size 0 max 16384 2024-05-14T09:37:17.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:37:17.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:37:17.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:37:17.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:37:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.536+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89600b28d0 msgr2=0x7f89600b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.536+0000 7f897f600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89600b28d0 0x7f89600b4de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55e476f822d0 tx=0x7f8970009500 comp rx=0 tx=0).stop 2024-05-14T09:37:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.536+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810a250 msgr2=0x7f89781a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.536+0000 7f897f600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810a250 0x7f89781a08d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f896c00e9f0 tx=0x7f896c00edf0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.537+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 shutdown_connections 2024-05-14T09:37:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.537+0000 7f897f600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f89600b28d0 0x7f89600b4de0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.537+0000 7f897f600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f897810bcc0 0x7f89781a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.537+0000 7f897f600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f897810b370 0x7f89781a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.537+0000 7f897f600640 1 --2- 172.21.15.120:0/3538351576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f897810a250 0x7f89781a08d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.537+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 >> 172.21.15.120:0/3538351576 conn(0x7f8978070a90 msgr2=0x7f897810f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.537+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 shutdown_connections 2024-05-14T09:37:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:17.538+0000 7f897f600640 1 -- 172.21.15.120:0/3538351576 wait complete. 2024-05-14T09:37:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:18 smithi120 ceph-mon[31085]: pgmap v968: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-05-14T09:37:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:18 smithi152 ceph-mon[34868]: pgmap v968: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-05-14T09:37:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:18 smithi175 ceph-mon[35353]: pgmap v968: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-05-14T09:37:19.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 585.0 s, 694.5 tps, lat 143.721 ms stddev 45.943 2024-05-14T09:37:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:20 smithi120 ceph-mon[31085]: pgmap v969: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 635 op/s 2024-05-14T09:37:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:20 smithi152 ceph-mon[34868]: pgmap v969: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 635 op/s 2024-05-14T09:37:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:20 smithi175 ceph-mon[35353]: pgmap v969: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 635 op/s 2024-05-14T09:37:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:22 smithi120 ceph-mon[31085]: pgmap v970: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 623 op/s 2024-05-14T09:37:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:22 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:37:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:22 smithi152 ceph-mon[34868]: pgmap v970: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 623 op/s 2024-05-14T09:37:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:22 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:37:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:22 smithi175 ceph-mon[35353]: pgmap v970: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 623 op/s 2024-05-14T09:37:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:22 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:37:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 590.0 s, 571.0 tps, lat 149.817 ms stddev 52.359 2024-05-14T09:37:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:24 smithi120 ceph-mon[31085]: pgmap v971: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 622 op/s 2024-05-14T09:37:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:24 smithi152 ceph-mon[34868]: pgmap v971: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 622 op/s 2024-05-14T09:37:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:24 smithi175 ceph-mon[35353]: pgmap v971: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 622 op/s 2024-05-14T09:37:26.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:26 smithi120 ceph-mon[31085]: pgmap v972: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 683 op/s 2024-05-14T09:37:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:26 smithi152 ceph-mon[34868]: pgmap v972: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 683 op/s 2024-05-14T09:37:26.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:26 smithi175 ceph-mon[35353]: pgmap v972: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 683 op/s 2024-05-14T09:37:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:28 smithi120 ceph-mon[31085]: pgmap v973: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 663 op/s 2024-05-14T09:37:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:28 smithi152 ceph-mon[34868]: pgmap v973: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 663 op/s 2024-05-14T09:37:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:28 smithi175 ceph-mon[35353]: pgmap v973: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 663 op/s 2024-05-14T09:37:29.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 595.0 s, 525.8 tps, lat 125.994 ms stddev 61.903 2024-05-14T09:37:30.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:30 smithi120 ceph-mon[31085]: pgmap v974: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 711 op/s 2024-05-14T09:37:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:30 smithi152 ceph-mon[34868]: pgmap v974: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 711 op/s 2024-05-14T09:37:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:30 smithi175 ceph-mon[35353]: pgmap v974: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 711 op/s 2024-05-14T09:37:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.917+0000 7ff6e3200640 1 -- 172.21.15.120:0/3544663945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc10a450 msgr2=0x7ff6dc10af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.917+0000 7ff6e3200640 1 --2- 172.21.15.120:0/3544663945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc10a450 0x7ff6dc10af50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009900 tx=0x7ff6cc02a400 comp rx=0 tx=0).stop 2024-05-14T09:37:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.919+0000 7ff6e3200640 1 -- 172.21.15.120:0/3544663945 shutdown_connections 2024-05-14T09:37:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.920+0000 7ff6e3200640 1 --2- 172.21.15.120:0/3544663945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc110190 0x7ff6dc1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.920+0000 7ff6e3200640 1 --2- 172.21.15.120:0/3544663945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10b490 0x7ff6dc10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.920+0000 7ff6e3200640 1 --2- 172.21.15.120:0/3544663945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc10a450 0x7ff6dc10af50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.920+0000 7ff6e3200640 1 -- 172.21.15.120:0/3544663945 >> 172.21.15.120:0/3544663945 conn(0x7ff6dc078f10 msgr2=0x7ff6dc07b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.920+0000 7ff6e3200640 1 -- 172.21.15.120:0/3544663945 shutdown_connections 2024-05-14T09:37:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.920+0000 7ff6e3200640 1 -- 172.21.15.120:0/3544663945 wait complete. 2024-05-14T09:37:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.922+0000 7ff6e3200640 1 Processor -- start 2024-05-14T09:37:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.922+0000 7ff6e3200640 1 -- start start 2024-05-14T09:37:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.923+0000 7ff6e3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10a450 0x7ff6dc1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.923+0000 7ff6e3200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10b490 0x7ff6dc1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.923+0000 7ff6e3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc110190 0x7ff6dc1a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.923+0000 7ff6e3200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc115ce0 con 0x7ff6dc10a450 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.923+0000 7ff6e3200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc115b60 con 0x7ff6dc10b490 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.923+0000 7ff6e3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc115e60 con 0x7ff6dc110190 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.923+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10a450 0x7ff6dc1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.924+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10a450 0x7ff6dc1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42156/0 (socket says 172.21.15.120:42156) 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.924+0000 7ff6dbe00640 1 -- 172.21.15.120:0/2603654813 learned_addr learned my addr 172.21.15.120:0/2603654813 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.924+0000 7ff6e1200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc110190 0x7ff6dc1a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.924+0000 7ff6db400640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10b490 0x7ff6dc1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.925+0000 7ff6e1200640 1 -- 172.21.15.120:0/2603654813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10b490 msgr2=0x7ff6dc1a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.925+0000 7ff6e1200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10b490 0x7ff6dc1a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.925+0000 7ff6e1200640 1 -- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10a450 msgr2=0x7ff6dc1a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.925+0000 7ff6e1200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10a450 0x7ff6dc1a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.925+0000 7ff6e1200640 1 -- 172.21.15.120:0/2603654813 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc1a8480 con 0x7ff6dc110190 2024-05-14T09:37:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.925+0000 7ff6dbe00640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10a450 0x7ff6dc1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.926+0000 7ff6e1200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc110190 0x7ff6dc1a7e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800e940 tx=0x7ff6c800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.926+0000 7ff6d8c00640 1 -- 172.21.15.120:0/2603654813 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800ccc0 con 0x7ff6dc110190 2024-05-14T09:37:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.927+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc1a8770 con 0x7ff6dc110190 2024-05-14T09:37:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.927+0000 7ff6d8c00640 1 -- 172.21.15.120:0/2603654813 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6c8005020 con 0x7ff6dc110190 2024-05-14T09:37:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.927+0000 7ff6d8c00640 1 -- 172.21.15.120:0/2603654813 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800ccc0 con 0x7ff6dc110190 2024-05-14T09:37:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.927+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc1a8c90 con 0x7ff6dc110190 2024-05-14T09:37:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.936+0000 7ff6ea24b740 1 Processor -- start 2024-05-14T09:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.936+0000 7ff6d8c00640 1 -- 172.21.15.120:0/2603654813 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff6c80047a0 con 0x7ff6dc110190 2024-05-14T09:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.937+0000 7ff6ea24b740 1 -- start start 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.938+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb8231b0 0x558fbbbc5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.938+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb7fa2f0 0x558fbbbc5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.938+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.938+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558fbbb29550 con 0x558fbb7fa2f0 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.938+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558fbbacebc0 con 0x558fbb8024d0 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.938+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558fbbb25510 con 0x558fbb8231b0 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.939+0000 7ff6db400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb8231b0 0x558fbbbc5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb8231b0 0x558fbbbc5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44522/0 (socket says 172.21.15.120:44522) 2024-05-14T09:37:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 -- 172.21.15.120:0/3197859865 learned_addr learned my addr 172.21.15.120:0/3197859865 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6d8c00640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff6c00b2aa0 0x7ff6c00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 -- 172.21.15.120:0/3197859865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 msgr2=0x558fbbbcc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 -- 172.21.15.120:0/3197859865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb7fa2f0 msgr2=0x558fbbbc5680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:37:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb7fa2f0 0x558fbbbc5680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.940+0000 7ff6db400640 1 -- 172.21.15.120:0/3197859865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fbb83b210 con 0x558fbb8231b0 2024-05-14T09:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.941+0000 7ff6d8c00640 1 -- 172.21.15.120:0/2603654813 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff6c80e21c0 con 0x7ff6dc110190 2024-05-14T09:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.941+0000 7ff6db400640 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb8231b0 0x558fbbbc5100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400bdb0 tx=0x7ff6d4009bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2b09a8d8626e07a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.941+0000 7ff6e1200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff6c00b2aa0 0x7ff6c00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.942+0000 7ff6d1600640 1 -- 172.21.15.120:0/3197859865 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4014040 con 0x558fbb8231b0 2024-05-14T09:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.942+0000 7ff6d1600640 1 -- 172.21.15.120:0/3197859865 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6d4008d50 con 0x558fbb8231b0 2024-05-14T09:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.942+0000 7ff6d1600640 1 -- 172.21.15.120:0/3197859865 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40195e0 con 0x558fbb8231b0 2024-05-14T09:37:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6ea24b740 1 -- 172.21.15.120:0/3197859865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb8231b0 msgr2=0x558fbbbc5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb8231b0 0x558fbbbc5100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400bdb0 tx=0x7ff6d4009bc0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6e1200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff6c00b2aa0 0x7ff6c00b4fb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff6c801a040 tx=0x7ff6c8011000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6ea24b740 1 -- 172.21.15.120:0/3197859865 shutdown_connections 2024-05-14T09:37:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb7fa2f0 0x558fbbbc5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/3197859865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb8231b0 0x558fbbbc5100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.945+0000 7ff6ea24b740 1 -- 172.21.15.120:0/3197859865 >> 172.21.15.120:0/3197859865 conn(0x558fbb817300 msgr2=0x558fbbbc0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.946+0000 7ff6ea24b740 1 -- 172.21.15.120:0/3197859865 shutdown_connections 2024-05-14T09:37:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.946+0000 7ff6ea24b740 1 -- 172.21.15.120:0/3197859865 wait complete. 2024-05-14T09:37:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.947+0000 7ff6ea24b740 1 -- start start 2024-05-14T09:37:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.947+0000 7ff6ea24b740 1 Processor -- start 2024-05-14T09:37:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.948+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbcec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.948+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.948+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8231b0 0x558fbbbd6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.948+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558fbbbccfd0 con 0x558fbb8231b0 2024-05-14T09:37:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.948+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558fbbae2660 con 0x558fbb8024d0 2024-05-14T09:37:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.948+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558fbbbcd150 con 0x558fbb7fa2f0 2024-05-14T09:37:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.948+0000 7ff6ea24b740 10 client.0 _ll_register_callbacks cb 0x558fbbaac400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.949+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.949+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40636/0 (socket says 172.21.15.120:40636) 2024-05-14T09:37:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.949+0000 7ff6dbe00640 1 -- 172.21.15.120:0/1203936455 learned_addr learned my addr 172.21.15.120:0/1203936455 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.949+0000 7ff6db400640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8231b0 0x558fbbbd6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.949+0000 7ff6db400640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbcec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.950+0000 7ff6dbe00640 1 -- 172.21.15.120:0/1203936455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 msgr2=0x558fbbbcec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.950+0000 7ff6dbe00640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbcec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.950+0000 7ff6dbe00640 1 -- 172.21.15.120:0/1203936455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8231b0 msgr2=0x558fbbbd6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.950+0000 7ff6dbe00640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8231b0 0x558fbbbd6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.950+0000 7ff6dbe00640 1 -- 172.21.15.120:0/1203936455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fbb907620 con 0x558fbb8024d0 2024-05-14T09:37:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.950+0000 7ff6db400640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8231b0 0x558fbbbd6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:37:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.950+0000 7ff6dbe00640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcf1d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009850 tx=0x7ff6cc003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0fff6830524fd34 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.951+0000 7ff6c6000640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:37:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.951+0000 7ff6c6000640 1 -- 172.21.15.120:0/1203936455 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc035030 con 0x558fbb8024d0 2024-05-14T09:37:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.951+0000 7ff6c6000640 1 -- 172.21.15.120:0/1203936455 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff6cc031500 con 0x558fbb8024d0 2024-05-14T09:37:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.951+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4008d50 con 0x558fbb8024d0 2024-05-14T09:37:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.952+0000 7ff6c6000640 1 -- 172.21.15.120:0/1203936455 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff6cc031700 con 0x558fbb8024d0 2024-05-14T09:37:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.952+0000 7ff6ea24b740 10 client.36638 fetch_fsmap learned FSMap version 66 2024-05-14T09:37:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.952+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558fbbbd9100 con 0x558fbb8024d0 2024-05-14T09:37:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6c6000640 1 -- 172.21.15.120:0/1203936455 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6d4008d50 con 0x558fbb8024d0 2024-05-14T09:37:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6c6000640 1 -- 172.21.15.120:0/1203936455 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7ff6cc045880 con 0x558fbb8024d0 2024-05-14T09:37:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6ea24b740 10 client.36638 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:37:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6ea24b740 10 client.36638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6ea24b740 20 client.36638 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb7e1d80 0x558fbbbdcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6ea24b740 4 client.36638 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:37:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.953+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fbbb37160 con 0x558fbb7e1d80 2024-05-14T09:37:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.955+0000 7ff6db400640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb7e1d80 0x558fbbbdcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.958+0000 7ff6db400640 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb7e1d80 0x558fbbbdcc80 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36037ebee6df1aea server_cookie=5845769e8fc8c675 in_seq=0 out_seq=0 2024-05-14T09:37:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.958+0000 7ff6c6000640 10 client.36638 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.959+0000 7ff6c6000640 1 -- 172.21.15.120:0/1203936455 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558fbbb37160 con 0x558fbb7e1d80 2024-05-14T09:37:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.959+0000 7ff6c6000640 10 client.36638 handle_command_reply: tid=0 2024-05-14T09:37:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.959+0000 7ff6ea24b740 1 client.36638 shutdown 2024-05-14T09:37:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.960+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 msgr2=0x558fbbbcf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.960+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcf1d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009850 tx=0x7ff6cc003890 comp rx=0 tx=0).stop 2024-05-14T09:37:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.960+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 shutdown_connections 2024-05-14T09:37:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.960+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb7e1d80 0x558fbbbdcc80 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.961+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8231b0 0x558fbbbd6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.961+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb8024d0 0x558fbbbcf1d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.961+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1203936455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbcec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.961+0000 7ff6c6000640 0 client.36638 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.961+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 >> 172.21.15.120:0/1203936455 conn(0x558fbb817300 msgr2=0x558fbbbc39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.963+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 shutdown_connections 2024-05-14T09:37:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.964+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1203936455 wait complete. 2024-05-14T09:37:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.964+0000 7ff6ea24b740 20 client.36638 trim_cache size 0 max 16384 2024-05-14T09:37:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.996+0000 7ff6ea24b740 1 Processor -- start 2024-05-14T09:37:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.997+0000 7ff6ea24b740 1 -- start start 2024-05-14T09:37:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.997+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7e1d80 0x558fbbbc0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.997+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbc0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.997+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbc90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.997+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc00fca0 con 0x558fbb8024d0 2024-05-14T09:37:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.997+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc0117e0 con 0x558fbb7e1d80 2024-05-14T09:37:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.997+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc010370 con 0x558fbb7fa2f0 2024-05-14T09:37:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.999+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbc0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:30.999+0000 7ff6db400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbc90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7e1d80 0x558fbbbc0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbc90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42184/0 (socket says 172.21.15.120:42184) 2024-05-14T09:37:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 -- 172.21.15.120:0/867898249 learned_addr learned my addr 172.21.15.120:0/867898249 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 -- 172.21.15.120:0/867898249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 msgr2=0x558fbbbc0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 --2- 172.21.15.120:0/867898249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbc0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 -- 172.21.15.120:0/867898249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7e1d80 msgr2=0x558fbbbc0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 --2- 172.21.15.120:0/867898249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7e1d80 0x558fbbbc0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.000+0000 7ff6db400640 1 -- 172.21.15.120:0/867898249 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fbbbc1020 con 0x558fbb8024d0 2024-05-14T09:37:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.001+0000 7ff6db400640 1 --2- 172.21.15.120:0/867898249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbc90c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400bd50 tx=0x7ff6d4004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8c217c89a819e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.002+0000 7ff6d0c00640 1 -- 172.21.15.120:0/867898249 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d401ad70 con 0x558fbb8024d0 2024-05-14T09:37:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.002+0000 7ff6d0c00640 1 -- 172.21.15.120:0/867898249 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6d4008bd0 con 0x558fbb8024d0 2024-05-14T09:37:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.002+0000 7ff6d0c00640 1 -- 172.21.15.120:0/867898249 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40283e0 con 0x558fbb8024d0 2024-05-14T09:37:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.003+0000 7ff6ea24b740 1 -- 172.21.15.120:0/867898249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 msgr2=0x558fbbbc90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.003+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/867898249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbc90c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400bd50 tx=0x7ff6d4004b50 comp rx=0 tx=0).stop 2024-05-14T09:37:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.004+0000 7ff6ea24b740 1 -- 172.21.15.120:0/867898249 shutdown_connections 2024-05-14T09:37:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.004+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/867898249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbc90c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.004+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/867898249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7fa2f0 0x558fbbbc0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.004+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/867898249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7e1d80 0x558fbbbc0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.004+0000 7ff6ea24b740 1 -- 172.21.15.120:0/867898249 >> 172.21.15.120:0/867898249 conn(0x558fbb817300 msgr2=0x558fbbbc50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.004+0000 7ff6ea24b740 1 -- 172.21.15.120:0/867898249 shutdown_connections 2024-05-14T09:37:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.005+0000 7ff6ea24b740 1 -- 172.21.15.120:0/867898249 wait complete. 2024-05-14T09:37:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.005+0000 7ff6ea24b740 1 -- start start 2024-05-14T09:37:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 1 Processor -- start 2024-05-14T09:37:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7e1d80 0x558fbbbd63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7fa2f0 0x558fbbbd2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbd3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc011110 con 0x558fbb8024d0 2024-05-14T09:37:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc010a40 con 0x558fbb7fa2f0 2024-05-14T09:37:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc00dca0 con 0x558fbb7e1d80 2024-05-14T09:37:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.006+0000 7ff6ea24b740 10 client.0 _ll_register_callbacks cb 0x7ff6cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.007+0000 7ff6db400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7e1d80 0x558fbbbd63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7e1d80 0x558fbbbd63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:44564/0 (socket says 172.21.15.120:44564) 2024-05-14T09:37:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 -- 172.21.15.120:0/1099719834 learned_addr learned my addr 172.21.15.120:0/1099719834 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbd3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6dbe00640 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7fa2f0 0x558fbbbd2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 -- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7fa2f0 msgr2=0x558fbbbd2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7fa2f0 0x558fbbbd2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 -- 172.21.15.120:0/1099719834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 msgr2=0x558fbbbd3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbd3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.008+0000 7ff6db400640 1 -- 172.21.15.120:0/1099719834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fbbbd6a70 con 0x558fbb7e1d80 2024-05-14T09:37:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.009+0000 7ff6db400640 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7e1d80 0x558fbbbd63d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4004a80 tx=0x7ff6d4009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f9e03659f6ba693 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.009+0000 7ff6c6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:37:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.009+0000 7ff6c6000640 1 -- 172.21.15.120:0/1099719834 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4008e10 con 0x558fbb7e1d80 2024-05-14T09:37:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.009+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4008bd0 con 0x558fbb7e1d80 2024-05-14T09:37:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.009+0000 7ff6c6000640 1 -- 172.21.15.120:0/1099719834 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff6d4020040 con 0x558fbb7e1d80 2024-05-14T09:37:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.010+0000 7ff6c6000640 1 -- 172.21.15.120:0/1099719834 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff6d403f050 con 0x558fbb7e1d80 2024-05-14T09:37:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.010+0000 7ff6ea24b740 10 client.26713 fetch_fsmap learned FSMap version 66 2024-05-14T09:37:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.010+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558fbbc43e30 con 0x558fbb7e1d80 2024-05-14T09:37:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.010+0000 7ff6c6000640 1 -- 172.21.15.120:0/1099719834 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6d4008bd0 con 0x558fbb7e1d80 2024-05-14T09:37:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.011+0000 7ff6c6000640 1 -- 172.21.15.120:0/1099719834 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7ff6d4028730 con 0x558fbb7e1d80 2024-05-14T09:37:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.011+0000 7ff6ea24b740 10 client.26713 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:37:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.012+0000 7ff6ea24b740 10 client.26713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.012+0000 7ff6ea24b740 20 client.26713 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.012+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb8231b0 0x558fbbc466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.012+0000 7ff6ea24b740 4 client.26713 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:37:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.012+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558fbbb30fd0 con 0x558fbb8231b0 2024-05-14T09:37:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.012+0000 7ff6dbe00640 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb8231b0 0x558fbbc466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.014+0000 7ff6dbe00640 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb8231b0 0x558fbbc466c0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6c2acaa12a44382 server_cookie=7e03a7844bc9034e in_seq=0 out_seq=0 2024-05-14T09:37:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.014+0000 7ff6c6000640 10 client.26713 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.056+0000 7ff6c6000640 1 -- 172.21.15.120:0/1099719834 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558fbbb30fd0 con 0x558fbb8231b0 2024-05-14T09:37:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.056+0000 7ff6c6000640 10 client.26713 handle_command_reply: tid=0 2024-05-14T09:37:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.056+0000 7ff6ea24b740 1 client.26713 shutdown 2024-05-14T09:37:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.057+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7e1d80 msgr2=0x558fbbbd63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.057+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7e1d80 0x558fbbbd63d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4004a80 tx=0x7ff6d4009fd0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 shutdown_connections 2024-05-14T09:37:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x558fbb8231b0 0x558fbbc466c0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558fbb8024d0 0x558fbbbd3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fbb7fa2f0 0x558fbbbd2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 --2- 172.21.15.120:0/1099719834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fbb7e1d80 0x558fbbbd63d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 >> 172.21.15.120:0/1099719834 conn(0x558fbb817300 msgr2=0x558fbbbc90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6c6000640 0 client.26713 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 shutdown_connections 2024-05-14T09:37:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.058+0000 7ff6ea24b740 1 -- 172.21.15.120:0/1099719834 wait complete. 2024-05-14T09:37:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.059+0000 7ff6ea24b740 20 client.26713 trim_cache size 0 max 16384 2024-05-14T09:37:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:37:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:37:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:37:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.060+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff6c00b2aa0 msgr2=0x7ff6c00b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.060+0000 7ff6e3200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff6c00b2aa0 0x7ff6c00b4fb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff6c801a040 tx=0x7ff6c8011000 comp rx=0 tx=0).stop 2024-05-14T09:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.060+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc110190 msgr2=0x7ff6dc1a7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.060+0000 7ff6e3200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc110190 0x7ff6dc1a7e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800e940 tx=0x7ff6c800ee00 comp rx=0 tx=0).stop 2024-05-14T09:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 shutdown_connections 2024-05-14T09:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff6c00b2aa0 0x7ff6c00b4fb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6dc110190 0x7ff6dc1a7e10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc10b490 0x7ff6dc1a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 --2- 172.21.15.120:0/2603654813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc10a450 0x7ff6dc1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 >> 172.21.15.120:0/2603654813 conn(0x7ff6dc078f10 msgr2=0x7ff6dc10c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 shutdown_connections 2024-05-14T09:37:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:31.061+0000 7ff6e3200640 1 -- 172.21.15.120:0/2603654813 wait complete. 2024-05-14T09:37:32.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:32 smithi120 ceph-mon[31085]: pgmap v975: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 673 op/s 2024-05-14T09:37:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:32 smithi152 ceph-mon[34868]: pgmap v975: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 673 op/s 2024-05-14T09:37:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:32 smithi175 ceph-mon[35353]: pgmap v975: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 673 op/s 2024-05-14T09:37:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 600.0 s, 531.0 tps, lat 124.356 ms stddev 50.796 2024-05-14T09:37:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:34 smithi120 ceph-mon[31085]: pgmap v976: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 649 op/s 2024-05-14T09:37:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:34 smithi152 ceph-mon[34868]: pgmap v976: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 649 op/s 2024-05-14T09:37:34.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:34 smithi175 ceph-mon[35353]: pgmap v976: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 649 op/s 2024-05-14T09:37:36.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:36 smithi120 ceph-mon[31085]: pgmap v977: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-05-14T09:37:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:36 smithi152 ceph-mon[34868]: pgmap v977: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-05-14T09:37:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:36 smithi175 ceph-mon[35353]: pgmap v977: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-05-14T09:37:38.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:38 smithi120 ceph-mon[31085]: pgmap v978: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.9 MiB/s wr, 647 op/s 2024-05-14T09:37:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:38 smithi152 ceph-mon[34868]: pgmap v978: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.9 MiB/s wr, 647 op/s 2024-05-14T09:37:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:38 smithi175 ceph-mon[35353]: pgmap v978: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.9 MiB/s wr, 647 op/s 2024-05-14T09:37:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 605.0 s, 610.0 tps, lat 107.908 ms stddev 39.176 2024-05-14T09:37:40.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:40 smithi152 ceph-mon[34868]: pgmap v979: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 692 op/s 2024-05-14T09:37:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:40 smithi175 ceph-mon[35353]: pgmap v979: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 692 op/s 2024-05-14T09:37:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:40 smithi120 ceph-mon[31085]: pgmap v979: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 692 op/s 2024-05-14T09:37:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:42 smithi152 ceph-mon[34868]: pgmap v980: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.9 MiB/s wr, 647 op/s 2024-05-14T09:37:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:42 smithi175 ceph-mon[35353]: pgmap v980: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.9 MiB/s wr, 647 op/s 2024-05-14T09:37:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:42 smithi120 ceph-mon[31085]: pgmap v980: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.9 MiB/s wr, 647 op/s 2024-05-14T09:37:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 610.0 s, 473.2 tps, lat 455.758 ms stddev 2157.964 2024-05-14T09:37:44.437 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:44 smithi120 ceph-mon[31085]: pgmap v981: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 649 op/s 2024-05-14T09:37:44.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.438+0000 7f18ab000640 1 -- 172.21.15.120:0/1884724511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 msgr2=0x7f18a410ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.438+0000 7f18ab000640 1 --2- 172.21.15.120:0/1884724511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 0x7f18a410ad80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1898009900 tx=0x7f189802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.439+0000 7f18ab000640 1 -- 172.21.15.120:0/1884724511 shutdown_connections 2024-05-14T09:37:44.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.439+0000 7f18ab000640 1 --2- 172.21.15.120:0/1884724511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410bfc0 0x7f18a410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.439+0000 7f18ab000640 1 --2- 172.21.15.120:0/1884724511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18a410b2c0 0x7f18a410b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.439+0000 7f18ab000640 1 --2- 172.21.15.120:0/1884724511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 0x7f18a410ad80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.439+0000 7f18ab000640 1 -- 172.21.15.120:0/1884724511 >> 172.21.15.120:0/1884724511 conn(0x7f18a4070460 msgr2=0x7f18a4072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:44.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.440+0000 7f18ab000640 1 -- 172.21.15.120:0/1884724511 shutdown_connections 2024-05-14T09:37:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.440+0000 7f18ab000640 1 -- 172.21.15.120:0/1884724511 wait complete. 2024-05-14T09:37:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.442+0000 7f18ab000640 1 Processor -- start 2024-05-14T09:37:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.442+0000 7f18ab000640 1 -- start start 2024-05-14T09:37:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.442+0000 7f18ab000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 0x7f18a41110b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18ab000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410b2c0 0x7f18a41115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18ab000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18a410bfc0 0x7f18a410dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18ab000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4119de0 con 0x7f18a410a470 2024-05-14T09:37:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18ab000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4119c60 con 0x7f18a410bfc0 2024-05-14T09:37:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18ab000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4119f60 con 0x7f18a410b2c0 2024-05-14T09:37:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18a9c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 0x7f18a41110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18a9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410b2c0 0x7f18a41115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18a9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410b2c0 0x7f18a41115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54374/0 (socket says 172.21.15.120:54374) 2024-05-14T09:37:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.443+0000 7f18a9200640 1 -- 172.21.15.120:0/2252606438 learned_addr learned my addr 172.21.15.120:0/2252606438 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.444+0000 7f18aa600640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18a410bfc0 0x7f18a410dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.444+0000 7f18a9200640 1 -- 172.21.15.120:0/2252606438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18a410bfc0 msgr2=0x7f18a410dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.444+0000 7f18a9200640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18a410bfc0 0x7f18a410dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.444+0000 7f18a9200640 1 -- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 msgr2=0x7f18a41110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.444+0000 7f18a9200640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 0x7f18a41110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.444+0000 7f18a9200640 1 -- 172.21.15.120:0/2252606438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a410e420 con 0x7f18a410b2c0 2024-05-14T09:37:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.445+0000 7f18a9200640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410b2c0 0x7f18a41115f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f189000e9f0 tx=0x7f189000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.445+0000 7f18a2000640 1 -- 172.21.15.120:0/2252606438 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189000cd80 con 0x7f18a410b2c0 2024-05-14T09:37:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.445+0000 7f18a2000640 1 -- 172.21.15.120:0/2252606438 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18900108c0 con 0x7f18a410b2c0 2024-05-14T09:37:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.445+0000 7f18a2000640 1 -- 172.21.15.120:0/2252606438 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900187c0 con 0x7f18a410b2c0 2024-05-14T09:37:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.446+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a410e710 con 0x7f18a410b2c0 2024-05-14T09:37:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.446+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a41b0fb0 con 0x7f18a410b2c0 2024-05-14T09:37:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.454+0000 7f18a2000640 1 -- 172.21.15.120:0/2252606438 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1890010430 con 0x7f18a410b2c0 2024-05-14T09:37:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.456+0000 7f18b35fb740 1 Processor -- start 2024-05-14T09:37:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.457+0000 7f18b35fb740 1 -- start start 2024-05-14T09:37:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.457+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175afa11b0 0x56175b3432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.457+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b343870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.457+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b34a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.457+0000 7f18b35fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56175b2a7550 con 0x56175afa11b0 2024-05-14T09:37:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.457+0000 7f18b35fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56175b24cbc0 con 0x56175af782f0 2024-05-14T09:37:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.458+0000 7f18b35fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56175b2a3510 con 0x56175af804d0 2024-05-14T09:37:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:44 smithi152 ceph-mon[34868]: pgmap v981: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 649 op/s 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.458+0000 7f18a9c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b343870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.458+0000 7f18a9c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b343870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39614/0 (socket says 172.21.15.120:39614) 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.458+0000 7f18a9c00640 1 -- 172.21.15.120:0/717894704 learned_addr learned my addr 172.21.15.120:0/717894704 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.458+0000 7f18a9200640 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b34a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.458+0000 7f18aa600640 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175afa11b0 0x56175b3432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.459+0000 7f18a9200640 1 -- 172.21.15.120:0/717894704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 msgr2=0x56175b343870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.459+0000 7f18a9200640 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b343870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.459+0000 7f18a2000640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f188c0b2930 0x7f188c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.459+0000 7f18a9200640 1 -- 172.21.15.120:0/717894704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175afa11b0 msgr2=0x56175b3432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.459+0000 7f18a9200640 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175afa11b0 0x56175b3432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.459+0000 7f18a9200640 1 -- 172.21.15.120:0/717894704 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175afb9210 con 0x56175af804d0 2024-05-14T09:37:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.459+0000 7f18a9200640 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b34a770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f18900e0060 tx=0x7f18900e8f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3040f33531cfb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.460+0000 7f18a2000640 1 -- 172.21.15.120:0/2252606438 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f18900e29c0 con 0x7f18a410b2c0 2024-05-14T09:37:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.461+0000 7f1896a00640 1 -- 172.21.15.120:0/717894704 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900a99b0 con 0x56175af804d0 2024-05-14T09:37:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.461+0000 7f1896a00640 1 -- 172.21.15.120:0/717894704 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18900a96f0 con 0x56175af804d0 2024-05-14T09:37:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.461+0000 7f1896a00640 1 -- 172.21.15.120:0/717894704 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890010720 con 0x56175af804d0 2024-05-14T09:37:44.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.461+0000 7f18aa600640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f188c0b2930 0x7f188c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.463+0000 7f18b35fb740 1 -- 172.21.15.120:0/717894704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 msgr2=0x56175b34a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.463+0000 7f18b35fb740 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b34a770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f18900e0060 tx=0x7f18900e8f40 comp rx=0 tx=0).stop 2024-05-14T09:37:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.463+0000 7f18b35fb740 1 -- 172.21.15.120:0/717894704 shutdown_connections 2024-05-14T09:37:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.463+0000 7f18b35fb740 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b34a770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.463+0000 7f18b35fb740 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b343870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.463+0000 7f18b35fb740 1 --2- 172.21.15.120:0/717894704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175afa11b0 0x56175b3432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.463+0000 7f18b35fb740 1 -- 172.21.15.120:0/717894704 >> 172.21.15.120:0/717894704 conn(0x56175af95300 msgr2=0x56175b33ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.464+0000 7f18aa600640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f188c0b2930 0x7f188c0b4e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x56175b3444c0 tx=0x7f189c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.464+0000 7f18b35fb740 1 -- 172.21.15.120:0/717894704 shutdown_connections 2024-05-14T09:37:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.464+0000 7f18b35fb740 1 -- 172.21.15.120:0/717894704 wait complete. 2024-05-14T09:37:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.465+0000 7f18b35fb740 1 -- start start 2024-05-14T09:37:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.465+0000 7f18b35fb740 1 Processor -- start 2024-05-14T09:37:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.466+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b35de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.466+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af804d0 0x56175b35e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.466+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b3652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.466+0000 7f18b35fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56175b35c1d0 con 0x56175af804d0 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.466+0000 7f18b35fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56175b260660 con 0x56175af782f0 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.466+0000 7f18b35fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56175b35c350 con 0x56175afa11b0 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.466+0000 7f18b35fb740 10 client.0 _ll_register_callbacks cb 0x56175b22a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b35de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af804d0 0x56175b35e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b35de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:39618/0 (socket says 172.21.15.120:39618) 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 -- 172.21.15.120:0/778296802 learned_addr learned my addr 172.21.15.120:0/778296802 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af804d0 0x56175b35e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54252/0 (socket says 172.21.15.120:54252) 2024-05-14T09:37:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18aa600640 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b3652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 -- 172.21.15.120:0/778296802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 msgr2=0x56175b3652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b3652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 -- 172.21.15.120:0/778296802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af804d0 msgr2=0x56175b35e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af804d0 0x56175b35e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.467+0000 7f18a9c00640 1 -- 172.21.15.120:0/778296802 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175b085620 con 0x56175af782f0 2024-05-14T09:37:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.468+0000 7f188b400640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:37:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.468+0000 7f18a9c00640 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b35de50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1898009230 tx=0x7f1898031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64675a3a690d71ff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.469+0000 7f188b400640 1 -- 172.21.15.120:0/778296802 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898035040 con 0x56175af782f0 2024-05-14T09:37:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.469+0000 7f188b400640 1 -- 172.21.15.120:0/778296802 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1898004240 con 0x56175af782f0 2024-05-14T09:37:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.470+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18900a96f0 con 0x56175af782f0 2024-05-14T09:37:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.471+0000 7f188b400640 1 -- 172.21.15.120:0/778296802 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f1898004440 con 0x56175af782f0 2024-05-14T09:37:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.472+0000 7f18b35fb740 10 client.36656 fetch_fsmap learned FSMap version 66 2024-05-14T09:37:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.472+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56175b368290 con 0x56175af782f0 2024-05-14T09:37:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.472+0000 7f188b400640 1 -- 172.21.15.120:0/778296802 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18900a96f0 con 0x56175af782f0 2024-05-14T09:37:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.474+0000 7f188b400640 1 -- 172.21.15.120:0/778296802 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f189804f610 con 0x56175af782f0 2024-05-14T09:37:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.474+0000 7f18b35fb740 10 client.36656 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:37:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.474+0000 7f18b35fb740 10 client.36656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.474+0000 7f18b35fb740 20 client.36656 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.474+0000 7f18b35fb740 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175af5fd80 0x56175b36b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.475+0000 7f18b35fb740 4 client.36656 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:37:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.475+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56175b2b5160 con 0x56175af5fd80 2024-05-14T09:37:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.475+0000 7f18a9200640 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175af5fd80 0x56175b36b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:44 smithi175 ceph-mon[35353]: pgmap v981: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 649 op/s 2024-05-14T09:37:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.478+0000 7f188b400640 10 client.36656 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.478+0000 7f18a9200640 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175af5fd80 0x56175b36b950 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e72d68730f96c982 server_cookie=66046789be45086 in_seq=0 out_seq=0 2024-05-14T09:37:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.480+0000 7f188b400640 1 -- 172.21.15.120:0/778296802 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56175b2b5160 con 0x56175af5fd80 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.480+0000 7f188b400640 10 client.36656 handle_command_reply: tid=0 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.480+0000 7f18b35fb740 1 client.36656 shutdown 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.480+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 msgr2=0x56175b35de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.480+0000 7f18b35fb740 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b35de50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1898009230 tx=0x7f1898031630 comp rx=0 tx=0).stop 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.481+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 shutdown_connections 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.481+0000 7f18b35fb740 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175af5fd80 0x56175b36b950 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.481+0000 7f18b35fb740 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b3652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.481+0000 7f18b35fb740 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af804d0 0x56175b35e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.481+0000 7f18b35fb740 1 --2- 172.21.15.120:0/778296802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af782f0 0x56175b35de50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.481+0000 7f188b400640 0 client.36656 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.481+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 >> 172.21.15.120:0/778296802 conn(0x56175af95300 msgr2=0x56175b33dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.482+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 shutdown_connections 2024-05-14T09:37:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.482+0000 7f18b35fb740 1 -- 172.21.15.120:0/778296802 wait complete. 2024-05-14T09:37:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.482+0000 7f18b35fb740 20 client.36656 trim_cache size 0 max 16384 2024-05-14T09:37:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.519+0000 7f18b35fb740 1 Processor -- start 2024-05-14T09:37:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.520+0000 7f18b35fb740 1 -- start start 2024-05-14T09:37:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.520+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af782f0 0x56175b33edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b365280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175afa11b0 0x56175b3657c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18b35fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41b2bf0 con 0x56175af782f0 2024-05-14T09:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18b35fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41b4730 con 0x56175afa11b0 2024-05-14T09:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18b35fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41b32c0 con 0x56175af804d0 2024-05-14T09:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18a9c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af782f0 0x56175b33edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18a9c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af782f0 0x56175b33edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54268/0 (socket says 172.21.15.120:54268) 2024-05-14T09:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.521+0000 7f18a9c00640 1 -- 172.21.15.120:0/2229358786 learned_addr learned my addr 172.21.15.120:0/2229358786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.522+0000 7f18a9c00640 1 -- 172.21.15.120:0/2229358786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 msgr2=0x56175b365280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.522+0000 7f18a9c00640 1 --2- 172.21.15.120:0/2229358786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b365280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.522+0000 7f18a9c00640 1 -- 172.21.15.120:0/2229358786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175afa11b0 msgr2=0x56175b3657c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:37:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.522+0000 7f18a9c00640 1 --2- 172.21.15.120:0/2229358786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175afa11b0 0x56175b3657c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.522+0000 7f18a9c00640 1 -- 172.21.15.120:0/2229358786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175b33a470 con 0x56175af782f0 2024-05-14T09:37:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.523+0000 7f18a9c00640 1 --2- 172.21.15.120:0/2229358786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af782f0 0x56175b33edc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f189803c440 tx=0x7f189802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546e0966369f8855 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.523+0000 7f1896000640 1 -- 172.21.15.120:0/2229358786 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898000e60 con 0x56175af782f0 2024-05-14T09:37:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.523+0000 7f1896000640 1 -- 172.21.15.120:0/2229358786 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f189804f670 con 0x56175af782f0 2024-05-14T09:37:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.523+0000 7f1896000640 1 -- 172.21.15.120:0/2229358786 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898035070 con 0x56175af782f0 2024-05-14T09:37:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.525+0000 7f18b35fb740 1 -- 172.21.15.120:0/2229358786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af782f0 msgr2=0x56175b33edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.525+0000 7f18b35fb740 1 --2- 172.21.15.120:0/2229358786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af782f0 0x56175b33edc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f189803c440 tx=0x7f189802a3f0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.525+0000 7f18b35fb740 1 -- 172.21.15.120:0/2229358786 shutdown_connections 2024-05-14T09:37:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.525+0000 7f18b35fb740 1 --2- 172.21.15.120:0/2229358786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175afa11b0 0x56175b3657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.525+0000 7f18b35fb740 1 --2- 172.21.15.120:0/2229358786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175af804d0 0x56175b365280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.525+0000 7f18b35fb740 1 --2- 172.21.15.120:0/2229358786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af782f0 0x56175b33edc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.525+0000 7f18b35fb740 1 -- 172.21.15.120:0/2229358786 >> 172.21.15.120:0/2229358786 conn(0x56175af95300 msgr2=0x56175b33e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.526+0000 7f18b35fb740 1 -- 172.21.15.120:0/2229358786 shutdown_connections 2024-05-14T09:37:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.526+0000 7f18b35fb740 1 -- 172.21.15.120:0/2229358786 wait complete. 2024-05-14T09:37:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.527+0000 7f18b35fb740 1 -- start start 2024-05-14T09:37:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.528+0000 7f18b35fb740 1 Processor -- start 2024-05-14T09:37:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.529+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af804d0 0x56175b360b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.529+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b361050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.529+0000 7f18b35fb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af351c0 0x56175b363f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.529+0000 7f18b35fb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41b4060 con 0x56175af351c0 2024-05-14T09:37:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.529+0000 7f18b35fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41b3990 con 0x56175af804d0 2024-05-14T09:37:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.529+0000 7f18b35fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41ac720 con 0x56175afa11b0 2024-05-14T09:37:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.530+0000 7f18b35fb740 10 client.0 _ll_register_callbacks cb 0x7f189c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.530+0000 7f18a9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b361050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.530+0000 7f18a9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b361050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54404/0 (socket says 172.21.15.120:54404) 2024-05-14T09:37:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.530+0000 7f18a9200640 1 -- 172.21.15.120:0/3257823254 learned_addr learned my addr 172.21.15.120:0/3257823254 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.530+0000 7f18a9c00640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af804d0 0x56175b360b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.530+0000 7f18aa600640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af351c0 0x56175b363f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.531+0000 7f18a9200640 1 -- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af804d0 msgr2=0x56175b360b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.531+0000 7f18a9200640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af804d0 0x56175b360b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.531+0000 7f18a9200640 1 -- 172.21.15.120:0/3257823254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af351c0 msgr2=0x56175b363f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.531+0000 7f18a9200640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af351c0 0x56175b363f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.531+0000 7f18a9200640 1 -- 172.21.15.120:0/3257823254 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175b364550 con 0x56175afa11b0 2024-05-14T09:37:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.531+0000 7f18aa600640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af351c0 0x56175b363f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:37:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.532+0000 7f18a9200640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b361050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f18900e8b40 tx=0x7f1890009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59e18b3f657521a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.532+0000 7f18a9c00640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af804d0 0x56175b360b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.533+0000 7f188b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:37:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.533+0000 7f188b400640 1 -- 172.21.15.120:0/3257823254 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900a9350 con 0x56175afa11b0 2024-05-14T09:37:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.533+0000 7f188b400640 1 -- 172.21.15.120:0/3257823254 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f18900e8750 con 0x56175afa11b0 2024-05-14T09:37:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.533+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f189804f670 con 0x56175afa11b0 2024-05-14T09:37:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.534+0000 7f188b400640 1 -- 172.21.15.120:0/3257823254 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f18900a9530 con 0x56175afa11b0 2024-05-14T09:37:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.534+0000 7f18b35fb740 10 client.26728 fetch_fsmap learned FSMap version 66 2024-05-14T09:37:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.534+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56175b3657e0 con 0x56175afa11b0 2024-05-14T09:37:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.534+0000 7f188b400640 1 -- 172.21.15.120:0/3257823254 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f189804f670 con 0x56175afa11b0 2024-05-14T09:37:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.534+0000 7f188b400640 1 -- 172.21.15.120:0/3257823254 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f18900a5550 con 0x56175afa11b0 2024-05-14T09:37:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.535+0000 7f18b35fb740 10 client.26728 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:37:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.535+0000 7f18b35fb740 10 client.26728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.535+0000 7f18b35fb740 20 client.26728 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.535+0000 7f18b35fb740 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175b3d3da0 0x56175b3d61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.536+0000 7f18b35fb740 4 client.26728 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:37:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.536+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56175b2aefd0 con 0x56175b3d3da0 2024-05-14T09:37:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.536+0000 7f18a9c00640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175b3d3da0 0x56175b3d61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.538+0000 7f188b400640 10 client.26728 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.538+0000 7f18a9c00640 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175b3d3da0 0x56175b3d61c0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22e9ee29cc7ebb9b server_cookie=1c4563abae10325f in_seq=0 out_seq=0 2024-05-14T09:37:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.566+0000 7f188b400640 1 -- 172.21.15.120:0/3257823254 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56175b2aefd0 con 0x56175b3d3da0 2024-05-14T09:37:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.566+0000 7f188b400640 10 client.26728 handle_command_reply: tid=0 2024-05-14T09:37:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.566+0000 7f18b35fb740 1 client.26728 shutdown 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.567+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 msgr2=0x56175b361050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.567+0000 7f18b35fb740 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b361050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f18900e8b40 tx=0x7f1890009310 comp rx=0 tx=0).stop 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.567+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 shutdown_connections 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.567+0000 7f18b35fb740 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56175b3d3da0 0x56175b3d61c0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.568+0000 7f18b35fb740 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56175af351c0 0x56175b363f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.568+0000 7f188b400640 0 client.26728 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.568+0000 7f18b35fb740 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56175afa11b0 0x56175b361050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.568+0000 7f18b35fb740 1 --2- 172.21.15.120:0/3257823254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56175af804d0 0x56175b360b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.568+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 >> 172.21.15.120:0/3257823254 conn(0x56175af95300 msgr2=0x56175b35d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.568+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 shutdown_connections 2024-05-14T09:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.568+0000 7f18b35fb740 1 -- 172.21.15.120:0/3257823254 wait complete. 2024-05-14T09:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.569+0000 7f18b35fb740 20 client.26728 trim_cache size 0 max 16384 2024-05-14T09:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:37:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:37:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f188c0b2930 msgr2=0x7f188c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f188c0b2930 0x7f188c0b4e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x56175b3444c0 tx=0x7f189c004a40 comp rx=0 tx=0).stop 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410b2c0 msgr2=0x7f18a41115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410b2c0 0x7f18a41115f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f189000e9f0 tx=0x7f189000eeb0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 shutdown_connections 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f188c0b2930 0x7f188c0b4e40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18a410bfc0 0x7f18a410dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a410b2c0 0x7f18a41115f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 --2- 172.21.15.120:0/2252606438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a410a470 0x7f18a41110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.570+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 >> 172.21.15.120:0/2252606438 conn(0x7f18a4070460 msgr2=0x7f18a4113ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.571+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 shutdown_connections 2024-05-14T09:37:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:44.571+0000 7f18ab000640 1 -- 172.21.15.120:0/2252606438 wait complete. 2024-05-14T09:37:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:46 smithi152 ceph-mon[34868]: pgmap v982: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.5 MiB/s wr, 698 op/s 2024-05-14T09:37:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:46 smithi175 ceph-mon[35353]: pgmap v982: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.5 MiB/s wr, 698 op/s 2024-05-14T09:37:46.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:46 smithi120 ceph-mon[31085]: pgmap v982: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.5 MiB/s wr, 698 op/s 2024-05-14T09:37:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:48 smithi152 ceph-mon[34868]: pgmap v983: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 664 op/s 2024-05-14T09:37:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:48 smithi175 ceph-mon[35353]: pgmap v983: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 664 op/s 2024-05-14T09:37:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:48 smithi120 ceph-mon[31085]: pgmap v983: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 664 op/s 2024-05-14T09:37:49.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 615.0 s, 565.1 tps, lat 175.162 ms stddev 73.107 2024-05-14T09:37:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:50 smithi152 ceph-mon[34868]: pgmap v984: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 705 op/s 2024-05-14T09:37:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:50 smithi175 ceph-mon[35353]: pgmap v984: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 705 op/s 2024-05-14T09:37:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:50 smithi120 ceph-mon[31085]: pgmap v984: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 705 op/s 2024-05-14T09:37:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:52 smithi152 ceph-mon[34868]: pgmap v985: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-05-14T09:37:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:52 smithi175 ceph-mon[35353]: pgmap v985: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-05-14T09:37:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:52 smithi120 ceph-mon[31085]: pgmap v985: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-05-14T09:37:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 620.0 s, 594.3 tps, lat 170.150 ms stddev 76.191 2024-05-14T09:37:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:54 smithi152 ceph-mon[34868]: pgmap v986: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.3 MiB/s wr, 664 op/s 2024-05-14T09:37:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:54 smithi175 ceph-mon[35353]: pgmap v986: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.3 MiB/s wr, 664 op/s 2024-05-14T09:37:54.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:54 smithi120 ceph-mon[31085]: pgmap v986: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.3 MiB/s wr, 664 op/s 2024-05-14T09:37:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:56 smithi175 ceph-mon[35353]: pgmap v987: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 680 op/s 2024-05-14T09:37:56.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:56 smithi120 ceph-mon[31085]: pgmap v987: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 680 op/s 2024-05-14T09:37:56.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:56 smithi152 ceph-mon[34868]: pgmap v987: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 680 op/s 2024-05-14T09:37:57.484 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:57 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:37:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:57 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:37:57.729 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:57 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:37:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.973+0000 7f0904a00640 1 -- 172.21.15.120:0/345419048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900109bc0 msgr2=0x7f090010bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.973+0000 7f08fca00640 1 -- 172.21.15.120:0/345419048 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8036070 con 0x7f0900109bc0 2024-05-14T09:37:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.973+0000 7f0904a00640 1 --2- 172.21.15.120:0/345419048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900109bc0 0x7f090010bfe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009be0 tx=0x7f08f802a6f0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.974+0000 7f0904a00640 1 -- 172.21.15.120:0/345419048 shutdown_connections 2024-05-14T09:37:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.974+0000 7f0904a00640 1 --2- 172.21.15.120:0/345419048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900109bc0 0x7f090010bfe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.974+0000 7f0904a00640 1 --2- 172.21.15.120:0/345419048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0900104ec0 0x7f09001052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.974+0000 7f0904a00640 1 --2- 172.21.15.120:0/345419048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900103c80 0x7f0900104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.974+0000 7f0904a00640 1 -- 172.21.15.120:0/345419048 >> 172.21.15.120:0/345419048 conn(0x7f09000fee70 msgr2=0x7f0900101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.976+0000 7f0904a00640 1 -- 172.21.15.120:0/345419048 shutdown_connections 2024-05-14T09:37:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.977+0000 7f0904a00640 1 -- 172.21.15.120:0/345419048 wait complete. 2024-05-14T09:37:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.978+0000 7f0904a00640 1 Processor -- start 2024-05-14T09:37:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.979+0000 7f0904a00640 1 -- start start 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.979+0000 7f0904a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0900103c80 0x7f0900070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.979+0000 7f0904a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900104ec0 0x7f0900070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.979+0000 7f0904a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900109bc0 0x7f0900073c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f08fe800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900109bc0 0x7f0900073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f0904a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f090006c9e0 con 0x7f0900103c80 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f0904a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f090006c860 con 0x7f0900109bc0 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f08fe800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900109bc0 0x7f0900073c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56782/0 (socket says 172.21.15.120:56782) 2024-05-14T09:37:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f08fe800640 1 -- 172.21.15.120:0/3173695512 learned_addr learned my addr 172.21.15.120:0/3173695512 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f0904a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f090006cb60 con 0x7f0900104ec0 2024-05-14T09:37:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f08fde00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0900103c80 0x7f0900070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.980+0000 7f08fd400640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900104ec0 0x7f0900070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.981+0000 7f08fe800640 1 -- 172.21.15.120:0/3173695512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900104ec0 msgr2=0x7f0900070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.981+0000 7f08fe800640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900104ec0 0x7f0900070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.981+0000 7f08fe800640 1 -- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0900103c80 msgr2=0x7f0900070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.981+0000 7f08fe800640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0900103c80 0x7f0900070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.981+0000 7f08fe800640 1 -- 172.21.15.120:0/3173695512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09000742b0 con 0x7f0900109bc0 2024-05-14T09:37:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.982+0000 7f08fe800640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900109bc0 0x7f0900073c40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f08f802ace0 tx=0x7f08f8030790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.982+0000 7f08f6a00640 1 -- 172.21.15.120:0/3173695512 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8041020 con 0x7f0900109bc0 2024-05-14T09:37:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.982+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0900074540 con 0x7f0900109bc0 2024-05-14T09:37:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.982+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0900074b00 con 0x7f0900109bc0 2024-05-14T09:37:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.983+0000 7f08f6a00640 1 -- 172.21.15.120:0/3173695512 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f80318d0 con 0x7f0900109bc0 2024-05-14T09:37:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.983+0000 7f08f6a00640 1 -- 172.21.15.120:0/3173695512 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8036040 con 0x7f0900109bc0 2024-05-14T09:37:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.990+0000 7f090b9bf740 1 Processor -- start 2024-05-14T09:37:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.990+0000 7f090b9bf740 1 -- start start 2024-05-14T09:37:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.991+0000 7f08f6a00640 1 -- 172.21.15.120:0/3173695512 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f08f8044020 con 0x7f0900109bc0 2024-05-14T09:37:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.992+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfdf7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.992+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa2c2f0 0x564dbfdf7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.992+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa344d0 0x564dbfdfe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.992+0000 7f090b9bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564dbfd5b550 con 0x564dbfa344d0 2024-05-14T09:37:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.992+0000 7f090b9bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564dbfd00bc0 con 0x564dbfa551b0 2024-05-14T09:37:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.992+0000 7f090b9bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564dbfd57510 con 0x564dbfa2c2f0 2024-05-14T09:37:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.993+0000 7f08fd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa344d0 0x564dbfdfe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.993+0000 7f08fd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa344d0 0x564dbfdfe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50440/0 (socket says 172.21.15.120:50440) 2024-05-14T09:37:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.993+0000 7f08fd400640 1 -- 172.21.15.120:0/1873544784 learned_addr learned my addr 172.21.15.120:0/1873544784 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.993+0000 7f08fde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa2c2f0 0x564dbfdf7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.993+0000 7f08fd400640 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfdf7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.994+0000 7f08f6a00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08e40b2920 0x7f08e40b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.995+0000 7f08f6a00640 1 -- 172.21.15.120:0/3173695512 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f08f8103670 con 0x7f0900109bc0 2024-05-14T09:37:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.996+0000 7f08fde00640 1 -- 172.21.15.120:0/1873544784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 msgr2=0x564dbfdf7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.996+0000 7f08fde00640 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfdf7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.996+0000 7f08fde00640 1 -- 172.21.15.120:0/1873544784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa344d0 msgr2=0x564dbfdfe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.997+0000 7f08fde00640 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa344d0 0x564dbfdfe580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.997+0000 7f08fde00640 1 -- 172.21.15.120:0/1873544784 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbfa6d210 con 0x564dbfa2c2f0 2024-05-14T09:37:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.997+0000 7f08fe800640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08e40b2920 0x7f08e40b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.998+0000 7f08fd400640 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa344d0 0x564dbfdfe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:37:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.998+0000 7f08fde00640 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa2c2f0 0x564dbfdf7680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0900104880 tx=0x7f08f000bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d68f96ceffb0f169 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.999+0000 7f08eb000640 1 -- 172.21.15.120:0/1873544784 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f000be30 con 0x564dbfa2c2f0 2024-05-14T09:37:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.999+0000 7f08eb000640 1 -- 172.21.15.120:0/1873544784 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f0019070 con 0x564dbfa2c2f0 2024-05-14T09:37:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:57.999+0000 7f08eb000640 1 -- 172.21.15.120:0/1873544784 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0014c40 con 0x564dbfa2c2f0 2024-05-14T09:37:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.004+0000 7f090b9bf740 1 -- 172.21.15.120:0/1873544784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa2c2f0 msgr2=0x564dbfdf7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.004+0000 7f090b9bf740 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa2c2f0 0x564dbfdf7680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0900104880 tx=0x7f08f000bbe0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.004+0000 7f08fe800640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08e40b2920 0x7f08e40b4e30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006010 tx=0x7f08f8009330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.005+0000 7f090b9bf740 1 -- 172.21.15.120:0/1873544784 shutdown_connections 2024-05-14T09:37:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.006+0000 7f090b9bf740 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa344d0 0x564dbfdfe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.006+0000 7f090b9bf740 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa2c2f0 0x564dbfdf7680 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.006+0000 7f090b9bf740 1 --2- 172.21.15.120:0/1873544784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfdf7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.006+0000 7f090b9bf740 1 -- 172.21.15.120:0/1873544784 >> 172.21.15.120:0/1873544784 conn(0x564dbfa49300 msgr2=0x564dbfdf2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.007+0000 7f090b9bf740 1 -- 172.21.15.120:0/1873544784 shutdown_connections 2024-05-14T09:37:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.007+0000 7f090b9bf740 1 -- 172.21.15.120:0/1873544784 wait complete. 2024-05-14T09:37:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.008+0000 7f090b9bf740 1 -- start start 2024-05-14T09:37:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.009+0000 7f090b9bf740 1 Processor -- start 2024-05-14T09:37:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.010+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe00c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.010+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa344d0 0x564dbfe011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.010+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfe08120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.010+0000 7f090b9bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564dbfdfefd0 con 0x564dbfa2c2f0 2024-05-14T09:37:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.010+0000 7f090b9bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564dbfd14660 con 0x564dbfa551b0 2024-05-14T09:37:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.010+0000 7f090b9bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564dbfdff150 con 0x564dbfa344d0 2024-05-14T09:37:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.010+0000 7f090b9bf740 10 client.0 _ll_register_callbacks cb 0x564dbfcde400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa344d0 0x564dbfe011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa344d0 0x564dbfe011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54082/0 (socket says 172.21.15.120:54082) 2024-05-14T09:37:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 -- 172.21.15.120:0/3446906061 learned_addr learned my addr 172.21.15.120:0/3446906061 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fd400640 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfe08120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 -- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 msgr2=0x564dbfe08120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfe08120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 -- 172.21.15.120:0/3446906061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 msgr2=0x564dbfe00c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe00c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.011+0000 7f08fde00640 1 -- 172.21.15.120:0/3446906061 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dbfb39620 con 0x564dbfa344d0 2024-05-14T09:37:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.013+0000 7f08fde00640 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa344d0 0x564dbfe011c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f08f0016040 tx=0x7f08f00146d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b290e65bc3c66f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.013+0000 7f08df400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:37:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.014+0000 7f08df400640 1 -- 172.21.15.120:0/3446906061 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f000de30 con 0x564dbfa344d0 2024-05-14T09:37:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.014+0000 7f08df400640 1 -- 172.21.15.120:0/3446906061 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f08f0014940 con 0x564dbfa344d0 2024-05-14T09:37:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.015+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f0019070 con 0x564dbfa344d0 2024-05-14T09:37:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.015+0000 7f08df400640 1 -- 172.21.15.120:0/3446906061 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f08f0014b40 con 0x564dbfa344d0 2024-05-14T09:37:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.016+0000 7f090b9bf740 10 client.26740 fetch_fsmap learned FSMap version 66 2024-05-14T09:37:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.016+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x564dbfe0b080 con 0x564dbfa344d0 2024-05-14T09:37:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.016+0000 7f08df400640 1 -- 172.21.15.120:0/3446906061 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f0019070 con 0x564dbfa344d0 2024-05-14T09:37:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.017+0000 7f08df400640 1 -- 172.21.15.120:0/3446906061 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f08f0013070 con 0x564dbfa344d0 2024-05-14T09:37:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.017+0000 7f090b9bf740 10 client.26740 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:37:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.017+0000 7f090b9bf740 10 client.26740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.017+0000 7f090b9bf740 20 client.26740 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.017+0000 7f090b9bf740 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfa13d80 0x564dbfe0e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.017+0000 7f090b9bf740 4 client.26740 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:37:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.017+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dbfd69160 con 0x564dbfa13d80 2024-05-14T09:37:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.018+0000 7f08fd400640 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfa13d80 0x564dbfe0e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.020+0000 7f08fd400640 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfa13d80 0x564dbfe0e4a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f09f8a1931f3382 server_cookie=d688c373ff904814 in_seq=0 out_seq=0 2024-05-14T09:37:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.020+0000 7f08df400640 10 client.26740 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.021+0000 7f08df400640 1 -- 172.21.15.120:0/3446906061 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564dbfd69160 con 0x564dbfa13d80 2024-05-14T09:37:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.021+0000 7f08df400640 10 client.26740 handle_command_reply: tid=0 2024-05-14T09:37:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.021+0000 7f090b9bf740 1 client.26740 shutdown 2024-05-14T09:37:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa344d0 msgr2=0x564dbfe011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa344d0 0x564dbfe011c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f08f0016040 tx=0x7f08f00146d0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 shutdown_connections 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfa13d80 0x564dbfe0e4a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f08df400640 0 client.26740 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa551b0 0x564dbfe08120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa344d0 0x564dbfe011c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 --2- 172.21.15.120:0/3446906061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe00c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.022+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 >> 172.21.15.120:0/3446906061 conn(0x564dbfa49300 msgr2=0x564dbfdf59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.024+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 shutdown_connections 2024-05-14T09:37:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.024+0000 7f090b9bf740 1 -- 172.21.15.120:0/3446906061 wait complete. 2024-05-14T09:37:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.024+0000 7f090b9bf740 20 client.26740 trim_cache size 0 max 16384 2024-05-14T09:37:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.066+0000 7f090b9bf740 1 Processor -- start 2024-05-14T09:37:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.067+0000 7f090b9bf740 1 -- start start 2024-05-14T09:37:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.068+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa2c2f0 0x564dbfdffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.068+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe080e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.068+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbf9e91c0 0x564dbfe08620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.068+0000 7f090b9bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f08e000fba0 con 0x564dbf9e91c0 2024-05-14T09:37:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.068+0000 7f090b9bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f08e00116e0 con 0x564dbfa2c2f0 2024-05-14T09:37:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.068+0000 7f090b9bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0010270 con 0x564dbfa551b0 2024-05-14T09:37:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.069+0000 7f08fde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.069+0000 7f08fde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:54086/0 (socket says 172.21.15.120:54086) 2024-05-14T09:37:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.069+0000 7f08fde00640 1 -- 172.21.15.120:0/567549705 learned_addr learned my addr 172.21.15.120:0/567549705 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.069+0000 7f08fd400640 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbf9e91c0 0x564dbfe08620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.069+0000 7f08fd400640 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa2c2f0 0x564dbfdffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.070+0000 7f08fde00640 1 -- 172.21.15.120:0/567549705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa2c2f0 msgr2=0x564dbfdffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.070+0000 7f08fde00640 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa2c2f0 0x564dbfdffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.070+0000 7f08fde00640 1 -- 172.21.15.120:0/567549705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbf9e91c0 msgr2=0x564dbfe08620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.070+0000 7f08fde00640 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbf9e91c0 0x564dbfe08620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.070+0000 7f08fde00640 1 -- 172.21.15.120:0/567549705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbfdf7df0 con 0x564dbfa551b0 2024-05-14T09:37:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.071+0000 7f08fde00640 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe080e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08f0000c00 tx=0x7f08f000d920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b10f6d2e1356dc1b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.071+0000 7f08ea600640 1 -- 172.21.15.120:0/567549705 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f000dc30 con 0x564dbfa551b0 2024-05-14T09:37:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.071+0000 7f08ea600640 1 -- 172.21.15.120:0/567549705 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f0034020 con 0x564dbfa551b0 2024-05-14T09:37:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.071+0000 7f08ea600640 1 -- 172.21.15.120:0/567549705 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f001d770 con 0x564dbfa551b0 2024-05-14T09:37:58.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.073+0000 7f090b9bf740 1 -- 172.21.15.120:0/567549705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 msgr2=0x564dbfe080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:58.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.073+0000 7f090b9bf740 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe080e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08f0000c00 tx=0x7f08f000d920 comp rx=0 tx=0).stop 2024-05-14T09:37:58.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.073+0000 7f090b9bf740 1 -- 172.21.15.120:0/567549705 shutdown_connections 2024-05-14T09:37:58.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.074+0000 7f090b9bf740 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbf9e91c0 0x564dbfe08620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.074+0000 7f090b9bf740 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe080e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.074+0000 7f090b9bf740 1 --2- 172.21.15.120:0/567549705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbfa2c2f0 0x564dbfdffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.074+0000 7f090b9bf740 1 -- 172.21.15.120:0/567549705 >> 172.21.15.120:0/567549705 conn(0x564dbfa49300 msgr2=0x564dbfdff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:58.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.074+0000 7f090b9bf740 1 -- 172.21.15.120:0/567549705 shutdown_connections 2024-05-14T09:37:58.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.074+0000 7f090b9bf740 1 -- 172.21.15.120:0/567549705 wait complete. 2024-05-14T09:37:58.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.075+0000 7f090b9bf740 1 -- start start 2024-05-14T09:37:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.076+0000 7f090b9bf740 1 Processor -- start 2024-05-14T09:37:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.077+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbf9e91c0 0x564dbfe05940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.077+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe05e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.077+0000 7f090b9bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe74760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.077+0000 7f090b9bf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0011010 con 0x564dbfa2c2f0 2024-05-14T09:37:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.077+0000 7f090b9bf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0010940 con 0x564dbf9e91c0 2024-05-14T09:37:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.077+0000 7f090b9bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08e000dba0 con 0x564dbfa551b0 2024-05-14T09:37:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.077+0000 7f090b9bf740 10 client.0 _ll_register_callbacks cb 0x7f08ec00ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:37:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.078+0000 7f08fde00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe05e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.078+0000 7f08fde00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe05e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50466/0 (socket says 172.21.15.120:50466) 2024-05-14T09:37:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.078+0000 7f08fde00640 1 -- 172.21.15.120:0/326777947 learned_addr learned my addr 172.21.15.120:0/326777947 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:37:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.079+0000 7f08fd400640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe74760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.079+0000 7f08fd400640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbf9e91c0 0x564dbfe05940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.079+0000 7f08fde00640 1 -- 172.21.15.120:0/326777947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 msgr2=0x564dbfe74760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.079+0000 7f08fde00640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe74760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.079+0000 7f08fde00640 1 -- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbf9e91c0 msgr2=0x564dbfe05940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:37:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.079+0000 7f08fde00640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbf9e91c0 0x564dbfe05940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.079+0000 7f08fde00640 1 -- 172.21.15.120:0/326777947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dbfe74cd0 con 0x564dbfa2c2f0 2024-05-14T09:37:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.080+0000 7f08fd400640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe74760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:37:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.080+0000 7f08df400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:37:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.080+0000 7f08fde00640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe05e80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f08f0006b40 tx=0x7f08f0030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a124a65055bdea6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:37:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.081+0000 7f08df400640 1 -- 172.21.15.120:0/326777947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f003e020 con 0x564dbfa2c2f0 2024-05-14T09:37:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.082+0000 7f08df400640 1 -- 172.21.15.120:0/326777947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f08f0035030 con 0x564dbfa2c2f0 2024-05-14T09:37:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.082+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f0034020 con 0x564dbfa2c2f0 2024-05-14T09:37:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.083+0000 7f08df400640 1 -- 172.21.15.120:0/326777947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f08f003e020 con 0x564dbfa2c2f0 2024-05-14T09:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.083+0000 7f090b9bf740 10 client.17175 fetch_fsmap learned FSMap version 66 2024-05-14T09:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.084+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x564dbfe75f70 con 0x564dbfa2c2f0 2024-05-14T09:37:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.086+0000 7f08df400640 1 -- 172.21.15.120:0/326777947 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f0019070 con 0x564dbfa2c2f0 2024-05-14T09:37:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.087+0000 7f08df400640 1 -- 172.21.15.120:0/326777947 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f08f0014ce0 con 0x564dbfa2c2f0 2024-05-14T09:37:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.088+0000 7f090b9bf740 10 client.17175 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:37:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.088+0000 7f090b9bf740 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:37:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.088+0000 7f090b9bf740 20 client.17175 populate_metadata read hostname 'smithi120' 2024-05-14T09:37:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.088+0000 7f090b9bf740 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfe76920 0x564dbfe78d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:37:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.088+0000 7f090b9bf740 4 client.17175 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:37:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.088+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f08f0034020 con 0x564dbfe76920 2024-05-14T09:37:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.089+0000 7f08fd400640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfe76920 0x564dbfe78d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:37:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.092+0000 7f08fd400640 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfe76920 0x564dbfe78d40 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd27caa48a6ae8 server_cookie=3adc69664da6aace in_seq=0 out_seq=0 2024-05-14T09:37:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.092+0000 7f08df400640 10 client.17175 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.126+0000 7f08df400640 1 -- 172.21.15.120:0/326777947 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f08f0034020 con 0x564dbfe76920 2024-05-14T09:37:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.126+0000 7f08df400640 10 client.17175 handle_command_reply: tid=0 2024-05-14T09:37:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.127+0000 7f090b9bf740 1 client.17175 shutdown 2024-05-14T09:37:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.128+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 msgr2=0x564dbfe05e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.128+0000 7f090b9bf740 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe05e80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f08f0006b40 tx=0x7f08f0030bc0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.129+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 shutdown_connections 2024-05-14T09:37:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.129+0000 7f090b9bf740 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564dbfe76920 0x564dbfe78d40 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.129+0000 7f090b9bf740 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dbfa551b0 0x564dbfe74760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.129+0000 7f090b9bf740 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564dbfa2c2f0 0x564dbfe05e80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.129+0000 7f090b9bf740 1 --2- 172.21.15.120:0/326777947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564dbf9e91c0 0x564dbfe05940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.129+0000 7f08df400640 0 client.17175 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:37:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.129+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 >> 172.21.15.120:0/326777947 conn(0x564dbfa49300 msgr2=0x564dbfdf1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.130+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 shutdown_connections 2024-05-14T09:37:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.130+0000 7f090b9bf740 1 -- 172.21.15.120:0/326777947 wait complete. 2024-05-14T09:37:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.131+0000 7f090b9bf740 20 client.17175 trim_cache size 0 max 16384 2024-05-14T09:37:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:37:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:37:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:37:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:37:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08e40b2920 msgr2=0x7f08e40b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08e40b2920 0x7f08e40b4e30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006010 tx=0x7f08f8009330 comp rx=0 tx=0).stop 2024-05-14T09:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900109bc0 msgr2=0x7f0900073c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900109bc0 0x7f0900073c40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f08f802ace0 tx=0x7f08f8030790 comp rx=0 tx=0).stop 2024-05-14T09:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 shutdown_connections 2024-05-14T09:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f08e40b2920 0x7f08e40b4e30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0900109bc0 0x7f0900073c40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0900104ec0 0x7f0900070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 --2- 172.21.15.120:0/3173695512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0900103c80 0x7f0900070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:37:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.133+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 >> 172.21.15.120:0/3173695512 conn(0x7f09000fee70 msgr2=0x7f0900101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:37:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.136+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 shutdown_connections 2024-05-14T09:37:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:37:58.136+0000 7f0904a00640 1 -- 172.21.15.120:0/3173695512 wait complete. 2024-05-14T09:37:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:58 smithi120 ceph-mon[31085]: pgmap v988: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 651 op/s 2024-05-14T09:37:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:58 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:58 smithi152 ceph-mon[34868]: pgmap v988: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 651 op/s 2024-05-14T09:37:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:58 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:58 smithi175 ceph-mon[35353]: pgmap v988: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 651 op/s 2024-05-14T09:37:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:58 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T09:37:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 625.0 s, 526.0 tps, lat 181.979 ms stddev 52.419 2024-05-14T09:37:59.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:59 smithi120 ceph-mon[31085]: Adjusting osd_memory_target on smithi175 to 176.4M 2024-05-14T09:37:59.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:37:59 smithi120 ceph-mon[31085]: Unable to set osd_memory_target on smithi175 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:37:59.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:59 smithi152 ceph-mon[34868]: Adjusting osd_memory_target on smithi175 to 176.4M 2024-05-14T09:37:59.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:37:59 smithi152 ceph-mon[34868]: Unable to set osd_memory_target on smithi175 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:37:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:59 smithi175 ceph-mon[35353]: Adjusting osd_memory_target on smithi175 to 176.4M 2024-05-14T09:37:59.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:37:59 smithi175 ceph-mon[35353]: Unable to set osd_memory_target on smithi175 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-14T09:38:00.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:00 smithi120 ceph-mon[31085]: pgmap v989: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 671 op/s 2024-05-14T09:38:00.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:00 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:00 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:00 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:38:00.637 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:00 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:38:00.637 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:00 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:00 smithi152 ceph-mon[34868]: pgmap v989: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 671 op/s 2024-05-14T09:38:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:00 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:00 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:00 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:38:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:00 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:38:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:00 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:00 smithi175 ceph-mon[35353]: pgmap v989: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 671 op/s 2024-05-14T09:38:00.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:00 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:00 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:00.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:00 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:38:00.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:00 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:38:00.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:00 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:38:02.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:02 smithi120 ceph-mon[31085]: pgmap v990: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.7 MiB/s wr, 659 op/s 2024-05-14T09:38:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:02 smithi152 ceph-mon[34868]: pgmap v990: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.7 MiB/s wr, 659 op/s 2024-05-14T09:38:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:02 smithi175 ceph-mon[35353]: pgmap v990: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.7 MiB/s wr, 659 op/s 2024-05-14T09:38:04.333 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 630.0 s, 561.3 tps, lat 187.883 ms stddev 176.420 2024-05-14T09:38:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:04 smithi120 ceph-mon[31085]: pgmap v991: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-05-14T09:38:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:04 smithi152 ceph-mon[34868]: pgmap v991: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-05-14T09:38:04.796 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:04 smithi175 ceph-mon[35353]: pgmap v991: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-05-14T09:38:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:06 smithi120 ceph-mon[31085]: pgmap v992: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-05-14T09:38:06.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:06 smithi152 ceph-mon[34868]: pgmap v992: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-05-14T09:38:06.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:06 smithi175 ceph-mon[35353]: pgmap v992: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-05-14T09:38:08.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:08 smithi120 ceph-mon[31085]: pgmap v993: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 698 op/s 2024-05-14T09:38:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:08 smithi152 ceph-mon[34868]: pgmap v993: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 698 op/s 2024-05-14T09:38:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:08 smithi175 ceph-mon[35353]: pgmap v993: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 698 op/s 2024-05-14T09:38:09.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 635.0 s, 586.2 tps, lat 167.598 ms stddev 57.344 2024-05-14T09:38:09.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:09 smithi120 ceph-mon[31085]: pgmap v994: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 724 op/s 2024-05-14T09:38:09.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:09 smithi152 ceph-mon[34868]: pgmap v994: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 724 op/s 2024-05-14T09:38:09.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:09 smithi175 ceph-mon[35353]: pgmap v994: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 724 op/s 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 -- 172.21.15.120:0/296464359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39241101c0 msgr2=0x7f39241125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 --2- 172.21.15.120:0/296464359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39241101c0 0x7f39241125e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f391c009ca0 tx=0x7f391c02a8c0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 -- 172.21.15.120:0/296464359 shutdown_connections 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 --2- 172.21.15.120:0/296464359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39241101c0 0x7f39241125e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 --2- 172.21.15.120:0/296464359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f392410b4c0 0x7f392410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 --2- 172.21.15.120:0/296464359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f392410a280 0x7f392410af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 -- 172.21.15.120:0/296464359 >> 172.21.15.120:0/296464359 conn(0x7f3924078f10 msgr2=0x7f3924107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.507+0000 7f3929a00640 1 -- 172.21.15.120:0/296464359 shutdown_connections 2024-05-14T09:38:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.508+0000 7f3929a00640 1 -- 172.21.15.120:0/296464359 wait complete. 2024-05-14T09:38:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.509+0000 7f3929a00640 1 Processor -- start 2024-05-14T09:38:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.509+0000 7f3929a00640 1 -- start start 2024-05-14T09:38:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3929a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f392410a280 0x7f39241a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3929a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f392410b4c0 0x7f39241a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3929a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39241101c0 0x7f39241a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3929a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3924115c50 con 0x7f392410b4c0 2024-05-14T09:38:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3929a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3924115ad0 con 0x7f392410a280 2024-05-14T09:38:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3929a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3924115dd0 con 0x7f39241101c0 2024-05-14T09:38:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3922000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f392410b4c0 0x7f39241a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3922000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f392410b4c0 0x7f39241a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49812/0 (socket says 172.21.15.120:49812) 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3922000640 1 -- 172.21.15.120:0/2030415250 learned_addr learned my addr 172.21.15.120:0/2030415250 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.510+0000 7f3922a00640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f392410a280 0x7f39241a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.511+0000 7f3923400640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39241101c0 0x7f39241a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.511+0000 7f3922000640 1 -- 172.21.15.120:0/2030415250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39241101c0 msgr2=0x7f39241a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.511+0000 7f3922000640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39241101c0 0x7f39241a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.511+0000 7f3922000640 1 -- 172.21.15.120:0/2030415250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f392410a280 msgr2=0x7f39241a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.511+0000 7f3922000640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f392410a280 0x7f39241a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.511+0000 7f3922000640 1 -- 172.21.15.120:0/2030415250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39241a8370 con 0x7f392410b4c0 2024-05-14T09:38:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.512+0000 7f3922000640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f392410b4c0 0x7f39241a0d70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f391000e9f0 tx=0x7f391000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.512+0000 7f391b400640 1 -- 172.21.15.120:0/2030415250 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391000cd80 con 0x7f392410b4c0 2024-05-14T09:38:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.512+0000 7f391b400640 1 -- 172.21.15.120:0/2030415250 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39100108c0 con 0x7f392410b4c0 2024-05-14T09:38:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.512+0000 7f391b400640 1 -- 172.21.15.120:0/2030415250 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391000cd80 con 0x7f392410b4c0 2024-05-14T09:38:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.512+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39241a8660 con 0x7f392410b4c0 2024-05-14T09:38:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.513+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39241a8aa0 con 0x7f392410b4c0 2024-05-14T09:38:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.517+0000 7f3930a20740 1 Processor -- start 2024-05-14T09:38:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.517+0000 7f3930a20740 1 -- start start 2024-05-14T09:38:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.518+0000 7f3930a20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.518+0000 7f3930a20740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.518+0000 7f3930a20740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.518+0000 7f3930a20740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dd3b513550 con 0x55dd3b1e42f0 2024-05-14T09:38:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.518+0000 7f3930a20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dd3b4b8bc0 con 0x55dd3b20d1b0 2024-05-14T09:38:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.518+0000 7f3930a20740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd3b50f510 con 0x55dd3b1ec4d0 2024-05-14T09:38:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.519+0000 7f3923400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.519+0000 7f3923400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:45634/0 (socket says 172.21.15.120:45634) 2024-05-14T09:38:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.519+0000 7f3923400640 1 -- 172.21.15.120:0/4220678907 learned_addr learned my addr 172.21.15.120:0/4220678907 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.519+0000 7f3922a00640 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.520+0000 7f3922a00640 1 -- 172.21.15.120:0/4220678907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 msgr2=0x55dd3b5b6580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:38:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.520+0000 7f3922a00640 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5b6580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.520+0000 7f3922a00640 1 -- 172.21.15.120:0/4220678907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 msgr2=0x55dd3b5af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.520+0000 7f3922a00640 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.520+0000 7f391b400640 1 -- 172.21.15.120:0/2030415250 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f39100185a0 con 0x7f392410b4c0 2024-05-14T09:38:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.520+0000 7f3922a00640 1 -- 172.21.15.120:0/4220678907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd3b225210 con 0x55dd3b1e42f0 2024-05-14T09:38:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.520+0000 7f3923400640 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:38:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.521+0000 7f3922a00640 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5af680 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3924109b50 tx=0x7f39140107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66926d939467d898 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.521+0000 7f390fe00640 1 -- 172.21.15.120:0/4220678907 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914004030 con 0x55dd3b1e42f0 2024-05-14T09:38:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.521+0000 7f390fe00640 1 -- 172.21.15.120:0/4220678907 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3914005020 con 0x55dd3b1e42f0 2024-05-14T09:38:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.521+0000 7f390fe00640 1 -- 172.21.15.120:0/4220678907 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914004b60 con 0x55dd3b1e42f0 2024-05-14T09:38:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.523+0000 7f391b400640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39080b2aa0 0x7f39080b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.523+0000 7f391b400640 1 -- 172.21.15.120:0/2030415250 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f39100e2680 con 0x7f392410b4c0 2024-05-14T09:38:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.524+0000 7f3923400640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39080b2aa0 0x7f39080b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.525+0000 7f3930a20740 1 -- 172.21.15.120:0/4220678907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 msgr2=0x55dd3b5af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.525+0000 7f3930a20740 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5af680 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3924109b50 tx=0x7f39140107a0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.525+0000 7f3930a20740 1 -- 172.21.15.120:0/4220678907 shutdown_connections 2024-05-14T09:38:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.525+0000 7f3923400640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39080b2aa0 0x7f39080b4fb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55dd3b5b02d0 tx=0x7f391c031000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.526+0000 7f3930a20740 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.526+0000 7f3930a20740 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5af680 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.526+0000 7f3930a20740 1 --2- 172.21.15.120:0/4220678907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.526+0000 7f3930a20740 1 -- 172.21.15.120:0/4220678907 >> 172.21.15.120:0/4220678907 conn(0x55dd3b201300 msgr2=0x55dd3b5aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.526+0000 7f3930a20740 1 -- 172.21.15.120:0/4220678907 shutdown_connections 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.527+0000 7f3930a20740 1 -- 172.21.15.120:0/4220678907 wait complete. 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.527+0000 7f3930a20740 1 -- start start 2024-05-14T09:38:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.528+0000 7f3930a20740 1 Processor -- start 2024-05-14T09:38:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.529+0000 7f3930a20740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.529+0000 7f3930a20740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.529+0000 7f3930a20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.529+0000 7f3930a20740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dd3b5c7fe0 con 0x55dd3b1e42f0 2024-05-14T09:38:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.529+0000 7f3930a20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dd3b4cc660 con 0x55dd3b20d1b0 2024-05-14T09:38:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.529+0000 7f3930a20740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd3b5c8160 con 0x55dd3b1ec4d0 2024-05-14T09:38:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.529+0000 7f3930a20740 10 client.0 _ll_register_callbacks cb 0x55dd3b496400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.530+0000 7f3922a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.530+0000 7f3922a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49824/0 (socket says 172.21.15.120:49824) 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.530+0000 7f3922a00640 1 -- 172.21.15.120:0/774539597 learned_addr learned my addr 172.21.15.120:0/774539597 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.530+0000 7f3923400640 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.530+0000 7f3922000640 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.530+0000 7f3922a00640 1 -- 172.21.15.120:0/774539597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 msgr2=0x55dd3b5ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.530+0000 7f3922a00640 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.531+0000 7f3922a00640 1 -- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 msgr2=0x55dd3b5d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.531+0000 7f3922a00640 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.531+0000 7f3922a00640 1 -- 172.21.15.120:0/774539597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd3b2f1620 con 0x55dd3b1e42f0 2024-05-14T09:38:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.531+0000 7f3922a00640 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5c9c40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3914000c00 tx=0x7f3914005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b0df56d36a7a69 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.531+0000 7f390cc00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:38:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.532+0000 7f390cc00640 1 -- 172.21.15.120:0/774539597 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391402a060 con 0x55dd3b1e42f0 2024-05-14T09:38:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.532+0000 7f390cc00640 1 -- 172.21.15.120:0/774539597 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f391400bd40 con 0x55dd3b1e42f0 2024-05-14T09:38:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.533+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3914005020 con 0x55dd3b1e42f0 2024-05-14T09:38:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.533+0000 7f390cc00640 1 -- 172.21.15.120:0/774539597 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f3914004250 con 0x55dd3b1e42f0 2024-05-14T09:38:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.534+0000 7f3930a20740 10 client.17187 fetch_fsmap learned FSMap version 66 2024-05-14T09:38:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.534+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55dd3b5d4010 con 0x55dd3b1e42f0 2024-05-14T09:38:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.536+0000 7f390cc00640 1 -- 172.21.15.120:0/774539597 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3914005020 con 0x55dd3b1e42f0 2024-05-14T09:38:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.538+0000 7f390cc00640 1 -- 172.21.15.120:0/774539597 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f3914003870 con 0x55dd3b1e42f0 2024-05-14T09:38:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.538+0000 7f3930a20740 10 client.17187 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:38:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.538+0000 7f3930a20740 10 client.17187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.538+0000 7f3930a20740 20 client.17187 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.538+0000 7f3930a20740 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1cbd80 0x55dd3b5d7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.538+0000 7f3930a20740 4 client.17187 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:38:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.538+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd3b521160 con 0x55dd3b1cbd80 2024-05-14T09:38:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.539+0000 7f3922000640 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1cbd80 0x55dd3b5d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.541+0000 7f390cc00640 10 client.17187 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.541+0000 7f3922000640 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1cbd80 0x55dd3b5d7430 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d71d3ef025c5901 server_cookie=7d71f7cd94c1d478 in_seq=0 out_seq=0 2024-05-14T09:38:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.544+0000 7f390cc00640 1 -- 172.21.15.120:0/774539597 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dd3b521160 con 0x55dd3b1cbd80 2024-05-14T09:38:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.544+0000 7f390cc00640 10 client.17187 handle_command_reply: tid=0 2024-05-14T09:38:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.544+0000 7f3930a20740 1 client.17187 shutdown 2024-05-14T09:38:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.544+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 msgr2=0x55dd3b5c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.544+0000 7f3930a20740 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5c9c40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3914000c00 tx=0x7f3914005400 comp rx=0 tx=0).stop 2024-05-14T09:38:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 shutdown_connections 2024-05-14T09:38:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1cbd80 0x55dd3b5d7430 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 --2- 172.21.15.120:0/774539597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5c9c40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 >> 172.21.15.120:0/774539597 conn(0x55dd3b201300 msgr2=0x55dd3b5ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f390cc00640 0 client.17187 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 shutdown_connections 2024-05-14T09:38:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 1 -- 172.21.15.120:0/774539597 wait complete. 2024-05-14T09:38:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.546+0000 7f3930a20740 20 client.17187 trim_cache size 0 max 16384 2024-05-14T09:38:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.576+0000 7f3930a20740 1 Processor -- start 2024-05-14T09:38:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.576+0000 7f3930a20740 1 -- start start 2024-05-14T09:38:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.576+0000 7f3930a20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.576+0000 7f3930a20740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3930a20740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3930a20740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39241aa9b0 con 0x55dd3b20d1b0 2024-05-14T09:38:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3930a20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f39241ac4f0 con 0x55dd3b1e42f0 2024-05-14T09:38:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3930a20740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39241ab080 con 0x55dd3b1ec4d0 2024-05-14T09:38:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3922000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3922a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3922000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5d1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53472/0 (socket says 172.21.15.120:53472) 2024-05-14T09:38:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.577+0000 7f3922000640 1 -- 172.21.15.120:0/1024736730 learned_addr learned my addr 172.21.15.120:0/1024736730 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.578+0000 7f3923400640 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.578+0000 7f3922a00640 1 -- 172.21.15.120:0/1024736730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 msgr2=0x55dd3b5d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.578+0000 7f3922a00640 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.578+0000 7f3922a00640 1 -- 172.21.15.120:0/1024736730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 msgr2=0x55dd3b5aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.578+0000 7f3922a00640 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.579+0000 7f3922a00640 1 -- 172.21.15.120:0/1024736730 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd3b5a6280 con 0x55dd3b1e42f0 2024-05-14T09:38:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.580+0000 7f3922a00640 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5b36d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3914001eb0 tx=0x7f39140107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=963c997df0123e12 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.580+0000 7f390f400640 1 -- 172.21.15.120:0/1024736730 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391402a050 con 0x55dd3b1e42f0 2024-05-14T09:38:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.580+0000 7f390f400640 1 -- 172.21.15.120:0/1024736730 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3914005850 con 0x55dd3b1e42f0 2024-05-14T09:38:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.580+0000 7f390f400640 1 -- 172.21.15.120:0/1024736730 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914034080 con 0x55dd3b1e42f0 2024-05-14T09:38:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.582+0000 7f3930a20740 1 -- 172.21.15.120:0/1024736730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1e42f0 msgr2=0x55dd3b5b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.582+0000 7f3930a20740 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5b36d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3914001eb0 tx=0x7f39140107a0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.582+0000 7f3930a20740 1 -- 172.21.15.120:0/1024736730 shutdown_connections 2024-05-14T09:38:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.582+0000 7f3930a20740 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.582+0000 7f3930a20740 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.582+0000 7f3930a20740 1 --2- 172.21.15.120:0/1024736730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5b36d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.582+0000 7f3930a20740 1 -- 172.21.15.120:0/1024736730 >> 172.21.15.120:0/1024736730 conn(0x55dd3b201300 msgr2=0x55dd3b5aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.583+0000 7f3930a20740 1 -- 172.21.15.120:0/1024736730 shutdown_connections 2024-05-14T09:38:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.583+0000 7f3930a20740 1 -- 172.21.15.120:0/1024736730 wait complete. 2024-05-14T09:38:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.583+0000 7f3930a20740 1 -- start start 2024-05-14T09:38:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.584+0000 7f3930a20740 1 Processor -- start 2024-05-14T09:38:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3930a20740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3930a20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3930a20740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3930a20740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39241abe20 con 0x55dd3b20d1b0 2024-05-14T09:38:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3930a20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f39241ab750 con 0x55dd3b1ec4d0 2024-05-14T09:38:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3930a20740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3924074af0 con 0x55dd3b1e42f0 2024-05-14T09:38:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3930a20740 10 client.0 _ll_register_callbacks cb 0x7f391c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.585+0000 7f3923400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3922a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3922a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53478/0 (socket says 172.21.15.120:53478) 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3922a00640 1 -- 172.21.15.120:0/2542862687 learned_addr learned my addr 172.21.15.120:0/2542862687 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3923400640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49846/0 (socket says 172.21.15.120:49846) 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3922000640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3923400640 1 -- 172.21.15.120:0/2542862687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1e42f0 msgr2=0x55dd3b5ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3923400640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3923400640 1 -- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1ec4d0 msgr2=0x55dd3b5cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3923400640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3923400640 1 -- 172.21.15.120:0/2542862687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd3b5d0130 con 0x55dd3b20d1b0 2024-05-14T09:38:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.586+0000 7f3922a00640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.587+0000 7f3923400640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5cfb70 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f391c009bf0 tx=0x7f391c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75f57a2cb6b0ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.587+0000 7f390cc00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.588+0000 7f390cc00640 1 -- 172.21.15.120:0/2542862687 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c059060 con 0x55dd3b20d1b0 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.588+0000 7f390cc00640 1 -- 172.21.15.120:0/2542862687 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f391c003970 con 0x55dd3b20d1b0 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.588+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3914005850 con 0x55dd3b20d1b0 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.588+0000 7f390cc00640 1 -- 172.21.15.120:0/2542862687 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f391c060050 con 0x55dd3b20d1b0 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.588+0000 7f3930a20740 10 client.17193 fetch_fsmap learned FSMap version 66 2024-05-14T09:38:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.588+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55dd3b5d1430 con 0x55dd3b20d1b0 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.589+0000 7f390cc00640 1 -- 172.21.15.120:0/2542862687 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3914005850 con 0x55dd3b20d1b0 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.589+0000 7f390cc00640 1 -- 172.21.15.120:0/2542862687 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f391c054480 con 0x55dd3b20d1b0 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.589+0000 7f3930a20740 10 client.17193 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.589+0000 7f3930a20740 10 client.17193 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.589+0000 7f3930a20740 20 client.17193 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.590+0000 7f3930a20740 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1a11c0 0x55dd3b641d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.590+0000 7f3930a20740 4 client.17193 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:38:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.590+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd3b51afd0 con 0x55dd3b1a11c0 2024-05-14T09:38:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.590+0000 7f3922a00640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1a11c0 0x55dd3b641d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.592+0000 7f3922a00640 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1a11c0 0x55dd3b641d60 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95ae73e789f9511 server_cookie=dcf021e8bec77b78 in_seq=0 out_seq=0 2024-05-14T09:38:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.592+0000 7f390cc00640 10 client.17193 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.628+0000 7f390cc00640 1 -- 172.21.15.120:0/2542862687 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd3b51afd0 con 0x55dd3b1a11c0 2024-05-14T09:38:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.628+0000 7f390cc00640 10 client.17193 handle_command_reply: tid=0 2024-05-14T09:38:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.630+0000 7f3930a20740 1 client.17193 shutdown 2024-05-14T09:38:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.631+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 msgr2=0x55dd3b5cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.631+0000 7f3930a20740 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5cfb70 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f391c009bf0 tx=0x7f391c0095c0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.632+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 shutdown_connections 2024-05-14T09:38:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.632+0000 7f3930a20740 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55dd3b1a11c0 0x55dd3b641d60 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.633+0000 7f3930a20740 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dd3b20d1b0 0x55dd3b5cfb70 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.633+0000 7f3930a20740 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd3b1ec4d0 0x55dd3b5cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.633+0000 7f390cc00640 0 client.17193 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.633+0000 7f3930a20740 1 --2- 172.21.15.120:0/2542862687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd3b1e42f0 0x55dd3b5ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.633+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 >> 172.21.15.120:0/2542862687 conn(0x55dd3b201300 msgr2=0x55dd3b5ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.634+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 shutdown_connections 2024-05-14T09:38:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.634+0000 7f3930a20740 1 -- 172.21.15.120:0/2542862687 wait complete. 2024-05-14T09:38:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.635+0000 7f3930a20740 20 client.17193 trim_cache size 0 max 16384 2024-05-14T09:38:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:38:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:38:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:38:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.636+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39080b2aa0 msgr2=0x7f39080b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.636+0000 7f3929a00640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39080b2aa0 0x7f39080b4fb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55dd3b5b02d0 tx=0x7f391c031000 comp rx=0 tx=0).stop 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.636+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f392410b4c0 msgr2=0x7f39241a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.636+0000 7f3929a00640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f392410b4c0 0x7f39241a0d70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f391000e9f0 tx=0x7f391000eeb0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.637+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 shutdown_connections 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.637+0000 7f3929a00640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39080b2aa0 0x7f39080b4fb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.637+0000 7f3929a00640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39241101c0 0x7f39241a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.637+0000 7f3929a00640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f392410b4c0 0x7f39241a0d70 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.637+0000 7f3929a00640 1 --2- 172.21.15.120:0/2030415250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f392410a280 0x7f39241a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.637+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 >> 172.21.15.120:0/2030415250 conn(0x7f3924078f10 msgr2=0x7f392410c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.637+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 shutdown_connections 2024-05-14T09:38:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:11.638+0000 7f3929a00640 1 -- 172.21.15.120:0/2030415250 wait complete. 2024-05-14T09:38:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:12 smithi120 ceph-mon[31085]: pgmap v995: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 721 op/s 2024-05-14T09:38:12.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:12 smithi175 ceph-mon[35353]: pgmap v995: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 721 op/s 2024-05-14T09:38:12.457 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:12 smithi152 ceph-mon[34868]: pgmap v995: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 721 op/s 2024-05-14T09:38:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 640.0 s, 568.5 tps, lat 177.263 ms stddev 78.906 2024-05-14T09:38:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:14 smithi120 ceph-mon[31085]: pgmap v996: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 689 op/s 2024-05-14T09:38:14.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:14 smithi152 ceph-mon[34868]: pgmap v996: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 689 op/s 2024-05-14T09:38:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:14 smithi175 ceph-mon[35353]: pgmap v996: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 689 op/s 2024-05-14T09:38:16.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:16 smithi120 ceph-mon[31085]: pgmap v997: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 720 op/s 2024-05-14T09:38:16.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:16 smithi152 ceph-mon[34868]: pgmap v997: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 720 op/s 2024-05-14T09:38:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:16 smithi175 ceph-mon[35353]: pgmap v997: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 720 op/s 2024-05-14T09:38:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:18 smithi120 ceph-mon[31085]: pgmap v998: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 655 op/s 2024-05-14T09:38:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:18 smithi152 ceph-mon[34868]: pgmap v998: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 655 op/s 2024-05-14T09:38:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:18 smithi175 ceph-mon[35353]: pgmap v998: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 655 op/s 2024-05-14T09:38:19.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 645.0 s, 545.6 tps, lat 182.829 ms stddev 71.125 2024-05-14T09:38:20.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:20 smithi120 ceph-mon[31085]: pgmap v999: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 668 op/s 2024-05-14T09:38:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:20 smithi152 ceph-mon[34868]: pgmap v999: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 668 op/s 2024-05-14T09:38:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:20 smithi175 ceph-mon[35353]: pgmap v999: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 668 op/s 2024-05-14T09:38:22.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:22 smithi120 ceph-mon[31085]: pgmap v1000: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 637 op/s 2024-05-14T09:38:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:22 smithi152 ceph-mon[34868]: pgmap v1000: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 637 op/s 2024-05-14T09:38:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:22 smithi175 ceph-mon[35353]: pgmap v1000: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 637 op/s 2024-05-14T09:38:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 650.0 s, 545.4 tps, lat 183.485 ms stddev 82.836 2024-05-14T09:38:24.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:24 smithi120 ceph-mon[31085]: pgmap v1001: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 596 op/s 2024-05-14T09:38:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:24 smithi152 ceph-mon[34868]: pgmap v1001: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 596 op/s 2024-05-14T09:38:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:24 smithi175 ceph-mon[35353]: pgmap v1001: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 596 op/s 2024-05-14T09:38:26.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:26 smithi120 ceph-mon[31085]: pgmap v1002: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 648 op/s 2024-05-14T09:38:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:26 smithi152 ceph-mon[34868]: pgmap v1002: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 648 op/s 2024-05-14T09:38:26.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:26 smithi175 ceph-mon[35353]: pgmap v1002: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 648 op/s 2024-05-14T09:38:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.968+0000 7f55a5200640 1 -- 172.21.15.120:0/2320930684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a0101f80 msgr2=0x7f55a0102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.968+0000 7f55a5200640 1 --2- 172.21.15.120:0/2320930684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a0101f80 0x7f55a0102390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5590009ca0 tx=0x7f559002a8d0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.968+0000 7f55a5200640 1 -- 172.21.15.120:0/2320930684 shutdown_connections 2024-05-14T09:38:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.968+0000 7f55a5200640 1 --2- 172.21.15.120:0/2320930684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55a01034c0 0x7f55a01039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.968+0000 7f55a5200640 1 --2- 172.21.15.120:0/2320930684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0102960 0x7f55a0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.968+0000 7f55a5200640 1 --2- 172.21.15.120:0/2320930684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a0101f80 0x7f55a0102390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.968+0000 7f55a5200640 1 -- 172.21.15.120:0/2320930684 >> 172.21.15.120:0/2320930684 conn(0x7f55a00fdb50 msgr2=0x7f55a0100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.969+0000 7f55a5200640 1 -- 172.21.15.120:0/2320930684 shutdown_connections 2024-05-14T09:38:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.969+0000 7f55a5200640 1 -- 172.21.15.120:0/2320930684 wait complete. 2024-05-14T09:38:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.970+0000 7f55a5200640 1 Processor -- start 2024-05-14T09:38:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.970+0000 7f55a5200640 1 -- start start 2024-05-14T09:38:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.971+0000 7f55a5200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55a0101f80 0x7f55a019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.971+0000 7f55a5200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0102960 0x7f55a019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.971+0000 7f55a5200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a01034c0 0x7f55a01a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f55a5200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55a01116b0 con 0x7f55a0101f80 2024-05-14T09:38:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f55a5200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f55a0111530 con 0x7f55a0102960 2024-05-14T09:38:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f55a5200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f55a0111830 con 0x7f55a01034c0 2024-05-14T09:38:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f559f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55a0101f80 0x7f55a019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f559f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55a0101f80 0x7f55a019c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39722/0 (socket says 172.21.15.120:39722) 2024-05-14T09:38:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f559f400640 1 -- 172.21.15.120:0/20063702 learned_addr learned my addr 172.21.15.120:0/20063702 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f559ea00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0102960 0x7f55a019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.972+0000 7f559fe00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a01034c0 0x7f55a01a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.973+0000 7f559fe00640 1 -- 172.21.15.120:0/20063702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0102960 msgr2=0x7f55a019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.973+0000 7f559fe00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0102960 0x7f55a019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.973+0000 7f559fe00640 1 -- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55a0101f80 msgr2=0x7f55a019c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.973+0000 7f559fe00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55a0101f80 0x7f55a019c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.973+0000 7f559fe00640 1 -- 172.21.15.120:0/20063702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a01a3c10 con 0x7f55a01034c0 2024-05-14T09:38:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.975+0000 7f559fe00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a01034c0 0x7f55a01a35a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f559800c710 tx=0x7f559800cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.976+0000 7f5597e00640 1 -- 172.21.15.120:0/20063702 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598004220 con 0x7f55a01034c0 2024-05-14T09:38:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.976+0000 7f5597e00640 1 -- 172.21.15.120:0/20063702 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55980043c0 con 0x7f55a01034c0 2024-05-14T09:38:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.976+0000 7f5597e00640 1 -- 172.21.15.120:0/20063702 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598003c30 con 0x7f55a01034c0 2024-05-14T09:38:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.978+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a01041f0 con 0x7f55a01034c0 2024-05-14T09:38:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.978+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a0104710 con 0x7f55a01034c0 2024-05-14T09:38:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.988+0000 7f55ad87e740 1 Processor -- start 2024-05-14T09:38:26.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.989+0000 7f55ad87e740 1 -- start start 2024-05-14T09:38:26.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.989+0000 7f5597e00640 1 -- 172.21.15.120:0/20063702 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5598007740 con 0x7f55a01034c0 2024-05-14T09:38:26.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.990+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933eb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930202f0 0x5619933eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930284d0 0x5619933f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f55ad87e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56199334f550 con 0x5619930491b0 2024-05-14T09:38:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f55ad87e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5619932f4bc0 con 0x5619930202f0 2024-05-14T09:38:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f55ad87e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56199334b510 con 0x5619930284d0 2024-05-14T09:38:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f559f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930202f0 0x5619933eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f559f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930202f0 0x5619933eb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:42538/0 (socket says 172.21.15.120:42538) 2024-05-14T09:38:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.991+0000 7f559f400640 1 -- 172.21.15.120:0/322753626 learned_addr learned my addr 172.21.15.120:0/322753626 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.992+0000 7f5597e00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f55840b29b0 0x7f55840b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.992+0000 7f559f400640 1 -- 172.21.15.120:0/322753626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930284d0 msgr2=0x5619933f27b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:38:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.992+0000 7f559f400640 1 --2- 172.21.15.120:0/322753626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930284d0 0x5619933f27b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.992+0000 7f559f400640 1 -- 172.21.15.120:0/322753626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 msgr2=0x5619933eb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.992+0000 7f559f400640 1 --2- 172.21.15.120:0/322753626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.992+0000 7f559f400640 1 -- 172.21.15.120:0/322753626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561993061210 con 0x5619930202f0 2024-05-14T09:38:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.992+0000 7f559fe00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f55840b29b0 0x7f55840b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.993+0000 7f559f400640 1 --2- 172.21.15.120:0/322753626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930202f0 0x5619933eb8b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55900314e0 tx=0x7f5590031510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a2d272eac1cca47 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.993+0000 7f5597e00640 1 -- 172.21.15.120:0/20063702 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f55980e2000 con 0x7f55a01034c0 2024-05-14T09:38:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.994+0000 7f559fe00640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f55840b29b0 0x7f55840b4ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f55980a5320 tx=0x7f5598007ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.994+0000 7f5594c00640 1 -- 172.21.15.120:0/322753626 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590031b60 con 0x5619930202f0 2024-05-14T09:38:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.994+0000 7f5594c00640 1 -- 172.21.15.120:0/322753626 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5590036040 con 0x5619930202f0 2024-05-14T09:38:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.994+0000 7f5594c00640 1 -- 172.21.15.120:0/322753626 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590044660 con 0x5619930202f0 2024-05-14T09:38:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.999+0000 7f55ad87e740 1 -- 172.21.15.120:0/322753626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930202f0 msgr2=0x5619933eb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.999+0000 7f55ad87e740 1 --2- 172.21.15.120:0/322753626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930202f0 0x5619933eb8b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55900314e0 tx=0x7f5590031510 comp rx=0 tx=0).stop 2024-05-14T09:38:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.999+0000 7f55ad87e740 1 -- 172.21.15.120:0/322753626 shutdown_connections 2024-05-14T09:38:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.999+0000 7f55ad87e740 1 --2- 172.21.15.120:0/322753626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930284d0 0x5619933f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:26.999+0000 7f55ad87e740 1 --2- 172.21.15.120:0/322753626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930202f0 0x5619933eb8b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.000+0000 7f55ad87e740 1 --2- 172.21.15.120:0/322753626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933eb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.000+0000 7f55ad87e740 1 -- 172.21.15.120:0/322753626 >> 172.21.15.120:0/322753626 conn(0x56199303d300 msgr2=0x5619933e6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.002+0000 7f55ad87e740 1 -- 172.21.15.120:0/322753626 shutdown_connections 2024-05-14T09:38:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.003+0000 7f55ad87e740 1 -- 172.21.15.120:0/322753626 wait complete. 2024-05-14T09:38:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.004+0000 7f55ad87e740 1 -- start start 2024-05-14T09:38:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.004+0000 7f55ad87e740 1 Processor -- start 2024-05-14T09:38:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.005+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f559ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f559ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43906/0 (socket says 172.21.15.120:43906) 2024-05-14T09:38:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f55ad87e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5619933f3140 con 0x5619930491b0 2024-05-14T09:38:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f559ea00640 1 -- 172.21.15.120:0/4262477472 learned_addr learned my addr 172.21.15.120:0/4262477472 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561993308660 con 0x5619930284d0 2024-05-14T09:38:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619933f32c0 con 0x5619930202f0 2024-05-14T09:38:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.006+0000 7f55ad87e740 10 client.0 _ll_register_callbacks cb 0x5619932d2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.007+0000 7f559f400640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.008+0000 7f559ea00640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.008+0000 7f559f400640 1 -- 172.21.15.120:0/4262477472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 msgr2=0x5619933f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.008+0000 7f559f400640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.008+0000 7f559f400640 1 -- 172.21.15.120:0/4262477472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 msgr2=0x5619933fc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.008+0000 7f559f400640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933fc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.009+0000 7f559f400640 1 -- 172.21.15.120:0/4262477472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199312d620 con 0x5619930284d0 2024-05-14T09:38:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.009+0000 7f559ea00640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:38:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.011+0000 7f559f400640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f5310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5590009a60 tx=0x7f5590030800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7998c2a751c5bfe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.011+0000 7f5589600640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:38:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.013+0000 7f5589600640 1 -- 172.21.15.120:0/4262477472 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900309f0 con 0x5619930284d0 2024-05-14T09:38:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.013+0000 7f5589600640 1 -- 172.21.15.120:0/4262477472 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5590041040 con 0x5619930284d0 2024-05-14T09:38:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.013+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5590036040 con 0x5619930284d0 2024-05-14T09:38:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.014+0000 7f5589600640 1 -- 172.21.15.120:0/4262477472 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f5590003970 con 0x5619930284d0 2024-05-14T09:38:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.015+0000 7f55ad87e740 10 client.36695 fetch_fsmap learned FSMap version 66 2024-05-14T09:38:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.015+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5619933f3140 con 0x5619930284d0 2024-05-14T09:38:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.016+0000 7f5589600640 1 -- 172.21.15.120:0/4262477472 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5590036040 con 0x5619930284d0 2024-05-14T09:38:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.016+0000 7f5589600640 1 -- 172.21.15.120:0/4262477472 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f559004d070 con 0x5619930284d0 2024-05-14T09:38:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.017+0000 7f55ad87e740 10 client.36695 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:38:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.017+0000 7f55ad87e740 10 client.36695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.017+0000 7f55ad87e740 20 client.36695 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.017+0000 7f55ad87e740 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561993007d80 0x5619934023f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.017+0000 7f55ad87e740 4 client.36695 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:38:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.017+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56199335d160 con 0x561993007d80 2024-05-14T09:38:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.017+0000 7f559ea00640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561993007d80 0x5619934023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.019+0000 7f559ea00640 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561993007d80 0x5619934023f0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c0a6aa2af970a4 server_cookie=4675bf8d9f101646 in_seq=0 out_seq=0 2024-05-14T09:38:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.019+0000 7f5589600640 10 client.36695 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:27.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.020+0000 7f5589600640 1 -- 172.21.15.120:0/4262477472 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56199335d160 con 0x561993007d80 2024-05-14T09:38:27.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.020+0000 7f5589600640 10 client.36695 handle_command_reply: tid=0 2024-05-14T09:38:27.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 client.36695 shutdown 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 msgr2=0x5619933f5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f5310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5590009a60 tx=0x7f5590030800 comp rx=0 tx=0).stop 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 shutdown_connections 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561993007d80 0x5619934023f0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619933fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f5310 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 --2- 172.21.15.120:0/4262477472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f5589600640 0 client.36695 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.021+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 >> 172.21.15.120:0/4262477472 conn(0x56199303d300 msgr2=0x5619933e9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.022+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 shutdown_connections 2024-05-14T09:38:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.022+0000 7f55ad87e740 1 -- 172.21.15.120:0/4262477472 wait complete. 2024-05-14T09:38:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.022+0000 7f55ad87e740 20 client.36695 trim_cache size 0 max 16384 2024-05-14T09:38:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.068+0000 7f55ad87e740 1 Processor -- start 2024-05-14T09:38:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.069+0000 7f55ad87e740 1 -- start start 2024-05-14T09:38:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.069+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.069+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930284d0 0x5619933fc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930491b0 0x5619933ef830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f55ad87e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55a01aa430 con 0x5619930284d0 2024-05-14T09:38:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f55ad87e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f55a01abf70 con 0x5619930491b0 2024-05-14T09:38:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f55ad87e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f55a01aab00 con 0x5619930202f0 2024-05-14T09:38:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f559f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930284d0 0x5619933fc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f559ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f559ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933ef2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43916/0 (socket says 172.21.15.120:43916) 2024-05-14T09:38:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.070+0000 7f559ea00640 1 -- 172.21.15.120:0/575465870 learned_addr learned my addr 172.21.15.120:0/575465870 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.071+0000 7f559ea00640 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930491b0 0x5619933ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.071+0000 7f559f400640 1 -- 172.21.15.120:0/575465870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 msgr2=0x5619933ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.071+0000 7f559f400640 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.072+0000 7f559f400640 1 -- 172.21.15.120:0/575465870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930491b0 msgr2=0x5619933ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.072+0000 7f559f400640 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930491b0 0x5619933ef830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.072+0000 7f559f400640 1 -- 172.21.15.120:0/575465870 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619933e24a0 con 0x5619930284d0 2024-05-14T09:38:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.072+0000 7f559f400640 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930284d0 0x5619933fc190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f559002adf0 tx=0x7f55900094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628d09e928d8c5af server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.073+0000 7f558be00640 1 -- 172.21.15.120:0/575465870 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559003b860 con 0x5619930284d0 2024-05-14T09:38:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.073+0000 7f558be00640 1 -- 172.21.15.120:0/575465870 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5590036040 con 0x5619930284d0 2024-05-14T09:38:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.073+0000 7f558be00640 1 -- 172.21.15.120:0/575465870 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900586e0 con 0x5619930284d0 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.074+0000 7f55ad87e740 1 -- 172.21.15.120:0/575465870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930284d0 msgr2=0x5619933fc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.074+0000 7f55ad87e740 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930284d0 0x5619933fc190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f559002adf0 tx=0x7f55900094a0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.074+0000 7f55ad87e740 1 -- 172.21.15.120:0/575465870 shutdown_connections 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.075+0000 7f55ad87e740 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930491b0 0x5619933ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.075+0000 7f55ad87e740 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930284d0 0x5619933fc190 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.075+0000 7f55ad87e740 1 --2- 172.21.15.120:0/575465870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.075+0000 7f55ad87e740 1 -- 172.21.15.120:0/575465870 >> 172.21.15.120:0/575465870 conn(0x56199303d300 msgr2=0x5619933eb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.075+0000 7f55ad87e740 1 -- 172.21.15.120:0/575465870 shutdown_connections 2024-05-14T09:38:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.075+0000 7f55ad87e740 1 -- 172.21.15.120:0/575465870 wait complete. 2024-05-14T09:38:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.076+0000 7f55ad87e740 1 -- start start 2024-05-14T09:38:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.076+0000 7f55ad87e740 1 Processor -- start 2024-05-14T09:38:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f55ad87e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619934796d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f55ad87e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55a01ab8a0 con 0x5619930491b0 2024-05-14T09:38:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f55ad87e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f55a01ab1d0 con 0x5619930284d0 2024-05-14T09:38:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f55ad87e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f55a01a8430 con 0x5619930202f0 2024-05-14T09:38:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f55ad87e740 10 client.0 _ll_register_callbacks cb 0x7f55900099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f559ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f559ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43922/0 (socket says 172.21.15.120:43922) 2024-05-14T09:38:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f559ea00640 1 -- 172.21.15.120:0/3441094433 learned_addr learned my addr 172.21.15.120:0/3441094433 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.077+0000 7f559ea00640 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619934796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.078+0000 7f559f400640 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.078+0000 7f559ea00640 1 -- 172.21.15.120:0/3441094433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 msgr2=0x5619933f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.078+0000 7f559ea00640 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.078+0000 7f559ea00640 1 -- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 msgr2=0x5619933f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.078+0000 7f559ea00640 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.078+0000 7f559ea00640 1 -- 172.21.15.120:0/3441094433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561993479c10 con 0x5619930491b0 2024-05-14T09:38:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.079+0000 7f559ea00640 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619934796d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x561993402a90 tx=0x7f558c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579046efa402b1cb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.079+0000 7f5589600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:38:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.080+0000 7f5589600640 1 -- 172.21.15.120:0/3441094433 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c00f040 con 0x5619930491b0 2024-05-14T09:38:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.080+0000 7f5589600640 1 -- 172.21.15.120:0/3441094433 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f558c0239a0 con 0x5619930491b0 2024-05-14T09:38:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.080+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5590036040 con 0x5619930491b0 2024-05-14T09:38:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.081+0000 7f5589600640 1 -- 172.21.15.120:0/3441094433 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f558c023ba0 con 0x5619930491b0 2024-05-14T09:38:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.081+0000 7f55ad87e740 10 client.17205 fetch_fsmap learned FSMap version 66 2024-05-14T09:38:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.081+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56199347ae90 con 0x5619930491b0 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f5589600640 1 -- 172.21.15.120:0/3441094433 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5590036040 con 0x5619930491b0 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f5589600640 1 -- 172.21.15.120:0/3441094433 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 66) ==== 8362+0+0 (secure 0 0 0) 0x7f558c006360 con 0x5619930491b0 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f55ad87e740 10 client.17205 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f55ad87e740 10 client.17205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f55ad87e740 20 client.17205 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f55ad87e740 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561992fdd1c0 0x56199347d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f55ad87e740 4 client.17205 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:38:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.082+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561993356fd0 con 0x561992fdd1c0 2024-05-14T09:38:27.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.083+0000 7f559f400640 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561992fdd1c0 0x56199347d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.085+0000 7f559f400640 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561992fdd1c0 0x56199347d8b0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bbb6c350c8d167a server_cookie=8b55b5c8a2ce7fec in_seq=0 out_seq=0 2024-05-14T09:38:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.085+0000 7f5589600640 10 client.17205 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.120+0000 7f5589600640 1 -- 172.21.15.120:0/3441094433 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561993356fd0 con 0x561992fdd1c0 2024-05-14T09:38:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.120+0000 7f5589600640 10 client.17205 handle_command_reply: tid=0 2024-05-14T09:38:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.121+0000 7f55ad87e740 1 client.17205 shutdown 2024-05-14T09:38:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.121+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 msgr2=0x5619934796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.121+0000 7f55ad87e740 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619934796d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x561993402a90 tx=0x7f558c011920 comp rx=0 tx=0).stop 2024-05-14T09:38:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.122+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 shutdown_connections 2024-05-14T09:38:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.122+0000 7f55ad87e740 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561992fdd1c0 0x56199347d8b0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.122+0000 7f55ad87e740 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5619930491b0 0x5619934796d0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.122+0000 7f55ad87e740 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619930284d0 0x5619933f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.122+0000 7f55ad87e740 1 --2- 172.21.15.120:0/3441094433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619930202f0 0x5619933f90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.122+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 >> 172.21.15.120:0/3441094433 conn(0x56199303d300 msgr2=0x5619933ef2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.122+0000 7f5589600640 0 client.17205 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.123+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 shutdown_connections 2024-05-14T09:38:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.123+0000 7f55ad87e740 1 -- 172.21.15.120:0/3441094433 wait complete. 2024-05-14T09:38:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.124+0000 7f55ad87e740 20 client.17205 trim_cache size 0 max 16384 2024-05-14T09:38:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:38:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:38:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:38:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:38:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.126+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f55840b29b0 msgr2=0x7f55840b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.126+0000 7f55a5200640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f55840b29b0 0x7f55840b4ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f55980a5320 tx=0x7f5598007ca0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a01034c0 msgr2=0x7f55a01a35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a01034c0 0x7f55a01a35a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f559800c710 tx=0x7f559800cb10 comp rx=0 tx=0).stop 2024-05-14T09:38:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 shutdown_connections 2024-05-14T09:38:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f55840b29b0 0x7f55840b4ec0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55a01034c0 0x7f55a01a35a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0102960 0x7f55a019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 --2- 172.21.15.120:0/20063702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55a0101f80 0x7f55a019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.127+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 >> 172.21.15.120:0/20063702 conn(0x7f55a00fdb50 msgr2=0x7f55a00fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.129+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 shutdown_connections 2024-05-14T09:38:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:27.129+0000 7f55a5200640 1 -- 172.21.15.120:0/20063702 wait complete. 2024-05-14T09:38:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:28 smithi120 ceph-mon[31085]: pgmap v1003: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.5 MiB/s wr, 595 op/s 2024-05-14T09:38:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:28 smithi152 ceph-mon[34868]: pgmap v1003: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.5 MiB/s wr, 595 op/s 2024-05-14T09:38:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:28 smithi175 ceph-mon[35353]: pgmap v1003: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.5 MiB/s wr, 595 op/s 2024-05-14T09:38:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 655.0 s, 585.8 tps, lat 170.306 ms stddev 54.112 2024-05-14T09:38:30.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:30 smithi120 ceph-mon[31085]: pgmap v1004: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 675 op/s 2024-05-14T09:38:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:30 smithi152 ceph-mon[34868]: pgmap v1004: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 675 op/s 2024-05-14T09:38:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:30 smithi175 ceph-mon[35353]: pgmap v1004: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 675 op/s 2024-05-14T09:38:32.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:32 smithi120 ceph-mon[31085]: pgmap v1005: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 651 op/s 2024-05-14T09:38:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:32 smithi152 ceph-mon[34868]: pgmap v1005: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 651 op/s 2024-05-14T09:38:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:32 smithi175 ceph-mon[35353]: pgmap v1005: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 651 op/s 2024-05-14T09:38:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 660.0 s, 539.6 tps, lat 167.408 ms stddev 49.843 2024-05-14T09:38:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:34 smithi120 ceph-mon[31085]: pgmap v1006: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 661 op/s 2024-05-14T09:38:34.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:34 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:38:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:34 smithi152 ceph-mon[34868]: pgmap v1006: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 661 op/s 2024-05-14T09:38:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:34 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:38:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:34 smithi175 ceph-mon[35353]: pgmap v1006: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 661 op/s 2024-05-14T09:38:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:34 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:38:36.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:36 smithi120 ceph-mon[31085]: pgmap v1007: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-05-14T09:38:36.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:36 smithi152 ceph-mon[34868]: pgmap v1007: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-05-14T09:38:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:36 smithi175 ceph-mon[35353]: pgmap v1007: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-05-14T09:38:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:38 smithi152 ceph-mon[34868]: pgmap v1008: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 662 op/s 2024-05-14T09:38:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:38 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:38:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:38 smithi175 ceph-mon[35353]: pgmap v1008: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 662 op/s 2024-05-14T09:38:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:38 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:38:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:38 smithi120 ceph-mon[31085]: pgmap v1008: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 662 op/s 2024-05-14T09:38:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:38 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:38:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 665.0 s, 393.6 tps, lat 278.639 ms stddev 394.687 2024-05-14T09:38:40.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:40 smithi152 ceph-mon[34868]: pgmap v1009: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 730 op/s 2024-05-14T09:38:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:40 smithi175 ceph-mon[35353]: pgmap v1009: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 730 op/s 2024-05-14T09:38:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:40 smithi120 ceph-mon[31085]: pgmap v1009: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 730 op/s 2024-05-14T09:38:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.293+0000 7f77c9000640 1 -- 172.21.15.120:0/2073051505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4106ec0 msgr2=0x7f77c41092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.293+0000 7f77c9000640 1 --2- 172.21.15.120:0/2073051505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4106ec0 0x7f77c41092e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009900 tx=0x7f77ac02a440 comp rx=0 tx=0).stop 2024-05-14T09:38:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.293+0000 7f77c9000640 1 -- 172.21.15.120:0/2073051505 shutdown_connections 2024-05-14T09:38:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.293+0000 7f77c9000640 1 --2- 172.21.15.120:0/2073051505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77c4109820 0x7f77c410bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.293+0000 7f77c9000640 1 --2- 172.21.15.120:0/2073051505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4106ec0 0x7f77c41092e0 secure :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009900 tx=0x7f77ac02a440 comp rx=0 tx=0).stop 2024-05-14T09:38:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.293+0000 7f77c9000640 1 --2- 172.21.15.120:0/2073051505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c4104560 0x7f77c4106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.293+0000 7f77c9000640 1 -- 172.21.15.120:0/2073051505 >> 172.21.15.120:0/2073051505 conn(0x7f77c40fdb60 msgr2=0x7f77c4100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.295+0000 7f77c9000640 1 -- 172.21.15.120:0/2073051505 shutdown_connections 2024-05-14T09:38:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.295+0000 7f77c9000640 1 -- 172.21.15.120:0/2073051505 wait complete. 2024-05-14T09:38:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.297+0000 7f77c9000640 1 Processor -- start 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.299+0000 7f77c9000640 1 -- start start 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.299+0000 7f77c9000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77c4104560 0x7f77c4071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.299+0000 7f77c9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4109820 0x7f77c40722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.299+0000 7f77c9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40731c0 0x7f77c40735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.299+0000 7f77c9000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4111680 con 0x7f77c4109820 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.299+0000 7f77c9000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4111500 con 0x7f77c4104560 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.299+0000 7f77c9000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4111800 con 0x7f77c40731c0 2024-05-14T09:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.300+0000 7f77c2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4109820 0x7f77c40722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.301+0000 7f77c2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4109820 0x7f77c40722e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38904/0 (socket says 172.21.15.120:38904) 2024-05-14T09:38:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.301+0000 7f77c2a00640 1 -- 172.21.15.120:0/60867650 learned_addr learned my addr 172.21.15.120:0/60867650 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.301+0000 7f77c3e00640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40731c0 0x7f77c40735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.301+0000 7f77c3400640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77c4104560 0x7f77c4071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.302+0000 7f77c2a00640 1 -- 172.21.15.120:0/60867650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40731c0 msgr2=0x7f77c40735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.302+0000 7f77c2a00640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40731c0 0x7f77c40735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.302+0000 7f77c2a00640 1 -- 172.21.15.120:0/60867650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77c4104560 msgr2=0x7f77c4071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.302+0000 7f77c2a00640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77c4104560 0x7f77c4071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.302+0000 7f77c2a00640 1 -- 172.21.15.120:0/60867650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c4110d60 con 0x7f77c4109820 2024-05-14T09:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.302+0000 7f77c3400640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77c4104560 0x7f77c4071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.303+0000 7f77c2a00640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4109820 0x7f77c40722e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009230 tx=0x7f77ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.303+0000 7f77bbe00640 1 -- 172.21.15.120:0/60867650 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac03f020 con 0x7f77c4109820 2024-05-14T09:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.304+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c4073bd0 con 0x7f77c4109820 2024-05-14T09:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.304+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c4074090 con 0x7f77c4109820 2024-05-14T09:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.304+0000 7f77bbe00640 1 -- 172.21.15.120:0/60867650 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77ac031ba0 con 0x7f77c4109820 2024-05-14T09:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.304+0000 7f77bbe00640 1 -- 172.21.15.120:0/60867650 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac035070 con 0x7f77c4109820 2024-05-14T09:38:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.320+0000 7f77d165b740 1 Processor -- start 2024-05-14T09:38:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.320+0000 7f77bbe00640 1 -- 172.21.15.120:0/60867650 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f77ac042020 con 0x7f77c4109820 2024-05-14T09:38:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.321+0000 7f77d165b740 1 -- start start 2024-05-14T09:38:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.321+0000 7f77d165b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abaa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.321+0000 7f77d165b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7df2f0 0x55991abaa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.321+0000 7f77d165b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abb1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.321+0000 7f77d165b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55991ab0e550 con 0x55991a7e74d0 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.321+0000 7f77d165b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55991aab3bc0 con 0x55991a7df2f0 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.321+0000 7f77d165b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55991ab0a510 con 0x55991a8081b0 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.323+0000 7f77c3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7df2f0 0x55991abaa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.323+0000 7f77c3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7df2f0 0x55991abaa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:45926/0 (socket says 172.21.15.120:45926) 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.323+0000 7f77c3400640 1 -- 172.21.15.120:0/559929469 learned_addr learned my addr 172.21.15.120:0/559929469 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.323+0000 7f77c3e00640 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abaa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.323+0000 7f77c2a00640 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abb1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.323+0000 7f77bbe00640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77a80b2a50 0x7f77a80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.324+0000 7f77c3400640 1 -- 172.21.15.120:0/559929469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 msgr2=0x55991abaa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.324+0000 7f77c3400640 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abaa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.324+0000 7f77c3400640 1 -- 172.21.15.120:0/559929469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 msgr2=0x55991abb1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.324+0000 7f77c3400640 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abb1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.324+0000 7f77c3400640 1 -- 172.21.15.120:0/559929469 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991a820210 con 0x55991a7df2f0 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.324+0000 7f77c2a00640 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abb1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:38:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.325+0000 7f77c3e00640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77a80b2a50 0x7f77a80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.326+0000 7f77bbe00640 1 -- 172.21.15.120:0/60867650 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f77ac03b900 con 0x7f77c4109820 2024-05-14T09:38:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.326+0000 7f77c3e00640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77a80b2a50 0x7f77a80b4f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f77b4005fd0 tx=0x7f77b4004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.326+0000 7f77c3400640 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7df2f0 0x55991abaa880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77bc010450 tx=0x7f77bc010910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce3eeb9450c07a79 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.327+0000 7f77b8c00640 1 -- 172.21.15.120:0/559929469 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc017070 con 0x55991a7df2f0 2024-05-14T09:38:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.327+0000 7f77b8c00640 1 -- 172.21.15.120:0/559929469 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77bc011bf0 con 0x55991a7df2f0 2024-05-14T09:38:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.327+0000 7f77b8c00640 1 -- 172.21.15.120:0/559929469 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc01bb50 con 0x55991a7df2f0 2024-05-14T09:38:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.330+0000 7f77d165b740 1 -- 172.21.15.120:0/559929469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7df2f0 msgr2=0x55991abaa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.330+0000 7f77d165b740 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7df2f0 0x55991abaa880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77bc010450 tx=0x7f77bc010910 comp rx=0 tx=0).stop 2024-05-14T09:38:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.331+0000 7f77d165b740 1 -- 172.21.15.120:0/559929469 shutdown_connections 2024-05-14T09:38:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.331+0000 7f77d165b740 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abb1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.331+0000 7f77d165b740 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7df2f0 0x55991abaa880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.331+0000 7f77d165b740 1 --2- 172.21.15.120:0/559929469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abaa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.331+0000 7f77d165b740 1 -- 172.21.15.120:0/559929469 >> 172.21.15.120:0/559929469 conn(0x55991a7fc300 msgr2=0x55991aba5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.335+0000 7f77d165b740 1 -- 172.21.15.120:0/559929469 shutdown_connections 2024-05-14T09:38:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.336+0000 7f77d165b740 1 -- 172.21.15.120:0/559929469 wait complete. 2024-05-14T09:38:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.338+0000 7f77d165b740 1 -- start start 2024-05-14T09:38:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.338+0000 7f77d165b740 1 Processor -- start 2024-05-14T09:38:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.338+0000 7f77d165b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77d165b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77d165b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abbb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77d165b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55991abb21d0 con 0x55991a7df2f0 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77d165b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55991aac7660 con 0x55991a7e74d0 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77d165b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55991abb2350 con 0x55991a8081b0 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77d165b740 10 client.0 _ll_register_callbacks cb 0x55991aa91400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77c2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77c2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:45942/0 (socket says 172.21.15.120:45942) 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77c2a00640 1 -- 172.21.15.120:0/636958551 learned_addr learned my addr 172.21.15.120:0/636958551 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.339+0000 7f77c3e00640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abbb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.340+0000 7f77c3400640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.341+0000 7f77c2a00640 1 -- 172.21.15.120:0/636958551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 msgr2=0x55991abbb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.341+0000 7f77c2a00640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abbb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.341+0000 7f77c2a00640 1 -- 172.21.15.120:0/636958551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 msgr2=0x55991abb3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.341+0000 7f77c2a00640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.341+0000 7f77c2a00640 1 -- 172.21.15.120:0/636958551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55991a8ec620 con 0x55991a7e74d0 2024-05-14T09:38:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.341+0000 7f77c3400640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:38:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.341+0000 7f77c3e00640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abbb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:38:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.343+0000 7f77c2a00640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb43c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0c93b0 tx=0x7f77ac0c91f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c5f637583783f38 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.343+0000 7f77b1600640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:38:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.344+0000 7f77b1600640 1 -- 172.21.15.120:0/636958551 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac035040 con 0x55991a7e74d0 2024-05-14T09:38:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.344+0000 7f77b1600640 1 -- 172.21.15.120:0/636958551 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f77ac0cd440 con 0x55991a7e74d0 2024-05-14T09:38:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.346+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77bc011bf0 con 0x55991a7e74d0 2024-05-14T09:38:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.347+0000 7f77b1600640 1 -- 172.21.15.120:0/636958551 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f77ac0c8f30 con 0x55991a7e74d0 2024-05-14T09:38:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.347+0000 7f77d165b740 10 client.36713 fetch_fsmap learned FSMap version 68 2024-05-14T09:38:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.347+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x55991abb21d0 con 0x55991a7e74d0 2024-05-14T09:38:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.347+0000 7f77b1600640 1 -- 172.21.15.120:0/636958551 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77bc011bf0 con 0x55991a7e74d0 2024-05-14T09:38:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.347+0000 7f77b1600640 1 -- 172.21.15.120:0/636958551 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 68) ==== 8378+0+0 (secure 0 0 0) 0x7f77ac0c56b0 con 0x55991a7e74d0 2024-05-14T09:38:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.348+0000 7f77d165b740 10 client.36713 fetch_fsmap finished waiting for FSMap version 68 2024-05-14T09:38:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.348+0000 7f77d165b740 10 client.36713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.348+0000 7f77d165b740 20 client.36713 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.348+0000 7f77d165b740 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a7c6d80 0x55991abc1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.348+0000 7f77d165b740 4 client.36713 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:38:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.348+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55991ab1c160 con 0x55991a7c6d80 2024-05-14T09:38:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.348+0000 7f77c3400640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a7c6d80 0x55991abc1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.351+0000 7f77c3400640 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a7c6d80 0x55991abc1b70 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70327c45443137ec server_cookie=8fe862f283d110c1 in_seq=0 out_seq=0 2024-05-14T09:38:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.351+0000 7f77b1600640 10 client.36713 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.352+0000 7f77b1600640 1 -- 172.21.15.120:0/636958551 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55991ab1c160 con 0x55991a7c6d80 2024-05-14T09:38:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.352+0000 7f77b1600640 10 client.36713 handle_command_reply: tid=0 2024-05-14T09:38:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.352+0000 7f77d165b740 1 client.36713 shutdown 2024-05-14T09:38:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 msgr2=0x55991abb43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb43c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0c93b0 tx=0x7f77ac0c91f0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 shutdown_connections 2024-05-14T09:38:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a7c6d80 0x55991abc1b70 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abbb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb43c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 --2- 172.21.15.120:0/636958551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 >> 172.21.15.120:0/636958551 conn(0x55991a7fc300 msgr2=0x55991aba8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.353+0000 7f77b1600640 0 client.36713 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.354+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 shutdown_connections 2024-05-14T09:38:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.354+0000 7f77d165b740 1 -- 172.21.15.120:0/636958551 wait complete. 2024-05-14T09:38:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.354+0000 7f77d165b740 20 client.36713 trim_cache size 0 max 16384 2024-05-14T09:38:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.401+0000 7f77d165b740 1 Processor -- start 2024-05-14T09:38:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.402+0000 7f77d165b740 1 -- start start 2024-05-14T09:38:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.403+0000 7f77d165b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a7df2f0 0x55991abb2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.403+0000 7f77d165b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abbb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.403+0000 7f77d165b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a8081b0 0x55991abbb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.403+0000 7f77d165b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f77a000fca0 con 0x55991a7e74d0 2024-05-14T09:38:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.403+0000 7f77d165b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77a00118a0 con 0x55991a8081b0 2024-05-14T09:38:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.403+0000 7f77d165b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0010370 con 0x55991a7df2f0 2024-05-14T09:38:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.403+0000 7f77c3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a8081b0 0x55991abbb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a7df2f0 0x55991abb2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a7df2f0 0x55991abb2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53366/0 (socket says 172.21.15.120:53366) 2024-05-14T09:38:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3400640 1 -- 172.21.15.120:0/1330590693 learned_addr learned my addr 172.21.15.120:0/1330590693 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c2a00640 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abbb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3e00640 1 -- 172.21.15.120:0/1330590693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a7df2f0 msgr2=0x55991abb2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3e00640 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a7df2f0 0x55991abb2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3e00640 1 -- 172.21.15.120:0/1330590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 msgr2=0x55991abbb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3e00640 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abbb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.404+0000 7f77c3e00640 1 -- 172.21.15.120:0/1330590693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991aba14a0 con 0x55991a8081b0 2024-05-14T09:38:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.405+0000 7f77c3e00640 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a8081b0 0x55991abbb780 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55991abab4d0 tx=0x7f77b4012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30b41e493f911301 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.406+0000 7f77b3e00640 1 -- 172.21.15.120:0/1330590693 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b401f440 con 0x55991a8081b0 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.406+0000 7f77b3e00640 1 -- 172.21.15.120:0/1330590693 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77b401fa70 con 0x55991a8081b0 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.406+0000 7f77b3e00640 1 -- 172.21.15.120:0/1330590693 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b401e960 con 0x55991a8081b0 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.408+0000 7f77d165b740 1 -- 172.21.15.120:0/1330590693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a8081b0 msgr2=0x55991abbb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.408+0000 7f77d165b740 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a8081b0 0x55991abbb780 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55991abab4d0 tx=0x7f77b4012000 comp rx=0 tx=0).stop 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.409+0000 7f77d165b740 1 -- 172.21.15.120:0/1330590693 shutdown_connections 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.409+0000 7f77d165b740 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a8081b0 0x55991abbb780 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.409+0000 7f77d165b740 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7e74d0 0x55991abbb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.409+0000 7f77d165b740 1 --2- 172.21.15.120:0/1330590693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a7df2f0 0x55991abb2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.409+0000 7f77d165b740 1 -- 172.21.15.120:0/1330590693 >> 172.21.15.120:0/1330590693 conn(0x55991a7fc300 msgr2=0x55991abb2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.410+0000 7f77d165b740 1 -- 172.21.15.120:0/1330590693 shutdown_connections 2024-05-14T09:38:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.410+0000 7f77d165b740 1 -- 172.21.15.120:0/1330590693 wait complete. 2024-05-14T09:38:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.411+0000 7f77d165b740 1 -- start start 2024-05-14T09:38:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.411+0000 7f77d165b740 1 Processor -- start 2024-05-14T09:38:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.413+0000 7f77d165b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.413+0000 7f77d165b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.413+0000 7f77d165b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77d165b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0011110 con 0x55991a7df2f0 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77d165b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0010a40 con 0x55991a7e74d0 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77d165b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77a000dca0 con 0x55991a8081b0 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77d165b740 10 client.0 _ll_register_callbacks cb 0x7f77ac0b1050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77c3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77c3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abba420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:53382/0 (socket says 172.21.15.120:53382) 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77c3e00640 1 -- 172.21.15.120:0/3732164063 learned_addr learned my addr 172.21.15.120:0/3732164063 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77c2a00640 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.414+0000 7f77c3400640 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.415+0000 7f77c3e00640 1 -- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 msgr2=0x55991abb94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.415+0000 7f77c3e00640 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.415+0000 7f77c3e00640 1 -- 172.21.15.120:0/3732164063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 msgr2=0x55991abb8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.415+0000 7f77c3e00640 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.415+0000 7f77c3e00640 1 -- 172.21.15.120:0/3732164063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55991abba9e0 con 0x55991a8081b0 2024-05-14T09:38:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.416+0000 7f77b1600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:38:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.416+0000 7f77c3e00640 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abba420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77b401f6a0 tx=0x7f77b401f6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ec1d7ddf5b6b51 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.417+0000 7f77b1600640 1 -- 172.21.15.120:0/3732164063 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b401e6e0 con 0x55991a8081b0 2024-05-14T09:38:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.417+0000 7f77b1600640 1 -- 172.21.15.120:0/3732164063 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f77b401e880 con 0x55991a8081b0 2024-05-14T09:38:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.417+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b401fa70 con 0x55991a8081b0 2024-05-14T09:38:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.418+0000 7f77b1600640 1 -- 172.21.15.120:0/3732164063 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f77b403f050 con 0x55991a8081b0 2024-05-14T09:38:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.418+0000 7f77d165b740 10 client.26785 fetch_fsmap learned FSMap version 68 2024-05-14T09:38:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.418+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x55991abbbc70 con 0x55991a8081b0 2024-05-14T09:38:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.419+0000 7f77b1600640 1 -- 172.21.15.120:0/3732164063 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77b401fa70 con 0x55991a8081b0 2024-05-14T09:38:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.419+0000 7f77b1600640 1 -- 172.21.15.120:0/3732164063 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 68) ==== 8378+0+0 (secure 0 0 0) 0x7f77b4017050 con 0x55991a8081b0 2024-05-14T09:38:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.420+0000 7f77d165b740 10 client.26785 fetch_fsmap finished waiting for FSMap version 68 2024-05-14T09:38:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.420+0000 7f77d165b740 10 client.26785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.420+0000 7f77d165b740 20 client.26785 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.420+0000 7f77d165b740 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a79c1c0 0x55991ac2c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.420+0000 7f77d165b740 4 client.26785 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:38:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.420+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55991ab15fd0 con 0x55991a79c1c0 2024-05-14T09:38:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.421+0000 7f77c3400640 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a79c1c0 0x55991ac2c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.422+0000 7f77c3400640 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a79c1c0 0x55991ac2c570 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41088603290b8f2c server_cookie=90ff550c92565b7 in_seq=0 out_seq=0 2024-05-14T09:38:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.423+0000 7f77b1600640 10 client.26785 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:42.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.451+0000 7f77b1600640 1 -- 172.21.15.120:0/3732164063 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55991ab15fd0 con 0x55991a79c1c0 2024-05-14T09:38:42.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.451+0000 7f77b1600640 10 client.26785 handle_command_reply: tid=0 2024-05-14T09:38:42.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.451+0000 7f77d165b740 1 client.26785 shutdown 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.452+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 msgr2=0x55991abba420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.452+0000 7f77d165b740 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abba420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77b401f6a0 tx=0x7f77b401f6d0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.453+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 shutdown_connections 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.453+0000 7f77d165b740 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55991a79c1c0 0x55991ac2c570 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.453+0000 7f77d165b740 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55991a8081b0 0x55991abba420 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.453+0000 7f77d165b740 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55991a7e74d0 0x55991abb94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.453+0000 7f77b1600640 0 client.26785 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.453+0000 7f77d165b740 1 --2- 172.21.15.120:0/3732164063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55991a7df2f0 0x55991abb8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.454 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.453+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 >> 172.21.15.120:0/3732164063 conn(0x55991a7fc300 msgr2=0x55991aba8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:42.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.454+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 shutdown_connections 2024-05-14T09:38:42.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.454+0000 7f77d165b740 1 -- 172.21.15.120:0/3732164063 wait complete. 2024-05-14T09:38:42.455 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.455+0000 7f77d165b740 20 client.26785 trim_cache size 0 max 16384 2024-05-14T09:38:42.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:38:42.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:38:42.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:38:42.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:38:42.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.456+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77a80b2a50 msgr2=0x7f77a80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.456+0000 7f77c9000640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77a80b2a50 0x7f77a80b4f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f77b4005fd0 tx=0x7f77b4004730 comp rx=0 tx=0).stop 2024-05-14T09:38:42.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.456+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4109820 msgr2=0x7f77c40722e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:42.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.456+0000 7f77c9000640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4109820 0x7f77c40722e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009230 tx=0x7f77ac003c10 comp rx=0 tx=0).stop 2024-05-14T09:38:42.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.457+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 shutdown_connections 2024-05-14T09:38:42.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.457+0000 7f77c9000640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f77a80b2a50 0x7f77a80b4f60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.457+0000 7f77c9000640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40731c0 0x7f77c40735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.457+0000 7f77c9000640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77c4109820 0x7f77c40722e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.457+0000 7f77c9000640 1 --2- 172.21.15.120:0/60867650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77c4104560 0x7f77c4071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:42.458 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.457+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 >> 172.21.15.120:0/60867650 conn(0x7f77c40fdb60 msgr2=0x7f77c4108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:42.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:42 smithi152 ceph-mon[34868]: pgmap v1010: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 671 op/s 2024-05-14T09:38:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.458+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 shutdown_connections 2024-05-14T09:38:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:42.458+0000 7f77c9000640 1 -- 172.21.15.120:0/60867650 wait complete. 2024-05-14T09:38:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:42 smithi175 ceph-mon[35353]: pgmap v1010: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 671 op/s 2024-05-14T09:38:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:42 smithi120 ceph-mon[31085]: pgmap v1010: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 671 op/s 2024-05-14T09:38:44.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 670.0 s, 487.2 tps, lat 203.639 ms stddev 84.990 2024-05-14T09:38:44.436 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:44 smithi120 ceph-mon[31085]: pgmap v1011: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.3 MiB/s wr, 654 op/s 2024-05-14T09:38:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:44 smithi152 ceph-mon[34868]: pgmap v1011: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.3 MiB/s wr, 654 op/s 2024-05-14T09:38:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:44 smithi175 ceph-mon[35353]: pgmap v1011: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.3 MiB/s wr, 654 op/s 2024-05-14T09:38:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:46 smithi152 ceph-mon[34868]: pgmap v1012: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-05-14T09:38:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:46 smithi175 ceph-mon[35353]: pgmap v1012: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-05-14T09:38:46.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:46 smithi120 ceph-mon[31085]: pgmap v1012: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-05-14T09:38:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:48 smithi152 ceph-mon[34868]: pgmap v1013: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.0 MiB/s wr, 629 op/s 2024-05-14T09:38:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:48 smithi175 ceph-mon[35353]: pgmap v1013: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.0 MiB/s wr, 629 op/s 2024-05-14T09:38:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:48 smithi120 ceph-mon[31085]: pgmap v1013: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.0 MiB/s wr, 629 op/s 2024-05-14T09:38:49.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 675.0 s, 424.6 tps, lat 231.878 ms stddev 171.379 2024-05-14T09:38:50.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:50 smithi152 ceph-mon[34868]: pgmap v1014: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.0 MiB/s wr, 710 op/s 2024-05-14T09:38:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:50 smithi175 ceph-mon[35353]: pgmap v1014: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.0 MiB/s wr, 710 op/s 2024-05-14T09:38:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:50 smithi120 ceph-mon[31085]: pgmap v1014: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.0 MiB/s wr, 710 op/s 2024-05-14T09:38:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:52 smithi152 ceph-mon[34868]: pgmap v1015: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 659 op/s 2024-05-14T09:38:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:52 smithi175 ceph-mon[35353]: pgmap v1015: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 659 op/s 2024-05-14T09:38:52.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:52 smithi120 ceph-mon[31085]: pgmap v1015: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 659 op/s 2024-05-14T09:38:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 680.0 s, 523.4 tps, lat 191.022 ms stddev 143.267 2024-05-14T09:38:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:54 smithi175 ceph-mon[35353]: pgmap v1016: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 653 op/s 2024-05-14T09:38:54.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:54 smithi120 ceph-mon[31085]: pgmap v1016: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 653 op/s 2024-05-14T09:38:54.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:54 smithi152 ceph-mon[34868]: pgmap v1016: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 653 op/s 2024-05-14T09:38:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.834+0000 7ff45e800640 1 -- 172.21.15.120:0/3834357892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 msgr2=0x7ff4500998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.834+0000 7ff45e800640 1 --2- 172.21.15.120:0/3834357892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 0x7ff4500998d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff4580687c0 tx=0x7ff45809fcf0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.835+0000 7ff45e800640 1 -- 172.21.15.120:0/3834357892 shutdown_connections 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.835+0000 7ff45e800640 1 --2- 172.21.15.120:0/3834357892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff45009eb10 0x7ff4500a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.835+0000 7ff45e800640 1 --2- 172.21.15.120:0/3834357892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff450099e10 0x7ff45009a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.835+0000 7ff45e800640 1 --2- 172.21.15.120:0/3834357892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 0x7ff4500998d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.835+0000 7ff45e800640 1 -- 172.21.15.120:0/3834357892 >> 172.21.15.120:0/3834357892 conn(0x7ff450093de0 msgr2=0x7ff450096270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.835+0000 7ff45e800640 1 -- 172.21.15.120:0/3834357892 shutdown_connections 2024-05-14T09:38:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.837+0000 7ff45e800640 1 -- 172.21.15.120:0/3834357892 wait complete. 2024-05-14T09:38:55.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.838+0000 7ff45e800640 1 Processor -- start 2024-05-14T09:38:55.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.840+0000 7ff45e800640 1 -- start start 2024-05-14T09:38:55.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.840+0000 7ff45e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 0x7ff45012ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.840+0000 7ff45e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff450099e10 0x7ff45012b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.840+0000 7ff45e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45009eb10 0x7ff4501433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.841+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff450099e10 0x7ff45012b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.841+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff450099e10 0x7ff45012b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40566/0 (socket says 172.21.15.120:40566) 2024-05-14T09:38:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.842+0000 7ff45ca00640 1 -- 172.21.15.120:0/2961122581 learned_addr learned my addr 172.21.15.120:0/2961122581 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.842+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500a44e0 con 0x7ff450098bd0 2024-05-14T09:38:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.842+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500a4360 con 0x7ff450099e10 2024-05-14T09:38:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.842+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500a4660 con 0x7ff45009eb10 2024-05-14T09:38:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.843+0000 7ff45d400640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 0x7ff45012ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.843+0000 7ff45de00640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45009eb10 0x7ff4501433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.845+0000 7ff45de00640 1 -- 172.21.15.120:0/2961122581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff450099e10 msgr2=0x7ff45012b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.845+0000 7ff45de00640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff450099e10 0x7ff45012b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.845+0000 7ff45de00640 1 -- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 msgr2=0x7ff45012ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.845+0000 7ff45de00640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 0x7ff45012ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.845+0000 7ff45de00640 1 -- 172.21.15.120:0/2961122581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff450143920 con 0x7ff45009eb10 2024-05-14T09:38:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.845+0000 7ff45de00640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45009eb10 0x7ff4501433e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e970 tx=0x7ff44400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.846+0000 7ff456000640 1 -- 172.21.15.120:0/2961122581 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44400ccc0 con 0x7ff45009eb10 2024-05-14T09:38:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.846+0000 7ff456000640 1 -- 172.21.15.120:0/2961122581 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff444005020 con 0x7ff45009eb10 2024-05-14T09:38:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.846+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff450143c10 con 0x7ff45009eb10 2024-05-14T09:38:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.847+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff450144130 con 0x7ff45009eb10 2024-05-14T09:38:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.847+0000 7ff456000640 1 -- 172.21.15.120:0/2961122581 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44400ce60 con 0x7ff45009eb10 2024-05-14T09:38:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.858+0000 7ff466d6a740 1 Processor -- start 2024-05-14T09:38:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.867+0000 7ff456000640 1 -- 172.21.15.120:0/2961122581 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff4440051d0 con 0x7ff45009eb10 2024-05-14T09:38:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.868+0000 7ff466d6a740 1 -- start start 2024-05-14T09:38:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.868+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d17d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.868+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d17d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.869+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d184770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.869+0000 7ff466d6a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56120d0e1550 con 0x56120cdba4d0 2024-05-14T09:38:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.869+0000 7ff466d6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56120d086bc0 con 0x56120cdb22f0 2024-05-14T09:38:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.869+0000 7ff466d6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56120d0dd510 con 0x56120cddb1b0 2024-05-14T09:38:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.869+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d17d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.870+0000 7ff45d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d17d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.870+0000 7ff45d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d17d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40574/0 (socket says 172.21.15.120:40574) 2024-05-14T09:38:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.870+0000 7ff45d400640 1 -- 172.21.15.120:0/280713736 learned_addr learned my addr 172.21.15.120:0/280713736 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.871+0000 7ff45ca00640 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d184770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.872+0000 7ff456000640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff4400b2870 0x7ff4400b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.873+0000 7ff45d400640 1 -- 172.21.15.120:0/280713736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 msgr2=0x56120d17d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.873+0000 7ff45d400640 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d17d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.873+0000 7ff45d400640 1 -- 172.21.15.120:0/280713736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 msgr2=0x56120d184770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.873+0000 7ff45d400640 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d184770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.873+0000 7ff45d400640 1 -- 172.21.15.120:0/280713736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120cdf3210 con 0x56120cdb22f0 2024-05-14T09:38:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.873+0000 7ff456000640 1 -- 172.21.15.120:0/2961122581 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff4440e2450 con 0x7ff45009eb10 2024-05-14T09:38:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.874+0000 7ff45ca00640 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d17d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:38:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.875+0000 7ff45d400640 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d17d870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff458066580 tx=0x7ff458064250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b5b3633951cb1ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.875+0000 7ff45de00640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff4400b2870 0x7ff4400b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.875+0000 7ff44a600640 1 -- 172.21.15.120:0/280713736 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4580a0bb0 con 0x56120cdb22f0 2024-05-14T09:38:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.875+0000 7ff44a600640 1 -- 172.21.15.120:0/280713736 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4580a4040 con 0x56120cdb22f0 2024-05-14T09:38:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.875+0000 7ff44a600640 1 -- 172.21.15.120:0/280713736 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4580af590 con 0x56120cdb22f0 2024-05-14T09:38:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.877+0000 7ff466d6a740 1 -- 172.21.15.120:0/280713736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 msgr2=0x56120d17d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.877+0000 7ff466d6a740 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d17d870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff458066580 tx=0x7ff458064250 comp rx=0 tx=0).stop 2024-05-14T09:38:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.879+0000 7ff466d6a740 1 -- 172.21.15.120:0/280713736 shutdown_connections 2024-05-14T09:38:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.879+0000 7ff466d6a740 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d184770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.879+0000 7ff466d6a740 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d17d870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.879+0000 7ff466d6a740 1 --2- 172.21.15.120:0/280713736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d17d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.879+0000 7ff466d6a740 1 -- 172.21.15.120:0/280713736 >> 172.21.15.120:0/280713736 conn(0x56120cdcf300 msgr2=0x56120d178c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.879+0000 7ff466d6a740 1 -- 172.21.15.120:0/280713736 shutdown_connections 2024-05-14T09:38:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.880+0000 7ff466d6a740 1 -- 172.21.15.120:0/280713736 wait complete. 2024-05-14T09:38:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.881+0000 7ff466d6a740 1 -- start start 2024-05-14T09:38:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.881+0000 7ff466d6a740 1 Processor -- start 2024-05-14T09:38:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff45de00640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff4400b2870 0x7ff4400b4d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e940 tx=0x7ff4440046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdb22f0 0x56120d186d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdba4d0 0x56120d187260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 0x56120d18e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff466d6a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56120d185160 con 0x56120cddb1b0 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff466d6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56120d09a660 con 0x56120cdba4d0 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff466d6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56120d1852e0 con 0x56120cdb22f0 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.882+0000 7ff466d6a740 10 client.0 _ll_register_callbacks cb 0x56120d064400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.883+0000 7ff45d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdba4d0 0x56120d187260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.883+0000 7ff45d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdba4d0 0x56120d187260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40590/0 (socket says 172.21.15.120:40590) 2024-05-14T09:38:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.883+0000 7ff45d400640 1 -- 172.21.15.120:0/3009096108 learned_addr learned my addr 172.21.15.120:0/3009096108 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.883+0000 7ff45d400640 1 -- 172.21.15.120:0/3009096108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdb22f0 msgr2=0x56120d186d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:38:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.883+0000 7ff45d400640 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdb22f0 0x56120d186d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.883+0000 7ff45d400640 1 -- 172.21.15.120:0/3009096108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 msgr2=0x56120d18e1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:38:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.884+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 0x56120d18e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.884+0000 7ff45d400640 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 0x56120d18e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.885+0000 7ff45d400640 1 -- 172.21.15.120:0/3009096108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120cebf620 con 0x56120cdba4d0 2024-05-14T09:38:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.886+0000 7ff45d400640 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdba4d0 0x56120d187260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4580687c0 tx=0x7ff458068de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bee4088dde8a7a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.886+0000 7ff43ea00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:38:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.888+0000 7ff43ea00640 1 -- 172.21.15.120:0/3009096108 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4580a0d60 con 0x56120cdba4d0 2024-05-14T09:38:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.888+0000 7ff43ea00640 1 -- 172.21.15.120:0/3009096108 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff45806d490 con 0x56120cdba4d0 2024-05-14T09:38:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.889+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4580a4040 con 0x56120cdba4d0 2024-05-14T09:38:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.890+0000 7ff43ea00640 1 -- 172.21.15.120:0/3009096108 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ff4580bb480 con 0x56120cdba4d0 2024-05-14T09:38:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.890+0000 7ff466d6a740 10 client.36731 fetch_fsmap learned FSMap version 68 2024-05-14T09:38:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.890+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x56120d1910f0 con 0x56120cdba4d0 2024-05-14T09:38:55.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.892+0000 7ff43ea00640 1 -- 172.21.15.120:0/3009096108 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4580a4040 con 0x56120cdba4d0 2024-05-14T09:38:55.896 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.895+0000 7ff43ea00640 1 -- 172.21.15.120:0/3009096108 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 68) ==== 8378+0+0 (secure 0 0 0) 0x7ff4580c5480 con 0x56120cdba4d0 2024-05-14T09:38:55.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.896+0000 7ff466d6a740 10 client.36731 fetch_fsmap finished waiting for FSMap version 68 2024-05-14T09:38:55.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.896+0000 7ff466d6a740 10 client.36731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:55.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.896+0000 7ff466d6a740 20 client.36731 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:55.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.896+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd99d80 0x56120d1944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.896+0000 7ff466d6a740 4 client.36731 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:38:55.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.896+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56120d0ef160 con 0x56120cd99d80 2024-05-14T09:38:55.897 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.897+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd99d80 0x56120d1944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.899+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd99d80 0x56120d1944c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a4169752fe00976 server_cookie=2b1956b1ecb0d4f6 in_seq=0 out_seq=0 2024-05-14T09:38:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.900+0000 7ff43ea00640 10 client.36731 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.901+0000 7ff43ea00640 1 -- 172.21.15.120:0/3009096108 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56120d0ef160 con 0x56120cd99d80 2024-05-14T09:38:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.901+0000 7ff43ea00640 10 client.36731 handle_command_reply: tid=0 2024-05-14T09:38:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 client.36731 shutdown 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdba4d0 msgr2=0x56120d187260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdba4d0 0x56120d187260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4580687c0 tx=0x7ff458068de0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 shutdown_connections 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd99d80 0x56120d1944c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 0x56120d18e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdba4d0 0x56120d187260 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3009096108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdb22f0 0x56120d186d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.902+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 >> 172.21.15.120:0/3009096108 conn(0x56120cdcf300 msgr2=0x56120d17bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.903+0000 7ff43ea00640 0 client.36731 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.903+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 shutdown_connections 2024-05-14T09:38:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.903+0000 7ff466d6a740 1 -- 172.21.15.120:0/3009096108 wait complete. 2024-05-14T09:38:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.904+0000 7ff466d6a740 20 client.36731 trim_cache size 0 max 16384 2024-05-14T09:38:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.943+0000 7ff466d6a740 1 Processor -- start 2024-05-14T09:38:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.944+0000 7ff466d6a740 1 -- start start 2024-05-14T09:38:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.944+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d178d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.944+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdba4d0 0x56120d18e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.944+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 0x56120d177960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.944+0000 7ff466d6a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff43800fc90 con 0x56120cddb1b0 2024-05-14T09:38:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.944+0000 7ff466d6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff438011890 con 0x56120cdb22f0 2024-05-14T09:38:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.944+0000 7ff466d6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff438010360 con 0x56120cdba4d0 2024-05-14T09:38:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.945+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d178d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.945+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d178d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40596/0 (socket says 172.21.15.120:40596) 2024-05-14T09:38:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.945+0000 7ff45ca00640 1 -- 172.21.15.120:0/1958340268 learned_addr learned my addr 172.21.15.120:0/1958340268 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.945+0000 7ff45d400640 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdba4d0 0x56120d18e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.946+0000 7ff45d400640 1 -- 172.21.15.120:0/1958340268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 msgr2=0x56120d178d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.946+0000 7ff45d400640 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d178d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.946+0000 7ff45d400640 1 -- 172.21.15.120:0/1958340268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 msgr2=0x56120d177960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.946+0000 7ff45d400640 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 0x56120d177960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.946+0000 7ff45d400640 1 -- 172.21.15.120:0/1958340268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120d17d950 con 0x56120cdba4d0 2024-05-14T09:38:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.946+0000 7ff45d400640 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdba4d0 0x56120d18e0e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff458052220 tx=0x7ff4580b8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d891d3f2399fca3c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.947+0000 7ff449c00640 1 -- 172.21.15.120:0/1958340268 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4580a0c60 con 0x56120cdba4d0 2024-05-14T09:38:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.947+0000 7ff449c00640 1 -- 172.21.15.120:0/1958340268 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4580a4070 con 0x56120cdba4d0 2024-05-14T09:38:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.947+0000 7ff449c00640 1 -- 172.21.15.120:0/1958340268 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4580c5930 con 0x56120cdba4d0 2024-05-14T09:38:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 -- 172.21.15.120:0/1958340268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdba4d0 msgr2=0x56120d18e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdba4d0 0x56120d18e0e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff458052220 tx=0x7ff4580b8000 comp rx=0 tx=0).stop 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 -- 172.21.15.120:0/1958340268 shutdown_connections 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cddb1b0 0x56120d177960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cdba4d0 0x56120d18e0e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 --2- 172.21.15.120:0/1958340268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d178d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 -- 172.21.15.120:0/1958340268 >> 172.21.15.120:0/1958340268 conn(0x56120cdcf300 msgr2=0x56120d177250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 -- 172.21.15.120:0/1958340268 shutdown_connections 2024-05-14T09:38:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.949+0000 7ff466d6a740 1 -- 172.21.15.120:0/1958340268 wait complete. 2024-05-14T09:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.950+0000 7ff466d6a740 1 -- start start 2024-05-14T09:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.950+0000 7ff466d6a740 1 Processor -- start 2024-05-14T09:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.951+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d18cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.951+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d18d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.951+0000 7ff466d6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d18d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.951+0000 7ff466d6a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff438011100 con 0x56120cdba4d0 2024-05-14T09:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.951+0000 7ff466d6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff438010a30 con 0x56120cdb22f0 2024-05-14T09:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.951+0000 7ff466d6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff43800dc90 con 0x56120cddb1b0 2024-05-14T09:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.951+0000 7ff466d6a740 10 client.0 _ll_register_callbacks cb 0x7ff4580a0860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d18d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d18d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41804/0 (socket says 172.21.15.120:41804) 2024-05-14T09:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45d400640 1 -- 172.21.15.120:0/3510980044 learned_addr learned my addr 172.21.15.120:0/3510980044 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d18d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d18cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45ca00640 1 -- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 msgr2=0x56120d18cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d18cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45ca00640 1 -- 172.21.15.120:0/3510980044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 msgr2=0x56120d18d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d18d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.952+0000 7ff45ca00640 1 -- 172.21.15.120:0/3510980044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120d1fa9f0 con 0x56120cddb1b0 2024-05-14T09:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.953+0000 7ff45ca00640 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d18d5b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff44c000c00 tx=0x7ff44c005bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d317e82640d1179 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.953+0000 7ff43ea00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:38:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.954+0000 7ff43ea00640 1 -- 172.21.15.120:0/3510980044 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c005020 con 0x56120cddb1b0 2024-05-14T09:38:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.954+0000 7ff43ea00640 1 -- 172.21.15.120:0/3510980044 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff44c0051c0 con 0x56120cddb1b0 2024-05-14T09:38:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.954+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4580a4070 con 0x56120cddb1b0 2024-05-14T09:38:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.955+0000 7ff43ea00640 1 -- 172.21.15.120:0/3510980044 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ff44c030050 con 0x56120cddb1b0 2024-05-14T09:38:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.955+0000 7ff466d6a740 10 client.26800 fetch_fsmap learned FSMap version 68 2024-05-14T09:38:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.955+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x56120d1fbd50 con 0x56120cddb1b0 2024-05-14T09:38:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.955+0000 7ff43ea00640 1 -- 172.21.15.120:0/3510980044 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4580a4070 con 0x56120cddb1b0 2024-05-14T09:38:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.956+0000 7ff43ea00640 1 -- 172.21.15.120:0/3510980044 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 68) ==== 8378+0+0 (secure 0 0 0) 0x7ff44c01b070 con 0x56120cddb1b0 2024-05-14T09:38:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.956+0000 7ff466d6a740 10 client.26800 fetch_fsmap finished waiting for FSMap version 68 2024-05-14T09:38:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.956+0000 7ff466d6a740 10 client.26800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:38:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.956+0000 7ff466d6a740 20 client.26800 populate_metadata read hostname 'smithi120' 2024-05-14T09:38:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.956+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd6f1c0 0x56120d1fe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:38:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.956+0000 7ff466d6a740 4 client.26800 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:38:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.956+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56120d0e8fd0 con 0x56120cd6f1c0 2024-05-14T09:38:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.957+0000 7ff45d400640 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd6f1c0 0x56120d1fe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:38:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.959+0000 7ff45d400640 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd6f1c0 0x56120d1fe780 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958f0344ea05a5e6 server_cookie=fb112f6ade3f4999 in_seq=0 out_seq=0 2024-05-14T09:38:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:55.959+0000 7ff43ea00640 10 client.26800 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff43ea00640 1 -- 172.21.15.120:0/3510980044 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56120d0e8fd0 con 0x56120cd6f1c0 2024-05-14T09:38:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff43ea00640 10 client.26800 handle_command_reply: tid=0 2024-05-14T09:38:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 client.26800 shutdown 2024-05-14T09:38:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 msgr2=0x56120d18d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d18d5b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff44c000c00 tx=0x7ff44c005bf0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 shutdown_connections 2024-05-14T09:38:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56120cd6f1c0 0x56120d1fe780 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56120cddb1b0 0x56120d18d5b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56120cdba4d0 0x56120d18d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 --2- 172.21.15.120:0/3510980044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56120cdb22f0 0x56120d18cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 >> 172.21.15.120:0/3510980044 conn(0x56120cdcf300 msgr2=0x56120d17c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.032+0000 7ff43ea00640 0 client.26800 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:38:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.034+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 shutdown_connections 2024-05-14T09:38:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.034+0000 7ff466d6a740 1 -- 172.21.15.120:0/3510980044 wait complete. 2024-05-14T09:38:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.035+0000 7ff466d6a740 20 client.26800 trim_cache size 0 max 16384 2024-05-14T09:38:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:38:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:38:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:38:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:38:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.037+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff4400b2870 msgr2=0x7ff4400b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.037+0000 7ff45e800640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff4400b2870 0x7ff4400b4d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e940 tx=0x7ff4440046c0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.037+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45009eb10 msgr2=0x7ff4501433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:38:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.037+0000 7ff45e800640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45009eb10 0x7ff4501433e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e970 tx=0x7ff44400ee30 comp rx=0 tx=0).stop 2024-05-14T09:38:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.037+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 shutdown_connections 2024-05-14T09:38:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.037+0000 7ff45e800640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff4400b2870 0x7ff4400b4d80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.038+0000 7ff45e800640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45009eb10 0x7ff4501433e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.038+0000 7ff45e800640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff450099e10 0x7ff45012b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.038+0000 7ff45e800640 1 --2- 172.21.15.120:0/2961122581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff450098bd0 0x7ff45012ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:38:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.038+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 >> 172.21.15.120:0/2961122581 conn(0x7ff450093de0 msgr2=0x7ff45009aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:38:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.038+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 shutdown_connections 2024-05-14T09:38:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:38:56.039+0000 7ff45e800640 1 -- 172.21.15.120:0/2961122581 wait complete. 2024-05-14T09:38:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:56 smithi175 ceph-mon[35353]: pgmap v1017: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 676 op/s 2024-05-14T09:38:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:56 smithi120 ceph-mon[31085]: pgmap v1017: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 676 op/s 2024-05-14T09:38:56.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:56 smithi152 ceph-mon[34868]: pgmap v1017: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 676 op/s 2024-05-14T09:38:58.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:38:58 smithi175 ceph-mon[35353]: pgmap v1018: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.6 MiB/s wr, 671 op/s 2024-05-14T09:38:58.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:38:58 smithi120 ceph-mon[31085]: pgmap v1018: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.6 MiB/s wr, 671 op/s 2024-05-14T09:38:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:38:58 smithi152 ceph-mon[34868]: pgmap v1018: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.6 MiB/s wr, 671 op/s 2024-05-14T09:38:59.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 685.0 s, 378.6 tps, lat 270.253 ms stddev 246.357 2024-05-14T09:39:00.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:00 smithi120 ceph-mon[31085]: pgmap v1019: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 MiB/s wr, 739 op/s 2024-05-14T09:39:00.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:00 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:39:00.707 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:00 smithi152 ceph-mon[34868]: pgmap v1019: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 MiB/s wr, 739 op/s 2024-05-14T09:39:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:00 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:39:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:00 smithi175 ceph-mon[35353]: pgmap v1019: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 MiB/s wr, 739 op/s 2024-05-14T09:39:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:00 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:39:02.255 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:02 smithi175 ceph-mon[35353]: pgmap v1020: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 653 op/s 2024-05-14T09:39:02.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:02 smithi120 ceph-mon[31085]: pgmap v1020: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 653 op/s 2024-05-14T09:39:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:02 smithi152 ceph-mon[34868]: pgmap v1020: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 653 op/s 2024-05-14T09:39:03.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:03 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:39:03.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:03 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:39:03.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:03 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:39:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 690.0 s, 459.0 tps, lat 135.891 ms stddev 67.182 2024-05-14T09:39:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:04 smithi120 ceph-mon[31085]: pgmap v1021: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 659 op/s 2024-05-14T09:39:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:04 smithi152 ceph-mon[34868]: pgmap v1021: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 659 op/s 2024-05-14T09:39:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:04 smithi175 ceph-mon[35353]: pgmap v1021: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 659 op/s 2024-05-14T09:39:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:05 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:39:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:05 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:05 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:39:05.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:05 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:05 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:39:05.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:05.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:05 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:06 smithi120 ceph-mon[31085]: pgmap v1022: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-05-14T09:39:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:06 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:06.707 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:06 smithi152 ceph-mon[34868]: pgmap v1022: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-05-14T09:39:06.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:06 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:06.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:06 smithi175 ceph-mon[35353]: pgmap v1022: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-05-14T09:39:06.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:06 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:39:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:39:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:07 smithi120 ceph-mon[31085]: pgmap v1023: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 670 op/s 2024-05-14T09:39:07.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:39:07.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:39:07.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:07.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:07 smithi152 ceph-mon[34868]: pgmap v1023: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 670 op/s 2024-05-14T09:39:07.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:39:07.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:39:07.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:39:07.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:07 smithi175 ceph-mon[35353]: pgmap v1023: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 670 op/s 2024-05-14T09:39:09.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 695.0 s, 447.2 tps, lat 306.671 ms stddev 939.725 2024-05-14T09:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.419+0000 7fc63f800640 1 -- 172.21.15.120:0/2738800464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638102b40 msgr2=0x7fc638103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.419+0000 7fc63f800640 1 --2- 172.21.15.120:0/2738800464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638102b40 0x7fc638103840 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc62c01a990 tx=0x7fc62c03d660 comp rx=0 tx=0).stop 2024-05-14T09:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.420+0000 7fc63f800640 1 -- 172.21.15.120:0/2738800464 shutdown_connections 2024-05-14T09:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.420+0000 7fc63f800640 1 --2- 172.21.15.120:0/2738800464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc638108a80 0x7fc63810aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.420+0000 7fc63f800640 1 --2- 172.21.15.120:0/2738800464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638103d80 0x7fc638104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.420+0000 7fc63f800640 1 --2- 172.21.15.120:0/2738800464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638102b40 0x7fc638103840 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.420+0000 7fc63f800640 1 -- 172.21.15.120:0/2738800464 >> 172.21.15.120:0/2738800464 conn(0x7fc6380fdd30 msgr2=0x7fc6381001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.420+0000 7fc63f800640 1 -- 172.21.15.120:0/2738800464 shutdown_connections 2024-05-14T09:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.421+0000 7fc63f800640 1 -- 172.21.15.120:0/2738800464 wait complete. 2024-05-14T09:39:09.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.422+0000 7fc63f800640 1 Processor -- start 2024-05-14T09:39:09.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.423+0000 7fc63f800640 1 -- start start 2024-05-14T09:39:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.423+0000 7fc63f800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638102b40 0x7fc638070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.423+0000 7fc63f800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638103d80 0x7fc638071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.423+0000 7fc63f800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc638108a80 0x7fc638112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.423+0000 7fc63f800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc638073440 con 0x7fc638103d80 2024-05-14T09:39:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.423+0000 7fc63f800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6380732c0 con 0x7fc638102b40 2024-05-14T09:39:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.423+0000 7fc63f800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6380735c0 con 0x7fc638108a80 2024-05-14T09:39:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.424+0000 7fc637e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638103d80 0x7fc638071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.424+0000 7fc63ce00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638102b40 0x7fc638070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.424+0000 7fc63ce00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638102b40 0x7fc638070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48188/0 (socket says 172.21.15.120:48188) 2024-05-14T09:39:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.424+0000 7fc63ce00640 1 -- 172.21.15.120:0/3639011274 learned_addr learned my addr 172.21.15.120:0/3639011274 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.424+0000 7fc63d800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc638108a80 0x7fc638112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.425+0000 7fc63ce00640 1 -- 172.21.15.120:0/3639011274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc638108a80 msgr2=0x7fc638112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.425+0000 7fc63ce00640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc638108a80 0x7fc638112090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.425+0000 7fc63ce00640 1 -- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638103d80 msgr2=0x7fc638071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.425+0000 7fc63ce00640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638103d80 0x7fc638071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.425+0000 7fc63ce00640 1 -- 172.21.15.120:0/3639011274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc638112700 con 0x7fc638102b40 2024-05-14T09:39:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.426+0000 7fc637e00640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638103d80 0x7fc638071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:39:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.426+0000 7fc63ce00640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638102b40 0x7fc638070f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc62c004d10 tx=0x7fc62c0050a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.426+0000 7fc635600640 1 -- 172.21.15.120:0/3639011274 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c050020 con 0x7fc638102b40 2024-05-14T09:39:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.427+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc638112990 con 0x7fc638102b40 2024-05-14T09:39:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.427+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc638112ed0 con 0x7fc638102b40 2024-05-14T09:39:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.427+0000 7fc635600640 1 -- 172.21.15.120:0/3639011274 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc62c0429a0 con 0x7fc638102b40 2024-05-14T09:39:09.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.427+0000 7fc635600640 1 -- 172.21.15.120:0/3639011274 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c048030 con 0x7fc638102b40 2024-05-14T09:39:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.435+0000 7fc64679c740 1 Processor -- start 2024-05-14T09:39:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.435+0000 7fc64679c740 1 -- start start 2024-05-14T09:39:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.436+0000 7fc64679c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x563296225100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.436+0000 7fc64679c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e5a2f0 0x563296225680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.436+0000 7fc64679c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e624d0 0x56329622c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.436+0000 7fc64679c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563296189550 con 0x563295e5a2f0 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.436+0000 7fc64679c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56329612ebc0 con 0x563295e831b0 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.436+0000 7fc64679c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563296185510 con 0x563295e624d0 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc63d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x563296225100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc637e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e624d0 0x56329622c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc63d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x563296225100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48192/0 (socket says 172.21.15.120:48192) 2024-05-14T09:39:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc63d800640 1 -- 172.21.15.120:0/3932536562 learned_addr learned my addr 172.21.15.120:0/3932536562 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc635600640 1 -- 172.21.15.120:0/3639011274 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fc62c053020 con 0x7fc638102b40 2024-05-14T09:39:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc637e00640 1 -- 172.21.15.120:0/3932536562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 msgr2=0x563296225100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc63ce00640 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e5a2f0 0x563296225680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc637e00640 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x563296225100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc637e00640 1 -- 172.21.15.120:0/3932536562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e5a2f0 msgr2=0x563296225680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc637e00640 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e5a2f0 0x563296225680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.437+0000 7fc637e00640 1 -- 172.21.15.120:0/3932536562 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563295e9b210 con 0x563295e624d0 2024-05-14T09:39:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.438+0000 7fc63d800640 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x563296225100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:39:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.438+0000 7fc63ce00640 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e5a2f0 0x563296225680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:39:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.438+0000 7fc637e00640 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e624d0 0x56329622c580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc624005d00 tx=0x7fc624010930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f0f720841f7951 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.439+0000 7fc62a000640 1 -- 172.21.15.120:0/3932536562 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624011760 con 0x563295e624d0 2024-05-14T09:39:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.439+0000 7fc62a000640 1 -- 172.21.15.120:0/3932536562 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc624011d90 con 0x563295e624d0 2024-05-14T09:39:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.439+0000 7fc62a000640 1 -- 172.21.15.120:0/3932536562 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62401cdf0 con 0x563295e624d0 2024-05-14T09:39:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.440+0000 7fc635600640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc6200b28e0 0x7fc6200b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.440+0000 7fc635600640 1 -- 172.21.15.120:0/3639011274 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc62c113cf0 con 0x7fc638102b40 2024-05-14T09:39:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.441+0000 7fc64679c740 1 -- 172.21.15.120:0/3932536562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e624d0 msgr2=0x56329622c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.441+0000 7fc64679c740 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e624d0 0x56329622c580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc624005d00 tx=0x7fc624010930 comp rx=0 tx=0).stop 2024-05-14T09:39:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.446+0000 7fc64679c740 1 -- 172.21.15.120:0/3932536562 shutdown_connections 2024-05-14T09:39:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.446+0000 7fc64679c740 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e624d0 0x56329622c580 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.446+0000 7fc64679c740 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e5a2f0 0x563296225680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.446+0000 7fc64679c740 1 --2- 172.21.15.120:0/3932536562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x563296225100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.446+0000 7fc64679c740 1 -- 172.21.15.120:0/3932536562 >> 172.21.15.120:0/3932536562 conn(0x563295e77300 msgr2=0x563296220a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.447+0000 7fc63d800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc6200b28e0 0x7fc6200b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.448+0000 7fc64679c740 1 -- 172.21.15.120:0/3932536562 shutdown_connections 2024-05-14T09:39:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.450+0000 7fc64679c740 1 -- 172.21.15.120:0/3932536562 wait complete. 2024-05-14T09:39:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.451+0000 7fc64679c740 1 -- start start 2024-05-14T09:39:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.451+0000 7fc63d800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc6200b28e0 0x7fc6200b4df0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5632962262d0 tx=0x7fc630009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.452+0000 7fc64679c740 1 Processor -- start 2024-05-14T09:39:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.453+0000 7fc64679c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x56329622ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.453+0000 7fc64679c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x56329622f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.453+0000 7fc64679c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x5632962360c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.453+0000 7fc64679c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56329622cfd0 con 0x563295e624d0 2024-05-14T09:39:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.453+0000 7fc64679c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563296142660 con 0x563295e831b0 2024-05-14T09:39:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.453+0000 7fc64679c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56329622d150 con 0x563295e5a2f0 2024-05-14T09:39:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.453+0000 7fc64679c740 10 client.0 _ll_register_callbacks cb 0x56329610c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.454+0000 7fc63ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x56329622ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.454+0000 7fc63ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x56329622ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:48676/0 (socket says 172.21.15.120:48676) 2024-05-14T09:39:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.454+0000 7fc63ce00640 1 -- 172.21.15.120:0/1421848329 learned_addr learned my addr 172.21.15.120:0/1421848329 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.455+0000 7fc63ce00640 1 -- 172.21.15.120:0/1421848329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 msgr2=0x5632962360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.455+0000 7fc63ce00640 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x5632962360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.455+0000 7fc63ce00640 1 -- 172.21.15.120:0/1421848329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 msgr2=0x56329622f160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.458+0000 7fc637e00640 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x56329622f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.458+0000 7fc63ce00640 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x56329622f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.458+0000 7fc63ce00640 1 -- 172.21.15.120:0/1421848329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563295f67620 con 0x563295e5a2f0 2024-05-14T09:39:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.458+0000 7fc63ce00640 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x56329622ec20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0dac10 tx=0x7fc62c0da920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28b08e8a9bfac092 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.459+0000 7fc61ea00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:39:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.459+0000 7fc61ea00640 1 -- 172.21.15.120:0/1421848329 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c042e70 con 0x563295e5a2f0 2024-05-14T09:39:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.459+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc624011d90 con 0x563295e5a2f0 2024-05-14T09:39:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.459+0000 7fc61ea00640 1 -- 172.21.15.120:0/1421848329 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc62c0d71a0 con 0x563295e5a2f0 2024-05-14T09:39:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.460+0000 7fc61ea00640 1 -- 172.21.15.120:0/1421848329 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fc62c0daa20 con 0x563295e5a2f0 2024-05-14T09:39:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.460+0000 7fc64679c740 10 client.26812 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.460+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x56329622cfd0 con 0x563295e5a2f0 2024-05-14T09:39:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.461+0000 7fc61ea00640 1 -- 172.21.15.120:0/1421848329 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc624011d90 con 0x563295e5a2f0 2024-05-14T09:39:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.461+0000 7fc61ea00640 1 -- 172.21.15.120:0/1421848329 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7fc62c01f040 con 0x563295e5a2f0 2024-05-14T09:39:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.461+0000 7fc64679c740 10 client.26812 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.462+0000 7fc64679c740 10 client.26812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.462+0000 7fc64679c740 20 client.26812 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.462+0000 7fc64679c740 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e41d80 0x56329623c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.462+0000 7fc64679c740 4 client.26812 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:39:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.462+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563296197160 con 0x563295e41d80 2024-05-14T09:39:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.463+0000 7fc637e00640 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e41d80 0x56329623c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.465+0000 7fc637e00640 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e41d80 0x56329623c720 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a67a7132c76a978 server_cookie=74917589a133160f in_seq=0 out_seq=0 2024-05-14T09:39:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.465+0000 7fc61ea00640 10 client.26812 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.468+0000 7fc61ea00640 1 -- 172.21.15.120:0/1421848329 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563296197160 con 0x563295e41d80 2024-05-14T09:39:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.469+0000 7fc61ea00640 10 client.26812 handle_command_reply: tid=0 2024-05-14T09:39:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.469+0000 7fc64679c740 1 client.26812 shutdown 2024-05-14T09:39:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.472+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 msgr2=0x56329622ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.472+0000 7fc64679c740 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x56329622ec20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0dac10 tx=0x7fc62c0da920 comp rx=0 tx=0).stop 2024-05-14T09:39:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.473+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 shutdown_connections 2024-05-14T09:39:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.473+0000 7fc64679c740 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e41d80 0x56329623c720 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.473+0000 7fc64679c740 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e831b0 0x5632962360c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.473+0000 7fc64679c740 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x56329622f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.473+0000 7fc64679c740 1 --2- 172.21.15.120:0/1421848329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x56329622ec20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.473+0000 7fc61ea00640 0 client.26812 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.473+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 >> 172.21.15.120:0/1421848329 conn(0x563295e77300 msgr2=0x56329621fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.474+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 shutdown_connections 2024-05-14T09:39:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.474+0000 7fc64679c740 1 -- 172.21.15.120:0/1421848329 wait complete. 2024-05-14T09:39:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.475+0000 7fc64679c740 20 client.26812 trim_cache size 0 max 16384 2024-05-14T09:39:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.517+0000 7fc64679c740 1 Processor -- start 2024-05-14T09:39:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.517+0000 7fc64679c740 1 -- start start 2024-05-14T09:39:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.518+0000 7fc64679c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e77300 0x563296240f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.518+0000 7fc64679c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e5a2f0 0x563296236050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.518+0000 7fc64679c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296236590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.518+0000 7fc64679c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc6381b3160 con 0x563295e624d0 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.518+0000 7fc64679c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6381b4dc0 con 0x563295e5a2f0 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.518+0000 7fc64679c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6381b3830 con 0x563295e77300 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.518+0000 7fc63d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296236590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296236590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34348/0 (socket says 172.21.15.120:34348) 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63d800640 1 -- 172.21.15.120:0/2725007575 learned_addr learned my addr 172.21.15.120:0/2725007575 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc637e00640 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e5a2f0 0x563296236050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63ce00640 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e77300 0x563296240f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63d800640 1 -- 172.21.15.120:0/2725007575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e77300 msgr2=0x563296240f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63d800640 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e77300 0x563296240f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63d800640 1 -- 172.21.15.120:0/2725007575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e5a2f0 msgr2=0x563296236050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63d800640 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e5a2f0 0x563296236050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.519+0000 7fc63d800640 1 -- 172.21.15.120:0/2725007575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563296225ed0 con 0x563295e624d0 2024-05-14T09:39:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.520+0000 7fc63d800640 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296236590 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc630011700 tx=0x7fc630015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac54e5e9424561c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.521+0000 7fc629600640 1 -- 172.21.15.120:0/2725007575 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63001f7b0 con 0x563295e624d0 2024-05-14T09:39:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.521+0000 7fc629600640 1 -- 172.21.15.120:0/2725007575 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc63001fde0 con 0x563295e624d0 2024-05-14T09:39:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.521+0000 7fc629600640 1 -- 172.21.15.120:0/2725007575 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63001f7b0 con 0x563295e624d0 2024-05-14T09:39:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.523+0000 7fc64679c740 1 -- 172.21.15.120:0/2725007575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 msgr2=0x563296236590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.523+0000 7fc64679c740 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296236590 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc630011700 tx=0x7fc630015040 comp rx=0 tx=0).stop 2024-05-14T09:39:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.525+0000 7fc64679c740 1 -- 172.21.15.120:0/2725007575 shutdown_connections 2024-05-14T09:39:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.525+0000 7fc64679c740 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296236590 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.525+0000 7fc64679c740 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e5a2f0 0x563296236050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.525+0000 7fc64679c740 1 --2- 172.21.15.120:0/2725007575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e77300 0x563296240f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.525+0000 7fc64679c740 1 -- 172.21.15.120:0/2725007575 >> 172.21.15.120:0/2725007575 conn(0x56329622f330 msgr2=0x5632962242c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.526+0000 7fc64679c740 1 -- 172.21.15.120:0/2725007575 shutdown_connections 2024-05-14T09:39:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.527+0000 7fc64679c740 1 -- 172.21.15.120:0/2725007575 wait complete. 2024-05-14T09:39:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.527+0000 7fc64679c740 1 -- start start 2024-05-14T09:39:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.528+0000 7fc64679c740 1 Processor -- start 2024-05-14T09:39:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.528+0000 7fc64679c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x5632962356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc64679c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296235c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc64679c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e77300 0x5632962a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc64679c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc6381b4630 con 0x563295e624d0 2024-05-14T09:39:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc64679c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6381b3f00 con 0x563295e77300 2024-05-14T09:39:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc64679c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6381b1100 con 0x563295e5a2f0 2024-05-14T09:39:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc64679c740 10 client.0 _ll_register_callbacks cb 0x7fc62c0dace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc63d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e77300 0x5632962a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc63d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e77300 0x5632962a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48222/0 (socket says 172.21.15.120:48222) 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc63d800640 1 -- 172.21.15.120:0/243324207 learned_addr learned my addr 172.21.15.120:0/243324207 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.529+0000 7fc63ce00640 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x5632962356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.530+0000 7fc637e00640 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296235c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.530+0000 7fc63d800640 1 -- 172.21.15.120:0/243324207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 msgr2=0x5632962356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.530+0000 7fc63d800640 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x5632962356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.530+0000 7fc63d800640 1 -- 172.21.15.120:0/243324207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 msgr2=0x563296235c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.530+0000 7fc63d800640 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296235c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.530+0000 7fc63d800640 1 -- 172.21.15.120:0/243324207 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632962a3110 con 0x563295e77300 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.531+0000 7fc63d800640 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e77300 0x5632962a2b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc63002a040 tx=0x7fc630020ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=638592929e9f042d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.531+0000 7fc61ea00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:39:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.531+0000 7fc61ea00640 1 -- 172.21.15.120:0/243324207 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630035020 con 0x563295e77300 2024-05-14T09:39:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.531+0000 7fc61ea00640 1 -- 172.21.15.120:0/243324207 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc63001f5b0 con 0x563295e77300 2024-05-14T09:39:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.531+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc63001fde0 con 0x563295e77300 2024-05-14T09:39:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc61ea00640 1 -- 172.21.15.120:0/243324207 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fc630004e50 con 0x563295e77300 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 10 client.36752 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x5632962a4380 con 0x563295e77300 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc61ea00640 1 -- 172.21.15.120:0/243324207 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc63001fde0 con 0x563295e77300 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc61ea00640 1 -- 172.21.15.120:0/243324207 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7fc63000f040 con 0x563295e77300 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 10 client.36752 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 10 client.36752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 20 client.36752 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e831b0 0x5632962a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 4 client.36752 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.532+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563296190fd0 con 0x563295e831b0 2024-05-14T09:39:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.533+0000 7fc63ce00640 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e831b0 0x5632962a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.536+0000 7fc61ea00640 10 client.36752 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.536+0000 7fc63ce00640 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e831b0 0x5632962a6e10 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbef34f6db431613 server_cookie=296f1133cfe9012f in_seq=0 out_seq=0 2024-05-14T09:39:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.558+0000 7fc61ea00640 1 -- 172.21.15.120:0/243324207 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563296190fd0 con 0x563295e831b0 2024-05-14T09:39:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.558+0000 7fc61ea00640 10 client.36752 handle_command_reply: tid=0 2024-05-14T09:39:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.558+0000 7fc64679c740 1 client.36752 shutdown 2024-05-14T09:39:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.559+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e77300 msgr2=0x5632962a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.559+0000 7fc64679c740 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e77300 0x5632962a2b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc63002a040 tx=0x7fc630020ea0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.560+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 shutdown_connections 2024-05-14T09:39:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.560+0000 7fc64679c740 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563295e831b0 0x5632962a6e10 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.560+0000 7fc64679c740 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563295e77300 0x5632962a2b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.560+0000 7fc64679c740 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563295e624d0 0x563296235c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.560+0000 7fc64679c740 1 --2- 172.21.15.120:0/243324207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563295e5a2f0 0x5632962356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.560+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 >> 172.21.15.120:0/243324207 conn(0x56329622f330 msgr2=0x56329622df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.560+0000 7fc61ea00640 0 client.36752 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.561+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 shutdown_connections 2024-05-14T09:39:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.561+0000 7fc64679c740 1 -- 172.21.15.120:0/243324207 wait complete. 2024-05-14T09:39:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.561+0000 7fc64679c740 20 client.36752 trim_cache size 0 max 16384 2024-05-14T09:39:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:39:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:39:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:39:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:39:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc6200b28e0 msgr2=0x7fc6200b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc6200b28e0 0x7fc6200b4df0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5632962262d0 tx=0x7fc630009600 comp rx=0 tx=0).stop 2024-05-14T09:39:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638102b40 msgr2=0x7fc638070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638102b40 0x7fc638070f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc62c004d10 tx=0x7fc62c0050a0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 shutdown_connections 2024-05-14T09:39:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc6200b28e0 0x7fc6200b4df0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc638108a80 0x7fc638112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc638103d80 0x7fc638071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 --2- 172.21.15.120:0/3639011274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc638102b40 0x7fc638070f40 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc62c004d10 tx=0x7fc62c0050a0 comp rx=0 tx=0).stop 2024-05-14T09:39:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.565+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 >> 172.21.15.120:0/3639011274 conn(0x7fc6380fdd30 msgr2=0x7fc638100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.566+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 shutdown_connections 2024-05-14T09:39:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:09.566+0000 7fc63f800640 1 -- 172.21.15.120:0/3639011274 wait complete. 2024-05-14T09:39:10.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:10 smithi120 ceph-mon[31085]: pgmap v1024: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 680 op/s 2024-05-14T09:39:10.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:10 smithi152 ceph-mon[34868]: pgmap v1024: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 680 op/s 2024-05-14T09:39:10.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:10 smithi175 ceph-mon[35353]: pgmap v1024: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 680 op/s 2024-05-14T09:39:12.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:12 smithi120 ceph-mon[31085]: pgmap v1025: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 636 op/s 2024-05-14T09:39:12.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:12 smithi152 ceph-mon[34868]: pgmap v1025: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 636 op/s 2024-05-14T09:39:12.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:12 smithi175 ceph-mon[35353]: pgmap v1025: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 636 op/s 2024-05-14T09:39:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 700.0 s, 560.6 tps, lat 175.749 ms stddev 101.892 2024-05-14T09:39:14.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:14 smithi120 ceph-mon[31085]: pgmap v1026: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.8 MiB/s wr, 634 op/s 2024-05-14T09:39:14.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:14 smithi152 ceph-mon[34868]: pgmap v1026: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.8 MiB/s wr, 634 op/s 2024-05-14T09:39:14.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:14 smithi175 ceph-mon[35353]: pgmap v1026: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.8 MiB/s wr, 634 op/s 2024-05-14T09:39:16.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:16 smithi120 ceph-mon[31085]: pgmap v1027: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 639 op/s 2024-05-14T09:39:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:16 smithi152 ceph-mon[34868]: pgmap v1027: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 639 op/s 2024-05-14T09:39:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:16 smithi175 ceph-mon[35353]: pgmap v1027: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 639 op/s 2024-05-14T09:39:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:18 smithi120 ceph-mon[31085]: pgmap v1028: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-05-14T09:39:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:18 smithi152 ceph-mon[34868]: pgmap v1028: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-05-14T09:39:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:18 smithi175 ceph-mon[35353]: pgmap v1028: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-05-14T09:39:19.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 705.0 s, 420.8 tps, lat 240.477 ms stddev 180.511 2024-05-14T09:39:20.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:20 smithi120 ceph-mon[31085]: pgmap v1029: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-05-14T09:39:20.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:20 smithi152 ceph-mon[34868]: pgmap v1029: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-05-14T09:39:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:20 smithi175 ceph-mon[35353]: pgmap v1029: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-05-14T09:39:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:22 smithi120 ceph-mon[31085]: pgmap v1030: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-05-14T09:39:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:22 smithi152 ceph-mon[34868]: pgmap v1030: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-05-14T09:39:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:22 smithi175 ceph-mon[35353]: pgmap v1030: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 -- 172.21.15.120:0/3758992335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372410f890 msgr2=0x7f3724111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 --2- 172.21.15.120:0/3758992335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372410f890 0x7f3724111cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3710009930 tx=0x7f371002a440 comp rx=0 tx=0).stop 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 -- 172.21.15.120:0/3758992335 shutdown_connections 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 --2- 172.21.15.120:0/3758992335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37241121f0 0x7f3724114610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 --2- 172.21.15.120:0/3758992335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372410f890 0x7f3724111cb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 --2- 172.21.15.120:0/3758992335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372410a0f0 0x7f372410a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 -- 172.21.15.120:0/3758992335 >> 172.21.15.120:0/3758992335 conn(0x7f3724070460 msgr2=0x7f3724072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 -- 172.21.15.120:0/3758992335 shutdown_connections 2024-05-14T09:39:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.955+0000 7f3723200640 1 -- 172.21.15.120:0/3758992335 wait complete. 2024-05-14T09:39:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.958+0000 7f3723200640 1 Processor -- start 2024-05-14T09:39:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.958+0000 7f3723200640 1 -- start start 2024-05-14T09:39:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.959+0000 7f3723200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372410a0f0 0x7f37241a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.959+0000 7f3723200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f372410f890 0x7f37241a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.959+0000 7f3723200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37241121f0 0x7f37241b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.959+0000 7f3723200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f372410cff0 con 0x7f372410a0f0 2024-05-14T09:39:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.959+0000 7f3723200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f372410ce70 con 0x7f372410f890 2024-05-14T09:39:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.959+0000 7f3723200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f372410d170 con 0x7f37241121f0 2024-05-14T09:39:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.959+0000 7f3721e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372410a0f0 0x7f37241a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.960+0000 7f3722800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37241121f0 0x7f37241b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.960+0000 7f3722800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37241121f0 0x7f37241b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:47994/0 (socket says 172.21.15.120:47994) 2024-05-14T09:39:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.960+0000 7f3722800640 1 -- 172.21.15.120:0/2372275219 learned_addr learned my addr 172.21.15.120:0/2372275219 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.961+0000 7f3721e00640 1 -- 172.21.15.120:0/2372275219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37241121f0 msgr2=0x7f37241b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.961+0000 7f3721e00640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37241121f0 0x7f37241b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.961+0000 7f3721e00640 1 -- 172.21.15.120:0/2372275219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f372410f890 msgr2=0x7f37241a9480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T09:39:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.961+0000 7f3721e00640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f372410f890 0x7f37241a9480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.961+0000 7f3721e00640 1 -- 172.21.15.120:0/2372275219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37241b0a80 con 0x7f372410a0f0 2024-05-14T09:39:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.962+0000 7f3721e00640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372410a0f0 0x7f37241a8f40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f371c005fd0 tx=0x7f371c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.963+0000 7f371aa00640 1 -- 172.21.15.120:0/2372275219 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c010430 con 0x7f372410a0f0 2024-05-14T09:39:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.963+0000 7f371aa00640 1 -- 172.21.15.120:0/2372275219 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f371c010a60 con 0x7f372410a0f0 2024-05-14T09:39:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.963+0000 7f371aa00640 1 -- 172.21.15.120:0/2372275219 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c010430 con 0x7f372410a0f0 2024-05-14T09:39:22.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.963+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37241b0d70 con 0x7f372410a0f0 2024-05-14T09:39:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.965+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37241b11b0 con 0x7f372410a0f0 2024-05-14T09:39:22.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.971+0000 7f3730036740 1 Processor -- start 2024-05-14T09:39:22.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.972+0000 7f3730036740 1 -- start start 2024-05-14T09:39:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.973+0000 7f3730036740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c1128a1b0 0x556c1162c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.973+0000 7f3730036740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112612f0 0x556c1162c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.973+0000 7f3730036740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c11633780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.973+0000 7f3730036740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556c11590550 con 0x556c112694d0 2024-05-14T09:39:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.973+0000 7f3730036740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556c11535bc0 con 0x556c1128a1b0 2024-05-14T09:39:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.973+0000 7f3730036740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556c1158c510 con 0x556c112612f0 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.974+0000 7f371aa00640 1 -- 172.21.15.120:0/2372275219 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f371c017780 con 0x7f372410a0f0 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.974+0000 7f3721e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112612f0 0x556c1162c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.974+0000 7f3721e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112612f0 0x556c1162c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:47996/0 (socket says 172.21.15.120:47996) 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.974+0000 7f3721e00640 1 -- 172.21.15.120:0/280826072 learned_addr learned my addr 172.21.15.120:0/280826072 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.974+0000 7f3722800640 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c1128a1b0 0x556c1162c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721400640 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c11633780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721e00640 1 -- 172.21.15.120:0/280826072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c1128a1b0 msgr2=0x556c1162c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721e00640 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c1128a1b0 0x556c1162c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721e00640 1 -- 172.21.15.120:0/280826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 msgr2=0x556c11633780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:22.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721e00640 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c11633780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721e00640 1 -- 172.21.15.120:0/280826072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c112a2210 con 0x556c112612f0 2024-05-14T09:39:22.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721400640 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c11633780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:39:22.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.975+0000 7f3721e00640 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112612f0 0x556c1162c880 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f371c0e6c10 tx=0x7f371c0eb6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa5523ed6e02be11 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:22.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.976+0000 7f370f400640 1 -- 172.21.15.120:0/280826072 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0f2070 con 0x556c112612f0 2024-05-14T09:39:22.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.977+0000 7f370f400640 1 -- 172.21.15.120:0/280826072 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f371c0ee900 con 0x556c112612f0 2024-05-14T09:39:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.977+0000 7f370f400640 1 -- 172.21.15.120:0/280826072 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0ed740 con 0x556c112612f0 2024-05-14T09:39:22.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.977+0000 7f371aa00640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37080b2b20 0x7f37080b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.978+0000 7f371aa00640 1 -- 172.21.15.120:0/2372275219 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f371c0e2ce0 con 0x7f372410a0f0 2024-05-14T09:39:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.978+0000 7f3730036740 1 -- 172.21.15.120:0/280826072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112612f0 msgr2=0x556c1162c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.978+0000 7f3730036740 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112612f0 0x556c1162c880 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f371c0e6c10 tx=0x7f371c0eb6c0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.979+0000 7f3722800640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37080b2b20 0x7f37080b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.979+0000 7f3730036740 1 -- 172.21.15.120:0/280826072 shutdown_connections 2024-05-14T09:39:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.979+0000 7f3730036740 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c11633780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.979+0000 7f3730036740 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112612f0 0x556c1162c880 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.979+0000 7f3730036740 1 --2- 172.21.15.120:0/280826072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c1128a1b0 0x556c1162c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.979+0000 7f3730036740 1 -- 172.21.15.120:0/280826072 >> 172.21.15.120:0/280826072 conn(0x556c1127e300 msgr2=0x556c11627c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.980+0000 7f3722800640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37080b2b20 0x7f37080b5030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x556c1162d4d0 tx=0x7f371400c430 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.981+0000 7f3730036740 1 -- 172.21.15.120:0/280826072 shutdown_connections 2024-05-14T09:39:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.981+0000 7f3730036740 1 -- 172.21.15.120:0/280826072 wait complete. 2024-05-14T09:39:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.982+0000 7f3730036740 1 -- start start 2024-05-14T09:39:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.982+0000 7f3730036740 1 Processor -- start 2024-05-14T09:39:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.983+0000 7f3730036740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11635e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.984+0000 7f3730036740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c116363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.984+0000 7f3730036740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c1128a1b0 0x556c1163d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.984+0000 7f3730036740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556c116341d0 con 0x556c112694d0 2024-05-14T09:39:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.984+0000 7f3730036740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556c11549660 con 0x556c112612f0 2024-05-14T09:39:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.984+0000 7f3730036740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556c11634350 con 0x556c1128a1b0 2024-05-14T09:39:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.984+0000 7f3730036740 10 client.0 _ll_register_callbacks cb 0x556c11513400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.984+0000 7f3721e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11635e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.985+0000 7f3722800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c1128a1b0 0x556c1163d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.985+0000 7f3721e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11635e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37210/0 (socket says 172.21.15.120:37210) 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.985+0000 7f3721e00640 1 -- 172.21.15.120:0/3847123352 learned_addr learned my addr 172.21.15.120:0/3847123352 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.986+0000 7f3721e00640 1 -- 172.21.15.120:0/3847123352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c1128a1b0 msgr2=0x556c1163d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.986+0000 7f3721e00640 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c1128a1b0 0x556c1163d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.986+0000 7f3721e00640 1 -- 172.21.15.120:0/3847123352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 msgr2=0x556c116363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.986+0000 7f3721e00640 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c116363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.986+0000 7f3721e00640 1 -- 172.21.15.120:0/3847123352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c1136e620 con 0x556c112612f0 2024-05-14T09:39:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.986+0000 7f3721e00640 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11635e80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f371c0e6be0 tx=0x7f371c0173c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a30b8bf00dc891 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.986+0000 7f3703e00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:39:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.987+0000 7f3703e00640 1 -- 172.21.15.120:0/3847123352 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0e5070 con 0x556c112612f0 2024-05-14T09:39:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.987+0000 7f3703e00640 1 -- 172.21.15.120:0/3847123352 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f371c0e6d00 con 0x556c112612f0 2024-05-14T09:39:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.987+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f371c0ee900 con 0x556c112612f0 2024-05-14T09:39:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.988+0000 7f3703e00640 1 -- 172.21.15.120:0/3847123352 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f371c0f2070 con 0x556c112612f0 2024-05-14T09:39:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.991+0000 7f3730036740 10 client.36758 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.991+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x556c116401c0 con 0x556c112612f0 2024-05-14T09:39:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.991+0000 7f3703e00640 1 -- 172.21.15.120:0/3847123352 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f371c0ee900 con 0x556c112612f0 2024-05-14T09:39:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.993+0000 7f3703e00640 1 -- 172.21.15.120:0/3847123352 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7f371c0ec040 con 0x556c112612f0 2024-05-14T09:39:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.994+0000 7f3730036740 10 client.36758 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.994+0000 7f3730036740 10 client.36758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.994+0000 7f3730036740 20 client.36758 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.994+0000 7f3730036740 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c11248d80 0x556c11643520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.994+0000 7f3730036740 4 client.36758 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:39:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.994+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c1159e160 con 0x556c11248d80 2024-05-14T09:39:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.996+0000 7f3721400640 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c11248d80 0x556c11643520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.999+0000 7f3721400640 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c11248d80 0x556c11643520 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfe537d603d85da8 server_cookie=9a8b1d215c20fa40 in_seq=0 out_seq=0 2024-05-14T09:39:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:22.999+0000 7f3703e00640 10 client.36758 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.001+0000 7f3703e00640 1 -- 172.21.15.120:0/3847123352 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556c1159e160 con 0x556c11248d80 2024-05-14T09:39:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.001+0000 7f3703e00640 10 client.36758 handle_command_reply: tid=0 2024-05-14T09:39:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.001+0000 7f3730036740 1 client.36758 shutdown 2024-05-14T09:39:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 msgr2=0x556c11635e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11635e80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f371c0e6be0 tx=0x7f371c0173c0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 shutdown_connections 2024-05-14T09:39:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c11248d80 0x556c11643520 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c1128a1b0 0x556c1163d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c112694d0 0x556c116363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 --2- 172.21.15.120:0/3847123352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11635e80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 >> 172.21.15.120:0/3847123352 conn(0x556c1127e300 msgr2=0x556c1162aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.002+0000 7f3703e00640 0 client.36758 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.003+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 shutdown_connections 2024-05-14T09:39:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.003+0000 7f3730036740 1 -- 172.21.15.120:0/3847123352 wait complete. 2024-05-14T09:39:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.003+0000 7f3730036740 20 client.36758 trim_cache size 0 max 16384 2024-05-14T09:39:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.054+0000 7f3730036740 1 Processor -- start 2024-05-14T09:39:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.054+0000 7f3730036740 1 -- start start 2024-05-14T09:39:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.056+0000 7f3730036740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11627ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3730036740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c1162aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3730036740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c1162afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3730036740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f37241bb7a0 con 0x556c1128a1b0 2024-05-14T09:39:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3730036740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37241bd400 con 0x556c112612f0 2024-05-14T09:39:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3730036740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37241bbe70 con 0x556c112694d0 2024-05-14T09:39:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3721e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11627ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3721400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c1162aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3721400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c1162aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:48012/0 (socket says 172.21.15.120:48012) 2024-05-14T09:39:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3721e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11627ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37218/0 (socket says 172.21.15.120:37218) 2024-05-14T09:39:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3721e00640 1 -- 172.21.15.120:0/69322570 learned_addr learned my addr 172.21.15.120:0/69322570 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.057+0000 7f3722800640 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c1162afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.059+0000 7f3721400640 1 -- 172.21.15.120:0/69322570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 msgr2=0x556c11627ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.059+0000 7f3721400640 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11627ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.059+0000 7f3721400640 1 -- 172.21.15.120:0/69322570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 msgr2=0x556c1162afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.059+0000 7f3721400640 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c1162afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.059+0000 7f3721400640 1 -- 172.21.15.120:0/69322570 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c116234a0 con 0x556c112694d0 2024-05-14T09:39:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.060+0000 7f3721400640 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c1162aa90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f371002aa30 tx=0x7f3710000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40bc465f8e707f1b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.060+0000 7f370ea00640 1 -- 172.21.15.120:0/69322570 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710046030 con 0x556c112694d0 2024-05-14T09:39:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.061+0000 7f370ea00640 1 -- 172.21.15.120:0/69322570 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3710037040 con 0x556c112694d0 2024-05-14T09:39:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.061+0000 7f370ea00640 1 -- 172.21.15.120:0/69322570 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710046030 con 0x556c112694d0 2024-05-14T09:39:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.064+0000 7f3730036740 1 -- 172.21.15.120:0/69322570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 msgr2=0x556c1162aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.065+0000 7f3730036740 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c1162aa90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f371002aa30 tx=0x7f3710000bc0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.065+0000 7f3730036740 1 -- 172.21.15.120:0/69322570 shutdown_connections 2024-05-14T09:39:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.065+0000 7f3730036740 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c1162afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.065+0000 7f3730036740 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c1162aa90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.065+0000 7f3730036740 1 --2- 172.21.15.120:0/69322570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11627ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.065+0000 7f3730036740 1 -- 172.21.15.120:0/69322570 >> 172.21.15.120:0/69322570 conn(0x556c1127e300 msgr2=0x556c116273a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.065+0000 7f3730036740 1 -- 172.21.15.120:0/69322570 shutdown_connections 2024-05-14T09:39:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.066+0000 7f3730036740 1 -- 172.21.15.120:0/69322570 wait complete. 2024-05-14T09:39:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.067+0000 7f3730036740 1 -- start start 2024-05-14T09:39:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.067+0000 7f3730036740 1 Processor -- start 2024-05-14T09:39:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.068+0000 7f3730036740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11639720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.068+0000 7f3730036740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c11639c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.068+0000 7f3730036740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c116a9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3721400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c11639c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3721400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c11639c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:48018/0 (socket says 172.21.15.120:48018) 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3721e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11639720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3722800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c116a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3722800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c116a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33924/0 (socket says 172.21.15.120:33924) 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3730036740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f37241bcc70 con 0x556c1128a1b0 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3730036740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37241bc540 con 0x556c112612f0 2024-05-14T09:39:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3730036740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37241b97a0 con 0x556c112694d0 2024-05-14T09:39:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3721e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11639720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37222/0 (socket says 172.21.15.120:37222) 2024-05-14T09:39:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.069+0000 7f3721400640 1 -- 172.21.15.120:0/85448055 learned_addr learned my addr 172.21.15.120:0/85448055 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.070+0000 7f3730036740 10 client.0 _ll_register_callbacks cb 0x7f371400c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.071+0000 7f3721400640 1 -- 172.21.15.120:0/85448055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 msgr2=0x556c11639720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.071+0000 7f3721400640 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11639720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.071+0000 7f3721400640 1 -- 172.21.15.120:0/85448055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 msgr2=0x556c116a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.071+0000 7f3721400640 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c116a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.071+0000 7f3721400640 1 -- 172.21.15.120:0/85448055 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c1163cbd0 con 0x556c112694d0 2024-05-14T09:39:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.071+0000 7f3721400640 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c11639c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3710034040 tx=0x7f3710031b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3adc218fa8cf234d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.071+0000 7f3703e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:39:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.072+0000 7f3703e00640 1 -- 172.21.15.120:0/85448055 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710046040 con 0x556c112694d0 2024-05-14T09:39:23.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.072+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3710037040 con 0x556c112694d0 2024-05-14T09:39:23.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.072+0000 7f3703e00640 1 -- 172.21.15.120:0/85448055 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3710031540 con 0x556c112694d0 2024-05-14T09:39:23.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.072+0000 7f3703e00640 1 -- 172.21.15.120:0/85448055 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f371005d050 con 0x556c112694d0 2024-05-14T09:39:23.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.073+0000 7f3730036740 10 client.26833 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:23.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.073+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x556c116aacf0 con 0x556c112694d0 2024-05-14T09:39:23.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.074+0000 7f3703e00640 1 -- 172.21.15.120:0/85448055 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3710037040 con 0x556c112694d0 2024-05-14T09:39:23.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.075+0000 7f3703e00640 1 -- 172.21.15.120:0/85448055 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7f37100035f0 con 0x556c112694d0 2024-05-14T09:39:23.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.075+0000 7f3730036740 10 client.26833 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:23.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.075+0000 7f3730036740 10 client.26833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:23.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.076+0000 7f3730036740 20 client.26833 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:23.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.076+0000 7f3730036740 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c1121e1c0 0x556c116ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:23.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.076+0000 7f3730036740 4 client.26833 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:39:23.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.076+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c11597fd0 con 0x556c1121e1c0 2024-05-14T09:39:23.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.077+0000 7f3721e00640 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c1121e1c0 0x556c116ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:23.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.078+0000 7f3703e00640 10 client.26833 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:23.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.078+0000 7f3721e00640 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c1121e1c0 0x556c116ad780 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e46cc2ab2f1182df server_cookie=21b9a9cd418fa226 in_seq=0 out_seq=0 2024-05-14T09:39:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3703e00640 1 -- 172.21.15.120:0/85448055 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c11597fd0 con 0x556c1121e1c0 2024-05-14T09:39:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3703e00640 10 client.26833 handle_command_reply: tid=0 2024-05-14T09:39:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 client.26833 shutdown 2024-05-14T09:39:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 msgr2=0x556c11639c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c11639c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3710034040 tx=0x7f3710031b00 comp rx=0 tx=0).stop 2024-05-14T09:39:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 shutdown_connections 2024-05-14T09:39:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556c1121e1c0 0x556c116ad780 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556c1128a1b0 0x556c116a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c112694d0 0x556c11639c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 --2- 172.21.15.120:0/85448055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556c112612f0 0x556c11639720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 >> 172.21.15.120:0/85448055 conn(0x556c1127e300 msgr2=0x556c1162aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.145+0000 7f3703e00640 0 client.26833 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.146+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 shutdown_connections 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.146+0000 7f3730036740 1 -- 172.21.15.120:0/85448055 wait complete. 2024-05-14T09:39:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.146+0000 7f3730036740 20 client.26833 trim_cache size 0 max 16384 2024-05-14T09:39:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:39:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:39:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:39:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:39:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37080b2b20 msgr2=0x7f37080b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37080b2b20 0x7f37080b5030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x556c1162d4d0 tx=0x7f371400c430 comp rx=0 tx=0).stop 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372410a0f0 msgr2=0x7f37241a8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372410a0f0 0x7f37241a8f40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f371c005fd0 tx=0x7f371c00ef90 comp rx=0 tx=0).stop 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 shutdown_connections 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f37080b2b20 0x7f37080b5030 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37241121f0 0x7f37241b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f372410f890 0x7f37241a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 --2- 172.21.15.120:0/2372275219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372410a0f0 0x7f37241a8f40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.147+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 >> 172.21.15.120:0/2372275219 conn(0x7f3724070460 msgr2=0x7f37241106d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.148+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 shutdown_connections 2024-05-14T09:39:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:23.148+0000 7f3723200640 1 -- 172.21.15.120:0/2372275219 wait complete. 2024-05-14T09:39:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 710.0 s, 353.6 tps, lat 277.978 ms stddev 270.836 2024-05-14T09:39:24.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:24 smithi120 ceph-mon[31085]: pgmap v1031: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-14T09:39:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:24 smithi152 ceph-mon[34868]: pgmap v1031: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-14T09:39:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:24 smithi175 ceph-mon[35353]: pgmap v1031: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-14T09:39:26.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:26 smithi120 ceph-mon[31085]: pgmap v1032: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 684 op/s 2024-05-14T09:39:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:26 smithi152 ceph-mon[34868]: pgmap v1032: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 684 op/s 2024-05-14T09:39:26.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:26 smithi175 ceph-mon[35353]: pgmap v1032: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 684 op/s 2024-05-14T09:39:28.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:28 smithi120 ceph-mon[31085]: pgmap v1033: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-05-14T09:39:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:28 smithi152 ceph-mon[34868]: pgmap v1033: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-05-14T09:39:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:28 smithi175 ceph-mon[35353]: pgmap v1033: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-05-14T09:39:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 715.0 s, 556.0 tps, lat 181.021 ms stddev 126.367 2024-05-14T09:39:30.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:30 smithi120 ceph-mon[31085]: pgmap v1034: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-05-14T09:39:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:30 smithi152 ceph-mon[34868]: pgmap v1034: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-05-14T09:39:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:30 smithi175 ceph-mon[35353]: pgmap v1034: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-05-14T09:39:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:32 smithi152 ceph-mon[34868]: pgmap v1035: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 689 op/s 2024-05-14T09:39:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:32 smithi175 ceph-mon[35353]: pgmap v1035: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 689 op/s 2024-05-14T09:39:32.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:32 smithi120 ceph-mon[31085]: pgmap v1035: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 689 op/s 2024-05-14T09:39:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 720.0 s, 537.4 tps, lat 187.763 ms stddev 107.182 2024-05-14T09:39:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:34 smithi152 ceph-mon[34868]: pgmap v1036: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 MiB/s wr, 659 op/s 2024-05-14T09:39:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:34 smithi175 ceph-mon[35353]: pgmap v1036: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 MiB/s wr, 659 op/s 2024-05-14T09:39:34.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:34 smithi120 ceph-mon[31085]: pgmap v1036: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 MiB/s wr, 659 op/s 2024-05-14T09:39:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:36 smithi152 ceph-mon[34868]: pgmap v1037: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.0 MiB/s wr, 661 op/s 2024-05-14T09:39:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:36 smithi175 ceph-mon[35353]: pgmap v1037: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.0 MiB/s wr, 661 op/s 2024-05-14T09:39:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.531+0000 7f3969200640 1 -- 172.21.15.120:0/1081045261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 msgr2=0x7f3964103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.531+0000 7f3969200640 1 --2- 172.21.15.120:0/1081045261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 0x7f3964103ba0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f395c009be0 tx=0x7f395c02a6c0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.531+0000 7f3969200640 1 -- 172.21.15.120:0/1081045261 shutdown_connections 2024-05-14T09:39:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.531+0000 7f3969200640 1 --2- 172.21.15.120:0/1081045261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 0x7f3964103ba0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.531+0000 7f3969200640 1 --2- 172.21.15.120:0/1081045261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3964102b70 0x7f3964103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.531+0000 7f3969200640 1 --2- 172.21.15.120:0/1081045261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102190 0x7f39641025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.531+0000 7f3969200640 1 -- 172.21.15.120:0/1081045261 >> 172.21.15.120:0/1081045261 conn(0x7f39640fdd40 msgr2=0x7f39641001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.532+0000 7f3969200640 1 -- 172.21.15.120:0/1081045261 shutdown_connections 2024-05-14T09:39:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.532+0000 7f3969200640 1 -- 172.21.15.120:0/1081045261 wait complete. 2024-05-14T09:39:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.534+0000 7f3969200640 1 Processor -- start 2024-05-14T09:39:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.534+0000 7f3969200640 1 -- start start 2024-05-14T09:39:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.535+0000 7f3969200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3964102190 0x7f396419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.535+0000 7f3969200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102b70 0x7f396419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.536+0000 7f3969200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 0x7f39641a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.536+0000 7f3969200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39641117e0 con 0x7f39641036d0 2024-05-14T09:39:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.536+0000 7f3969200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3964111660 con 0x7f3964102b70 2024-05-14T09:39:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.536+0000 7f3969200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3964111960 con 0x7f3964102190 2024-05-14T09:39:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.536+0000 7f3961400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102b70 0x7f396419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.536+0000 7f3961400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102b70 0x7f396419c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:60032/0 (socket says 172.21.15.120:60032) 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.536+0000 7f3961400640 1 -- 172.21.15.120:0/1980945441 learned_addr learned my addr 172.21.15.120:0/1980945441 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3961e00640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3964102190 0x7f396419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3962800640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 0x7f39641a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3961400640 1 -- 172.21.15.120:0/1980945441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3964102190 msgr2=0x7f396419c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3961400640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3964102190 0x7f396419c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3961400640 1 -- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 msgr2=0x7f39641a3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3961400640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 0x7f39641a3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3961400640 1 -- 172.21.15.120:0/1980945441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39641a3ef0 con 0x7f3964102b70 2024-05-14T09:39:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.537+0000 7f3962800640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 0x7f39641a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:39:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.538+0000 7f3961400640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102b70 0x7f396419c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f395400d950 tx=0x7f395400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.538+0000 7f395aa00640 1 -- 172.21.15.120:0/1980945441 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954017070 con 0x7f3964102b70 2024-05-14T09:39:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.538+0000 7f395aa00640 1 -- 172.21.15.120:0/1980945441 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3954009c30 con 0x7f3964102b70 2024-05-14T09:39:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.538+0000 7f395aa00640 1 -- 172.21.15.120:0/1980945441 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395400f620 con 0x7f3964102b70 2024-05-14T09:39:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.538+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39641a41e0 con 0x7f3964102b70 2024-05-14T09:39:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.539+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39641a46e0 con 0x7f3964102b70 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.546+0000 7f395aa00640 1 -- 172.21.15.120:0/1980945441 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3954010460 con 0x7f3964102b70 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.546+0000 7f39701f9740 1 Processor -- start 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.546+0000 7f39701f9740 1 -- start start 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.547+0000 7f39701f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac86100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.547+0000 7f39701f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8bb2f0 0x563c2ac86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.547+0000 7f39701f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac8d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.547+0000 7f39701f9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563c2abea550 con 0x563c2a8bb2f0 2024-05-14T09:39:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.547+0000 7f39701f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563c2ab8fbc0 con 0x563c2a8e41b0 2024-05-14T09:39:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.547+0000 7f39701f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563c2abe6510 con 0x563c2a8c34d0 2024-05-14T09:39:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.548+0000 7f3961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac8d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.548+0000 7f3961e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8bb2f0 0x563c2ac86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.548+0000 7f3961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac8d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36420/0 (socket says 172.21.15.120:36420) 2024-05-14T09:39:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.548+0000 7f3961400640 1 -- 172.21.15.120:0/3388921609 learned_addr learned my addr 172.21.15.120:0/3388921609 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.548+0000 7f3962800640 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac86100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.548+0000 7f395aa00640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39480b28e0 0x7f39480b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.549+0000 7f395aa00640 1 -- 172.21.15.120:0/1980945441 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f39540e2270 con 0x7f3964102b70 2024-05-14T09:39:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.549+0000 7f3962800640 1 -- 172.21.15.120:0/3388921609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 msgr2=0x563c2ac8d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.549+0000 7f3962800640 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac8d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.549+0000 7f3962800640 1 -- 172.21.15.120:0/3388921609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8bb2f0 msgr2=0x563c2ac86680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.549+0000 7f3962800640 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8bb2f0 0x563c2ac86680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.549+0000 7f3962800640 1 -- 172.21.15.120:0/3388921609 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c2a8fc210 con 0x563c2a8e41b0 2024-05-14T09:39:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.549+0000 7f3961e00640 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8bb2f0 0x563c2ac86680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:39:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.550+0000 7f3962800640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39480b28e0 0x7f39480b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.551+0000 7f3962800640 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac86100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f395c006010 tx=0x7f395c030430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2bbf0383642cc4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.552+0000 7f3962800640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39480b28e0 0x7f39480b4df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f395c030800 tx=0x7f395c044000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.552+0000 7f394f400640 1 -- 172.21.15.120:0/3388921609 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c036070 con 0x563c2a8e41b0 2024-05-14T09:39:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.552+0000 7f394f400640 1 -- 172.21.15.120:0/3388921609 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f395c037040 con 0x563c2a8e41b0 2024-05-14T09:39:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.552+0000 7f394f400640 1 -- 172.21.15.120:0/3388921609 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c031440 con 0x563c2a8e41b0 2024-05-14T09:39:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 -- 172.21.15.120:0/3388921609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 msgr2=0x563c2ac86100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac86100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f395c006010 tx=0x7f395c030430 comp rx=0 tx=0).stop 2024-05-14T09:39:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 -- 172.21.15.120:0/3388921609 shutdown_connections 2024-05-14T09:39:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac8d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8bb2f0 0x563c2ac86680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 --2- 172.21.15.120:0/3388921609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac86100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 -- 172.21.15.120:0/3388921609 >> 172.21.15.120:0/3388921609 conn(0x563c2a8d8300 msgr2=0x563c2ac81a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.554+0000 7f39701f9740 1 -- 172.21.15.120:0/3388921609 shutdown_connections 2024-05-14T09:39:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.555+0000 7f39701f9740 1 -- 172.21.15.120:0/3388921609 wait complete. 2024-05-14T09:39:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.555+0000 7f39701f9740 1 -- start start 2024-05-14T09:39:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.556+0000 7f39701f9740 1 Processor -- start 2024-05-14T09:39:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.557+0000 7f39701f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f39701f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8c34d0 0x563c2ac90160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f39701f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac970c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f3961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f3961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36432/0 (socket says 172.21.15.120:36432) 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f39701f9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563c2ac8df10 con 0x563c2a8e41b0 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f39701f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563c2aba3660 con 0x563c2a8c34d0 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f39701f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563c2ac8e090 con 0x563c2a8bb2f0 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f3961400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8c34d0 0x563c2ac90160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.558+0000 7f39701f9740 10 client.0 _ll_register_callbacks cb 0x563c2ab6d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.559+0000 7f3961e00640 1 -- 172.21.15.120:0/1564492273 learned_addr learned my addr 172.21.15.120:0/1564492273 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.559+0000 7f3962800640 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.559+0000 7f3961400640 1 -- 172.21.15.120:0/1564492273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 msgr2=0x563c2ac8fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.559+0000 7f3961400640 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.559+0000 7f3961400640 1 -- 172.21.15.120:0/1564492273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 msgr2=0x563c2ac970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.559+0000 7f3961400640 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.559+0000 7f3961400640 1 -- 172.21.15.120:0/1564492273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c2a9c8620 con 0x563c2a8c34d0 2024-05-14T09:39:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.560+0000 7f3961400640 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8c34d0 0x563c2ac90160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f39540a6700 tx=0x7f39540a8f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48c7b2f73a4f71a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.560+0000 7f3943e00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:39:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.560+0000 7f3943e00640 1 -- 172.21.15.120:0/1564492273 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954020070 con 0x563c2a8c34d0 2024-05-14T09:39:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.560+0000 7f3943e00640 1 -- 172.21.15.120:0/1564492273 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f39540b0dd0 con 0x563c2a8c34d0 2024-05-14T09:39:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.561+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f395c037040 con 0x563c2a8c34d0 2024-05-14T09:39:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.562+0000 7f3943e00640 1 -- 172.21.15.120:0/1564492273 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f39540910b0 con 0x563c2a8c34d0 2024-05-14T09:39:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.562+0000 7f39701f9740 10 client.36776 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.562+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x563c2ac9a060 con 0x563c2a8c34d0 2024-05-14T09:39:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.562+0000 7f3943e00640 1 -- 172.21.15.120:0/1564492273 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f395c037040 con 0x563c2a8c34d0 2024-05-14T09:39:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.563+0000 7f3943e00640 1 -- 172.21.15.120:0/1564492273 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7f39540a3bb0 con 0x563c2a8c34d0 2024-05-14T09:39:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.564+0000 7f39701f9740 10 client.36776 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.564+0000 7f39701f9740 10 client.36776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.564+0000 7f39701f9740 20 client.36776 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.564+0000 7f39701f9740 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8a2d80 0x563c2ac9d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.564+0000 7f39701f9740 4 client.36776 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:39:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.564+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c2abf8160 con 0x563c2a8a2d80 2024-05-14T09:39:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.565+0000 7f3961e00640 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8a2d80 0x563c2ac9d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.569+0000 7f3961e00640 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8a2d80 0x563c2ac9d7a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b2368a7f6ca960d server_cookie=d034fbed4c3ec136 in_seq=0 out_seq=0 2024-05-14T09:39:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.569+0000 7f3943e00640 10 client.36776 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.571+0000 7f3943e00640 1 -- 172.21.15.120:0/1564492273 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563c2abf8160 con 0x563c2a8a2d80 2024-05-14T09:39:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.571+0000 7f3943e00640 10 client.36776 handle_command_reply: tid=0 2024-05-14T09:39:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.571+0000 7f39701f9740 1 client.36776 shutdown 2024-05-14T09:39:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.572+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8c34d0 msgr2=0x563c2ac90160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.572+0000 7f39701f9740 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8c34d0 0x563c2ac90160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f39540a6700 tx=0x7f39540a8f10 comp rx=0 tx=0).stop 2024-05-14T09:39:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 shutdown_connections 2024-05-14T09:39:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f39701f9740 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8a2d80 0x563c2ac9d7a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f39701f9740 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f39701f9740 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8c34d0 0x563c2ac90160 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f39701f9740 1 --2- 172.21.15.120:0/1564492273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 >> 172.21.15.120:0/1564492273 conn(0x563c2a8d8300 msgr2=0x563c2ac80a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f3943e00640 0 client.36776 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.573+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 shutdown_connections 2024-05-14T09:39:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.574+0000 7f39701f9740 1 -- 172.21.15.120:0/1564492273 wait complete. 2024-05-14T09:39:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.574+0000 7f39701f9740 20 client.36776 trim_cache size 0 max 16384 2024-05-14T09:39:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.605+0000 7f39701f9740 1 Processor -- start 2024-05-14T09:39:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.606+0000 7f39701f9740 1 -- start start 2024-05-14T09:39:36.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.606+0000 7f39701f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f39701f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8c34d0 0x563c2ac96fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f39701f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac8a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f39701f9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39641aed50 con 0x563c2a8c34d0 2024-05-14T09:39:36.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f39701f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f39641b09b0 con 0x563c2a8e41b0 2024-05-14T09:39:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f39701f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39641af420 con 0x563c2a8bb2f0 2024-05-14T09:39:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f3961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f3961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36438/0 (socket says 172.21.15.120:36438) 2024-05-14T09:39:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f3961e00640 1 -- 172.21.15.120:0/3699185819 learned_addr learned my addr 172.21.15.120:0/3699185819 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f3961400640 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8c34d0 0x563c2ac96fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.607+0000 7f3962800640 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.608+0000 7f3962800640 1 -- 172.21.15.120:0/3699185819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 msgr2=0x563c2ac8a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.608+0000 7f3962800640 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.609+0000 7f3962800640 1 -- 172.21.15.120:0/3699185819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8c34d0 msgr2=0x563c2ac96fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.609+0000 7f3962800640 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8c34d0 0x563c2ac96fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.609+0000 7f3962800640 1 -- 172.21.15.120:0/3699185819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c2ac8e1c0 con 0x563c2a8e41b0 2024-05-14T09:39:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.609+0000 7f3961400640 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8c34d0 0x563c2ac96fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:39:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.609+0000 7f3962800640 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac8a680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f395c02abe0 tx=0x7f395c009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15caefe4a56b9d8e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.610+0000 7f394ea00640 1 -- 172.21.15.120:0/3699185819 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c036030 con 0x563c2a8e41b0 2024-05-14T09:39:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.610+0000 7f394ea00640 1 -- 172.21.15.120:0/3699185819 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f395c055070 con 0x563c2a8e41b0 2024-05-14T09:39:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f394ea00640 1 -- 172.21.15.120:0/3699185819 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c0045b0 con 0x563c2a8e41b0 2024-05-14T09:39:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 -- 172.21.15.120:0/3699185819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 msgr2=0x563c2ac8a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac8a680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f395c02abe0 tx=0x7f395c009800 comp rx=0 tx=0).stop 2024-05-14T09:39:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 -- 172.21.15.120:0/3699185819 shutdown_connections 2024-05-14T09:39:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8e41b0 0x563c2ac8a680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8c34d0 0x563c2ac96fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 --2- 172.21.15.120:0/3699185819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8bb2f0 0x563c2ac8a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 -- 172.21.15.120:0/3699185819 >> 172.21.15.120:0/3699185819 conn(0x563c2a8d8300 msgr2=0x563c2ac8fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 -- 172.21.15.120:0/3699185819 shutdown_connections 2024-05-14T09:39:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.611+0000 7f39701f9740 1 -- 172.21.15.120:0/3699185819 wait complete. 2024-05-14T09:39:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.612+0000 7f39701f9740 1 -- start start 2024-05-14T09:39:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.612+0000 7f39701f9740 1 Processor -- start 2024-05-14T09:39:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.613+0000 7f39701f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8bb2f0 0x563c2ac958f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.613+0000 7f39701f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac95e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.613+0000 7f39701f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac96370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.614+0000 7f3962800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac96370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.614+0000 7f3961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac95e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.614+0000 7f3962800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac96370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47874/0 (socket says 172.21.15.120:47874) 2024-05-14T09:39:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.614+0000 7f3962800640 1 -- 172.21.15.120:0/3392917412 learned_addr learned my addr 172.21.15.120:0/3392917412 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.614+0000 7f3961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac95e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36442/0 (socket says 172.21.15.120:36442) 2024-05-14T09:39:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.614+0000 7f3961e00640 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8bb2f0 0x563c2ac958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.615+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39641b0220 con 0x563c2a8e41b0 2024-05-14T09:39:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.615+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f39641afaf0 con 0x563c2a8bb2f0 2024-05-14T09:39:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.615+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39641acd50 con 0x563c2a8c34d0 2024-05-14T09:39:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.615+0000 7f39701f9740 10 client.0 _ll_register_callbacks cb 0x7f39540a92f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.615+0000 7f3962800640 1 -- 172.21.15.120:0/3392917412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 msgr2=0x563c2ac95e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.615+0000 7f3962800640 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac95e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.615+0000 7f3962800640 1 -- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8bb2f0 msgr2=0x563c2ac958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.616+0000 7f3962800640 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8bb2f0 0x563c2ac958f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.616+0000 7f3962800640 1 -- 172.21.15.120:0/3392917412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c2ad0c350 con 0x563c2a8e41b0 2024-05-14T09:39:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.616+0000 7f3962800640 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac96370 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f395c003c00 tx=0x7f395c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f7fc1e69b5d8e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.616+0000 7f3943e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:39:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.616+0000 7f3943e00640 1 -- 172.21.15.120:0/3392917412 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c036040 con 0x563c2a8e41b0 2024-05-14T09:39:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.617+0000 7f3943e00640 1 -- 172.21.15.120:0/3392917412 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f395c05a870 con 0x563c2a8e41b0 2024-05-14T09:39:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.617+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f395c055070 con 0x563c2a8e41b0 2024-05-14T09:39:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.619+0000 7f3943e00640 1 -- 172.21.15.120:0/3392917412 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f395c0305a0 con 0x563c2a8e41b0 2024-05-14T09:39:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.619+0000 7f39701f9740 10 client.17271 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.619+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x563c2ad0d5c0 con 0x563c2a8e41b0 2024-05-14T09:39:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.620+0000 7f3943e00640 1 -- 172.21.15.120:0/3392917412 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f395c055070 con 0x563c2a8e41b0 2024-05-14T09:39:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.620+0000 7f3943e00640 1 -- 172.21.15.120:0/3392917412 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7f395c031440 con 0x563c2a8e41b0 2024-05-14T09:39:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.620+0000 7f39701f9740 10 client.17271 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.620+0000 7f39701f9740 10 client.17271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.620+0000 7f39701f9740 20 client.17271 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.621+0000 7f39701f9740 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8781c0 0x563c2ad0faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.621+0000 7f39701f9740 4 client.17271 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:39:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.621+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c2abf1fd0 con 0x563c2a8781c0 2024-05-14T09:39:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.621+0000 7f3961e00640 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8781c0 0x563c2ad0faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.623+0000 7f3961e00640 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8781c0 0x563c2ad0faf0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2ad738e0848693a server_cookie=bddc8068377567a6 in_seq=0 out_seq=0 2024-05-14T09:39:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.623+0000 7f3943e00640 10 client.17271 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:36.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:36 smithi120 ceph-mon[31085]: pgmap v1037: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.0 MiB/s wr, 661 op/s 2024-05-14T09:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.643+0000 7f3943e00640 1 -- 172.21.15.120:0/3392917412 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c2abf1fd0 con 0x563c2a8781c0 2024-05-14T09:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.643+0000 7f3943e00640 10 client.17271 handle_command_reply: tid=0 2024-05-14T09:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.643+0000 7f39701f9740 1 client.17271 shutdown 2024-05-14T09:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.644+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 msgr2=0x563c2ac96370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.644+0000 7f39701f9740 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac96370 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f395c003c00 tx=0x7f395c003c30 comp rx=0 tx=0).stop 2024-05-14T09:39:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 shutdown_connections 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x563c2a8781c0 0x563c2ad0faf0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563c2a8e41b0 0x563c2ac96370 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c2a8c34d0 0x563c2ac95e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 --2- 172.21.15.120:0/3392917412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563c2a8bb2f0 0x563c2ac958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 >> 172.21.15.120:0/3392917412 conn(0x563c2a8d8300 msgr2=0x563c2ac8fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f3943e00640 0 client.17271 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 shutdown_connections 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 1 -- 172.21.15.120:0/3392917412 wait complete. 2024-05-14T09:39:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.645+0000 7f39701f9740 20 client.17271 trim_cache size 0 max 16384 2024-05-14T09:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39480b28e0 msgr2=0x7f39480b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39480b28e0 0x7f39480b4df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f395c030800 tx=0x7f395c044000 comp rx=0 tx=0).stop 2024-05-14T09:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102b70 msgr2=0x7f396419c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102b70 0x7f396419c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f395400d950 tx=0x7f395400de10 comp rx=0 tx=0).stop 2024-05-14T09:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 shutdown_connections 2024-05-14T09:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f39480b28e0 0x7f39480b4df0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39641036d0 0x7f39641a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3964102b70 0x7f396419c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.647+0000 7f3969200640 1 --2- 172.21.15.120:0/1980945441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3964102190 0x7f396419c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.648+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 >> 172.21.15.120:0/1980945441 conn(0x7f39640fdd40 msgr2=0x7f396410a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.648+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 shutdown_connections 2024-05-14T09:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:36.648+0000 7f3969200640 1 -- 172.21.15.120:0/1980945441 wait complete. 2024-05-14T09:39:38.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:38 smithi152 ceph-mon[34868]: pgmap v1038: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 629 op/s 2024-05-14T09:39:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:38 smithi175 ceph-mon[35353]: pgmap v1038: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 629 op/s 2024-05-14T09:39:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:38 smithi120 ceph-mon[31085]: pgmap v1038: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 629 op/s 2024-05-14T09:39:39.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 725.0 s, 497.4 tps, lat 201.730 ms stddev 138.753 2024-05-14T09:39:40.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:40 smithi152 ceph-mon[34868]: pgmap v1039: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.8 MiB/s wr, 714 op/s 2024-05-14T09:39:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:40 smithi175 ceph-mon[35353]: pgmap v1039: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.8 MiB/s wr, 714 op/s 2024-05-14T09:39:40.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:40 smithi120 ceph-mon[31085]: pgmap v1039: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.8 MiB/s wr, 714 op/s 2024-05-14T09:39:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:42 smithi152 ceph-mon[34868]: pgmap v1040: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-05-14T09:39:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:42 smithi175 ceph-mon[35353]: pgmap v1040: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-05-14T09:39:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:42 smithi120 ceph-mon[31085]: pgmap v1040: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-05-14T09:39:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 730.0 s, 590.0 tps, lat 171.200 ms stddev 95.372 2024-05-14T09:39:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:44 smithi152 ceph-mon[34868]: pgmap v1041: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 697 op/s 2024-05-14T09:39:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:44 smithi175 ceph-mon[35353]: pgmap v1041: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 697 op/s 2024-05-14T09:39:44.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:44 smithi120 ceph-mon[31085]: pgmap v1041: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 697 op/s 2024-05-14T09:39:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:46 smithi152 ceph-mon[34868]: pgmap v1042: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-05-14T09:39:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:46 smithi175 ceph-mon[35353]: pgmap v1042: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-05-14T09:39:46.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:46 smithi120 ceph-mon[31085]: pgmap v1042: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-05-14T09:39:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:48 smithi152 ceph-mon[34868]: pgmap v1043: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 735 op/s 2024-05-14T09:39:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:48 smithi175 ceph-mon[35353]: pgmap v1043: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 735 op/s 2024-05-14T09:39:48.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:48 smithi120 ceph-mon[31085]: pgmap v1043: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 735 op/s 2024-05-14T09:39:49.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 735.0 s, 299.2 tps, lat 262.254 ms stddev 516.191 2024-05-14T09:39:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.051+0000 7fa1cbe00640 1 -- 172.21.15.120:0/3216750942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 msgr2=0x7fa1c41103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.051+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/3216750942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 0x7fa1c41103b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009900 tx=0x7fa1bc02a3f0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.051+0000 7fa1cbe00640 1 -- 172.21.15.120:0/3216750942 shutdown_connections 2024-05-14T09:39:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.051+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/3216750942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 0x7fa1c41103b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.051+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/3216750942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c410b280 0x7fa1c410b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.051+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/3216750942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c406c0e0 0x7fa1c410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.051+0000 7fa1cbe00640 1 -- 172.21.15.120:0/3216750942 >> 172.21.15.120:0/3216750942 conn(0x7fa1c40715a0 msgr2=0x7fa1c4073a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.052+0000 7fa1cbe00640 1 -- 172.21.15.120:0/3216750942 shutdown_connections 2024-05-14T09:39:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.052+0000 7fa1cbe00640 1 -- 172.21.15.120:0/3216750942 wait complete. 2024-05-14T09:39:50.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.053+0000 7fa1cbe00640 1 Processor -- start 2024-05-14T09:39:50.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.054+0000 7fa1cbe00640 1 -- start start 2024-05-14T09:39:50.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.054+0000 7fa1cbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c406c0e0 0x7fa1c41a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.054+0000 7fa1cbe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c410b280 0x7fa1c41a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.054+0000 7fa1cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 0x7fa1c41b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.054+0000 7fa1cbe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c411e240 con 0x7fa1c406c0e0 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.054+0000 7fa1cbe00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c411e0c0 con 0x7fa1c410b280 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.054+0000 7fa1cbe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c411e3c0 con 0x7fa1c410ffa0 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.055+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c406c0e0 0x7fa1c41a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.055+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c406c0e0 0x7fa1c41a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56430/0 (socket says 172.21.15.120:56430) 2024-05-14T09:39:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.055+0000 7fa1c9400640 1 -- 172.21.15.120:0/1373161385 learned_addr learned my addr 172.21.15.120:0/1373161385 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.055+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c410b280 0x7fa1c41a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.055+0000 7fa1ca800640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 0x7fa1c41b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.056+0000 7fa1c8a00640 1 -- 172.21.15.120:0/1373161385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 msgr2=0x7fa1c41b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.056+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 0x7fa1c41b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.056+0000 7fa1c8a00640 1 -- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c406c0e0 msgr2=0x7fa1c41a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.056+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c406c0e0 0x7fa1c41a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.056+0000 7fa1c8a00640 1 -- 172.21.15.120:0/1373161385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c41b0930 con 0x7fa1c410b280 2024-05-14T09:39:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.056+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c410b280 0x7fa1c41a93e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c970 tx=0x7fa1b000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.057+0000 7fa1c2000640 1 -- 172.21.15.120:0/1373161385 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0007bb0 con 0x7fa1c410b280 2024-05-14T09:39:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.057+0000 7fa1c2000640 1 -- 172.21.15.120:0/1373161385 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1b0007d50 con 0x7fa1c410b280 2024-05-14T09:39:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.057+0000 7fa1c2000640 1 -- 172.21.15.120:0/1373161385 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00186f0 con 0x7fa1c410b280 2024-05-14T09:39:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.057+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c41b0c20 con 0x7fa1c410b280 2024-05-14T09:39:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.057+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c41b1120 con 0x7fa1c410b280 2024-05-14T09:39:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.062+0000 7fa1d2e11740 1 Processor -- start 2024-05-14T09:39:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.063+0000 7fa1d2e11740 1 -- start start 2024-05-14T09:39:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.063+0000 7fa1c2000640 1 -- 172.21.15.120:0/1373161385 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa1b0018890 con 0x7fa1c410b280 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.064+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5644f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.064+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd5644f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.064+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56456780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.064+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55fd563b3550 con 0x55fd5608c4d0 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.064+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd56358bc0 con 0x55fd560ad1b0 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.064+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fd563af510 con 0x55fd560842f0 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.065+0000 7fa1ca800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5644f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.065+0000 7fa1ca800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5644f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:38060/0 (socket says 172.21.15.120:38060) 2024-05-14T09:39:50.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.065+0000 7fa1ca800640 1 -- 172.21.15.120:0/1346745969 learned_addr learned my addr 172.21.15.120:0/1346745969 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1c2000640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1ac0b29f0 0x7fa1ac0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1ca800640 1 -- 172.21.15.120:0/1346745969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 msgr2=0x55fd5644f880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1ca800640 1 --2- 172.21.15.120:0/1346745969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd5644f880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1ca800640 1 -- 172.21.15.120:0/1346745969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 msgr2=0x55fd56456780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1ca800640 1 --2- 172.21.15.120:0/1346745969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56456780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1ca800640 1 -- 172.21.15.120:0/1346745969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd560c5210 con 0x55fd560ad1b0 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1c2000640 1 -- 172.21.15.120:0/1373161385 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa1b00e2550 con 0x7fa1c410b280 2024-05-14T09:39:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.066+0000 7fa1ca800640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1ac0b29f0 0x7fa1ac0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.068+0000 7fa1ca800640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1ac0b29f0 0x7fa1ac0b4f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0096c0 tx=0x7fa1bc03f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.068+0000 7fa1ca800640 1 --2- 172.21.15.120:0/1346745969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5644f300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009900 tx=0x7fa1bc004310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8787431564a69c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.069+0000 7fa1b6600640 1 -- 172.21.15.120:0/1346745969 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc035030 con 0x55fd560ad1b0 2024-05-14T09:39:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.069+0000 7fa1b6600640 1 -- 172.21.15.120:0/1346745969 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1bc040070 con 0x55fd560ad1b0 2024-05-14T09:39:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.069+0000 7fa1b6600640 1 -- 172.21.15.120:0/1346745969 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc03c9c0 con 0x55fd560ad1b0 2024-05-14T09:39:50.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.071+0000 7fa1d2e11740 1 -- 172.21.15.120:0/1346745969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 msgr2=0x55fd5644f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.070 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.071+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/1346745969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5644f300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009900 tx=0x7fa1bc004310 comp rx=0 tx=0).stop 2024-05-14T09:39:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.071+0000 7fa1d2e11740 1 -- 172.21.15.120:0/1346745969 shutdown_connections 2024-05-14T09:39:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.071+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/1346745969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56456780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.071+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/1346745969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd5644f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.071+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/1346745969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5644f300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.071+0000 7fa1d2e11740 1 -- 172.21.15.120:0/1346745969 >> 172.21.15.120:0/1346745969 conn(0x55fd560a1300 msgr2=0x55fd5644ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.072+0000 7fa1d2e11740 1 -- 172.21.15.120:0/1346745969 shutdown_connections 2024-05-14T09:39:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.072+0000 7fa1d2e11740 1 -- 172.21.15.120:0/1346745969 wait complete. 2024-05-14T09:39:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.073+0000 7fa1d2e11740 1 -- start start 2024-05-14T09:39:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.073+0000 7fa1d2e11740 1 Processor -- start 2024-05-14T09:39:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.074+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56458ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd564593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd56460340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55fd56457170 con 0x55fd5608c4d0 2024-05-14T09:39:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd5636c660 con 0x55fd560ad1b0 2024-05-14T09:39:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fd564572f0 con 0x55fd560842f0 2024-05-14T09:39:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1c8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd564593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1d2e11740 10 client.0 _ll_register_callbacks cb 0x55fd56336400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1c8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd564593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56434/0 (socket says 172.21.15.120:56434) 2024-05-14T09:39:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1c8a00640 1 -- 172.21.15.120:0/2191849236 learned_addr learned my addr 172.21.15.120:0/2191849236 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.075+0000 7fa1c9400640 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56458ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.076+0000 7fa1ca800640 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd56460340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.076+0000 7fa1c8a00640 1 -- 172.21.15.120:0/2191849236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 msgr2=0x55fd56458ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.076+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56458ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.076+0000 7fa1c8a00640 1 -- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 msgr2=0x55fd56460340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.076+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd56460340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.076+0000 7fa1c8a00640 1 -- 172.21.15.120:0/2191849236 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd56191620 con 0x55fd5608c4d0 2024-05-14T09:39:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.077+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd564593e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00a9700 tx=0x7fa1b000fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6326d64f8b6c8a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.077+0000 7fa1aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:39:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.077+0000 7fa1aaa00640 1 -- 172.21.15.120:0/2191849236 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00e2070 con 0x55fd5608c4d0 2024-05-14T09:39:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.078+0000 7fa1aaa00640 1 -- 172.21.15.120:0/2191849236 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa1b0018b80 con 0x55fd5608c4d0 2024-05-14T09:39:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.078+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1bc040070 con 0x55fd5608c4d0 2024-05-14T09:39:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.078+0000 7fa1aaa00640 1 -- 172.21.15.120:0/2191849236 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fa1b00a9e70 con 0x55fd5608c4d0 2024-05-14T09:39:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.078+0000 7fa1d2e11740 10 client.17277 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.079+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x55fd564630d0 con 0x55fd5608c4d0 2024-05-14T09:39:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.079+0000 7fa1aaa00640 1 -- 172.21.15.120:0/2191849236 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1bc040070 con 0x55fd5608c4d0 2024-05-14T09:39:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.079+0000 7fa1aaa00640 1 -- 172.21.15.120:0/2191849236 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7fa1b0020030 con 0x55fd5608c4d0 2024-05-14T09:39:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.080+0000 7fa1d2e11740 10 client.17277 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.080+0000 7fa1d2e11740 10 client.17277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.080+0000 7fa1d2e11740 20 client.17277 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.080+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd5606bd80 0x55fd564667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.080+0000 7fa1d2e11740 4 client.17277 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:39:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.080+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd563c1160 con 0x55fd5606bd80 2024-05-14T09:39:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.081+0000 7fa1c9400640 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd5606bd80 0x55fd564667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.084+0000 7fa1c9400640 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd5606bd80 0x55fd564667d0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f933fb3ba2a4a8b server_cookie=e33713e5dd1dec0a in_seq=0 out_seq=0 2024-05-14T09:39:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.084+0000 7fa1aaa00640 10 client.17277 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.085+0000 7fa1aaa00640 1 -- 172.21.15.120:0/2191849236 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd563c1160 con 0x55fd5606bd80 2024-05-14T09:39:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.085+0000 7fa1aaa00640 10 client.17277 handle_command_reply: tid=0 2024-05-14T09:39:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.086+0000 7fa1d2e11740 1 client.17277 shutdown 2024-05-14T09:39:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.086+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 msgr2=0x55fd564593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.086+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd564593e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00a9700 tx=0x7fa1b000fca0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.086+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 shutdown_connections 2024-05-14T09:39:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.086+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd5606bd80 0x55fd564667d0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd56460340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd564593e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/2191849236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56458ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1aaa00640 0 client.17277 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 >> 172.21.15.120:0/2191849236 conn(0x55fd560a1300 msgr2=0x55fd56449c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 shutdown_connections 2024-05-14T09:39:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1d2e11740 1 -- 172.21.15.120:0/2191849236 wait complete. 2024-05-14T09:39:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.087+0000 7fa1d2e11740 20 client.17277 trim_cache size 0 max 16384 2024-05-14T09:39:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 Processor -- start 2024-05-14T09:39:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 -- start start 2024-05-14T09:39:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56457e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56460260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5646b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41bb5b0 con 0x55fd5608c4d0 2024-05-14T09:39:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41bd210 con 0x55fd560ad1b0 2024-05-14T09:39:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.128+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41bbc80 con 0x55fd560842f0 2024-05-14T09:39:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.129+0000 7fa1c8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56460260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.129+0000 7fa1c8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56460260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56444/0 (socket says 172.21.15.120:56444) 2024-05-14T09:39:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.129+0000 7fa1c8a00640 1 -- 172.21.15.120:0/3419315628 learned_addr learned my addr 172.21.15.120:0/3419315628 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.129+0000 7fa1ca800640 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5646b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.129+0000 7fa1c9400640 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56457e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.130+0000 7fa1c8a00640 1 -- 172.21.15.120:0/3419315628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 msgr2=0x55fd56457e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.130+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56457e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.130+0000 7fa1c8a00640 1 -- 172.21.15.120:0/3419315628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 msgr2=0x55fd5646b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.130+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5646b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.130+0000 7fa1c8a00640 1 -- 172.21.15.120:0/3419315628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd564464a0 con 0x55fd5608c4d0 2024-05-14T09:39:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.131+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56460260 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0004770 tx=0x7fa1b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f40837c0c11f97 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.131+0000 7fa1b5c00640 1 -- 172.21.15.120:0/3419315628 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00e2040 con 0x55fd5608c4d0 2024-05-14T09:39:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.132+0000 7fa1b5c00640 1 -- 172.21.15.120:0/3419315628 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1b00adb20 con 0x55fd5608c4d0 2024-05-14T09:39:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.132+0000 7fa1b5c00640 1 -- 172.21.15.120:0/3419315628 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00a50e0 con 0x55fd5608c4d0 2024-05-14T09:39:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.133+0000 7fa1d2e11740 1 -- 172.21.15.120:0/3419315628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 msgr2=0x55fd56460260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.133+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56460260 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0004770 tx=0x7fa1b0000bc0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.133+0000 7fa1d2e11740 1 -- 172.21.15.120:0/3419315628 shutdown_connections 2024-05-14T09:39:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.133+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560ad1b0 0x55fd5646b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.133+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd56460260 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.133+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/3419315628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560842f0 0x55fd56457e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.134+0000 7fa1d2e11740 1 -- 172.21.15.120:0/3419315628 >> 172.21.15.120:0/3419315628 conn(0x55fd560a1300 msgr2=0x55fd56457710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.134+0000 7fa1d2e11740 1 -- 172.21.15.120:0/3419315628 shutdown_connections 2024-05-14T09:39:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.134+0000 7fa1d2e11740 1 -- 172.21.15.120:0/3419315628 wait complete. 2024-05-14T09:39:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.134+0000 7fa1d2e11740 1 -- start start 2024-05-14T09:39:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.135+0000 7fa1d2e11740 1 Processor -- start 2024-05-14T09:39:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560842f0 0x55fd5645d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd5645da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1d2e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560ad1b0 0x55fd5645e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41bca80 con 0x55fd5608c4d0 2024-05-14T09:39:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41bc350 con 0x55fd560842f0 2024-05-14T09:39:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1d2e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41b95b0 con 0x55fd560ad1b0 2024-05-14T09:39:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1d2e11740 10 client.0 _ll_register_callbacks cb 0x7fa1b00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1c8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd5645da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.136+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560842f0 0x55fd5645d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.137+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560842f0 0x55fd5645d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:38082/0 (socket says 172.21.15.120:38082) 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.137+0000 7fa1c9400640 1 -- 172.21.15.120:0/435891651 learned_addr learned my addr 172.21.15.120:0/435891651 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.137+0000 7fa1ca800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560ad1b0 0x55fd5645e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1c8a00640 1 -- 172.21.15.120:0/435891651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560ad1b0 msgr2=0x55fd5645e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560ad1b0 0x55fd5645e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1c8a00640 1 -- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560842f0 msgr2=0x55fd5645d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560842f0 0x55fd5645d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1c8a00640 1 -- 172.21.15.120:0/435891651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd5645ef10 con 0x55fd5608c4d0 2024-05-14T09:39:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1c9400640 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560842f0 0x55fd5645d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:39:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1c8a00640 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd5645da20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00a9470 tx=0x7fa1b00b2740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193f711fc33a6ecd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.138+0000 7fa1aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:39:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.139+0000 7fa1aaa00640 1 -- 172.21.15.120:0/435891651 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00e2040 con 0x55fd5608c4d0 2024-05-14T09:39:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.139+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b00adb20 con 0x55fd5608c4d0 2024-05-14T09:39:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.139+0000 7fa1aaa00640 1 -- 172.21.15.120:0/435891651 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa1b00a52f0 con 0x55fd5608c4d0 2024-05-14T09:39:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.140+0000 7fa1aaa00640 1 -- 172.21.15.120:0/435891651 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fa1b00a5630 con 0x55fd5608c4d0 2024-05-14T09:39:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.140+0000 7fa1d2e11740 10 client.17283 fetch_fsmap learned FSMap version 70 2024-05-14T09:39:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.140+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x55fd564601a0 con 0x55fd5608c4d0 2024-05-14T09:39:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1aaa00640 1 -- 172.21.15.120:0/435891651 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1b00adb20 con 0x55fd5608c4d0 2024-05-14T09:39:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1aaa00640 1 -- 172.21.15.120:0/435891651 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7fa1b0020070 con 0x55fd5608c4d0 2024-05-14T09:39:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1d2e11740 10 client.17283 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:39:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1d2e11740 10 client.17283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:39:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1d2e11740 20 client.17283 populate_metadata read hostname 'smithi120' 2024-05-14T09:39:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd560411c0 0x55fd564d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1d2e11740 4 client.17283 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:39:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.141+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fd563bafd0 con 0x55fd560411c0 2024-05-14T09:39:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.142+0000 7fa1c9400640 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd560411c0 0x55fd564d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.144+0000 7fa1c9400640 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd560411c0 0x55fd564d0e00 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d0b4690ca600f5d server_cookie=63be20b31fb2bb4c in_seq=0 out_seq=0 2024-05-14T09:39:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.144+0000 7fa1aaa00640 10 client.17283 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1aaa00640 1 -- 172.21.15.120:0/435891651 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fd563bafd0 con 0x55fd560411c0 2024-05-14T09:39:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1aaa00640 10 client.17283 handle_command_reply: tid=0 2024-05-14T09:39:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 client.17283 shutdown 2024-05-14T09:39:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 msgr2=0x55fd5645da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd5645da20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00a9470 tx=0x7fa1b00b2740 comp rx=0 tx=0).stop 2024-05-14T09:39:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 shutdown_connections 2024-05-14T09:39:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55fd560411c0 0x55fd564d0e00 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1aaa00640 0 client.17283 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fd560ad1b0 0x55fd5645e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55fd5608c4d0 0x55fd5645da20 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 --2- 172.21.15.120:0/435891651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd560842f0 0x55fd5645d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.168+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 >> 172.21.15.120:0/435891651 conn(0x55fd560a1300 msgr2=0x55fd5644da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.169+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 shutdown_connections 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.169+0000 7fa1d2e11740 1 -- 172.21.15.120:0/435891651 wait complete. 2024-05-14T09:39:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.169+0000 7fa1d2e11740 20 client.17283 trim_cache size 0 max 16384 2024-05-14T09:39:50.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:39:50.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:39:50.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:39:50.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1ac0b29f0 msgr2=0x7fa1ac0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1ac0b29f0 0x7fa1ac0b4f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0096c0 tx=0x7fa1bc03f000 comp rx=0 tx=0).stop 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c410b280 msgr2=0x7fa1c41a93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c410b280 0x7fa1c41a93e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c970 tx=0x7fa1b000ce30 comp rx=0 tx=0).stop 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 shutdown_connections 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa1ac0b29f0 0x7fa1ac0b4f00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1c410ffa0 0x7fa1c41b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c410b280 0x7fa1c41a93e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 --2- 172.21.15.120:0/1373161385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c406c0e0 0x7fa1c41a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.171+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 >> 172.21.15.120:0/1373161385 conn(0x7fa1c40715a0 msgr2=0x7fa1c410bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.172+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 shutdown_connections 2024-05-14T09:39:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:39:50.173+0000 7fa1cbe00640 1 -- 172.21.15.120:0/1373161385 wait complete. 2024-05-14T09:39:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:50 smithi175 ceph-mon[35353]: pgmap v1044: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 778 op/s 2024-05-14T09:39:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:50 smithi120 ceph-mon[31085]: pgmap v1044: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 778 op/s 2024-05-14T09:39:50.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:50 smithi152 ceph-mon[34868]: pgmap v1044: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 778 op/s 2024-05-14T09:39:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:52 smithi175 ceph-mon[35353]: pgmap v1045: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 14 MiB/s wr, 804 op/s 2024-05-14T09:39:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:52 smithi120 ceph-mon[31085]: pgmap v1045: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 14 MiB/s wr, 804 op/s 2024-05-14T09:39:52.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:52 smithi152 ceph-mon[34868]: pgmap v1045: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 14 MiB/s wr, 804 op/s 2024-05-14T09:39:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 740.0 s, 484.8 tps, lat 244.586 ms stddev 284.723 2024-05-14T09:39:54.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:54 smithi120 ceph-mon[31085]: pgmap v1046: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 717 op/s 2024-05-14T09:39:54.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:54 smithi152 ceph-mon[34868]: pgmap v1046: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 717 op/s 2024-05-14T09:39:54.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:54 smithi175 ceph-mon[35353]: pgmap v1046: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 717 op/s 2024-05-14T09:39:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:56 smithi120 ceph-mon[31085]: pgmap v1047: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 745 op/s 2024-05-14T09:39:56.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:56 smithi152 ceph-mon[34868]: pgmap v1047: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 745 op/s 2024-05-14T09:39:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:56 smithi175 ceph-mon[35353]: pgmap v1047: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 745 op/s 2024-05-14T09:39:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:39:58 smithi120 ceph-mon[31085]: pgmap v1048: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 707 op/s 2024-05-14T09:39:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:39:58 smithi152 ceph-mon[34868]: pgmap v1048: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 707 op/s 2024-05-14T09:39:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:39:58 smithi175 ceph-mon[35353]: pgmap v1048: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 707 op/s 2024-05-14T09:39:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 745.0 s, 585.4 tps, lat 174.752 ms stddev 124.751 2024-05-14T09:40:00.263 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[31080]: 2024-05-14T09:39:59.998+0000 7fa7d9e00700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:40:00.263 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:00 smithi120 ceph-mon[31085]: pgmap v1049: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 707 op/s 2024-05-14T09:40:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:00 smithi120 ceph-mon[31085]: overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:40:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:00 smithi152 ceph-mon[34868]: pgmap v1049: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 707 op/s 2024-05-14T09:40:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:00 smithi152 ceph-mon[34868]: overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:40:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:00 smithi175 ceph-mon[35353]: pgmap v1049: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 707 op/s 2024-05-14T09:40:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:00 smithi175 ceph-mon[35353]: overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T09:40:02.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:02 smithi120 ceph-mon[31085]: pgmap v1050: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 687 op/s 2024-05-14T09:40:02.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:02 smithi152 ceph-mon[34868]: pgmap v1050: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 687 op/s 2024-05-14T09:40:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:02 smithi175 ceph-mon[35353]: pgmap v1050: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 687 op/s 2024-05-14T09:40:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.578+0000 7fc36a200640 1 -- 172.21.15.120:0/217292811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075040 msgr2=0x7fc364075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.578+0000 7fc36a200640 1 --2- 172.21.15.120:0/217292811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075040 0x7fc364075450 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc358009900 tx=0x7fc35802a420 comp rx=0 tx=0).stop 2024-05-14T09:40:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.579+0000 7fc36a200640 1 -- 172.21.15.120:0/217292811 shutdown_connections 2024-05-14T09:40:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.579+0000 7fc36a200640 1 --2- 172.21.15.120:0/217292811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 0x7fc364105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.579+0000 7fc36a200640 1 --2- 172.21.15.120:0/217292811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc364075990 0x7fc36410b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.579+0000 7fc36a200640 1 --2- 172.21.15.120:0/217292811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075040 0x7fc364075450 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.579+0000 7fc36a200640 1 -- 172.21.15.120:0/217292811 >> 172.21.15.120:0/217292811 conn(0x7fc3640fec50 msgr2=0x7fc364101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.579+0000 7fc36a200640 1 -- 172.21.15.120:0/217292811 shutdown_connections 2024-05-14T09:40:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.579+0000 7fc36a200640 1 -- 172.21.15.120:0/217292811 wait complete. 2024-05-14T09:40:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 Processor -- start 2024-05-14T09:40:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 -- start start 2024-05-14T09:40:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075990 0x7fc3641a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 0x7fc3641a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3641a5c30 0x7fc3641a8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc364115a90 con 0x7fc364075990 2024-05-14T09:40:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc364115910 con 0x7fc3641030e0 2024-05-14T09:40:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.582+0000 7fc36a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc364115c10 con 0x7fc3641a5c30 2024-05-14T09:40:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.584+0000 7fc363e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 0x7fc3641a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.584+0000 7fc368e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075990 0x7fc3641a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.584+0000 7fc363e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 0x7fc3641a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:40908/0 (socket says 172.21.15.120:40908) 2024-05-14T09:40:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.584+0000 7fc363e00640 1 -- 172.21.15.120:0/1954781864 learned_addr learned my addr 172.21.15.120:0/1954781864 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc369800640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3641a5c30 0x7fc3641a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc368e00640 1 -- 172.21.15.120:0/1954781864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3641a5c30 msgr2=0x7fc3641a8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc368e00640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3641a5c30 0x7fc3641a8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc368e00640 1 -- 172.21.15.120:0/1954781864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 msgr2=0x7fc3641a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc368e00640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 0x7fc3641a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc368e00640 1 -- 172.21.15.120:0/1954781864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36410bb80 con 0x7fc364075990 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc363e00640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 0x7fc3641a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc369800640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3641a5c30 0x7fc3641a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.585+0000 7fc368e00640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075990 0x7fc3641a07c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc364075010 tx=0x7fc3580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.586+0000 7fc361600640 1 -- 172.21.15.120:0/1954781864 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358040030 con 0x7fc364075990 2024-05-14T09:40:03.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.586+0000 7fc361600640 1 -- 172.21.15.120:0/1954781864 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc35803c8d0 con 0x7fc364075990 2024-05-14T09:40:03.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.586+0000 7fc361600640 1 -- 172.21.15.120:0/1954781864 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358031830 con 0x7fc364075990 2024-05-14T09:40:03.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.586+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36410be10 con 0x7fc364075990 2024-05-14T09:40:03.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.586+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36410c280 con 0x7fc364075990 2024-05-14T09:40:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.600+0000 7fc361600640 1 -- 172.21.15.120:0/1954781864 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fc358043030 con 0x7fc364075990 2024-05-14T09:40:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.600+0000 7fc37279e740 1 Processor -- start 2024-05-14T09:40:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.601+0000 7fc37279e740 1 -- start start 2024-05-14T09:40:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.606+0000 7fc37279e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f4a1b0 0x557e942ec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.606+0000 7fc37279e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f212f0 0x557e942ec8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.606+0000 7fc37279e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f294d0 0x557e942f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.606+0000 7fc37279e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557e94250550 con 0x557e93f4a1b0 2024-05-14T09:40:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.606+0000 7fc37279e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557e941f5bc0 con 0x557e93f212f0 2024-05-14T09:40:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.606+0000 7fc37279e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557e9424c510 con 0x557e93f294d0 2024-05-14T09:40:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.606+0000 7fc361600640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc34c0b2930 0x7fc34c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.607+0000 7fc368e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f212f0 0x557e942ec8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.607+0000 7fc369800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f4a1b0 0x557e942ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.607+0000 7fc369800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f4a1b0 0x557e942ec330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41780/0 (socket says 172.21.15.120:41780) 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.607+0000 7fc369800640 1 -- 172.21.15.120:0/411741724 learned_addr learned my addr 172.21.15.120:0/411741724 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.607+0000 7fc369800640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc34c0b2930 0x7fc34c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.607+0000 7fc363e00640 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f294d0 0x557e942f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.608+0000 7fc363e00640 1 -- 172.21.15.120:0/411741724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f212f0 msgr2=0x557e942ec8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.608+0000 7fc363e00640 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f212f0 0x557e942ec8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.608+0000 7fc363e00640 1 -- 172.21.15.120:0/411741724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f4a1b0 msgr2=0x557e942ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.608+0000 7fc363e00640 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f4a1b0 0x557e942ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.608+0000 7fc363e00640 1 -- 172.21.15.120:0/411741724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e93f62210 con 0x557e93f294d0 2024-05-14T09:40:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.608+0000 7fc368e00640 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f212f0 0x557e942ec8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:40:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.609+0000 7fc369800640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc34c0b2930 0x7fc34c0b4e40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0148a0 tx=0x7fc35c0099d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.607+0000 7fc361600640 1 -- 172.21.15.120:0/1954781864 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc358102f30 con 0x7fc364075990 2024-05-14T09:40:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.610+0000 7fc363e00640 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f294d0 0x557e942f37b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3500058c0 tx=0x7fc3500109e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35ec45c2fdffadfa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.611+0000 7fc356000640 1 -- 172.21.15.120:0/411741724 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500117c0 con 0x557e93f294d0 2024-05-14T09:40:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.611+0000 7fc356000640 1 -- 172.21.15.120:0/411741724 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc350011df0 con 0x557e93f294d0 2024-05-14T09:40:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.611+0000 7fc356000640 1 -- 172.21.15.120:0/411741724 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35000ed30 con 0x557e93f294d0 2024-05-14T09:40:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.613+0000 7fc37279e740 1 -- 172.21.15.120:0/411741724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f294d0 msgr2=0x557e942f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.613+0000 7fc37279e740 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f294d0 0x557e942f37b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3500058c0 tx=0x7fc3500109e0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.614+0000 7fc37279e740 1 -- 172.21.15.120:0/411741724 shutdown_connections 2024-05-14T09:40:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.614+0000 7fc37279e740 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f294d0 0x557e942f37b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.614+0000 7fc37279e740 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f212f0 0x557e942ec8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.614+0000 7fc37279e740 1 --2- 172.21.15.120:0/411741724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f4a1b0 0x557e942ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.614+0000 7fc37279e740 1 -- 172.21.15.120:0/411741724 >> 172.21.15.120:0/411741724 conn(0x557e93f3e300 msgr2=0x557e942e7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.615+0000 7fc37279e740 1 -- 172.21.15.120:0/411741724 shutdown_connections 2024-05-14T09:40:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.615+0000 7fc37279e740 1 -- 172.21.15.120:0/411741724 wait complete. 2024-05-14T09:40:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.616+0000 7fc37279e740 1 -- start start 2024-05-14T09:40:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.617+0000 7fc37279e740 1 Processor -- start 2024-05-14T09:40:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.618+0000 7fc37279e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f212f0 0x557e942f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.618+0000 7fc37279e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f294d0 0x557e942f6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.618+0000 7fc37279e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.618+0000 7fc37279e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557e942f4200 con 0x557e93f294d0 2024-05-14T09:40:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.618+0000 7fc37279e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557e94209660 con 0x557e93f4a1b0 2024-05-14T09:40:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.618+0000 7fc37279e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557e942f4380 con 0x557e93f212f0 2024-05-14T09:40:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.618+0000 7fc37279e740 10 client.0 _ll_register_callbacks cb 0x557e941d3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.619+0000 7fc363e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f294d0 0x557e942f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.620+0000 7fc368e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f212f0 0x557e942f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.620+0000 7fc363e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f294d0 0x557e942f6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41796/0 (socket says 172.21.15.120:41796) 2024-05-14T09:40:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.620+0000 7fc363e00640 1 -- 172.21.15.120:0/1101547021 learned_addr learned my addr 172.21.15.120:0/1101547021 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.620+0000 7fc369800640 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.621+0000 7fc363e00640 1 -- 172.21.15.120:0/1101547021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f212f0 msgr2=0x557e942f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.621+0000 7fc363e00640 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f212f0 0x557e942f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.621+0000 7fc363e00640 1 -- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 msgr2=0x557e942fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.621+0000 7fc363e00640 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.621+0000 7fc363e00640 1 -- 172.21.15.120:0/1101547021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9402e620 con 0x557e93f294d0 2024-05-14T09:40:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.621+0000 7fc368e00640 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f212f0 0x557e942f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:40:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.622+0000 7fc363e00640 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f294d0 0x557e942f6370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc35000e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7265fb9d413e119e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.622+0000 7fc34aa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:40:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.623+0000 7fc34aa00640 1 -- 172.21.15.120:0/1101547021 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350004030 con 0x557e93f294d0 2024-05-14T09:40:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.623+0000 7fc34aa00640 1 -- 172.21.15.120:0/1101547021 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc3500041d0 con 0x557e93f294d0 2024-05-14T09:40:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.623+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc350011df0 con 0x557e93f294d0 2024-05-14T09:40:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.623+0000 7fc34aa00640 1 -- 172.21.15.120:0/1101547021 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fc3500043d0 con 0x557e93f294d0 2024-05-14T09:40:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.623+0000 7fc37279e740 10 client.17295 fetch_fsmap learned FSMap version 70 2024-05-14T09:40:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.623+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x557e94300170 con 0x557e93f294d0 2024-05-14T09:40:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.624+0000 7fc34aa00640 1 -- 172.21.15.120:0/1101547021 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc350011df0 con 0x557e93f294d0 2024-05-14T09:40:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.625+0000 7fc34aa00640 1 -- 172.21.15.120:0/1101547021 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7fc3500119b0 con 0x557e93f294d0 2024-05-14T09:40:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.625+0000 7fc37279e740 10 client.17295 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:40:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.625+0000 7fc37279e740 10 client.17295 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.626+0000 7fc37279e740 20 client.17295 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.626+0000 7fc37279e740 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e93f08d80 0x557e94303660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.626+0000 7fc37279e740 4 client.17295 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:40:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.626+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e9425e160 con 0x557e93f08d80 2024-05-14T09:40:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.628+0000 7fc368e00640 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e93f08d80 0x557e94303660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.629+0000 7fc368e00640 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e93f08d80 0x557e94303660 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7464acd729c97ae server_cookie=7cd0468aa85095c in_seq=0 out_seq=0 2024-05-14T09:40:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.629+0000 7fc34aa00640 10 client.17295 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.631+0000 7fc34aa00640 1 -- 172.21.15.120:0/1101547021 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e9425e160 con 0x557e93f08d80 2024-05-14T09:40:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.631+0000 7fc34aa00640 10 client.17295 handle_command_reply: tid=0 2024-05-14T09:40:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.631+0000 7fc37279e740 1 client.17295 shutdown 2024-05-14T09:40:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.631+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f294d0 msgr2=0x557e942f6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.631+0000 7fc37279e740 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f294d0 0x557e942f6370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc35000e6d0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.632+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 shutdown_connections 2024-05-14T09:40:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.632+0000 7fc37279e740 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e93f08d80 0x557e94303660 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.632+0000 7fc37279e740 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.632+0000 7fc37279e740 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f294d0 0x557e942f6370 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.632+0000 7fc37279e740 1 --2- 172.21.15.120:0/1101547021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93f212f0 0x557e942f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.632+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 >> 172.21.15.120:0/1101547021 conn(0x557e93f3e300 msgr2=0x557e942eabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.633+0000 7fc34aa00640 0 client.17295 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.633+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 shutdown_connections 2024-05-14T09:40:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.633+0000 7fc37279e740 1 -- 172.21.15.120:0/1101547021 wait complete. 2024-05-14T09:40:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.633+0000 7fc37279e740 20 client.17295 trim_cache size 0 max 16384 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 Processor -- start 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 -- start start 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942f0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc3641bbd20 con 0x557e93f212f0 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc3641bd980 con 0x557e93f4a1b0 2024-05-14T09:40:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.664+0000 7fc37279e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3641bc3f0 con 0x557e93ede1c0 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.665+0000 7fc368e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.665+0000 7fc368e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942f0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41804/0 (socket says 172.21.15.120:41804) 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.665+0000 7fc368e00640 1 -- 172.21.15.120:0/3063271139 learned_addr learned my addr 172.21.15.120:0/3063271139 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.665+0000 7fc363e00640 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.665+0000 7fc369800640 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.665+0000 7fc368e00640 1 -- 172.21.15.120:0/3063271139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 msgr2=0x557e942fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.665+0000 7fc368e00640 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.666+0000 7fc368e00640 1 -- 172.21.15.120:0/3063271139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 msgr2=0x557e942f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.666+0000 7fc368e00640 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.666+0000 7fc368e00640 1 -- 172.21.15.120:0/3063271139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e942e34a0 con 0x557e93f212f0 2024-05-14T09:40:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.666+0000 7fc363e00640 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.666+0000 7fc368e00640 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942f0290 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc3580ca140 tx=0x7fc358100560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fc59ae3ad747c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.667+0000 7fc355600640 1 -- 172.21.15.120:0/3063271139 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580e3070 con 0x557e93f212f0 2024-05-14T09:40:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.667+0000 7fc355600640 1 -- 172.21.15.120:0/3063271139 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3580ca1b0 con 0x557e93f212f0 2024-05-14T09:40:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.667+0000 7fc355600640 1 -- 172.21.15.120:0/3063271139 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35804a040 con 0x557e93f212f0 2024-05-14T09:40:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.668+0000 7fc37279e740 1 -- 172.21.15.120:0/3063271139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 msgr2=0x557e942f0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.668+0000 7fc37279e740 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942f0290 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc3580ca140 tx=0x7fc358100560 comp rx=0 tx=0).stop 2024-05-14T09:40:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.669+0000 7fc37279e740 1 -- 172.21.15.120:0/3063271139 shutdown_connections 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.669+0000 7fc37279e740 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.669+0000 7fc37279e740 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.669+0000 7fc37279e740 1 --2- 172.21.15.120:0/3063271139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942f0290 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.669+0000 7fc37279e740 1 -- 172.21.15.120:0/3063271139 >> 172.21.15.120:0/3063271139 conn(0x557e93f3e300 msgr2=0x557e942ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.669+0000 7fc37279e740 1 -- 172.21.15.120:0/3063271139 shutdown_connections 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.669+0000 7fc37279e740 1 -- 172.21.15.120:0/3063271139 wait complete. 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.670+0000 7fc37279e740 1 -- start start 2024-05-14T09:40:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.670+0000 7fc37279e740 1 Processor -- start 2024-05-14T09:40:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.671+0000 7fc37279e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.671+0000 7fc37279e740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942fa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.671+0000 7fc37279e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.671+0000 7fc37279e740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc3641bd1f0 con 0x557e93f212f0 2024-05-14T09:40:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.671+0000 7fc37279e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc3641bcac0 con 0x557e93f4a1b0 2024-05-14T09:40:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.671+0000 7fc37279e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc364114000 con 0x557e93ede1c0 2024-05-14T09:40:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.671+0000 7fc37279e740 10 client.0 _ll_register_callbacks cb 0x7fc3500103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.672+0000 7fc363e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.672+0000 7fc363e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942fa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41816/0 (socket says 172.21.15.120:41816) 2024-05-14T09:40:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.672+0000 7fc363e00640 1 -- 172.21.15.120:0/1906058279 learned_addr learned my addr 172.21.15.120:0/1906058279 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.672+0000 7fc368e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.672+0000 7fc369800640 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.673+0000 7fc363e00640 1 -- 172.21.15.120:0/1906058279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 msgr2=0x557e942fd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.673+0000 7fc363e00640 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.673+0000 7fc363e00640 1 -- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 msgr2=0x557e942fa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.673+0000 7fc363e00640 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.673+0000 7fc363e00640 1 -- 172.21.15.120:0/1906058279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e943699c0 con 0x557e93f212f0 2024-05-14T09:40:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.676+0000 7fc363e00640 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942fa400 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc350005c60 tx=0x7fc350005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2d1e0ad16d6f6e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.676+0000 7fc34aa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:40:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.676+0000 7fc34aa00640 1 -- 172.21.15.120:0/1906058279 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35003d030 con 0x557e93f212f0 2024-05-14T09:40:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.677+0000 7fc34aa00640 1 -- 172.21.15.120:0/1906058279 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc350034040 con 0x557e93f212f0 2024-05-14T09:40:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.677+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3580ca1b0 con 0x557e93f212f0 2024-05-14T09:40:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.677+0000 7fc34aa00640 1 -- 172.21.15.120:0/1906058279 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fc350047050 con 0x557e93f212f0 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.678+0000 7fc37279e740 10 client.17301 fetch_fsmap learned FSMap version 70 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.678+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x557e9437bac0 con 0x557e93f212f0 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc34aa00640 1 -- 172.21.15.120:0/1906058279 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc350011a50 con 0x557e93f212f0 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc34aa00640 1 -- 172.21.15.120:0/1906058279 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7fc3500035f0 con 0x557e93f212f0 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc37279e740 10 client.17301 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc37279e740 10 client.17301 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc37279e740 20 client.17301 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc37279e740 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e9437c530 0x557e9437e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc37279e740 4 client.17301 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:40:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.679+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fc3580ca1b0 con 0x557e9437c530 2024-05-14T09:40:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.681+0000 7fc368e00640 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e9437c530 0x557e9437e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.684+0000 7fc368e00640 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e9437c530 0x557e9437e950 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a10db21690613d server_cookie=28b33df37c842fef in_seq=0 out_seq=0 2024-05-14T09:40:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.685+0000 7fc34aa00640 10 client.17301 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.706+0000 7fc34aa00640 1 -- 172.21.15.120:0/1906058279 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fc3580ca1b0 con 0x557e9437c530 2024-05-14T09:40:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.706+0000 7fc34aa00640 10 client.17301 handle_command_reply: tid=0 2024-05-14T09:40:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.706+0000 7fc37279e740 1 client.17301 shutdown 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 msgr2=0x557e942fa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942fa400 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc350005c60 tx=0x7fc350005fa0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 shutdown_connections 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x557e9437c530 0x557e9437e950 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557e93f4a1b0 0x557e942fa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc34aa00640 0 client.17301 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557e93f212f0 0x557e942fa400 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 --2- 172.21.15.120:0/1906058279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e93ede1c0 0x557e942fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.707+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 >> 172.21.15.120:0/1906058279 conn(0x557e93f3e300 msgr2=0x557e942ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.708+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 shutdown_connections 2024-05-14T09:40:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.708+0000 7fc37279e740 1 -- 172.21.15.120:0/1906058279 wait complete. 2024-05-14T09:40:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.708+0000 7fc37279e740 20 client.17301 trim_cache size 0 max 16384 2024-05-14T09:40:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:40:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:40:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:40:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:40:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.709+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc34c0b2930 msgr2=0x7fc34c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.709+0000 7fc36a200640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc34c0b2930 0x7fc34c0b4e40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0148a0 tx=0x7fc35c0099d0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.709+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075990 msgr2=0x7fc3641a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.709+0000 7fc36a200640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075990 0x7fc3641a07c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc364075010 tx=0x7fc3580042f0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 shutdown_connections 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc34c0b2930 0x7fc34c0b4e40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3641a5c30 0x7fc3641a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3641030e0 0x7fc3641a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 --2- 172.21.15.120:0/1954781864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc364075990 0x7fc3641a07c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 >> 172.21.15.120:0/1954781864 conn(0x7fc3640fec50 msgr2=0x7fc3640ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 shutdown_connections 2024-05-14T09:40:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:03.710+0000 7fc36a200640 1 -- 172.21.15.120:0/1954781864 wait complete. 2024-05-14T09:40:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 750.0 s, 611.8 tps, lat 164.061 ms stddev 89.011 2024-05-14T09:40:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:04 smithi120 ceph-mon[31085]: pgmap v1051: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.9 MiB/s wr, 597 op/s 2024-05-14T09:40:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:04 smithi152 ceph-mon[34868]: pgmap v1051: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.9 MiB/s wr, 597 op/s 2024-05-14T09:40:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:04 smithi175 ceph-mon[35353]: pgmap v1051: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.9 MiB/s wr, 597 op/s 2024-05-14T09:40:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:06 smithi120 ceph-mon[31085]: pgmap v1052: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 652 op/s 2024-05-14T09:40:06.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:06 smithi152 ceph-mon[34868]: pgmap v1052: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 652 op/s 2024-05-14T09:40:06.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:06 smithi175 ceph-mon[35353]: pgmap v1052: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 652 op/s 2024-05-14T09:40:07.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:07 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:40:07.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:07 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:40:07.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:07 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:40:08.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:08 smithi120 ceph-mon[31085]: pgmap v1053: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.8 MiB/s wr, 635 op/s 2024-05-14T09:40:08.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:08.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:08 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:08 smithi152 ceph-mon[34868]: pgmap v1053: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.8 MiB/s wr, 635 op/s 2024-05-14T09:40:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:08 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:08 smithi175 ceph-mon[35353]: pgmap v1053: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.8 MiB/s wr, 635 op/s 2024-05-14T09:40:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:08 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:09.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 755.0 s, 464.8 tps, lat 213.082 ms stddev 138.736 2024-05-14T09:40:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:09 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:09.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:09 smithi152 ceph-mon[34868]: pgmap v1054: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 9.8 MiB/s wr, 656 op/s 2024-05-14T09:40:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:09 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:10.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:09 smithi120 ceph-mon[31085]: pgmap v1054: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 9.8 MiB/s wr, 656 op/s 2024-05-14T09:40:10.229 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:10.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:09 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:10.230 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:09 smithi175 ceph-mon[35353]: pgmap v1054: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 9.8 MiB/s wr, 656 op/s 2024-05-14T09:40:11.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:40:11.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:40:11.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:10 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:11.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:40:11.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:40:11.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:10 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:40:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:40:11.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:10 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:40:12.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:11 smithi175 ceph-mon[35353]: pgmap v1055: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.4 MiB/s wr, 657 op/s 2024-05-14T09:40:12.134 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:11 smithi120 ceph-mon[31085]: pgmap v1055: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.4 MiB/s wr, 657 op/s 2024-05-14T09:40:12.208 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:11 smithi152 ceph-mon[34868]: pgmap v1055: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.4 MiB/s wr, 657 op/s 2024-05-14T09:40:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 760.0 s, 520.0 tps, lat 193.034 ms stddev 127.190 2024-05-14T09:40:14.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:14 smithi120 ceph-mon[31085]: pgmap v1056: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.6 MiB/s wr, 620 op/s 2024-05-14T09:40:14.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:14 smithi152 ceph-mon[34868]: pgmap v1056: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.6 MiB/s wr, 620 op/s 2024-05-14T09:40:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:14 smithi175 ceph-mon[35353]: pgmap v1056: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.6 MiB/s wr, 620 op/s 2024-05-14T09:40:16.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:16 smithi120 ceph-mon[31085]: pgmap v1057: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.9 MiB/s wr, 662 op/s 2024-05-14T09:40:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:16 smithi152 ceph-mon[34868]: pgmap v1057: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.9 MiB/s wr, 662 op/s 2024-05-14T09:40:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:16 smithi175 ceph-mon[35353]: pgmap v1057: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.9 MiB/s wr, 662 op/s 2024-05-14T09:40:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:16.999+0000 7f598fa00640 1 -- 172.21.15.120:0/3836926252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 msgr2=0x7f598810bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:16.999+0000 7f598fa00640 1 --2- 172.21.15.120:0/3836926252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f598810bfe0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5980009be0 tx=0x7f598002a6d0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.000+0000 7f598fa00640 1 -- 172.21.15.120:0/3836926252 shutdown_connections 2024-05-14T09:40:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.000+0000 7f598fa00640 1 --2- 172.21.15.120:0/3836926252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f598810bfe0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.000+0000 7f598fa00640 1 --2- 172.21.15.120:0/3836926252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5988104ec0 0x7f59881052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.000+0000 7f598fa00640 1 --2- 172.21.15.120:0/3836926252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5988103c80 0x7f5988104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.000+0000 7f598fa00640 1 -- 172.21.15.120:0/3836926252 >> 172.21.15.120:0/3836926252 conn(0x7f59880fee50 msgr2=0x7f5988101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.001+0000 7f598fa00640 1 -- 172.21.15.120:0/3836926252 shutdown_connections 2024-05-14T09:40:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.001+0000 7f598fa00640 1 -- 172.21.15.120:0/3836926252 wait complete. 2024-05-14T09:40:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.002+0000 7f598fa00640 1 Processor -- start 2024-05-14T09:40:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.003+0000 7f598fa00640 1 -- start start 2024-05-14T09:40:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.003+0000 7f598fa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5988103c80 0x7f5988071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.003+0000 7f598fa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5988104ec0 0x7f5988072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.003+0000 7f598fa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f5988073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.003+0000 7f598fa00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f598810f640 con 0x7f5988109bc0 2024-05-14T09:40:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.003+0000 7f598fa00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f598810f4c0 con 0x7f5988104ec0 2024-05-14T09:40:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.003+0000 7f598fa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f598810f7c0 con 0x7f5988103c80 2024-05-14T09:40:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f5988073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f5988073080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45956/0 (socket says 172.21.15.120:45956) 2024-05-14T09:40:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 -- 172.21.15.120:0/3943206645 learned_addr learned my addr 172.21.15.120:0/3943206645 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598d000640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5988103c80 0x7f5988071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 -- 172.21.15.120:0/3943206645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5988103c80 msgr2=0x7f5988071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5988103c80 0x7f5988071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 -- 172.21.15.120:0/3943206645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5988104ec0 msgr2=0x7f5988072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5988104ec0 0x7f5988072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.004+0000 7f598da00640 1 -- 172.21.15.120:0/3943206645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59880736f0 con 0x7f5988109bc0 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.005+0000 7f598da00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f5988073080 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5980031f40 tx=0x7f5980030b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.006+0000 7f5985600640 1 -- 172.21.15.120:0/3943206645 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980049020 con 0x7f5988109bc0 2024-05-14T09:40:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.006+0000 7f5985600640 1 -- 172.21.15.120:0/3943206645 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5980037040 con 0x7f5988109bc0 2024-05-14T09:40:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.006+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5988073980 con 0x7f5988109bc0 2024-05-14T09:40:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.006+0000 7f5985600640 1 -- 172.21.15.120:0/3943206645 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980036070 con 0x7f5988109bc0 2024-05-14T09:40:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.006+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5988073e70 con 0x7f5988109bc0 2024-05-14T09:40:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.013+0000 7f59969f9740 1 Processor -- start 2024-05-14T09:40:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f5985600640 1 -- 172.21.15.120:0/3943206645 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f598004c020 con 0x7f5988109bc0 2024-05-14T09:40:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f59969f9740 1 -- start start 2024-05-14T09:40:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f59969f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a69100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f59969f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a69680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f59969f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a70580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f59969f9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556dc69cd550 con 0x556dc66c71b0 2024-05-14T09:40:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f59969f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556dc6972bc0 con 0x556dc66a64d0 2024-05-14T09:40:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.015+0000 7f59969f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556dc69c9510 con 0x556dc669e2f0 2024-05-14T09:40:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.018+0000 7f5985600640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f596c0b29b0 0x7f596c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.018+0000 7f5985600640 1 -- 172.21.15.120:0/3943206645 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5980045e00 con 0x7f5988109bc0 2024-05-14T09:40:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.019+0000 7f598da00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f596c0b29b0 0x7f596c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.019+0000 7f598d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a69680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.021+0000 7f598d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a69680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:47284/0 (socket says 172.21.15.120:47284) 2024-05-14T09:40:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.021+0000 7f598d000640 1 -- 172.21.15.120:0/3455849173 learned_addr learned my addr 172.21.15.120:0/3455849173 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.021+0000 7f5987e00640 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a70580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.021+0000 7f5987e00640 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a69100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.023+0000 7f5987e00640 1 -- 172.21.15.120:0/3455849173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 msgr2=0x556dc6a69680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.023+0000 7f5987e00640 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a69680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.023+0000 7f5987e00640 1 -- 172.21.15.120:0/3455849173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 msgr2=0x556dc6a70580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.023+0000 7f5987e00640 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a70580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.023+0000 7f5987e00640 1 -- 172.21.15.120:0/3455849173 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc66df210 con 0x556dc66c71b0 2024-05-14T09:40:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.023+0000 7f598da00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f596c0b29b0 0x7f596c0b4ec0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5980004af0 tx=0x7f5980030db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:17.027 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.026+0000 7f5987e00640 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a69100 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5988072c80 tx=0x7f5974005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef74cf74fdf09e94 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.027+0000 7f597e000640 1 -- 172.21.15.120:0/3455849173 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974018020 con 0x556dc66c71b0 2024-05-14T09:40:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.027+0000 7f597e000640 1 -- 172.21.15.120:0/3455849173 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5974004240 con 0x556dc66c71b0 2024-05-14T09:40:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.027+0000 7f597e000640 1 -- 172.21.15.120:0/3455849173 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597400f690 con 0x556dc66c71b0 2024-05-14T09:40:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.029+0000 7f59969f9740 1 -- 172.21.15.120:0/3455849173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 msgr2=0x556dc6a69100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.029+0000 7f59969f9740 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a69100 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5988072c80 tx=0x7f5974005850 comp rx=0 tx=0).stop 2024-05-14T09:40:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.030+0000 7f59969f9740 1 -- 172.21.15.120:0/3455849173 shutdown_connections 2024-05-14T09:40:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.030+0000 7f59969f9740 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a70580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.030+0000 7f59969f9740 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a69680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.030+0000 7f59969f9740 1 --2- 172.21.15.120:0/3455849173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a69100 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.030+0000 7f59969f9740 1 -- 172.21.15.120:0/3455849173 >> 172.21.15.120:0/3455849173 conn(0x556dc66bb300 msgr2=0x556dc6a64a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.032+0000 7f59969f9740 1 -- 172.21.15.120:0/3455849173 shutdown_connections 2024-05-14T09:40:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.033+0000 7f59969f9740 1 -- 172.21.15.120:0/3455849173 wait complete. 2024-05-14T09:40:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.034+0000 7f59969f9740 1 -- start start 2024-05-14T09:40:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.034+0000 7f59969f9740 1 Processor -- start 2024-05-14T09:40:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f59969f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc669e2f0 0x556dc6a83c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f59969f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66a64d0 0x556dc6a84140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f59969f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66c71b0 0x556dc6a8b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f59969f9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556dc6a81fe0 con 0x556dc669e2f0 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f59969f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556dc6986660 con 0x556dc66c71b0 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f59969f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556dc6a82160 con 0x556dc66a64d0 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f59969f9740 10 client.0 _ll_register_callbacks cb 0x556dc6950400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f598d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66a64d0 0x556dc6a84140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f598d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66a64d0 0x556dc6a84140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:47300/0 (socket says 172.21.15.120:47300) 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.035+0000 7f598d000640 1 -- 172.21.15.120:0/3816640116 learned_addr learned my addr 172.21.15.120:0/3816640116 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.036+0000 7f5987e00640 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc669e2f0 0x556dc6a83c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.036+0000 7f598d000640 1 -- 172.21.15.120:0/3816640116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66c71b0 msgr2=0x556dc6a8b0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:40:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.037+0000 7f598d000640 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66c71b0 0x556dc6a8b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.037+0000 7f598d000640 1 -- 172.21.15.120:0/3816640116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc669e2f0 msgr2=0x556dc6a83c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.037+0000 7f598d000640 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc669e2f0 0x556dc6a83c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.037+0000 7f598d000640 1 -- 172.21.15.120:0/3816640116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc67ab620 con 0x556dc66a64d0 2024-05-14T09:40:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.037+0000 7f598d000640 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66a64d0 0x556dc6a84140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59780136e0 tx=0x7f5978013ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e83e77371d0472 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.037+0000 7f5972a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:40:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.038+0000 7f5972a00640 1 -- 172.21.15.120:0/3816640116 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978011dd0 con 0x556dc66a64d0 2024-05-14T09:40:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.038+0000 7f5972a00640 1 -- 172.21.15.120:0/3816640116 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f5978004030 con 0x556dc66a64d0 2024-05-14T09:40:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.039+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5974004240 con 0x556dc66a64d0 2024-05-14T09:40:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.042+0000 7f5972a00640 1 -- 172.21.15.120:0/3816640116 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f5978004270 con 0x556dc66a64d0 2024-05-14T09:40:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.042+0000 7f59969f9740 10 client.26893 fetch_fsmap learned FSMap version 70 2024-05-14T09:40:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.042+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x556dc6a70e00 con 0x556dc66a64d0 2024-05-14T09:40:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f5972a00640 1 -- 172.21.15.120:0/3816640116 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5974004240 con 0x556dc66a64d0 2024-05-14T09:40:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f5972a00640 1 -- 172.21.15.120:0/3816640116 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7f597801a070 con 0x556dc66a64d0 2024-05-14T09:40:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f59969f9740 10 client.26893 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:40:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f59969f9740 10 client.26893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f59969f9740 20 client.26893 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f59969f9740 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc6685d80 0x556dc6a746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f59969f9740 4 client.26893 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:40:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.043+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dc69db160 con 0x556dc6685d80 2024-05-14T09:40:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.046+0000 7f5987e00640 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc6685d80 0x556dc6a746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.047+0000 7f5987e00640 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc6685d80 0x556dc6a746d0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaeae4ca1afc3ce6 server_cookie=6181ff01b515347 in_seq=0 out_seq=0 2024-05-14T09:40:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.048+0000 7f5972a00640 10 client.26893 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.049+0000 7f5972a00640 1 -- 172.21.15.120:0/3816640116 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556dc69db160 con 0x556dc6685d80 2024-05-14T09:40:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.049+0000 7f5972a00640 10 client.26893 handle_command_reply: tid=0 2024-05-14T09:40:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.049+0000 7f59969f9740 1 client.26893 shutdown 2024-05-14T09:40:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66a64d0 msgr2=0x556dc6a84140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66a64d0 0x556dc6a84140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59780136e0 tx=0x7f5978013ba0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 shutdown_connections 2024-05-14T09:40:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc6685d80 0x556dc6a746d0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66c71b0 0x556dc6a8b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66a64d0 0x556dc6a84140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 --2- 172.21.15.120:0/3816640116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc669e2f0 0x556dc6a83c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f5972a00640 0 client.26893 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 >> 172.21.15.120:0/3816640116 conn(0x556dc66bb300 msgr2=0x556dc6a679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 shutdown_connections 2024-05-14T09:40:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.050+0000 7f59969f9740 1 -- 172.21.15.120:0/3816640116 wait complete. 2024-05-14T09:40:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.051+0000 7f59969f9740 20 client.26893 trim_cache size 0 max 16384 2024-05-14T09:40:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.085+0000 7f59969f9740 1 Processor -- start 2024-05-14T09:40:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.085+0000 7f59969f9740 1 -- start start 2024-05-14T09:40:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f59969f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc669e2f0 0x556dc6a6d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f59969f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66a64d0 0x556dc6a6d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f59969f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66c71b0 0x556dc6a8afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f59969f9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f59881b2f80 con 0x556dc66a64d0 2024-05-14T09:40:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f59969f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59881b4be0 con 0x556dc669e2f0 2024-05-14T09:40:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f59969f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59881b3650 con 0x556dc66c71b0 2024-05-14T09:40:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f598d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66a64d0 0x556dc6a6d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f598d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66a64d0 0x556dc6a6d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45980/0 (socket says 172.21.15.120:45980) 2024-05-14T09:40:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f598d000640 1 -- 172.21.15.120:0/517565998 learned_addr learned my addr 172.21.15.120:0/517565998 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.086+0000 7f5987e00640 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66c71b0 0x556dc6a8afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.088+0000 7f598d000640 1 -- 172.21.15.120:0/517565998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66c71b0 msgr2=0x556dc6a8afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.088+0000 7f598d000640 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66c71b0 0x556dc6a8afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.088+0000 7f598d000640 1 -- 172.21.15.120:0/517565998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc669e2f0 msgr2=0x556dc6a6d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.088+0000 7f598d000640 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc669e2f0 0x556dc6a6d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.088+0000 7f598d000640 1 -- 172.21.15.120:0/517565998 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc6a70430 con 0x556dc66a64d0 2024-05-14T09:40:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.089+0000 7f5987e00640 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66c71b0 0x556dc6a8afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.089+0000 7f598d000640 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66a64d0 0x556dc6a6d5c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f597800f6b0 tx=0x7f5978011830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700f3dc63105e86c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.090+0000 7f597d600640 1 -- 172.21.15.120:0/517565998 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597802e020 con 0x556dc66a64d0 2024-05-14T09:40:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.090+0000 7f597d600640 1 -- 172.21.15.120:0/517565998 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5978004000 con 0x556dc66a64d0 2024-05-14T09:40:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.090+0000 7f597d600640 1 -- 172.21.15.120:0/517565998 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978003850 con 0x556dc66a64d0 2024-05-14T09:40:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.091+0000 7f59969f9740 1 -- 172.21.15.120:0/517565998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66a64d0 msgr2=0x556dc6a6d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.091+0000 7f59969f9740 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66a64d0 0x556dc6a6d5c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f597800f6b0 tx=0x7f5978011830 comp rx=0 tx=0).stop 2024-05-14T09:40:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.093+0000 7f59969f9740 1 -- 172.21.15.120:0/517565998 shutdown_connections 2024-05-14T09:40:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.093+0000 7f59969f9740 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc66c71b0 0x556dc6a8afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.093+0000 7f59969f9740 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66a64d0 0x556dc6a6d5c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.093+0000 7f59969f9740 1 --2- 172.21.15.120:0/517565998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc669e2f0 0x556dc6a6d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.093+0000 7f59969f9740 1 -- 172.21.15.120:0/517565998 >> 172.21.15.120:0/517565998 conn(0x556dc66bb300 msgr2=0x556dc6a690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.093+0000 7f59969f9740 1 -- 172.21.15.120:0/517565998 shutdown_connections 2024-05-14T09:40:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.093+0000 7f59969f9740 1 -- 172.21.15.120:0/517565998 wait complete. 2024-05-14T09:40:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.094+0000 7f59969f9740 1 -- start start 2024-05-14T09:40:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.094+0000 7f59969f9740 1 Processor -- start 2024-05-14T09:40:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.095+0000 7f59969f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a86ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.095+0000 7f59969f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a87420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.095+0000 7f59969f9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a8a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.095+0000 7f59969f9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f59881b4450 con 0x556dc66c71b0 2024-05-14T09:40:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.095+0000 7f59969f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59881b3d20 con 0x556dc66a64d0 2024-05-14T09:40:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.095+0000 7f59969f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59881b0f80 con 0x556dc669e2f0 2024-05-14T09:40:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.095+0000 7f59969f9740 10 client.0 _ll_register_callbacks cb 0x7f59780096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.096+0000 7f5987e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a86ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.096+0000 7f5987e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a86ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:47314/0 (socket says 172.21.15.120:47314) 2024-05-14T09:40:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.096+0000 7f5987e00640 1 -- 172.21.15.120:0/1928348654 learned_addr learned my addr 172.21.15.120:0/1928348654 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.096+0000 7f5987e00640 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a8a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.096+0000 7f598d000640 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a87420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.097+0000 7f5987e00640 1 -- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 msgr2=0x556dc6a87420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.097+0000 7f5987e00640 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a87420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.097+0000 7f5987e00640 1 -- 172.21.15.120:0/1928348654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 msgr2=0x556dc6a8a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.097+0000 7f5987e00640 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a8a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.097+0000 7f5987e00640 1 -- 172.21.15.120:0/1928348654 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc6a8a920 con 0x556dc669e2f0 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.097+0000 7f5987e00640 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a86ee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5974012d70 tx=0x7f5974005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162d427d921bc92d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.097+0000 7f5972a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:40:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.098+0000 7f5972a00640 1 -- 172.21.15.120:0/1928348654 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974018040 con 0x556dc669e2f0 2024-05-14T09:40:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.098+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5978004000 con 0x556dc669e2f0 2024-05-14T09:40:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.098+0000 7f5972a00640 1 -- 172.21.15.120:0/1928348654 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f59740295c0 con 0x556dc669e2f0 2024-05-14T09:40:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.099+0000 7f5972a00640 1 -- 172.21.15.120:0/1928348654 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f59740297c0 con 0x556dc669e2f0 2024-05-14T09:40:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.099+0000 7f59969f9740 10 client.26899 fetch_fsmap learned FSMap version 70 2024-05-14T09:40:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.100+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x556dc6a8bbb0 con 0x556dc669e2f0 2024-05-14T09:40:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.100+0000 7f5972a00640 1 -- 172.21.15.120:0/1928348654 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5978004000 con 0x556dc669e2f0 2024-05-14T09:40:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.103+0000 7f5972a00640 1 -- 172.21.15.120:0/1928348654 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 70) ==== 8386+0+0 (secure 0 0 0) 0x7f597401dc80 con 0x556dc669e2f0 2024-05-14T09:40:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.104+0000 7f59969f9740 10 client.26899 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T09:40:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.104+0000 7f59969f9740 10 client.26899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.104+0000 7f59969f9740 20 client.26899 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.104+0000 7f59969f9740 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc665b1c0 0x556dc6b0c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.104+0000 7f59969f9740 4 client.26899 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:40:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.104+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556dc69d4fd0 con 0x556dc665b1c0 2024-05-14T09:40:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.106+0000 7f598d000640 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc665b1c0 0x556dc6b0c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.108+0000 7f598d000640 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc665b1c0 0x556dc6b0c860 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc157625d9d7bdb server_cookie=e96eff8246d92328 in_seq=0 out_seq=0 2024-05-14T09:40:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.108+0000 7f5972a00640 10 client.26899 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.139+0000 7f5972a00640 1 -- 172.21.15.120:0/1928348654 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556dc69d4fd0 con 0x556dc665b1c0 2024-05-14T09:40:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.139+0000 7f5972a00640 10 client.26899 handle_command_reply: tid=0 2024-05-14T09:40:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.139+0000 7f59969f9740 1 client.26899 shutdown 2024-05-14T09:40:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.139+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 msgr2=0x556dc6a86ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.139+0000 7f59969f9740 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a86ee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5974012d70 tx=0x7f5974005f90 comp rx=0 tx=0).stop 2024-05-14T09:40:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 shutdown_connections 2024-05-14T09:40:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x556dc665b1c0 0x556dc6b0c860 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556dc66c71b0 0x556dc6a8a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556dc66a64d0 0x556dc6a87420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 --2- 172.21.15.120:0/1928348654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dc669e2f0 0x556dc6a86ee0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 >> 172.21.15.120:0/1928348654 conn(0x556dc66bb300 msgr2=0x556dc6a69080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f5972a00640 0 client.26899 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 shutdown_connections 2024-05-14T09:40:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 1 -- 172.21.15.120:0/1928348654 wait complete. 2024-05-14T09:40:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.140+0000 7f59969f9740 20 client.26899 trim_cache size 0 max 16384 2024-05-14T09:40:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:40:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:40:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:40:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.141+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f596c0b29b0 msgr2=0x7f596c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.141+0000 7f598fa00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f596c0b29b0 0x7f596c0b4ec0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5980004af0 tx=0x7f5980030db0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.141+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 msgr2=0x7f5988073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.141+0000 7f598fa00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f5988073080 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5980031f40 tx=0x7f5980030b90 comp rx=0 tx=0).stop 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 shutdown_connections 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f596c0b29b0 0x7f596c0b4ec0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5988109bc0 0x7f5988073080 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5988104ec0 0x7f5988072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 --2- 172.21.15.120:0/3943206645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5988103c80 0x7f5988071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 >> 172.21.15.120:0/3943206645 conn(0x7f59880fee50 msgr2=0x7f5988105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 shutdown_connections 2024-05-14T09:40:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:17.142+0000 7f598fa00640 1 -- 172.21.15.120:0/3943206645 wait complete. 2024-05-14T09:40:18.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:18 smithi120 ceph-mon[31085]: pgmap v1058: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.6 MiB/s wr, 623 op/s 2024-05-14T09:40:18.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:18 smithi152 ceph-mon[34868]: pgmap v1058: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.6 MiB/s wr, 623 op/s 2024-05-14T09:40:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:18 smithi175 ceph-mon[35353]: pgmap v1058: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.6 MiB/s wr, 623 op/s 2024-05-14T09:40:19.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 765.0 s, 567.0 tps, lat 178.123 ms stddev 177.305 2024-05-14T09:40:20.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:20 smithi120 ceph-mon[31085]: pgmap v1059: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.3 MiB/s wr, 628 op/s 2024-05-14T09:40:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:20 smithi152 ceph-mon[34868]: pgmap v1059: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.3 MiB/s wr, 628 op/s 2024-05-14T09:40:20.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:20 smithi175 ceph-mon[35353]: pgmap v1059: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.3 MiB/s wr, 628 op/s 2024-05-14T09:40:22.386 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:22 smithi120 ceph-mon[31085]: pgmap v1060: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 643 op/s 2024-05-14T09:40:22.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:22 smithi152 ceph-mon[34868]: pgmap v1060: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 643 op/s 2024-05-14T09:40:22.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:22 smithi175 ceph-mon[35353]: pgmap v1060: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 643 op/s 2024-05-14T09:40:24.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 770.0 s, 560.4 tps, lat 177.497 ms stddev 111.220 2024-05-14T09:40:24.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:24 smithi152 ceph-mon[34868]: pgmap v1061: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 600 op/s 2024-05-14T09:40:24.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:24 smithi175 ceph-mon[35353]: pgmap v1061: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 600 op/s 2024-05-14T09:40:24.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:24 smithi120 ceph-mon[31085]: pgmap v1061: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 600 op/s 2024-05-14T09:40:26.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:26 smithi152 ceph-mon[34868]: pgmap v1062: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.9 MiB/s wr, 640 op/s 2024-05-14T09:40:26.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:26 smithi175 ceph-mon[35353]: pgmap v1062: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.9 MiB/s wr, 640 op/s 2024-05-14T09:40:26.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:26 smithi120 ceph-mon[31085]: pgmap v1062: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.9 MiB/s wr, 640 op/s 2024-05-14T09:40:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:28 smithi152 ceph-mon[34868]: pgmap v1063: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.6 MiB/s wr, 589 op/s 2024-05-14T09:40:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:28 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:40:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:28 smithi175 ceph-mon[35353]: pgmap v1063: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.6 MiB/s wr, 589 op/s 2024-05-14T09:40:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:28 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:40:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:28 smithi120 ceph-mon[31085]: pgmap v1063: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.6 MiB/s wr, 589 op/s 2024-05-14T09:40:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:28 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:40:29.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 775.0 s, 587.6 tps, lat 170.465 ms stddev 120.988 2024-05-14T09:40:30.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:30 smithi152 ceph-mon[34868]: pgmap v1064: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 618 op/s 2024-05-14T09:40:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.477+0000 7f3496c00640 1 -- 172.21.15.120:0/1166101514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 msgr2=0x7f3490103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.477+0000 7f3496c00640 1 --2- 172.21.15.120:0/1166101514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490103d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3488009ca0 tx=0x7f348802a8b0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.478+0000 7f3496c00640 1 -- 172.21.15.120:0/1166101514 shutdown_connections 2024-05-14T09:40:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.478+0000 7f3496c00640 1 --2- 172.21.15.120:0/1166101514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490103d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.478+0000 7f3496c00640 1 --2- 172.21.15.120:0/1166101514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3490102120 0x7f3490102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.478+0000 7f3496c00640 1 --2- 172.21.15.120:0/1166101514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3490101c20 0x7f3490102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.478+0000 7f3496c00640 1 -- 172.21.15.120:0/1166101514 >> 172.21.15.120:0/1166101514 conn(0x7f34900fd080 msgr2=0x7f34900ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:30.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:30 smithi175 ceph-mon[35353]: pgmap v1064: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 618 op/s 2024-05-14T09:40:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.479+0000 7f3496c00640 1 -- 172.21.15.120:0/1166101514 shutdown_connections 2024-05-14T09:40:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.479+0000 7f3496c00640 1 -- 172.21.15.120:0/1166101514 wait complete. 2024-05-14T09:40:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.481+0000 7f3496c00640 1 Processor -- start 2024-05-14T09:40:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.481+0000 7f3496c00640 1 -- start start 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.481+0000 7f3496c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3490101c20 0x7f3490071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.481+0000 7f3496c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3490102120 0x7f3490072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.481+0000 7f3496c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f3496c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3490111860 con 0x7f3490102120 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f3496c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34901116e0 con 0x7f3490103980 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f3496c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34901119e0 con 0x7f3490101c20 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f348f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3490102120 0x7f3490072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f3494c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f3494c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490073080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:56538/0 (socket says 172.21.15.120:56538) 2024-05-14T09:40:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f3494c00640 1 -- 172.21.15.120:0/1330605653 learned_addr learned my addr 172.21.15.120:0/1330605653 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.482+0000 7f348fe00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3490101c20 0x7f3490071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.483+0000 7f3494c00640 1 -- 172.21.15.120:0/1330605653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3490101c20 msgr2=0x7f3490071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.483+0000 7f3494c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3490101c20 0x7f3490071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.483+0000 7f3494c00640 1 -- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3490102120 msgr2=0x7f3490072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.483+0000 7f3494c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3490102120 0x7f3490072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.483+0000 7f3494c00640 1 -- 172.21.15.120:0/1330605653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34900736f0 con 0x7f3490103980 2024-05-14T09:40:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.483+0000 7f3494c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490073080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3488030750 tx=0x7f3488003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.484+0000 7f348cc00640 1 -- 172.21.15.120:0/1330605653 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488004240 con 0x7f3490103980 2024-05-14T09:40:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.484+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3490073980 con 0x7f3490103980 2024-05-14T09:40:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.484+0000 7f348cc00640 1 -- 172.21.15.120:0/1330605653 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3488040070 con 0x7f3490103980 2024-05-14T09:40:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.484+0000 7f348cc00640 1 -- 172.21.15.120:0/1330605653 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488045af0 con 0x7f3490103980 2024-05-14T09:40:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.484+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3490073f20 con 0x7f3490103980 2024-05-14T09:40:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.490+0000 7f348cc00640 1 -- 172.21.15.120:0/1330605653 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f34880043e0 con 0x7f3490103980 2024-05-14T09:40:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.491+0000 7f349dd86740 1 Processor -- start 2024-05-14T09:40:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.491+0000 7f349dd86740 1 -- start start 2024-05-14T09:40:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.491+0000 7f349dd86740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.492+0000 7f349dd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 0x55d0534c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.492+0000 7f349dd86740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530f54d0 0x55d0534c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.492+0000 7f349dd86740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d05341c550 con 0x55d0530f54d0 2024-05-14T09:40:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.492+0000 7f349dd86740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0533c1bc0 con 0x55d0531161b0 2024-05-14T09:40:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.492+0000 7f349dd86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d053418510 con 0x55d0530ed2f0 2024-05-14T09:40:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.492+0000 7f348f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530f54d0 0x55d0534c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530f54d0 0x55d0534c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36136/0 (socket says 172.21.15.120:36136) 2024-05-14T09:40:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348f400640 1 -- 172.21.15.120:0/19257941 learned_addr learned my addr 172.21.15.120:0/19257941 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348cc00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f34740b2860 0x7f34740b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348f400640 1 -- 172.21.15.120:0/19257941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 msgr2=0x55d0534c0e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:40:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348f400640 1 --2- 172.21.15.120:0/19257941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 0x55d0534c0e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348f400640 1 -- 172.21.15.120:0/19257941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 msgr2=0x55d0534c0910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:40:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348f400640 1 --2- 172.21.15.120:0/19257941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534c0910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.493+0000 7f348f400640 1 -- 172.21.15.120:0/19257941 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d05312e210 con 0x55d0530f54d0 2024-05-14T09:40:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.494+0000 7f3494c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f34740b2860 0x7f34740b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.494+0000 7f348cc00640 1 -- 172.21.15.120:0/1330605653 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3488103a80 con 0x7f3490103980 2024-05-14T09:40:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.496+0000 7f348f400640 1 --2- 172.21.15.120:0/19257941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530f54d0 0x55d0534c7d90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f347c00bca0 tx=0x7f347c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956643f20456debe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.496+0000 7f3485200640 1 -- 172.21.15.120:0/19257941 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c01c480 con 0x55d0530f54d0 2024-05-14T09:40:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.496+0000 7f3494c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f34740b2860 0x7f34740b4d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f34880cac90 tx=0x7f348802a8b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.496+0000 7f3485200640 1 -- 172.21.15.120:0/19257941 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f347c01cab0 con 0x55d0530f54d0 2024-05-14T09:40:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.496+0000 7f3485200640 1 -- 172.21.15.120:0/19257941 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c011a70 con 0x55d0530f54d0 2024-05-14T09:40:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.498+0000 7f349dd86740 1 -- 172.21.15.120:0/19257941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530f54d0 msgr2=0x55d0534c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.498+0000 7f349dd86740 1 --2- 172.21.15.120:0/19257941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530f54d0 0x55d0534c7d90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f347c00bca0 tx=0x7f347c0107a0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.498+0000 7f349dd86740 1 -- 172.21.15.120:0/19257941 shutdown_connections 2024-05-14T09:40:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.498+0000 7f349dd86740 1 --2- 172.21.15.120:0/19257941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530f54d0 0x55d0534c7d90 secure :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f347c00bca0 tx=0x7f347c0107a0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.498+0000 7f349dd86740 1 --2- 172.21.15.120:0/19257941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 0x55d0534c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.498+0000 7f349dd86740 1 --2- 172.21.15.120:0/19257941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.498+0000 7f349dd86740 1 -- 172.21.15.120:0/19257941 >> 172.21.15.120:0/19257941 conn(0x55d05310a300 msgr2=0x55d0534b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.499+0000 7f349dd86740 1 -- 172.21.15.120:0/19257941 shutdown_connections 2024-05-14T09:40:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.499+0000 7f349dd86740 1 -- 172.21.15.120:0/19257941 wait complete. 2024-05-14T09:40:30.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.500+0000 7f349dd86740 1 -- start start 2024-05-14T09:40:30.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.500+0000 7f349dd86740 1 Processor -- start 2024-05-14T09:40:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.501+0000 7f349dd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 0x55d0534ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.501+0000 7f349dd86740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0531161b0 0x55d0534ba5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.501+0000 7f349dd86740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0530d4d80 0x55d0534bf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.501+0000 7f349dd86740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d0534b8150 con 0x55d0531161b0 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.501+0000 7f349dd86740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0533d5660 con 0x55d0530d4d80 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.501+0000 7f349dd86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0534b82d0 con 0x55d0530ed2f0 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.501+0000 7f349dd86740 10 client.0 _ll_register_callbacks cb 0x55d05339f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0531161b0 0x55d0534ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0531161b0 0x55d0534ba5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36146/0 (socket says 172.21.15.120:36146) 2024-05-14T09:40:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 -- 172.21.15.120:0/3204151498 learned_addr learned my addr 172.21.15.120:0/3204151498 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 -- 172.21.15.120:0/3204151498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 msgr2=0x55d0534ba070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 0x55d0534ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 -- 172.21.15.120:0/3204151498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0530d4d80 msgr2=0x55d0534bf490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:40:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0530d4d80 0x55d0534bf490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.502+0000 7f348fe00640 1 -- 172.21.15.120:0/3204151498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0531fa620 con 0x55d0531161b0 2024-05-14T09:40:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.503+0000 7f348fe00640 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0531161b0 0x55d0534ba5b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3480009fb0 tx=0x7f3480010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2478342a11120e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.503+0000 7f3479600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:40:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.505+0000 7f3479600640 1 -- 172.21.15.120:0/3204151498 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480005220 con 0x55d0531161b0 2024-05-14T09:40:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.505+0000 7f3479600640 1 -- 172.21.15.120:0/3204151498 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f34800053c0 con 0x55d0531161b0 2024-05-14T09:40:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.505+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f347c01cab0 con 0x55d0531161b0 2024-05-14T09:40:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.507+0000 7f3479600640 1 -- 172.21.15.120:0/3204151498 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f3480023050 con 0x55d0531161b0 2024-05-14T09:40:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.507+0000 7f349dd86740 10 client.17331 fetch_fsmap learned FSMap version 71 2024-05-14T09:40:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.507+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55d0534dd280 con 0x55d0531161b0 2024-05-14T09:40:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f3479600640 1 -- 172.21.15.120:0/3204151498 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f347c01cab0 con 0x55d0531161b0 2024-05-14T09:40:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f3479600640 1 -- 172.21.15.120:0/3204151498 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f348000f040 con 0x55d0531161b0 2024-05-14T09:40:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f349dd86740 10 client.17331 fetch_fsmap finished waiting for FSMap version 71 2024-05-14T09:40:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f349dd86740 10 client.17331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f349dd86740 20 client.17331 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f349dd86740 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0530aa1c0 0x55d0534e0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f349dd86740 4 client.17331 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:40:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d05342a160 con 0x55d0530aa1c0 2024-05-14T09:40:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.509+0000 7f348f400640 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0530aa1c0 0x55d0534e0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.511+0000 7f348f400640 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0530aa1c0 0x55d0534e0a90 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eba2205413717ac server_cookie=5d045b699e0b10a7 in_seq=0 out_seq=0 2024-05-14T09:40:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.511+0000 7f3479600640 10 client.17331 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.512+0000 7f3479600640 1 -- 172.21.15.120:0/3204151498 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d05342a160 con 0x55d0530aa1c0 2024-05-14T09:40:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.512+0000 7f3479600640 10 client.17331 handle_command_reply: tid=0 2024-05-14T09:40:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.512+0000 7f349dd86740 1 client.17331 shutdown 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.512+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0531161b0 msgr2=0x55d0534ba5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.512+0000 7f349dd86740 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0531161b0 0x55d0534ba5b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3480009fb0 tx=0x7f3480010800 comp rx=0 tx=0).stop 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 shutdown_connections 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d0530aa1c0 0x55d0534e0a90 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0530d4d80 0x55d0534bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0531161b0 0x55d0534ba5b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 --2- 172.21.15.120:0/3204151498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530ed2f0 0x55d0534ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 >> 172.21.15.120:0/3204151498 conn(0x55d05310a300 msgr2=0x55d0534b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f3479600640 0 client.17331 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 shutdown_connections 2024-05-14T09:40:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.513+0000 7f349dd86740 1 -- 172.21.15.120:0/3204151498 wait complete. 2024-05-14T09:40:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.514+0000 7f349dd86740 20 client.17331 trim_cache size 0 max 16384 2024-05-14T09:40:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 Processor -- start 2024-05-14T09:40:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 -- start start 2024-05-14T09:40:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534bf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534bf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b3050 con 0x55d0530ed2f0 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b4c20 con 0x55d0531161b0 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.554+0000 7f349dd86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b3720 con 0x55d0530d4d80 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.555+0000 7f348f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.555+0000 7f348f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534bf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43152/0 (socket says 172.21.15.120:43152) 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.555+0000 7f348f400640 1 -- 172.21.15.120:0/4263972829 learned_addr learned my addr 172.21.15.120:0/4263972829 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.555+0000 7f348f400640 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.555+0000 7f348fe00640 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.556+0000 7f348f400640 1 -- 172.21.15.120:0/4263972829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 msgr2=0x55d0534c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.556+0000 7f348f400640 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.556+0000 7f348f400640 1 -- 172.21.15.120:0/4263972829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 msgr2=0x55d0534bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.556+0000 7f348f400640 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534bf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.556+0000 7f348f400640 1 -- 172.21.15.120:0/4263972829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0534af280 con 0x55d0530d4d80 2024-05-14T09:40:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.557+0000 7f348f400640 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534bf450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f347c00bc70 tx=0x7f347c00b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=233125765260dd81 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.558+0000 7f347be00640 1 -- 172.21.15.120:0/4263972829 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c005490 con 0x55d0530d4d80 2024-05-14T09:40:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.558+0000 7f347be00640 1 -- 172.21.15.120:0/4263972829 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f347c02d030 con 0x55d0530d4d80 2024-05-14T09:40:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.558+0000 7f347be00640 1 -- 172.21.15.120:0/4263972829 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c011890 con 0x55d0530d4d80 2024-05-14T09:40:30.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.560+0000 7f349dd86740 1 -- 172.21.15.120:0/4263972829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 msgr2=0x55d0534bf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.559 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.560+0000 7f349dd86740 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534bf450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f347c00bc70 tx=0x7f347c00b7c0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.561+0000 7f349dd86740 1 -- 172.21.15.120:0/4263972829 shutdown_connections 2024-05-14T09:40:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.561+0000 7f349dd86740 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.561+0000 7f349dd86740 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.561+0000 7f349dd86740 1 --2- 172.21.15.120:0/4263972829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534bf450 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.561+0000 7f349dd86740 1 -- 172.21.15.120:0/4263972829 >> 172.21.15.120:0/4263972829 conn(0x55d05310a300 msgr2=0x55d0534b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.561+0000 7f349dd86740 1 -- 172.21.15.120:0/4263972829 shutdown_connections 2024-05-14T09:40:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.562+0000 7f349dd86740 1 -- 172.21.15.120:0/4263972829 wait complete. 2024-05-14T09:40:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.562+0000 7f349dd86740 1 -- start start 2024-05-14T09:40:30.562 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.563+0000 7f349dd86740 1 Processor -- start 2024-05-14T09:40:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.564+0000 7f349dd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.564+0000 7f349dd86740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534eea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.564+0000 7f349dd86740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534eefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.564+0000 7f349dd86740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b4520 con 0x55d0530ed2f0 2024-05-14T09:40:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.564+0000 7f349dd86740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b3df0 con 0x55d0531161b0 2024-05-14T09:40:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.564+0000 7f349dd86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b1010 con 0x55d0530d4d80 2024-05-14T09:40:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.564+0000 7f349dd86740 10 client.0 _ll_register_callbacks cb 0x7f3480009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.565+0000 7f348f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.565+0000 7f348f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:43156/0 (socket says 172.21.15.120:43156) 2024-05-14T09:40:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.565+0000 7f348f400640 1 -- 172.21.15.120:0/4291048286 learned_addr learned my addr 172.21.15.120:0/4291048286 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.565+0000 7f348fe00640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.565+0000 7f348f400640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534eefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.566+0000 7f348f400640 1 -- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 msgr2=0x55d0534eefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.566+0000 7f348f400640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534eefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.566+0000 7f348f400640 1 -- 172.21.15.120:0/4291048286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 msgr2=0x55d0534eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.566+0000 7f348f400640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.566+0000 7f348f400640 1 -- 172.21.15.120:0/4291048286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0534ef4f0 con 0x55d0530d4d80 2024-05-14T09:40:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.567+0000 7f348fe00640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.567+0000 7f348f400640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534f1ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f347c00ba90 tx=0x7f347c005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84cb3d9a6347f045 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.567+0000 7f3479600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:40:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.568+0000 7f3479600640 1 -- 172.21.15.120:0/4291048286 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c005490 con 0x55d0530d4d80 2024-05-14T09:40:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.568+0000 7f3479600640 1 -- 172.21.15.120:0/4291048286 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f347c0273a0 con 0x55d0530d4d80 2024-05-14T09:40:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.568+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f347c02d030 con 0x55d0530d4d80 2024-05-14T09:40:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.568+0000 7f3479600640 1 -- 172.21.15.120:0/4291048286 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f347c0275a0 con 0x55d0530d4d80 2024-05-14T09:40:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.568+0000 7f349dd86740 10 client.26908 fetch_fsmap learned FSMap version 71 2024-05-14T09:40:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.568+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55d0535479f0 con 0x55d0530d4d80 2024-05-14T09:40:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f3479600640 1 -- 172.21.15.120:0/4291048286 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f347c02d030 con 0x55d0530d4d80 2024-05-14T09:40:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f3479600640 1 -- 172.21.15.120:0/4291048286 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f347c025070 con 0x55d0530d4d80 2024-05-14T09:40:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f349dd86740 10 client.26908 fetch_fsmap finished waiting for FSMap version 71 2024-05-14T09:40:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f349dd86740 10 client.26908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f349dd86740 20 client.26908 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f349dd86740 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d053548060 0x55d05354a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f349dd86740 4 client.26908 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:40:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.569+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d053423fd0 con 0x55d053548060 2024-05-14T09:40:30.571 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.571+0000 7f348fe00640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d053548060 0x55d05354a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.574+0000 7f348fe00640 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d053548060 0x55d05354a480 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af13d1503fd931e6 server_cookie=269accf2dfa0007e in_seq=0 out_seq=0 2024-05-14T09:40:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.574+0000 7f3479600640 10 client.26908 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.599+0000 7f3479600640 1 -- 172.21.15.120:0/4291048286 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d053423fd0 con 0x55d053548060 2024-05-14T09:40:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.599+0000 7f3479600640 10 client.26908 handle_command_reply: tid=0 2024-05-14T09:40:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.599+0000 7f349dd86740 1 client.26908 shutdown 2024-05-14T09:40:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.600+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 msgr2=0x55d0534f1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.600+0000 7f349dd86740 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534f1ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f347c00ba90 tx=0x7f347c005040 comp rx=0 tx=0).stop 2024-05-14T09:40:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.601+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 shutdown_connections 2024-05-14T09:40:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.601+0000 7f349dd86740 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d053548060 0x55d05354a480 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.601+0000 7f349dd86740 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0531161b0 0x55d0534eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.601+0000 7f349dd86740 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d0530ed2f0 0x55d0534eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.601+0000 7f349dd86740 1 --2- 172.21.15.120:0/4291048286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0530d4d80 0x55d0534f1ef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.601+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 >> 172.21.15.120:0/4291048286 conn(0x55d05310a300 msgr2=0x55d0534c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.601+0000 7f3479600640 0 client.26908 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.603+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 shutdown_connections 2024-05-14T09:40:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.603+0000 7f349dd86740 1 -- 172.21.15.120:0/4291048286 wait complete. 2024-05-14T09:40:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.604+0000 7f349dd86740 20 client.26908 trim_cache size 0 max 16384 2024-05-14T09:40:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:40:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:40:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:40:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f34740b2860 msgr2=0x7f34740b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f34740b2860 0x7f34740b4d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f34880cac90 tx=0x7f348802a8b0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 msgr2=0x7f3490073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490073080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3488030750 tx=0x7f3488003b80 comp rx=0 tx=0).stop 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 shutdown_connections 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f34740b2860 0x7f34740b4d70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3490103980 0x7f3490073080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3490102120 0x7f3490072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.605+0000 7f3496c00640 1 --2- 172.21.15.120:0/1330605653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3490101c20 0x7f3490071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.606+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 >> 172.21.15.120:0/1330605653 conn(0x7f34900fd080 msgr2=0x7f34901025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.606+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 shutdown_connections 2024-05-14T09:40:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:30.606+0000 7f3496c00640 1 -- 172.21.15.120:0/1330605653 wait complete. 2024-05-14T09:40:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:30 smithi120 ceph-mon[31085]: pgmap v1064: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 618 op/s 2024-05-14T09:40:32.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:32 smithi152 ceph-mon[34868]: pgmap v1065: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.8 MiB/s wr, 636 op/s 2024-05-14T09:40:32.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:32 smithi175 ceph-mon[35353]: pgmap v1065: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.8 MiB/s wr, 636 op/s 2024-05-14T09:40:32.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:32 smithi120 ceph-mon[31085]: pgmap v1065: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.8 MiB/s wr, 636 op/s 2024-05-14T09:40:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 780.0 s, 591.4 tps, lat 169.543 ms stddev 95.205 2024-05-14T09:40:34.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:34 smithi152 ceph-mon[34868]: pgmap v1066: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 610 op/s 2024-05-14T09:40:34.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:34 smithi175 ceph-mon[35353]: pgmap v1066: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 610 op/s 2024-05-14T09:40:34.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:34 smithi120 ceph-mon[31085]: pgmap v1066: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 610 op/s 2024-05-14T09:40:36.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:36 smithi152 ceph-mon[34868]: pgmap v1067: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.3 MiB/s wr, 644 op/s 2024-05-14T09:40:36.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:36 smithi175 ceph-mon[35353]: pgmap v1067: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.3 MiB/s wr, 644 op/s 2024-05-14T09:40:36.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:36 smithi120 ceph-mon[31085]: pgmap v1067: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.3 MiB/s wr, 644 op/s 2024-05-14T09:40:38.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:38 smithi175 ceph-mon[35353]: pgmap v1068: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 597 op/s 2024-05-14T09:40:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:38 smithi120 ceph-mon[31085]: pgmap v1068: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 597 op/s 2024-05-14T09:40:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:38 smithi152 ceph-mon[34868]: pgmap v1068: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 597 op/s 2024-05-14T09:40:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 785.0 s, 611.4 tps, lat 162.725 ms stddev 58.467 2024-05-14T09:40:40.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:40 smithi175 ceph-mon[35353]: pgmap v1069: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 602 op/s 2024-05-14T09:40:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:40 smithi120 ceph-mon[31085]: pgmap v1069: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 602 op/s 2024-05-14T09:40:40.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:40 smithi152 ceph-mon[34868]: pgmap v1069: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 602 op/s 2024-05-14T09:40:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:42 smithi175 ceph-mon[35353]: pgmap v1070: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.0 MiB/s wr, 638 op/s 2024-05-14T09:40:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:42 smithi120 ceph-mon[31085]: pgmap v1070: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.0 MiB/s wr, 638 op/s 2024-05-14T09:40:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:42 smithi152 ceph-mon[34868]: pgmap v1070: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.0 MiB/s wr, 638 op/s 2024-05-14T09:40:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.007+0000 7f7fcde00640 1 -- 172.21.15.120:0/49361133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc8110070 msgr2=0x7f7fc8112490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.007+0000 7f7fcde00640 1 --2- 172.21.15.120:0/49361133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc8110070 0x7f7fc8112490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009ca0 tx=0x7f7fc002a8c0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.007+0000 7f7fcde00640 1 -- 172.21.15.120:0/49361133 shutdown_connections 2024-05-14T09:40:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.007+0000 7f7fcde00640 1 --2- 172.21.15.120:0/49361133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc8110070 0x7f7fc8112490 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.007+0000 7f7fcde00640 1 --2- 172.21.15.120:0/49361133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc810b370 0x7f7fc810b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.007+0000 7f7fcde00640 1 --2- 172.21.15.120:0/49361133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fc810a400 0x7f7fc810ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.007+0000 7f7fcde00640 1 -- 172.21.15.120:0/49361133 >> 172.21.15.120:0/49361133 conn(0x7f7fc8078d30 msgr2=0x7f7fc807b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.008+0000 7f7fcde00640 1 -- 172.21.15.120:0/49361133 shutdown_connections 2024-05-14T09:40:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.009+0000 7f7fcde00640 1 -- 172.21.15.120:0/49361133 wait complete. 2024-05-14T09:40:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 Processor -- start 2024-05-14T09:40:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 -- start start 2024-05-14T09:40:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc810a400 0x7f7fc8071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc810b370 0x7f7fc8072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fc8110070 0x7f7fc8073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8115ab0 con 0x7f7fc810a400 2024-05-14T09:40:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8115930 con 0x7f7fc810b370 2024-05-14T09:40:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.012+0000 7f7fcde00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8115c30 con 0x7f7fc8110070 2024-05-14T09:40:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.013+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc810b370 0x7f7fc8072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.013+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc810b370 0x7f7fc8072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41342/0 (socket says 172.21.15.120:41342) 2024-05-14T09:40:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.013+0000 7f7fc7e00640 1 -- 172.21.15.120:0/2680754659 learned_addr learned my addr 172.21.15.120:0/2680754659 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.013+0000 7f7fcd400640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fc8110070 0x7f7fc8073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.014+0000 7f7fc7e00640 1 -- 172.21.15.120:0/2680754659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fc8110070 msgr2=0x7f7fc8073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.014+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fc8110070 0x7f7fc8073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.014+0000 7f7fc7e00640 1 -- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc810a400 msgr2=0x7f7fc8071bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T09:40:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.014+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc810a400 0x7f7fc8071bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.014+0000 7f7fc7e00640 1 -- 172.21.15.120:0/2680754659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80736d0 con 0x7f7fc810b370 2024-05-14T09:40:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.015+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc810b370 0x7f7fc8072100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c890 tx=0x7f7fb400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.015+0000 7f7fc5600640 1 -- 172.21.15.120:0/2680754659 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4004220 con 0x7f7fc810b370 2024-05-14T09:40:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.016+0000 7f7fc5600640 1 -- 172.21.15.120:0/2680754659 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fb4007e40 con 0x7f7fc810b370 2024-05-14T09:40:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.016+0000 7f7fc5600640 1 -- 172.21.15.120:0/2680754659 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4004a00 con 0x7f7fc810b370 2024-05-14T09:40:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.016+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc80739c0 con 0x7f7fc810b370 2024-05-14T09:40:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.016+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc8073ec0 con 0x7f7fc810b370 2024-05-14T09:40:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.023+0000 7f7fd6367740 1 Processor -- start 2024-05-14T09:40:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.023+0000 7f7fd6367740 1 -- start start 2024-05-14T09:40:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10b9e8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6254d0 0x55f10b9ef770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fd6367740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f10b94c550 con 0x55f10b6254d0 2024-05-14T09:40:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fd6367740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f10b8f1bc0 con 0x55f10b61d2f0 2024-05-14T09:40:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fd6367740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f10b948510 con 0x55f10b6461b0 2024-05-14T09:40:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fc5600640 1 -- 172.21.15.120:0/2680754659 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7fb40079b0 con 0x7f7fc810b370 2024-05-14T09:40:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fcca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10b9e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fcca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10b9e8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41354/0 (socket says 172.21.15.120:41354) 2024-05-14T09:40:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fcca00640 1 -- 172.21.15.120:0/4109731267 learned_addr learned my addr 172.21.15.120:0/4109731267 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.024+0000 7f7fcd400640 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.025+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6254d0 0x55f10b9ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.025+0000 7f7fc7e00640 1 -- 172.21.15.120:0/4109731267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 msgr2=0x55f10b9e82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.025+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9e82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.025+0000 7f7fc7e00640 1 -- 172.21.15.120:0/4109731267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 msgr2=0x55f10b9e8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.025+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10b9e8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.025+0000 7f7fc7e00640 1 -- 172.21.15.120:0/4109731267 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f10b65e210 con 0x55f10b6254d0 2024-05-14T09:40:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.026+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6254d0 0x55f10b9ef770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40dfd10 tx=0x7f7fb40e8790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be52d63c6795b367 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.026+0000 7f7fb9c00640 1 -- 172.21.15.120:0/4109731267 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40f6070 con 0x55f10b6254d0 2024-05-14T09:40:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.027+0000 7f7fb9c00640 1 -- 172.21.15.120:0/4109731267 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fb40e4560 con 0x55f10b6254d0 2024-05-14T09:40:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.028+0000 7f7fd6367740 1 -- 172.21.15.120:0/4109731267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6254d0 msgr2=0x55f10b9ef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.028+0000 7f7fb9c00640 1 -- 172.21.15.120:0/4109731267 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40ef820 con 0x55f10b6254d0 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.028+0000 7f7fd6367740 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6254d0 0x55f10b9ef770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40dfd10 tx=0x7f7fb40e8790 comp rx=0 tx=0).stop 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.028+0000 7f7fc5600640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7fb00b29b0 0x7f7fb00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fd6367740 1 -- 172.21.15.120:0/4109731267 shutdown_connections 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fd6367740 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6254d0 0x55f10b9ef770 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fd6367740 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10b9e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fd6367740 1 --2- 172.21.15.120:0/4109731267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9e82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fd6367740 1 -- 172.21.15.120:0/4109731267 >> 172.21.15.120:0/4109731267 conn(0x55f10b63a300 msgr2=0x55f10b9e3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fd6367740 1 -- 172.21.15.120:0/4109731267 shutdown_connections 2024-05-14T09:40:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fcd400640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7fb00b29b0 0x7f7fb00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.029+0000 7f7fc5600640 1 -- 172.21.15.120:0/2680754659 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7fb40e2670 con 0x7f7fc810b370 2024-05-14T09:40:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.030+0000 7f7fd6367740 1 -- 172.21.15.120:0/4109731267 wait complete. 2024-05-14T09:40:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.031+0000 7f7fd6367740 1 -- start start 2024-05-14T09:40:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.031+0000 7f7fcd400640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7fb00b29b0 0x7f7fb00b4ec0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0031920 tx=0x7f7fc0031980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.031+0000 7f7fd6367740 1 Processor -- start 2024-05-14T09:40:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b61d2f0 0x55f10b9f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6254d0 0x55f10b9f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9f9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fd6367740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f10b9f0210 con 0x55f10b61d2f0 2024-05-14T09:40:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fd6367740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f10b905660 con 0x55f10b6254d0 2024-05-14T09:40:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fd6367740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f10b9f0390 con 0x55f10b6461b0 2024-05-14T09:40:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fd6367740 10 client.0 _ll_register_callbacks cb 0x55f10b8cf400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.032+0000 7f7fcca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b61d2f0 0x55f10b9f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.033+0000 7f7fcd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.033+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6254d0 0x55f10b9f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.033+0000 7f7fcca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b61d2f0 0x55f10b9f1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50210/0 (socket says 172.21.15.120:50210) 2024-05-14T09:40:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.033+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6254d0 0x55f10b9f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41358/0 (socket says 172.21.15.120:41358) 2024-05-14T09:40:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.033+0000 7f7fcca00640 1 -- 172.21.15.120:0/100613851 learned_addr learned my addr 172.21.15.120:0/100613851 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.034+0000 7f7fcca00640 1 -- 172.21.15.120:0/100613851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 msgr2=0x55f10b9f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.034+0000 7f7fcca00640 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.034+0000 7f7fcca00640 1 -- 172.21.15.120:0/100613851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6254d0 msgr2=0x55f10b9f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.034+0000 7f7fcca00640 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6254d0 0x55f10b9f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.034+0000 7f7fcca00640 1 -- 172.21.15.120:0/100613851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f10b72a620 con 0x55f10b61d2f0 2024-05-14T09:40:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.034+0000 7f7fcca00640 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b61d2f0 0x55f10b9f1d90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00bd60 tx=0x7f7fbc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24f993de6701c14 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.034+0000 7f7fae000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:40:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.035+0000 7f7fae000640 1 -- 172.21.15.120:0/100613851 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc004260 con 0x55f10b61d2f0 2024-05-14T09:40:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.036+0000 7f7fae000640 1 -- 172.21.15.120:0/100613851 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7fbc004400 con 0x55f10b61d2f0 2024-05-14T09:40:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.036+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb40e4560 con 0x55f10b61d2f0 2024-05-14T09:40:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.037+0000 7f7fae000640 1 -- 172.21.15.120:0/100613851 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f7fbc0035f0 con 0x55f10b61d2f0 2024-05-14T09:40:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.037+0000 7f7fd6367740 10 client.17340 fetch_fsmap learned FSMap version 71 2024-05-14T09:40:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.037+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55f10b9fc070 con 0x55f10b61d2f0 2024-05-14T09:40:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.038+0000 7f7fae000640 1 -- 172.21.15.120:0/100613851 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fb40e4560 con 0x55f10b61d2f0 2024-05-14T09:40:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.039+0000 7f7fae000640 1 -- 172.21.15.120:0/100613851 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f7fbc0118f0 con 0x55f10b61d2f0 2024-05-14T09:40:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.039+0000 7f7fd6367740 10 client.17340 fetch_fsmap finished waiting for FSMap version 71 2024-05-14T09:40:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.039+0000 7f7fd6367740 10 client.17340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.039+0000 7f7fd6367740 20 client.17340 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.039+0000 7f7fd6367740 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10b604d80 0x55f10b9ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.039+0000 7f7fd6367740 4 client.17340 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:40:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.039+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f10b95a160 con 0x55f10b604d80 2024-05-14T09:40:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.040+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10b604d80 0x55f10b9ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.041+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10b604d80 0x55f10b9ff7b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8599f6b267fe875 server_cookie=dcd557a3818772c5 in_seq=0 out_seq=0 2024-05-14T09:40:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.041+0000 7f7fae000640 10 client.17340 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.043+0000 7f7fae000640 1 -- 172.21.15.120:0/100613851 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f10b95a160 con 0x55f10b604d80 2024-05-14T09:40:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.043+0000 7f7fae000640 10 client.17340 handle_command_reply: tid=0 2024-05-14T09:40:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 client.17340 shutdown 2024-05-14T09:40:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b61d2f0 msgr2=0x55f10b9f1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b61d2f0 0x55f10b9f1d90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00bd60 tx=0x7f7fbc00f730 comp rx=0 tx=0).stop 2024-05-14T09:40:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 shutdown_connections 2024-05-14T09:40:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10b604d80 0x55f10b9ff7b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6461b0 0x55f10b9f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6254d0 0x55f10b9f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 --2- 172.21.15.120:0/100613851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b61d2f0 0x55f10b9f1d90 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fae000640 0 client.17340 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.044+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 >> 172.21.15.120:0/100613851 conn(0x55f10b63a300 msgr2=0x55f10b9e6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.045+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 shutdown_connections 2024-05-14T09:40:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.045+0000 7f7fd6367740 1 -- 172.21.15.120:0/100613851 wait complete. 2024-05-14T09:40:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.045+0000 7f7fd6367740 20 client.17340 trim_cache size 0 max 16384 2024-05-14T09:40:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.080+0000 7f7fd6367740 1 Processor -- start 2024-05-14T09:40:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.081+0000 7f7fd6367740 1 -- start start 2024-05-14T09:40:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.081+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10ba03fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.081+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6254d0 0x55f10b9f9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.081+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6461b0 0x55f10b9f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.081+0000 7f7fd6367740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81c3e30 con 0x55f10b6461b0 2024-05-14T09:40:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.081+0000 7f7fd6367740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81c5a00 con 0x55f10b61d2f0 2024-05-14T09:40:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.081+0000 7f7fd6367740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81c4500 con 0x55f10b6254d0 2024-05-14T09:40:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.082+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6254d0 0x55f10b9f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.083+0000 7f7fcca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10ba03fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.083+0000 7f7fcca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10ba03fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41374/0 (socket says 172.21.15.120:41374) 2024-05-14T09:40:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.083+0000 7f7fcca00640 1 -- 172.21.15.120:0/2394438361 learned_addr learned my addr 172.21.15.120:0/2394438361 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.083+0000 7f7fcd400640 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6461b0 0x55f10b9f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.084+0000 7f7fc7e00640 1 -- 172.21.15.120:0/2394438361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 msgr2=0x55f10ba03fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.084+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10ba03fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.084+0000 7f7fc7e00640 1 -- 172.21.15.120:0/2394438361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6461b0 msgr2=0x55f10b9f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.084+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6461b0 0x55f10b9f9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.084+0000 7f7fc7e00640 1 -- 172.21.15.120:0/2394438361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f10b9e45e0 con 0x55f10b6254d0 2024-05-14T09:40:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.084+0000 7f7fcd400640 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6461b0 0x55f10b9f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.084+0000 7f7fc7e00640 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6254d0 0x55f10b9f9150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40a9590 tx=0x7f7fb40cc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e34c5f71c8ff537 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.085+0000 7f7fb9200640 1 -- 172.21.15.120:0/2394438361 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb401d030 con 0x55f10b6254d0 2024-05-14T09:40:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.085+0000 7f7fb9200640 1 -- 172.21.15.120:0/2394438361 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fb40e8310 con 0x55f10b6254d0 2024-05-14T09:40:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.085+0000 7f7fb9200640 1 -- 172.21.15.120:0/2394438361 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40a91e0 con 0x55f10b6254d0 2024-05-14T09:40:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.086+0000 7f7fd6367740 1 -- 172.21.15.120:0/2394438361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6254d0 msgr2=0x55f10b9f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.086+0000 7f7fd6367740 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6254d0 0x55f10b9f9150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40a9590 tx=0x7f7fb40cc040 comp rx=0 tx=0).stop 2024-05-14T09:40:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.087+0000 7f7fd6367740 1 -- 172.21.15.120:0/2394438361 shutdown_connections 2024-05-14T09:40:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.087+0000 7f7fd6367740 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b6461b0 0x55f10b9f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.087+0000 7f7fd6367740 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b6254d0 0x55f10b9f9150 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40a9590 tx=0x7f7fb40cc040 comp rx=0 tx=0).stop 2024-05-14T09:40:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.087+0000 7f7fd6367740 1 --2- 172.21.15.120:0/2394438361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b61d2f0 0x55f10ba03fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.087+0000 7f7fd6367740 1 -- 172.21.15.120:0/2394438361 >> 172.21.15.120:0/2394438361 conn(0x55f10b63a300 msgr2=0x55f10b9e74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.087+0000 7f7fd6367740 1 -- 172.21.15.120:0/2394438361 shutdown_connections 2024-05-14T09:40:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.089+0000 7f7fd6367740 1 -- 172.21.15.120:0/2394438361 wait complete. 2024-05-14T09:40:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.089+0000 7f7fd6367740 1 -- start start 2024-05-14T09:40:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.090+0000 7f7fd6367740 1 Processor -- start 2024-05-14T09:40:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.091+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b61d2f0 0x55f10b9f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.092+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6461b0 0x55f10b9f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.092+0000 7f7fd6367740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b5da1c0 0x55f10ba65c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.092+0000 7f7fd6367740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81c5300 con 0x55f10b5da1c0 2024-05-14T09:40:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.092+0000 7f7fd6367740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81c4bd0 con 0x55f10b6461b0 2024-05-14T09:40:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.092+0000 7f7fd6367740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8083aa0 con 0x55f10b61d2f0 2024-05-14T09:40:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.092+0000 7f7fd6367740 10 client.0 _ll_register_callbacks cb 0x7f7fbc00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.093+0000 7f7fcca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b61d2f0 0x55f10b9f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.093+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6461b0 0x55f10b9f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.093+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6461b0 0x55f10b9f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:41386/0 (socket says 172.21.15.120:41386) 2024-05-14T09:40:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.093+0000 7f7fc7e00640 1 -- 172.21.15.120:0/1467803059 learned_addr learned my addr 172.21.15.120:0/1467803059 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.093+0000 7f7fcd400640 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b5da1c0 0x55f10ba65c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.094+0000 7f7fcd400640 1 -- 172.21.15.120:0/1467803059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b61d2f0 msgr2=0x55f10b9f8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.094+0000 7f7fcd400640 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b61d2f0 0x55f10b9f8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.094+0000 7f7fcd400640 1 -- 172.21.15.120:0/1467803059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6461b0 msgr2=0x55f10b9f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.094+0000 7f7fcd400640 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6461b0 0x55f10b9f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.094+0000 7f7fcd400640 1 -- 172.21.15.120:0/1467803059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f10ba66240 con 0x55f10b5da1c0 2024-05-14T09:40:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.095+0000 7f7fae000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:40:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.095+0000 7f7fcd400640 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b5da1c0 0x55f10ba65c50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0006010 tx=0x7f7fc00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8169aacc7c814d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.095+0000 7f7fae000640 1 -- 172.21.15.120:0/1467803059 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0003b80 con 0x55f10b5da1c0 2024-05-14T09:40:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.096+0000 7f7fae000640 1 -- 172.21.15.120:0/1467803059 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f7fc0003d20 con 0x55f10b5da1c0 2024-05-14T09:40:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.096+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb40e8310 con 0x55f10b5da1c0 2024-05-14T09:40:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.096+0000 7f7fae000640 1 -- 172.21.15.120:0/1467803059 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f7fc0004040 con 0x55f10b5da1c0 2024-05-14T09:40:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.096+0000 7f7fd6367740 10 client.17346 fetch_fsmap learned FSMap version 71 2024-05-14T09:40:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.096+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55f10ba67540 con 0x55f10b5da1c0 2024-05-14T09:40:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.097+0000 7f7fae000640 1 -- 172.21.15.120:0/1467803059 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fb40e8310 con 0x55f10b5da1c0 2024-05-14T09:40:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.097+0000 7f7fae000640 1 -- 172.21.15.120:0/1467803059 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f7fc00546c0 con 0x55f10b5da1c0 2024-05-14T09:40:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.098+0000 7f7fd6367740 10 client.17346 fetch_fsmap finished waiting for FSMap version 71 2024-05-14T09:40:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.098+0000 7f7fd6367740 10 client.17346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.098+0000 7f7fd6367740 20 client.17346 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.098+0000 7f7fd6367740 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10ba67e50 0x55f10ba6a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.098+0000 7f7fd6367740 4 client.17346 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:40:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.098+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f10b953fd0 con 0x55f10ba67e50 2024-05-14T09:40:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.099+0000 7f7fcca00640 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10ba67e50 0x55f10ba6a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.102+0000 7f7fcca00640 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10ba67e50 0x55f10ba6a270 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3ee323fe69512d9 server_cookie=c80ce8c5eedbf8ed in_seq=0 out_seq=0 2024-05-14T09:40:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.102+0000 7f7fae000640 10 client.17346 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.129+0000 7f7fae000640 1 -- 172.21.15.120:0/1467803059 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f10b953fd0 con 0x55f10ba67e50 2024-05-14T09:40:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.130+0000 7f7fae000640 10 client.17346 handle_command_reply: tid=0 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.130+0000 7f7fd6367740 1 client.17346 shutdown 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b5da1c0 msgr2=0x55f10ba65c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b5da1c0 0x55f10ba65c50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0006010 tx=0x7f7fc00095c0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 shutdown_connections 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55f10ba67e50 0x55f10ba6a270 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f10b5da1c0 0x55f10ba65c50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f10b6461b0 0x55f10b9f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 --2- 172.21.15.120:0/1467803059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b61d2f0 0x55f10b9f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 >> 172.21.15.120:0/1467803059 conn(0x55f10b63a300 msgr2=0x55f10b9e7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.131+0000 7f7fae000640 0 client.17346 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.133+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 shutdown_connections 2024-05-14T09:40:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.133+0000 7f7fd6367740 1 -- 172.21.15.120:0/1467803059 wait complete. 2024-05-14T09:40:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.134+0000 7f7fd6367740 20 client.17346 trim_cache size 0 max 16384 2024-05-14T09:40:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:40:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:40:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:40:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:40:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.135+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7fb00b29b0 msgr2=0x7f7fb00b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.135+0000 7f7fcde00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7fb00b29b0 0x7f7fb00b4ec0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0031920 tx=0x7f7fc0031980 comp rx=0 tx=0).stop 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.135+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc810b370 msgr2=0x7f7fc8072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.135+0000 7f7fcde00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc810b370 0x7f7fc8072100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c890 tx=0x7f7fb400cd50 comp rx=0 tx=0).stop 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 shutdown_connections 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f7fb00b29b0 0x7f7fb00b4ec0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fc8110070 0x7f7fc8073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fc810b370 0x7f7fc8072100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 --2- 172.21.15.120:0/2680754659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc810a400 0x7f7fc8071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 >> 172.21.15.120:0/2680754659 conn(0x7f7fc8078d30 msgr2=0x7f7fc810c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 shutdown_connections 2024-05-14T09:40:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:44.136+0000 7f7fcde00640 1 -- 172.21.15.120:0/2680754659 wait complete. 2024-05-14T09:40:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 790.0 s, 529.8 tps, lat 188.026 ms stddev 82.069 2024-05-14T09:40:44.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:44 smithi152 ceph-mon[34868]: pgmap v1071: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.7 MiB/s wr, 593 op/s 2024-05-14T09:40:44.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:44 smithi120 ceph-mon[31085]: pgmap v1071: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.7 MiB/s wr, 593 op/s 2024-05-14T09:40:44.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:44 smithi175 ceph-mon[35353]: pgmap v1071: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.7 MiB/s wr, 593 op/s 2024-05-14T09:40:46.637 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:46 smithi120 ceph-mon[31085]: pgmap v1072: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-05-14T09:40:46.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:46 smithi152 ceph-mon[34868]: pgmap v1072: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-05-14T09:40:46.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:46 smithi175 ceph-mon[35353]: pgmap v1072: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.8 MiB/s wr, 595 op/s 2024-05-14T09:40:48.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:48 smithi120 ceph-mon[31085]: pgmap v1073: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.8 MiB/s wr, 584 op/s 2024-05-14T09:40:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:48 smithi152 ceph-mon[34868]: pgmap v1073: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.8 MiB/s wr, 584 op/s 2024-05-14T09:40:48.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:48 smithi175 ceph-mon[35353]: pgmap v1073: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.8 MiB/s wr, 584 op/s 2024-05-14T09:40:49.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 795.0 s, 584.8 tps, lat 170.421 ms stddev 106.791 2024-05-14T09:40:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:50 smithi120 ceph-mon[31085]: pgmap v1074: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.6 MiB/s wr, 593 op/s 2024-05-14T09:40:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:50 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:40:50.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:50 smithi152 ceph-mon[34868]: pgmap v1074: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.6 MiB/s wr, 593 op/s 2024-05-14T09:40:50.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:50 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:40:50.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:50 smithi175 ceph-mon[35353]: pgmap v1074: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.6 MiB/s wr, 593 op/s 2024-05-14T09:40:50.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:50 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:40:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:52 smithi120 ceph-mon[31085]: pgmap v1075: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.9 MiB/s wr, 652 op/s 2024-05-14T09:40:52.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:52 smithi152 ceph-mon[34868]: pgmap v1075: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.9 MiB/s wr, 652 op/s 2024-05-14T09:40:52.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:52 smithi175 ceph-mon[35353]: pgmap v1075: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.9 MiB/s wr, 652 op/s 2024-05-14T09:40:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 800.0 s, 584.6 tps, lat 169.676 ms stddev 81.874 2024-05-14T09:40:54.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:54 smithi120 ceph-mon[31085]: pgmap v1076: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.8 MiB/s wr, 585 op/s 2024-05-14T09:40:54.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:54 smithi152 ceph-mon[34868]: pgmap v1076: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.8 MiB/s wr, 585 op/s 2024-05-14T09:40:54.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:54 smithi175 ceph-mon[35353]: pgmap v1076: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.8 MiB/s wr, 585 op/s 2024-05-14T09:40:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:56 smithi120 ceph-mon[31085]: pgmap v1077: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.1 MiB/s wr, 620 op/s 2024-05-14T09:40:56.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:56 smithi152 ceph-mon[34868]: pgmap v1077: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.1 MiB/s wr, 620 op/s 2024-05-14T09:40:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:56 smithi175 ceph-mon[35353]: pgmap v1077: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.1 MiB/s wr, 620 op/s 2024-05-14T09:40:57.522 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.521+0000 7fda11000640 1 -- 172.21.15.120:0/1177257014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c1017c0 msgr2=0x7fda0c101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.521+0000 7fda11000640 1 --2- 172.21.15.120:0/1177257014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c1017c0 0x7fda0c101bd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009900 tx=0x7fd9fc02a3f0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.522+0000 7fda11000640 1 -- 172.21.15.120:0/1177257014 shutdown_connections 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.522+0000 7fda11000640 1 --2- 172.21.15.120:0/1177257014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c102e90 0x7fda0c103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.522+0000 7fda11000640 1 --2- 172.21.15.120:0/1177257014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c102540 0x7fda0c102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.522+0000 7fda11000640 1 --2- 172.21.15.120:0/1177257014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c1017c0 0x7fda0c101bd0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.522+0000 7fda11000640 1 -- 172.21.15.120:0/1177257014 >> 172.21.15.120:0/1177257014 conn(0x7fda0c0fcea0 msgr2=0x7fda0c0ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.522+0000 7fda11000640 1 -- 172.21.15.120:0/1177257014 shutdown_connections 2024-05-14T09:40:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.522+0000 7fda11000640 1 -- 172.21.15.120:0/1177257014 wait complete. 2024-05-14T09:40:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 Processor -- start 2024-05-14T09:40:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 -- start start 2024-05-14T09:40:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c1017c0 0x7fda0c1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c102540 0x7fda0c1a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c102e90 0x7fda0c1a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c111690 con 0x7fda0c102540 2024-05-14T09:40:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c111510 con 0x7fda0c1017c0 2024-05-14T09:40:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.524+0000 7fda11000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c111810 con 0x7fda0c102e90 2024-05-14T09:40:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.525+0000 7fda0b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c1017c0 0x7fda0c1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.525+0000 7fda0aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c102540 0x7fda0c1a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.525+0000 7fda0b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c1017c0 0x7fda0c1a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:45990/0 (socket says 172.21.15.120:45990) 2024-05-14T09:40:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.525+0000 7fda0b400640 1 -- 172.21.15.120:0/1699428864 learned_addr learned my addr 172.21.15.120:0/1699428864 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.525+0000 7fda0be00640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c102e90 0x7fda0c1a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.526+0000 7fda0b400640 1 -- 172.21.15.120:0/1699428864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c102e90 msgr2=0x7fda0c1a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.526+0000 7fda0b400640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c102e90 0x7fda0c1a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.526+0000 7fda0b400640 1 -- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c102540 msgr2=0x7fda0c1a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.526+0000 7fda0b400640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c102540 0x7fda0c1a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.526+0000 7fda0b400640 1 -- 172.21.15.120:0/1699428864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c1a8220 con 0x7fda0c1017c0 2024-05-14T09:40:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.526+0000 7fda0aa00640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c102540 0x7fda0c1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.527+0000 7fda0b400640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c1017c0 0x7fda0c1a06e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc005760 tx=0x7fd9fc003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.528+0000 7fda03e00640 1 -- 172.21.15.120:0/1699428864 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc03f070 con 0x7fda0c1017c0 2024-05-14T09:40:57.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.528+0000 7fda03e00640 1 -- 172.21.15.120:0/1699428864 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9fc031b90 con 0x7fda0c1017c0 2024-05-14T09:40:57.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.528+0000 7fda03e00640 1 -- 172.21.15.120:0/1699428864 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc035030 con 0x7fda0c1017c0 2024-05-14T09:40:57.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.528+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c1a84b0 con 0x7fda0c1017c0 2024-05-14T09:40:57.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.529+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c1a8890 con 0x7fda0c1017c0 2024-05-14T09:40:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.533+0000 7fda19661740 1 Processor -- start 2024-05-14T09:40:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.534+0000 7fda19661740 1 -- start start 2024-05-14T09:40:57.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.534+0000 7fda19661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af4b1b0 0x56209b2ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.534+0000 7fda19661740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af222f0 0x56209b2ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.534+0000 7fda19661740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af2a4d0 0x56209b2f4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.534+0000 7fda19661740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56209b251550 con 0x56209af2a4d0 2024-05-14T09:40:57.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.534+0000 7fda19661740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56209b1f6bc0 con 0x56209af4b1b0 2024-05-14T09:40:57.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.534+0000 7fda19661740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56209b24d510 con 0x56209af222f0 2024-05-14T09:40:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.535+0000 7fda0aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af2a4d0 0x56209b2f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.535+0000 7fda03e00640 1 -- 172.21.15.120:0/1699428864 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd9fc042070 con 0x7fda0c1017c0 2024-05-14T09:40:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.535+0000 7fda0aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af2a4d0 0x56209b2f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43930/0 (socket says 172.21.15.120:43930) 2024-05-14T09:40:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.535+0000 7fda0aa00640 1 -- 172.21.15.120:0/3557390598 learned_addr learned my addr 172.21.15.120:0/3557390598 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.535+0000 7fda0be00640 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af4b1b0 0x56209b2ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.535+0000 7fda0b400640 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af222f0 0x56209b2ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.536+0000 7fda0aa00640 1 -- 172.21.15.120:0/3557390598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af222f0 msgr2=0x56209b2ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.536+0000 7fda0aa00640 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af222f0 0x56209b2ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.536+0000 7fda0aa00640 1 -- 172.21.15.120:0/3557390598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af4b1b0 msgr2=0x56209b2ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.536+0000 7fda0aa00640 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af4b1b0 0x56209b2ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.536+0000 7fda0aa00640 1 -- 172.21.15.120:0/3557390598 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209af63210 con 0x56209af2a4d0 2024-05-14T09:40:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.536+0000 7fda0b400640 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af222f0 0x56209b2ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.538+0000 7fda03e00640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9f00b29f0 0x7fd9f00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.538+0000 7fda03e00640 1 -- 172.21.15.120:0/1699428864 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd9fc102d30 con 0x7fda0c1017c0 2024-05-14T09:40:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.538+0000 7fda0be00640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9f00b29f0 0x7fd9f00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.539+0000 7fda0aa00640 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af2a4d0 0x56209b2f4780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80114f0 tx=0x7fd9f80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb53b2029a83c30 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.540 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.540+0000 7fda0be00640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9f00b29f0 0x7fd9f00b4f00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x56209b2ee4d0 tx=0x7fda04009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.540+0000 7fda00c00640 1 -- 172.21.15.120:0/3557390598 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f801e070 con 0x56209af2a4d0 2024-05-14T09:40:57.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.540+0000 7fda00c00640 1 -- 172.21.15.120:0/3557390598 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9f80044c0 con 0x56209af2a4d0 2024-05-14T09:40:57.541 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.540+0000 7fda00c00640 1 -- 172.21.15.120:0/3557390598 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800f5e0 con 0x56209af2a4d0 2024-05-14T09:40:57.542 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.541+0000 7fda19661740 1 -- 172.21.15.120:0/3557390598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af2a4d0 msgr2=0x56209b2f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.541+0000 7fda19661740 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af2a4d0 0x56209b2f4780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80114f0 tx=0x7fd9f80119b0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.542+0000 7fda19661740 1 -- 172.21.15.120:0/3557390598 shutdown_connections 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.542+0000 7fda19661740 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af2a4d0 0x56209b2f4780 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.542+0000 7fda19661740 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af222f0 0x56209b2ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.542+0000 7fda19661740 1 --2- 172.21.15.120:0/3557390598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af4b1b0 0x56209b2ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.542+0000 7fda19661740 1 -- 172.21.15.120:0/3557390598 >> 172.21.15.120:0/3557390598 conn(0x56209af3f300 msgr2=0x56209b2e8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.542+0000 7fda19661740 1 -- 172.21.15.120:0/3557390598 shutdown_connections 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.542+0000 7fda19661740 1 -- 172.21.15.120:0/3557390598 wait complete. 2024-05-14T09:40:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.543+0000 7fda19661740 1 -- start start 2024-05-14T09:40:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.543+0000 7fda19661740 1 Processor -- start 2024-05-14T09:40:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.544+0000 7fda19661740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.544+0000 7fda19661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2f7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.544+0000 7fda19661740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.544+0000 7fda19661740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56209b2f51d0 con 0x56209af222f0 2024-05-14T09:40:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.544+0000 7fda19661740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56209b20a660 con 0x56209af2a4d0 2024-05-14T09:40:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.544+0000 7fda19661740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56209b2f5350 con 0x56209af4b1b0 2024-05-14T09:40:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.544+0000 7fda19661740 10 client.0 _ll_register_callbacks cb 0x56209b1d4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43942/0 (socket says 172.21.15.120:43942) 2024-05-14T09:40:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 -- 172.21.15.120:0/996778761 learned_addr learned my addr 172.21.15.120:0/996778761 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0be00640 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0aa00640 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 -- 172.21.15.120:0/996778761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 msgr2=0x56209b2fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 -- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 msgr2=0x56209b2f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.545+0000 7fda0b400640 1 -- 172.21.15.120:0/996778761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56209b02f620 con 0x56209af222f0 2024-05-14T09:40:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.546+0000 7fda0b400640 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f6e20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0c71e0 tx=0x7fd9fc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1352e1ccffa5ab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.546+0000 7fd9f5600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:40:57.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.547+0000 7fd9f5600640 1 -- 172.21.15.120:0/996778761 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc049070 con 0x56209af222f0 2024-05-14T09:40:57.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.547+0000 7fd9f5600640 1 -- 172.21.15.120:0/996778761 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fd9fc0c6200 con 0x56209af222f0 2024-05-14T09:40:57.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.547+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56209b25f160 con 0x56209af222f0 2024-05-14T09:40:57.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.548+0000 7fd9f5600640 1 -- 172.21.15.120:0/996778761 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fd9fc0c9950 con 0x56209af222f0 2024-05-14T09:40:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.548+0000 7fda19661740 10 client.17358 fetch_fsmap learned FSMap version 72 2024-05-14T09:40:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.548+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x56209b3011f0 con 0x56209af222f0 2024-05-14T09:40:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.549+0000 7fd9f5600640 1 -- 172.21.15.120:0/996778761 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56209b25f160 con 0x56209af222f0 2024-05-14T09:40:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.549+0000 7fd9f5600640 1 -- 172.21.15.120:0/996778761 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 72) ==== 8370+0+0 (secure 0 0 0) 0x7fd9fc0d2920 con 0x56209af222f0 2024-05-14T09:40:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.549+0000 7fda19661740 10 client.17358 fetch_fsmap finished waiting for FSMap version 72 2024-05-14T09:40:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.549+0000 7fda19661740 10 client.17358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.549+0000 7fda19661740 20 client.17358 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.550+0000 7fda19661740 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209af09d80 0x56209b304a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.550+0000 7fda19661740 4 client.17358 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:40:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.550+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56209b258fd0 con 0x56209af09d80 2024-05-14T09:40:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.550+0000 7fda0aa00640 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209af09d80 0x56209b304a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.552+0000 7fda0aa00640 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209af09d80 0x56209b304a30 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32a976505c881c09 server_cookie=9f9f7740be212b11 in_seq=0 out_seq=0 2024-05-14T09:40:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.552+0000 7fd9f5600640 10 client.17358 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:57.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.553+0000 7fd9f5600640 1 -- 172.21.15.120:0/996778761 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56209b258fd0 con 0x56209af09d80 2024-05-14T09:40:57.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.553+0000 7fd9f5600640 10 client.17358 handle_command_reply: tid=0 2024-05-14T09:40:57.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.554+0000 7fda19661740 1 client.17358 shutdown 2024-05-14T09:40:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 msgr2=0x56209b2f6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f6e20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0c71e0 tx=0x7fd9fc003f10 comp rx=0 tx=0).stop 2024-05-14T09:40:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 shutdown_connections 2024-05-14T09:40:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209af09d80 0x56209b304a30 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 --2- 172.21.15.120:0/996778761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f6e20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 >> 172.21.15.120:0/996778761 conn(0x56209af3f300 msgr2=0x56209b2ebba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.555+0000 7fd9f5600640 0 client.17358 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.556+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 shutdown_connections 2024-05-14T09:40:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.556+0000 7fda19661740 1 -- 172.21.15.120:0/996778761 wait complete. 2024-05-14T09:40:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.557+0000 7fda19661740 20 client.17358 trim_cache size 0 max 16384 2024-05-14T09:40:57.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.593+0000 7fda19661740 1 Processor -- start 2024-05-14T09:40:57.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.593+0000 7fda19661740 1 -- start start 2024-05-14T09:40:57.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.594+0000 7fda19661740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.594+0000 7fda19661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.594+0000 7fda19661740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.595+0000 7fda0b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.595+0000 7fda0b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43946/0 (socket says 172.21.15.120:43946) 2024-05-14T09:40:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.595+0000 7fda0aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.595+0000 7fda0aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2e8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:46014/0 (socket says 172.21.15.120:46014) 2024-05-14T09:40:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.596+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1b2e60 con 0x56209af222f0 2024-05-14T09:40:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.596+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1b4a00 con 0x56209af2a4d0 2024-05-14T09:40:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.596+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1b3530 con 0x56209af4b1b0 2024-05-14T09:40:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.596+0000 7fda0b400640 1 -- 172.21.15.120:0/754540667 learned_addr learned my addr 172.21.15.120:0/754540667 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.596+0000 7fda0be00640 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.598+0000 7fda0aa00640 1 -- 172.21.15.120:0/754540667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 msgr2=0x56209b2fe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.598+0000 7fda0aa00640 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.598+0000 7fda0aa00640 1 -- 172.21.15.120:0/754540667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 msgr2=0x56209b2f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.598+0000 7fda0aa00640 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.598+0000 7fda0aa00640 1 -- 172.21.15.120:0/754540667 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209b2e44a0 con 0x56209af2a4d0 2024-05-14T09:40:57.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.599+0000 7fda0b400640 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:40:57.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.600+0000 7fda0aa00640 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2e8b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80114c0 tx=0x7fd9f80096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e269f167a92e095 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.605+0000 7fd9f7e00640 1 -- 172.21.15.120:0/754540667 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f801e040 con 0x56209af2a4d0 2024-05-14T09:40:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.605+0000 7fd9f7e00640 1 -- 172.21.15.120:0/754540667 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9f8003a80 con 0x56209af2a4d0 2024-05-14T09:40:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.605+0000 7fd9f7e00640 1 -- 172.21.15.120:0/754540667 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80052c0 con 0x56209af2a4d0 2024-05-14T09:40:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.607+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 msgr2=0x56209b2e8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.607+0000 7fda19661740 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2e8b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80114c0 tx=0x7fd9f80096e0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.607+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 shutdown_connections 2024-05-14T09:40:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.607+0000 7fda19661740 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af4b1b0 0x56209b2fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.607+0000 7fda19661740 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af2a4d0 0x56209b2e8b10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.607+0000 7fda19661740 1 --2- 172.21.15.120:0/754540667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af222f0 0x56209b2f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.607+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 >> 172.21.15.120:0/754540667 conn(0x56209af3f300 msgr2=0x56209b2e8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.608+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 shutdown_connections 2024-05-14T09:40:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.608+0000 7fda19661740 1 -- 172.21.15.120:0/754540667 wait complete. 2024-05-14T09:40:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.609+0000 7fda19661740 1 -- start start 2024-05-14T09:40:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.609+0000 7fda19661740 1 Processor -- start 2024-05-14T09:40:57.611 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.611+0000 7fda19661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af222f0 0x56209b2fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.611+0000 7fda19661740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af2a4d0 0x56209b2fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.612+0000 7fda19661740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af4b1b0 0x56209b36add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.612+0000 7fda19661740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1b4300 con 0x56209af4b1b0 2024-05-14T09:40:57.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.612+0000 7fda19661740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1b3c00 con 0x56209af222f0 2024-05-14T09:40:57.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.612+0000 7fda19661740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1b0e60 con 0x56209af2a4d0 2024-05-14T09:40:57.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.612+0000 7fda19661740 10 client.0 _ll_register_callbacks cb 0x7fd9fc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:40:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.614+0000 7fda0be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af4b1b0 0x56209b36add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.614+0000 7fda0be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af4b1b0 0x56209b36add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43960/0 (socket says 172.21.15.120:43960) 2024-05-14T09:40:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.614+0000 7fda0be00640 1 -- 172.21.15.120:0/2189925796 learned_addr learned my addr 172.21.15.120:0/2189925796 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:40:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.615+0000 7fda0be00640 1 -- 172.21.15.120:0/2189925796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af2a4d0 msgr2=0x56209b2fbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.615+0000 7fda0be00640 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af2a4d0 0x56209b2fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.615+0000 7fda0be00640 1 -- 172.21.15.120:0/2189925796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af222f0 msgr2=0x56209b2fb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.615+0000 7fda0be00640 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af222f0 0x56209b2fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.615+0000 7fda0be00640 1 -- 172.21.15.120:0/2189925796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56209b36b310 con 0x56209af4b1b0 2024-05-14T09:40:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.616+0000 7fd9f5600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:40:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.616+0000 7fda0be00640 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af4b1b0 0x56209b36add0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fda04004620 tx=0x7fda04004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e9e2ca84ab935a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.616+0000 7fd9f5600640 1 -- 172.21.15.120:0/2189925796 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0402e060 con 0x56209af4b1b0 2024-05-14T09:40:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.617+0000 7fd9f5600640 1 -- 172.21.15.120:0/2189925796 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fda0400f960 con 0x56209af4b1b0 2024-05-14T09:40:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.617+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f8003a80 con 0x56209af4b1b0 2024-05-14T09:40:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.618+0000 7fd9f5600640 1 -- 172.21.15.120:0/2189925796 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fda04003e30 con 0x56209af4b1b0 2024-05-14T09:40:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.618+0000 7fda19661740 10 client.17364 fetch_fsmap learned FSMap version 72 2024-05-14T09:40:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.618+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x56209b36c5a0 con 0x56209af4b1b0 2024-05-14T09:40:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fd9f5600640 1 -- 172.21.15.120:0/2189925796 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9f8003a80 con 0x56209af4b1b0 2024-05-14T09:40:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fd9f5600640 1 -- 172.21.15.120:0/2189925796 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 72) ==== 8370+0+0 (secure 0 0 0) 0x7fda04028070 con 0x56209af4b1b0 2024-05-14T09:40:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fda19661740 10 client.17364 fetch_fsmap finished waiting for FSMap version 72 2024-05-14T09:40:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fda19661740 10 client.17364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:40:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fda19661740 20 client.17364 populate_metadata read hostname 'smithi120' 2024-05-14T09:40:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fda19661740 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209aedf1c0 0x56209b36f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fda19661740 4 client.17364 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:40:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.619+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56209b2f5ec0 con 0x56209aedf1c0 2024-05-14T09:40:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.620+0000 7fda0b400640 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209aedf1c0 0x56209b36f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.621+0000 7fda0b400640 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209aedf1c0 0x56209b36f050 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3c0cf68dfe31fb server_cookie=2863bf88b7d8e3af in_seq=0 out_seq=0 2024-05-14T09:40:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.621+0000 7fd9f5600640 10 client.17364 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.667+0000 7fd9f5600640 1 -- 172.21.15.120:0/2189925796 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56209b2f5ec0 con 0x56209aedf1c0 2024-05-14T09:40:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.667+0000 7fd9f5600640 10 client.17364 handle_command_reply: tid=0 2024-05-14T09:40:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.668+0000 7fda19661740 1 client.17364 shutdown 2024-05-14T09:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.668+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af4b1b0 msgr2=0x56209b36add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.668+0000 7fda19661740 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af4b1b0 0x56209b36add0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fda04004620 tx=0x7fda04004ab0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.669+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 shutdown_connections 2024-05-14T09:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.669+0000 7fda19661740 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56209aedf1c0 0x56209b36f050 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.669+0000 7fda19661740 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56209af4b1b0 0x56209b36add0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.669+0000 7fda19661740 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209af2a4d0 0x56209b2fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.669+0000 7fda19661740 1 --2- 172.21.15.120:0/2189925796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56209af222f0 0x56209b2fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.669+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 >> 172.21.15.120:0/2189925796 conn(0x56209af3f300 msgr2=0x56209b2f7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.669+0000 7fd9f5600640 0 client.17364 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.670+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 shutdown_connections 2024-05-14T09:40:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.670+0000 7fda19661740 1 -- 172.21.15.120:0/2189925796 wait complete. 2024-05-14T09:40:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.671+0000 7fda19661740 20 client.17364 trim_cache size 0 max 16384 2024-05-14T09:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.674+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9f00b29f0 msgr2=0x7fd9f00b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.674+0000 7fda11000640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9f00b29f0 0x7fd9f00b4f00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x56209b2ee4d0 tx=0x7fda04009500 comp rx=0 tx=0).stop 2024-05-14T09:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.674+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c1017c0 msgr2=0x7fda0c1a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.674+0000 7fda11000640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c1017c0 0x7fda0c1a06e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc005760 tx=0x7fd9fc003b90 comp rx=0 tx=0).stop 2024-05-14T09:40:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.676+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 shutdown_connections 2024-05-14T09:40:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.676+0000 7fda11000640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fd9f00b29f0 0x7fd9f00b4f00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.676+0000 7fda11000640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c102e90 0x7fda0c1a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.676+0000 7fda11000640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda0c102540 0x7fda0c1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.676+0000 7fda11000640 1 --2- 172.21.15.120:0/1699428864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c1017c0 0x7fda0c1a06e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.676+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 >> 172.21.15.120:0/1699428864 conn(0x7fda0c0fcea0 msgr2=0x7fda0c106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.677+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 shutdown_connections 2024-05-14T09:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:40:57.678+0000 7fda11000640 1 -- 172.21.15.120:0/1699428864 wait complete. 2024-05-14T09:40:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:40:58 smithi120 ceph-mon[31085]: pgmap v1078: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 612 op/s 2024-05-14T09:40:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:40:58 smithi152 ceph-mon[34868]: pgmap v1078: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 612 op/s 2024-05-14T09:40:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:40:58 smithi175 ceph-mon[35353]: pgmap v1078: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 612 op/s 2024-05-14T09:40:59.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 805.0 s, 580.6 tps, lat 174.427 ms stddev 77.625 2024-05-14T09:41:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:00 smithi120 ceph-mon[31085]: pgmap v1079: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 581 op/s 2024-05-14T09:41:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:00 smithi152 ceph-mon[34868]: pgmap v1079: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 581 op/s 2024-05-14T09:41:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:00 smithi175 ceph-mon[35353]: pgmap v1079: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 581 op/s 2024-05-14T09:41:02.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:02 smithi120 ceph-mon[31085]: pgmap v1080: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2024-05-14T09:41:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:02 smithi152 ceph-mon[34868]: pgmap v1080: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2024-05-14T09:41:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:02 smithi175 ceph-mon[35353]: pgmap v1080: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2024-05-14T09:41:03.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:03 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:41:03.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:03 smithi120 ceph-mon[31085]: pgmap v1081: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 571 op/s 2024-05-14T09:41:03.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:03 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:41:03.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:03 smithi152 ceph-mon[34868]: pgmap v1081: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 571 op/s 2024-05-14T09:41:03.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:03 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:41:03.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:03 smithi175 ceph-mon[35353]: pgmap v1081: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 571 op/s 2024-05-14T09:41:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 810.0 s, 563.4 tps, lat 175.363 ms stddev 125.875 2024-05-14T09:41:06.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:06 smithi120 ceph-mon[31085]: pgmap v1082: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.4 MiB/s wr, 632 op/s 2024-05-14T09:41:06.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:06 smithi152 ceph-mon[34868]: pgmap v1082: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.4 MiB/s wr, 632 op/s 2024-05-14T09:41:06.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:06 smithi175 ceph-mon[35353]: pgmap v1082: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.4 MiB/s wr, 632 op/s 2024-05-14T09:41:08.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:08 smithi152 ceph-mon[34868]: pgmap v1083: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 572 op/s 2024-05-14T09:41:08.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:08 smithi175 ceph-mon[35353]: pgmap v1083: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 572 op/s 2024-05-14T09:41:08.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:08 smithi120 ceph-mon[31085]: pgmap v1083: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 572 op/s 2024-05-14T09:41:09.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 815.0 s, 601.6 tps, lat 168.760 ms stddev 89.643 2024-05-14T09:41:10.460 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:10 smithi152 ceph-mon[34868]: pgmap v1084: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 566 op/s 2024-05-14T09:41:10.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:10 smithi175 ceph-mon[35353]: pgmap v1084: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 566 op/s 2024-05-14T09:41:10.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:10 smithi120 ceph-mon[31085]: pgmap v1084: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 566 op/s 2024-05-14T09:41:11.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.059+0000 7f356ec00640 1 -- 172.21.15.120:0/1600536484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 msgr2=0x7f356810b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.059+0000 7f356ec00640 1 --2- 172.21.15.120:0/1600536484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 0x7f356810b790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3550009860 tx=0x7f355002a340 comp rx=0 tx=0).stop 2024-05-14T09:41:11.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.059+0000 7f356ec00640 1 -- 172.21.15.120:0/1600536484 shutdown_connections 2024-05-14T09:41:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.059+0000 7f356ec00640 1 --2- 172.21.15.120:0/1600536484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f356810bcd0 0x7f356810e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.059+0000 7f356ec00640 1 --2- 172.21.15.120:0/1600536484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 0x7f356810b790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.059+0000 7f356ec00640 1 --2- 172.21.15.120:0/1600536484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3568076150 0x7f3568076560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.059+0000 7f356ec00640 1 -- 172.21.15.120:0/1600536484 >> 172.21.15.120:0/1600536484 conn(0x7f35680feeb0 msgr2=0x7f3568101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.060+0000 7f356ec00640 1 -- 172.21.15.120:0/1600536484 shutdown_connections 2024-05-14T09:41:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.060+0000 7f356ec00640 1 -- 172.21.15.120:0/1600536484 wait complete. 2024-05-14T09:41:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.062+0000 7f356ec00640 1 Processor -- start 2024-05-14T09:41:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.062+0000 7f356ec00640 1 -- start start 2024-05-14T09:41:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f356ec00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3568076150 0x7f356806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f356ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 0x7f356806e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f356ec00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f356810bcd0 0x7f3568073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f356ec00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3568103650 con 0x7f3568076150 2024-05-14T09:41:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f356ec00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f35681034d0 con 0x7f356810bcd0 2024-05-14T09:41:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f356ec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35681037d0 con 0x7f3568076aa0 2024-05-14T09:41:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f3567e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3568076150 0x7f356806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f3567e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3568076150 0x7f356806e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56680/0 (socket says 172.21.15.120:56680) 2024-05-14T09:41:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.063+0000 7f3567e00640 1 -- 172.21.15.120:0/2885457418 learned_addr learned my addr 172.21.15.120:0/2885457418 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:11.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.064+0000 7f356cc00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f356810bcd0 0x7f3568073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.064+0000 7f3567400640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 0x7f356806e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.065+0000 7f3567e00640 1 -- 172.21.15.120:0/2885457418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 msgr2=0x7f356806e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.065+0000 7f3567e00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 0x7f356806e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.065+0000 7f3567e00640 1 -- 172.21.15.120:0/2885457418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f356810bcd0 msgr2=0x7f3568073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.065+0000 7f3567e00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f356810bcd0 0x7f3568073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.064 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.065+0000 7f3567e00640 1 -- 172.21.15.120:0/2885457418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3568073e70 con 0x7f3568076150 2024-05-14T09:41:11.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.065+0000 7f3567400640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 0x7f356806e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:11.065 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.065+0000 7f356cc00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f356810bcd0 0x7f3568073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:41:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.066+0000 7f3567e00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3568076150 0x7f356806e340 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f355800e9c0 tx=0x7f355800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.067+0000 7f3564c00640 1 -- 172.21.15.120:0/2885457418 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355800cd80 con 0x7f3568076150 2024-05-14T09:41:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.068+0000 7f3564c00640 1 -- 172.21.15.120:0/2885457418 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35580054b0 con 0x7f3568076150 2024-05-14T09:41:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.068+0000 7f3564c00640 1 -- 172.21.15.120:0/2885457418 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355800cd80 con 0x7f3568076150 2024-05-14T09:41:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.068+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3568074160 con 0x7f3568076150 2024-05-14T09:41:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.068+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3568074630 con 0x7f3568076150 2024-05-14T09:41:11.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.073+0000 7f3575c26740 1 Processor -- start 2024-05-14T09:41:11.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.073+0000 7f3575c26740 1 -- start start 2024-05-14T09:41:11.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.074+0000 7f3575c26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c721b9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.074+0000 7f3575c26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 0x562c721b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.074+0000 7f3575c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.074+0000 7f3575c26740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c7211d550 con 0x562c71e171b0 2024-05-14T09:41:11.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.074+0000 7f3575c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562c720c2bc0 con 0x562c71df64d0 2024-05-14T09:41:11.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.074+0000 7f3575c26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c72119510 con 0x562c71dee2f0 2024-05-14T09:41:11.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.075+0000 7f3567400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.075+0000 7f3567400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48902/0 (socket says 172.21.15.120:48902) 2024-05-14T09:41:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.075+0000 7f3567400640 1 -- 172.21.15.120:0/4038166225 learned_addr learned my addr 172.21.15.120:0/4038166225 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.076+0000 7f3567400640 1 -- 172.21.15.120:0/4038166225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 msgr2=0x562c721b9680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:41:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.076+0000 7f3567400640 1 --2- 172.21.15.120:0/4038166225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 0x562c721b9680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.076+0000 7f3567400640 1 -- 172.21.15.120:0/4038166225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 msgr2=0x562c721b9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.076+0000 7f3567400640 1 --2- 172.21.15.120:0/4038166225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c721b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.076+0000 7f3567400640 1 -- 172.21.15.120:0/4038166225 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c71e2f210 con 0x562c71df64d0 2024-05-14T09:41:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.077+0000 7f3567400640 1 --2- 172.21.15.120:0/4038166225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c0580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3550009860 tx=0x7f355002cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78354e28866914c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.077+0000 7f355d200640 1 -- 172.21.15.120:0/4038166225 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550041020 con 0x562c71df64d0 2024-05-14T09:41:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.077+0000 7f355d200640 1 -- 172.21.15.120:0/4038166225 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35500044d0 con 0x562c71df64d0 2024-05-14T09:41:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.077+0000 7f355d200640 1 -- 172.21.15.120:0/4038166225 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550037040 con 0x562c71df64d0 2024-05-14T09:41:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.078+0000 7f3564c00640 1 -- 172.21.15.120:0/2885457418 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3558004ce0 con 0x7f3568076150 2024-05-14T09:41:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.078+0000 7f3575c26740 1 -- 172.21.15.120:0/4038166225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 msgr2=0x562c721c0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.078+0000 7f3575c26740 1 --2- 172.21.15.120:0/4038166225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c0580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3550009860 tx=0x7f355002cdd0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.079+0000 7f3575c26740 1 -- 172.21.15.120:0/4038166225 shutdown_connections 2024-05-14T09:41:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.079+0000 7f3575c26740 1 --2- 172.21.15.120:0/4038166225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c0580 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.079+0000 7f3575c26740 1 --2- 172.21.15.120:0/4038166225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 0x562c721b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.079+0000 7f3575c26740 1 --2- 172.21.15.120:0/4038166225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c721b9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.079+0000 7f3575c26740 1 -- 172.21.15.120:0/4038166225 >> 172.21.15.120:0/4038166225 conn(0x562c71e0b300 msgr2=0x562c721b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.079+0000 7f3575c26740 1 -- 172.21.15.120:0/4038166225 shutdown_connections 2024-05-14T09:41:11.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.079+0000 7f3575c26740 1 -- 172.21.15.120:0/4038166225 wait complete. 2024-05-14T09:41:11.079 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.080+0000 7f3575c26740 1 -- start start 2024-05-14T09:41:11.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.080+0000 7f3575c26740 1 Processor -- start 2024-05-14T09:41:11.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.083+0000 7f3564c00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f354c0b29e0 0x7f354c0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.084+0000 7f356cc00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f354c0b29e0 0x7f354c0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.084+0000 7f3575c26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3567e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3567e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56690/0 (socket says 172.21.15.120:56690) 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3575c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3575c26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71e171b0 0x562c721ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3575c26740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c721c0f70 con 0x562c71dee2f0 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3575c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562c720d6660 con 0x562c71df64d0 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3575c26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c721c10f0 con 0x562c71e171b0 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3567e00640 1 -- 172.21.15.120:0/375825722 learned_addr learned my addr 172.21.15.120:0/375825722 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.085+0000 7f3575c26740 10 client.0 _ll_register_callbacks cb 0x562c720a0400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.086+0000 7f3564c00640 1 -- 172.21.15.120:0/2885457418 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f35580e27f0 con 0x7f3568076150 2024-05-14T09:41:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.086+0000 7f3567400640 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.086+0000 7f3567e00640 1 -- 172.21.15.120:0/375825722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71e171b0 msgr2=0x562c721ca160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:41:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.086+0000 7f3567e00640 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71e171b0 0x562c721ca160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.086+0000 7f3567e00640 1 -- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 msgr2=0x562c721c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.086+0000 7f3567e00640 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.086+0000 7f3567e00640 1 -- 172.21.15.120:0/375825722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c71efb620 con 0x562c71dee2f0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.087+0000 7f3567e00640 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721c2cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f355804dfb0 tx=0x7f35580a9420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21711c7c8c469717 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.087+0000 7f3555600640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.088+0000 7f3555600640 1 -- 172.21.15.120:0/375825722 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580a9520 con 0x562c71dee2f0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.088+0000 7f3555600640 1 -- 172.21.15.120:0/375825722 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f35580046c0 con 0x562c71dee2f0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.088+0000 7f356cc00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f354c0b29e0 0x7f354c0b4ef0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x562c721ba2d0 tx=0x7f3560010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.088+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35500044d0 con 0x562c71dee2f0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.088+0000 7f3555600640 1 -- 172.21.15.120:0/375825722 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f35580c3050 con 0x562c71dee2f0 2024-05-14T09:41:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.089+0000 7f3575c26740 10 client.17373 fetch_fsmap learned FSMap version 73 2024-05-14T09:41:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.089+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x562c721cd140 con 0x562c71dee2f0 2024-05-14T09:41:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.090+0000 7f3555600640 1 -- 172.21.15.120:0/375825722 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35500044d0 con 0x562c71dee2f0 2024-05-14T09:41:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.090+0000 7f3555600640 1 -- 172.21.15.120:0/375825722 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 73) ==== 8366+0+0 (secure 0 0 0) 0x7f3558053d10 con 0x562c71dee2f0 2024-05-14T09:41:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.091+0000 7f3575c26740 10 client.17373 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T09:41:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.091+0000 7f3575c26740 10 client.17373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.091+0000 7f3575c26740 20 client.17373 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.091+0000 7f3575c26740 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dd5d80 0x562c721d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.091+0000 7f3575c26740 4 client.17373 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.091+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c7212b160 con 0x562c71dd5d80 2024-05-14T09:41:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.092+0000 7f3567400640 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dd5d80 0x562c721d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.093+0000 7f3555600640 10 client.17373 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.093+0000 7f3567400640 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dd5d80 0x562c721d0760 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51459f9a9ecd8c1f server_cookie=5b0d025879f75b13 in_seq=0 out_seq=0 2024-05-14T09:41:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.095+0000 7f3555600640 1 -- 172.21.15.120:0/375825722 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562c7212b160 con 0x562c71dd5d80 2024-05-14T09:41:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.095+0000 7f3555600640 10 client.17373 handle_command_reply: tid=0 2024-05-14T09:41:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.095+0000 7f3575c26740 1 client.17373 shutdown 2024-05-14T09:41:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.096+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 msgr2=0x562c721c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.096+0000 7f3575c26740 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721c2cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f355804dfb0 tx=0x7f35580a9420 comp rx=0 tx=0).stop 2024-05-14T09:41:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.097+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 shutdown_connections 2024-05-14T09:41:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.097+0000 7f3575c26740 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dd5d80 0x562c721d0760 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.097+0000 7f3575c26740 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71e171b0 0x562c721ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.097+0000 7f3575c26740 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.097+0000 7f3575c26740 1 --2- 172.21.15.120:0/375825722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721c2cc0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.097+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 >> 172.21.15.120:0/375825722 conn(0x562c71e0b300 msgr2=0x562c721b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.098+0000 7f3555600640 0 client.17373 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.098+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 shutdown_connections 2024-05-14T09:41:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.098+0000 7f3575c26740 1 -- 172.21.15.120:0/375825722 wait complete. 2024-05-14T09:41:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.098+0000 7f3575c26740 20 client.17373 trim_cache size 0 max 16384 2024-05-14T09:41:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.136+0000 7f3575c26740 1 Processor -- start 2024-05-14T09:41:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.136+0000 7f3575c26740 1 -- start start 2024-05-14T09:41:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3575c26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721bd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3575c26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71df64d0 0x562c721b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3575c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71e171b0 0x562c721ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3575c26740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f35681bb6b0 con 0x562c71dee2f0 2024-05-14T09:41:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3575c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f35681bd220 con 0x562c71e171b0 2024-05-14T09:41:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3575c26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35681bbd80 con 0x562c71df64d0 2024-05-14T09:41:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f356cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71e171b0 0x562c721ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3567e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721bd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3567e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721bd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56700/0 (socket says 172.21.15.120:56700) 2024-05-14T09:41:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3567e00640 1 -- 172.21.15.120:0/536399215 learned_addr learned my addr 172.21.15.120:0/536399215 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.137+0000 7f3567400640 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71df64d0 0x562c721b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.138+0000 7f3567e00640 1 -- 172.21.15.120:0/536399215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71df64d0 msgr2=0x562c721b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.138+0000 7f3567e00640 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71df64d0 0x562c721b8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.138+0000 7f3567e00640 1 -- 172.21.15.120:0/536399215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71e171b0 msgr2=0x562c721ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.138+0000 7f3567e00640 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71e171b0 0x562c721ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.138+0000 7f3567e00640 1 -- 172.21.15.120:0/536399215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c721b5010 con 0x562c71dee2f0 2024-05-14T09:41:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.139+0000 7f3567e00640 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721bd790 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f355800cfd0 tx=0x7f35580a9490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee4a9b6f0f52905 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.139+0000 7f3557e00640 1 -- 172.21.15.120:0/536399215 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355804ee60 con 0x562c71dee2f0 2024-05-14T09:41:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.139+0000 7f3557e00640 1 -- 172.21.15.120:0/536399215 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35580a9520 con 0x562c71dee2f0 2024-05-14T09:41:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.139+0000 7f3557e00640 1 -- 172.21.15.120:0/536399215 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580bee60 con 0x562c71dee2f0 2024-05-14T09:41:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.141+0000 7f3575c26740 1 -- 172.21.15.120:0/536399215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 msgr2=0x562c721bd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.141+0000 7f3575c26740 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721bd790 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f355800cfd0 tx=0x7f35580a9490 comp rx=0 tx=0).stop 2024-05-14T09:41:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.141+0000 7f3575c26740 1 -- 172.21.15.120:0/536399215 shutdown_connections 2024-05-14T09:41:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.141+0000 7f3575c26740 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71e171b0 0x562c721ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.141+0000 7f3575c26740 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71df64d0 0x562c721b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.141+0000 7f3575c26740 1 --2- 172.21.15.120:0/536399215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71dee2f0 0x562c721bd790 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.141+0000 7f3575c26740 1 -- 172.21.15.120:0/536399215 >> 172.21.15.120:0/536399215 conn(0x562c71e0b300 msgr2=0x562c721b7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.142+0000 7f3575c26740 1 -- 172.21.15.120:0/536399215 shutdown_connections 2024-05-14T09:41:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.142+0000 7f3575c26740 1 -- 172.21.15.120:0/536399215 wait complete. 2024-05-14T09:41:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.143+0000 7f3575c26740 1 -- start start 2024-05-14T09:41:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.143+0000 7f3575c26740 1 Processor -- start 2024-05-14T09:41:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3575c26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 0x562c721c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3575c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3575c26740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c72236ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3575c26740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f35681bcb50 con 0x562c71e171b0 2024-05-14T09:41:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3575c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f35681bc450 con 0x562c71df64d0 2024-05-14T09:41:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3575c26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35681b96b0 con 0x562c71dee2f0 2024-05-14T09:41:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3575c26740 10 client.0 _ll_register_callbacks cb 0x7f3558004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3567400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3567400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:48938/0 (socket says 172.21.15.120:48938) 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.144+0000 7f3567400640 1 -- 172.21.15.120:0/4294177274 learned_addr learned my addr 172.21.15.120:0/4294177274 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.145+0000 7f3567e00640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 0x562c721c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.145+0000 7f356cc00640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c72236ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.145+0000 7f3567400640 1 -- 172.21.15.120:0/4294177274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 msgr2=0x562c721c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.145+0000 7f3567400640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 0x562c721c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.145+0000 7f3567400640 1 -- 172.21.15.120:0/4294177274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 msgr2=0x562c72236ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.145+0000 7f3567400640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c72236ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.145+0000 7f3567400640 1 -- 172.21.15.120:0/4294177274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c722374b0 con 0x562c71df64d0 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.146+0000 7f356cc00640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c72236ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.146+0000 7f3567400640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721ca3d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3550009830 tx=0x7f3550005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94930db432be152 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.146+0000 7f3555600640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:41:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.147+0000 7f3555600640 1 -- 172.21.15.120:0/4294177274 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550041040 con 0x562c71df64d0 2024-05-14T09:41:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.147+0000 7f3555600640 1 -- 172.21.15.120:0/4294177274 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f3550030c10 con 0x562c71df64d0 2024-05-14T09:41:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.147+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35580a9520 con 0x562c71df64d0 2024-05-14T09:41:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.153+0000 7f3555600640 1 -- 172.21.15.120:0/4294177274 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f3550037040 con 0x562c71df64d0 2024-05-14T09:41:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.153+0000 7f3575c26740 10 client.36881 fetch_fsmap learned FSMap version 73 2024-05-14T09:41:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.153+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x562c722387d0 con 0x562c71df64d0 2024-05-14T09:41:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3555600640 1 -- 172.21.15.120:0/4294177274 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35580a9520 con 0x562c71df64d0 2024-05-14T09:41:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3555600640 1 -- 172.21.15.120:0/4294177274 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 73) ==== 8366+0+0 (secure 0 0 0) 0x7f355004dce0 con 0x562c71df64d0 2024-05-14T09:41:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3575c26740 10 client.36881 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T09:41:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3575c26740 10 client.36881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3575c26740 20 client.36881 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3575c26740 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dab1c0 0x562c7223ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3575c26740 4 client.36881 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:41:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.154+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c72124fd0 con 0x562c71dab1c0 2024-05-14T09:41:11.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.155+0000 7f3567e00640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dab1c0 0x562c7223ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.156+0000 7f3567e00640 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dab1c0 0x562c7223ad50 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fad878d5488f653 server_cookie=4f19b6058594c5d3 in_seq=0 out_seq=0 2024-05-14T09:41:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.156+0000 7f3555600640 10 client.36881 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.175+0000 7f3555600640 1 -- 172.21.15.120:0/4294177274 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c72124fd0 con 0x562c71dab1c0 2024-05-14T09:41:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.175+0000 7f3555600640 10 client.36881 handle_command_reply: tid=0 2024-05-14T09:41:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.175+0000 7f3575c26740 1 client.36881 shutdown 2024-05-14T09:41:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 msgr2=0x562c721ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721ca3d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3550009830 tx=0x7f3550005c90 comp rx=0 tx=0).stop 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 shutdown_connections 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x562c71dab1c0 0x562c7223ad50 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c71e171b0 0x562c72236ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3555600640 0 client.36881 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c71df64d0 0x562c721ca3d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 --2- 172.21.15.120:0/4294177274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c71dee2f0 0x562c721c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 >> 172.21.15.120:0/4294177274 conn(0x562c71e0b300 msgr2=0x562c721c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 shutdown_connections 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 1 -- 172.21.15.120:0/4294177274 wait complete. 2024-05-14T09:41:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.176+0000 7f3575c26740 20 client.36881 trim_cache size 0 max 16384 2024-05-14T09:41:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:41:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:41:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:41:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.177+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f354c0b29e0 msgr2=0x7f354c0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.177+0000 7f356ec00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f354c0b29e0 0x7f354c0b4ef0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x562c721ba2d0 tx=0x7f3560010040 comp rx=0 tx=0).stop 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.177+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3568076150 msgr2=0x7f356806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.177+0000 7f356ec00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3568076150 0x7f356806e340 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f355800e9c0 tx=0x7f355800ee80 comp rx=0 tx=0).stop 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 shutdown_connections 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f354c0b29e0 0x7f354c0b4ef0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f356810bcd0 0x7f3568073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568076aa0 0x7f356806e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 --2- 172.21.15.120:0/2885457418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3568076150 0x7f356806e340 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 >> 172.21.15.120:0/2885457418 conn(0x7f35680feeb0 msgr2=0x7f3568104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 shutdown_connections 2024-05-14T09:41:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:11.178+0000 7f356ec00640 1 -- 172.21.15.120:0/2885457418 wait complete. 2024-05-14T09:41:11.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:11 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:41:11.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:11 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:41:11.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:11 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:41:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:12 smithi175 ceph-mon[35353]: pgmap v1085: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 663 op/s 2024-05-14T09:41:12.439 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:12 smithi152 ceph-mon[34868]: pgmap v1085: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 663 op/s 2024-05-14T09:41:12.558 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:12 smithi120 ceph-mon[31085]: pgmap v1085: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 663 op/s 2024-05-14T09:41:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 820.0 s, 564.2 tps, lat 174.486 ms stddev 100.087 2024-05-14T09:41:14.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:14 smithi152 ceph-mon[34868]: pgmap v1086: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 547 op/s 2024-05-14T09:41:14.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.459 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:14 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:14 smithi175 ceph-mon[35353]: pgmap v1086: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 547 op/s 2024-05-14T09:41:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:14 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:14 smithi120 ceph-mon[31085]: pgmap v1086: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 547 op/s 2024-05-14T09:41:14.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:14.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:14 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:16 smithi152 ceph-mon[34868]: pgmap v1087: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2024-05-14T09:41:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:16.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:16 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:16 smithi175 ceph-mon[35353]: pgmap v1087: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2024-05-14T09:41:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:16.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:16 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:16.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:16 smithi120 ceph-mon[31085]: pgmap v1087: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2024-05-14T09:41:16.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:16.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:16 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:18.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:18 smithi175 ceph-mon[35353]: pgmap v1088: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-05-14T09:41:18.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:41:18.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:41:18.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:18.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:18 smithi120 ceph-mon[31085]: pgmap v1088: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-05-14T09:41:18.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:41:18.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:41:18.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:18 smithi152 ceph-mon[34868]: pgmap v1088: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-05-14T09:41:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:41:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:41:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:41:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 825.0 s, 485.4 tps, lat 209.168 ms stddev 86.906 2024-05-14T09:41:20.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:20 smithi175 ceph-mon[35353]: pgmap v1089: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.4 MiB/s wr, 560 op/s 2024-05-14T09:41:20.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:20 smithi120 ceph-mon[31085]: pgmap v1089: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.4 MiB/s wr, 560 op/s 2024-05-14T09:41:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:20 smithi152 ceph-mon[34868]: pgmap v1089: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.4 MiB/s wr, 560 op/s 2024-05-14T09:41:22.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:22 smithi120 ceph-mon[31085]: pgmap v1090: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.7 MiB/s wr, 624 op/s 2024-05-14T09:41:22.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:22 smithi152 ceph-mon[34868]: pgmap v1090: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.7 MiB/s wr, 624 op/s 2024-05-14T09:41:22.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:22 smithi175 ceph-mon[35353]: pgmap v1090: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.7 MiB/s wr, 624 op/s 2024-05-14T09:41:24.333 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 830.0 s, 543.8 tps, lat 182.617 ms stddev 116.488 2024-05-14T09:41:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.626+0000 7f1515800640 1 -- 172.21.15.120:0/3585832384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508096a50 msgr2=0x7f1508097750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.626+0000 7f1515800640 1 --2- 172.21.15.120:0/3585832384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508096a50 0x7f1508097750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1504009860 tx=0x7f150402a340 comp rx=0 tx=0).stop 2024-05-14T09:41:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.627+0000 7f1515800640 1 -- 172.21.15.120:0/3585832384 shutdown_connections 2024-05-14T09:41:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.627+0000 7f1515800640 1 --2- 172.21.15.120:0/3585832384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150809c990 0x7f150809edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.627+0000 7f1515800640 1 --2- 172.21.15.120:0/3585832384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1508097c90 0x7f15080980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.627+0000 7f1515800640 1 --2- 172.21.15.120:0/3585832384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508096a50 0x7f1508097750 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.627+0000 7f1515800640 1 -- 172.21.15.120:0/3585832384 >> 172.21.15.120:0/3585832384 conn(0x7f1508091c20 msgr2=0x7f15080940f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.627+0000 7f1515800640 1 -- 172.21.15.120:0/3585832384 shutdown_connections 2024-05-14T09:41:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.627+0000 7f1515800640 1 -- 172.21.15.120:0/3585832384 wait complete. 2024-05-14T09:41:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 Processor -- start 2024-05-14T09:41:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 -- start start 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1508096a50 0x7f150812f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508097c90 0x7f150812f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f150809c990 0x7f15081367b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f15080a23f0 con 0x7f1508096a50 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15080a2270 con 0x7f150809c990 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.629+0000 7f1515800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15080a2570 con 0x7f1508097c90 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.630+0000 7f150fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1508096a50 0x7f150812f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.630+0000 7f150fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1508096a50 0x7f150812f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55938/0 (socket says 172.21.15.120:55938) 2024-05-14T09:41:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.630+0000 7f150fe00640 1 -- 172.21.15.120:0/1251742767 learned_addr learned my addr 172.21.15.120:0/1251742767 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.630+0000 7f1514e00640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f150809c990 0x7f15081367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.630+0000 7f150f400640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508097c90 0x7f150812f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.631+0000 7f150fe00640 1 -- 172.21.15.120:0/1251742767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508097c90 msgr2=0x7f150812f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.631+0000 7f150fe00640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508097c90 0x7f150812f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.631+0000 7f150fe00640 1 -- 172.21.15.120:0/1251742767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f150809c990 msgr2=0x7f15081367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.631+0000 7f150fe00640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f150809c990 0x7f15081367b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.631+0000 7f150fe00640 1 -- 172.21.15.120:0/1251742767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1508136e20 con 0x7f1508096a50 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.631+0000 7f150fe00640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1508096a50 0x7f150812f2e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f150402a930 tx=0x7f15040306e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.632+0000 7f150cc00640 1 -- 172.21.15.120:0/1251742767 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504042070 con 0x7f1508096a50 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.632+0000 7f150cc00640 1 -- 172.21.15.120:0/1251742767 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1504032df0 con 0x7f1508096a50 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.632+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15081370b0 con 0x7f1508096a50 2024-05-14T09:41:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.632+0000 7f150cc00640 1 -- 172.21.15.120:0/1251742767 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504037040 con 0x7f1508096a50 2024-05-14T09:41:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.632+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1508137570 con 0x7f1508096a50 2024-05-14T09:41:24.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:24 smithi120 ceph-mon[31085]: pgmap v1091: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.4 MiB/s wr, 499 op/s 2024-05-14T09:41:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.636+0000 7f151de78740 1 Processor -- start 2024-05-14T09:41:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.637+0000 7f151de78740 1 -- start start 2024-05-14T09:41:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.637+0000 7f151de78740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393b91b0 0x562939763b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.637+0000 7f151de78740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393902f0 0x562939764080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.637+0000 7f151de78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.637+0000 7f151de78740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5629396bf550 con 0x5629393902f0 2024-05-14T09:41:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.637+0000 7f151de78740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562939664bc0 con 0x5629393b91b0 2024-05-14T09:41:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.637+0000 7f151de78740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5629396bb510 con 0x5629393984d0 2024-05-14T09:41:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.638+0000 7f150f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.638+0000 7f150f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:35196/0 (socket says 172.21.15.120:35196) 2024-05-14T09:41:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.638+0000 7f150f400640 1 -- 172.21.15.120:0/2321237949 learned_addr learned my addr 172.21.15.120:0/2321237949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.638+0000 7f1514e00640 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393b91b0 0x562939763b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.639+0000 7f150f400640 1 -- 172.21.15.120:0/2321237949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393b91b0 msgr2=0x562939763b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.639+0000 7f150f400640 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393b91b0 0x562939763b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.639+0000 7f150f400640 1 -- 172.21.15.120:0/2321237949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393902f0 msgr2=0x562939764080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:41:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.639+0000 7f150f400640 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393902f0 0x562939764080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.639+0000 7f150f400640 1 -- 172.21.15.120:0/2321237949 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629393d1210 con 0x5629393984d0 2024-05-14T09:41:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.640+0000 7f150f400640 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976af80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1510051620 tx=0x7f1510068de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32cf2d5934185e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.641+0000 7f1501600640 1 -- 172.21.15.120:0/2321237949 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151007f4f0 con 0x5629393984d0 2024-05-14T09:41:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.641+0000 7f1501600640 1 -- 172.21.15.120:0/2321237949 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1510083030 con 0x5629393984d0 2024-05-14T09:41:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.641+0000 7f1501600640 1 -- 172.21.15.120:0/2321237949 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151007ea00 con 0x5629393984d0 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 -- 172.21.15.120:0/2321237949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 msgr2=0x56293976af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976af80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1510051620 tx=0x7f1510068de0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 -- 172.21.15.120:0/2321237949 shutdown_connections 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976af80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393902f0 0x562939764080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 --2- 172.21.15.120:0/2321237949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393b91b0 0x562939763b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 -- 172.21.15.120:0/2321237949 >> 172.21.15.120:0/2321237949 conn(0x5629393ad300 msgr2=0x56293975f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f150cc00640 1 -- 172.21.15.120:0/1251742767 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f1504045070 con 0x7f1508096a50 2024-05-14T09:41:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.643+0000 7f151de78740 1 -- 172.21.15.120:0/2321237949 shutdown_connections 2024-05-14T09:41:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.644+0000 7f151de78740 1 -- 172.21.15.120:0/2321237949 wait complete. 2024-05-14T09:41:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.645+0000 7f151de78740 1 -- start start 2024-05-14T09:41:24.797 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:24 smithi175 ceph-mon[35353]: pgmap v1091: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.4 MiB/s wr, 499 op/s 2024-05-14T09:41:24.797 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:24 smithi152 ceph-mon[34868]: pgmap v1091: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.4 MiB/s wr, 499 op/s 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.646+0000 7f150cc00640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14f80b26b0 0x7f14f80b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.647+0000 7f150cc00640 1 -- 172.21.15.120:0/1251742767 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1504102040 con 0x7f1508096a50 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.647+0000 7f151de78740 1 Processor -- start 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.647+0000 7f1514e00640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14f80b26b0 0x7f14f80b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.648+0000 7f151de78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.648+0000 7f151de78740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.648+0000 7f151de78740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562939377d80 0x562939774b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.648+0000 7f151de78740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56293976b9d0 con 0x5629393b91b0 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.648+0000 7f151de78740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562939678660 con 0x562939377d80 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.648+0000 7f151de78740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56293976bb50 con 0x5629393984d0 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.649+0000 7f1514e00640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14f80b26b0 0x7f14f80b4bc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x562939764cd0 tx=0x7f14fc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.649+0000 7f150f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.649+0000 7f151de78740 10 client.0 _ll_register_callbacks cb 0x562939642400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.649+0000 7f150f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55942/0 (socket says 172.21.15.120:55942) 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.649+0000 7f150fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.649+0000 7f150f400640 1 -- 172.21.15.120:0/2442434903 learned_addr learned my addr 172.21.15.120:0/2442434903 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.649+0000 7f1514e00640 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562939377d80 0x562939774b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f150fe00640 1 -- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562939377d80 msgr2=0x562939774b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f150fe00640 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562939377d80 0x562939774b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f150fe00640 1 -- 172.21.15.120:0/2442434903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 msgr2=0x56293976dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f150fe00640 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f150fe00640 1 -- 172.21.15.120:0/2442434903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56293949d620 con 0x5629393984d0 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f150f400640 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f150fe00640 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976d6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x562939764ee0 tx=0x7f150402a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e481ca0777e9f932 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.650+0000 7f14f6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:41:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.651+0000 7f14f6000640 1 -- 172.21.15.120:0/2442434903 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040c92c0 con 0x5629393984d0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.651+0000 7f14f6000640 1 -- 172.21.15.120:0/2442434903 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1504032880 con 0x5629393984d0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.651+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1510083030 con 0x5629393984d0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.652+0000 7f14f6000640 1 -- 172.21.15.120:0/2442434903 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f15040cd670 con 0x5629393984d0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.652+0000 7f151de78740 10 client.26965 fetch_fsmap learned FSMap version 73 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.653+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x56293976baf0 con 0x5629393984d0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.653+0000 7f14f6000640 1 -- 172.21.15.120:0/2442434903 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1510083030 con 0x5629393984d0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.654+0000 7f14f6000640 1 -- 172.21.15.120:0/2442434903 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 73) ==== 8366+0+0 (secure 0 0 0) 0x7f15040e3bb0 con 0x5629393984d0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.654+0000 7f151de78740 10 client.26965 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.654+0000 7f151de78740 10 client.26965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.654+0000 7f151de78740 20 client.26965 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.654+0000 7f151de78740 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56293934d1c0 0x56293977b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.654+0000 7f151de78740 4 client.26965 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.654+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629396cd160 con 0x56293934d1c0 2024-05-14T09:41:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.655+0000 7f150f400640 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56293934d1c0 0x56293977b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.657+0000 7f150f400640 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56293934d1c0 0x56293977b260 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d0341a58d9fdc8 server_cookie=7f87e31fe682d24f in_seq=0 out_seq=0 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.657+0000 7f14f6000640 10 client.26965 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.659+0000 7f14f6000640 1 -- 172.21.15.120:0/2442434903 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5629396cd160 con 0x56293934d1c0 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.659+0000 7f14f6000640 10 client.26965 handle_command_reply: tid=0 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 client.26965 shutdown 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 msgr2=0x56293976d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976d6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x562939764ee0 tx=0x7f150402a340 comp rx=0 tx=0).stop 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 shutdown_connections 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x56293934d1c0 0x56293977b260 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f14f6000640 0 client.26965 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562939377d80 0x562939774b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 --2- 172.21.15.120:0/2442434903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393984d0 0x56293976d6b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.660+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 >> 172.21.15.120:0/2442434903 conn(0x5629393ad300 msgr2=0x562939755c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.661+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 shutdown_connections 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.661+0000 7f151de78740 1 -- 172.21.15.120:0/2442434903 wait complete. 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.662+0000 7f151de78740 20 client.26965 trim_cache size 0 max 16384 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.714+0000 7f151de78740 1 Processor -- start 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.714+0000 7f151de78740 1 -- start start 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.715+0000 7f151de78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562939377d80 0x562939751ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.715+0000 7f151de78740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 0x56293976c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.715+0000 7f151de78740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.716+0000 7f151de78740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f150813d5b0 con 0x5629393b91b0 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.716+0000 7f150fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562939377d80 0x562939751ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.716+0000 7f150fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562939377d80 0x562939751ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:35218/0 (socket says 172.21.15.120:35218) 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.716+0000 7f150fe00640 1 -- 172.21.15.120:0/522343656 learned_addr learned my addr 172.21.15.120:0/522343656 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.716+0000 7f151de78740 1 -- 172.21.15.120:0/522343656 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f150813f120 con 0x5629393984d0 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.716+0000 7f151de78740 1 -- 172.21.15.120:0/522343656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f150813dc80 con 0x562939377d80 2024-05-14T09:41:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.717+0000 7f1514e00640 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.717+0000 7f150fe00640 1 -- 172.21.15.120:0/522343656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 msgr2=0x56293976c940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.717+0000 7f150fe00640 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 0x56293976c940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.717+0000 7f150fe00640 1 -- 172.21.15.120:0/522343656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 msgr2=0x56293976ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.718+0000 7f150fe00640 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.718+0000 7f150fe00640 1 -- 172.21.15.120:0/522343656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629397646c0 con 0x562939377d80 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.718+0000 7f1514e00640 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.718+0000 7f150fe00640 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562939377d80 0x562939751ba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15040c8fc0 tx=0x7f15040c51a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5cb8cfb95ff310c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.720+0000 7f1500c00640 1 -- 172.21.15.120:0/522343656 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040c9090 con 0x562939377d80 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.720+0000 7f1500c00640 1 -- 172.21.15.120:0/522343656 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15040c92c0 con 0x562939377d80 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.720+0000 7f1500c00640 1 -- 172.21.15.120:0/522343656 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040e3ca0 con 0x562939377d80 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.722+0000 7f151de78740 1 -- 172.21.15.120:0/522343656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562939377d80 msgr2=0x562939751ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.722+0000 7f151de78740 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562939377d80 0x562939751ba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15040c8fc0 tx=0x7f15040c51a0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.722+0000 7f151de78740 1 -- 172.21.15.120:0/522343656 shutdown_connections 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.724+0000 7f151de78740 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5629393b91b0 0x56293976ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.724+0000 7f151de78740 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 0x56293976c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.724+0000 7f151de78740 1 --2- 172.21.15.120:0/522343656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562939377d80 0x562939751ba0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.724+0000 7f151de78740 1 -- 172.21.15.120:0/522343656 >> 172.21.15.120:0/522343656 conn(0x5629393ad300 msgr2=0x562939767ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.725+0000 7f151de78740 1 -- 172.21.15.120:0/522343656 shutdown_connections 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.725+0000 7f151de78740 1 -- 172.21.15.120:0/522343656 wait complete. 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.726+0000 7f151de78740 1 -- start start 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.726+0000 7f151de78740 1 Processor -- start 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.727+0000 7f151de78740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562939377d80 0x5629397713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.727+0000 7f151de78740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 0x5629397718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.727+0000 7f151de78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393b91b0 0x562939772820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.727+0000 7f151de78740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f150813ea50 con 0x562939377d80 2024-05-14T09:41:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.728+0000 7f150f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 0x5629397718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.728+0000 7f1514e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393b91b0 0x562939772820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.728+0000 7f151de78740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f150813e350 con 0x5629393984d0 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.728+0000 7f151de78740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f150813b5b0 con 0x5629393b91b0 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.728+0000 7f1514e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393b91b0 0x562939772820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:35226/0 (socket says 172.21.15.120:35226) 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.728+0000 7f1514e00640 1 -- 172.21.15.120:0/4197857374 learned_addr learned my addr 172.21.15.120:0/4197857374 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.728+0000 7f151de78740 10 client.0 _ll_register_callbacks cb 0x7f1504009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.729+0000 7f150fe00640 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562939377d80 0x5629397713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.730+0000 7f150fe00640 1 -- 172.21.15.120:0/4197857374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393b91b0 msgr2=0x562939772820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.730+0000 7f150fe00640 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393b91b0 0x562939772820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.730+0000 7f150fe00640 1 -- 172.21.15.120:0/4197857374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 msgr2=0x5629397718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.730+0000 7f150fe00640 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 0x5629397718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.730+0000 7f150fe00640 1 -- 172.21.15.120:0/4197857374 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562939752470 con 0x562939377d80 2024-05-14T09:41:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.730+0000 7f150fe00640 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562939377d80 0x5629397713b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f15040c5860 tx=0x7f1504005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcfe2d0ab2b5141 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.730+0000 7f14f6000640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.731+0000 7f14f6000640 1 -- 172.21.15.120:0/4197857374 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040d2120 con 0x562939377d80 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.731+0000 7f14f6000640 1 -- 172.21.15.120:0/4197857374 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f1504032880 con 0x562939377d80 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.731+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15040c92c0 con 0x562939377d80 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.732+0000 7f14f6000640 1 -- 172.21.15.120:0/4197857374 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f1504030cb0 con 0x562939377d80 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.733+0000 7f151de78740 10 client.17391 fetch_fsmap learned FSMap version 73 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.733+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x562939773ea0 con 0x562939377d80 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.734+0000 7f14f6000640 1 -- 172.21.15.120:0/4197857374 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15040a9030 con 0x562939377d80 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.736+0000 7f14f6000640 1 -- 172.21.15.120:0/4197857374 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 73) ==== 8366+0+0 (secure 0 0 0) 0x7f15040c4e30 con 0x562939377d80 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.736+0000 7f151de78740 10 client.17391 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.736+0000 7f151de78740 10 client.17391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.736+0000 7f151de78740 20 client.17391 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.736+0000 7f151de78740 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5629397e3610 0x5629397e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.737+0000 7f151de78740 4 client.17391 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.737+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629396c6fd0 con 0x5629397e3610 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.737+0000 7f150f400640 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5629397e3610 0x5629397e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.740+0000 7f150f400640 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5629397e3610 0x5629397e5a30 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=807e1f152e5f0a6a server_cookie=d4d1211008622969 in_seq=0 out_seq=0 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.741+0000 7f14f6000640 10 client.17391 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.791+0000 7f14f6000640 1 -- 172.21.15.120:0/4197857374 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629396c6fd0 con 0x5629397e3610 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.791+0000 7f14f6000640 10 client.17391 handle_command_reply: tid=0 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.791+0000 7f151de78740 1 client.17391 shutdown 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562939377d80 msgr2=0x5629397713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562939377d80 0x5629397713b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f15040c5860 tx=0x7f1504005710 comp rx=0 tx=0).stop 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 shutdown_connections 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5629397e3610 0x5629397e5a30 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629393b91b0 0x562939772820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5629393984d0 0x5629397718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 --2- 172.21.15.120:0/4197857374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562939377d80 0x5629397713b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 >> 172.21.15.120:0/4197857374 conn(0x5629393ad300 msgr2=0x56293976c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f14f6000640 0 client.17391 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 shutdown_connections 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.792+0000 7f151de78740 1 -- 172.21.15.120:0/4197857374 wait complete. 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.793+0000 7f151de78740 20 client.17391 trim_cache size 0 max 16384 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:41:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.794+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14f80b26b0 msgr2=0x7f14f80b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.794+0000 7f1515800640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14f80b26b0 0x7f14f80b4bc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x562939764cd0 tx=0x7f14fc008040 comp rx=0 tx=0).stop 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.794+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1508096a50 msgr2=0x7f150812f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.794+0000 7f1515800640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1508096a50 0x7f150812f2e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f150402a930 tx=0x7f15040306e0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.795+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 shutdown_connections 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.795+0000 7f1515800640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f14f80b26b0 0x7f14f80b4bc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.795+0000 7f1515800640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f150809c990 0x7f15081367b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.795+0000 7f1515800640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1508097c90 0x7f150812f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.795+0000 7f1515800640 1 --2- 172.21.15.120:0/1251742767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1508096a50 0x7f150812f2e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.795+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 >> 172.21.15.120:0/1251742767 conn(0x7f1508091c20 msgr2=0x7f1508092030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.796+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 shutdown_connections 2024-05-14T09:41:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:24.797+0000 7f1515800640 1 -- 172.21.15.120:0/1251742767 wait complete. 2024-05-14T09:41:26.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:26 smithi120 ceph-mon[31085]: pgmap v1092: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.4 MiB/s wr, 592 op/s 2024-05-14T09:41:26.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:26 smithi152 ceph-mon[34868]: pgmap v1092: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.4 MiB/s wr, 592 op/s 2024-05-14T09:41:26.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:26 smithi175 ceph-mon[35353]: pgmap v1092: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.4 MiB/s wr, 592 op/s 2024-05-14T09:41:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:28 smithi120 ceph-mon[31085]: pgmap v1093: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2024-05-14T09:41:28.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:28 smithi152 ceph-mon[34868]: pgmap v1093: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2024-05-14T09:41:28.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:28 smithi175 ceph-mon[35353]: pgmap v1093: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2024-05-14T09:41:29.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 835.0 s, 508.2 tps, lat 193.485 ms stddev 149.438 2024-05-14T09:41:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:30 smithi120 ceph-mon[31085]: pgmap v1094: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2024-05-14T09:41:30.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:30 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:41:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:30 smithi152 ceph-mon[34868]: pgmap v1094: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2024-05-14T09:41:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:30 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:41:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:30 smithi175 ceph-mon[35353]: pgmap v1094: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2024-05-14T09:41:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:30 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:41:32.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:32 smithi120 ceph-mon[31085]: pgmap v1095: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.4 MiB/s wr, 619 op/s 2024-05-14T09:41:32.707 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:32 smithi152 ceph-mon[34868]: pgmap v1095: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.4 MiB/s wr, 619 op/s 2024-05-14T09:41:32.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:32 smithi175 ceph-mon[35353]: pgmap v1095: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.4 MiB/s wr, 619 op/s 2024-05-14T09:41:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 840.0 s, 603.2 tps, lat 168.755 ms stddev 114.196 2024-05-14T09:41:34.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:34 smithi120 ceph-mon[31085]: pgmap v1096: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 505 op/s 2024-05-14T09:41:34.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:34 smithi152 ceph-mon[34868]: pgmap v1096: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 505 op/s 2024-05-14T09:41:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:34 smithi175 ceph-mon[35353]: pgmap v1096: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 505 op/s 2024-05-14T09:41:36.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:36 smithi120 ceph-mon[31085]: pgmap v1097: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 614 op/s 2024-05-14T09:41:36.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:36 smithi152 ceph-mon[34868]: pgmap v1097: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 614 op/s 2024-05-14T09:41:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:36 smithi175 ceph-mon[35353]: pgmap v1097: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 614 op/s 2024-05-14T09:41:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 -- 172.21.15.120:0/3309012185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e28099e10 msgr2=0x7f6e2809a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 --2- 172.21.15.120:0/3309012185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e28099e10 0x7f6e2809a220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009860 tx=0x7f6e1c02a380 comp rx=0 tx=0).stop 2024-05-14T09:41:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 -- 172.21.15.120:0/3309012185 shutdown_connections 2024-05-14T09:41:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 --2- 172.21.15.120:0/3309012185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e2809eb10 0x7f6e280a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 --2- 172.21.15.120:0/3309012185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e28099e10 0x7f6e2809a220 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 --2- 172.21.15.120:0/3309012185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 0x7f6e280998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 -- 172.21.15.120:0/3309012185 >> 172.21.15.120:0/3309012185 conn(0x7f6e28093de0 msgr2=0x7f6e28096270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 -- 172.21.15.120:0/3309012185 shutdown_connections 2024-05-14T09:41:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.227+0000 7f6e36600640 1 -- 172.21.15.120:0/3309012185 wait complete. 2024-05-14T09:41:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.230+0000 7f6e36600640 1 Processor -- start 2024-05-14T09:41:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.232+0000 7f6e36600640 1 -- start start 2024-05-14T09:41:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.233+0000 7f6e36600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 0x7f6e2812f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.233+0000 7f6e36600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e28099e10 0x7f6e2812f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.233+0000 7f6e36600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2809eb10 0x7f6e28136790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.233+0000 7f6e36600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280a4580 con 0x7f6e28099e10 2024-05-14T09:41:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.234+0000 7f6e36600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280a4400 con 0x7f6e2809eb10 2024-05-14T09:41:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.234+0000 7f6e36600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280a4700 con 0x7f6e28098bd0 2024-05-14T09:41:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.235+0000 7f6e2fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e28099e10 0x7f6e2812f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.236+0000 7f6e35200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 0x7f6e2812f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.236+0000 7f6e35200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 0x7f6e2812f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:55732/0 (socket says 172.21.15.120:55732) 2024-05-14T09:41:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.236+0000 7f6e35200640 1 -- 172.21.15.120:0/2468260410 learned_addr learned my addr 172.21.15.120:0/2468260410 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.237+0000 7f6e35200640 1 -- 172.21.15.120:0/2468260410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2809eb10 msgr2=0x7f6e28136790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.237+0000 7f6e35c00640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2809eb10 0x7f6e28136790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.237+0000 7f6e35200640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2809eb10 0x7f6e28136790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.237+0000 7f6e35200640 1 -- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e28099e10 msgr2=0x7f6e2812f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.237+0000 7f6e35200640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e28099e10 0x7f6e2812f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.237+0000 7f6e35200640 1 -- 172.21.15.120:0/2468260410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e28136e00 con 0x7f6e28098bd0 2024-05-14T09:41:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.237+0000 7f6e35c00640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2809eb10 0x7f6e28136790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:41:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.240+0000 7f6e35200640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 0x7f6e2812f310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400e9c0 tx=0x7f6e2400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.240+0000 7f6e2d600640 1 -- 172.21.15.120:0/2468260410 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400ccc0 con 0x7f6e28098bd0 2024-05-14T09:41:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.241+0000 7f6e2d600640 1 -- 172.21.15.120:0/2468260410 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e240035f0 con 0x7f6e28098bd0 2024-05-14T09:41:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.241+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e281370f0 con 0x7f6e28098bd0 2024-05-14T09:41:38.242 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.241+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e28137640 con 0x7f6e28098bd0 2024-05-14T09:41:38.242 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.241+0000 7f6e2d600640 1 -- 172.21.15.120:0/2468260410 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400ce60 con 0x7f6e28098bd0 2024-05-14T09:41:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.251+0000 7f6e2d600640 1 -- 172.21.15.120:0/2468260410 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6e24010750 con 0x7f6e28098bd0 2024-05-14T09:41:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.255+0000 7f6e3ebcb740 1 Processor -- start 2024-05-14T09:41:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.255+0000 7f6e3ebcb740 1 -- start start 2024-05-14T09:41:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.256+0000 7f6e2d600640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6e180b2940 0x7f6e180b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.256+0000 7f6e2d600640 1 -- 172.21.15.120:0/2468260410 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6e240e2850 con 0x7f6e28098bd0 2024-05-14T09:41:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.257+0000 7f6e35c00640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6e180b2940 0x7f6e180b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.260+0000 7f6e35c00640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6e180b2940 0x7f6e180b4e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e30051dc0 tx=0x7f6e30051230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.260+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.260+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.260+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0d4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564c2b031550 con 0x564c2ad022f0 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564c2afd6bc0 con 0x564c2ad0a4d0 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c2b02d510 con 0x564c2ad2b1b0 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e2fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e2fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54966/0 (socket says 172.21.15.120:54966) 2024-05-14T09:41:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e35c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0d4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e35c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0d4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37786/0 (socket says 172.21.15.120:37786) 2024-05-14T09:41:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.261+0000 7f6e2fe00640 1 -- 172.21.15.120:0/3984531132 learned_addr learned my addr 172.21.15.120:0/3984531132 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.262+0000 7f6e35200640 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.263+0000 7f6e2fe00640 1 -- 172.21.15.120:0/3984531132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 msgr2=0x564c2b0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.263+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.263+0000 7f6e2fe00640 1 -- 172.21.15.120:0/3984531132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 msgr2=0x564c2b0d4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.263+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0d4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.263+0000 7f6e2fe00640 1 -- 172.21.15.120:0/3984531132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2ad43210 con 0x564c2ad022f0 2024-05-14T09:41:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.264+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0cd870 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c02a970 tx=0x7f6e1c02add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9205edcabe67ff02 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.265+0000 7f6e22000640 1 -- 172.21.15.120:0/3984531132 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c037040 con 0x564c2ad022f0 2024-05-14T09:41:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.266+0000 7f6e22000640 1 -- 172.21.15.120:0/3984531132 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e1c030a70 con 0x564c2ad022f0 2024-05-14T09:41:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.268+0000 7f6e22000640 1 -- 172.21.15.120:0/3984531132 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c005040 con 0x564c2ad022f0 2024-05-14T09:41:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.268+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3984531132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 msgr2=0x564c2b0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.268+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0cd870 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c02a970 tx=0x7f6e1c02add0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.269+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3984531132 shutdown_connections 2024-05-14T09:41:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.269+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.269+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0cd870 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.269+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3984531132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.269+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3984531132 >> 172.21.15.120:0/3984531132 conn(0x564c2ad1f300 msgr2=0x564c2b0c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.270+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3984531132 shutdown_connections 2024-05-14T09:41:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.270+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3984531132 wait complete. 2024-05-14T09:41:38.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.271+0000 7f6e3ebcb740 1 -- start start 2024-05-14T09:41:38.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.271+0000 7f6e3ebcb740 1 Processor -- start 2024-05-14T09:41:38.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.273+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0df600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.273+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad0a4d0 0x564c2b0dfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.273+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.273+0000 7f6e35200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.273+0000 7f6e35200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0df600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37794/0 (socket says 172.21.15.120:37794) 2024-05-14T09:41:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.274+0000 7f6e35200640 1 -- 172.21.15.120:0/3108169963 learned_addr learned my addr 172.21.15.120:0/3108169963 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.274+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564c2b0d51b0 con 0x564c2ad2b1b0 2024-05-14T09:41:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.274+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564c2afea660 con 0x564c2ad022f0 2024-05-14T09:41:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.274+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c2b0d5330 con 0x564c2ad0a4d0 2024-05-14T09:41:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.274+0000 7f6e3ebcb740 10 client.0 _ll_register_callbacks cb 0x564c2afb4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.274+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad0a4d0 0x564c2b0dfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.274+0000 7f6e35c00640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.275+0000 7f6e35200640 1 -- 172.21.15.120:0/3108169963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad0a4d0 msgr2=0x564c2b0dfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.275+0000 7f6e35200640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad0a4d0 0x564c2b0dfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.275+0000 7f6e35200640 1 -- 172.21.15.120:0/3108169963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad2b1b0 msgr2=0x564c2b0e6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.275+0000 7f6e35200640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.276+0000 7f6e35200640 1 -- 172.21.15.120:0/3108169963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2ae0f620 con 0x564c2ad022f0 2024-05-14T09:41:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.276+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad0a4d0 0x564c2b0dfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.277+0000 7f6e35c00640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:41:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.277+0000 7f6e35200640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0df600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e240dffb0 tx=0x7f6e24003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68d3e497bb3b4e10 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.277+0000 7f6e16a00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:41:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.278+0000 7f6e16a00640 1 -- 172.21.15.120:0/3108169963 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e240c2070 con 0x564c2ad022f0 2024-05-14T09:41:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.278+0000 7f6e16a00640 1 -- 172.21.15.120:0/3108169963 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6e240a6130 con 0x564c2ad022f0 2024-05-14T09:41:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.280+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e1c030a70 con 0x564c2ad022f0 2024-05-14T09:41:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.280+0000 7f6e16a00640 1 -- 172.21.15.120:0/3108169963 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f6e240aa1d0 con 0x564c2ad022f0 2024-05-14T09:41:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.281+0000 7f6e3ebcb740 10 client.36905 fetch_fsmap learned FSMap version 74 2024-05-14T09:41:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.282+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x564c2b0e9a30 con 0x564c2ad022f0 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.282+0000 7f6e16a00640 1 -- 172.21.15.120:0/3108169963 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e1c030a70 con 0x564c2ad022f0 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.282+0000 7f6e16a00640 1 -- 172.21.15.120:0/3108169963 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7f6e240a8810 con 0x564c2ad022f0 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.283+0000 7f6e3ebcb740 10 client.36905 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.283+0000 7f6e3ebcb740 10 client.36905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.283+0000 7f6e3ebcb740 20 client.36905 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.283+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2ace9d80 0x564c2b0ed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.283+0000 7f6e3ebcb740 4 client.36905 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.283+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c2b03f160 con 0x564c2ace9d80 2024-05-14T09:41:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.284+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2ace9d80 0x564c2b0ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.285+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2ace9d80 0x564c2b0ed170 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fc0ce0cd72d9f93 server_cookie=4e5061fac560d8d6 in_seq=0 out_seq=0 2024-05-14T09:41:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.285+0000 7f6e16a00640 10 client.36905 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.286+0000 7f6e16a00640 1 -- 172.21.15.120:0/3108169963 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564c2b03f160 con 0x564c2ace9d80 2024-05-14T09:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.286+0000 7f6e16a00640 10 client.36905 handle_command_reply: tid=0 2024-05-14T09:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.287+0000 7f6e3ebcb740 1 client.36905 shutdown 2024-05-14T09:41:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.288+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 msgr2=0x564c2b0df600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.288+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0df600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e240dffb0 tx=0x7f6e24003cd0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 shutdown_connections 2024-05-14T09:41:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2ace9d80 0x564c2b0ed170 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad0a4d0 0x564c2b0dfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3108169963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0df600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 >> 172.21.15.120:0/3108169963 conn(0x564c2ad1f300 msgr2=0x564c2b0cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e16a00640 0 client.36905 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.289+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 shutdown_connections 2024-05-14T09:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.291+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3108169963 wait complete. 2024-05-14T09:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.291+0000 7f6e3ebcb740 20 client.36905 trim_cache size 0 max 16384 2024-05-14T09:41:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 Processor -- start 2024-05-14T09:41:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 -- start start 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1000fcf0 con 0x564c2ad022f0 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10011830 con 0x564c2ad0a4d0 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.329+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100103c0 con 0x564c2ad2b1b0 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.330+0000 7f6e2fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.330+0000 7f6e2fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37808/0 (socket says 172.21.15.120:37808) 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.330+0000 7f6e2fe00640 1 -- 172.21.15.120:0/134697782 learned_addr learned my addr 172.21.15.120:0/134697782 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.330+0000 7f6e35c00640 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.330+0000 7f6e2fe00640 1 -- 172.21.15.120:0/134697782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 msgr2=0x564c2b0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.330+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.330+0000 7f6e2fe00640 1 -- 172.21.15.120:0/134697782 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 msgr2=0x564c2b0c8300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:41:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.332+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.332+0000 7f6e2fe00640 1 -- 172.21.15.120:0/134697782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2b0c4470 con 0x564c2ad0a4d0 2024-05-14T09:41:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.332+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e69c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009780 tx=0x7f6e1c02a380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b6b0f7c95e08372 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.333+0000 7f6e21600640 1 -- 172.21.15.120:0/134697782 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c037040 con 0x564c2ad0a4d0 2024-05-14T09:41:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.333+0000 7f6e21600640 1 -- 172.21.15.120:0/134697782 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e1c030a70 con 0x564c2ad0a4d0 2024-05-14T09:41:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.334+0000 7f6e21600640 1 -- 172.21.15.120:0/134697782 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0052a0 con 0x564c2ad0a4d0 2024-05-14T09:41:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/134697782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 msgr2=0x564c2b0e69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e69c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009780 tx=0x7f6e1c02a380 comp rx=0 tx=0).stop 2024-05-14T09:41:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/134697782 shutdown_connections 2024-05-14T09:41:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e69c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/134697782 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad022f0 0x564c2b0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/134697782 >> 172.21.15.120:0/134697782 conn(0x564c2ad1f300 msgr2=0x564c2b0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/134697782 shutdown_connections 2024-05-14T09:41:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.335+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/134697782 wait complete. 2024-05-14T09:41:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.336+0000 7f6e3ebcb740 1 -- start start 2024-05-14T09:41:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.336+0000 7f6e3ebcb740 1 Processor -- start 2024-05-14T09:41:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.337+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0e4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.337+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.338+0000 7f6e35200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.338+0000 7f6e35200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0e4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:37820/0 (socket says 172.21.15.120:37820) 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e3ebcb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10011160 con 0x564c2ad0a4d0 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10010a90 con 0x564c2ad022f0 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e3ebcb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1000dcf0 con 0x564c2ad2b1b0 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e3ebcb740 10 client.0 _ll_register_callbacks cb 0x7f6e240a5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e35200640 1 -- 172.21.15.120:0/3030127622 learned_addr learned my addr 172.21.15.120:0/3030127622 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e35c00640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.339+0000 7f6e2fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e35200640 1 -- 172.21.15.120:0/3030127622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 msgr2=0x564c2b0e5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e35200640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.341+0000 7f6e35200640 1 -- 172.21.15.120:0/3030127622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad0a4d0 msgr2=0x564c2b0e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.343+0000 7f6e35200640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.343+0000 7f6e35200640 1 -- 172.21.15.120:0/3030127622 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2b0e5be0 con 0x564c2ad022f0 2024-05-14T09:41:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.343+0000 7f6e35c00640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.343+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:41:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.343+0000 7f6e35200640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0e4220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e240a60e0 tx=0x7f6e24010690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76322ba656d8931d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.343+0000 7f6e16a00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:41:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.344+0000 7f6e16a00640 1 -- 172.21.15.120:0/3030127622 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e240c2040 con 0x564c2ad022f0 2024-05-14T09:41:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.344+0000 7f6e16a00640 1 -- 172.21.15.120:0/3030127622 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f6e240a6130 con 0x564c2ad022f0 2024-05-14T09:41:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.344+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e1c030a70 con 0x564c2ad022f0 2024-05-14T09:41:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.345+0000 7f6e16a00640 1 -- 172.21.15.120:0/3030127622 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f6e240b6050 con 0x564c2ad022f0 2024-05-14T09:41:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.345+0000 7f6e3ebcb740 10 client.36911 fetch_fsmap learned FSMap version 74 2024-05-14T09:41:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.345+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x564c2b155570 con 0x564c2ad022f0 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.345+0000 7f6e16a00640 1 -- 172.21.15.120:0/3030127622 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e1c030a70 con 0x564c2ad022f0 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.345+0000 7f6e16a00640 1 -- 172.21.15.120:0/3030127622 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7f6e240b2b80 con 0x564c2ad022f0 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.346+0000 7f6e3ebcb740 10 client.36911 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.346+0000 7f6e3ebcb740 10 client.36911 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.346+0000 7f6e3ebcb740 20 client.36911 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.346+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2acbf1c0 0x564c2b157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.346+0000 7f6e3ebcb740 4 client.36911 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.346+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564c2b038fd0 con 0x564c2acbf1c0 2024-05-14T09:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.346+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2acbf1c0 0x564c2b157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.348+0000 7f6e2fe00640 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2acbf1c0 0x564c2b157da0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d89324bae657bdb2 server_cookie=daa4df2c91dfb920 in_seq=0 out_seq=0 2024-05-14T09:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.348+0000 7f6e16a00640 10 client.36911 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.380+0000 7f6e16a00640 1 -- 172.21.15.120:0/3030127622 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564c2b038fd0 con 0x564c2acbf1c0 2024-05-14T09:41:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.380+0000 7f6e16a00640 10 client.36911 handle_command_reply: tid=0 2024-05-14T09:41:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.380+0000 7f6e3ebcb740 1 client.36911 shutdown 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 msgr2=0x564c2b0e4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0e4220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e240a60e0 tx=0x7f6e24010690 comp rx=0 tx=0).stop 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 shutdown_connections 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x564c2acbf1c0 0x564c2b157da0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c2ad2b1b0 0x564c2b0e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c2ad0a4d0 0x564c2b0e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 --2- 172.21.15.120:0/3030127622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564c2ad022f0 0x564c2b0e4220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 >> 172.21.15.120:0/3030127622 conn(0x564c2ad1f300 msgr2=0x564c2b0cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e16a00640 0 client.36911 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.381+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 shutdown_connections 2024-05-14T09:41:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.382+0000 7f6e3ebcb740 1 -- 172.21.15.120:0/3030127622 wait complete. 2024-05-14T09:41:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.384+0000 7f6e3ebcb740 20 client.36911 trim_cache size 0 max 16384 2024-05-14T09:41:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:41:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:41:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:41:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:41:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6e180b2940 msgr2=0x7f6e180b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6e180b2940 0x7f6e180b4e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e30051dc0 tx=0x7f6e30051230 comp rx=0 tx=0).stop 2024-05-14T09:41:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 msgr2=0x7f6e2812f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 0x7f6e2812f310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400e9c0 tx=0x7f6e2400ee80 comp rx=0 tx=0).stop 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 shutdown_connections 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f6e180b2940 0x7f6e180b4e50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2809eb10 0x7f6e28136790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e28099e10 0x7f6e2812f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.389+0000 7f6e36600640 1 --2- 172.21.15.120:0/2468260410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e28098bd0 0x7f6e2812f310 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.390+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 >> 172.21.15.120:0/2468260410 conn(0x7f6e28093de0 msgr2=0x7f6e2809aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.390+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 shutdown_connections 2024-05-14T09:41:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:38.390+0000 7f6e36600640 1 -- 172.21.15.120:0/2468260410 wait complete. 2024-05-14T09:41:38.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:38 smithi120 ceph-mon[31085]: pgmap v1098: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 516 op/s 2024-05-14T09:41:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:38 smithi152 ceph-mon[34868]: pgmap v1098: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 516 op/s 2024-05-14T09:41:38.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:38 smithi175 ceph-mon[35353]: pgmap v1098: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 516 op/s 2024-05-14T09:41:39.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 845.0 s, 590.0 tps, lat 169.264 ms stddev 94.936 2024-05-14T09:41:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:40 smithi120 ceph-mon[31085]: pgmap v1099: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 542 op/s 2024-05-14T09:41:40.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:40 smithi152 ceph-mon[34868]: pgmap v1099: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 542 op/s 2024-05-14T09:41:40.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:40 smithi175 ceph-mon[35353]: pgmap v1099: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 542 op/s 2024-05-14T09:41:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:42 smithi120 ceph-mon[31085]: pgmap v1100: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.0 MiB/s wr, 643 op/s 2024-05-14T09:41:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:42 smithi152 ceph-mon[34868]: pgmap v1100: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.0 MiB/s wr, 643 op/s 2024-05-14T09:41:42.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:42 smithi175 ceph-mon[35353]: pgmap v1100: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.0 MiB/s wr, 643 op/s 2024-05-14T09:41:44.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 850.0 s, 566.8 tps, lat 175.914 ms stddev 151.807 2024-05-14T09:41:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:44 smithi120 ceph-mon[31085]: pgmap v1101: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 533 op/s 2024-05-14T09:41:44.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:44 smithi152 ceph-mon[34868]: pgmap v1101: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 533 op/s 2024-05-14T09:41:44.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:44 smithi175 ceph-mon[35353]: pgmap v1101: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 533 op/s 2024-05-14T09:41:46.637 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:46 smithi120 ceph-mon[31085]: pgmap v1102: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 625 op/s 2024-05-14T09:41:46.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:46 smithi152 ceph-mon[34868]: pgmap v1102: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 625 op/s 2024-05-14T09:41:46.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:46 smithi175 ceph-mon[35353]: pgmap v1102: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 625 op/s 2024-05-14T09:41:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:48 smithi120 ceph-mon[31085]: pgmap v1103: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 534 op/s 2024-05-14T09:41:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:48 smithi152 ceph-mon[34868]: pgmap v1103: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 534 op/s 2024-05-14T09:41:48.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:48 smithi175 ceph-mon[35353]: pgmap v1103: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 534 op/s 2024-05-14T09:41:49.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 855.0 s, 600.6 tps, lat 166.355 ms stddev 150.391 2024-05-14T09:41:49.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:49 smithi152 ceph-mon[34868]: pgmap v1104: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.9 MiB/s wr, 538 op/s 2024-05-14T09:41:49.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:49 smithi175 ceph-mon[35353]: pgmap v1104: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.9 MiB/s wr, 538 op/s 2024-05-14T09:41:49.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:49 smithi120 ceph-mon[31085]: pgmap v1104: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.9 MiB/s wr, 538 op/s 2024-05-14T09:41:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.786+0000 7efd0b800640 1 -- 172.21.15.120:0/1545154152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd04105e70 msgr2=0x7efd04106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.786+0000 7efd0b800640 1 --2- 172.21.15.120:0/1545154152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd04105e70 0x7efd04106b70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009860 tx=0x7efcf802a360 comp rx=0 tx=0).stop 2024-05-14T09:41:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.786+0000 7efd0b800640 1 -- 172.21.15.120:0/1545154152 shutdown_connections 2024-05-14T09:41:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.786+0000 7efd0b800640 1 --2- 172.21.15.120:0/1545154152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd0410bdb0 0x7efd0410e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.786+0000 7efd0b800640 1 --2- 172.21.15.120:0/1545154152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd041070b0 0x7efd041074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.786+0000 7efd0b800640 1 --2- 172.21.15.120:0/1545154152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd04105e70 0x7efd04106b70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.786+0000 7efd0b800640 1 -- 172.21.15.120:0/1545154152 >> 172.21.15.120:0/1545154152 conn(0x7efd04101040 msgr2=0x7efd04103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.787+0000 7efd0b800640 1 -- 172.21.15.120:0/1545154152 shutdown_connections 2024-05-14T09:41:51.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.787+0000 7efd0b800640 1 -- 172.21.15.120:0/1545154152 wait complete. 2024-05-14T09:41:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.788+0000 7efd0b800640 1 Processor -- start 2024-05-14T09:41:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.788+0000 7efd0b800640 1 -- start start 2024-05-14T09:41:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.789+0000 7efd0b800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd04105e70 0x7efd041a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd0b800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd041070b0 0x7efd041a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd0b800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd0410bdb0 0x7efd041a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd0b800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efd04111850 con 0x7efd041070b0 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd0b800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efd041116d0 con 0x7efd0410bdb0 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd0b800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd041119d0 con 0x7efd04105e70 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd08e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd04105e70 0x7efd041a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd08e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd04105e70 0x7efd041a08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37616/0 (socket says 172.21.15.120:37616) 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.790+0000 7efd08e00640 1 -- 172.21.15.120:0/3379529573 learned_addr learned my addr 172.21.15.120:0/3379529573 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.791+0000 7efd03e00640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd041070b0 0x7efd041a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.791+0000 7efd09800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd0410bdb0 0x7efd041a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.791+0000 7efd09800640 1 -- 172.21.15.120:0/3379529573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd04105e70 msgr2=0x7efd041a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.791+0000 7efd09800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd04105e70 0x7efd041a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.791+0000 7efd09800640 1 -- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd041070b0 msgr2=0x7efd041a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.792+0000 7efd09800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd041070b0 0x7efd041a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.792+0000 7efd09800640 1 -- 172.21.15.120:0/3379529573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd041a8400 con 0x7efd0410bdb0 2024-05-14T09:41:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.792+0000 7efd08e00640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd04105e70 0x7efd041a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:41:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.792+0000 7efd03e00640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd041070b0 0x7efd041a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:41:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.792+0000 7efd09800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd0410bdb0 0x7efd041a7d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00ef00 tx=0x7efcfc00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.792+0000 7efd01600640 1 -- 172.21.15.120:0/3379529573 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc004b20 con 0x7efd0410bdb0 2024-05-14T09:41:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.793+0000 7efd01600640 1 -- 172.21.15.120:0/3379529573 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcfc003e00 con 0x7efd0410bdb0 2024-05-14T09:41:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.793+0000 7efd01600640 1 -- 172.21.15.120:0/3379529573 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc004820 con 0x7efd0410bdb0 2024-05-14T09:41:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.793+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd041a86f0 con 0x7efd0410bdb0 2024-05-14T09:41:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.793+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd041a8bf0 con 0x7efd0410bdb0 2024-05-14T09:41:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.798+0000 7efd12767740 1 Processor -- start 2024-05-14T09:41:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.800+0000 7efd01600640 1 -- 172.21.15.120:0/3379529573 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7efcfc01d020 con 0x7efd0410bdb0 2024-05-14T09:41:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.802+0000 7efd01600640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efcec0b28b0 0x7efcec0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.803+0000 7efd01600640 1 -- 172.21.15.120:0/3379529573 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efcfc0e2390 con 0x7efd0410bdb0 2024-05-14T09:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.804+0000 7efd12767740 1 -- start start 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.804+0000 7efd12767740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58ad8b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.804+0000 7efd12767740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c02f0 0x55d58ad8b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.804+0000 7efd12767740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58ad92580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.805+0000 7efd12767740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d58acef550 con 0x55d58a9c84d0 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.805+0000 7efd12767740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d58ac94bc0 con 0x55d58a9c02f0 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.805+0000 7efd12767740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d58aceb510 con 0x55d58a9e91b0 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd08e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58ad8b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd09800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58ad92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd03e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c02f0 0x55d58ad8b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd09800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58ad92580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41730/0 (socket says 172.21.15.120:41730) 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd09800640 1 -- 172.21.15.120:0/197928434 learned_addr learned my addr 172.21.15.120:0/197928434 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd03e00640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efcec0b28b0 0x7efcec0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd08e00640 1 -- 172.21.15.120:0/197928434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c02f0 msgr2=0x55d58ad8b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd08e00640 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c02f0 0x55d58ad8b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd08e00640 1 -- 172.21.15.120:0/197928434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 msgr2=0x55d58ad92580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd08e00640 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58ad92580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.806+0000 7efd08e00640 1 -- 172.21.15.120:0/197928434 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58aa01210 con 0x55d58a9e91b0 2024-05-14T09:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.807+0000 7efd09800640 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58ad92580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.807+0000 7efd08e00640 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58ad8b100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000c00 tx=0x7efcf8009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3982f96ea580a561 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.808+0000 7efcf6000640 1 -- 172.21.15.120:0/197928434 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8037040 con 0x55d58a9e91b0 2024-05-14T09:41:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.808+0000 7efcf6000640 1 -- 172.21.15.120:0/197928434 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcf8005030 con 0x55d58a9e91b0 2024-05-14T09:41:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.808+0000 7efcf6000640 1 -- 172.21.15.120:0/197928434 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8032a70 con 0x55d58a9e91b0 2024-05-14T09:41:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.808+0000 7efd03e00640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efcec0b28b0 0x7efcec0b4dc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55d58ad8c4e0 tx=0x7efcf0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.809+0000 7efd12767740 1 -- 172.21.15.120:0/197928434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 msgr2=0x55d58ad8b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.809+0000 7efd12767740 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58ad8b100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000c00 tx=0x7efcf8009520 comp rx=0 tx=0).stop 2024-05-14T09:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.809+0000 7efd12767740 1 -- 172.21.15.120:0/197928434 shutdown_connections 2024-05-14T09:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.809+0000 7efd12767740 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58ad92580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.809+0000 7efd12767740 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c02f0 0x55d58ad8b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.810+0000 7efd12767740 1 --2- 172.21.15.120:0/197928434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58ad8b100 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.810+0000 7efd12767740 1 -- 172.21.15.120:0/197928434 >> 172.21.15.120:0/197928434 conn(0x55d58a9dd300 msgr2=0x55d58ad86a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.810+0000 7efd12767740 1 -- 172.21.15.120:0/197928434 shutdown_connections 2024-05-14T09:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.810+0000 7efd12767740 1 -- 172.21.15.120:0/197928434 wait complete. 2024-05-14T09:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.810+0000 7efd12767740 1 -- start start 2024-05-14T09:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 1 Processor -- start 2024-05-14T09:41:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c84d0 0x55d58ada6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58adacfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d58ada3f80 con 0x55d58a9c02f0 2024-05-14T09:41:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d58aca8660 con 0x55d58a9c84d0 2024-05-14T09:41:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d58ada4100 con 0x55d58a9e91b0 2024-05-14T09:41:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.811+0000 7efd12767740 10 client.0 _ll_register_callbacks cb 0x55d58ac72400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41744/0 (socket says 172.21.15.120:41744) 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 -- 172.21.15.120:0/1359180466 learned_addr learned my addr 172.21.15.120:0/1359180466 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd03e00640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c84d0 0x55d58ada6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd09800640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58adacfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 -- 172.21.15.120:0/1359180466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 msgr2=0x55d58adacfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58adacfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 -- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c84d0 msgr2=0x55d58ada6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c84d0 0x55d58ada6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd08e00640 1 -- 172.21.15.120:0/1359180466 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58aacd620 con 0x55d58a9c02f0 2024-05-14T09:41:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.812+0000 7efd09800640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58adacfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.813+0000 7efd08e00640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5b40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efcf8030910 tx=0x7efcf8030940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf3fa7a6db68904 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.813+0000 7efceaa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:41:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.814+0000 7efceaa00640 1 -- 172.21.15.120:0/1359180466 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8037040 con 0x55d58a9c02f0 2024-05-14T09:41:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.814+0000 7efceaa00640 1 -- 172.21.15.120:0/1359180466 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efcf8004040 con 0x55d58a9c02f0 2024-05-14T09:41:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.815+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf8005030 con 0x55d58a9c02f0 2024-05-14T09:41:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.815+0000 7efceaa00640 1 -- 172.21.15.120:0/1359180466 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7efcf8004280 con 0x55d58a9c02f0 2024-05-14T09:41:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.815+0000 7efd12767740 10 client.17415 fetch_fsmap learned FSMap version 74 2024-05-14T09:41:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.815+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d58adaff10 con 0x55d58a9c02f0 2024-05-14T09:41:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efceaa00640 1 -- 172.21.15.120:0/1359180466 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcf8005030 con 0x55d58a9c02f0 2024-05-14T09:41:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efceaa00640 1 -- 172.21.15.120:0/1359180466 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7efcf8004860 con 0x55d58a9c02f0 2024-05-14T09:41:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efd12767740 10 client.17415 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:41:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efd12767740 10 client.17415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efd12767740 20 client.17415 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efd12767740 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a9a7d80 0x55d58adb3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efd12767740 4 client.17415 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.818+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d58acfd160 con 0x55d58a9a7d80 2024-05-14T09:41:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.819+0000 7efd03e00640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a9a7d80 0x55d58adb3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.820+0000 7efd03e00640 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a9a7d80 0x55d58adb3290 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e688016ebc0fb40b server_cookie=363bbcc7bedfa4be in_seq=0 out_seq=0 2024-05-14T09:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.820+0000 7efceaa00640 10 client.17415 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.822+0000 7efceaa00640 1 -- 172.21.15.120:0/1359180466 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d58acfd160 con 0x55d58a9a7d80 2024-05-14T09:41:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.823+0000 7efceaa00640 10 client.17415 handle_command_reply: tid=0 2024-05-14T09:41:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.823+0000 7efd12767740 1 client.17415 shutdown 2024-05-14T09:41:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 msgr2=0x55d58ada5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5b40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efcf8030910 tx=0x7efcf8030940 comp rx=0 tx=0).stop 2024-05-14T09:41:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 shutdown_connections 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a9a7d80 0x55d58adb3290 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9e91b0 0x55d58adacfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9c84d0 0x55d58ada6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 --2- 172.21.15.120:0/1359180466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5b40 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.827+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 >> 172.21.15.120:0/1359180466 conn(0x55d58a9dd300 msgr2=0x55d58ad899a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.828+0000 7efceaa00640 0 client.17415 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.828+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 shutdown_connections 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.828+0000 7efd12767740 1 -- 172.21.15.120:0/1359180466 wait complete. 2024-05-14T09:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.828+0000 7efd12767740 20 client.17415 trim_cache size 0 max 16384 2024-05-14T09:41:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.858+0000 7efd12767740 1 Processor -- start 2024-05-14T09:41:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.859+0000 7efd12767740 1 -- start start 2024-05-14T09:41:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd12767740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd12767740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c84d0 0x55d58adacf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd12767740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58adad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd12767740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efd041aa910 con 0x55d58a9c02f0 2024-05-14T09:41:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd12767740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efd041ac450 con 0x55d58a9e91b0 2024-05-14T09:41:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd12767740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd041aafe0 con 0x55d58a9c84d0 2024-05-14T09:41:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd09800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58adad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd03e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c84d0 0x55d58adacf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd09800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58adad440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:38162/0 (socket says 172.21.15.120:38162) 2024-05-14T09:41:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd03e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c84d0 0x55d58adacf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:37642/0 (socket says 172.21.15.120:37642) 2024-05-14T09:41:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.860+0000 7efd09800640 1 -- 172.21.15.120:0/3053538707 learned_addr learned my addr 172.21.15.120:0/3053538707 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.861+0000 7efd08e00640 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.861+0000 7efd03e00640 1 -- 172.21.15.120:0/3053538707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 msgr2=0x55d58adad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.861+0000 7efd03e00640 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58adad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.861+0000 7efd03e00640 1 -- 172.21.15.120:0/3053538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 msgr2=0x55d58ada5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.861+0000 7efd03e00640 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.861+0000 7efd03e00640 1 -- 172.21.15.120:0/3053538707 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58ad82280 con 0x55d58a9c84d0 2024-05-14T09:41:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.861+0000 7efd08e00640 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:41:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.862+0000 7efd03e00640 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c84d0 0x55d58adacf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55d58adb3990 tx=0x7efcf0013070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b003552097dbae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.863+0000 7efcf5600640 1 -- 172.21.15.120:0/3053538707 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0009e40 con 0x55d58a9c84d0 2024-05-14T09:41:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.863+0000 7efcf5600640 1 -- 172.21.15.120:0/3053538707 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcf002f070 con 0x55d58a9c84d0 2024-05-14T09:41:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.863+0000 7efcf5600640 1 -- 172.21.15.120:0/3053538707 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf002b690 con 0x55d58a9c84d0 2024-05-14T09:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.864+0000 7efd12767740 1 -- 172.21.15.120:0/3053538707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c84d0 msgr2=0x55d58adacf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.864+0000 7efd12767740 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c84d0 0x55d58adacf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55d58adb3990 tx=0x7efcf0013070 comp rx=0 tx=0).stop 2024-05-14T09:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.864+0000 7efd12767740 1 -- 172.21.15.120:0/3053538707 shutdown_connections 2024-05-14T09:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.864+0000 7efd12767740 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58adad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.864+0000 7efd12767740 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c84d0 0x55d58adacf00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.865+0000 7efd12767740 1 --2- 172.21.15.120:0/3053538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c02f0 0x55d58ada5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.865+0000 7efd12767740 1 -- 172.21.15.120:0/3053538707 >> 172.21.15.120:0/3053538707 conn(0x55d58a9dd300 msgr2=0x55d58ada5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.865+0000 7efd12767740 1 -- 172.21.15.120:0/3053538707 shutdown_connections 2024-05-14T09:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.865+0000 7efd12767740 1 -- 172.21.15.120:0/3053538707 wait complete. 2024-05-14T09:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.865+0000 7efd12767740 1 -- start start 2024-05-14T09:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 1 Processor -- start 2024-05-14T09:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c02f0 0x55d58adaa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58adaabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58ae195f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efd041abd80 con 0x55d58a9c84d0 2024-05-14T09:41:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efd041ab6b0 con 0x55d58a9e91b0 2024-05-14T09:41:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd040748f0 con 0x55d58a9c02f0 2024-05-14T09:41:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.866+0000 7efd12767740 10 client.0 _ll_register_callbacks cb 0x7efcf0011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.867+0000 7efd03e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58adaabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd03e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58adaabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41762/0 (socket says 172.21.15.120:41762) 2024-05-14T09:41:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd09800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58ae195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd03e00640 1 -- 172.21.15.120:0/1010340163 learned_addr learned my addr 172.21.15.120:0/1010340163 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:41:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd08e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c02f0 0x55d58adaa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd03e00640 1 -- 172.21.15.120:0/1010340163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c02f0 msgr2=0x55d58adaa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd03e00640 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c02f0 0x55d58adaa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd03e00640 1 -- 172.21.15.120:0/1010340163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 msgr2=0x55d58ae195f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd03e00640 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58ae195f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.868+0000 7efd03e00640 1 -- 172.21.15.120:0/1010340163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58ae19b30 con 0x55d58a9c84d0 2024-05-14T09:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.869+0000 7efd03e00640 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58adaabf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcf00116b0 tx=0x7efcf00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6d8cab64a83707 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.869+0000 7efceaa00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.870+0000 7efceaa00640 1 -- 172.21.15.120:0/1010340163 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0037070 con 0x55d58a9c84d0 2024-05-14T09:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.870+0000 7efceaa00640 1 -- 172.21.15.120:0/1010340163 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7efcf0005050 con 0x55d58a9c84d0 2024-05-14T09:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.870+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf002f070 con 0x55d58a9c84d0 2024-05-14T09:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.870+0000 7efceaa00640 1 -- 172.21.15.120:0/1010340163 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7efcf0043050 con 0x55d58a9c84d0 2024-05-14T09:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.870+0000 7efd12767740 10 client.17418 fetch_fsmap learned FSMap version 74 2024-05-14T09:41:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.870+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d58ae1ac30 con 0x55d58a9c84d0 2024-05-14T09:41:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efceaa00640 1 -- 172.21.15.120:0/1010340163 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcf002f070 con 0x55d58a9c84d0 2024-05-14T09:41:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efceaa00640 1 -- 172.21.15.120:0/1010340163 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7efcf001d070 con 0x55d58a9c84d0 2024-05-14T09:41:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efd12767740 10 client.17418 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:41:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efd12767740 10 client.17418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:41:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efd12767740 20 client.17418 populate_metadata read hostname 'smithi120' 2024-05-14T09:41:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efd12767740 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a97d1c0 0x55d58ae1d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efd12767740 4 client.17418 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:41:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.871+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d58acf6fd0 con 0x55d58a97d1c0 2024-05-14T09:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.872+0000 7efd08e00640 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a97d1c0 0x55d58ae1d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.873+0000 7efd08e00640 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a97d1c0 0x55d58ae1d600 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b126cc640ff6f7d server_cookie=61a759f8dd6bd7be in_seq=0 out_seq=0 2024-05-14T09:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.873+0000 7efceaa00640 10 client.17418 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.900+0000 7efceaa00640 1 -- 172.21.15.120:0/1010340163 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d58acf6fd0 con 0x55d58a97d1c0 2024-05-14T09:41:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.900+0000 7efceaa00640 10 client.17418 handle_command_reply: tid=0 2024-05-14T09:41:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.901+0000 7efd12767740 1 client.17418 shutdown 2024-05-14T09:41:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 msgr2=0x55d58adaabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58adaabf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcf00116b0 tx=0x7efcf00190d0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 shutdown_connections 2024-05-14T09:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d58a97d1c0 0x55d58ae1d600 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d58a9e91b0 0x55d58ae195f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d58a9c84d0 0x55d58adaabf0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efceaa00640 0 client.17418 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 --2- 172.21.15.120:0/1010340163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d58a9c02f0 0x55d58adaa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.902+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 >> 172.21.15.120:0/1010340163 conn(0x55d58a9dd300 msgr2=0x55d58ad89910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.903+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 shutdown_connections 2024-05-14T09:41:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.903+0000 7efd12767740 1 -- 172.21.15.120:0/1010340163 wait complete. 2024-05-14T09:41:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.903+0000 7efd12767740 20 client.17418 trim_cache size 0 max 16384 2024-05-14T09:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efcec0b28b0 msgr2=0x7efcec0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efcec0b28b0 0x7efcec0b4dc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55d58ad8c4e0 tx=0x7efcf0005f90 comp rx=0 tx=0).stop 2024-05-14T09:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd0410bdb0 msgr2=0x7efd041a7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd0410bdb0 0x7efd041a7d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00ef00 tx=0x7efcfc00c740 comp rx=0 tx=0).stop 2024-05-14T09:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 shutdown_connections 2024-05-14T09:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7efcec0b28b0 0x7efcec0b4dc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd0410bdb0 0x7efd041a7d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd041070b0 0x7efd041a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 --2- 172.21.15.120:0/3379529573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd04105e70 0x7efd041a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.904+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 >> 172.21.15.120:0/3379529573 conn(0x7efd04101040 msgr2=0x7efd04107d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.905+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 shutdown_connections 2024-05-14T09:41:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:41:51.905+0000 7efd0b800640 1 -- 172.21.15.120:0/3379529573 wait complete. 2024-05-14T09:41:52.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:52 smithi152 ceph-mon[34868]: pgmap v1105: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 650 op/s 2024-05-14T09:41:52.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:52 smithi175 ceph-mon[35353]: pgmap v1105: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 650 op/s 2024-05-14T09:41:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:52 smithi120 ceph-mon[31085]: pgmap v1105: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 650 op/s 2024-05-14T09:41:54.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 860.0 s, 585.0 tps, lat 169.896 ms stddev 106.811 2024-05-14T09:41:54.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:54 smithi152 ceph-mon[34868]: pgmap v1106: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 544 op/s 2024-05-14T09:41:54.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:54 smithi175 ceph-mon[35353]: pgmap v1106: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 544 op/s 2024-05-14T09:41:54.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:54 smithi120 ceph-mon[31085]: pgmap v1106: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 544 op/s 2024-05-14T09:41:56.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:56 smithi152 ceph-mon[34868]: pgmap v1107: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.6 MiB/s wr, 601 op/s 2024-05-14T09:41:56.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:56 smithi175 ceph-mon[35353]: pgmap v1107: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.6 MiB/s wr, 601 op/s 2024-05-14T09:41:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:56 smithi120 ceph-mon[31085]: pgmap v1107: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.6 MiB/s wr, 601 op/s 2024-05-14T09:41:58.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:41:58 smithi152 ceph-mon[34868]: pgmap v1108: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-05-14T09:41:58.476 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:41:58 smithi175 ceph-mon[35353]: pgmap v1108: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-05-14T09:41:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:41:58 smithi120 ceph-mon[31085]: pgmap v1108: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-05-14T09:41:59.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 865.0 s, 545.0 tps, lat 184.134 ms stddev 215.336 2024-05-14T09:42:00.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:00 smithi152 ceph-mon[34868]: pgmap v1109: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 564 op/s 2024-05-14T09:42:00.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:00 smithi175 ceph-mon[35353]: pgmap v1109: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 564 op/s 2024-05-14T09:42:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:00 smithi120 ceph-mon[31085]: pgmap v1109: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 564 op/s 2024-05-14T09:42:02.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:02 smithi175 ceph-mon[35353]: pgmap v1110: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 677 op/s 2024-05-14T09:42:02.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:02 smithi120 ceph-mon[31085]: pgmap v1110: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 677 op/s 2024-05-14T09:42:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:02 smithi152 ceph-mon[34868]: pgmap v1110: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 677 op/s 2024-05-14T09:42:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 870.0 s, 549.2 tps, lat 179.727 ms stddev 144.568 2024-05-14T09:42:04.478 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:04 smithi175 ceph-mon[35353]: pgmap v1111: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.5 MiB/s wr, 534 op/s 2024-05-14T09:42:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:04 smithi120 ceph-mon[31085]: pgmap v1111: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.5 MiB/s wr, 534 op/s 2024-05-14T09:42:04.707 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:04 smithi152 ceph-mon[34868]: pgmap v1111: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.5 MiB/s wr, 534 op/s 2024-05-14T09:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.259+0000 7fc1f9a00640 1 -- 172.21.15.120:0/918717528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f4107db0 msgr2=0x7fc1f410a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.259+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/918717528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f4107db0 0x7fc1f410a1d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009ca0 tx=0x7fc1ec02a8c0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.260+0000 7fc1f9a00640 1 -- 172.21.15.120:0/918717528 shutdown_connections 2024-05-14T09:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.260+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/918717528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f4107db0 0x7fc1f410a1d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.260+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/918717528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f41030b0 0x7fc1f41034c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.260+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/918717528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4101e70 0x7fc1f4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.260+0000 7fc1f9a00640 1 -- 172.21.15.120:0/918717528 >> 172.21.15.120:0/918717528 conn(0x7fc1f40fd080 msgr2=0x7fc1f40ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.261+0000 7fc1f9a00640 1 -- 172.21.15.120:0/918717528 shutdown_connections 2024-05-14T09:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.262+0000 7fc1f9a00640 1 -- 172.21.15.120:0/918717528 wait complete. 2024-05-14T09:42:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.264+0000 7fc1f9a00640 1 Processor -- start 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.266+0000 7fc1f9a00640 1 -- start start 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.266+0000 7fc1f9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f4101e70 0x7fc1f4109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.266+0000 7fc1f9a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f41030b0 0x7fc1f41082e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.266+0000 7fc1f9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4107db0 0x7fc1f4108820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.266+0000 7fc1f9a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f410d440 con 0x7fc1f4107db0 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f9a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f410d2c0 con 0x7fc1f41030b0 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f41030b0 0x7fc1f41082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4107db0 0x7fc1f4108820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f4101e70 0x7fc1f4109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4107db0 0x7fc1f4108820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47848/0 (socket says 172.21.15.120:47848) 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f4101e70 0x7fc1f4109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45046/0 (socket says 172.21.15.120:45046) 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f3400640 1 -- 172.21.15.120:0/369775114 learned_addr learned my addr 172.21.15.120:0/369775114 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.267+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f410d5c0 con 0x7fc1f4101e70 2024-05-14T09:42:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.269+0000 7fc1f3400640 1 -- 172.21.15.120:0/369775114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f4101e70 msgr2=0x7fc1f4109c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.270+0000 7fc1f3400640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f4101e70 0x7fc1f4109c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.270+0000 7fc1f3400640 1 -- 172.21.15.120:0/369775114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f41030b0 msgr2=0x7fc1f41082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.270+0000 7fc1f3400640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f41030b0 0x7fc1f41082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.270+0000 7fc1f3400640 1 -- 172.21.15.120:0/369775114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f419e0c0 con 0x7fc1f4107db0 2024-05-14T09:42:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.270+0000 7fc1f2000640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f41030b0 0x7fc1f41082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:42:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.270+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f4101e70 0x7fc1f4109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:42:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.273+0000 7fc1f3400640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4107db0 0x7fc1f4108820 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec004af0 tx=0x7fc1ec0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.273+0000 7fc1eb400640 1 -- 172.21.15.120:0/369775114 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec003cf0 con 0x7fc1f4107db0 2024-05-14T09:42:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.274+0000 7fc1eb400640 1 -- 172.21.15.120:0/369775114 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1ec0044d0 con 0x7fc1f4107db0 2024-05-14T09:42:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.274+0000 7fc1eb400640 1 -- 172.21.15.120:0/369775114 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec030bd0 con 0x7fc1f4107db0 2024-05-14T09:42:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.276+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f419e350 con 0x7fc1f4107db0 2024-05-14T09:42:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.277+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f419e850 con 0x7fc1f4107db0 2024-05-14T09:42:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.281+0000 7fc200a42740 1 Processor -- start 2024-05-14T09:42:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.290+0000 7fc1eb400640 1 -- 172.21.15.120:0/369775114 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fc1ec004680 con 0x7fc1f4107db0 2024-05-14T09:42:05.292 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.292+0000 7fc200a42740 1 -- start start 2024-05-14T09:42:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.294+0000 7fc200a42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe74d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.294+0000 7fc200a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe74d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.294+0000 7fc200a42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe754580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.294+0000 7fc200a42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5620fe6b1550 con 0x5620fe38a4d0 2024-05-14T09:42:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.294+0000 7fc200a42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5620fe656bc0 con 0x5620fe3ab1b0 2024-05-14T09:42:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.294+0000 7fc200a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5620fe6ad510 con 0x5620fe3822f0 2024-05-14T09:42:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.295+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe74d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.295+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe74d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:45050/0 (socket says 172.21.15.120:45050) 2024-05-14T09:42:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.295+0000 7fc1f2a00640 1 -- 172.21.15.120:0/1543726855 learned_addr learned my addr 172.21.15.120:0/1543726855 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.295+0000 7fc1eb400640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc1d80b28e0 0x7fc1d80b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.296+0000 7fc1f2a00640 1 -- 172.21.15.120:0/1543726855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 msgr2=0x5620fe74d100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:42:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.296+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe74d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.296+0000 7fc1f2a00640 1 -- 172.21.15.120:0/1543726855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 msgr2=0x5620fe754580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:42:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.296+0000 7fc1f2000640 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe754580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.296+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe754580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.296+0000 7fc1f2a00640 1 -- 172.21.15.120:0/1543726855 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fe3c3210 con 0x5620fe3822f0 2024-05-14T09:42:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.296+0000 7fc1f2000640 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe754580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.297+0000 7fc1f3400640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc1d80b28e0 0x7fc1d80b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.297+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe74d680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400afa0 tx=0x7fc1e400f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54bb4c7d5649b24a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.297+0000 7fc1eb400640 1 -- 172.21.15.120:0/369775114 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc1ec103ab0 con 0x7fc1f4107db0 2024-05-14T09:42:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.298+0000 7fc1f3400640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc1d80b28e0 0x7fc1d80b4df0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec031920 tx=0x7fc1ec04a000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.298+0000 7fc1dfe00640 1 -- 172.21.15.120:0/1543726855 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e401d070 con 0x5620fe3822f0 2024-05-14T09:42:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.298+0000 7fc1dfe00640 1 -- 172.21.15.120:0/1543726855 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1e4010d90 con 0x5620fe3822f0 2024-05-14T09:42:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.298+0000 7fc1dfe00640 1 -- 172.21.15.120:0/1543726855 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4016340 con 0x5620fe3822f0 2024-05-14T09:42:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.300+0000 7fc200a42740 1 -- 172.21.15.120:0/1543726855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 msgr2=0x5620fe74d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.300+0000 7fc200a42740 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe74d680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400afa0 tx=0x7fc1e400f850 comp rx=0 tx=0).stop 2024-05-14T09:42:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.300+0000 7fc200a42740 1 -- 172.21.15.120:0/1543726855 shutdown_connections 2024-05-14T09:42:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.300+0000 7fc200a42740 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe754580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.300+0000 7fc200a42740 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe74d680 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.300+0000 7fc200a42740 1 --2- 172.21.15.120:0/1543726855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe74d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.300+0000 7fc200a42740 1 -- 172.21.15.120:0/1543726855 >> 172.21.15.120:0/1543726855 conn(0x5620fe39f300 msgr2=0x5620fe748a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.301+0000 7fc200a42740 1 -- 172.21.15.120:0/1543726855 shutdown_connections 2024-05-14T09:42:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.301+0000 7fc200a42740 1 -- 172.21.15.120:0/1543726855 wait complete. 2024-05-14T09:42:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.302+0000 7fc200a42740 1 -- start start 2024-05-14T09:42:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.303+0000 7fc200a42740 1 Processor -- start 2024-05-14T09:42:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.305+0000 7fc200a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe756ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.305+0000 7fc200a42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe757220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.305+0000 7fc200a42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe75e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.305+0000 7fc200a42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5620fe754fd0 con 0x5620fe38a4d0 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.305+0000 7fc200a42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5620fe66a660 con 0x5620fe3ab1b0 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.305+0000 7fc200a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5620fe755150 con 0x5620fe3822f0 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.305+0000 7fc200a42740 10 client.0 _ll_register_callbacks cb 0x5620fe634400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.306+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe757220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.306+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe757220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47866/0 (socket says 172.21.15.120:47866) 2024-05-14T09:42:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.306+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2977667271 learned_addr learned my addr 172.21.15.120:0/2977667271 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.306+0000 7fc1f2000640 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe756ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.307+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2977667271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 msgr2=0x5620fe756ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.307+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe756ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.307+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2977667271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 msgr2=0x5620fe75e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.307+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe75e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.307+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2977667271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fe48f620 con 0x5620fe38a4d0 2024-05-14T09:42:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.307+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe757220 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4010010 tx=0x7fc1e4018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8102d8eebfd71051 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.307+0000 7fc1dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:42:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.308+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2977667271 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4027020 con 0x5620fe38a4d0 2024-05-14T09:42:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.308+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2977667271 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc1e4010900 con 0x5620fe38a4d0 2024-05-14T09:42:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.308+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e4010d90 con 0x5620fe38a4d0 2024-05-14T09:42:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.309+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2977667271 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc1e401d040 con 0x5620fe38a4d0 2024-05-14T09:42:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.309+0000 7fc200a42740 10 client.17424 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.309+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x5620fe761020 con 0x5620fe38a4d0 2024-05-14T09:42:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.309+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2977667271 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1e4010d90 con 0x5620fe38a4d0 2024-05-14T09:42:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.309+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2977667271 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7fc1e40049d0 con 0x5620fe38a4d0 2024-05-14T09:42:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.310+0000 7fc200a42740 10 client.17424 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.310+0000 7fc200a42740 10 client.17424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.310+0000 7fc200a42740 20 client.17424 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.310+0000 7fc200a42740 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe369d80 0x5620fe764440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.310+0000 7fc200a42740 4 client.17424 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:42:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.310+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620fe6bf160 con 0x5620fe369d80 2024-05-14T09:42:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.312+0000 7fc1f2000640 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe369d80 0x5620fe764440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.313+0000 7fc1f2000640 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe369d80 0x5620fe764440 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ab1739a0573958c server_cookie=73868e5d3fc0be46 in_seq=0 out_seq=0 2024-05-14T09:42:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.313+0000 7fc1dcc00640 10 client.17424 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.314+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2977667271 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5620fe6bf160 con 0x5620fe369d80 2024-05-14T09:42:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.314+0000 7fc1dcc00640 10 client.17424 handle_command_reply: tid=0 2024-05-14T09:42:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.314+0000 7fc200a42740 1 client.17424 shutdown 2024-05-14T09:42:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.315+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 msgr2=0x5620fe757220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.315+0000 7fc200a42740 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe757220 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4010010 tx=0x7fc1e4018670 comp rx=0 tx=0).stop 2024-05-14T09:42:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 shutdown_connections 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe369d80 0x5620fe764440 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe75e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe38a4d0 0x5620fe757220 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 --2- 172.21.15.120:0/2977667271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe756ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 >> 172.21.15.120:0/2977667271 conn(0x5620fe39f300 msgr2=0x5620fe74b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc1dcc00640 0 client.17424 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 shutdown_connections 2024-05-14T09:42:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.316+0000 7fc200a42740 1 -- 172.21.15.120:0/2977667271 wait complete. 2024-05-14T09:42:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.317+0000 7fc200a42740 20 client.17424 trim_cache size 0 max 16384 2024-05-14T09:42:05.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.348+0000 7fc200a42740 1 Processor -- start 2024-05-14T09:42:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.348+0000 7fc200a42740 1 -- start start 2024-05-14T09:42:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.350+0000 7fc200a42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3822f0 0x5620fe7562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.350+0000 7fc200a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe38a4d0 0x5620fe75e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.350+0000 7fc200a42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe751140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.350+0000 7fc200a42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f41bb840 con 0x5620fe3822f0 2024-05-14T09:42:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.350+0000 7fc200a42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f41bd380 con 0x5620fe3ab1b0 2024-05-14T09:42:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.350+0000 7fc200a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f41bbf10 con 0x5620fe38a4d0 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe751140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe751140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55330/0 (socket says 172.21.15.120:55330) 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 -- 172.21.15.120:0/916426525 learned_addr learned my addr 172.21.15.120:0/916426525 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3822f0 0x5620fe7562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe38a4d0 0x5620fe75e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 -- 172.21.15.120:0/916426525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe38a4d0 msgr2=0x5620fe75e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe38a4d0 0x5620fe75e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 -- 172.21.15.120:0/916426525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3822f0 msgr2=0x5620fe7562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3822f0 0x5620fe7562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.351+0000 7fc1f2000640 1 -- 172.21.15.120:0/916426525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fe756a90 con 0x5620fe3ab1b0 2024-05-14T09:42:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.352+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe38a4d0 0x5620fe75e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.352+0000 7fc1f2000640 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe751140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000ad10 tx=0x7fc1e000af10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=988b20ea4a11eb4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.355+0000 7fc1df400640 1 -- 172.21.15.120:0/916426525 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0004030 con 0x5620fe3ab1b0 2024-05-14T09:42:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.355+0000 7fc1df400640 1 -- 172.21.15.120:0/916426525 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1e00035f0 con 0x5620fe3ab1b0 2024-05-14T09:42:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.355+0000 7fc1df400640 1 -- 172.21.15.120:0/916426525 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0017660 con 0x5620fe3ab1b0 2024-05-14T09:42:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.357+0000 7fc200a42740 1 -- 172.21.15.120:0/916426525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 msgr2=0x5620fe751140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.357+0000 7fc200a42740 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe751140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000ad10 tx=0x7fc1e000af10 comp rx=0 tx=0).stop 2024-05-14T09:42:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.357+0000 7fc200a42740 1 -- 172.21.15.120:0/916426525 shutdown_connections 2024-05-14T09:42:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.357+0000 7fc200a42740 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe3ab1b0 0x5620fe751140 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.357+0000 7fc200a42740 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe38a4d0 0x5620fe75e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.357+0000 7fc200a42740 1 --2- 172.21.15.120:0/916426525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3822f0 0x5620fe7562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.357+0000 7fc200a42740 1 -- 172.21.15.120:0/916426525 >> 172.21.15.120:0/916426525 conn(0x5620fe39f300 msgr2=0x5620fe74d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.360+0000 7fc200a42740 1 -- 172.21.15.120:0/916426525 shutdown_connections 2024-05-14T09:42:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.360+0000 7fc200a42740 1 -- 172.21.15.120:0/916426525 wait complete. 2024-05-14T09:42:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.361+0000 7fc200a42740 1 -- start start 2024-05-14T09:42:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.362+0000 7fc200a42740 1 Processor -- start 2024-05-14T09:42:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc200a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe75adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc200a42740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe38a4d0 0x5620fe75b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc200a42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3ab1b0 0x5620fe7ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc200a42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f41bccb0 con 0x5620fe3ab1b0 2024-05-14T09:42:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc200a42740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f41bc5e0 con 0x5620fe38a4d0 2024-05-14T09:42:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc200a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f4050870 con 0x5620fe3822f0 2024-05-14T09:42:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc200a42740 10 client.0 _ll_register_callbacks cb 0x7fc1e401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe38a4d0 0x5620fe75b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc1f2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe38a4d0 0x5620fe75b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:55334/0 (socket says 172.21.15.120:55334) 2024-05-14T09:42:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.364+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2484784051 learned_addr learned my addr 172.21.15.120:0/2484784051 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.366+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2484784051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 msgr2=0x5620fe75adb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:42:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.366+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe75adb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.366+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2484784051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3ab1b0 msgr2=0x5620fe7ca760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:42:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.366+0000 7fc1f2000640 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3ab1b0 0x5620fe7ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.366+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3ab1b0 0x5620fe7ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.366+0000 7fc1f2a00640 1 -- 172.21.15.120:0/2484784051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fe75e2b0 con 0x5620fe38a4d0 2024-05-14T09:42:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.367+0000 7fc1f2a00640 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe38a4d0 0x5620fe75b2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4010d60 tx=0x7fc1e400adf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e31924b785a445 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.367+0000 7fc1dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-05-14T09:42:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.367+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2484784051 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e403b060 con 0x5620fe38a4d0 2024-05-14T09:42:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.368+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2484784051 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fc1e4005c60 con 0x5620fe38a4d0 2024-05-14T09:42:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.368+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e00035f0 con 0x5620fe38a4d0 2024-05-14T09:42:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.369+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2484784051 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc1e4027040 con 0x5620fe38a4d0 2024-05-14T09:42:05.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.369+0000 7fc200a42740 10 client.36938 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:05.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.369+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x5620fe7cbb50 con 0x5620fe38a4d0 2024-05-14T09:42:05.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.373+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2484784051 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1e00035f0 con 0x5620fe38a4d0 2024-05-14T09:42:05.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.374+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2484784051 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7fc1e4004680 con 0x5620fe38a4d0 2024-05-14T09:42:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.374+0000 7fc200a42740 10 client.36938 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.374+0000 7fc200a42740 10 client.36938 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.374+0000 7fc200a42740 20 client.36938 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.374+0000 7fc200a42740 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe33f1c0 0x5620fe7ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.375+0000 7fc200a42740 4 client.36938 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:42:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.375+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620fe6b8fd0 con 0x5620fe33f1c0 2024-05-14T09:42:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.375+0000 7fc1f2000640 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe33f1c0 0x5620fe7ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.376+0000 7fc1f2000640 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe33f1c0 0x5620fe7ce4c0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85740f5377667d12 server_cookie=72a1e08578b0f4eb in_seq=0 out_seq=0 2024-05-14T09:42:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.376+0000 7fc1dcc00640 10 client.36938 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.401+0000 7fc1dcc00640 1 -- 172.21.15.120:0/2484784051 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620fe6b8fd0 con 0x5620fe33f1c0 2024-05-14T09:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.401+0000 7fc1dcc00640 10 client.36938 handle_command_reply: tid=0 2024-05-14T09:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.401+0000 7fc200a42740 1 client.36938 shutdown 2024-05-14T09:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.401+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe38a4d0 msgr2=0x5620fe75b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.401+0000 7fc200a42740 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe38a4d0 0x5620fe75b2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4010d60 tx=0x7fc1e400adf0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.402+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 shutdown_connections 2024-05-14T09:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.402+0000 7fc200a42740 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x5620fe33f1c0 0x5620fe7ce4c0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.402+0000 7fc200a42740 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5620fe3ab1b0 0x5620fe7ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.402+0000 7fc200a42740 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620fe38a4d0 0x5620fe75b2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.402+0000 7fc200a42740 1 --2- 172.21.15.120:0/2484784051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fe3822f0 0x5620fe75adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.402+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 >> 172.21.15.120:0/2484784051 conn(0x5620fe39f300 msgr2=0x5620fe751140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.402+0000 7fc1dcc00640 0 client.36938 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.403+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 shutdown_connections 2024-05-14T09:42:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.403+0000 7fc200a42740 1 -- 172.21.15.120:0/2484784051 wait complete. 2024-05-14T09:42:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.405+0000 7fc200a42740 20 client.36938 trim_cache size 0 max 16384 2024-05-14T09:42:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:42:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:42:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:42:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:42:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc1d80b28e0 msgr2=0x7fc1d80b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc1d80b28e0 0x7fc1d80b4df0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec031920 tx=0x7fc1ec04a000 comp rx=0 tx=0).stop 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4107db0 msgr2=0x7fc1f4108820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4107db0 0x7fc1f4108820 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec004af0 tx=0x7fc1ec0093d0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 shutdown_connections 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fc1d80b28e0 0x7fc1d80b4df0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f4107db0 0x7fc1f4108820 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f41030b0 0x7fc1f41082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 --2- 172.21.15.120:0/369775114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f4101e70 0x7fc1f4109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.407+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 >> 172.21.15.120:0/369775114 conn(0x7fc1f40fd080 msgr2=0x7fc1f4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.409+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 shutdown_connections 2024-05-14T09:42:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:05.410+0000 7fc1f9a00640 1 -- 172.21.15.120:0/369775114 wait complete. 2024-05-14T09:42:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:06 smithi120 ceph-mon[31085]: pgmap v1112: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-05-14T09:42:06.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:06 smithi152 ceph-mon[34868]: pgmap v1112: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-05-14T09:42:06.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:06 smithi175 ceph-mon[35353]: pgmap v1112: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-05-14T09:42:08.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:08 smithi120 ceph-mon[31085]: pgmap v1113: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 526 op/s 2024-05-14T09:42:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:08 smithi152 ceph-mon[34868]: pgmap v1113: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 526 op/s 2024-05-14T09:42:08.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:08 smithi175 ceph-mon[35353]: pgmap v1113: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 526 op/s 2024-05-14T09:42:09.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 875.0 s, 599.6 tps, lat 169.987 ms stddev 129.699 2024-05-14T09:42:10.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:10 smithi120 ceph-mon[31085]: pgmap v1114: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 548 op/s 2024-05-14T09:42:10.707 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:10 smithi152 ceph-mon[34868]: pgmap v1114: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 548 op/s 2024-05-14T09:42:10.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:10 smithi175 ceph-mon[35353]: pgmap v1114: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 548 op/s 2024-05-14T09:42:12.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:12 smithi175 ceph-mon[35353]: pgmap v1115: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 618 op/s 2024-05-14T09:42:12.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:12 smithi120 ceph-mon[31085]: pgmap v1115: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 618 op/s 2024-05-14T09:42:12.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:12 smithi152 ceph-mon[34868]: pgmap v1115: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 618 op/s 2024-05-14T09:42:14.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 880.0 s, 625.6 tps, lat 159.238 ms stddev 95.814 2024-05-14T09:42:14.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:14 smithi120 ceph-mon[31085]: pgmap v1116: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 515 op/s 2024-05-14T09:42:14.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:14 smithi152 ceph-mon[34868]: pgmap v1116: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 515 op/s 2024-05-14T09:42:14.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:14 smithi175 ceph-mon[35353]: pgmap v1116: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 515 op/s 2024-05-14T09:42:16.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:16 smithi120 ceph-mon[31085]: pgmap v1117: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-05-14T09:42:16.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:16 smithi152 ceph-mon[34868]: pgmap v1117: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-05-14T09:42:16.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:16 smithi175 ceph-mon[35353]: pgmap v1117: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-05-14T09:42:18.639 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:18 smithi120 ceph-mon[31085]: pgmap v1118: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 519 op/s 2024-05-14T09:42:18.639 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:18 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:42:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:18 smithi152 ceph-mon[34868]: pgmap v1118: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 519 op/s 2024-05-14T09:42:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:18 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:42:18.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:18 smithi175 ceph-mon[35353]: pgmap v1118: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 519 op/s 2024-05-14T09:42:18.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:18 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:42:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.813+0000 7ff2e3000640 1 -- 172.21.15.120:0/2459229566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 msgr2=0x7ff2dc10b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.813+0000 7ff2e3000640 1 --2- 172.21.15.120:0/2459229566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 0x7ff2dc10b1b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009860 tx=0x7ff2c802a380 comp rx=0 tx=0).stop 2024-05-14T09:42:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.814+0000 7ff2e3000640 1 -- 172.21.15.120:0/2459229566 shutdown_connections 2024-05-14T09:42:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.814+0000 7ff2e3000640 1 --2- 172.21.15.120:0/2459229566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc1103f0 0x7ff2dc112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.814+0000 7ff2e3000640 1 --2- 172.21.15.120:0/2459229566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2dc10b6f0 0x7ff2dc10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.814+0000 7ff2e3000640 1 --2- 172.21.15.120:0/2459229566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 0x7ff2dc10b1b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.814+0000 7ff2e3000640 1 -- 172.21.15.120:0/2459229566 >> 172.21.15.120:0/2459229566 conn(0x7ff2dc070460 msgr2=0x7ff2dc072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.814+0000 7ff2e3000640 1 -- 172.21.15.120:0/2459229566 shutdown_connections 2024-05-14T09:42:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.815+0000 7ff2e3000640 1 -- 172.21.15.120:0/2459229566 wait complete. 2024-05-14T09:42:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.816+0000 7ff2e3000640 1 Processor -- start 2024-05-14T09:42:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.817+0000 7ff2e3000640 1 -- start start 2024-05-14T09:42:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.817+0000 7ff2e3000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 0x7ff2dc19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.817+0000 7ff2e3000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc10b6f0 0x7ff2dc19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.817+0000 7ff2e3000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2dc1103f0 0x7ff2dc19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.817+0000 7ff2e3000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc115a30 con 0x7ff2dc1103f0 2024-05-14T09:42:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.817+0000 7ff2e3000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1158b0 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.817+0000 7ff2e3000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc115bb0 con 0x7ff2dc10a4c0 2024-05-14T09:42:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.818+0000 7ff2e1c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 0x7ff2dc19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.818+0000 7ff2e1200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc10b6f0 0x7ff2dc19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.819+0000 7ff2e1c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 0x7ff2dc19e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:58526/0 (socket says 172.21.15.120:58526) 2024-05-14T09:42:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.819+0000 7ff2e1c00640 1 -- 172.21.15.120:0/4240450002 learned_addr learned my addr 172.21.15.120:0/4240450002 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.819+0000 7ff2e1200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc10b6f0 0x7ff2dc19ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:44612/0 (socket says 172.21.15.120:44612) 2024-05-14T09:42:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.819+0000 7ff2e2600640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2dc1103f0 0x7ff2dc19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.819+0000 7ff2e1200640 1 -- 172.21.15.120:0/4240450002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 msgr2=0x7ff2dc19e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.819+0000 7ff2e1200640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 0x7ff2dc19e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.819+0000 7ff2e1200640 1 -- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2dc1103f0 msgr2=0x7ff2dc19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.820+0000 7ff2e1200640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2dc1103f0 0x7ff2dc19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.820+0000 7ff2e1200640 1 -- 172.21.15.120:0/4240450002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc19bcb0 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.820+0000 7ff2e2600640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2dc1103f0 0x7ff2dc19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:42:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.820+0000 7ff2e1200640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc10b6f0 0x7ff2dc19ee80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0005fd0 tx=0x7ff2d000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.820+0000 7ff2da000640 1 -- 172.21.15.120:0/4240450002 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000cd00 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.821+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc19bfa0 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.821+0000 7ff2da000640 1 -- 172.21.15.120:0/4240450002 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d00044b0 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.821+0000 7ff2da000640 1 -- 172.21.15.120:0/4240450002 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0010430 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.821+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc1a4b00 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.827+0000 7ff2da000640 1 -- 172.21.15.120:0/4240450002 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff2d00105d0 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.827+0000 7ff2eb60b740 1 Processor -- start 2024-05-14T09:42:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.827+0000 7ff2eb60b740 1 -- start start 2024-05-14T09:42:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.828+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381768300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.828+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381768880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.828+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d38176f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.828+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d3816cc550 con 0x55d3813c61b0 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.828+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d381671bc0 con 0x55d38139d2f0 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.828+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3816c8510 con 0x55d3813a54d0 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.829+0000 7ff2e1c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381768880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.830+0000 7ff2da000640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff2c40b2930 0x7ff2c40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.830+0000 7ff2e1c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381768880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:44628/0 (socket says 172.21.15.120:44628) 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.830+0000 7ff2e1c00640 1 -- 172.21.15.120:0/889652264 learned_addr learned my addr 172.21.15.120:0/889652264 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.830+0000 7ff2da000640 1 -- 172.21.15.120:0/4240450002 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff2d00e2890 con 0x7ff2dc10b6f0 2024-05-14T09:42:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.831+0000 7ff2e2600640 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381768300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.832+0000 7ff2e2600640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff2c40b2930 0x7ff2c40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.832+0000 7ff2e1c00640 1 -- 172.21.15.120:0/889652264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 msgr2=0x55d38176f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.832+0000 7ff2e1200640 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d38176f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.833+0000 7ff2e1c00640 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d38176f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.833+0000 7ff2e1c00640 1 -- 172.21.15.120:0/889652264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 msgr2=0x55d381768300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.833+0000 7ff2e1c00640 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381768300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.833+0000 7ff2e1c00640 1 -- 172.21.15.120:0/889652264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3813de210 con 0x55d38139d2f0 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.833+0000 7ff2e2600640 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381768300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.833+0000 7ff2e1200640 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d38176f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.834+0000 7ff2e2600640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff2c40b2930 0x7ff2c40b4e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55d3817694d0 tx=0x7ff2d4004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.834+0000 7ff2e1c00640 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381768880 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff2c802ad80 tx=0x7ff2c802adb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=998d042d0be8a50e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.836+0000 7ff2cea00640 1 -- 172.21.15.120:0/889652264 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8037040 con 0x55d38139d2f0 2024-05-14T09:42:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.836+0000 7ff2cea00640 1 -- 172.21.15.120:0/889652264 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2c80306b0 con 0x55d38139d2f0 2024-05-14T09:42:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.836+0000 7ff2cea00640 1 -- 172.21.15.120:0/889652264 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8005040 con 0x55d38139d2f0 2024-05-14T09:42:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.837+0000 7ff2eb60b740 1 -- 172.21.15.120:0/889652264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 msgr2=0x55d381768880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.838+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381768880 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff2c802ad80 tx=0x7ff2c802adb0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.838+0000 7ff2eb60b740 1 -- 172.21.15.120:0/889652264 shutdown_connections 2024-05-14T09:42:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.838+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d38176f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.838+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381768880 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.838+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/889652264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381768300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.838+0000 7ff2eb60b740 1 -- 172.21.15.120:0/889652264 >> 172.21.15.120:0/889652264 conn(0x55d3813ba300 msgr2=0x55d381763c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.841+0000 7ff2eb60b740 1 -- 172.21.15.120:0/889652264 shutdown_connections 2024-05-14T09:42:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.841+0000 7ff2eb60b740 1 -- 172.21.15.120:0/889652264 wait complete. 2024-05-14T09:42:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.842+0000 7ff2eb60b740 1 -- start start 2024-05-14T09:42:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.842+0000 7ff2eb60b740 1 Processor -- start 2024-05-14T09:42:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.843+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d38139d2f0 0x55d381771dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.843+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d381772310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.843+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d3813c61b0 0x55d381779270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.843+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d381770170 con 0x55d3813a54d0 2024-05-14T09:42:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.843+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d381685660 con 0x55d3813c61b0 2024-05-14T09:42:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.843+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3817702f0 con 0x55d38139d2f0 2024-05-14T09:42:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.843+0000 7ff2e1200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d381772310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e2600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d3813c61b0 0x55d381779270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e1200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d381772310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37016/0 (socket says 172.21.15.120:37016) 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e1200640 1 -- 172.21.15.120:0/2822748702 learned_addr learned my addr 172.21.15.120:0/2822748702 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2eb60b740 10 client.0 _ll_register_callbacks cb 0x55d38164f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e1200640 1 -- 172.21.15.120:0/2822748702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d38139d2f0 msgr2=0x55d381771dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e1200640 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d38139d2f0 0x55d381771dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e1200640 1 -- 172.21.15.120:0/2822748702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d3813c61b0 msgr2=0x55d381779270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e1200640 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d3813c61b0 0x55d381779270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.844+0000 7ff2e1200640 1 -- 172.21.15.120:0/2822748702 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3814aa620 con 0x55d3813a54d0 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.845+0000 7ff2e1200640 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d381772310 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009860 tx=0x7ff2d00a6170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bfd9136b8b7a23 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.845+0000 7ff2c3400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.845+0000 7ff2c3400640 1 -- 172.21.15.120:0/2822748702 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0090e60 con 0x55d3813a54d0 2024-05-14T09:42:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.845+0000 7ff2c3400640 1 -- 172.21.15.120:0/2822748702 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff2d00cd0c0 con 0x55d3813a54d0 2024-05-14T09:42:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.845+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2c80306b0 con 0x55d3813a54d0 2024-05-14T09:42:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.846+0000 7ff2c3400640 1 -- 172.21.15.120:0/2822748702 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7ff2d00aa8f0 con 0x55d3813a54d0 2024-05-14T09:42:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.846+0000 7ff2eb60b740 10 client.17436 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.846+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d38177c180 con 0x55d3813a54d0 2024-05-14T09:42:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.846+0000 7ff2c3400640 1 -- 172.21.15.120:0/2822748702 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2c80306b0 con 0x55d3813a54d0 2024-05-14T09:42:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.847+0000 7ff2c3400640 1 -- 172.21.15.120:0/2822748702 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7ff2d00cbba0 con 0x55d3813a54d0 2024-05-14T09:42:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.847+0000 7ff2eb60b740 10 client.17436 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.847+0000 7ff2eb60b740 10 client.17436 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.847+0000 7ff2eb60b740 20 client.17436 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.847+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d381384d80 0x55d38177f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.848+0000 7ff2eb60b740 4 client.17436 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:42:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.848+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3816da160 con 0x55d381384d80 2024-05-14T09:42:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.848+0000 7ff2e1c00640 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d381384d80 0x55d38177f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.849+0000 7ff2e1c00640 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d381384d80 0x55d38177f890 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0abd32e5ee22e2 server_cookie=45e899e73bff0014 in_seq=0 out_seq=0 2024-05-14T09:42:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.849+0000 7ff2c3400640 10 client.17436 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.853+0000 7ff2c3400640 1 -- 172.21.15.120:0/2822748702 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d3816da160 con 0x55d381384d80 2024-05-14T09:42:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.853+0000 7ff2c3400640 10 client.17436 handle_command_reply: tid=0 2024-05-14T09:42:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.853+0000 7ff2eb60b740 1 client.17436 shutdown 2024-05-14T09:42:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.854+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 msgr2=0x55d381772310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.854+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d381772310 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009860 tx=0x7ff2d00a6170 comp rx=0 tx=0).stop 2024-05-14T09:42:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 shutdown_connections 2024-05-14T09:42:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d381384d80 0x55d38177f890 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d3813c61b0 0x55d381779270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d381772310 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2c3400640 0 client.17436 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2822748702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d38139d2f0 0x55d381771dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 >> 172.21.15.120:0/2822748702 conn(0x55d3813ba300 msgr2=0x55d381766ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.856+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 shutdown_connections 2024-05-14T09:42:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.857+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2822748702 wait complete. 2024-05-14T09:42:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.857+0000 7ff2eb60b740 20 client.17436 trim_cache size 0 max 16384 2024-05-14T09:42:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 Processor -- start 2024-05-14T09:42:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 -- start start 2024-05-14T09:42:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381762250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d381779190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381762790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1c60b0 con 0x55d3813c61b0 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1c3ea0 con 0x55d38139d2f0 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.900+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1c59e0 con 0x55d3813a54d0 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.902+0000 7ff2e1200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d381779190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.902+0000 7ff2e2600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381762790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.902+0000 7ff2e2600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381762790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37022/0 (socket says 172.21.15.120:37022) 2024-05-14T09:42:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.902+0000 7ff2e2600640 1 -- 172.21.15.120:0/2738094898 learned_addr learned my addr 172.21.15.120:0/2738094898 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.903+0000 7ff2e2600640 1 -- 172.21.15.120:0/2738094898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 msgr2=0x55d381779190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.903+0000 7ff2e2600640 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d381779190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.903+0000 7ff2e2600640 1 -- 172.21.15.120:0/2738094898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 msgr2=0x55d381762250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:42:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.904+0000 7ff2e2600640 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381762250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.904+0000 7ff2e2600640 1 -- 172.21.15.120:0/2738094898 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d38175f4a0 con 0x55d3813c61b0 2024-05-14T09:42:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.904+0000 7ff2e1200640 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d381779190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:42:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.905+0000 7ff2e2600640 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381762790 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400ac00 tx=0x7ff2d401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8992c49bdf375ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.906+0000 7ff2ce000640 1 -- 172.21.15.120:0/2738094898 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4009190 con 0x55d3813c61b0 2024-05-14T09:42:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.906+0000 7ff2ce000640 1 -- 172.21.15.120:0/2738094898 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d4009330 con 0x55d3813c61b0 2024-05-14T09:42:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.906+0000 7ff2ce000640 1 -- 172.21.15.120:0/2738094898 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4007ba0 con 0x55d3813c61b0 2024-05-14T09:42:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.907+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2738094898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 msgr2=0x55d381762790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.907+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381762790 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400ac00 tx=0x7ff2d401f040 comp rx=0 tx=0).stop 2024-05-14T09:42:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.908+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2738094898 shutdown_connections 2024-05-14T09:42:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.908+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813c61b0 0x55d381762790 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.908+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813a54d0 0x55d381779190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.909+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/2738094898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381762250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.909+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2738094898 >> 172.21.15.120:0/2738094898 conn(0x55d3813ba300 msgr2=0x55d38176c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.909+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2738094898 shutdown_connections 2024-05-14T09:42:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.909+0000 7ff2eb60b740 1 -- 172.21.15.120:0/2738094898 wait complete. 2024-05-14T09:42:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.910+0000 7ff2eb60b740 1 -- start start 2024-05-14T09:42:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.910+0000 7ff2eb60b740 1 Processor -- start 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.911+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381776380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.911+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d3817768c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2eb60b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813c61b0 0x55d3817777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1c4c40 con 0x55d3813a54d0 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1c4570 con 0x55d38139d2f0 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2eb60b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1c5310 con 0x55d3813c61b0 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2eb60b740 10 client.0 _ll_register_callbacks cb 0x7ff2d0009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2e1200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d3817768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2e1200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d3817768c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37032/0 (socket says 172.21.15.120:37032) 2024-05-14T09:42:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.912+0000 7ff2e1200640 1 -- 172.21.15.120:0/723810820 learned_addr learned my addr 172.21.15.120:0/723810820 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.913+0000 7ff2e1200640 1 -- 172.21.15.120:0/723810820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813c61b0 msgr2=0x55d3817777f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:42:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.913+0000 7ff2e1200640 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813c61b0 0x55d3817777f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.913+0000 7ff2e1200640 1 -- 172.21.15.120:0/723810820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 msgr2=0x55d381776380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T09:42:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.913+0000 7ff2e1200640 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381776380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.913+0000 7ff2e1200640 1 -- 172.21.15.120:0/723810820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d381777db0 con 0x55d3813a54d0 2024-05-14T09:42:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.913+0000 7ff2e1200640 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d3817768c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009230 tx=0x7ff2d00c5100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd28d353320a830 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.913+0000 7ff2c3400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:42:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.914+0000 7ff2c3400640 1 -- 172.21.15.120:0/723810820 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0090e60 con 0x55d3813a54d0 2024-05-14T09:42:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.914+0000 7ff2c3400640 1 -- 172.21.15.120:0/723810820 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ff2d00a9b50 con 0x55d3813a54d0 2024-05-14T09:42:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.915+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d4009330 con 0x55d3813a54d0 2024-05-14T09:42:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.915+0000 7ff2c3400640 1 -- 172.21.15.120:0/723810820 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7ff2d00aeca0 con 0x55d3813a54d0 2024-05-14T09:42:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.915+0000 7ff2eb60b740 10 client.17442 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.915+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d3817790b0 con 0x55d3813a54d0 2024-05-14T09:42:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.916+0000 7ff2c3400640 1 -- 172.21.15.120:0/723810820 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d4009330 con 0x55d3813a54d0 2024-05-14T09:42:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.917+0000 7ff2c3400640 1 -- 172.21.15.120:0/723810820 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7ff2d00afe30 con 0x55d3813a54d0 2024-05-14T09:42:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.917+0000 7ff2eb60b740 10 client.17442 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.917+0000 7ff2eb60b740 10 client.17442 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.917+0000 7ff2eb60b740 20 client.17442 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.917+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d38135a1c0 0x55d3817e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.917+0000 7ff2eb60b740 4 client.17442 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:42:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.917+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d3816d3fd0 con 0x55d38135a1c0 2024-05-14T09:42:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.919+0000 7ff2e1c00640 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d38135a1c0 0x55d3817e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.920+0000 7ff2e1c00640 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d38135a1c0 0x55d3817e9e20 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=147ea4de3af9da7e server_cookie=23f4c6e22687cb82 in_seq=0 out_seq=0 2024-05-14T09:42:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.920+0000 7ff2c3400640 10 client.17442 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.943+0000 7ff2c3400640 1 -- 172.21.15.120:0/723810820 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d3816d3fd0 con 0x55d38135a1c0 2024-05-14T09:42:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.943+0000 7ff2c3400640 10 client.17442 handle_command_reply: tid=0 2024-05-14T09:42:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.943+0000 7ff2eb60b740 1 client.17442 shutdown 2024-05-14T09:42:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.943+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 msgr2=0x55d3817768c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.943+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d3817768c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009230 tx=0x7ff2d00c5100 comp rx=0 tx=0).stop 2024-05-14T09:42:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.944+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 shutdown_connections 2024-05-14T09:42:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.944+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55d38135a1c0 0x55d3817e9e20 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.944+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3813c61b0 0x55d3817777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.944+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d3813a54d0 0x55d3817768c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.944+0000 7ff2c3400640 0 client.17442 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.945+0000 7ff2eb60b740 1 --2- 172.21.15.120:0/723810820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d38139d2f0 0x55d381776380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.945+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 >> 172.21.15.120:0/723810820 conn(0x55d3813ba300 msgr2=0x55d381766a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.945+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 shutdown_connections 2024-05-14T09:42:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.946+0000 7ff2eb60b740 1 -- 172.21.15.120:0/723810820 wait complete. 2024-05-14T09:42:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.946+0000 7ff2eb60b740 20 client.17442 trim_cache size 0 max 16384 2024-05-14T09:42:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:42:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:42:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:42:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:42:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.947+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff2c40b2930 msgr2=0x7ff2c40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.947+0000 7ff2e3000640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff2c40b2930 0x7ff2c40b4e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55d3817694d0 tx=0x7ff2d4004ab0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.947+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc10b6f0 msgr2=0x7ff2dc19ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.947+0000 7ff2e3000640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc10b6f0 0x7ff2dc19ee80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0005fd0 tx=0x7ff2d000ee50 comp rx=0 tx=0).stop 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 shutdown_connections 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ff2c40b2930 0x7ff2c40b4e40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2dc1103f0 0x7ff2dc19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2dc10b6f0 0x7ff2dc19ee80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 --2- 172.21.15.120:0/4240450002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2dc10a4c0 0x7ff2dc19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 >> 172.21.15.120:0/4240450002 conn(0x7ff2dc070460 msgr2=0x7ff2dc10c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 shutdown_connections 2024-05-14T09:42:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:18.948+0000 7ff2e3000640 1 -- 172.21.15.120:0/4240450002 wait complete. 2024-05-14T09:42:19.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 885.0 s, 650.0 tps, lat 154.493 ms stddev 58.209 2024-05-14T09:42:20.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:20 smithi120 ceph-mon[31085]: pgmap v1119: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-05-14T09:42:20.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:42:20.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:42:20.636 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:20 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:42:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:20 smithi152 ceph-mon[34868]: pgmap v1119: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-05-14T09:42:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:42:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:42:20.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:20 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:42:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:20 smithi175 ceph-mon[35353]: pgmap v1119: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-05-14T09:42:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:42:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:42:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:20 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:42:22.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:22 smithi120 ceph-mon[31085]: pgmap v1120: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 647 op/s 2024-05-14T09:42:22.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:22 smithi152 ceph-mon[34868]: pgmap v1120: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 647 op/s 2024-05-14T09:42:22.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:22 smithi175 ceph-mon[35353]: pgmap v1120: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 647 op/s 2024-05-14T09:42:24.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 890.0 s, 488.0 tps, lat 199.753 ms stddev 148.208 2024-05-14T09:42:24.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:24 smithi120 ceph-mon[31085]: pgmap v1121: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 546 op/s 2024-05-14T09:42:24.709 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:24 smithi152 ceph-mon[34868]: pgmap v1121: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 546 op/s 2024-05-14T09:42:24.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:24 smithi175 ceph-mon[35353]: pgmap v1121: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.5 MiB/s wr, 546 op/s 2024-05-14T09:42:26.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:26 smithi120 ceph-mon[31085]: pgmap v1122: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 667 op/s 2024-05-14T09:42:26.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:26 smithi152 ceph-mon[34868]: pgmap v1122: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 667 op/s 2024-05-14T09:42:26.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:26 smithi175 ceph-mon[35353]: pgmap v1122: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 667 op/s 2024-05-14T09:42:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:28 smithi120 ceph-mon[31085]: pgmap v1123: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-05-14T09:42:28.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:28 smithi152 ceph-mon[34868]: pgmap v1123: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-05-14T09:42:28.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:28 smithi175 ceph-mon[35353]: pgmap v1123: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 502 op/s 2024-05-14T09:42:29.331 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 895.0 s, 627.4 tps, lat 161.568 ms stddev 166.454 2024-05-14T09:42:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:30 smithi120 ceph-mon[31085]: pgmap v1124: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 578 op/s 2024-05-14T09:42:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:30 smithi152 ceph-mon[34868]: pgmap v1124: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 578 op/s 2024-05-14T09:42:30.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:30 smithi175 ceph-mon[35353]: pgmap v1124: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 578 op/s 2024-05-14T09:42:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.322+0000 7fec19000640 1 -- 172.21.15.120:0/4187760806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410f890 msgr2=0x7fec14111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.322+0000 7fec19000640 1 --2- 172.21.15.120:0/4187760806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410f890 0x7fec14111cb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec00009900 tx=0x7fec0002a400 comp rx=0 tx=0).stop 2024-05-14T09:42:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.324+0000 7fec19000640 1 -- 172.21.15.120:0/4187760806 shutdown_connections 2024-05-14T09:42:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.324+0000 7fec19000640 1 --2- 172.21.15.120:0/4187760806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec141121f0 0x7fec14114610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.324+0000 7fec19000640 1 --2- 172.21.15.120:0/4187760806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410f890 0x7fec14111cb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.324+0000 7fec19000640 1 --2- 172.21.15.120:0/4187760806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec1410a0f0 0x7fec1410a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.324+0000 7fec19000640 1 -- 172.21.15.120:0/4187760806 >> 172.21.15.120:0/4187760806 conn(0x7fec14070460 msgr2=0x7fec14072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.324+0000 7fec19000640 1 -- 172.21.15.120:0/4187760806 shutdown_connections 2024-05-14T09:42:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.324+0000 7fec19000640 1 -- 172.21.15.120:0/4187760806 wait complete. 2024-05-14T09:42:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 Processor -- start 2024-05-14T09:42:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 -- start start 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410a0f0 0x7fec141a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec1410f890 0x7fec141a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec141121f0 0x7fec141abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fec14117c70 con 0x7fec1410f890 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec14117af0 con 0x7fec1410a0f0 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.328+0000 7fec19000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec14117df0 con 0x7fec141121f0 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.329+0000 7fec13400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410a0f0 0x7fec141a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.329+0000 7fec13400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410a0f0 0x7fec141a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:50176/0 (socket says 172.21.15.120:50176) 2024-05-14T09:42:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.329+0000 7fec13400640 1 -- 172.21.15.120:0/2155379693 learned_addr learned my addr 172.21.15.120:0/2155379693 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.330+0000 7fec13e00640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec141121f0 0x7fec141abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.330+0000 7fec13400640 1 -- 172.21.15.120:0/2155379693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec141121f0 msgr2=0x7fec141abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.330+0000 7fec13400640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec141121f0 0x7fec141abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.330+0000 7fec13400640 1 -- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec1410f890 msgr2=0x7fec141a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.330+0000 7fec12a00640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec1410f890 0x7fec141a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.331+0000 7fec13400640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec1410f890 0x7fec141a5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.331+0000 7fec13400640 1 -- 172.21.15.120:0/2155379693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec141ac600 con 0x7fec1410a0f0 2024-05-14T09:42:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.332+0000 7fec12a00640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec1410f890 0x7fec141a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.332+0000 7fec13400640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410a0f0 0x7fec141a4ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec0400ccb0 tx=0x7fec0400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.332+0000 7fec0be00640 1 -- 172.21.15.120:0/2155379693 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04004b20 con 0x7fec1410a0f0 2024-05-14T09:42:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.333+0000 7fec0be00640 1 -- 172.21.15.120:0/2155379693 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec04004cc0 con 0x7fec1410a0f0 2024-05-14T09:42:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.333+0000 7fec0be00640 1 -- 172.21.15.120:0/2155379693 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0400f6b0 con 0x7fec1410a0f0 2024-05-14T09:42:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.334+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec141ac8f0 con 0x7fec1410a0f0 2024-05-14T09:42:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.334+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec141acdc0 con 0x7fec1410a0f0 2024-05-14T09:42:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.340+0000 7fec21637740 1 Processor -- start 2024-05-14T09:42:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.341+0000 7fec21637740 1 -- start start 2024-05-14T09:42:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.341+0000 7fec21637740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.341+0000 7fec21637740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f396870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.341+0000 7fec21637740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f39d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.341+0000 7fec21637740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bf5f2fa550 con 0x55bf5efd34d0 2024-05-14T09:42:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.341+0000 7fec21637740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bf5f29fbc0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.341+0000 7fec21637740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf5f2f6510 con 0x55bf5eff41b0 2024-05-14T09:42:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.342+0000 7fec12a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f39d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.343+0000 7fec13e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.343+0000 7fec13e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36184/0 (socket says 172.21.15.120:36184) 2024-05-14T09:42:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.343+0000 7fec12a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f39d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45370/0 (socket says 172.21.15.120:45370) 2024-05-14T09:42:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.343+0000 7fec12a00640 1 -- 172.21.15.120:0/741540700 learned_addr learned my addr 172.21.15.120:0/741540700 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:32.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.344+0000 7fec12a00640 1 -- 172.21.15.120:0/741540700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 msgr2=0x55bf5f3962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:32.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.344+0000 7fec12a00640 1 --2- 172.21.15.120:0/741540700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.344+0000 7fec12a00640 1 -- 172.21.15.120:0/741540700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 msgr2=0x55bf5f396870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:42:32.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.344+0000 7fec12a00640 1 --2- 172.21.15.120:0/741540700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f396870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.344+0000 7fec12a00640 1 -- 172.21.15.120:0/741540700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf5f00c210 con 0x55bf5efd34d0 2024-05-14T09:42:32.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.345+0000 7fec12a00640 1 --2- 172.21.15.120:0/741540700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f39d770 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fec00004260 tx=0x7fec00004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8022e784e6ce8dd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:32.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.345+0000 7fec0be00640 1 -- 172.21.15.120:0/2155379693 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fec04005000 con 0x7fec1410a0f0 2024-05-14T09:42:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.350+0000 7fec0be00640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7febf80b28b0 0x7febf80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.350+0000 7fec0be00640 1 -- 172.21.15.120:0/2155379693 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fec040e29b0 con 0x7fec1410a0f0 2024-05-14T09:42:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.352+0000 7fec13e00640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7febf80b28b0 0x7febf80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.356+0000 7fec13e00640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7febf80b28b0 0x7febf80b4dc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55bf5f3974c0 tx=0x7fec0c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.358+0000 7fec08c00640 1 -- 172.21.15.120:0/741540700 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0003f070 con 0x55bf5efd34d0 2024-05-14T09:42:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.358+0000 7fec08c00640 1 -- 172.21.15.120:0/741540700 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec000044b0 con 0x55bf5efd34d0 2024-05-14T09:42:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.360+0000 7fec21637740 1 -- 172.21.15.120:0/741540700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 msgr2=0x55bf5f39d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.360+0000 7fec21637740 1 --2- 172.21.15.120:0/741540700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f39d770 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fec00004260 tx=0x7fec00004290 comp rx=0 tx=0).stop 2024-05-14T09:42:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.361+0000 7fec21637740 1 -- 172.21.15.120:0/741540700 shutdown_connections 2024-05-14T09:42:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.361+0000 7fec21637740 1 --2- 172.21.15.120:0/741540700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f39d770 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.361+0000 7fec21637740 1 --2- 172.21.15.120:0/741540700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f396870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.361+0000 7fec21637740 1 --2- 172.21.15.120:0/741540700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.361+0000 7fec21637740 1 -- 172.21.15.120:0/741540700 >> 172.21.15.120:0/741540700 conn(0x55bf5efe8300 msgr2=0x55bf5f391c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.362+0000 7fec21637740 1 -- 172.21.15.120:0/741540700 shutdown_connections 2024-05-14T09:42:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.362+0000 7fec21637740 1 -- 172.21.15.120:0/741540700 wait complete. 2024-05-14T09:42:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.364+0000 7fec21637740 1 -- start start 2024-05-14T09:42:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.365+0000 7fec21637740 1 Processor -- start 2024-05-14T09:42:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.368+0000 7fec21637740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.368+0000 7fec21637740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f3a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.368+0000 7fec21637740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.368+0000 7fec21637740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bf5f39e200 con 0x55bf5efd34d0 2024-05-14T09:42:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.368+0000 7fec21637740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bf5f2b3660 con 0x55bf5efcb2f0 2024-05-14T09:42:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.368+0000 7fec21637740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf5f39e380 con 0x55bf5eff41b0 2024-05-14T09:42:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.368+0000 7fec21637740 10 client.0 _ll_register_callbacks cb 0x55bf5f27d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.369+0000 7fec13e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.369+0000 7fec13e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36194/0 (socket says 172.21.15.120:36194) 2024-05-14T09:42:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.369+0000 7fec12a00640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f3a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.369+0000 7fec13e00640 1 -- 172.21.15.120:0/451295071 learned_addr learned my addr 172.21.15.120:0/451295071 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.370+0000 7fec13400640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.371+0000 7fec13e00640 1 -- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 msgr2=0x55bf5f3a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.371+0000 7fec13e00640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.372+0000 7fec13e00640 1 -- 172.21.15.120:0/451295071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 msgr2=0x55bf5f3a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:32.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.373+0000 7fec13e00640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f3a8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.373+0000 7fec13e00640 1 -- 172.21.15.120:0/451295071 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf5f0d8620 con 0x55bf5eff41b0 2024-05-14T09:42:32.374 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.373+0000 7fec12a00640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f3a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:42:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.376+0000 7fec13e00640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3afa60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec0c01e8b0 tx=0x7fec0c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c1a15c6b8b0e811 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.376+0000 7febfd600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:42:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.378+0000 7febfd600640 1 -- 172.21.15.120:0/451295071 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c02b060 con 0x55bf5eff41b0 2024-05-14T09:42:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.378+0000 7febfd600640 1 -- 172.21.15.120:0/451295071 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fec0c011b70 con 0x55bf5eff41b0 2024-05-14T09:42:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.378+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec000044b0 con 0x55bf5eff41b0 2024-05-14T09:42:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.379+0000 7febfd600640 1 -- 172.21.15.120:0/451295071 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fec0c01ee30 con 0x55bf5eff41b0 2024-05-14T09:42:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.379+0000 7fec21637740 10 client.27034 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.379+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55bf5f3b2ab0 con 0x55bf5eff41b0 2024-05-14T09:42:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.379+0000 7febfd600640 1 -- 172.21.15.120:0/451295071 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec000044b0 con 0x55bf5eff41b0 2024-05-14T09:42:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.380+0000 7febfd600640 1 -- 172.21.15.120:0/451295071 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7fec0c01a040 con 0x55bf5eff41b0 2024-05-14T09:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.380+0000 7fec21637740 10 client.27034 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.381+0000 7fec21637740 10 client.27034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.381+0000 7fec21637740 20 client.27034 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.381+0000 7fec21637740 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5efb2d80 0x55bf5f3b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.381+0000 7fec21637740 4 client.27034 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.381+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf5f308160 con 0x55bf5efb2d80 2024-05-14T09:42:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.382+0000 7fec13400640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5efb2d80 0x55bf5f3b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.383+0000 7fec13400640 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5efb2d80 0x55bf5f3b6130 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=965eef608bf1f92e server_cookie=178d48171abaf575 in_seq=0 out_seq=0 2024-05-14T09:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.383+0000 7febfd600640 10 client.27034 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.385+0000 7febfd600640 1 -- 172.21.15.120:0/451295071 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bf5f308160 con 0x55bf5efb2d80 2024-05-14T09:42:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.385+0000 7febfd600640 10 client.27034 handle_command_reply: tid=0 2024-05-14T09:42:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.385+0000 7fec21637740 1 client.27034 shutdown 2024-05-14T09:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.385+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 msgr2=0x55bf5f3afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.385+0000 7fec21637740 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3afa60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec0c01e8b0 tx=0x7fec0c0046c0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.386+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 shutdown_connections 2024-05-14T09:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.386+0000 7fec21637740 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5efb2d80 0x55bf5f3b6130 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.386+0000 7fec21637740 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3afa60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.386+0000 7fec21637740 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f3a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.386+0000 7fec21637740 1 --2- 172.21.15.120:0/451295071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.386+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 >> 172.21.15.120:0/451295071 conn(0x55bf5efe8300 msgr2=0x55bf5f390c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.386+0000 7febfd600640 0 client.27034 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.387+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 shutdown_connections 2024-05-14T09:42:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.388+0000 7fec21637740 1 -- 172.21.15.120:0/451295071 wait complete. 2024-05-14T09:42:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.388+0000 7fec21637740 20 client.27034 trim_cache size 0 max 16384 2024-05-14T09:42:32.432 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.432+0000 7fec21637740 1 Processor -- start 2024-05-14T09:42:32.433 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.432+0000 7fec21637740 1 -- start start 2024-05-14T09:42:32.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.433+0000 7fec21637740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f391640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.434 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.434+0000 7fec21637740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f391b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.434+0000 7fec21637740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.434+0000 7fec13400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f391640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.435+0000 7fec13400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f391640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.120:50188/0 (socket says 172.21.15.120:50188) 2024-05-14T09:42:32.435 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.435+0000 7fec13400640 1 -- 172.21.15.120:0/36023518 learned_addr learned my addr 172.21.15.120:0/36023518 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:32.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.435+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fec141b2fb0 con 0x55bf5efd34d0 2024-05-14T09:42:32.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.435+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec141b4af0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.435+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec141b3680 con 0x55bf5eff41b0 2024-05-14T09:42:32.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.435+0000 7fec13e00640 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.436 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.435+0000 7fec12a00640 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f391b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.436+0000 7fec13400640 1 -- 172.21.15.120:0/36023518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 msgr2=0x55bf5f3af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.436+0000 7fec13400640 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.436+0000 7fec13400640 1 -- 172.21.15.120:0/36023518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 msgr2=0x55bf5f391b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.436+0000 7fec13400640 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f391b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.436+0000 7fec13400640 1 -- 172.21.15.120:0/36023518 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf5efb2fb0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.436+0000 7fec13e00640 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:42:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.437+0000 7fec13400640 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f391640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec040a9930 tx=0x7fec040dffe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff4affee2ca8de72 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:32.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.438+0000 7febffe00640 1 -- 172.21.15.120:0/36023518 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec040c8030 con 0x55bf5efcb2f0 2024-05-14T09:42:32.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.438+0000 7febffe00640 1 -- 172.21.15.120:0/36023518 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec040b23d0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.439 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.438+0000 7febffe00640 1 -- 172.21.15.120:0/36023518 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec040adfe0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.439+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 msgr2=0x55bf5f391640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.439+0000 7fec21637740 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f391640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec040a9930 tx=0x7fec040dffe0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.440+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 shutdown_connections 2024-05-14T09:42:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.440+0000 7fec21637740 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5eff41b0 0x55bf5f3af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.440+0000 7fec21637740 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5efd34d0 0x55bf5f391b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.440+0000 7fec21637740 1 --2- 172.21.15.120:0/36023518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efcb2f0 0x55bf5f391640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.440+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 >> 172.21.15.120:0/36023518 conn(0x55bf5efe8300 msgr2=0x55bf5f39a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.440+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 shutdown_connections 2024-05-14T09:42:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.440+0000 7fec21637740 1 -- 172.21.15.120:0/36023518 wait complete. 2024-05-14T09:42:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.441+0000 7fec21637740 1 -- start start 2024-05-14T09:42:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.441+0000 7fec21637740 1 Processor -- start 2024-05-14T09:42:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.442+0000 7fec21637740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.442+0000 7fec21637740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efd34d0 0x55bf5f3acd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.442+0000 7fec21637740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5eff41b0 0x55bf5f3ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.442+0000 7fec21637740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fec141b4420 con 0x55bf5eff41b0 2024-05-14T09:42:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.442+0000 7fec21637740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec141b3d50 con 0x55bf5efd34d0 2024-05-14T09:42:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.442+0000 7fec21637740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec141b0fb0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.442+0000 7fec21637740 10 client.0 _ll_register_callbacks cb 0x7fec0c009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.120:36208/0 (socket says 172.21.15.120:36208) 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 -- 172.21.15.120:0/2366783382 learned_addr learned my addr 172.21.15.120:0/2366783382 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec12a00640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efd34d0 0x55bf5f3acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 -- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efd34d0 msgr2=0x55bf5f3acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13e00640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5eff41b0 0x55bf5f3ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efd34d0 0x55bf5f3acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 -- 172.21.15.120:0/2366783382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5eff41b0 msgr2=0x55bf5f3ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5eff41b0 0x55bf5f3ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.443+0000 7fec13400640 1 -- 172.21.15.120:0/2366783382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf5f41c550 con 0x55bf5efcb2f0 2024-05-14T09:42:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.444+0000 7fec13e00640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5eff41b0 0x55bf5f3ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.444+0000 7fec13400640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3b0210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec040e0480 tx=0x7fec040c42f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782bd278a960857d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.444+0000 7febfd600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-05-14T09:42:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.444+0000 7febfd600640 1 -- 172.21.15.120:0/2366783382 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec040c8030 con 0x55bf5efcb2f0 2024-05-14T09:42:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.445+0000 7febfd600640 1 -- 172.21.15.120:0/2366783382 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fec040a6220 con 0x55bf5efcb2f0 2024-05-14T09:42:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.445+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf5f301fd0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.446+0000 7febfd600640 1 -- 172.21.15.120:0/2366783382 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fec040aa330 con 0x55bf5efcb2f0 2024-05-14T09:42:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.446+0000 7fec21637740 10 client.27040 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.446+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55bf5f41d860 con 0x55bf5efcb2f0 2024-05-14T09:42:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.446+0000 7febfd600640 1 -- 172.21.15.120:0/2366783382 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bf5f301fd0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7febfd600640 1 -- 172.21.15.120:0/2366783382 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7fec040b2ce0 con 0x55bf5efcb2f0 2024-05-14T09:42:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7fec21637740 10 client.27040 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7fec21637740 10 client.27040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7fec21637740 20 client.27040 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7fec21637740 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5ef881c0 0x55bf5f420200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7fec21637740 4 client.27040 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:42:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bf5f27d4b0 con 0x55bf5ef881c0 2024-05-14T09:42:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.447+0000 7fec12a00640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5ef881c0 0x55bf5f420200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:32.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.449+0000 7fec12a00640 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5ef881c0 0x55bf5f420200 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6dd28b547efde9 server_cookie=cdca27c16ecae603 in_seq=0 out_seq=0 2024-05-14T09:42:32.449 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.449+0000 7febfd600640 10 client.27040 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.493+0000 7febfd600640 1 -- 172.21.15.120:0/2366783382 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bf5f27d4b0 con 0x55bf5ef881c0 2024-05-14T09:42:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7febfd600640 10 client.27040 handle_command_reply: tid=0 2024-05-14T09:42:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 client.27040 shutdown 2024-05-14T09:42:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5efcb2f0 msgr2=0x55bf5f3b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3b0210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec040e0480 tx=0x7fec040c42f0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 shutdown_connections 2024-05-14T09:42:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x55bf5ef881c0 0x55bf5f420200 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7febfd600640 0 client.27040 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bf5eff41b0 0x55bf5f3ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bf5efd34d0 0x55bf5f3acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 --2- 172.21.15.120:0/2366783382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf5efcb2f0 0x55bf5f3b0210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 >> 172.21.15.120:0/2366783382 conn(0x55bf5efe8300 msgr2=0x55bf5f391640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.494+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 shutdown_connections 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.495+0000 7fec21637740 1 -- 172.21.15.120:0/2366783382 wait complete. 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.495+0000 7fec21637740 20 client.27040 trim_cache size 0 max 16384 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:42:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:42:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7febf80b28b0 msgr2=0x7febf80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7febf80b28b0 0x7febf80b4dc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55bf5f3974c0 tx=0x7fec0c005f90 comp rx=0 tx=0).stop 2024-05-14T09:42:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410a0f0 msgr2=0x7fec141a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410a0f0 0x7fec141a4ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec0400ccb0 tx=0x7fec0400a620 comp rx=0 tx=0).stop 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 shutdown_connections 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7febf80b28b0 0x7febf80b4dc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec141121f0 0x7fec141abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec1410f890 0x7fec141a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 --2- 172.21.15.120:0/2155379693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1410a0f0 0x7fec141a4ac0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.496+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 >> 172.21.15.120:0/2155379693 conn(0x7fec14070460 msgr2=0x7fec1410c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.497+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 shutdown_connections 2024-05-14T09:42:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:32.497+0000 7fec19000640 1 -- 172.21.15.120:0/2155379693 wait complete. 2024-05-14T09:42:32.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:32 smithi120 ceph-mon[31085]: pgmap v1125: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-05-14T09:42:32.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:32 smithi152 ceph-mon[34868]: pgmap v1125: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-05-14T09:42:32.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:32 smithi175 ceph-mon[35353]: pgmap v1125: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-05-14T09:42:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:progress: 900.0 s, 584.4 tps, lat 172.716 ms stddev 104.707 2024-05-14T09:42:34.638 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:34 smithi120 ceph-mon[31085]: pgmap v1126: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-05-14T09:42:34.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:34 smithi152 ceph-mon[34868]: pgmap v1126: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-05-14T09:42:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:34 smithi175 ceph-mon[35353]: pgmap v1126: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:transaction type: 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:scaling factor: 32 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:query mode: simple 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:number of clients: 100 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:number of threads: 4 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:duration: 900 s 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:number of transactions actually processed: 537173 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:latency average = 167.430 ms 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:latency stddev = 276.123 ms 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:tps = 596.545820 (including connections establishing) 2024-05-14T09:42:34.804 INFO:teuthology.orchestra.run.smithi120.stdout:tps = 596.559595 (excluding connections establishing) 2024-05-14T09:42:35.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-05-14T09:42:36.637 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:36 smithi120 ceph-mon[31085]: pgmap v1127: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 650 op/s 2024-05-14T09:42:36.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:36 smithi152 ceph-mon[34868]: pgmap v1127: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 650 op/s 2024-05-14T09:42:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:36 smithi175 ceph-mon[35353]: pgmap v1127: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 650 op/s 2024-05-14T09:42:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:38 smithi120 ceph-mon[31085]: pgmap v1128: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2024-05-14T09:42:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:38 smithi152 ceph-mon[34868]: pgmap v1128: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2024-05-14T09:42:38.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:38 smithi175 ceph-mon[35353]: pgmap v1128: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2024-05-14T09:42:39.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:39 smithi152 ceph-mon[34868]: pgmap v1129: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-14T09:42:39.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:39 smithi175 ceph-mon[35353]: pgmap v1129: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-14T09:42:39.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:39 smithi120 ceph-mon[31085]: pgmap v1129: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-14T09:42:42.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:42 smithi152 ceph-mon[34868]: pgmap v1130: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 7.9 MiB/s wr, 850 op/s 2024-05-14T09:42:42.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:42 smithi175 ceph-mon[35353]: pgmap v1130: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 7.9 MiB/s wr, 850 op/s 2024-05-14T09:42:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:42 smithi120 ceph-mon[31085]: pgmap v1130: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 7.9 MiB/s wr, 850 op/s 2024-05-14T09:42:44.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:44 smithi152 ceph-mon[34868]: pgmap v1131: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 7.6 MiB/s wr, 839 op/s 2024-05-14T09:42:44.466 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:44 smithi120 ceph-mon[31085]: pgmap v1131: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 7.6 MiB/s wr, 839 op/s 2024-05-14T09:42:44.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:44 smithi175 ceph-mon[35353]: pgmap v1131: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 7.6 MiB/s wr, 839 op/s 2024-05-14T09:42:46.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:46 smithi152 ceph-mon[34868]: pgmap v1132: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 9.2 MiB/s wr, 1.02k op/s 2024-05-14T09:42:46.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:46 smithi175 ceph-mon[35353]: pgmap v1132: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 9.2 MiB/s wr, 1.02k op/s 2024-05-14T09:42:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.564+0000 7fe843200640 1 -- 172.21.15.120:0/2395989419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 msgr2=0x7fe8441065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.564+0000 7fe843200640 1 --2- 172.21.15.120:0/2395989419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe8441065a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe834009900 tx=0x7fe83402a410 comp rx=0 tx=0).stop 2024-05-14T09:42:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.564+0000 7fe843200640 1 -- 172.21.15.120:0/2395989419 shutdown_connections 2024-05-14T09:42:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.564+0000 7fe843200640 1 --2- 172.21.15.120:0/2395989419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe844109700 0x7fe84410bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.564+0000 7fe843200640 1 --2- 172.21.15.120:0/2395989419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe844106b90 0x7fe844109070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.564+0000 7fe843200640 1 --2- 172.21.15.120:0/2395989419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe8441065a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.564+0000 7fe843200640 1 -- 172.21.15.120:0/2395989419 >> 172.21.15.120:0/2395989419 conn(0x7fe8440fdb60 msgr2=0x7fe844100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.565+0000 7fe843200640 1 -- 172.21.15.120:0/2395989419 shutdown_connections 2024-05-14T09:42:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.565+0000 7fe843200640 1 -- 172.21.15.120:0/2395989419 wait complete. 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 Processor -- start 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 -- start start 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe84419c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe844106b90 0x7fe84419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe844109700 0x7fe8441a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe84410f440 con 0x7fe844104180 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe84410f2c0 con 0x7fe844106b90 2024-05-14T09:42:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe843200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe84410f5c0 con 0x7fe844109700 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.566+0000 7fe841e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe84419c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe84419c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60282/0 (socket says 172.21.15.120:60282) 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841e00640 1 -- 172.21.15.120:0/1401382345 learned_addr learned my addr 172.21.15.120:0/1401382345 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841400640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe844106b90 0x7fe84419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe842800640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe844109700 0x7fe8441a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841e00640 1 -- 172.21.15.120:0/1401382345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe844109700 msgr2=0x7fe8441a37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841e00640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe844109700 0x7fe8441a37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841e00640 1 -- 172.21.15.120:0/1401382345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe844106b90 msgr2=0x7fe84419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841e00640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe844106b90 0x7fe84419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841e00640 1 -- 172.21.15.120:0/1401382345 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8441a3e30 con 0x7fe844104180 2024-05-14T09:42:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.567+0000 7fe841400640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe844106b90 0x7fe84419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:42:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.568+0000 7fe841e00640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe84419c2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe834005760 tx=0x7fe834003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.568+0000 7fe83aa00640 1 -- 172.21.15.120:0/1401382345 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83403f070 con 0x7fe844104180 2024-05-14T09:42:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.568+0000 7fe83aa00640 1 -- 172.21.15.120:0/1401382345 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe834031da0 con 0x7fe844104180 2024-05-14T09:42:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.568+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8441a40c0 con 0x7fe844104180 2024-05-14T09:42:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.568+0000 7fe83aa00640 1 -- 172.21.15.120:0/1401382345 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834035030 con 0x7fe844104180 2024-05-14T09:42:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.568+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8441a45b0 con 0x7fe844104180 2024-05-14T09:42:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.572+0000 7fe83aa00640 1 -- 172.21.15.120:0/1401382345 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fe834042070 con 0x7fe844104180 2024-05-14T09:42:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 Processor -- start 2024-05-14T09:42:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 -- start start 2024-05-14T09:42:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf11a1b0 0x561adf4bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f12f0 0x561adf4bc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f94d0 0x561adf4c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561adf420550 con 0x561adf0f94d0 2024-05-14T09:42:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561adf3c5bc0 con 0x561adf11a1b0 2024-05-14T09:42:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.573+0000 7fe850223740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561adf41c510 con 0x561adf0f12f0 2024-05-14T09:42:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f94d0 0x561adf4c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f94d0 0x561adf4c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60292/0 (socket says 172.21.15.120:60292) 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 -- 172.21.15.120:0/1962730436 learned_addr learned my addr 172.21.15.120:0/1962730436 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841e00640 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f12f0 0x561adf4bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe842800640 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf11a1b0 0x561adf4bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 -- 172.21.15.120:0/1962730436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f12f0 msgr2=0x561adf4bc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f12f0 0x561adf4bc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 -- 172.21.15.120:0/1962730436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf11a1b0 msgr2=0x561adf4bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf11a1b0 0x561adf4bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.574+0000 7fe841400640 1 -- 172.21.15.120:0/1962730436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561adf132210 con 0x561adf0f94d0 2024-05-14T09:42:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.575+0000 7fe83aa00640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe8280b27e0 0x7fe8280b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.575+0000 7fe83aa00640 1 -- 172.21.15.120:0/1401382345 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe834102f80 con 0x7fe844104180 2024-05-14T09:42:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.575+0000 7fe841400640 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f94d0 0x561adf4c3780 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe83000bd40 tx=0x7fe83000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931070a36c669c28 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.575+0000 7fe842800640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe8280b27e0 0x7fe8280b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.575+0000 7fe82f400640 1 -- 172.21.15.120:0/1962730436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830011640 con 0x561adf0f94d0 2024-05-14T09:42:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.575+0000 7fe82f400640 1 -- 172.21.15.120:0/1962730436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe83000be30 con 0x561adf0f94d0 2024-05-14T09:42:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.575+0000 7fe82f400640 1 -- 172.21.15.120:0/1962730436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83001b9c0 con 0x561adf0f94d0 2024-05-14T09:42:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.576+0000 7fe850223740 1 -- 172.21.15.120:0/1962730436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f94d0 msgr2=0x561adf4c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.576+0000 7fe850223740 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f94d0 0x561adf4c3780 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe83000bd40 tx=0x7fe83000f730 comp rx=0 tx=0).stop 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.576+0000 7fe842800640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe8280b27e0 0x7fe8280b4cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0092f0 tx=0x7fe83c009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 -- 172.21.15.120:0/1962730436 shutdown_connections 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f94d0 0x561adf4c3780 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f12f0 0x561adf4bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 --2- 172.21.15.120:0/1962730436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf11a1b0 0x561adf4bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 -- 172.21.15.120:0/1962730436 >> 172.21.15.120:0/1962730436 conn(0x561adf10e300 msgr2=0x561adf4b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 -- 172.21.15.120:0/1962730436 shutdown_connections 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 -- 172.21.15.120:0/1962730436 wait complete. 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.577+0000 7fe850223740 1 -- start start 2024-05-14T09:42:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 1 Processor -- start 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f12f0 0x561adf4c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f94d0 0x561adf4c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf11a1b0 0x561adf4cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561adf4c41d0 con 0x561adf11a1b0 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561adf3d9660 con 0x561adf0f12f0 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561adf4c4350 con 0x561adf0f94d0 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.578+0000 7fe850223740 10 client.0 _ll_register_callbacks cb 0x561adf3a3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf11a1b0 0x561adf4cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf11a1b0 0x561adf4cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60302/0 (socket says 172.21.15.120:60302) 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 -- 172.21.15.120:0/4074428316 learned_addr learned my addr 172.21.15.120:0/4074428316 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe841400640 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f94d0 0x561adf4c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe841e00640 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f12f0 0x561adf4c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 -- 172.21.15.120:0/4074428316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f94d0 msgr2=0x561adf4c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f94d0 0x561adf4c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 -- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f12f0 msgr2=0x561adf4c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f12f0 0x561adf4c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.579+0000 7fe842800640 1 -- 172.21.15.120:0/4074428316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561adf1fe620 con 0x561adf11a1b0 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.580+0000 7fe842800640 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf11a1b0 0x561adf4cd270 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0097d0 tx=0x7fe83c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d3b7b75a366c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.580+0000 7fe823e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:42:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.580+0000 7fe823e00640 1 -- 172.21.15.120:0/4074428316 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00ece0 con 0x561adf11a1b0 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.580+0000 7fe823e00640 1 -- 172.21.15.120:0/4074428316 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe83c01f420 con 0x561adf11a1b0 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.580+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe83000be30 con 0x561adf11a1b0 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.580+0000 7fe823e00640 1 -- 172.21.15.120:0/4074428316 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fe83c030050 con 0x561adf11a1b0 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 10 client.17463 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x561adf4d0270 con 0x561adf11a1b0 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe823e00640 1 -- 172.21.15.120:0/4074428316 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe83000be30 con 0x561adf11a1b0 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe823e00640 1 -- 172.21.15.120:0/4074428316 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7fe83c00f040 con 0x561adf11a1b0 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 10 client.17463 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 10 client.17463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 20 client.17463 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0d8d80 0x561adf4d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 4 client.17463 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:42:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.581+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561adf42e160 con 0x561adf0d8d80 2024-05-14T09:42:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.582+0000 7fe841e00640 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0d8d80 0x561adf4d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.583+0000 7fe841e00640 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0d8d80 0x561adf4d3990 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=381a4aadabd15d25 server_cookie=3d79800071a00400 in_seq=0 out_seq=0 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.583+0000 7fe823e00640 10 client.17463 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe823e00640 1 -- 172.21.15.120:0/4074428316 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561adf42e160 con 0x561adf0d8d80 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe823e00640 10 client.17463 handle_command_reply: tid=0 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 client.17463 shutdown 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf11a1b0 msgr2=0x561adf4cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf11a1b0 0x561adf4cd270 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0097d0 tx=0x7fe83c004a40 comp rx=0 tx=0).stop 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 shutdown_connections 2024-05-14T09:42:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0d8d80 0x561adf4d3990 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf11a1b0 0x561adf4cd270 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf0f94d0 0x561adf4c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 --2- 172.21.15.120:0/4074428316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f12f0 0x561adf4c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe823e00640 0 client.17463 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 >> 172.21.15.120:0/4074428316 conn(0x561adf10e300 msgr2=0x561adf4b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.585+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 shutdown_connections 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.586+0000 7fe850223740 1 -- 172.21.15.120:0/4074428316 wait complete. 2024-05-14T09:42:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.586+0000 7fe850223740 20 client.17463 trim_cache size 0 max 16384 2024-05-14T09:42:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.604+0000 7fe850223740 1 Processor -- start 2024-05-14T09:42:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.604+0000 7fe850223740 1 -- start start 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.604+0000 7fe850223740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4d81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe850223740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe850223740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf4cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe850223740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe8441aeae0 con 0x561adf0f12f0 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe850223740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe8441b0620 con 0x561adf0f94d0 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe850223740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8441af1b0 con 0x561adf11a1b0 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4d81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4d81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60308/0 (socket says 172.21.15.120:60308) 2024-05-14T09:42:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 -- 172.21.15.120:0/2539419603 learned_addr learned my addr 172.21.15.120:0/2539419603 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe842800640 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf4cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841400640 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 -- 172.21.15.120:0/2539419603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 msgr2=0x561adf4cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf4cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 -- 172.21.15.120:0/2539419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 msgr2=0x561adf4cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841e00640 1 -- 172.21.15.120:0/2539419603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561adf4b34a0 con 0x561adf0f12f0 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe841400640 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.605+0000 7fe842800640 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf4cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.606+0000 7fe841e00640 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4d81d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe834000c00 tx=0x7fe83402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8862027593d00eb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.606+0000 7fe82ea00640 1 -- 172.21.15.120:0/2539419603 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834049040 con 0x561adf0f12f0 2024-05-14T09:42:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.606+0000 7fe82ea00640 1 -- 172.21.15.120:0/2539419603 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8340ce5b0 con 0x561adf0f12f0 2024-05-14T09:42:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.606+0000 7fe82ea00640 1 -- 172.21.15.120:0/2539419603 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8341050e0 con 0x561adf0f12f0 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 -- 172.21.15.120:0/2539419603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 msgr2=0x561adf4d81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4d81d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe834000c00 tx=0x7fe83402a410 comp rx=0 tx=0).stop 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 -- 172.21.15.120:0/2539419603 shutdown_connections 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf4cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 --2- 172.21.15.120:0/2539419603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4d81d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 -- 172.21.15.120:0/2539419603 >> 172.21.15.120:0/2539419603 conn(0x561adf10e300 msgr2=0x561adf4c0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 -- 172.21.15.120:0/2539419603 shutdown_connections 2024-05-14T09:42:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.607+0000 7fe850223740 1 -- 172.21.15.120:0/2539419603 wait complete. 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.608+0000 7fe850223740 1 -- start start 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.608+0000 7fe850223740 1 Processor -- start 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.608+0000 7fe850223740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe850223740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe850223740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf539e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe850223740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe8441aff50 con 0x561adf0f12f0 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe850223740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe8441af880 con 0x561adf0f94d0 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe850223740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8441acae0 con 0x561adf11a1b0 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe850223740 10 client.0 _ll_register_callbacks cb 0x7fe83c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60320/0 (socket says 172.21.15.120:60320) 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 -- 172.21.15.120:0/624439028 learned_addr learned my addr 172.21.15.120:0/624439028 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe842800640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf539e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841400640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 -- 172.21.15.120:0/624439028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 msgr2=0x561adf539e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf539e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 -- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 msgr2=0x561adf4cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841e00640 1 -- 172.21.15.120:0/624439028 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561adf53a440 con 0x561adf0f12f0 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.609+0000 7fe841400640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe841e00640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4ccc10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe834100730 tx=0x7fe834009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f223d27fd3162383 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe823e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe823e00640 1 -- 172.21.15.120:0/624439028 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834049040 con 0x561adf0f12f0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe823e00640 1 -- 172.21.15.120:0/624439028 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fe8341050f0 con 0x561adf0f12f0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8340ce5b0 con 0x561adf0f12f0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe823e00640 1 -- 172.21.15.120:0/624439028 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fe83403b4f0 con 0x561adf0f12f0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe850223740 10 client.17469 fetch_fsmap learned FSMap version 74 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x561adf53b5b0 con 0x561adf0f12f0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.610+0000 7fe823e00640 1 -- 172.21.15.120:0/624439028 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8340ce5b0 con 0x561adf0f12f0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.611+0000 7fe823e00640 1 -- 172.21.15.120:0/624439028 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 74) ==== 8362+0+0 (secure 0 0 0) 0x7fe8340d2c60 con 0x561adf0f12f0 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.611+0000 7fe850223740 10 client.17469 fetch_fsmap finished waiting for FSMap version 74 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.611+0000 7fe850223740 10 client.17469 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.h 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.611+0000 7fe850223740 20 client.17469 populate_metadata read hostname 'smithi120' 2024-05-14T09:42:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.611+0000 7fe850223740 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0ae1c0 0x561adf53dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.611+0000 7fe850223740 4 client.17469 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T09:42:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.611+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 --> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561adf4bcc10 con 0x561adf0ae1c0 2024-05-14T09:42:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.612+0000 7fe841400640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0ae1c0 0x561adf53dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.613+0000 7fe823e00640 10 client.17469 ms_handle_connect on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.613+0000 7fe841400640 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0ae1c0 0x561adf53dec0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ece3b1387d84e8f5 server_cookie=3d8459fe024fbfd2 in_seq=0 out_seq=0 2024-05-14T09:42:46.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:46 smithi120 ceph-mon[31085]: pgmap v1132: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 9.2 MiB/s wr, 1.02k op/s 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe823e00640 1 -- 172.21.15.120:0/624439028 <== mds.0 v2:172.21.15.152:6836/1812479560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561adf4bcc10 con 0x561adf0ae1c0 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe823e00640 10 client.17469 handle_command_reply: tid=0 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 client.17469 shutdown 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 msgr2=0x561adf4ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4ccc10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe834100730 tx=0x7fe834009260 comp rx=0 tx=0).stop 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 shutdown_connections 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:6836/1812479560,v1:172.21.15.152:6837/1812479560] conn(0x561adf0ae1c0 0x561adf53dec0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561adf11a1b0 0x561adf539e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561adf0f94d0 0x561adf4cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe823e00640 0 client.17469 ms_handle_reset on v2:172.21.15.152:6836/1812479560 2024-05-14T09:42:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 --2- 172.21.15.120:0/624439028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561adf0f12f0 0x561adf4ccc10 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 >> 172.21.15.120:0/624439028 conn(0x561adf10e300 msgr2=0x561adf4baa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 shutdown_connections 2024-05-14T09:42:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.638+0000 7fe850223740 1 -- 172.21.15.120:0/624439028 wait complete. 2024-05-14T09:42:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.639+0000 7fe850223740 20 client.17469 trim_cache size 0 max 16384 2024-05-14T09:42:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-05-14T09:42:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-05-14T09:42:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-05-14T09:42:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-05-14T09:42:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.639+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe8280b27e0 msgr2=0x7fe8280b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe8280b27e0 0x7fe8280b4cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0092f0 tx=0x7fe83c009280 comp rx=0 tx=0).stop 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 msgr2=0x7fe84419c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe84419c2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe834005760 tx=0x7fe834003d50 comp rx=0 tx=0).stop 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 shutdown_connections 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fe8280b27e0 0x7fe8280b4cf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe844109700 0x7fe8441a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe844106b90 0x7fe84419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 --2- 172.21.15.120:0/1401382345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe844104180 0x7fe84419c2f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 >> 172.21.15.120:0/1401382345 conn(0x7fe8440fdb60 msgr2=0x7fe8441020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 shutdown_connections 2024-05-14T09:42:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-05-14T09:42:46.640+0000 7fe843200640 1 -- 172.21.15.120:0/1401382345 wait complete. 2024-05-14T09:42:48.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:48 smithi152 ceph-mon[34868]: pgmap v1133: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 7.8 MiB/s wr, 856 op/s 2024-05-14T09:42:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:48 smithi175 ceph-mon[35353]: pgmap v1133: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 7.8 MiB/s wr, 856 op/s 2024-05-14T09:42:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:48 smithi120 ceph-mon[31085]: pgmap v1133: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 7.8 MiB/s wr, 856 op/s 2024-05-14T09:42:50.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:50 smithi175 ceph-mon[35353]: pgmap v1134: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 7.8 MiB/s wr, 870 op/s 2024-05-14T09:42:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:50 smithi120 ceph-mon[31085]: pgmap v1134: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 7.8 MiB/s wr, 870 op/s 2024-05-14T09:42:50.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:50 smithi152 ceph-mon[34868]: pgmap v1134: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 7.8 MiB/s wr, 870 op/s 2024-05-14T09:42:52.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-14T09:42:52.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:52 smithi175 ceph-mon[35353]: pgmap v1135: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 6.8 MiB/s wr, 754 op/s 2024-05-14T09:42:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:52 smithi120 ceph-mon[31085]: pgmap v1135: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 6.8 MiB/s wr, 754 op/s 2024-05-14T09:42:52.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:52 smithi152 ceph-mon[34868]: pgmap v1135: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 6.8 MiB/s wr, 754 op/s 2024-05-14T09:42:54.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:54 smithi175 ceph-mon[35353]: pgmap v1136: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 419 op/s 2024-05-14T09:42:54.555 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/: 2024-05-14T09:42:54.555 INFO:teuthology.orchestra.run.smithi120.stdout:total 2 2024-05-14T09:42:54.555 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1508529400 May 14 09:23 . 2024-05-14T09:42:54.555 INFO:teuthology.orchestra.run.smithi120.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1508529400 May 14 09:23 .. 2024-05-14T09:42:54.555 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508529400 May 14 09:42 data 2024-05-14T09:42:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data: 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:total 46 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508529400 May 14 09:42 . 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1508529400 May 14 09:23 .. 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 584685109 May 14 09:27 base 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 May 14 09:24 current_logfiles 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 May 14 09:24 global 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1152 May 14 09:24 log 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_commit_ts 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_dynshmem 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 14 09:23 pg_hba.conf 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 14 09:23 pg_ident.conf 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:42 pg_logical 2024-05-14T09:42:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 pg_multixact 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_notify 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_replslot 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_serial 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_snapshots 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 09:42 pg_stat 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 09:42 pg_stat_tmp 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:42 pg_subtrans 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_tblspc 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 pg_twophase 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:23 PG_VERSION 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 922746880 May 14 09:42 pg_wal 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 May 14 09:23 pg_xact 2024-05-14T09:42:54.557 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 14 09:23 postgresql.auto.conf 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 14 09:23 postgresql.conf 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 May 14 09:24 postmaster.opts 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base: 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:total 3 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 584685109 May 14 09:27 . 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508529400 May 14 09:42 .. 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:23 1 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:24 13493 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 568758831 May 14 09:31 13494 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:27 pgsql_tmp 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-14T09:42:54.558 INFO:teuthology.orchestra.run.smithi120.stdout:total 7778 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:23 . 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 584685109 May 14 09:27 .. 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 112 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 113 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:23 1247 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1247_fsm 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1247_vm 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 09:23 1249 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1249_fsm 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1249_vm 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 09:23 1255 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1255_fsm 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1255_vm 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 09:24 1259 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1259_fsm 2024-05-14T09:42:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1259_vm 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 09:24 13344 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13344_fsm 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13344_vm 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13346 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13348 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13349_fsm 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349_vm 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13351 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13353 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13354_fsm 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354_vm 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13356 2024-05-14T09:42:54.560 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13358 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13359_fsm 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359_vm 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 13361 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 13363 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 1417 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 1418 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 174 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 175 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2187 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2224 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2328 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2336 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2337 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2579 2024-05-14T09:42:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2600 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2600_fsm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2600_vm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2601 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2601_fsm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2601_vm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:23 2602 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2602_fsm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2602_vm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2603 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2603_fsm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2603_vm 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2604 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2605 2024-05-14T09:42:54.562 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2605_fsm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2605_vm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2606 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2606_fsm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2606_vm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2607 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 2607_fsm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2607_vm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 09:24 2608 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2608_fsm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2608_vm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 09:24 2609 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2609_fsm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2609_vm 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2610 2024-05-14T09:42:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2610_fsm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2610_vm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2611 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2612_fsm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612_vm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2613 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2615_fsm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615_vm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2616 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2616_fsm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2616_vm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 09:24 2617 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2617_fsm 2024-05-14T09:42:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2617_vm 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 09:24 2618 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2618_fsm 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2618_vm 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 09:24 2619 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2619_fsm 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2619_vm 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2620 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2650 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2651 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2652 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:23 2653 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:23 2654 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2655 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2656 2024-05-14T09:42:54.565 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2657 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 09:24 2658 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 2659 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2660 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2661 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2662 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2663 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2664 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2665 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2666 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2667 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2668 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2669 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2670 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 09:24 2673 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 09:24 2674 2024-05-14T09:42:54.566 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 09:24 2675 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2678 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2679 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2680 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2681 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2682 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2683 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2684 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2685 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2686 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2687 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:23 2688 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:23 2689 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 09:24 2690 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 09:24 2691 2024-05-14T09:42:54.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2692 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2693 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2696 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2699 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2701 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2702 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2703 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2704 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2753 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2753_fsm 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2753_vm 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2754 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2755 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2756 2024-05-14T09:42:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:23 2757 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2830 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2831 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2832 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2833 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2834 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2835 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2836 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2837 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 09:24 2838 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2838_fsm 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2838_vm 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2839 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840_fsm 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2840_vm 2024-05-14T09:42:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2841 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2995 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2996 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3079_fsm 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079_vm 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3080 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3081 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3085 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3118 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3119 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:24 3164 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3256 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3257 2024-05-14T09:42:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3258 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3350 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3351 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3379 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3380 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3381 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3394 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3394_fsm 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3394_vm 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3395 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3429 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3430 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3431 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3433 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3439 2024-05-14T09:42:54.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3440 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3455 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 09:24 3456 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3456_fsm 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3456_vm 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3466 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3467 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3468 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3501 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3502 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3503 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3534 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3541_fsm 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541_vm 2024-05-14T09:42:54.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 3542 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3574 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3575 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3576 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3596 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3597 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3598 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3599 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3600_fsm 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600_vm 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3601_fsm 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601_vm 2024-05-14T09:42:54.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3602_fsm 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602_vm 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603_fsm 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3603_vm 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3604 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3605 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 3606 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 3607 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3608 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 3609 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3712 2024-05-14T09:42:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3764_fsm 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764_vm 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3766 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3767 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3997 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4143 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4144 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4145 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4146 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4147 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4148 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4149 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4150 2024-05-14T09:42:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4151 2024-05-14T09:42:54.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:54 smithi120 ceph-mon[31085]: pgmap v1136: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 419 op/s 2024-05-14T09:42:54.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:54 smithi152 ceph-mon[34868]: pgmap v1136: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 419 op/s 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4152 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4153 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4154 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4155 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4156 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4157 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4158 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4159 2024-05-14T09:42:56.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4160 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4161 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4162 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4163 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4164 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4165 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4166 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4167 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4168 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4169 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4170 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4171 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4172 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4173 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4174 2024-05-14T09:42:56.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 5002 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 548 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 549 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6102 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6104 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6106 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6110 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6111 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6112 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6113 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6117 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 826 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 827 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 828 2024-05-14T09:42:56.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:23 pg_filenode.map 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:23 PG_VERSION 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:total 7778 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 09:24 . 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 584685109 May 14 09:27 .. 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 112 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 113 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 1247 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1247_fsm 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1247_vm 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 09:24 1249 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1249_fsm 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1249_vm 2024-05-14T09:42:56.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 09:24 1255 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1255_fsm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1255_vm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 09:24 1259 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1259_fsm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1259_vm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 09:24 13344 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13344_fsm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13344_vm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13346 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13348 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13349_fsm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349_vm 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13351 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13353 2024-05-14T09:42:56.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13354_fsm 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354_vm 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13356 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13358 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13359_fsm 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359_vm 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13361 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13363 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1417 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1418 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 174 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 175 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2187 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2224 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2328 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2336 2024-05-14T09:42:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2337 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2579 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2600 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2600_fsm 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2600_vm 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2601_fsm 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601_vm 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2602 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2602_fsm 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2602_vm 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2603 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2603_fsm 2024-05-14T09:42:56.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2603_vm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2604 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2605 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2605_fsm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2605_vm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2606 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2606_fsm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2606_vm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2607 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2607_fsm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2607_vm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 09:24 2608 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2608_fsm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2608_vm 2024-05-14T09:42:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 09:24 2609 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2609_fsm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2609_vm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2610 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2610_fsm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2610_vm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2611 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2612_fsm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612_vm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2613 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2615_fsm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615_vm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2616 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2616_fsm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2616_vm 2024-05-14T09:42:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 09:24 2617 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2617_fsm 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2617_vm 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 09:24 2618 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2618_fsm 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2618_vm 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 09:24 2619 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2619_fsm 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2619_vm 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2620 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2650 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2651 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2652 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2653 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2654 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2655 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2656 2024-05-14T09:42:56.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2657 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 09:24 2658 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:24 2659 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2660 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2661 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2662 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2663 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2664 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2665 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2666 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2667 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2668 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2669 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2670 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 09:24 2673 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 09:24 2674 2024-05-14T09:42:56.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 09:24 2675 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2678 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2679 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2680 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2681 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2682 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2683 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2684 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2685 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2686 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2687 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2688 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2689 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 09:24 2690 2024-05-14T09:42:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 09:24 2691 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2692 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2693 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2696 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2699 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2701 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2702 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2703 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2704 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2753 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2753_fsm 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2753_vm 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2754 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2755 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2756 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2757 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2830 2024-05-14T09:42:56.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2831 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2832 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2833 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2834 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2835 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2836 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2837 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 09:24 2838 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2838_fsm 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2838_vm 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2839 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840_fsm 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2840_vm 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2841 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2995 2024-05-14T09:42:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2996 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3079_fsm 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079_vm 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3080 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3081 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3085 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3118 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3119 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:24 3164 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3256 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3257 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3258 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3350 2024-05-14T09:42:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3351 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3379 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3380 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3381 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3394 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3394_fsm 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3394_vm 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3395 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3429 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3430 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3431 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3433 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3439 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3440 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3455 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 09:24 3456 2024-05-14T09:42:56.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3456_fsm 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3456_vm 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3466 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3467 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3468 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3501 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3502 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3503 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3534 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3541_fsm 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541_vm 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3542 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3574 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3575 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3576 2024-05-14T09:42:56.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3596 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3597 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3598 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3599 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3600_fsm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600_vm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3601_fsm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601_vm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3602_fsm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602_vm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603_fsm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3603_vm 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3604 2024-05-14T09:42:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3605 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3606 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3607 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3608 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 3609 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3712 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3764_fsm 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764_vm 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3766 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3767 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3997 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4143 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4144 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4145 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4146 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4147 2024-05-14T09:42:56.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4148 2024-05-14T09:42:56.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4149 2024-05-14T09:42:56.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4150 2024-05-14T09:42:56.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4151 2024-05-14T09:42:56.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4152 2024-05-14T09:42:56.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4153 2024-05-14T09:42:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:56 smithi120 ceph-mon[31085]: pgmap v1137: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2024-05-14T09:42:56.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:56 smithi152 ceph-mon[34868]: pgmap v1137: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2024-05-14T09:42:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:56 smithi175 ceph-mon[35353]: pgmap v1137: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2024-05-14T09:42:58.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4154 2024-05-14T09:42:58.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4155 2024-05-14T09:42:58.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4156 2024-05-14T09:42:58.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4157 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4158 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4159 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4160 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4161 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4162 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4163 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4164 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4165 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4166 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4167 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4168 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4169 2024-05-14T09:42:58.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4170 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4171 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4172 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4173 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4174 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 5002 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 548 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 549 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6102 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6104 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6106 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6110 2024-05-14T09:42:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6111 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6112 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6113 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6117 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 826 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 827 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 828 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:24 pg_filenode.map 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:24 PG_VERSION 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:total 555431 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 568758831 May 14 09:31 . 2024-05-14T09:42:58.461 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 584685109 May 14 09:27 .. 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 112 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 113 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:28 1247 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1247_fsm 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 1247_vm 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 09:28 1249 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:27 1249_fsm 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 1249_vm 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 09:24 1255 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1255_fsm 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1255_vm 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 09:42 1259 2024-05-14T09:42:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1259_fsm 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 1259_vm 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 09:24 13344 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13344_fsm 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13344_vm 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13346 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13348 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13349_fsm 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13349_vm 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13351 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13353 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354 2024-05-14T09:42:58.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13354_fsm 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13354_vm 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13356 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13358 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 13359_fsm 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13359_vm 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 13361 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 13363 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1417 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 1418 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 445677568 May 14 09:42 16396 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 14 09:42 16396_fsm 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:42 16396_vm 2024-05-14T09:42:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4079616 May 14 09:42 16397 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:42 16397_fsm 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:42 16397_vm 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8757248 May 14 09:42 16399 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:42 16399_fsm 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:42 16399_vm 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:42 16400 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 09:40 16402 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 May 14 09:42 16404 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 29827072 May 14 09:42 16406 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:42 16406_fsm 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:42 16406_vm 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 174 2024-05-14T09:42:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 175 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2187 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2224 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2328 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2336 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2337 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:27 2579 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2600 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2600_fsm 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2600_vm 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2601_fsm 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2601_vm 2024-05-14T09:42:58.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2602 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2602_fsm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2602_vm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2603 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2603_fsm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2603_vm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2604 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2605 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2605_fsm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2605_vm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 2606 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2606_fsm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 2606_vm 2024-05-14T09:42:58.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2607 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2607_fsm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2607_vm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 09:28 2608 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2608_fsm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 2608_vm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 09:24 2609 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2609_fsm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2609_vm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:28 2610 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2610_fsm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 2610_vm 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2611 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612 2024-05-14T09:42:58.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2612_fsm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2612_vm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2613 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2615_fsm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2615_vm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2616 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2616_fsm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2616_vm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 09:24 2617 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2617_fsm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2617_vm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 09:24 2618 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2618_fsm 2024-05-14T09:42:58.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2618_vm 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 May 14 09:42 2619 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:41 2619_fsm 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:27 2619_vm 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2620 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2650 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2651 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2652 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2653 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2654 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2655 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2656 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2657 2024-05-14T09:42:58.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 09:28 2658 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 09:28 2659 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2660 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2661 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:28 2662 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:28 2663 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:28 2664 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:28 2665 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:27 2666 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:28 2667 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2668 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2669 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2670 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 09:28 2673 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 09:28 2674 2024-05-14T09:42:58.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 09:24 2675 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:28 2678 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:28 2679 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2680 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2681 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2682 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2683 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2684 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2685 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2686 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2687 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 2688 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 09:24 2689 2024-05-14T09:42:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 09:24 2690 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 09:24 2691 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2692 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2693 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:42 2696 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2699 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2701 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2702 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:28 2703 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:28 2704 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2753 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2753_fsm 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2753_vm 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2754 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2755 2024-05-14T09:42:58.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2756 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 2757 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2830 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2831 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2832 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2833 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2834 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2835 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2836 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2837 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 09:24 2838 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2838_fsm 2024-05-14T09:42:58.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2838_vm 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2839 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2840_fsm 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2840_vm 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2841 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 2995 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2996 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3079_fsm 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3079_vm 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3080 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3081 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:24 3085 2024-05-14T09:42:58.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3118 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3119 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:24 3164 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3256 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3257 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3258 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3350 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3351 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3379 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3380 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3381 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3394 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3394_fsm 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3394_vm 2024-05-14T09:42:58.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3395 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3429 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3430 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3431 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3433 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3439 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3440 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 09:28 3455 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 09:24 3456 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3456_fsm 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3456_vm 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3466 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3467 2024-05-14T09:42:58.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3468 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3501 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3502 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3503 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3534 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3541_fsm 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3541_vm 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3542 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3574 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3575 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3576 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3596 2024-05-14T09:42:58.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3597 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 3598 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3599 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3600_fsm 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3600_vm 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3601_fsm 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3601_vm 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3602_fsm 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3602_vm 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603 2024-05-14T09:42:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3603_fsm 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3603_vm 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3604 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3605 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3606 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3607 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3608 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 09:24 3609 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3712 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 3764_fsm 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3764_vm 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3766 2024-05-14T09:42:58.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 3767 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 3997 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4143 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4144 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4145 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4146 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4147 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4148 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4149 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4150 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4151 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4152 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4153 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4154 2024-05-14T09:42:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4155 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4156 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4157 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4158 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4159 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4160 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4161 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4162 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4163 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4164 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4165 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4166 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4167 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4168 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4169 2024-05-14T09:42:58.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4170 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4171 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4172 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 4173 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 4174 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 5002 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 548 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 549 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6102 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6104 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 6106 2024-05-14T09:42:58.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6110 2024-05-14T09:42:58.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:58 smithi120 ceph-mon[31085]: pgmap v1138: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 133 KiB/s wr, 45 op/s 2024-05-14T09:42:58.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:42:58 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:42:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:58 smithi152 ceph-mon[34868]: pgmap v1138: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 133 KiB/s wr, 45 op/s 2024-05-14T09:42:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:42:58 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:42:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:58 smithi175 ceph-mon[35353]: pgmap v1138: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 133 KiB/s wr, 45 op/s 2024-05-14T09:42:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:42:58 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:42:58.807 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6111 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6112 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6113 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 6117 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:24 826 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 827 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 828 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:24 pg_filenode.map 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 May 14 09:24 pg_internal.init 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 09:24 PG_VERSION 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:27 . 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 584685109 May 14 09:27 .. 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/global: 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:total 561 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 May 14 09:24 . 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1213 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1213_fsm 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1213_vm 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1214 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:23 1214_fsm 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 1214_vm 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 1232 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 1233 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1260 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1260_fsm 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1260_vm 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1261 2024-05-14T09:42:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1261_fsm 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1261_vm 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1262 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 1262_fsm 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 1262_vm 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2396 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 09:24 2396_fsm 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:24 2396_vm 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2397 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2671 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2672 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2676 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2677 2024-05-14T09:42:58.810 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2694 2024-05-14T09:42:58.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:24 2695 2024-05-14T09:42:58.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2697 2024-05-14T09:42:58.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 2698 2024-05-14T09:42:58.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2846 2024-05-14T09:42:58.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2847 2024-05-14T09:42:58.902 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2964 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2965 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 2966 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 2967 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 3592 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 3593 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4060 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4061 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4175 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4176 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4177 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4178 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4181 2024-05-14T09:42:58.903 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4182 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4183 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4184 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 4185 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 4186 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6000 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6001 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6002 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 6100 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6114 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 6115 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:42 pg_control 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 09:23 pg_filenode.map 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 May 14 09:24 pg_internal.init 2024-05-14T09:42:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/log: 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:total 3 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1152 May 14 09:24 . 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1223 May 14 09:42 postgresql-Tue.log 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:58.905 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:58.906 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:58.906 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-14T09:42:58.906 INFO:teuthology.orchestra.run.smithi120.stdout:total 3 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:42 . 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 mappings 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:42 replorigin_checkpoint 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 snapshots 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:42 .. 2024-05-14T09:42:59.138 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 09:42 .. 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:total 2 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 . 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 members 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 offsets 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:total 9 2024-05-14T09:42:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 . 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 .. 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 0000 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:total 9 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:23 . 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 09:23 .. 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 09:29 0000 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-14T09:42:59.140 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:total 16 2024-05-14T09:42:59.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 09:42 . 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 May 14 09:42 db_0.stat 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 May 14 09:42 db_13494.stat 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 May 14 09:42 global.stat 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 09:42 . 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:total 57 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:42 . 2024-05-14T09:42:59.142 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 09:42 0008 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:total 901122 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 922746880 May 14 09:42 . 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:42 00000001000000000000007A 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 00000001000000000000007B 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:34 00000001000000000000007C 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:36 00000001000000000000007D 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:34 00000001000000000000007E 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:34 00000001000000000000007F 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 000000010000000000000080 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:37 000000010000000000000081 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:34 000000010000000000000082 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:36 000000010000000000000083 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:38 000000010000000000000084 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 000000010000000000000085 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:34 000000010000000000000086 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:37 000000010000000000000087 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 000000010000000000000088 2024-05-14T09:42:59.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:37 000000010000000000000089 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:38 00000001000000000000008A 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:34 00000001000000000000008B 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 00000001000000000000008C 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 00000001000000000000008D 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:36 00000001000000000000008E 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:36 00000001000000000000008F 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:36 000000010000000000000090 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 000000010000000000000091 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 000000010000000000000092 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:34 000000010000000000000093 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:35 000000010000000000000094 2024-05-14T09:42:59.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 000000010000000000000095 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 000000010000000000000096 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:41 000000010000000000000097 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:42 000000010000000000000098 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:41 000000010000000000000099 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:41 00000001000000000000009A 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 00000001000000000000009B 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:41 00000001000000000000009C 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 00000001000000000000009D 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 00000001000000000000009E 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 00000001000000000000009F 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000A0 2024-05-14T09:42:59.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 0000000100000000000000A1 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 0000000100000000000000A2 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000A3 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000A4 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000A5 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000A6 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 0000000100000000000000A7 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000A8 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000A9 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 0000000100000000000000AA 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:40 0000000100000000000000AB 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 0000000100000000000000AC 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:42 0000000100000000000000AD 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:41 0000000100000000000000AE 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:41 0000000100000000000000AF 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 09:39 0000000100000000000000B0 2024-05-14T09:42:59.530 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 archive_status 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:total 1 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 09:23 . 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 922746880 May 14 09:42 .. 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:total 137 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 May 14 09:23 . 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1508281231 May 14 09:42 .. 2024-05-14T09:42:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 May 14 09:42 0000 2024-05-14T09:42:59.538 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-14T09:42:59.551 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:42:59.570 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-14T09:42:59.580 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-14T09:42:59.580 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T09:42:59.581 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-14T09:42:59.590 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:42:59.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 -- 172.21.15.120:0/3797579556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010b2b0 msgr2=0x7ffbf010b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:59.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 --2- 172.21.15.120:0/3797579556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010b2b0 0x7ffbf010b6c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009900 tx=0x7ffbd802a410 comp rx=0 tx=0).stop 2024-05-14T09:42:59.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 -- 172.21.15.120:0/3797579556 shutdown_connections 2024-05-14T09:42:59.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 --2- 172.21.15.120:0/3797579556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf010ffb0 0x7ffbf01123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:59.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 --2- 172.21.15.120:0/3797579556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010b2b0 0x7ffbf010b6c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:59.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 --2- 172.21.15.120:0/3797579556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbf010a070 0x7ffbf010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:59.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 -- 172.21.15.120:0/3797579556 >> 172.21.15.120:0/3797579556 conn(0x7ffbf0078c60 msgr2=0x7ffbf0107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:42:59.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 -- 172.21.15.120:0/3797579556 shutdown_connections 2024-05-14T09:42:59.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.914+0000 7ffbef200640 1 -- 172.21.15.120:0/3797579556 wait complete. 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.915+0000 7ffbef200640 1 Processor -- start 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.915+0000 7ffbef200640 1 -- start start 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbef200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf010a070 0x7ffbf01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbef200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbf010b2b0 0x7ffbf01a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbef200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010ffb0 0x7ffbf01a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbef200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0115b70 con 0x7ffbf010ffb0 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbef200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01159f0 con 0x7ffbf010a070 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbef200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0115cf0 con 0x7ffbf010b2b0 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbee800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010ffb0 0x7ffbf01a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:59.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbee800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010ffb0 0x7ffbf01a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49532/0 (socket says 172.21.15.120:49532) 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbee800640 1 -- 172.21.15.120:0/3615103985 learned_addr learned my addr 172.21.15.120:0/3615103985 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.916+0000 7ffbe7e00640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbf010b2b0 0x7ffbf01a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbede00640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf010a070 0x7ffbf01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbee800640 1 -- 172.21.15.120:0/3615103985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbf010b2b0 msgr2=0x7ffbf01a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbee800640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbf010b2b0 0x7ffbf01a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbee800640 1 -- 172.21.15.120:0/3615103985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf010a070 msgr2=0x7ffbf01a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbee800640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf010a070 0x7ffbf01a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbee800640 1 -- 172.21.15.120:0/3615103985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf01a82f0 con 0x7ffbf010ffb0 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbede00640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf010a070 0x7ffbf01a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbee800640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010ffb0 0x7ffbf01a7c80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800b970 tx=0x7ffbe800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbe6a00640 1 -- 172.21.15.120:0/3615103985 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8019070 con 0x7ffbf010ffb0 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.917+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf01a85e0 con 0x7ffbf010ffb0 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.918+0000 7ffbe6a00640 1 -- 172.21.15.120:0/3615103985 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbe8014440 con 0x7ffbf010ffb0 2024-05-14T09:42:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.918+0000 7ffbe6a00640 1 -- 172.21.15.120:0/3615103985 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe80075d0 con 0x7ffbf010ffb0 2024-05-14T09:42:59.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.918+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf01a8bb0 con 0x7ffbf010ffb0 2024-05-14T09:42:59.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.919+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf010edc0 con 0x7ffbf010ffb0 2024-05-14T09:42:59.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.921+0000 7ffbe6a00640 1 -- 172.21.15.120:0/3615103985 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ffbe801c070 con 0x7ffbf010ffb0 2024-05-14T09:42:59.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.923+0000 7ffbe6a00640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbd40b27e0 0x7ffbd40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:42:59.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.923+0000 7ffbe6a00640 1 -- 172.21.15.120:0/3615103985 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7ffbe80e20f0 con 0x7ffbf010ffb0 2024-05-14T09:42:59.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.923+0000 7ffbede00640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbd40b27e0 0x7ffbd40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:42:59.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.924+0000 7ffbede00640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbd40b27e0 0x7ffbd40b4cf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0006fd0 tx=0x7ffbe0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:42:59.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:42:59.926+0000 7ffbe6a00640 1 -- 172.21.15.120:0/3615103985 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffbe80a9a10 con 0x7ffbf010ffb0 2024-05-14T09:43:00.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.135+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbf002ddd0 con 0x7ffbf010ffb0 2024-05-14T09:43:00.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.139+0000 7ffbe6a00640 1 -- 172.21.15.120:0/3615103985 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24798 (secure 0 0 0) 0x7ffbe80a9310 con 0x7ffbf010ffb0 2024-05-14T09:43:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:43:00.141 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":90,"fsid":"15b5acb4-11d1-11ef-bc98-c7b262605968","created":"2024-05-14T09:06:21.773383+0000","modified":"2024-05-14T09:19:42.440912+0000","last_up_change":"2024-05-14T09:16:37.624187+0000","last_in_change":"2024-05-14T09:16:11.718778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:11:00.255347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:17:56.520013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:18:00.789799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:18:13.868113+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eb734948-7a05-48ee-b91b-f35370e93d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6803","nonce":2428528152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6805","nonce":2428528152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6809","nonce":2428528152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2428528152},{"type":"v1","addr":"172.21.15.120:6807","nonce":2428528152}]},"public_addr":"172.21.15.120:6803/2428528152","cluster_addr":"172.21.15.120:6805/2428528152","heartbeat_back_addr":"172.21.15.120:6809/2428528152","heartbeat_front_addr":"172.21.15.120:6807/2428528152","state":["exists","up"]},{"osd":1,"uuid":"9a48da4c-1105-46af-9372-8403c631030d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6801","nonce":3641772741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6803","nonce":3641772741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6807","nonce":3641772741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3641772741},{"type":"v1","addr":"172.21.15.152:6805","nonce":3641772741}]},"public_addr":"172.21.15.152:6801/3641772741","cluster_addr":"172.21.15.152:6803/3641772741","heartbeat_back_addr":"172.21.15.152:6807/3641772741","heartbeat_front_addr":"172.21.15.152:6805/3641772741","state":["exists","up"]},{"osd":2,"uuid":"faf13568-1e16-4349-b77f-ad12a08ef3ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6801","nonce":636369105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6803","nonce":636369105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6807","nonce":636369105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":636369105},{"type":"v1","addr":"172.21.15.175:6805","nonce":636369105}]},"public_addr":"172.21.15.175:6801/636369105","cluster_addr":"172.21.15.175:6803/636369105","heartbeat_back_addr":"172.21.15.175:6807/636369105","heartbeat_front_addr":"172.21.15.175:6805/636369105","state":["exists","up"]},{"osd":3,"uuid":"dc6567b9-b095-481f-b68a-95e8119e71a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6811","nonce":920546533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6813","nonce":920546533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6817","nonce":920546533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":920546533},{"type":"v1","addr":"172.21.15.120:6815","nonce":920546533}]},"public_addr":"172.21.15.120:6811/920546533","cluster_addr":"172.21.15.120:6813/920546533","heartbeat_back_addr":"172.21.15.120:6817/920546533","heartbeat_front_addr":"172.21.15.120:6815/920546533","state":["exists","up"]},{"osd":4,"uuid":"7d112625-503e-4906-8165-24025f4bd184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6809","nonce":3049924657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6811","nonce":3049924657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6815","nonce":3049924657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3049924657},{"type":"v1","addr":"172.21.15.152:6813","nonce":3049924657}]},"public_addr":"172.21.15.152:6809/3049924657","cluster_addr":"172.21.15.152:6811/3049924657","heartbeat_back_addr":"172.21.15.152:6815/3049924657","heartbeat_front_addr":"172.21.15.152:6813/3049924657","state":["exists","up"]},{"osd":5,"uuid":"1e68188d-0af5-4edf-a9e8-17a5ef0cd98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6809","nonce":10166549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6811","nonce":10166549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6815","nonce":10166549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":10166549},{"type":"v1","addr":"172.21.15.175:6813","nonce":10166549}]},"public_addr":"172.21.15.175:6809/10166549","cluster_addr":"172.21.15.175:6811/10166549","heartbeat_back_addr":"172.21.15.175:6815/10166549","heartbeat_front_addr":"172.21.15.175:6813/10166549","state":["exists","up"]},{"osd":6,"uuid":"c2d6f698-0513-4b46-a575-24ec7b0bb63b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6819","nonce":3056363875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6821","nonce":3056363875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6825","nonce":3056363875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3056363875},{"type":"v1","addr":"172.21.15.120:6823","nonce":3056363875}]},"public_addr":"172.21.15.120:6819/3056363875","cluster_addr":"172.21.15.120:6821/3056363875","heartbeat_back_addr":"172.21.15.120:6825/3056363875","heartbeat_front_addr":"172.21.15.120:6823/3056363875","state":["exists","up"]},{"osd":7,"uuid":"42fe6ed9-d065-45d6-938c-66322c1ec1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6817","nonce":2236830001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6819","nonce":2236830001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6823","nonce":2236830001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2236830001},{"type":"v1","addr":"172.21.15.152:6821","nonce":2236830001}]},"public_addr":"172.21.15.152:6817/2236830001","cluster_addr":"172.21.15.152:6819/2236830001","heartbeat_back_addr":"172.21.15.152:6823/2236830001","heartbeat_front_addr":"172.21.15.152:6821/2236830001","state":["exists","up"]},{"osd":8,"uuid":"6917512f-8d13-47e1-8150-fdc1c89a20f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6817","nonce":3403319131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6819","nonce":3403319131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6823","nonce":3403319131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3403319131},{"type":"v1","addr":"172.21.15.175:6821","nonce":3403319131}]},"public_addr":"172.21.15.175:6817/3403319131","cluster_addr":"172.21.15.175:6819/3403319131","heartbeat_back_addr":"172.21.15.175:6823/3403319131","heartbeat_front_addr":"172.21.15.175:6821/3403319131","state":["exists","up"]},{"osd":9,"uuid":"b9c8846f-4e89-4037-be61-133dcc3f14b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6827","nonce":1052033755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6829","nonce":1052033755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6833","nonce":1052033755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1052033755},{"type":"v1","addr":"172.21.15.120:6831","nonce":1052033755}]},"public_addr":"172.21.15.120:6827/1052033755","cluster_addr":"172.21.15.120:6829/1052033755","heartbeat_back_addr":"172.21.15.120:6833/1052033755","heartbeat_front_addr":"172.21.15.120:6831/1052033755","state":["exists","up"]},{"osd":10,"uuid":"345256b7-22fe-434c-b01b-9fd4b7863770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6825","nonce":832573806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6827","nonce":832573806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6831","nonce":832573806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":832573806},{"type":"v1","addr":"172.21.15.152:6829","nonce":832573806}]},"public_addr":"172.21.15.152:6825/832573806","cluster_addr":"172.21.15.152:6827/832573806","heartbeat_back_addr":"172.21.15.152:6831/832573806","heartbeat_front_addr":"172.21.15.152:6829/832573806","state":["exists","up"]},{"osd":11,"uuid":"98aafbef-b766-49dc-b707-68043cf59c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6825","nonce":82369907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6827","nonce":82369907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6831","nonce":82369907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":82369907},{"type":"v1","addr":"172.21.15.175:6829","nonce":82369907}]},"public_addr":"172.21.15.175:6825/82369907","cluster_addr":"172.21.15.175:6827/82369907","heartbeat_back_addr":"172.21.15.175:6831/82369907","heartbeat_front_addr":"172.21.15.175:6829/82369907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:09:46.543735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:22.574020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:10:57.645662+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:11:34.343529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:11.719446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:12:48.781735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:13:26.476282+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:05.472654+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:14:42.489975+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:20.238391+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:15:58.232590+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:16:35.734021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":6},{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6800/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/975840748":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/1968421814":"2024-05-15T09:07:40.065639+0000","172.21.15.120:6801/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2919660982":"2024-05-15T09:07:04.655251+0000","172.21.15.120:6800/3992386407":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/2419562786":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/1457013957":"2024-05-15T09:07:40.065639+0000","172.21.15.120:0/3562327753":"2024-05-15T09:07:04.655251+0000","172.21.15.120:0/119127043":"2024-05-15T09:07:40.065639+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:43:00.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.142+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbd40b27e0 msgr2=0x7ffbd40b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.142+0000 7ffbef200640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbd40b27e0 0x7ffbd40b4cf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0006fd0 tx=0x7ffbe0008040 comp rx=0 tx=0).stop 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.142+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010ffb0 msgr2=0x7ffbf01a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.142+0000 7ffbef200640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010ffb0 0x7ffbf01a7c80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800b970 tx=0x7ffbe800be30 comp rx=0 tx=0).stop 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 shutdown_connections 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7ffbd40b27e0 0x7ffbd40b4cf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbf010ffb0 0x7ffbf01a7c80 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbf010b2b0 0x7ffbf01a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 --2- 172.21.15.120:0/3615103985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf010a070 0x7ffbf01a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 >> 172.21.15.120:0/3615103985 conn(0x7ffbf0078c60 msgr2=0x7ffbf010bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 shutdown_connections 2024-05-14T09:43:00.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.143+0000 7ffbef200640 1 -- 172.21.15.120:0/3615103985 wait complete. 2024-05-14T09:43:00.173 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T09:11:00.255347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T09:17:56.520013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T09:18:00.789799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-14T09:18:13.868113+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-14T09:43:00.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 -- 172.21.15.120:0/3380552053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 msgr2=0x7f0994106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 --2- 172.21.15.120:0/3380552053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f0994106940 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0984009900 tx=0x7f098402a410 comp rx=0 tx=0).stop 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 -- 172.21.15.120:0/3380552053 shutdown_connections 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 --2- 172.21.15.120:0/3380552053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09941097e0 0x7f099410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 --2- 172.21.15.120:0/3380552053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0994106e80 0x7f09941092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 --2- 172.21.15.120:0/3380552053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f0994106940 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 -- 172.21.15.120:0/3380552053 >> 172.21.15.120:0/3380552053 conn(0x7f09940fdb20 msgr2=0x7f09940fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 -- 172.21.15.120:0/3380552053 shutdown_connections 2024-05-14T09:43:00.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.450+0000 7f0993200640 1 -- 172.21.15.120:0/3380552053 wait complete. 2024-05-14T09:43:00.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 Processor -- start 2024-05-14T09:43:00.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 -- start start 2024-05-14T09:43:00.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f099419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0994106e80 0x7f099419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09941097e0 0x7f09941a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f099410f430 con 0x7f0994104520 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f099410f2b0 con 0x7f0994106e80 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.451+0000 7f0993200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f099410f5b0 con 0x7f09941097e0 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f099419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f099419a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49554/0 (socket says 172.21.15.120:49554) 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 -- 172.21.15.120:0/4064085963 learned_addr learned my addr 172.21.15.120:0/4064085963 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991400640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0994106e80 0x7f099419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0992800640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09941097e0 0x7f09941a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 -- 172.21.15.120:0/4064085963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09941097e0 msgr2=0x7f09941a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09941097e0 0x7f09941a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 -- 172.21.15.120:0/4064085963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0994106e80 msgr2=0x7f099419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0994106e80 0x7f099419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 -- 172.21.15.120:0/4064085963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09941a1c30 con 0x7f0994104520 2024-05-14T09:43:00.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.452+0000 7f0991e00640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f099419a0f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0984005760 tx=0x7f0984003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:00.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.453+0000 7f098aa00640 1 -- 172.21.15.120:0/4064085963 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098403f070 con 0x7f0994104520 2024-05-14T09:43:00.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.453+0000 7f098aa00640 1 -- 172.21.15.120:0/4064085963 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0984031da0 con 0x7f0994104520 2024-05-14T09:43:00.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.453+0000 7f098aa00640 1 -- 172.21.15.120:0/4064085963 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984035030 con 0x7f0994104520 2024-05-14T09:43:00.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.453+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09941a1ec0 con 0x7f0994104520 2024-05-14T09:43:00.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.453+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09941a22d0 con 0x7f0994104520 2024-05-14T09:43:00.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.454+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09940ff640 con 0x7f0994104520 2024-05-14T09:43:00.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.458+0000 7f098aa00640 1 -- 172.21.15.120:0/4064085963 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f0984042070 con 0x7f0994104520 2024-05-14T09:43:00.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.459+0000 7f098aa00640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f09780b27e0 0x7f09780b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.460+0000 7f098aa00640 1 -- 172.21.15.120:0/4064085963 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f0984103710 con 0x7f0994104520 2024-05-14T09:43:00.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.460+0000 7f0991400640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f09780b27e0 0x7f09780b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.460+0000 7f0991400640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f09780b27e0 0x7f09780b4cf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f097c005fd0 tx=0x7f097c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:00.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.461+0000 7f098aa00640 1 -- 172.21.15.120:0/4064085963 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f09840cb030 con 0x7f0994104520 2024-05-14T09:43:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:00 smithi120 ceph-mon[31085]: pgmap v1139: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T09:43:00.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:00 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/3615103985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:43:00.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.670+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f099402de80 con 0x7f0994104520 2024-05-14T09:43:00.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.671+0000 7f098aa00640 1 -- 172.21.15.120:0/4064085963 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f09840ca930 con 0x7f0994104520 2024-05-14T09:43:00.672 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-05-14T09:43:00.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.674+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f09780b27e0 msgr2=0x7f09780b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.674+0000 7f0993200640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f09780b27e0 0x7f09780b4cf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f097c005fd0 tx=0x7f097c005850 comp rx=0 tx=0).stop 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.674+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 msgr2=0x7f099419a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.674+0000 7f0993200640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f099419a0f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0984005760 tx=0x7f0984003d50 comp rx=0 tx=0).stop 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 shutdown_connections 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f09780b27e0 0x7f09780b4cf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09941097e0 0x7f09941a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0994106e80 0x7f099419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 --2- 172.21.15.120:0/4064085963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0994104520 0x7f099419a0f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 >> 172.21.15.120:0/4064085963 conn(0x7f09940fdb20 msgr2=0x7f0994106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 shutdown_connections 2024-05-14T09:43:00.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.675+0000 7f0993200640 1 -- 172.21.15.120:0/4064085963 wait complete. 2024-05-14T09:43:00.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T09:43:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:00 smithi152 ceph-mon[34868]: pgmap v1139: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T09:43:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:00 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/3615103985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:43:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:00 smithi175 ceph-mon[35353]: pgmap v1139: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T09:43:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:00 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/3615103985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T09:43:00.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.983+0000 7fa3aee00640 1 -- 172.21.15.120:0/3589686736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 msgr2=0x7fa3a81123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.983+0000 7fa3aee00640 1 --2- 172.21.15.120:0/3589686736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81123d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009ca0 tx=0x7fa3a002a8c0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.984+0000 7fa3aee00640 1 -- 172.21.15.120:0/3589686736 shutdown_connections 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.984+0000 7fa3aee00640 1 --2- 172.21.15.120:0/3589686736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81123d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.984+0000 7fa3aee00640 1 --2- 172.21.15.120:0/3589686736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3a810b2b0 0x7fa3a810b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.984+0000 7fa3aee00640 1 --2- 172.21.15.120:0/3589686736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a810a070 0x7fa3a810ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.984+0000 7fa3aee00640 1 -- 172.21.15.120:0/3589686736 >> 172.21.15.120:0/3589686736 conn(0x7fa3a8078c60 msgr2=0x7fa3a8107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.984+0000 7fa3aee00640 1 -- 172.21.15.120:0/3589686736 shutdown_connections 2024-05-14T09:43:00.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.984+0000 7fa3aee00640 1 -- 172.21.15.120:0/3589686736 wait complete. 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 Processor -- start 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 -- start start 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a810a070 0x7fa3a81a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3a810b2b0 0x7fa3a81a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a8115a90 con 0x7fa3a810ffb0 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a8115910 con 0x7fa3a810a070 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.985+0000 7fa3aee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a8115c10 con 0x7fa3a810b2b0 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81a7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49580/0 (socket says 172.21.15.120:49580) 2024-05-14T09:43:00.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 -- 172.21.15.120:0/335099095 learned_addr learned my addr 172.21.15.120:0/335099095 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ada00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a810a070 0x7fa3a81a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ad000640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3a810b2b0 0x7fa3a81a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 -- 172.21.15.120:0/335099095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3a810b2b0 msgr2=0x7fa3a81a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3a810b2b0 0x7fa3a81a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 -- 172.21.15.120:0/335099095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a810a070 msgr2=0x7fa3a81a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a810a070 0x7fa3a81a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ae400640 1 -- 172.21.15.120:0/335099095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a81a81a0 con 0x7fa3a810ffb0 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.986+0000 7fa3ada00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a810a070 0x7fa3a81a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:43:00.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.987+0000 7fa3ae400640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81a7b30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00098d0 tx=0x7fa3a0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:00.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.987+0000 7fa3a6000640 1 -- 172.21.15.120:0/335099095 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0003d90 con 0x7fa3a810ffb0 2024-05-14T09:43:00.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.987+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a81a8430 con 0x7fa3a810ffb0 2024-05-14T09:43:00.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.987+0000 7fa3a6000640 1 -- 172.21.15.120:0/335099095 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3a00044d0 con 0x7fa3a810ffb0 2024-05-14T09:43:00.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.987+0000 7fa3a6000640 1 -- 172.21.15.120:0/335099095 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0030d10 con 0x7fa3a810ffb0 2024-05-14T09:43:00.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.987+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a81a8980 con 0x7fa3a810ffb0 2024-05-14T09:43:00.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.988+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a810edc0 con 0x7fa3a810ffb0 2024-05-14T09:43:00.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.991+0000 7fa3a6000640 1 -- 172.21.15.120:0/335099095 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa3a0004040 con 0x7fa3a810ffb0 2024-05-14T09:43:00.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.992+0000 7fa3a6000640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa3900b27e0 0x7fa3900b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:00.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.992+0000 7fa3a6000640 1 -- 172.21.15.120:0/335099095 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa3a0103d80 con 0x7fa3a810ffb0 2024-05-14T09:43:00.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.992+0000 7fa3ada00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa3900b27e0 0x7fa3900b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:00.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.993+0000 7fa3ada00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa3900b27e0 0x7fa3900b4cf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0058c0 tx=0x7fa39c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:00.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:00.995+0000 7fa3a6000640 1 -- 172.21.15.120:0/335099095 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa3a00cb6a0 con 0x7fa3a810ffb0 2024-05-14T09:43:01.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.201+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa3a80638d0 con 0x7fa3a810ffb0 2024-05-14T09:43:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.202+0000 7fa3a6000640 1 -- 172.21.15.120:0/335099095 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fa3a00cafa0 con 0x7fa3a810ffb0 2024-05-14T09:43:01.203 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa3900b27e0 msgr2=0x7fa3900b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa3900b27e0 0x7fa3900b4cf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0058c0 tx=0x7fa39c005850 comp rx=0 tx=0).stop 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 msgr2=0x7fa3a81a7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81a7b30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00098d0 tx=0x7fa3a0003ba0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 shutdown_connections 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa3900b27e0 0x7fa3900b4cf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a810ffb0 0x7fa3a81a7b30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3a810b2b0 0x7fa3a81a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 --2- 172.21.15.120:0/335099095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a810a070 0x7fa3a81a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 >> 172.21.15.120:0/335099095 conn(0x7fa3a8078c60 msgr2=0x7fa3a810bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:01.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 shutdown_connections 2024-05-14T09:43:01.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.205+0000 7fa3aee00640 1 -- 172.21.15.120:0/335099095 wait complete. 2024-05-14T09:43:01.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T09:43:01.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 -- 172.21.15.120:0/3240788680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e410bba0 msgr2=0x7f63e410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:01.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 --2- 172.21.15.120:0/3240788680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e410bba0 0x7f63e410dfc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009ca0 tx=0x7f63dc02a8c0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 -- 172.21.15.120:0/3240788680 shutdown_connections 2024-05-14T09:43:01.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 --2- 172.21.15.120:0/3240788680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e410bba0 0x7f63e410dfc0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 --2- 172.21.15.120:0/3240788680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e4106ea0 0x7f63e41072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 --2- 172.21.15.120:0/3240788680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e4105c60 0x7f63e4106960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 -- 172.21.15.120:0/3240788680 >> 172.21.15.120:0/3240788680 conn(0x7f63e4100e50 msgr2=0x7f63e4103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:01.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 -- 172.21.15.120:0/3240788680 shutdown_connections 2024-05-14T09:43:01.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.514+0000 7f63e8a00640 1 -- 172.21.15.120:0/3240788680 wait complete. 2024-05-14T09:43:01.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.515+0000 7f63e8a00640 1 Processor -- start 2024-05-14T09:43:01.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e8a00640 1 -- start start 2024-05-14T09:43:01.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e4105c60 0x7f63e419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:01.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e4106ea0 0x7f63e419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e8a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e410bba0 0x7f63e41a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e8a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4111690 con 0x7f63e4106ea0 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e8a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4111510 con 0x7f63e410bba0 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e8a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4111810 con 0x7f63e4105c60 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e4106ea0 0x7f63e419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e4106ea0 0x7f63e419c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49598/0 (socket says 172.21.15.120:49598) 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.516+0000 7f63e2a00640 1 -- 172.21.15.120:0/2900949432 learned_addr learned my addr 172.21.15.120:0/2900949432 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e3400640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e4105c60 0x7f63e419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e3e00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e410bba0 0x7f63e41a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e2a00640 1 -- 172.21.15.120:0/2900949432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e4105c60 msgr2=0x7f63e419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:01.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e2a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e4105c60 0x7f63e419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e2a00640 1 -- 172.21.15.120:0/2900949432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e410bba0 msgr2=0x7f63e41a36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e2a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e410bba0 0x7f63e41a36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e2a00640 1 -- 172.21.15.120:0/2900949432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e41a3d40 con 0x7f63e4106ea0 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63e2a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e4106ea0 0x7f63e419c740 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d770 tx=0x7f63d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63dbe00640 1 -- 172.21.15.120:0/2900949432 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0017070 con 0x7f63e4106ea0 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.517+0000 7f63dbe00640 1 -- 172.21.15.120:0/2900949432 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63d00054b0 con 0x7f63e4106ea0 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.518+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e41a3fd0 con 0x7f63e4106ea0 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.518+0000 7f63dbe00640 1 -- 172.21.15.120:0/2900949432 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0004c60 con 0x7f63e4106ea0 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.518+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e41a44c0 con 0x7f63e4106ea0 2024-05-14T09:43:01.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.519+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e410a9b0 con 0x7f63e4106ea0 2024-05-14T09:43:01.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.523+0000 7f63dbe00640 1 -- 172.21.15.120:0/2900949432 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f63d0004e00 con 0x7f63e4106ea0 2024-05-14T09:43:01.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.524+0000 7f63dbe00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63c80b2860 0x7f63c80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:01.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.525+0000 7f63dbe00640 1 -- 172.21.15.120:0/2900949432 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f63d00e2490 con 0x7f63e4106ea0 2024-05-14T09:43:01.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.525+0000 7f63e3400640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63c80b2860 0x7f63c80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:01.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.526+0000 7f63e3400640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63c80b2860 0x7f63c80b4d70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f63d4005fd0 tx=0x7f63d4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:01.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.527+0000 7f63dbe00640 1 -- 172.21.15.120:0/2900949432 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f63d00a9e30 con 0x7f63e4106ea0 2024-05-14T09:43:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:01 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/4064085963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:43:01.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:01 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/335099095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T09:43:01.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:01 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/4064085963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:43:01.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:01 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/335099095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T09:43:01.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:01 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/4064085963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T09:43:01.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:01 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/335099095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T09:43:01.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.736+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f63e402ddc0 con 0x7f63e4106ea0 2024-05-14T09:43:01.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.737+0000 7f63dbe00640 1 -- 172.21.15.120:0/2900949432 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f63d00a9730 con 0x7f63e4106ea0 2024-05-14T09:43:01.737 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-05-14T09:43:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.739+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63c80b2860 msgr2=0x7f63c80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.739+0000 7f63e8a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63c80b2860 0x7f63c80b4d70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f63d4005fd0 tx=0x7f63d4005850 comp rx=0 tx=0).stop 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.739+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e4106ea0 msgr2=0x7f63e419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.739+0000 7f63e8a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e4106ea0 0x7f63e419c740 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d770 tx=0x7f63d000dc30 comp rx=0 tx=0).stop 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 shutdown_connections 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f63c80b2860 0x7f63c80b4d70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63e410bba0 0x7f63e41a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63e4106ea0 0x7f63e419c740 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 --2- 172.21.15.120:0/2900949432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63e4105c60 0x7f63e419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 >> 172.21.15.120:0/2900949432 conn(0x7f63e4100e50 msgr2=0x7f63e4107b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 shutdown_connections 2024-05-14T09:43:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:01.740+0000 7f63e8a00640 1 -- 172.21.15.120:0/2900949432 wait complete. 2024-05-14T09:43:01.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-14T09:43:02.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.052+0000 7fa0e3200640 1 -- 172.21.15.120:0/2842492001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc105c60 msgr2=0x7fa0dc106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.052+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2842492001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc105c60 0x7fa0dc106960 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009900 tx=0x7fa0d002a410 comp rx=0 tx=0).stop 2024-05-14T09:43:02.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.052+0000 7fa0e3200640 1 -- 172.21.15.120:0/2842492001 shutdown_connections 2024-05-14T09:43:02.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.052+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2842492001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc10bba0 0x7fa0dc10dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.052+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2842492001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc106ea0 0x7fa0dc1072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.052+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2842492001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc105c60 0x7fa0dc106960 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.052+0000 7fa0e3200640 1 -- 172.21.15.120:0/2842492001 >> 172.21.15.120:0/2842492001 conn(0x7fa0dc100e50 msgr2=0x7fa0dc103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:02.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.053+0000 7fa0e3200640 1 -- 172.21.15.120:0/2842492001 shutdown_connections 2024-05-14T09:43:02.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.053+0000 7fa0e3200640 1 -- 172.21.15.120:0/2842492001 wait complete. 2024-05-14T09:43:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 Processor -- start 2024-05-14T09:43:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 -- start start 2024-05-14T09:43:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc105c60 0x7fa0dc19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc106ea0 0x7fa0dc19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc10bba0 0x7fa0dc1a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc1115f0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc111470 con 0x7fa0dc105c60 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc111770 con 0x7fa0dc10bba0 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc106ea0 0x7fa0dc19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc106ea0 0x7fa0dc19c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49624/0 (socket says 172.21.15.120:49624) 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.054+0000 7fa0e1400640 1 -- 172.21.15.120:0/2068397098 learned_addr learned my addr 172.21.15.120:0/2068397098 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e2800640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc10bba0 0x7fa0dc1a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e1e00640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc105c60 0x7fa0dc19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e1400640 1 -- 172.21.15.120:0/2068397098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc10bba0 msgr2=0x7fa0dc1a3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e1400640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc10bba0 0x7fa0dc1a3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e1400640 1 -- 172.21.15.120:0/2068397098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc105c60 msgr2=0x7fa0dc19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e1400640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc105c60 0x7fa0dc19c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e1400640 1 -- 172.21.15.120:0/2068397098 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc1a3df0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0e1400640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc106ea0 0x7fa0dc19c7f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800d950 tx=0x7fa0c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.055+0000 7fa0d6a00640 1 -- 172.21.15.120:0/2068397098 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8017030 con 0x7fa0dc106ea0 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.056+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc1a40e0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.056+0000 7fa0d6a00640 1 -- 172.21.15.120:0/2068397098 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c8004020 con 0x7fa0dc106ea0 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.056+0000 7fa0d6a00640 1 -- 172.21.15.120:0/2068397098 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80055d0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.056+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc1a4630 con 0x7fa0dc106ea0 2024-05-14T09:43:02.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.057+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc10a9b0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.059+0000 7fa0d6a00640 1 -- 172.21.15.120:0/2068397098 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fa0c8009a30 con 0x7fa0dc106ea0 2024-05-14T09:43:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.061+0000 7fa0d6a00640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa0c40b27e0 0x7fa0c40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.061+0000 7fa0d6a00640 1 -- 172.21.15.120:0/2068397098 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7fa0c80e2780 con 0x7fa0dc106ea0 2024-05-14T09:43:02.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.061+0000 7fa0e1e00640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa0c40b27e0 0x7fa0c40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.062+0000 7fa0e1e00640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa0c40b27e0 0x7fa0c40b4cf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00057c0 tx=0x7fa0d0005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:02.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.063+0000 7fa0d6a00640 1 -- 172.21.15.120:0/2068397098 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa0c80aa0a0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.270+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa0dc0638d0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.272+0000 7fa0d6a00640 1 -- 172.21.15.120:0/2068397098 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7fa0c80a99a0 con 0x7fa0dc106ea0 2024-05-14T09:43:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-05-14T09:43:02.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa0c40b27e0 msgr2=0x7fa0c40b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa0c40b27e0 0x7fa0c40b4cf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00057c0 tx=0x7fa0d0005720 comp rx=0 tx=0).stop 2024-05-14T09:43:02.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc106ea0 msgr2=0x7fa0dc19c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc106ea0 0x7fa0dc19c7f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800d950 tx=0x7fa0c800de10 comp rx=0 tx=0).stop 2024-05-14T09:43:02.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 shutdown_connections 2024-05-14T09:43:02.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7fa0c40b27e0 0x7fa0c40b4cf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0dc10bba0 0x7fa0dc1a3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0dc106ea0 0x7fa0dc19c7f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 --2- 172.21.15.120:0/2068397098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc105c60 0x7fa0dc19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 >> 172.21.15.120:0/2068397098 conn(0x7fa0dc100e50 msgr2=0x7fa0dc107b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:02.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 shutdown_connections 2024-05-14T09:43:02.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.275+0000 7fa0e3200640 1 -- 172.21.15.120:0/2068397098 wait complete. 2024-05-14T09:43:02.303 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-14T09:43:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.570+0000 7f882b200640 1 -- 172.21.15.120:0/2669982717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c103a60 msgr2=0x7f882c104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.570+0000 7f882b200640 1 --2- 172.21.15.120:0/2669982717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c103a60 0x7f882c104760 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f881c009ca0 tx=0x7f881c02a8c0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.571+0000 7f882b200640 1 -- 172.21.15.120:0/2669982717 shutdown_connections 2024-05-14T09:43:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.571+0000 7f882b200640 1 --2- 172.21.15.120:0/2669982717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c1099a0 0x7f882c10bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.571+0000 7f882b200640 1 --2- 172.21.15.120:0/2669982717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f882c104ca0 0x7f882c1050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.571+0000 7f882b200640 1 --2- 172.21.15.120:0/2669982717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c103a60 0x7f882c104760 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.571+0000 7f882b200640 1 -- 172.21.15.120:0/2669982717 >> 172.21.15.120:0/2669982717 conn(0x7f882c0fec50 msgr2=0x7f882c101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.571+0000 7f882b200640 1 -- 172.21.15.120:0/2669982717 shutdown_connections 2024-05-14T09:43:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.571+0000 7f882b200640 1 -- 172.21.15.120:0/2669982717 wait complete. 2024-05-14T09:43:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 Processor -- start 2024-05-14T09:43:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 -- start start 2024-05-14T09:43:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c103a60 0x7f882c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f882c104ca0 0x7f882c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c1099a0 0x7f882c1a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f882c10f460 con 0x7f882c1099a0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f882c10f2e0 con 0x7f882c103a60 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f882c10f5e0 con 0x7f882c104ca0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.572+0000 7f882a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c1099a0 0x7f882c1a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c1099a0 0x7f882c1a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49636/0 (socket says 172.21.15.120:49636) 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 -- 172.21.15.120:0/459321012 learned_addr learned my addr 172.21.15.120:0/459321012 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f8829e00640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c103a60 0x7f882c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f8821400640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f882c104ca0 0x7f882c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 -- 172.21.15.120:0/459321012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f882c104ca0 msgr2=0x7f882c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f882c104ca0 0x7f882c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 -- 172.21.15.120:0/459321012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c103a60 msgr2=0x7f882c19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c103a60 0x7f882c19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 -- 172.21.15.120:0/459321012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c1a1c00 con 0x7f882c1099a0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.573+0000 7f882a800640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c1099a0 0x7f882c1a1590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f882400c970 tx=0x7f882400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.574+0000 7f8823400640 1 -- 172.21.15.120:0/459321012 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824007bb0 con 0x7f882c1099a0 2024-05-14T09:43:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.574+0000 7f8823400640 1 -- 172.21.15.120:0/459321012 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8824007d50 con 0x7f882c1099a0 2024-05-14T09:43:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.574+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c1a1ef0 con 0x7f882c1099a0 2024-05-14T09:43:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.574+0000 7f8823400640 1 -- 172.21.15.120:0/459321012 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824004d50 con 0x7f882c1099a0 2024-05-14T09:43:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.574+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c1a2300 con 0x7f882c1099a0 2024-05-14T09:43:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.575+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c1087b0 con 0x7f882c1099a0 2024-05-14T09:43:02.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.577+0000 7f8823400640 1 -- 172.21.15.120:0/459321012 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8824004f50 con 0x7f882c1099a0 2024-05-14T09:43:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.579+0000 7f8823400640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f88100b27e0 0x7f88100b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.579+0000 7f8823400640 1 -- 172.21.15.120:0/459321012 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f88240e2730 con 0x7f882c1099a0 2024-05-14T09:43:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.579+0000 7f8829e00640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f88100b27e0 0x7f88100b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:02.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.580+0000 7f8829e00640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f88100b27e0 0x7f88100b4cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f881c006010 tx=0x7f881c0318e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:02.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.581+0000 7f8823400640 1 -- 172.21.15.120:0/459321012 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8824014030 con 0x7f882c1099a0 2024-05-14T09:43:02.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:02 smithi120 ceph-mon[31085]: pgmap v1140: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 27 op/s 2024-05-14T09:43:02.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:02 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2900949432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T09:43:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:02 smithi152 ceph-mon[34868]: pgmap v1140: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 27 op/s 2024-05-14T09:43:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:02 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2900949432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T09:43:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:02 smithi175 ceph-mon[35353]: pgmap v1140: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 27 op/s 2024-05-14T09:43:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:02 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2900949432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T09:43:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.842+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f882c02de80 con 0x7f882c1099a0 2024-05-14T09:43:02.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.861+0000 7f8823400640 1 -- 172.21.15.120:0/459321012 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+815645 (secure 0 0 0) 0x7f88240aa050 con 0x7f882c1099a0 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 18, 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "active_gid": 14152, 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "active_name": "x", 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addrs": { 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-05-14T09:43:02.875 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 197404993 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 197404993 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addr": "172.21.15.120:6801/197404993", 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "active_change": "2024-05-14T09:07:40.065942+0000", 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "active_mgr_features": 4540701547738038271, 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "available": true, 2024-05-14T09:43:02.876 INFO:teuthology.orchestra.run.smithi120.stdout: "standbys": [ 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 24112, 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "z", 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_features": 4540701547738038271, 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.877 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.879 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.880 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.881 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.882 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.883 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.884 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2024-05-14T09:43:02.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2024-05-14T09:43:02.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.889 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:02.890 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2024-05-14T09:43:02.891 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.892 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.893 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.894 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T09:43:02.895 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2024-05-14T09:43:02.896 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2359", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T09:43:02.897 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T09:43:02.898 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.899 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.900 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.901 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.903 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-05-14T09:43:02.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "upmap", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "read", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap-read" 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.906 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2024-05-14T09:43:02.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_optimizations": { 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_optimizations", 2024-05-14T09:43:02.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.910 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_down_multiplier": { 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_down_multiplier", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_refresh_rate": { 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_refresh_rate", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "20", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_starting_port": { 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_starting_port", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4721", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_ptrace": { 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_ptrace", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.914 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_interval": { 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_interval", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_memory_target_ratio": { 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T09:43:02.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.7", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm_log_destination": { 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm_log_destination", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "file", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "file,syslog", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "syslog" 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "cgroups_split": { 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cgroups_split", 2024-05-14T09:43:02.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "config_checks_enabled": { 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_checks_enabled", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.918 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "config_dashboard": { 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_dashboard", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.919 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_alertmanager": { 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_alertmanager", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T09:43:02.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_base": { 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_base", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Container image name, without the tag", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_elasticsearch": { 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_elasticsearch", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.922 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "elasticsearch container image", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_grafana": { 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_grafana", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_haproxy": { 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_haproxy", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "HAproxy container image", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.924 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_agent": { 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_agent", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger agent container image", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_collector": { 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_collector", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger collector container image", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_query": { 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_query", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger query container image", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_keepalived": { 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_keepalived", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Keepalived container image", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_loki": { 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_loki", 2024-05-14T09:43:02.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Loki container image", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_node_exporter": { 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_node_exporter", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.929 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_nvmeof": { 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_nvmeof", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.930 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Nvme-of container image", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_prometheus": { 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_prometheus", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_promtail": { 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_promtail", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.932 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Promtail container image", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_samba": { 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_samba", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.933 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Samba/SMB container image", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_snmp_gateway": { 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_snmp_gateway", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.934 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SNMP Gateway container image", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "container_init": { 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_init", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.935 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "daemon_cache_timeout": { 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "daemon_cache_timeout", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.936 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "default_cephadm_command_timeout": { 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "900", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.937 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "default_registry": { 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_registry", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.938 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "device_cache_timeout": { 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_cache_timeout", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1800", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache device inventory", 2024-05-14T09:43:02.939 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "device_enhanced_scan": { 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_enhanced_scan", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.940 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "facts_cache_timeout": { 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "facts_cache_timeout", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache host facts data", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "grafana_dashboards_path": { 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "grafana_dashboards_path", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "host_check_interval": { 2024-05-14T09:43:02.942 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "host_check_interval", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to perform a host check", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "hw_monitoring": { 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hw_monitoring", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.943 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_list_all": { 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_list_all", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.944 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.945 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.946 INFO:teuthology.orchestra.run.smithi120.stdout: "log_refresh_metadata": { 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_refresh_metadata", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T09:43:02.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "*", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "max_count_per_host": { 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_count_per_host", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of daemons per service per host", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd_draining_count": { 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_osd_draining_count", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.953 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "migration_current": { 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "migration_current", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.954 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "internal - do not modify", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "root", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.955 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm-package", 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "root" 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "oob_default_addr": { 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "oob_default_addr", 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.956 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "169.254.1.1", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "prometheus_alerts_path": { 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus_alerts_path", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.957 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_insecure": { 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_insecure", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.958 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_password": { 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_password", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.959 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_url": { 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_url", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T09:43:02.960 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_username": { 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_username", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.961 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "secure_monitoring_stack": { 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secure_monitoring_stack", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "service_discovery_port": { 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "service_discovery_port", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8765", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "cephadm service discovery port", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:02.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "use_agent": { 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_agent", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.965 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "use_repo_digest": { 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_repo_digest", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.966 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_failed_host_check": { 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_failed_host_check", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.967 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_daemons": { 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_daemons", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T09:43:02.968 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_hosts": { 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_hosts", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.970 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.971 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:02.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.973 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.974 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.975 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2024-05-14T09:43:02.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.979 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.980 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T09:43:02.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.982 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.983 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.984 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.985 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.986 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.990 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T09:43:02.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2024-05-14T09:43:02.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T09:43:02.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T09:43:02.994 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T09:43:02.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T09:43:02.996 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.997 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.998 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "[]", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "{}", 2024-05-14T09:43:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.000 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.001 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.002 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.003 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.004 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.006 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.007 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T09:43:03.009 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.010 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.012 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.013 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.014 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.015 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.017 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.019 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.020 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "cross_origin_url": { 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cross_origin_url", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.021 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2024-05-14T09:43:03.022 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2024-05-14T09:43:03.023 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-05-14T09:43:03.024 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.025 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.026 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.027 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.028 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "motd": { 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "motd", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "The message of the day", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect_resolve_ip_addr": { 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.031 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.032 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.033 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.034 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.035 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.036 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.038 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2024-05-14T09:43:03.039 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2024-05-14T09:43:03.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.039 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.039 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.039 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.039 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.041 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.041 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.041 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.042 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.043 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.044 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.045 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2024-05-14T09:43:03.048 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.049 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.051 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.052 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.053 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.054 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.055 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.056 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.058 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.060 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "predictor_model": { 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predictor_model", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "prophetstor", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.061 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2024-05-14T09:43:03.063 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2024-05-14T09:43:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server hostname", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "5", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.070 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.071 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.072 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "password of InfluxDB server user", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.073 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server port", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.074 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.075 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "32", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "username of InfluxDB server user", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.078 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.079 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.080 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.081 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.082 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.085 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.086 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.087 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.089 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "k8sevents", 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_event_retention_days": { 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ceph_event_retention_days", 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.091 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "config_check_secs": { 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_check_secs", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "10", 2024-05-14T09:43:03.092 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.093 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.094 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.095 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.096 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.098 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.101 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.103 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.104 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.105 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.107 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.109 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.110 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mds_autoscaler", 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.111 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.112 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.113 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.114 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.115 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.116 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirroring", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.118 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.120 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.121 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.123 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "nfs", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.124 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.125 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.126 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.128 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.129 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "fail_fs": { 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "fail_fs", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.132 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.133 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "rook", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "test_orchestrator" 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Orchestrator backend", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_perf_query", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.138 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.139 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.141 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.142 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_support", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.144 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.145 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.146 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.148 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.149 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.150 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.151 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.152 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.154 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "threshold": { 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threshold", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.156 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1.0", 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "scaling threshold", 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.157 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_pg_recovery_event": { 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_pg_recovery_event", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.158 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.160 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.161 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.162 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.165 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long the module is going to sleep", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.166 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "cache": { 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cache", 2024-05-14T09:43:03.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "exclude_perf_counters": { 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "exclude_perf_counters", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.169 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.172 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.173 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.174 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15.0", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:03.176 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.177 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "9283", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.178 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "log", 2024-05-14T09:43:03.179 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "default", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "default", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "error" 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-05-14T09:43:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.182 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.183 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.184 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.185 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.186 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_snap_create": { 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_snap_create", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.187 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "mirror_snapshot_schedule": { 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.188 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "trash_purge_schedule": { 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "trash_purge_schedule", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_auth": { 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_auth", 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.191 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.192 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.193 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.194 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.195 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.196 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:03.197 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:03.198 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.199 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rgw", 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.200 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.201 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.202 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.203 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.204 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.205 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2024-05-14T09:43:03.206 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.207 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.208 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.210 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "storage_class": { 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "storage_class", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "local", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.213 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.215 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.216 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.217 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.218 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.219 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.220 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.221 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.222 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.223 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.224 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.225 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption7": { 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption7", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "42", 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.226 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.228 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smb", 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.231 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.233 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.234 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "update_orchestration": { 2024-05-14T09:43:03.236 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "update_orchestration", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_m_granularity": { 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_m_granularity", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.238 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "dump_on_update": { 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dump_on_update", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.239 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "dump database to debug log on update", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.240 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.241 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.242 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.244 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.245 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stats", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.246 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.248 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.249 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.250 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.252 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.253 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.254 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.255 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.257 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.258 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.260 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.261 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.262 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.263 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.264 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.265 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2024-05-14T09:43:03.266 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.267 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.268 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_perf": { 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_perf", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.269 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.270 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.272 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2024-05-14T09:43:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.275 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard_description": { 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard_description", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.276 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.277 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.278 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2024-05-14T09:43:03.282 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.283 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.285 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.286 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.287 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.288 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.289 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.291 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.292 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.293 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.294 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.295 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2024-05-14T09:43:03.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "periodic_async_work": { 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "periodic_async_work", 2024-05-14T09:43:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Periodically check for async work", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_delay": { 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_delay", 2024-05-14T09:43:03.298 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_no_wait": { 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.299 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.300 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.301 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "discovery_interval": { 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "discovery_interval", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "100", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.302 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.303 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.304 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.305 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.306 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.308 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.309 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.310 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.311 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.312 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 34112, 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "y", 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_features": 4540701547738038271, 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.313 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T09:43:03.314 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.315 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.316 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.317 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.318 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2024-05-14T09:43:03.319 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2024-05-14T09:43:03.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.321 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.322 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.323 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.325 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.326 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2024-05-14T09:43:03.328 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.329 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.330 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.331 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.332 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.333 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2359", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T09:43:03.334 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.335 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.336 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.337 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.338 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.339 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "upmap", 2024-05-14T09:43:03.341 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "read", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap-read" 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2024-05-14T09:43:03.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.343 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.345 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_optimizations": { 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_optimizations", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.346 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm", 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_down_multiplier": { 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_down_multiplier", 2024-05-14T09:43:03.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_refresh_rate": { 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_refresh_rate", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.348 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "20", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_starting_port": { 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_starting_port", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4721", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_ptrace": { 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_ptrace", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.350 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_interval": { 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_interval", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.351 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_memory_target_ratio": { 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.7", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.352 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm_log_destination": { 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm_log_destination", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "file", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "file,syslog", 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: "syslog" 2024-05-14T09:43:03.353 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "cgroups_split": { 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cgroups_split", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.354 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "config_checks_enabled": { 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_checks_enabled", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.355 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "config_dashboard": { 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_dashboard", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.356 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_alertmanager": { 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_alertmanager", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_base": { 2024-05-14T09:43:03.357 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_base", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Container image name, without the tag", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_elasticsearch": { 2024-05-14T09:43:03.358 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_elasticsearch", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "elasticsearch container image", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_grafana": { 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_grafana", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.359 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_haproxy": { 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_haproxy", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "HAproxy container image", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_agent": { 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_agent", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T09:43:03.361 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger agent container image", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_collector": { 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_collector", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.362 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger collector container image", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_query": { 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_query", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.363 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger query container image", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_keepalived": { 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_keepalived", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Keepalived container image", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_loki": { 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_loki", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Loki container image", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_node_exporter": { 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_node_exporter", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.366 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_nvmeof": { 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_nvmeof", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Nvme-of container image", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_prometheus": { 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_prometheus", 2024-05-14T09:43:03.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_promtail": { 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_promtail", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Promtail container image", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_samba": { 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_samba", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.369 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Samba/SMB container image", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_snmp_gateway": { 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_snmp_gateway", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T09:43:03.370 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SNMP Gateway container image", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "container_init": { 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_init", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.371 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "daemon_cache_timeout": { 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "daemon_cache_timeout", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.372 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "default_cephadm_command_timeout": { 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "900", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T09:43:03.373 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "default_registry": { 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_registry", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T09:43:03.374 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "device_cache_timeout": { 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_cache_timeout", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1800", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache device inventory", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.375 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "device_enhanced_scan": { 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_enhanced_scan", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.376 INFO:teuthology.orchestra.run.smithi120.stdout: "facts_cache_timeout": { 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "facts_cache_timeout", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache host facts data", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "grafana_dashboards_path": { 2024-05-14T09:43:03.377 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "grafana_dashboards_path", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "host_check_interval": { 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "host_check_interval", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.378 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to perform a host check", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "hw_monitoring": { 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hw_monitoring", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.379 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_list_all": { 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_list_all", 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.380 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.382 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "log_refresh_metadata": { 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_refresh_metadata", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.384 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.386 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T09:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T09:43:03.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "*", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "max_count_per_host": { 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_count_per_host", 2024-05-14T09:43:03.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of daemons per service per host", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd_draining_count": { 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_osd_draining_count", 2024-05-14T09:43:03.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "migration_current": { 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "migration_current", 2024-05-14T09:43:03.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "internal - do not modify", 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-05-14T09:43:03.392 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "root", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm-package", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "root" 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "oob_default_addr": { 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "oob_default_addr", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "169.254.1.1", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "prometheus_alerts_path": { 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus_alerts_path", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_insecure": { 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_insecure", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.396 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_password": { 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_password", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.397 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_url": { 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_url", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_username": { 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_username", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "secure_monitoring_stack": { 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secure_monitoring_stack", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: "service_discovery_port": { 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "service_discovery_port", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8765", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "cephadm service discovery port", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2024-05-14T09:43:03.402 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "use_agent": { 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_agent", 2024-05-14T09:43:03.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "use_repo_digest": { 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_repo_digest", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.404 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_failed_host_check": { 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_failed_host_check", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.405 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_daemons": { 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_daemons", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_hosts": { 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_hosts", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.407 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.408 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.409 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.410 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.411 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.412 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2024-05-14T09:43:03.413 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.414 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.416 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.420 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T09:43:03.421 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T09:43:03.422 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.423 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T09:43:03.424 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.425 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.427 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.428 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.429 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.430 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.431 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.432 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.433 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.434 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.435 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.436 INFO:teuthology.orchestra.run.smithi120.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.437 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "[]", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.438 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "{}", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.440 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.441 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.442 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.443 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.444 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.445 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.446 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T09:43:03.448 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.449 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2024-05-14T09:43:03.451 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.452 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.453 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.454 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.456 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.457 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.458 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "cross_origin_url": { 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cross_origin_url", 2024-05-14T09:43:03.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2024-05-14T09:43:03.462 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.463 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.464 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.465 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "motd": { 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "motd", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "The message of the day", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect_resolve_ip_addr": { 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-05-14T09:43:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2024-05-14T09:43:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2024-05-14T09:43:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2024-05-14T09:43:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2024-05-14T09:43:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-05-14T09:43:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2024-05-14T09:43:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "predictor_model": { 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predictor_model", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "prophetstor", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2024-05-14T09:43:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server hostname", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "5", 2024-05-14T09:43:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "password of InfluxDB server user", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2024-05-14T09:43:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server port", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2024-05-14T09:43:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "32", 2024-05-14T09:43:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "username of InfluxDB server user", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "k8sevents", 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_event_retention_days": { 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ceph_event_retention_days", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "config_check_secs": { 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_check_secs", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "10", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2024-05-14T09:43:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2024-05-14T09:43:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2024-05-14T09:43:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mds_autoscaler", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirroring", 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.552 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.553 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.554 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.555 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.557 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "nfs", 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.558 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.559 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.560 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.561 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.562 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.563 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "fail_fs": { 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "fail_fs", 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.564 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.565 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.566 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.567 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.568 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.569 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "rook", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "test_orchestrator" 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Orchestrator backend", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.571 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_perf_query", 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.572 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.573 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.575 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.576 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_support", 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.578 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.580 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.581 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.583 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.584 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.585 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.586 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.587 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.588 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "threshold": { 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threshold", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1.0", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "scaling threshold", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.591 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_pg_recovery_event": { 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_pg_recovery_event", 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.592 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.593 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.594 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.595 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.597 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.598 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2024-05-14T09:43:03.599 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long the module is going to sleep", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "cache": { 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cache", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "exclude_perf_counters": { 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "exclude_perf_counters", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T09:43:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2024-05-14T09:43:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15.0", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "9283", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "log", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "default", 2024-05-14T09:43:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "default", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "error" 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_snap_create": { 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_snap_create", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "mirror_snapshot_schedule": { 2024-05-14T09:43:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "trash_purge_schedule": { 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "trash_purge_schedule", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_auth": { 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_auth", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-05-14T09:43:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rgw", 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "storage_class": { 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "storage_class", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "local", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2024-05-14T09:43:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption7": { 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption7", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "42", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2024-05-14T09:43:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smb", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "update_orchestration": { 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "update_orchestration", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_m_granularity": { 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_m_granularity", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "dump_on_update": { 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dump_on_update", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "dump database to debug log on update", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.679 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stats", 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2024-05-14T09:43:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_perf": { 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_perf", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard_description": { 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard_description", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2024-05-14T09:43:03.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.718 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.719 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.720 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.721 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.722 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.723 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.724 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.725 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.726 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.727 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.728 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.729 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.730 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2024-05-14T09:43:03.732 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "periodic_async_work": { 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "periodic_async_work", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.733 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Periodically check for async work", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_delay": { 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_delay", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.734 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_no_wait": { 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.735 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.736 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "discovery_interval": { 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "discovery_interval", 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "100", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.738 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.739 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.741 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.742 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.743 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.744 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2024-05-14T09:43:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2024-05-14T09:43:03.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.747 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.748 INFO:teuthology.orchestra.run.smithi120.stdout: "modules": [ 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "dashboard", 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "iostat", 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "nfs", 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "restful" 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.749 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.751 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.753 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.754 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2024-05-14T09:43:03.756 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.757 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.759 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.760 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.761 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.762 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.763 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2024-05-14T09:43:03.764 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-05-14T09:43:03.765 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T09:43:03.766 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.767 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.768 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2359", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.769 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.773 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.774 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.775 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "upmap", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2024-05-14T09:43:03.776 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "read", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap-read" 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.777 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.779 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.780 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_optimizations": { 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_optimizations", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.781 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm", 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_down_multiplier": { 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_down_multiplier", 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.782 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_refresh_rate": { 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_refresh_rate", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.783 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "20", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_starting_port": { 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_starting_port", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4721", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.784 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_ptrace": { 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_ptrace", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.785 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_interval": { 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_interval", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T09:43:03.786 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_memory_target_ratio": { 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.7", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm_log_destination": { 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm_log_destination", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "file", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "file,syslog", 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "syslog" 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.788 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "cgroups_split": { 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cgroups_split", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.789 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "config_checks_enabled": { 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_checks_enabled", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.790 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "config_dashboard": { 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_dashboard", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_alertmanager": { 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_alertmanager", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_base": { 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_base", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Container image name, without the tag", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_elasticsearch": { 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_elasticsearch", 2024-05-14T09:43:03.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "elasticsearch container image", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_grafana": { 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_grafana", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.794 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_haproxy": { 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_haproxy", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.795 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "HAproxy container image", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_agent": { 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_agent", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger agent container image", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_collector": { 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_collector", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.797 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger collector container image", 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_query": { 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_query", 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T09:43:03.798 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger query container image", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_keepalived": { 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_keepalived", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.799 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Keepalived container image", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_loki": { 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_loki", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.800 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Loki container image", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_node_exporter": { 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_node_exporter", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_nvmeof": { 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_nvmeof", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Nvme-of container image", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.802 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_prometheus": { 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_prometheus", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_promtail": { 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_promtail", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Promtail container image", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.804 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_samba": { 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_samba", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Samba/SMB container image", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_snmp_gateway": { 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_snmp_gateway", 2024-05-14T09:43:03.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SNMP Gateway container image", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "container_init": { 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_init", 2024-05-14T09:43:03.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "daemon_cache_timeout": { 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "daemon_cache_timeout", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.807 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "default_cephadm_command_timeout": { 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "900", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "default_registry": { 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_registry", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io", 2024-05-14T09:43:03.809 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "device_cache_timeout": { 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_cache_timeout", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1800", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.810 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache device inventory", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "device_enhanced_scan": { 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_enhanced_scan", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T09:43:03.811 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "facts_cache_timeout": { 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "facts_cache_timeout", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache host facts data", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.812 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "grafana_dashboards_path": { 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "grafana_dashboards_path", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "host_check_interval": { 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "host_check_interval", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to perform a host check", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "hw_monitoring": { 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hw_monitoring", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_list_all": { 2024-05-14T09:43:03.815 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_list_all", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "log_refresh_metadata": { 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_refresh_metadata", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.819 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.820 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.821 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.822 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "*", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T09:43:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "max_count_per_host": { 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_count_per_host", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of daemons per service per host", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.824 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd_draining_count": { 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_osd_draining_count", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "migration_current": { 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "migration_current", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "internal - do not modify", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "root", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm-package", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "root" 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T09:43:03.827 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "oob_default_addr": { 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "oob_default_addr", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "169.254.1.1", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "prometheus_alerts_path": { 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus_alerts_path", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_insecure": { 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_insecure", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.830 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_password": { 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_password", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_url": { 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_url", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_username": { 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_username", 2024-05-14T09:43:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "secure_monitoring_stack": { 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secure_monitoring_stack", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "service_discovery_port": { 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "service_discovery_port", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.834 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8765", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "cephadm service discovery port", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.835 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.836 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "use_agent": { 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_agent", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.837 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "use_repo_digest": { 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_repo_digest", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T09:43:03.838 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_failed_host_check": { 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_failed_host_check", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_daemons": { 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_daemons", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.840 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_hosts": { 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_hosts", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.842 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.844 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.845 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.847 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T09:43:03.851 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.852 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.853 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.854 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.855 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.856 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T09:43:03.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.860 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.861 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.863 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.864 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.865 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.867 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T09:43:03.868 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.869 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "[]", 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T09:43:03.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "{}", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T09:43:03.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.873 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.874 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.878 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T09:43:03.879 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.880 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.881 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.882 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.883 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.884 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.885 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T09:43:03.887 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.888 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.889 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "cross_origin_url": { 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cross_origin_url", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.891 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.892 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.894 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.896 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.897 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.898 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.899 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "motd": { 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "motd", 2024-05-14T09:43:03.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "The message of the day", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect_resolve_ip_addr": { 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.901 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.903 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.904 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.905 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.906 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.907 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-05-14T09:43:03.908 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.909 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2024-05-14T09:43:03.910 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.911 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.913 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.914 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.915 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.916 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.917 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2024-05-14T09:43:03.919 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2024-05-14T09:43:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.923 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.924 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.925 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.926 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.927 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2024-05-14T09:43:03.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "predictor_model": { 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predictor_model", 2024-05-14T09:43:03.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "prophetstor", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.930 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2024-05-14T09:43:03.932 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server hostname", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:03.935 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "5", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.936 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.939 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.940 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "password of InfluxDB server user", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server port", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.942 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-05-14T09:43:03.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "32", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.945 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "username of InfluxDB server user", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.946 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.947 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.948 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.949 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.950 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.951 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.952 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.953 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.956 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.958 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "k8sevents", 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_event_retention_days": { 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ceph_event_retention_days", 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "config_check_secs": { 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_check_secs", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "10", 2024-05-14T09:43:03.960 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.961 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.963 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.964 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.965 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.966 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.967 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.968 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.969 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.971 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.972 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.973 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2024-05-14T09:43:03.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.978 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mds_autoscaler", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.979 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.980 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirroring", 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.984 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.985 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.986 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.987 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.988 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.989 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "nfs", 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.990 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.991 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.992 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.993 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.994 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.995 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "fail_fs": { 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "fail_fs", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.997 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:03.998 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:03.999 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.000 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.001 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "rook", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "test_orchestrator" 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Orchestrator backend", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_perf_query", 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.005 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.006 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.007 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.008 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_support", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.011 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.012 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.013 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.014 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.015 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.017 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.019 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "threshold": { 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threshold", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1.0", 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "scaling threshold", 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.024 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_pg_recovery_event": { 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_pg_recovery_event", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.025 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.026 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.027 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.028 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.029 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.031 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long the module is going to sleep", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.033 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.034 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "cache": { 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cache", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.035 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "exclude_perf_counters": { 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "exclude_perf_counters", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.036 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.037 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.039 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.040 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.041 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.043 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15.0", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-05-14T09:43:04.044 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "9283", 2024-05-14T09:43:04.045 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.046 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "log", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.047 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "default", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "default", 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: "error" 2024-05-14T09:43:04.048 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.049 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.051 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.052 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.053 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.054 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_snap_create": { 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_snap_create", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "mirror_snapshot_schedule": { 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.056 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.057 INFO:teuthology.orchestra.run.smithi120.stdout: "trash_purge_schedule": { 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "trash_purge_schedule", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_auth": { 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_auth", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.060 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.061 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.062 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.063 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.064 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-05-14T09:43:04.065 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-05-14T09:43:04.066 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.067 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rgw", 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.069 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.070 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.071 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.072 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.073 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.076 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.078 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.079 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.080 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "storage_class": { 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "storage_class", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.081 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "local", 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.082 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.084 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.085 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.086 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.087 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.088 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2024-05-14T09:43:04.089 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.090 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.091 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2024-05-14T09:43:04.092 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2024-05-14T09:43:04.093 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.094 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption7": { 2024-05-14T09:43:04.095 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption7", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "42", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.096 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2024-05-14T09:43:04.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2024-05-14T09:43:04.098 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2024-05-14T09:43:04.099 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.100 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smb", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.101 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.104 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.105 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.106 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "update_orchestration": { 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "update_orchestration", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.107 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_m_granularity": { 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_m_granularity", 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.108 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "dump_on_update": { 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dump_on_update", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.109 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "dump database to debug log on update", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.110 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.111 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.112 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.114 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stats", 2024-05-14T09:43:04.115 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.116 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.117 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.118 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.119 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.122 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.123 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.124 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.125 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2024-05-14T09:43:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.128 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.130 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.131 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.132 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.133 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.134 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2024-05-14T09:43:04.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.136 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.137 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_perf": { 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_perf", 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.139 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.140 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.141 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.142 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-05-14T09:43:04.144 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.145 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.147 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard_description": { 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard_description", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.148 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.149 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.150 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.152 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.153 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.154 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.155 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.157 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.160 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.161 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.162 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.163 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.164 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.166 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.167 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.169 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "periodic_async_work": { 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "periodic_async_work", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.170 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Periodically check for async work", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_delay": { 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_delay", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.171 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_no_wait": { 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.172 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "discovery_interval": { 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "discovery_interval", 2024-05-14T09:43:04.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "100", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-05-14T09:43:04.176 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.177 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-05-14T09:43:04.178 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-05-14T09:43:04.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.180 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.181 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "sqlite3_killpoint": { 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sqlite3_killpoint", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "dev", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.182 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "services": { 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "dashboard": "https://172.21.15.120:8443/" 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "always_on_modules": { 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "octopus": [ 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-05-14T09:43:04.186 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "pacific": [ 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-05-14T09:43:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "quincy": [ 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.188 INFO:teuthology.orchestra.run.smithi120.stdout: "reef": [ 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "squid": [ 2024-05-14T09:43:04.189 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "last_failure_osd_epoch": 3, 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: "active_clients": [ 2024-05-14T09:43:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1314222723 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "libcephsqlite", 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-05-14T09:43:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 616357660 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 137027080 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.192 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 204536492 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-05-14T09:43:04.193 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:43:04.194 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:03 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2068397098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T09:43:04.194 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:03 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:04.194 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:03 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/459321012' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T09:43:04.194 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:03 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2068397098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T09:43:04.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:03 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:04.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:03 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/459321012' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f88100b27e0 msgr2=0x7f88100b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f88100b27e0 0x7f88100b4cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f881c006010 tx=0x7f881c0318e0 comp rx=0 tx=0).stop 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c1099a0 msgr2=0x7f882c1a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c1099a0 0x7f882c1a1590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f882400c970 tx=0x7f882400ce30 comp rx=0 tx=0).stop 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 shutdown_connections 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f88100b27e0 0x7f88100b4cf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f882c1099a0 0x7f882c1a1590 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f882c104ca0 0x7f882c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 --2- 172.21.15.120:0/459321012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c103a60 0x7f882c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 >> 172.21.15.120:0/459321012 conn(0x7f882c0fec50 msgr2=0x7f882c105980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 shutdown_connections 2024-05-14T09:43:04.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:02.876+0000 7f882b200640 1 -- 172.21.15.120:0/459321012 wait complete. 2024-05-14T09:43:04.204 DEBUG:tasks.check_counter:Getting stats from a 2024-05-14T09:43:04.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-14T09:43:04.204 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:03 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2068397098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T09:43:04.204 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:03 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:04.204 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:03 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/459321012' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T09:43:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:04 smithi120 ceph-mon[31085]: pgmap v1141: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-05-14T09:43:04.662 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:43:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:04 smithi152 ceph-mon[34868]: pgmap v1141: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-05-14T09:43:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:04 smithi175 ceph-mon[35353]: pgmap v1141: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-05-14T09:43:06.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:06 smithi120 ceph-mon[31085]: pgmap v1142: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-05-14T09:43:06.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:06 smithi152 ceph-mon[34868]: pgmap v1142: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-05-14T09:43:06.730 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:06 smithi175 ceph-mon[35353]: pgmap v1142: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-05-14T09:43:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 2727, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 2727, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 799795, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 866363, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 6, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 2, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.556229116, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.168692053, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.122233847, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.207537921, 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:07.211 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 2726, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.399333671, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000146490 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 2146, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 2095, 2024-05-14T09:43:07.212 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 4831639, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 786933, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 5, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 3, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.476063483, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.162856075, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.148373502, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.130469589, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 2094, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.296409470, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000141551 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.213 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 909760, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 252000 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 5, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 313, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 1668, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 690373, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 8, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 4, 2024-05-14T09:43:07.214 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.067966945, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.054468268, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.007804368, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000074763, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 311, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.067913002, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000218369 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-14T09:43:07.215 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 689408 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 1, 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "finisher-MDSRank": { 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "queue_len": 0, 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "complete_latency": { 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 7147, 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.416171369, 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000058230 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:07.216 INFO:teuthology.orchestra.run.smithi120.stdout: "queue_len": 0, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "complete_latency": { 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": { 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "request": 0, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "reply": 0, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "reply_latency": { 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "slow_reply": 0, 2024-05-14T09:43:07.217 INFO:teuthology.orchestra.run.smithi120.stdout: "forward": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_commit": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_split": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_merge": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes": 466, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_top": 75, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_bottom": 391, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_pin_tail": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_pinned": 358, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_expired": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_with_caps": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": 0, 2024-05-14T09:43:07.218 INFO:teuthology.orchestra.run.smithi120.stdout: "subtrees": 8, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_hit": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_forward": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_discover": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_lock": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "load_cent": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "q": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "exported": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "exported_inodes": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "imported": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "imported_inodes": 0, 2024-05-14T09:43:07.219 INFO:teuthology.orchestra.run.smithi120.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "openino_backtrace_fetch": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "root_rfiles": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "root_rbytes": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "root_rsnaps": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_dir_inodes": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_file_inodes": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T09:43:07.220 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_grant": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_caps": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_caps_dirty": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_cap_release": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "process_request_cap_release": 0 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache": { 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_update": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_try_discover": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_send_discover": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_handle_discover": 0, 2024-05-14T09:43:07.221 INFO:teuthology.orchestra.run.smithi120.stdout: "num_strays": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_created": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_enqueued": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_migrated": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_started": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_completed": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:07.222 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_exportdir": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_flush": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_inodestats": 0 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log": { 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "evlrg": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "evadd": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "evex": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "evtrm": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ev": 2962, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "evexg": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "evexd": 0, 2024-05-14T09:43:07.223 INFO:teuthology.orchestra.run.smithi120.stdout: "segadd": 0, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "segex": 0, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "segtrm": 0, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "seg": 4, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "segmjr": 2, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "segexg": 0, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "segexd": 0, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "expos": 4194304, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "wrpos": 7679771, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "rdpos": 7679197, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "jlat": { 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "replayed": 2962 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.224 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_mem": { 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 193, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "ino+": 509, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "ino-": 316, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "dir": 18, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "dir+": 21, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "dir-": 3, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "dn": 466, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "dn+": 556, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "dn-": 90, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "cap": 0, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "cap+": 0, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "cap-": 0, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "rss": 120744, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "heap": 215440 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.225 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_server": { 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "dispatch_client_request": 0, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "dispatch_server_request": 0, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_request": 0, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_session": 0, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_peer_request": 0, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "req_create_latency": { 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "req_getattr_latency": { 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.226 INFO:teuthology.orchestra.run.smithi120.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "req_link_latency": { 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookup_latency": { 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.227 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupino_latency": { 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupname_latency": { 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.228 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lssnap_latency": { 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.229 INFO:teuthology.orchestra.run.smithi120.stdout: "req_mkdir_latency": { 2024-05-14T09:43:07.230 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.230 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.230 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.230 INFO:teuthology.orchestra.run.smithi120.stdout: "req_mknod_latency": { 2024-05-14T09:43:07.230 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.230 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "req_mksnap_latency": { 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "req_open_latency": { 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "req_readdir_latency": { 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.231 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rename_latency": { 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.232 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rmdir_latency": { 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.233 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setattr_latency": { 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setlayout_latency": { 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setxattr_latency": { 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "req_symlink_latency": { 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.235 INFO:teuthology.orchestra.run.smithi120.stdout: "req_unlink_latency": { 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.236 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_sessions": { 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "session_count": 1, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "session_add": 2, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "session_remove": 1, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "sessions_open": 1, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "sessions_stale": 0, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "total_load": 0, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "average_load": 0, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "avg_session_uptime": 2891, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:07.237 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:07.238 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:07.239 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 198281, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 58, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 172, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:07.240 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 758095, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 2530, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter": { 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "op_active": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "op_laggy": 0, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "op_send": 4408, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "op_send_bytes": 21, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "op_resend": 3, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "op_reply": 4408, 2024-05-14T09:43:07.241 INFO:teuthology.orchestra.run.smithi120.stdout: "op_latency": { 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 4408, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 7.587825726, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.001721376 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "op_inflight": 0, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "oplen_avg": { 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 4408, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 4409 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "op": 4408, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "op_r": 4408, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "op_w": 0, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "op_rmw": 0, 2024-05-14T09:43:07.242 INFO:teuthology.orchestra.run.smithi120.stdout: "op_pg": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_stat": 2722, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_create": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_read": 1684, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_write": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_writefull": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_writesame": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_append": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_zero": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_truncate": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_delete": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_mapext": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:07.243 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_getxattr": 1, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_setxattr": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_call": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_watch": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_notify": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_pgls": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_other": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_active": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_send": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_resend": 0, 2024-05-14T09:43:07.244 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_ping": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "poolop_active": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "poolop_send": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "poolop_resend": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "poolstat_active": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "poolstat_send": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "poolstat_resend": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "statfs_active": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "statfs_send": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "statfs_resend": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "command_active": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "command_send": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "command_resend": 0, 2024-05-14T09:43:07.245 INFO:teuthology.orchestra.run.smithi120.stdout: "map_epoch": 90, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "map_full": 0, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "map_inc": 2, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_sessions": 6, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_session_open": 9, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_session_close": 3, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_laggy": 0, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_wr": 0, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_rd": 2, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_del": 0 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "oft": { 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_objs": 0, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_updates": 0, 2024-05-14T09:43:07.246 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_removes": 0 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "osd-slow-ops": { 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "slow_ops_count": 0 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "purge_queue": { 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing": 0, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing_high_water": 0, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executed_ops": 0, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executed": 0, 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:07.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 4874, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 5167829, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 4874, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 4874, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 5167829, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.248 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 4408, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 3485472, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 4408, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 3485472, 2024-05-14T09:43:07.249 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 1024, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 4408, 2024-05-14T09:43:07.250 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 4408, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 4408, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 4408, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 3758096384, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:07.251 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 0, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 0, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-write_buf_throttle-0x55ca0ad148f0": { 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 3758096384, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:07.252 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:07.253 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:43:08.107 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-14T09:43:08.107 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-14T09:43:08.107 DEBUG:tasks.check_counter:Getting stats from d 2024-05-14T09:43:08.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-14T09:43:08.569 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:43:08.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:08 smithi120 ceph-mon[31085]: pgmap v1143: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 14 op/s 2024-05-14T09:43:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:08 smithi152 ceph-mon[34868]: pgmap v1143: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 14 op/s 2024-05-14T09:43:08.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:08 smithi175 ceph-mon[35353]: pgmap v1143: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 14 op/s 2024-05-14T09:43:10.465 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:10 smithi120 ceph-mon[31085]: pgmap v1144: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.5 KiB/s wr, 13 op/s 2024-05-14T09:43:10.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:10 smithi152 ceph-mon[34868]: pgmap v1144: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.5 KiB/s wr, 13 op/s 2024-05-14T09:43:10.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:10 smithi175 ceph-mon[35353]: pgmap v1144: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.5 KiB/s wr, 13 op/s 2024-05-14T09:43:11.000 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 418, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 415, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 570640, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 256576, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 0, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.142498815, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.062198448, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.053725694, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.020993638, 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 414, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.074601998, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000180198 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 570640, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 256576 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 6, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 319, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 3232, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 213584, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 2, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.059733730, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.050319922, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.003229167, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 318, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.052542899, 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000165229 2024-05-14T09:43:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 213584 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 0, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 2, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 0, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 0, 2024-05-14T09:43:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 2, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 1, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.000708896, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.000000000, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.000570147, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 0, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 148704, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 29, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 928, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 2, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-05-14T09:43:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 420, 2024-05-14T09:43:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 511514, 2024-05-14T09:43:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 420, 2024-05-14T09:43:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 420, 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 511514, 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:11.014 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:43:11.872 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-14T09:43:11.872 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-14T09:43:11.872 DEBUG:tasks.check_counter:Getting stats from g 2024-05-14T09:43:11.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-14T09:43:12.314 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:43:12.619 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:12 smithi120 ceph-mon[31085]: pgmap v1145: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-05-14T09:43:12.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:12 smithi152 ceph-mon[34868]: pgmap v1145: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-05-14T09:43:12.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:12 smithi175 ceph-mon[35353]: pgmap v1145: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-05-14T09:43:14.438 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:14 smithi120 ceph-mon[31085]: pgmap v1146: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-05-14T09:43:14.674 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:43:14.674 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 1420, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 1420, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 478633, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 450737, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 7, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 2, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.374935503, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.157644743, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.077976273, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.110052605, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 1419, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.236420506, 2024-05-14T09:43:14.675 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000166610 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 3483, 2024-05-14T09:43:14.676 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 3432, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 4586715, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 1213065, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 3, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.635847348, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.211809037, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.179483537, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.207041568, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 3431, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.437077767, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000127390 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.677 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 910576, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 253920 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 5, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 315, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 1668, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 692341, 2024-05-14T09:43:14.678 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 7, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 4, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.064758055, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.051525904, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.007490684, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000089371, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 313, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.053695020, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000171549 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.679 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 691376 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 1, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "finisher-MDSRank": { 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "queue_len": 0, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "complete_latency": { 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 7255, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.372738939, 2024-05-14T09:43:14.680 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000051376 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "queue_len": 0, 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "complete_latency": { 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": { 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "request": 0, 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "reply": 0, 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "reply_latency": { 2024-05-14T09:43:14.681 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "slow_reply": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "forward": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_commit": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_split": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_merge": 0, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes": 745, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_top": 163, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_bottom": 582, 2024-05-14T09:43:14.682 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_pin_tail": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_pinned": 513, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_expired": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "inodes_with_caps": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "subtrees": 13, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_hit": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_forward": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_discover": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "traverse_lock": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "load_cent": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "q": 0, 2024-05-14T09:43:14.683 INFO:teuthology.orchestra.run.smithi120.stdout: "exported": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "exported_inodes": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "imported": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "imported_inodes": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "openino_backtrace_fetch": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "root_rfiles": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "root_rbytes": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "root_rsnaps": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_dir_inodes": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_file_inodes": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_grant": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_caps": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_caps_dirty": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_cap_release": 0, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "process_request_cap_release": 0 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.685 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache": { 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_update": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_try_discover": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_send_discover": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "dir_handle_discover": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "num_strays": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_created": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_enqueued": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "strays_migrated": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:14.686 INFO:teuthology.orchestra.run.smithi120.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_started": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_completed": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_exportdir": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_flush": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: "ireq_inodestats": 0 2024-05-14T09:43:14.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log": { 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "evlrg": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "evadd": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "evex": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "evtrm": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "ev": 1817, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "evexg": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "evexd": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "segadd": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "segex": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "segtrm": 0, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "seg": 3, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "segmjr": 2, 2024-05-14T09:43:14.688 INFO:teuthology.orchestra.run.smithi120.stdout: "segexg": 0, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "segexd": 0, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "expos": 4194304, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "wrpos": 7105803, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "rdpos": 7105229, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "jlat": { 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "replayed": 1817 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_mem": { 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 698, 2024-05-14T09:43:14.689 INFO:teuthology.orchestra.run.smithi120.stdout: "ino+": 709, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "ino-": 11, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "dir": 57, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "dir+": 58, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "dir-": 1, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "dn": 745, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "dn+": 748, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "dn-": 3, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "cap": 0, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "cap+": 0, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "cap-": 0, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "rss": 122516, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "heap": 215440 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_server": { 2024-05-14T09:43:14.690 INFO:teuthology.orchestra.run.smithi120.stdout: "dispatch_client_request": 0, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "dispatch_server_request": 0, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_request": 0, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_client_session": 0, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "handle_peer_request": 0, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "req_create_latency": { 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "req_getattr_latency": { 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.691 INFO:teuthology.orchestra.run.smithi120.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "req_link_latency": { 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookup_latency": { 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:14.692 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupino_latency": { 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupname_latency": { 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.693 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "req_lssnap_latency": { 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.694 INFO:teuthology.orchestra.run.smithi120.stdout: "req_mkdir_latency": { 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: "req_mknod_latency": { 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "req_mksnap_latency": { 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "req_open_latency": { 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "req_readdir_latency": { 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.699 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rename_latency": { 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rmdir_latency": { 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.701 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setattr_latency": { 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.702 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setlayout_latency": { 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "req_setxattr_latency": { 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.703 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "req_symlink_latency": { 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "req_unlink_latency": { 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:14.704 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_sessions": { 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "session_count": 1, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "session_add": 2, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "session_remove": 1, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "sessions_open": 1, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "sessions_stale": 0, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "total_load": 0, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "average_load": 0, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "avg_session_uptime": 2896, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.705 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:14.706 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:14.707 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 198247, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 56, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 172, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 2069776, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 5688, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-05-14T09:43:14.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter": { 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_active": 0, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_laggy": 0, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_send": 4435, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_send_bytes": 21, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_resend": 3, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_reply": 4435, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_latency": { 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 4435, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 9.740776427, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.002196341 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.710 INFO:teuthology.orchestra.run.smithi120.stdout: "op_inflight": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "oplen_avg": { 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 4435, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 4436 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "op": 4435, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "op_r": 4435, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "op_w": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "op_rmw": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "op_pg": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_stat": 2730, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_create": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_read": 1703, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_write": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_writefull": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_writesame": 0, 2024-05-14T09:43:14.711 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_append": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_zero": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_truncate": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_delete": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_mapext": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_getxattr": 1, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_setxattr": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_call": 0, 2024-05-14T09:43:14.712 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_watch": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_notify": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_pgls": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "osdop_other": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_active": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_send": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_resend": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "linger_ping": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "poolop_active": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "poolop_send": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "poolop_resend": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "poolstat_active": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "poolstat_send": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "poolstat_resend": 0, 2024-05-14T09:43:14.713 INFO:teuthology.orchestra.run.smithi120.stdout: "statfs_active": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "statfs_send": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "statfs_resend": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "command_active": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "command_send": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "command_resend": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "map_epoch": 90, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "map_full": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "map_inc": 2, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_sessions": 6, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_session_open": 8, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_session_close": 2, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_laggy": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_wr": 0, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_rd": 2, 2024-05-14T09:43:14.714 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_del": 0 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "oft": { 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_objs": 0, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_updates": 0, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "omap_total_removes": 0 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "osd-slow-ops": { 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "slow_ops_count": 0 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "purge_queue": { 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing": 0, 2024-05-14T09:43:14.715 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executing_high_water": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executed_ops": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_executed": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 4904, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 4598887, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 4904, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 4904, 2024-05-14T09:43:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 4598887, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 4435, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 2911504, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 4435, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 2911504, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 1024, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 4435, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 4435, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 4435, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 4435, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 3758096384, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 0, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 0, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-write_buf_throttle-0x557e1acb68f0": { 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 3758096384, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:14.723 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:43:14.723 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:14 smithi152 ceph-mon[34868]: pgmap v1146: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-05-14T09:43:14.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:14 smithi175 ceph-mon[35353]: pgmap v1146: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-05-14T09:43:15.944 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-14T09:43:15.944 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-14T09:43:15.944 DEBUG:tasks.check_counter:Getting stats from j 2024-05-14T09:43:15.945 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-14T09:43:16.389 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:43:16.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:16 smithi120 ceph-mon[31085]: pgmap v1147: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-05-14T09:43:16.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:16 smithi152 ceph-mon[34868]: pgmap v1147: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-05-14T09:43:16.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:16 smithi175 ceph-mon[35353]: pgmap v1147: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-05-14T09:43:18.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:18 smithi120 ceph-mon[31085]: pgmap v1148: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T09:43:18.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:18 smithi152 ceph-mon[34868]: pgmap v1148: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T09:43:18.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:18 smithi175 ceph-mon[35353]: pgmap v1148: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T09:43:19.044 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 421, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 418, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 571456, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 258496, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 0, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.146294201, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.066385842, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.055464223, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.020525309, 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 417, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.062031669, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000148757 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 571456, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 258496 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 2, 2024-05-14T09:43:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 319, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 320, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 213488, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 2, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.064003161, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.055938288, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.002856862, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 317, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.051968777, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000163939 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 213488 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 4, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 4, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 2912, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 448, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 2, 2024-05-14T09:43:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 1, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.001470312, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.000072923, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.001267212, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 3, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.001555122, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000518374 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-05-14T09:43:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 148704, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 29, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-05-14T09:43:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 928, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 2, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 423, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 511904, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 423, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 423, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 511904, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-05-14T09:43:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-05-14T09:43:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-05-14T09:43:19.055 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-05-14T09:43:19.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:19 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:19.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:19 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:19.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:19 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:19.933 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-14T09:43:19.933 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-14T09:43:19.933 DEBUG:tasks.check_counter:Getting stats from b 2024-05-14T09:43:19.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-14T09:43:20.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:20 smithi152 ceph-mon[34868]: pgmap v1149: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-14T09:43:20.523 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:43:20.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:20 smithi120 ceph-mon[31085]: pgmap v1149: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-14T09:43:20.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:20 smithi175 ceph-mon[35353]: pgmap v1149: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-14T09:43:21.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:21 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:43:21.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:21 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:43:21.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:21 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T09:43:22.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:22 smithi152 ceph-mon[34868]: pgmap v1150: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-05-14T09:43:22.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:43:22.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:43:22.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:22 smithi152 ceph-mon[34868]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:43:22.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:22 smithi175 ceph-mon[35353]: pgmap v1150: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-05-14T09:43:22.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:43:22.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:43:22.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:22 smithi175 ceph-mon[35353]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:43:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:22 smithi120 ceph-mon[31085]: pgmap v1150: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-05-14T09:43:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T09:43:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T09:43:22.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:22 smithi120 ceph-mon[31085]: from='mgr.14152 172.21.15.120:0/3675944324' entity='mgr.x' 2024-05-14T09:43:23.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:23 smithi152 ceph-mon[34868]: pgmap v1151: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:23.716 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1119, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1064, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 5285298, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 459801, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 7, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 2, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.251254145, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.088111865, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.103887416, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.051305613, 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:23.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1064, 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.101582399, 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000095472 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 927008, 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 254368 2024-05-14T09:43:23.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 757, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1067, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 3964938, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 869328, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 9, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.163518791, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.061726119, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.047524414, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.038902222, 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1065, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.111702243, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000104884 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 629232 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 3077, 2024-05-14T09:43:23.720 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 3079, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 9290961, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 978544, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 5, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.636844778, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.218431184, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.185183080, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.177419168, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3077, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.301788224, 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000098078 2024-05-14T09:43:23.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.722 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7680, 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.381683445, 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000049698 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 0, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 0, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 0, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:23.724 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 400, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 1, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 399, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 399, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 3, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2024-05-14T09:43:23.725 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:23.726 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 0, 2024-05-14T09:43:23.727 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 0 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 0, 2024-05-14T09:43:23.728 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-05-14T09:43:23.729 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-05-14T09:43:23.730 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 12705, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 17, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 3, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 20552006, 2024-05-14T09:43:23.731 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 20551432, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 12705 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 74, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 459, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 385, 2024-05-14T09:43:23.732 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 18, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 67, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 49, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 400, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 804, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 404, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 0, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 0, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 120256, 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 215440 2024-05-14T09:43:23.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 0, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 0, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 0, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 0, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 0, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.734 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.737 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.738 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-05-14T09:43:23.738 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.738 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.738 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.738 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-05-14T09:43:23.739 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:23 smithi175 ceph-mon[35353]: pgmap v1151: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.741 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:23.744 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.745 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-05-14T09:43:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 1, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 0, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 0, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 0, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 2875, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:23.748 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:23.750 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 216759, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 70, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:23.751 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 172, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 473441, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 11961, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-05-14T09:43:23.752 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 4478, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 21, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 3, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 4478, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4478, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 9.029894720, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002016501 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4478, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4479 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 4478, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 4478, 2024-05-14T09:43:23.753 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 2624, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 1852, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:23.754 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 1, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-05-14T09:43:23.755 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 90, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 8, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 11, 2024-05-14T09:43:23.756 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 3, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 0, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 2, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 0 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 0, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.757 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 0, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 0, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 0, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:23.758 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 4949, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 18068924, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 4949, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 4949, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 18068924, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 4478, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 16360009, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 4478, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 16360009, 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 4478, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 4478, 2024-05-14T09:43:23.761 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 4478, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 4478, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:23.762 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x556ed2f12410": { 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:23.763 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:23.764 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-05-14T09:43:23.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:23 smithi120 ceph-mon[31085]: pgmap v1151: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:24.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:24 smithi152 ceph-mon[34868]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:24.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:24 smithi175 ceph-mon[35353]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:24.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:24 smithi120 ceph-mon[31085]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T09:43:25.013 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-05-14T09:43:25.013 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-05-14T09:43:25.013 DEBUG:tasks.check_counter:Getting stats from e 2024-05-14T09:43:25.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-14T09:43:25.514 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:43:25.673 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:25 smithi152 ceph-mon[34868]: pgmap v1152: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-14T09:43:25.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:25 smithi175 ceph-mon[35353]: pgmap v1152: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-14T09:43:25.884 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:25 smithi120 ceph-mon[31085]: pgmap v1152: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-14T09:43:28.129 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-05-14T09:43:28.129 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:28.129 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1564, 2024-05-14T09:43:28.129 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1370, 2024-05-14T09:43:28.129 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1608765, 2024-05-14T09:43:28.129 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 988331, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 13, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.324872887, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.123867120, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.157618322, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.046887669, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1365, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.198017484, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000145067 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 578, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.001805398, 2024-05-14T09:43:28.130 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000003123 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 956080, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 270448 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 6880, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 8287, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2478539, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 5467119, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 10, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 1.694604300, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.916661075, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.858378056, 2024-05-14T09:43:28.131 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.062120185, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 8289, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.966832158, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000116640 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12129, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.008399238, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000692 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 576688 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:28.132 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 5859, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 6685, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2146428, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 3614567, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 24, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 9, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 1.067689471, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.462978039, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.719077555, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.014469215, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 6684, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.972962633, 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000145565 2024-05-14T09:43:28.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 11021, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.005294485, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000480 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 3840, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 1184 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:28.134 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2099, 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.870708636, 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000414820 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 16, 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000596266, 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000037266 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.135 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 2435, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 2336, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2336, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.835460186, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001641892 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 99, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 11, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 144, 2024-05-14T09:43:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 0, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 123, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 21, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 144, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 143, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 127, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 127, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 8, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 3818, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 3469, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 99, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 6, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 930, 2024-05-14T09:43:28.137 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 3, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 141, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 7, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 261, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 1046, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 1017, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 1485206574, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 1046, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:28.138 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 4, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 4, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 1042, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 30, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 1233, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 1360, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 2883, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 733, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 1, 2024-05-14T09:43:28.139 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 24 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 6, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 14, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 1, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 1, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 5, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-05-14T09:43:28.141 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 1746, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 1746, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 3, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 3, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-05-14T09:43:28.142 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 6285215, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 537, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.490692347, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.008362555 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 145, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 286, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 141, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 27, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 28, 2024-05-14T09:43:28.143 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 1, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 144, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 314, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 170, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 127, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 267, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 140, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 127172, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 223632 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 3439, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 223, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 2435, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 24, 2024-05-14T09:43:28.144 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 472, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 18, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.151579806, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.008421100 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 618, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.391145770, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002251044 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 713, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.271245799, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001782953 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:28.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 975, 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.976022728, 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001001048 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 9, 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.021155290, 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002350587 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-05-14T09:43:28.150 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.007133957, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.007133957 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.151 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.008130709, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.008130709 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.154 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.009046127, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.009046127 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 83, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 83, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1209, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 120, 2024-05-14T09:43:28.156 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 120, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:28.157 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:28.158 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 289469, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 113, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:28.159 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 172, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 498322, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 2417, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.160 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 1863, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 2141878, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 32, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 1863, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1863, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 8.447901119, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004534568 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1863, 2024-05-14T09:43:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2056 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 1863, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 1047, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 816, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 1, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 538, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 78, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-05-14T09:43:28.162 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 14, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 1046, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:28.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-05-14T09:43:28.164 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 90, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 279, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 0, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 70 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.165 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 2, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 1, 2024-05-14T09:43:28.166 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 2, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 1, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 14299, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 4917244, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 14299, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 14299, 2024-05-14T09:43:28.167 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 4917244, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:28.168 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1863, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 2141987, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1863, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2141987, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-05-14T09:43:28.169 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1863, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 1863, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1863, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1863, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 1, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 109, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 1, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 109, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.171 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x5639678245b0": { 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 1746, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 2090911, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 1746, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 537, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2090911, 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:28.172 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:28.173 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:28.173 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:28.173 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.173 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:28.173 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-05-14T09:43:28.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:28 smithi152 ceph-mon[34868]: pgmap v1153: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:28.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:28 smithi175 ceph-mon[35353]: pgmap v1153: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:28.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:28 smithi120 ceph-mon[31085]: pgmap v1153: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:29.253 INFO:tasks.check_counter:Daemon mds.e mds.exported=3 2024-05-14T09:43:29.253 INFO:tasks.check_counter:Daemon mds.e mds.imported=7 2024-05-14T09:43:29.253 DEBUG:tasks.check_counter:Getting stats from h 2024-05-14T09:43:29.254 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-14T09:43:29.753 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:43:30.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:30 smithi175 ceph-mon[35353]: pgmap v1154: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:30.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:30 smithi120 ceph-mon[31085]: pgmap v1154: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:30.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:30 smithi152 ceph-mon[34868]: pgmap v1154: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-14T09:43:32.424 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:32 smithi152 ceph-mon[34868]: pgmap v1155: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 21175, 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 24866, 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 6988174, 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 20105314, 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 17, 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 5.043197992, 2024-05-14T09:43:32.428 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 2.266825874, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 2.892715596, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.303605739, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 24865, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.122951183, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000125596 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 37835, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.023942137, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000632 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 62352, 2024-05-14T09:43:32.429 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 30736 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 6481, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 7578, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2175471, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 8539373, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 10, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 1.324942548, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.541093836, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.655366563, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.177829983, 2024-05-14T09:43:32.430 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7576, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.774854899, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000234273 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 8228, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.006973902, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000847 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 609104 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 14143, 2024-05-14T09:43:32.431 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 12688, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 5747663, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 11014490, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 229, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 3.052526546, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.376707844, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 1.697976515, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.234328987, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12687, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.305726333, 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000181739 2024-05-14T09:43:32.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 20629, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.008035496, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000389 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 969952, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 277840 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-05-14T09:43:32.433 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7040, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 7.867822019, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001117588 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 123, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.014892972, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000121081 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.434 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 7484, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 5160, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5160, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 51.122837862, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.009907526 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 2324, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 5, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 2, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 835, 2024-05-14T09:43:32.435 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 3, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 300, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 16, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 273, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 11, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 277, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 1458, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 258, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 258, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 19, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 10555, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 6977, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 2271, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 9, 2024-05-14T09:43:32.436 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 218, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 48, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 1363, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 26, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 568, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 519, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 1016, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 1508267454, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-05-14T09:43:32.437 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 519, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 159, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 6, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 153, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 360, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 2232, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 2462, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 4727, 2024-05-14T09:43:32.438 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 940, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 12, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 1048 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 36, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 76, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 20, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 19, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 1, 2024-05-14T09:43:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 6, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 55, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 3, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.440 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 5558, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 5541, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 5541, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 17, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 2, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 91, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 90, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 90, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 1, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 1, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 1, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 19405023, 2024-05-14T09:43:32.441 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 19578421, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2776, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 27.506166355, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.009908561 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 302, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 1560, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 1258, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 53, 2024-05-14T09:43:32.442 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 103, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 50, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 300, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 1809, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 1509, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 258, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 1547, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 1289, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 135340, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 231824 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 9408, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 830, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 7484, 2024-05-14T09:43:32.443 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 68, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 1949, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 940, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.462120832, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003683107 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 373, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.264633665, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000709473 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.009386353, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.009386353 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2901, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 45.079094931, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.015539157 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.445 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.446 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:32.447 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.447 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.447 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.447 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-05-14T09:43:32.447 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.447 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 37, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.139391541, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003767338 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-05-14T09:43:32.448 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 827, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.596860025, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001930906 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 43, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.168381235, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003915842 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-05-14T09:43:32.449 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 11, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.256365359, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.023305941 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.450 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.016854759, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.008427379 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.004132479, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002066239 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 8, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.060118676, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.007514834 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 15, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.065498007, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004366533 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-05-14T09:43:32.454 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 3, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 2, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 75, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 75, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1217, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:32.455 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:32.456 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:32.457 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 321225, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 121, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 172, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 1033595, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 5017, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 7065, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 18017894, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 37, 2024-05-14T09:43:32.459 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 7065, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7065, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 225.807323883, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.031961404 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7065, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 11466 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 7065, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 551, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 6514, 2024-05-14T09:43:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 762, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 1733, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 19, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 2789, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 292, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 3, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 584, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 532, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 2630, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-05-14T09:43:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 90, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-05-14T09:43:32.463 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 11, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 2005, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 14, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 103 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.464 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 18, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 3, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 66, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 19, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:32.465 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 41795, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 11112926, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 41795, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 41795, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 11112926, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.466 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 7065, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 18019861, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 7065, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 18019861, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.467 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 7065, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 7065, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 7065, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 7065, 2024-05-14T09:43:32.468 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 19, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 2055, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 19, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:32.469 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 13, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2055, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x55e4f1cac4e0": { 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 5558, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 15384117, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:32.470 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 5558, 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2776, 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 15384117, 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:32.471 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-05-14T09:43:32.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:32 smithi120 ceph-mon[31085]: pgmap v1155: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-14T09:43:32.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:32 smithi175 ceph-mon[35353]: pgmap v1155: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-14T09:43:33.519 INFO:tasks.check_counter:Daemon mds.h mds.exported=48 2024-05-14T09:43:33.519 INFO:tasks.check_counter:Daemon mds.h mds.imported=26 2024-05-14T09:43:33.519 DEBUG:tasks.check_counter:Getting stats from k 2024-05-14T09:43:33.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-14T09:43:33.976 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T09:43:34.392 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:34 smithi152 ceph-mon[34868]: pgmap v1156: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-05-14T09:43:34.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:34 smithi120 ceph-mon[31085]: pgmap v1156: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-05-14T09:43:34.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:34 smithi175 ceph-mon[35353]: pgmap v1156: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-05-14T09:43:36.342 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:36 smithi152 ceph-mon[34868]: pgmap v1157: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T09:43:36.631 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-05-14T09:43:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 17639, 2024-05-14T09:43:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 18760, 2024-05-14T09:43:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 5765813, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 12910022, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 17, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 3.307876988, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.403524254, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 2.276383224, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.073447867, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 18754, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.193532764, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000170285 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 29170, 2024-05-14T09:43:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.021495127, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000736 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 8789, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 7776, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 3734599, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 7495166, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 9, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 1.959187899, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.007281951, 2024-05-14T09:43:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 1.124836064, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.068000557, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7780, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.970957358, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000124801 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 13591, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.006616747, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000486 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 580864 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1533, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1503, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1469020, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 9404538, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 20, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 9, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.382382430, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.162696242, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.151760063, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.068206528, 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1501, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.221599702, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000147634 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 270, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000113676, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000421 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 956800, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 278624 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-05-14T09:43:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4496, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.763895726, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001059585 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 56, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.003695428, 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000065989 2024-05-14T09:43:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 5013, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 4791, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4791, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 15.836085318, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003305382 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 222, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 11, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 404, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 1, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 269, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 134, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 402, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 389, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 66, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 66, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 6, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 11919, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 8886, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 222, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 23, 2024-05-14T09:43:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 7, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 417, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 20, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 375, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 20, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 374, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 825, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 1017, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 1485206574, 2024-05-14T09:43:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 825, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 21, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 21, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 804, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 540, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 827, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 11260, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 9875, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 4, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 568 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 64, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 15, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 182, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 7, 2024-05-14T09:43:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 175, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 22, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-05-14T09:43:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 12705, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 12705, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 17, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 17, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 3, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-05-14T09:43:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 20552006, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1775, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 11.127679260, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006269115 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 85, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 458, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 373, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 29, 2024-05-14T09:43:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 68, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 39, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 404, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 822, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 418, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 66, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 432, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 366, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 126864, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 223632 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 7791, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 2, 2024-05-14T09:43:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 5013, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 25, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 685, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 76, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.424118495, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.005580506 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 39, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.022472765, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000576224 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 175, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.145316788, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006544667 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3461, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 7.580059873, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002190135 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-05-14T09:43:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.650 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:36 smithi120 ceph-mon[31085]: pgmap v1157: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 655, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.118686170, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001707917 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-05-14T09:43:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 27, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.051510124, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001907782 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 180, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.464033080, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.024800183 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 178, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.029888023, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.005785887 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-05-14T09:43:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 1, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 0, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 1359, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 1359, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1220, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 298037, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 115, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 172, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-05-14T09:43:36.661 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 562465, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 15098, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 3128, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 16433573, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 33, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 3128, 2024-05-14T09:43:36.662 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3128, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 15.968812916, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.005105119 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3128, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3556 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 3128, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 830, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 2298, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2024-05-14T09:43:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 5, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 1780, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 85, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 38, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 825, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:36.664 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-05-14T09:43:36.665 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 90, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-05-14T09:43:36.666 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 628, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 0, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 165 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.667 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 10, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 2, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 23, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 7, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 27957, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 8423628, 2024-05-14T09:43:36.668 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 27957, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 27957, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 8423628, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:36.669 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 3128, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 16434336, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 3128, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 16434336, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 3128, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 3128, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 3128, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 3128, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 7, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 763, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 7, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 5, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 763, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x56300b02c410": { 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 12705, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 16357702, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 12705, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1775, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 16357702, 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-05-14T09:43:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-05-14T09:43:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-05-14T09:43:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-05-14T09:43:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-05-14T09:43:36.674 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-05-14T09:43:36.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:36 smithi175 ceph-mon[35353]: pgmap v1157: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T09:43:37.684 INFO:tasks.check_counter:Daemon mds.k mds.exported=20 2024-05-14T09:43:37.684 INFO:tasks.check_counter:Daemon mds.k mds.imported=20 2024-05-14T09:43:37.684 DEBUG:tasks.check_counter:Getting stats from c 2024-05-14T09:43:37.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-14T09:43:38.260 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:43:38.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:38 smithi175 ceph-mon[35353]: pgmap v1158: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T09:43:38.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:38 smithi120 ceph-mon[31085]: pgmap v1158: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T09:43:38.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:38 smithi152 ceph-mon[34868]: pgmap v1158: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T09:43:40.363 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:40 smithi175 ceph-mon[35353]: pgmap v1159: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-14T09:43:40.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:40 smithi120 ceph-mon[31085]: pgmap v1159: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-14T09:43:40.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:40 smithi152 ceph-mon[34868]: pgmap v1159: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-14T09:43:40.946 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-14T09:43:40.946 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:40.946 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 5658, 2024-05-14T09:43:40.946 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 5965, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2390927, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 5317185, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 14, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.055271263, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.442369173, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.584934196, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.087586896, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5965, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.664748977, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000111441 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.947 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8035, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.003711436, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000461 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 5881, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 6411, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2935039, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 3275193, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 15, 2024-05-14T09:43:40.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.111433419, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.458200861, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.757334202, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.042327844, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6406, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.841574301, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000131372 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8959, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.004131369, 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000461 2024-05-14T09:43:40.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 942128, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 282656 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1814, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2332, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1272105, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1908429, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 19, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.389114277, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.200984435, 2024-05-14T09:43:40.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.190866147, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.019168017, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2333, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.337311915, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000144582 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2578, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000822386, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000319 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 636160 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3104, 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.479870750, 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000476762 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:40.952 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 71, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.005802699, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000081728 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 1786, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 995, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 995, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 5.072561078, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005098051 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.953 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 791, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 475, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 0, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 475, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 475, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 251, 2024-05-14T09:43:40.954 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 444, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 444, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 19, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 2328, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 1441, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 777, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 7, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 329, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 7, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 249, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 19, 2024-05-14T09:43:40.955 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 718, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 1464, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 1017, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 1485206574, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 1464, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 2, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 2, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 1462, 2024-05-14T09:43:40.956 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 20, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 369, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 284, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 1, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 1485, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 405, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 7, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 47 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-05-14T09:43:40.957 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 35, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 27, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 10, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 10, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:40.958 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 7, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-05-14T09:43:40.959 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 1823, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 1823, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 3, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 3, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-05-14T09:43:40.960 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 7150323, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 955, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 7.172452933, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.007510421 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 462, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 716, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 254, 2024-05-14T09:43:40.961 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 65, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 66, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 1, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 475, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 761, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 286, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 444, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 698, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 254, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 128196, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223632 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 2077, 2024-05-14T09:43:40.962 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 508, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 1786, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 29, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 1026, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 10, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.038482277, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003848227 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 49, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.031024992, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000633163 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.963 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 485, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4.265289984, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.008794412 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.964 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.965 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-05-14T09:43:40.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.972 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.972 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.973 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 389, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.484739924, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001246118 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 46, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.124379001, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002703891 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5, 2024-05-14T09:43:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.032679573, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006535914 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.975 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.036959636, 2024-05-14T09:43:40.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.012319878 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.977 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-05-14T09:43:40.978 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.059005691, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.007375711 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-05-14T09:43:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 244, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 244, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1223, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:40.980 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:40.981 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 291552, 2024-05-14T09:43:40.982 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 116, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:40.983 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 172, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 1594946, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 8647, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-05-14T09:43:40.984 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 2678, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 3009986, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 2678, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2678, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 10.682836353, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003989109 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2678, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2812 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 2678, 2024-05-14T09:43:40.985 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 1473, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 1205, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 9, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 964, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 82, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 32, 2024-05-14T09:43:40.986 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1464, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 2, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-05-14T09:43:40.988 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 90, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 181, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 48 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:40.989 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 4, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 2, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 20, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 10, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:40.990 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 13349, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 5367130, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 13349, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 13349, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5367130, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.991 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:40.992 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2678, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 3011076, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2678, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3011076, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:40.993 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2678, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2678, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2678, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2678, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:40.994 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 10, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1090, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 10, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 9, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1090, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x563adac00410": { 2024-05-14T09:43:40.995 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 1823, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 2956019, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 1823, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 955, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2956019, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:40.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:40.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:40.997 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-14T09:43:42.051 INFO:tasks.check_counter:Daemon mds.c mds.exported=7 2024-05-14T09:43:42.051 INFO:tasks.check_counter:Daemon mds.c mds.imported=19 2024-05-14T09:43:42.051 DEBUG:tasks.check_counter:Getting stats from f 2024-05-14T09:43:42.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-14T09:43:42.480 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:43:42.633 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:42 smithi175 ceph-mon[35353]: pgmap v1160: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:43:42.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:42 smithi120 ceph-mon[31085]: pgmap v1160: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:43:42.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:42 smithi152 ceph-mon[34868]: pgmap v1160: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:43:44.621 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:44 smithi175 ceph-mon[35353]: pgmap v1161: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:44.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:44 smithi120 ceph-mon[31085]: pgmap v1161: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:44.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:44 smithi152 ceph-mon[34868]: pgmap v1161: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2854, 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2801, 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 5840516, 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1016060, 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 1, 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.609327704, 2024-05-14T09:43:45.002 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.210956372, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.195033456, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.158655209, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2800, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.274666611, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000098095 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 927520, 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 261760 2024-05-14T09:43:45.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2078, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2398, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 7524819, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1242392, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.408891490, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.153642985, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.113702961, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.105342976, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2396, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.220078962, 2024-05-14T09:43:45.004 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000091852 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 581840 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 418, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 418, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4300526, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 132107, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-05-14T09:43:45.005 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.118338626, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.043612810, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.036767898, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.028088431, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 417, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.044798602, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000107430 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8134, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.444679776, 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000054669 2024-05-14T09:43:45.007 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-05-14T09:43:45.008 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 286, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 53, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 233, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 210, 2024-05-14T09:43:45.009 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 10, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-05-14T09:43:45.010 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 1016, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 1508267454, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-05-14T09:43:45.011 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-05-14T09:43:45.012 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-05-14T09:43:45.013 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-05-14T09:43:45.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 5558, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 87, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 19405023, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 19578421, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 19578360, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.015 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 5558 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 265, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 1541, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 1276, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 21, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 104, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 83, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 286, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 1574, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 1288, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-05-14T09:43:45.016 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 121612, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215440 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.017 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-05-14T09:43:45.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-05-14T09:43:45.019 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.020 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.021 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.021 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-05-14T09:43:45.021 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.021 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.021 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.025 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.027 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 2, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 2945, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.028 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:45.029 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:45.030 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 190184, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 53, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:45.031 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 172, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 788301, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 2257, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-05-14T09:43:45.032 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 4863, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 26, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 4, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 4863, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4863, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 10.518837938, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002163034 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4863, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4864 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.033 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 4863, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 4863, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 2890, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 1970, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-05-14T09:43:45.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 2, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-05-14T09:43:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 90, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-05-14T09:43:45.036 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 5, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 6, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 1, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.037 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:45.038 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 5346, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 17157231, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 5346, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 5346, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 17157231, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:45.039 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4863, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 15384127, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4863, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 15384127, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.040 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4863, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 4863, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4863, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4863, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:45.042 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5588d3018410": { 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-05-14T09:43:45.043 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-05-14T09:43:45.044 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:45.044 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:45.044 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:45.044 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:45.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:45.044 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-14T09:43:46.028 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-14T09:43:46.028 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-14T09:43:46.028 DEBUG:tasks.check_counter:Getting stats from i 2024-05-14T09:43:46.028 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-14T09:43:46.384 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:46 smithi120 ceph-mon[31085]: pgmap v1162: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:46.471 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:43:46.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:46 smithi175 ceph-mon[35353]: pgmap v1162: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:46.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:46 smithi152 ceph-mon[34868]: pgmap v1162: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:48.477 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:48 smithi175 ceph-mon[35353]: pgmap v1163: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T09:43:48.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:48 smithi120 ceph-mon[31085]: pgmap v1163: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T09:43:48.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:48 smithi152 ceph-mon[34868]: pgmap v1163: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T09:43:48.868 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-14T09:43:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 6216, 2024-05-14T09:43:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 5906, 2024-05-14T09:43:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2297626, 2024-05-14T09:43:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 3339617, 2024-05-14T09:43:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 17, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.017129542, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.430665494, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.658277688, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.039881515, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5900, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.702046210, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000118990 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 9593, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.004731697, 2024-05-14T09:43:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000493 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 928, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 736 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 8380, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 7485, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4104085, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 6453724, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 9, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.558594106, 2024-05-14T09:43:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.693524951, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.863450156, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.134792125, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7488, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.797862987, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000106552 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 10297, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.006434150, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000624 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 947584, 2024-05-14T09:43:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 274240 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 838, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1154, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 540600, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1280826, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 22, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.181908957, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.076551641, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.064637099, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.028927115, 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1153, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.175927375, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000152582 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 207, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000081207, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000392 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 639456 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-05-14T09:43:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3397, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.696038452, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000499275 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1047, 2024-05-14T09:43:48.874 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.093596099, 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000089394 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 2338, 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 2278, 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2278, 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 5.706693473, 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002505133 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.875 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 60, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 199, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 2, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 197, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 199, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 96, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 183, 2024-05-14T09:43:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 183, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 11, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 6196, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 4374, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 59, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 7, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 1, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 11, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 3, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 93, 2024-05-14T09:43:48.877 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 9, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 300, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 1239, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 1017, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 1485206574, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 1239, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:48.878 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 1239, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 408, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 920, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 2775, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 418, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 76, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 1170 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.879 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 7, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 16, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 233, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 233, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:48.880 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 3, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 2963, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-05-14T09:43:48.881 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 2963, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 4, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 4, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 7680345, 2024-05-14T09:43:48.882 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1151, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 7.826467817, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006799711 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 201, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 516, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 315, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 28, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 29, 2024-05-14T09:43:48.883 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 1, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 199, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 574, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 375, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 183, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 498, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 315, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 127460, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223632 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 3955, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 2338, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 21, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 526, 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-05-14T09:43:48.884 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 240, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.260405790, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005251690 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 35, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.041612789, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001188936 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.885 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1463, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.256441736, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001542338 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-05-14T09:43:48.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.887 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:48.888 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.888 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.888 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.888 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-05-14T09:43:48.888 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.888 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 287, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.357521202, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001245718 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 18, 2024-05-14T09:43:48.890 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.039076163, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002170897 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 231, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.722524637, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.007456816 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.891 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:48.893 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-05-14T09:43:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.029111156, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.007277789 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 173, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 173, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1231, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:48.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:48.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:48.898 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 310430, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 130, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-05-14T09:43:48.899 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 172, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 683151, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 3682, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:48.900 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 3511, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 3580860, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 3511, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3511, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 21.929662314, 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006245987 2024-05-14T09:43:48.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3511, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3721 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 3511, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 1383, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 2128, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 144, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 1295, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 166, 2024-05-14T09:43:48.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 478, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1239, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-05-14T09:43:48.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-05-14T09:43:48.904 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 90, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 272, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 97 2024-05-14T09:43:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 10, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 5, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 466, 2024-05-14T09:43:48.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 233, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 15430, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 5524026, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 15430, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 15430, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5524026, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.907 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3511, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 3606257, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3511, 2024-05-14T09:43:48.908 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3606257, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3511, 2024-05-14T09:43:48.909 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 3511, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3511, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3511, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 233, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 25397, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:48.910 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 233, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 144, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 25397, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55ad1e67e410": { 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2963, 2024-05-14T09:43:48.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 3486041, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2963, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1151, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3486041, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:48.912 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-14T09:43:49.972 INFO:tasks.check_counter:Daemon mds.i mds.exported=3 2024-05-14T09:43:49.972 INFO:tasks.check_counter:Daemon mds.i mds.imported=9 2024-05-14T09:43:49.972 DEBUG:tasks.check_counter:Getting stats from l 2024-05-14T09:43:49.972 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-14T09:43:50.403 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T09:43:50.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:50 smithi175 ceph-mon[35353]: pgmap v1164: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:50.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:50 smithi120 ceph-mon[31085]: pgmap v1164: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:50.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:50 smithi152 ceph-mon[34868]: pgmap v1164: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T09:43:52.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:52 smithi175 ceph-mon[35353]: pgmap v1165: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:43:52.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:52 smithi120 ceph-mon[31085]: pgmap v1165: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:43:52.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:52 smithi152 ceph-mon[34868]: pgmap v1165: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:43:52.894 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-05-14T09:43:52.894 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T09:43:52.894 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4557, 2024-05-14T09:43:52.894 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 4559, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3366998, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1449133, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.793344235, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.273322358, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.206702982, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.252483886, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4557, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.355556861, 2024-05-14T09:43:52.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000078024 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 491, 2024-05-14T09:43:52.896 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 438, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 930092, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 267418, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 3, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.145381807, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.058301617, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.072212207, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.019753336, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 437, 2024-05-14T09:43:52.897 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.045013276, 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000103005 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 929536, 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 266720 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.898 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 7, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 331, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3500, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 642510, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.041435064, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.028799413, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.005730915, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000038190, 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T09:43:52.899 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 330, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.042836764, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000129808 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 642192 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.900 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7695, 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.360280771, 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000046820 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.901 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-05-14T09:43:52.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-05-14T09:43:52.903 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 141, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 72, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 69, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 40, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 6, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-05-14T09:43:52.904 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-05-14T09:43:52.905 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T09:43:52.906 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-05-14T09:43:52.907 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-05-14T09:43:52.908 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-05-14T09:43:52.909 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-05-14T09:43:52.910 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 1746, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 3, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-05-14T09:43:52.911 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 6285215, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 6284641, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 1746 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 135, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 277, 2024-05-14T09:43:52.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 142, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 15, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 18, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 3, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 141, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 288, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 147, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 119576, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215440 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.913 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-05-14T09:43:52.914 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.915 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.917 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.918 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.920 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-05-14T09:43:52.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.920 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.921 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.928 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-05-14T09:43:52.929 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-05-14T09:43:52.930 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 2953, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.931 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T09:43:52.932 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-05-14T09:43:52.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T09:43:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 182912, 2024-05-14T09:43:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 51, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-05-14T09:43:52.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8904, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 172, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 402618, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 980, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-05-14T09:43:52.937 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 4560, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 21, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 3, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 4560, 2024-05-14T09:43:52.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4560, 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 6.860893597, 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001504581 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4560, 2024-05-14T09:43:52.939 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4561 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 4560, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 4560, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 2814, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-05-14T09:43:52.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 1744, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-05-14T09:43:52.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-05-14T09:43:52.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-05-14T09:43:52.943 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 90, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 4, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 5, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 1, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-05-14T09:43:52.944 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.945 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 5051, 2024-05-14T09:43:52.946 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 3818097, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 5051, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 5051, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3818097, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:52.947 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4560, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2090916, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4560, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2090916, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.948 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4560, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 4560, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4560, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4560, 2024-05-14T09:43:52.949 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:52.950 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55e3656ea8f0": { 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-05-14T09:43:52.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-05-14T09:43:52.952 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-05-14T09:43:53.783 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-14T09:43:53.783 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-14T09:43:53.783 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-14T09:43:53.797 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-14T09:43:53.798 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:43:53.798 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T09:43:53.867 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:43:53.867 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T09:43:53.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T09:43:54.366 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:43:54.635 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:54 smithi120 ceph-mon[31085]: pgmap v1166: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:43:54.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:54 smithi152 ceph-mon[34868]: pgmap v1166: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:43:54.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:54 smithi175 ceph-mon[35353]: pgmap v1166: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:43:56.623 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:56 smithi152 ceph-mon[34868]: pgmap v1167: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:43:56.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:56 smithi120 ceph-mon[31085]: pgmap v1167: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:43:56.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.654+0000 7f9017600700 1 -- 172.21.15.120:0/2004793709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010110be0 msgr2=0x7f9010113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:56.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.654+0000 7f9017600700 1 --2- 172.21.15.120:0/2004793709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010110be0 0x7f9010113000 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f900800b0a0 tx=0x7f900800b3b0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.654+0000 7f9017600700 1 -- 172.21.15.120:0/2004793709 shutdown_connections 2024-05-14T09:43:56.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.654+0000 7f9017600700 1 --2- 172.21.15.120:0/2004793709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010110be0 0x7f9010113000 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.654+0000 7f9017600700 1 --2- 172.21.15.120:0/2004793709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9010076c10 0x7f9010077020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.654+0000 7f9017600700 1 --2- 172.21.15.120:0/2004793709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9010077560 0x7f90101106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.654+0000 7f9017600700 1 -- 172.21.15.120:0/2004793709 >> 172.21.15.120:0/2004793709 conn(0x7f90100ffea0 msgr2=0x7f90101022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:56.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.655+0000 7f9017600700 1 -- 172.21.15.120:0/2004793709 shutdown_connections 2024-05-14T09:43:56.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.655+0000 7f9017600700 1 -- 172.21.15.120:0/2004793709 wait complete. 2024-05-14T09:43:56.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 Processor -- start 2024-05-14T09:43:56.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 -- start start 2024-05-14T09:43:56.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9010076c10 0x7f901019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:56.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010077560 0x7f901019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:56.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9010110be0 0x7f90101a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:56.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f90101165a0 con 0x7f9010077560 2024-05-14T09:43:56.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9010116420 con 0x7f9010076c10 2024-05-14T09:43:56.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.656+0000 7f9017600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9010116720 con 0x7f9010110be0 2024-05-14T09:43:56.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010077560 0x7f901019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:56.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010077560 0x7f901019d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52160/0 (socket says 172.21.15.120:52160) 2024-05-14T09:43:56.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 -- 172.21.15.120:0/2435855126 learned_addr learned my addr 172.21.15.120:0/2435855126 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:43:56.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f9014c00700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9010076c10 0x7f901019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f9015600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9010110be0 0x7f90101a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 -- 172.21.15.120:0/2435855126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9010110be0 msgr2=0x7f90101a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9010110be0 0x7f90101a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 -- 172.21.15.120:0/2435855126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9010076c10 msgr2=0x7f901019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9010076c10 0x7f901019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f900fe00700 1 -- 172.21.15.120:0/2435855126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90101a1dc0 con 0x7f9010077560 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.657+0000 7f9015600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9010110be0 0x7f90101a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.658+0000 7f900fe00700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010077560 0x7f901019d490 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00d980 tx=0x7f8ffc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.658+0000 7f900d600700 1 -- 172.21.15.120:0/2435855126 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc017070 con 0x7f9010077560 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.658+0000 7f900d600700 1 -- 172.21.15.120:0/2435855126 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ffc010460 con 0x7f9010077560 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.658+0000 7f900d600700 1 -- 172.21.15.120:0/2435855126 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00de60 con 0x7f9010077560 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.658+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90101a2050 con 0x7f9010077560 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.658+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90101a2540 con 0x7f9010077560 2024-05-14T09:43:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.660+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90100512c0 con 0x7f9010077560 2024-05-14T09:43:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.662+0000 7f900d600700 1 -- 172.21.15.120:0/2435855126 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8ffc010610 con 0x7f9010077560 2024-05-14T09:43:56.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.665+0000 7f900d600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ff80b2900 0x7f8ff80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:43:56.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.665+0000 7f900d600700 1 -- 172.21.15.120:0/2435855126 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f8ffc0e1fe0 con 0x7f9010077560 2024-05-14T09:43:56.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.665+0000 7f9014c00700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ff80b2900 0x7f8ff80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:43:56.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.666+0000 7f9014c00700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ff80b2900 0x7f8ff80b4e10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9004005950 tx=0x7f90040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:43:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.668+0000 7f900d600700 1 -- 172.21.15.120:0/2435855126 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ffc0a99c0 con 0x7f9010077560 2024-05-14T09:43:56.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:56 smithi175 ceph-mon[35353]: pgmap v1167: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T09:43:56.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.913+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f901002e5f0 con 0x7f9010077560 2024-05-14T09:43:56.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.914+0000 7f900d600700 1 -- 172.21.15.120:0/2435855126 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+599 (secure 0 0 0) 0x7f8ffc0a92c0 con 0x7f9010077560 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1968421814 2024-05-15T09:07:40.065639+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2919660982 2024-05-15T09:07:04.655251+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2419562786 2024-05-15T09:07:04.655251+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1457013957 2024-05-15T09:07:40.065639+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3562327753 2024-05-15T09:07:04.655251+0000 2024-05-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/119127043 2024-05-15T09:07:40.065639+0000 2024-05-14T09:43:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ff80b2900 msgr2=0x7f8ff80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ff80b2900 0x7f8ff80b4e10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9004005950 tx=0x7f90040058e0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010077560 msgr2=0x7f901019d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010077560 0x7f901019d490 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00d980 tx=0x7f8ffc00dd40 comp rx=0 tx=0).stop 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 shutdown_connections 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f8ff80b2900 0x7f8ff80b4e10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9010076c10 0x7f901019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9010110be0 0x7f90101a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 --2- 172.21.15.120:0/2435855126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9010077560 0x7f901019d490 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 >> 172.21.15.120:0/2435855126 conn(0x7f90100ffea0 msgr2=0x7f9010100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:43:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 shutdown_connections 2024-05-14T09:43:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:43:56.917+0000 7f9017600700 1 -- 172.21.15.120:0/2435855126 wait complete. 2024-05-14T09:43:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:listed 10 entries 2024-05-14T09:43:57.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:57 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2435855126' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:43:57.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:57 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2435855126' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:43:57.711 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-05-14T09:43:57.711 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T09:43:57.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:57 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2435855126' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:43:57.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T09:43:58.222 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T09:43:58.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:43:58 smithi120 ceph-mon[31085]: pgmap v1168: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T09:43:58.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:43:58 smithi152 ceph-mon[34868]: pgmap v1168: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T09:43:58.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:43:58 smithi175 ceph-mon[35353]: pgmap v1168: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T09:44:00.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 -- 172.21.15.120:0/2067841381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c10a990 msgr2=0x7f627c10ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 --2- 172.21.15.120:0/2067841381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c10a990 0x7f627c10ada0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f626c009990 tx=0x7f626c009ca0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 -- 172.21.15.120:0/2067841381 shutdown_connections 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 --2- 172.21.15.120:0/2067841381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f627c110970 0x7f627c110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 --2- 172.21.15.120:0/2067841381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f627c10b2e0 0x7f627c117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 --2- 172.21.15.120:0/2067841381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c10a990 0x7f627c10ada0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 -- 172.21.15.120:0/2067841381 >> 172.21.15.120:0/2067841381 conn(0x7f627c077c80 msgr2=0x7f627c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 -- 172.21.15.120:0/2067841381 shutdown_connections 2024-05-14T09:44:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.547+0000 7f6280a00700 1 -- 172.21.15.120:0/2067841381 wait complete. 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.548+0000 7f6280a00700 1 Processor -- start 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f6280a00700 1 -- start start 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f6280a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f627c10a990 0x7f627c1a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f6280a00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f627c10b2e0 0x7f627c1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f6280a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c110970 0x7f627c1a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f6280a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f627c11a930 con 0x7f627c110970 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f6280a00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f627c11a7b0 con 0x7f627c10b2e0 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f6280a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f627c11aab0 con 0x7f627c10a990 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.549+0000 7f627a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c110970 0x7f627c1a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f627a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c110970 0x7f627c1a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51084/0 (socket says 172.21.15.120:51084) 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f6279e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f627c10a990 0x7f627c1a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:44:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f627a800700 1 -- 172.21.15.120:0/2365443056 learned_addr learned my addr 172.21.15.120:0/2365443056 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-05-14T09:44:00.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f6271400700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f627c10b2e0 0x7f627c1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:44:00.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f627a800700 1 -- 172.21.15.120:0/2365443056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f627c10a990 msgr2=0x7f627c1a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:44:00.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f627a800700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f627c10a990 0x7f627c1a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f627a800700 1 -- 172.21.15.120:0/2365443056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f627c10b2e0 msgr2=0x7f627c1a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:44:00.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f627a800700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f627c10b2e0 0x7f627c1a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.550+0000 7f627a800700 1 -- 172.21.15.120:0/2365443056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c1a6260 con 0x7f627c110970 2024-05-14T09:44:00.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.551+0000 7f627a800700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c110970 0x7f627c1a5c70 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f627400ada0 tx=0x7f627400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:44:00.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.551+0000 7f6273400700 1 -- 172.21.15.120:0/2365443056 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274017020 con 0x7f627c110970 2024-05-14T09:44:00.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.551+0000 7f6273400700 1 -- 172.21.15.120:0/2365443056 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f627400cd60 con 0x7f627c110970 2024-05-14T09:44:00.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.551+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c1a6550 con 0x7f627c110970 2024-05-14T09:44:00.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.551+0000 7f6273400700 1 -- 172.21.15.120:0/2365443056 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274005280 con 0x7f627c110970 2024-05-14T09:44:00.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.552+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c1a6a60 con 0x7f627c110970 2024-05-14T09:44:00.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.553+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c0512c0 con 0x7f627c110970 2024-05-14T09:44:00.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.556+0000 7f6273400700 1 -- 172.21.15.120:0/2365443056 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f627400c8d0 con 0x7f627c110970 2024-05-14T09:44:00.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:00 smithi120 ceph-mon[31085]: pgmap v1169: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-14T09:44:00.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.558+0000 7f6273400700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f62600b2900 0x7f62600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:44:00.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.559+0000 7f6273400700 1 -- 172.21.15.120:0/2365443056 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9166+0+0 (secure 0 0 0) 0x7f62740e2310 con 0x7f627c110970 2024-05-14T09:44:00.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.559+0000 7f6279e00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f62600b2900 0x7f62600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:44:00.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.560+0000 7f6279e00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f62600b2900 0x7f62600b4e10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f627c07d0f0 tx=0x7f626400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:44:00.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.561+0000 7f6273400700 1 -- 172.21.15.120:0/2365443056 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6274021020 con 0x7f627c110970 2024-05-14T09:44:00.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:00 smithi152 ceph-mon[34868]: pgmap v1169: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-14T09:44:00.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:00 smithi175 ceph-mon[35353]: pgmap v1169: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-14T09:44:00.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.811+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f627c02e5f0 con 0x7f627c110970 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.812+0000 7f6273400700 1 -- 172.21.15.120:0/2365443056 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+599 (secure 0 0 0) 0x7f62740a9cc0 con 0x7f627c110970 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/975840748 2024-05-15T09:07:40.065639+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1968421814 2024-05-15T09:07:40.065639+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2919660982 2024-05-15T09:07:04.655251+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/3992386407 2024-05-15T09:07:04.655251+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2419562786 2024-05-15T09:07:04.655251+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1457013957 2024-05-15T09:07:40.065639+0000 2024-05-14T09:44:00.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3562327753 2024-05-15T09:07:04.655251+0000 2024-05-14T09:44:00.814 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/119127043 2024-05-15T09:07:40.065639+0000 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f62600b2900 msgr2=0x7f62600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f62600b2900 0x7f62600b4e10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f627c07d0f0 tx=0x7f626400a380 comp rx=0 tx=0).stop 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c110970 msgr2=0x7f627c1a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c110970 0x7f627c1a5c70 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f627400ada0 tx=0x7f627400c330 comp rx=0 tx=0).stop 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 shutdown_connections 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:6800/197404993,v1:172.21.15.120:6801/197404993] conn(0x7f62600b2900 0x7f62600b4e10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f627c110970 0x7f627c1a5c70 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f627c10a990 0x7f627c1a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 --2- 172.21.15.120:0/2365443056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f627c10b2e0 0x7f627c1a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:44:00.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.815+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 >> 172.21.15.120:0/2365443056 conn(0x7f627c077c80 msgr2=0x7f627c07b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:44:00.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.816+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 shutdown_connections 2024-05-14T09:44:00.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-05-14T09:44:00.816+0000 7f6280a00700 1 -- 172.21.15.120:0/2365443056 wait complete. 2024-05-14T09:44:00.818 INFO:teuthology.orchestra.run.smithi120.stderr:listed 10 entries 2024-05-14T09:44:01.514 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:01 smithi120 ceph-mon[31085]: from='client.? 172.21.15.120:0/2365443056' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:44:01.591 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2024-05-14T09:44:01.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:44:01.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /tmp/cephfs 2024-05-14T09:44:01.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[90306]: fuse finished with error 0 and tester_r 0 2024-05-14T09:44:01.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:01 smithi152 ceph-mon[34868]: from='client.? 172.21.15.120:0/2365443056' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:44:01.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:01 smithi175 ceph-mon[35353]: from='client.? 172.21.15.120:0/2365443056' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T09:44:01.931 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T09:44:02.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:02 smithi120 ceph-mon[31085]: pgmap v1170: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:44:02.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:02 smithi152 ceph-mon[34868]: pgmap v1170: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:44:02.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:02 smithi175 ceph-mon[35353]: pgmap v1170: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T09:44:04.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:04 smithi120 ceph-mon[31085]: pgmap v1171: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-05-14T09:44:04.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:04 smithi152 ceph-mon[34868]: pgmap v1171: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-05-14T09:44:04.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:04 smithi175 ceph-mon[35353]: pgmap v1171: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-05-14T09:44:06.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:06 smithi120 ceph-mon[31085]: pgmap v1172: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-05-14T09:44:06.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:06 smithi152 ceph-mon[34868]: pgmap v1172: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-05-14T09:44:06.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:06 smithi175 ceph-mon[35353]: pgmap v1172: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-05-14T09:44:08.033 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T09:44:08.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:44:08.034 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-05-14T09:44:08.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:44:08.114 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-05-14T09:44:08.172 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-05-14T09:44:08.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:44:08.173 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-05-14T09:44:08.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:44:08.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-05-14T09:44:08.369 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-14T09:44:08.380 INFO:tasks.cephadm:Teardown begin 2024-05-14T09:44:08.380 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/cephadm.py", line 2273, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T09:44:08.381 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:44:08.460 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:44:08.528 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:08 smithi120 ceph-mon[31085]: pgmap v1173: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-05-14T09:44:08.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:44:08.631 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:08 smithi175 ceph-mon[35353]: pgmap v1173: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-05-14T09:44:08.656 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-14T09:44:08.656 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T09:44:08.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:08 smithi152 ceph-mon[34868]: pgmap v1173: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-05-14T09:44:08.716 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T09:44:08.775 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T09:44:08.832 INFO:tasks.cephadm:Stopping all daemons... 2024-05-14T09:44:08.832 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-14T09:44:08.832 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a 2024-05-14T09:44:09.385 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:08 smithi120 systemd[1]: Stopping Ceph mon.a for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:09.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:09 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[31080]: 2024-05-14T09:44:09.420+0000 7fa7dda00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:09.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:09 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a[31080]: 2024-05-14T09:44:09.420+0000 7fa7dda00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-14T09:44:09.885 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:09 smithi120 podman[115018]: 2024-05-14 09:44:09.605817661 +0000 UTC m=+0.333806679 container died 44b134424df38e531ac57ab5a15b96b5c3968f8573b5b2aa724f46699ff026b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-14T09:44:10.313 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:10 smithi120 podman[115018]: 2024-05-14 09:44:10.044278905 +0000 UTC m=+0.772267920 container cleanup 44b134424df38e531ac57ab5a15b96b5c3968f8573b5b2aa724f46699ff026b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5) 2024-05-14T09:44:10.313 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:10 smithi120 bash[115018]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a 2024-05-14T09:44:10.634 INFO:journalctl@ceph.mon.a.smithi120.stdout:May 14 09:44:10 smithi120 podman[115032]: 2024-05-14 09:44:10.312347152 +0000 UTC m=+0.684345056 container remove 44b134424df38e531ac57ab5a15b96b5c3968f8573b5b2aa724f46699ff026b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:44:10.878 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.a.service' 2024-05-14T09:44:11.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:11.016 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-14T09:44:11.016 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-14T09:44:11.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.b 2024-05-14T09:44:11.458 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:11 smithi152 systemd[1]: Stopping Ceph mon.b for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:11.958 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:11 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b[34864]: 2024-05-14T09:44:11.688+0000 7f4f02000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:11.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:11 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b[34864]: 2024-05-14T09:44:11.688+0000 7f4f02000700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-14T09:44:11.959 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:11 smithi152 podman[71733]: 2024-05-14 09:44:11.885461498 +0000 UTC m=+0.370171040 container died 75509f1e0e4134b46a713f62ebdd76144e691ea5657599e3ed0bb531a0bb8908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-14T09:44:12.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:12 smithi152 podman[71733]: 2024-05-14 09:44:12.394346909 +0000 UTC m=+0.879056487 container cleanup 75509f1e0e4134b46a713f62ebdd76144e691ea5657599e3ed0bb531a0bb8908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-14T09:44:12.708 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:12 smithi152 bash[71733]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b 2024-05-14T09:44:13.040 INFO:journalctl@ceph.mon.b.smithi152.stdout:May 14 09:44:12 smithi152 podman[71747]: 2024-05-14 09:44:12.778275419 +0000 UTC m=+0.857941591 container remove 75509f1e0e4134b46a713f62ebdd76144e691ea5657599e3ed0bb531a0bb8908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-14T09:44:13.073 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.b.service' 2024-05-14T09:44:13.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:13.190 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-14T09:44:13.191 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-14T09:44:13.191 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.c 2024-05-14T09:44:13.522 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:13 smithi175 systemd[1]: Stopping Ceph mon.c for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c[35344]: 2024-05-14T09:44:13.832+0000 7fdca7200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:14.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c[35344]: 2024-05-14T09:44:13.832+0000 7fdca7200700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-14T09:44:14.228 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:13 smithi175 podman[74042]: 2024-05-14 09:44:13.957127232 +0000 UTC m=+0.280923824 container died d5aa159258ef1bc67c16130904635ec090aa036f19fe6bd3eb655318c7eeae2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:44:14.693 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:14 smithi175 podman[74042]: 2024-05-14 09:44:14.466939975 +0000 UTC m=+0.790736557 container cleanup d5aa159258ef1bc67c16130904635ec090aa036f19fe6bd3eb655318c7eeae2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True) 2024-05-14T09:44:14.693 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:14 smithi175 bash[74042]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c 2024-05-14T09:44:14.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:May 14 09:44:14 smithi175 podman[74055]: 2024-05-14 09:44:14.693425081 +0000 UTC m=+0.717724083 container remove d5aa159258ef1bc67c16130904635ec090aa036f19fe6bd3eb655318c7eeae2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-14T09:44:15.143 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mon.c.service' 2024-05-14T09:44:15.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:15.267 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-14T09:44:15.267 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-14T09:44:15.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.x 2024-05-14T09:44:15.634 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:44:15 smithi120 systemd[1]: Stopping Ceph mgr.x for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:15.908 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:44:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:44:15.807+0000 7f75bfe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:15.908 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:44:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x[31325]: 2024-05-14T09:44:15.807+0000 7f75bfe00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-14T09:44:16.271 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:44:15 smithi120 podman[115142]: 2024-05-14 09:44:15.910336048 +0000 UTC m=+0.250225293 container died b226b2d5171a1191a840c5b9d83a4e7a98adb89ff329a93958b10f99b79a55b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T09:44:16.589 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:44:16 smithi120 podman[115142]: 2024-05-14 09:44:16.449252527 +0000 UTC m=+0.789141792 container cleanup b226b2d5171a1191a840c5b9d83a4e7a98adb89ff329a93958b10f99b79a55b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-14T09:44:16.589 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:44:16 smithi120 bash[115142]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x 2024-05-14T09:44:16.884 INFO:journalctl@ceph.mgr.x.smithi120.stdout:May 14 09:44:16 smithi120 podman[115154]: 2024-05-14 09:44:16.642690028 +0000 UTC m=+0.714961198 container remove b226b2d5171a1191a840c5b9d83a4e7a98adb89ff329a93958b10f99b79a55b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-x, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:44:17.134 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.x.service' 2024-05-14T09:44:17.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:17.233 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-14T09:44:17.233 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-14T09:44:17.233 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.y 2024-05-14T09:44:17.708 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:44:17 smithi152 systemd[1]: Stopping Ceph mgr.y for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:18.208 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:44:17 smithi152 podman[71865]: 2024-05-14 09:44:17.887987714 +0000 UTC m=+0.226083607 container died e61ff104d4bcfb878bb834eb8a2f9700cd67d21b3312a4e4c71605e39f30fc48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-14T09:44:18.505 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:44:18 smithi152 podman[71865]: 2024-05-14 09:44:18.474082362 +0000 UTC m=+0.812178291 container cleanup e61ff104d4bcfb878bb834eb8a2f9700cd67d21b3312a4e4c71605e39f30fc48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507) 2024-05-14T09:44:18.505 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:44:18 smithi152 bash[71865]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y 2024-05-14T09:44:19.208 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:44:18 smithi152 podman[71879]: 2024-05-14 09:44:18.725591812 +0000 UTC m=+0.819206998 container remove e61ff104d4bcfb878bb834eb8a2f9700cd67d21b3312a4e4c71605e39f30fc48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-14T09:44:19.208 INFO:journalctl@ceph.mgr.y.smithi152.stdout:May 14 09:44:18 smithi152 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-14T09:44:19.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.y.service' 2024-05-14T09:44:19.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:19.377 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-14T09:44:19.377 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-14T09:44:19.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.z 2024-05-14T09:44:19.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:44:19 smithi175 systemd[1]: Stopping Ceph mgr.z for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:20.369 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:44:20 smithi175 podman[74174]: 2024-05-14 09:44:20.021254815 +0000 UTC m=+0.227760471 container died 09f3351b5f0c721ca44e4ad5253e1e32dff6fbc23741e868a0498b000ea65b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-14T09:44:20.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:44:20 smithi175 podman[74174]: 2024-05-14 09:44:20.573110163 +0000 UTC m=+0.779615801 container cleanup 09f3351b5f0c721ca44e4ad5253e1e32dff6fbc23741e868a0498b000ea65b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-14T09:44:20.727 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:44:20 smithi175 bash[74174]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z 2024-05-14T09:44:21.228 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:44:20 smithi175 podman[74187]: 2024-05-14 09:44:20.807539869 +0000 UTC m=+0.769702657 container remove 09f3351b5f0c721ca44e4ad5253e1e32dff6fbc23741e868a0498b000ea65b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-05-14T09:44:21.228 INFO:journalctl@ceph.mgr.z.smithi175.stdout:May 14 09:44:20 smithi175 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-14T09:44:21.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mgr.z.service' 2024-05-14T09:44:21.405 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:21.405 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-14T09:44:21.405 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-14T09:44:21.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.0 2024-05-14T09:44:21.885 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:21 smithi120 systemd[1]: Stopping Ceph osd.0 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:22.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0[45374]: 2024-05-14T09:44:21.936+0000 7f8332000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:22.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0[45374]: 2024-05-14T09:44:21.936+0000 7f8332000700 -1 osd.0 90 *** Got signal Terminated *** 2024-05-14T09:44:22.385 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0[45374]: 2024-05-14T09:44:21.936+0000 7f8332000700 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:44:28.277 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:27 smithi120 podman[115274]: 2024-05-14 09:44:27.920650086 +0000 UTC m=+6.134710962 container died 945ae1b9a70b953894c16c6aaf34ab9c2814362b952db0317f1e2b55213fdfb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-14T09:44:28.634 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:28 smithi120 podman[115274]: 2024-05-14 09:44:28.428779312 +0000 UTC m=+6.642840181 container cleanup 945ae1b9a70b953894c16c6aaf34ab9c2814362b952db0317f1e2b55213fdfb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-05-14T09:44:28.635 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:28 smithi120 bash[115274]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0 2024-05-14T09:44:29.134 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:28 smithi120 podman[115294]: 2024-05-14 09:44:28.671732539 +0000 UTC m=+0.731880657 container remove 945ae1b9a70b953894c16c6aaf34ab9c2814362b952db0317f1e2b55213fdfb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:44:29.805 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:29 smithi120 podman[115380]: 2024-05-14 09:44:29.381231776 +0000 UTC m=+0.034876459 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:44:29.805 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:29 smithi120 podman[115380]: 2024-05-14 09:44:29.506195518 +0000 UTC m=+0.159840241 container create 3ce993659f899c918b399ae26704cd341535ea7f874e41fb0efb2633af2ff639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-14T09:44:29.805 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:29 smithi120 podman[115380]: 2024-05-14 09:44:29.804625268 +0000 UTC m=+0.458269994 container init 3ce993659f899c918b399ae26704cd341535ea7f874e41fb0efb2633af2ff639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-14T09:44:30.134 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:29 smithi120 podman[115380]: 2024-05-14 09:44:29.81673713 +0000 UTC m=+0.470381856 container start 3ce993659f899c918b399ae26704cd341535ea7f874e41fb0efb2633af2ff639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux ) 2024-05-14T09:44:30.134 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:29 smithi120 podman[115380]: 2024-05-14 09:44:29.942100012 +0000 UTC m=+0.595744778 container attach 3ce993659f899c918b399ae26704cd341535ea7f874e41fb0efb2633af2ff639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-05-14T09:44:31.066 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:30 smithi120 podman[115380]: 2024-05-14 09:44:30.793295455 +0000 UTC m=+1.446940179 container died 3ce993659f899c918b399ae26704cd341535ea7f874e41fb0efb2633af2ff639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-14T09:44:31.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.0.service' 2024-05-14T09:44:31.634 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:31 smithi120 podman[115407]: 2024-05-14 09:44:31.562847229 +0000 UTC m=+0.747530064 container remove 3ce993659f899c918b399ae26704cd341535ea7f874e41fb0efb2633af2ff639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-14T09:44:31.634 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:31 smithi120 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-14T09:44:31.634 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:31 smithi120 systemd[1]: Stopped Ceph osd.0 for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:44:31.634 INFO:journalctl@ceph.osd.0.smithi120.stdout:May 14 09:44:31 smithi120 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.0.service: Consumed 12min 40.482s CPU time. 2024-05-14T09:44:31.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:31.716 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-14T09:44:31.716 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-14T09:44:31.716 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.1 2024-05-14T09:44:32.208 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:31 smithi152 systemd[1]: Stopping Ceph osd.1 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:32.708 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1[39442]: 2024-05-14T09:44:32.351+0000 7f80ae400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:32.708 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1[39442]: 2024-05-14T09:44:32.351+0000 7f80ae400700 -1 osd.1 90 *** Got signal Terminated *** 2024-05-14T09:44:32.709 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1[39442]: 2024-05-14T09:44:32.351+0000 7f80ae400700 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:44:38.700 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:38 smithi152 podman[71992]: 2024-05-14 09:44:38.376709093 +0000 UTC m=+6.199570483 container died 303f8201c540fd52be9071d3a97605518321577cb44a948a2c9b339e0832ffe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-14T09:44:38.958 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:38 smithi152 podman[71992]: 2024-05-14 09:44:38.860542664 +0000 UTC m=+6.683404059 container cleanup 303f8201c540fd52be9071d3a97605518321577cb44a948a2c9b339e0832ffe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-14T09:44:38.958 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:38 smithi152 bash[71992]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1 2024-05-14T09:44:39.708 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:39 smithi152 podman[72011]: 2024-05-14 09:44:39.286926706 +0000 UTC m=+0.895087749 container remove 303f8201c540fd52be9071d3a97605518321577cb44a948a2c9b339e0832ffe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-14T09:44:40.223 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:39 smithi152 podman[72093]: 2024-05-14 09:44:39.875155904 +0000 UTC m=+0.036229102 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:44:40.223 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:40 smithi152 podman[72093]: 2024-05-14 09:44:40.00437972 +0000 UTC m=+0.165452956 container create e98694ace53e3ac2d818a4a0663f7c5aec7b18353def19eac0599c0d9b63d4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:44:40.515 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:40 smithi152 podman[72093]: 2024-05-14 09:44:40.366610378 +0000 UTC m=+0.527683618 container init e98694ace53e3ac2d818a4a0663f7c5aec7b18353def19eac0599c0d9b63d4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:44:40.515 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:40 smithi152 podman[72093]: 2024-05-14 09:44:40.378737176 +0000 UTC m=+0.539810416 container start e98694ace53e3ac2d818a4a0663f7c5aec7b18353def19eac0599c0d9b63d4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-14T09:44:40.515 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:40 smithi152 podman[72093]: 2024-05-14 09:44:40.515121916 +0000 UTC m=+0.676195155 container attach e98694ace53e3ac2d818a4a0663f7c5aec7b18353def19eac0599c0d9b63d4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD) 2024-05-14T09:44:41.390 INFO:journalctl@ceph.osd.1.smithi152.stdout:May 14 09:44:40 smithi152 podman[72093]: 2024-05-14 09:44:40.965313177 +0000 UTC m=+1.126386428 container died e98694ace53e3ac2d818a4a0663f7c5aec7b18353def19eac0599c0d9b63d4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-14T09:44:41.834 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.1.service' 2024-05-14T09:44:41.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:41.942 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-14T09:44:41.942 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-14T09:44:41.943 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.2 2024-05-14T09:44:42.478 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:42 smithi175 systemd[1]: Stopping Ceph osd.2 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:42.978 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2[40335]: 2024-05-14T09:44:42.523+0000 7f3c7fe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:42.978 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2[40335]: 2024-05-14T09:44:42.523+0000 7f3c7fe00700 -1 osd.2 90 *** Got signal Terminated *** 2024-05-14T09:44:42.978 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2[40335]: 2024-05-14T09:44:42.523+0000 7f3c7fe00700 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:44:48.891 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:48 smithi175 podman[74297]: 2024-05-14 09:44:48.563682907 +0000 UTC m=+6.195228906 container died d832cb389f0adfcd2b2ca0a50b1fc149eb94188d8af7f4ddf2acc068a88bba48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-14T09:44:49.136 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:48.860+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:49.228 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:49 smithi175 podman[74297]: 2024-05-14 09:44:49.025008242 +0000 UTC m=+6.656554234 container cleanup d832cb389f0adfcd2b2ca0a50b1fc149eb94188d8af7f4ddf2acc068a88bba48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:44:49.228 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:49 smithi175 bash[74297]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2 2024-05-14T09:44:49.727 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:49 smithi175 podman[74313]: 2024-05-14 09:44:49.265434899 +0000 UTC m=+0.691597754 container remove d832cb389f0adfcd2b2ca0a50b1fc149eb94188d8af7f4ddf2acc068a88bba48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:44:49.832 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:49.649+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:50.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:49.831+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:50.235 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:50.183+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:50.235 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:49 smithi175 podman[74400]: 2024-05-14 09:44:49.886744583 +0000 UTC m=+0.031635989 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:44:50.235 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:50 smithi175 podman[74400]: 2024-05-14 09:44:50.052278142 +0000 UTC m=+0.197169570 container create c104ca2012127ccb9e62439ac21d320fcf4c714a58c1a5c9faebec9f0f5e5aed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-05-14T09:44:50.584 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:50 smithi175 podman[74400]: 2024-05-14 09:44:50.356517127 +0000 UTC m=+0.501408568 container init c104ca2012127ccb9e62439ac21d320fcf4c714a58c1a5c9faebec9f0f5e5aed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:44:50.584 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:50 smithi175 podman[74400]: 2024-05-14 09:44:50.366890514 +0000 UTC m=+0.511781911 container start c104ca2012127ccb9e62439ac21d320fcf4c714a58c1a5c9faebec9f0f5e5aed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-14T09:44:50.584 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:50 smithi175 podman[74400]: 2024-05-14 09:44:50.463770458 +0000 UTC m=+0.608661939 container attach c104ca2012127ccb9e62439ac21d320fcf4c714a58c1a5c9faebec9f0f5e5aed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-14T09:44:51.134 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:50.680+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:51.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:50.783+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:51.227 INFO:journalctl@ceph.osd.2.smithi175.stdout:May 14 09:44:51 smithi175 podman[74400]: 2024-05-14 09:44:51.040488263 +0000 UTC m=+1.185379669 container died c104ca2012127ccb9e62439ac21d320fcf4c714a58c1a5c9faebec9f0f5e5aed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-14T09:44:51.697 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:51.231+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:51.840 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.2.service' 2024-05-14T09:44:51.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:44:51.936 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-14T09:44:51.936 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-14T09:44:51.936 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.3 2024-05-14T09:44:51.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:51.696+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:52.010 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:51.697+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:52.010 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:51.771+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:52.384 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:52 smithi120 systemd[1]: Stopping Ceph osd.3 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:44:52.519 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:52.243+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:52.885 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:52.504+0000 7f7387c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:44:52.885 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:52.504+0000 7f7387c00700 -1 osd.3 90 *** Got signal Terminated *** 2024-05-14T09:44:52.885 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:52.504+0000 7f7387c00700 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:44:52.885 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:52.718+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:52.886 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:52.726+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:52.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:52.518+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:52.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:52.698+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:53.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:52.888+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:44:53.477 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:53.212+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:53.700 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:44:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:44:53.422+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:44:53.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:53.493+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:53.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:53.650+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:54.134 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:53.708+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:54.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:53.699+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:54.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:53.875+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:44:54.477 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:54.222+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:54.477 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:54.444+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:54.704 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:44:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:44:54.393+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:44:54.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:54.661+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:55.134 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:54.704+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:55.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:54.728+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:55.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:54.903+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:44:55.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:44:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:44:55.350+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:44:55.686 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:55.265+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:55.686 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:55.483+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:55.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:55.685+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:56.134 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:55.719+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:56.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:55.760+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:56.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:55.906+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:44:56.492 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:56.239+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:56.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:44:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:44:56.335+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:44:56.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:56.492+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:56.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:56.733+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:57.134 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3[51822]: 2024-05-14T09:44:56.765+0000 7f737e400700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.180861+0000 front 2024-05-14T09:44:24.181256+0000 (oldest deadline 2024-05-14T09:44:48.880550+0000) 2024-05-14T09:44:57.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:56.718+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:57.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:56.929+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:44:57.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:44:57 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:44:57.327+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:44:57.727 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:57.231+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:57.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:57.466+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:58.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:57 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:57.708+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:58.217 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:57.769+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:58.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:57.972+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:44:58.477 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:58.217+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:58.477 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:58.453+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:58.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:44:58 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:44:58.329+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:44:58.634 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:58 smithi120 podman[115509]: 2024-05-14 09:44:58.346048687 +0000 UTC m=+5.985229891 container died d63cf4e8068b6a4168a23b7daee398968556e18715f8034f75302b7f9d34769e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-14T09:44:58.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:58.724+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:44:59.083 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:58 smithi120 podman[115509]: 2024-05-14 09:44:58.798009983 +0000 UTC m=+6.437191219 container cleanup d63cf4e8068b6a4168a23b7daee398968556e18715f8034f75302b7f9d34769e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:44:59.084 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:58 smithi120 bash[115509]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3 2024-05-14T09:44:59.084 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:58 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:58.717+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:44:59.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:58.922+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:44:59.384 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:59 smithi120 podman[115526]: 2024-05-14 09:44:59.082498909 +0000 UTC m=+0.716971512 container remove d63cf4e8068b6a4168a23b7daee398968556e18715f8034f75302b7f9d34769e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-14T09:44:59.384 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:44:59 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:44:59.311+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:44:59.727 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:44:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:44:59.243+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:44:59.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:59.443+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:44:59.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:44:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:44:59.443+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:00.116 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:44:59 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:44:59.744+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:00.116 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:59 smithi120 podman[115617]: 2024-05-14 09:44:59.809247097 +0000 UTC m=+0.032602940 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:45:00.116 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:44:59 smithi120 podman[115617]: 2024-05-14 09:44:59.950080029 +0000 UTC m=+0.173435917 container create 4da31fe9f520b8ae5f24e37d46f67a3569916a282389128e5312641012c541ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-14T09:45:00.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:44:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:44:59.951+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:00.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:44:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:44:59.763+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:00.384 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:00.325+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:00.385 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:45:00 smithi120 podman[115617]: 2024-05-14 09:45:00.237463459 +0000 UTC m=+0.460819427 container init 4da31fe9f520b8ae5f24e37d46f67a3569916a282389128e5312641012c541ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-14T09:45:00.385 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:45:00 smithi120 podman[115617]: 2024-05-14 09:45:00.248195027 +0000 UTC m=+0.471550881 container start 4da31fe9f520b8ae5f24e37d46f67a3569916a282389128e5312641012c541ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-05-14T09:45:00.385 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:45:00 smithi120 podman[115617]: 2024-05-14 09:45:00.319286808 +0000 UTC m=+0.542642715 container attach 4da31fe9f520b8ae5f24e37d46f67a3569916a282389128e5312641012c541ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-14T09:45:00.723 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:00.472+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:00.723 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:00.472+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:00.723 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:00.238+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:00.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:00.722+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:00.722+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:01.118 INFO:journalctl@ceph.osd.3.smithi120.stdout:May 14 09:45:00 smithi120 podman[115617]: 2024-05-14 09:45:00.700109861 +0000 UTC m=+0.923465772 container died 4da31fe9f520b8ae5f24e37d46f67a3569916a282389128e5312641012c541ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:45:01.118 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:00.704+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:01.118 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:00 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:00.704+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:01.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:00.925+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:01.384 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:01 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:01.365+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:01.384 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:01 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:01.365+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:01.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.3.service' 2024-05-14T09:45:01.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:45:01.671 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-14T09:45:01.671 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-14T09:45:01.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.4 2024-05-14T09:45:01.688 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:01.477+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:01.689 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:01.477+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:01.689 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:01.267+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:01.884 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:01 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:01.673+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:01.885 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:01 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:01.673+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:01.912 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:01.608+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:01.913 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:01 smithi152 systemd[1]: Stopping Ceph osd.4 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:45:01.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:01.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:01.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:01.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:02.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:01.912+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:02.620 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4[46037]: 2024-05-14T09:45:02.252+0000 7f5ff1200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:45:02.621 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4[46037]: 2024-05-14T09:45:02.252+0000 7f5ff1200700 -1 osd.4 90 *** Got signal Terminated *** 2024-05-14T09:45:02.621 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4[46037]: 2024-05-14T09:45:02.252+0000 7f5ff1200700 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:45:02.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:02.374+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:02.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:02.374+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:02.686 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:02.280+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:02.687 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:02.466+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:02.687 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:02.466+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:02.951 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:02.619+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:02.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:02.686+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:02.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:02.686+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:03.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:02.638+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:03.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:02 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:02.638+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:03.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:02.950+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:03.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:02.950+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:03.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:03.348+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:03.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:03.348+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:03.693 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:03.252+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:03.694 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:03.447+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:03.694 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:03.447+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:03.918 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:03.635+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:03.919 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4[46037]: 2024-05-14T09:45:03.501+0000 7f5fe7a00700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.831011+0000 front 2024-05-14T09:44:32.830952+0000 (oldest deadline 2024-05-14T09:45:03.432564+0000) 2024-05-14T09:45:03.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:03.693+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:03.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:03.693+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:04.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:03.670+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:04.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:03 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:03.670+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:04.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:03.918+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:04.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:03.918+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:04.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:04 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:04.342+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:04.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:04 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:04.342+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:04.646 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:04.267+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:04.646 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:04.267+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:04.647 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:04.474+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:04.647 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:04.474+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:04.885 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:04.666+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:04.885 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4[46037]: 2024-05-14T09:45:04.507+0000 7f5fe7a00700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.831011+0000 front 2024-05-14T09:44:32.830952+0000 (oldest deadline 2024-05-14T09:45:03.432564+0000) 2024-05-14T09:45:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:04.646+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:04.646+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:05.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:04 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:04.644+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:05.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:04 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:04.644+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:05.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:04.885+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:05.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:04.885+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:05.623 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:05.310+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:05.623 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:05.310+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:05.623 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:05.516+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:05.623 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:05.516+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:05.627 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:05 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:05.323+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:05.628 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:05 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:05.323+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:05.884 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:05 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:05.628+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:05.884 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:05 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:05.628+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:05.905 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:05.659+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:05.905 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4[46037]: 2024-05-14T09:45:05.514+0000 7f5fe7a00700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.831011+0000 front 2024-05-14T09:44:32.830952+0000 (oldest deadline 2024-05-14T09:45:03.432564+0000) 2024-05-14T09:45:05.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:05.622+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:05.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:05.622+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:06.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:05.905+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:06.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:05.905+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:06.617 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:06.262+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:06.617 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:06.262+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:06.617 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:06.494+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:06.618 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:06.494+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:06.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:06 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:06.275+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:06.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:06 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:06.275+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:06.946 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:06.710+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:06.946 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4[46037]: 2024-05-14T09:45:06.504+0000 7f5fe7a00700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.831011+0000 front 2024-05-14T09:44:32.830952+0000 (oldest deadline 2024-05-14T09:45:03.432564+0000) 2024-05-14T09:45:06.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:06.617+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:06.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:06.617+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:07.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:06 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:06.635+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:07.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:06 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:06.635+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:07.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:06.946+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:07.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:06.946+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:07.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:07 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:07.291+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:07.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:07 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:07.291+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:07.647 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:07.474+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:07.647 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:07.474+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:07.648 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:07.310+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:07.648 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:07.310+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:07.944 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:07 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:07.664+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:07.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:07.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:07.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:07.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:08.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:07 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:07.680+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:08.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:07 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:07.680+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:08.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:07 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:07.943+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:08.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:07 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:07.943+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:08.557 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:08 smithi152 podman[72209]: 2024-05-14 09:45:08.213251593 +0000 UTC m=+6.125843736 container died cce87c9a0997cbdc247e74ef2b890ebdf5e30f16ed6b05c69140c402c63e70b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:45:08.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:08 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:08.313+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:08.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:08 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:08.313+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:08.642 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:08.311+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:08.642 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:08.311+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:08.642 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:08.519+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:08.642 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:08.519+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:08.934 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:08 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:08.689+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:08.934 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:08 smithi152 podman[72209]: 2024-05-14 09:45:08.745467571 +0000 UTC m=+6.658059724 container cleanup cce87c9a0997cbdc247e74ef2b890ebdf5e30f16ed6b05c69140c402c63e70b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True) 2024-05-14T09:45:08.934 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:08 smithi152 bash[72209]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4 2024-05-14T09:45:08.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:08.641+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:08.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:08.641+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:09.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:08 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:08.704+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:09.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:08 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:08.704+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:09.208 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:09 smithi152 podman[72227]: 2024-05-14 09:45:09.094850066 +0000 UTC m=+0.854681197 container remove cce87c9a0997cbdc247e74ef2b890ebdf5e30f16ed6b05c69140c402c63e70b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:45:09.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:08 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:08.932+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:09.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:08 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:08.932+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:09.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:09 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:09.307+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:09.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:09 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:09.307+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:09.687 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:09.495+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:09.687 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:09.495+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:09.688 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:09.317+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:09.688 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:09.317+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:09.688 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:09.317+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:09.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:09.686+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:09.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:09.686+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:09.987 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:09 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:09.730+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:09.988 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:09 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:09.927+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:09.988 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:09 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:09.927+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:10.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:09 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:09.720+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:10.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:09 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:09.720+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:10.245 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:09 smithi152 podman[72314]: 2024-05-14 09:45:09.892428133 +0000 UTC m=+0.031761438 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:45:10.245 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:10 smithi152 podman[72314]: 2024-05-14 09:45:10.05623362 +0000 UTC m=+0.195566961 container create 314d7ae76d76007e0592ed57faeea2a2698aea97b0130c73ea1206330d676604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:45:10.525 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:10 smithi152 podman[72314]: 2024-05-14 09:45:10.418068102 +0000 UTC m=+0.557401466 container init 314d7ae76d76007e0592ed57faeea2a2698aea97b0130c73ea1206330d676604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-05-14T09:45:10.526 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:10 smithi152 podman[72314]: 2024-05-14 09:45:10.428494447 +0000 UTC m=+0.567827756 container start 314d7ae76d76007e0592ed57faeea2a2698aea97b0130c73ea1206330d676604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:45:10.526 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:10 smithi152 podman[72314]: 2024-05-14 09:45:10.525257394 +0000 UTC m=+0.664590755 container attach 314d7ae76d76007e0592ed57faeea2a2698aea97b0130c73ea1206330d676604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-14T09:45:10.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:10 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:10.286+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:10.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:10 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:10.286+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:10.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:10 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:10.286+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:10.687 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:10.518+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:10.687 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:10.518+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:10.687 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:10.346+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:10.687 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:10.346+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:10.687 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:10.346+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:10.887 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:10 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:10.727+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:10.887 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:10 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:10.727+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:10.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:10.686+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:10.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:10.686+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:10.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:10.686+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:11.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:10 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:10.768+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:11.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:10 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:10.768+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:11.208 INFO:journalctl@ceph.osd.4.smithi152.stdout:May 14 09:45:10 smithi152 podman[72314]: 2024-05-14 09:45:10.887784641 +0000 UTC m=+1.027117947 container died 314d7ae76d76007e0592ed57faeea2a2698aea97b0130c73ea1206330d676604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-14T09:45:11.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:10 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:10.968+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:11.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:10 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:10.968+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:11.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:11.312+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:11.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:11.312+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:11.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:11.312+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:11.725 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:11.510+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:11.725 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:11.510+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:11.726 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:11.338+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:11.726 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:11.338+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:11.726 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:11.338+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:11.747 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.4.service' 2024-05-14T09:45:11.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:45:11.854 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-14T09:45:11.855 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-14T09:45:11.855 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.5 2024-05-14T09:45:11.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:11 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:11.745+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:11.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:11 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:11.745+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:11.975 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:11.725+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:11.976 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:11.725+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:11.976 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:11.725+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:12.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:11.784+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:12.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:11.784+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:12.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:11 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:11.784+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:12.227 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:11 smithi175 systemd[1]: Stopping Ceph osd.5 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:45:12.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:12 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:12.007+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:12.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:12 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:12.007+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:12.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:12 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:12.292+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:12.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:12 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:12.292+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:12.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:12 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:12.292+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:12.718 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:12.547+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:12.718 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:12.547+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:12.718 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:12.385+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:12.718 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:12.385+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:12.719 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:12.385+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:12.719 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:12.392+0000 7fd254200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:45:12.719 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:12.392+0000 7fd254200700 -1 osd.5 90 *** Got signal Terminated *** 2024-05-14T09:45:12.719 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:12.392+0000 7fd254200700 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:45:12.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:12.718+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:12.718+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:12.718+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:13.053 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:12 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:12.717+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:13.053 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:12 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:12.717+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:13.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:12 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:12.761+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:13.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:12 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:12.761+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:13.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:12 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:12.761+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:13.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:13 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:13.052+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:13.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:13 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:13.052+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:13.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:13 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:13.052+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:13.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:13 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:13.313+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:13.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:13 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:13.313+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:13.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:13 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:13.313+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:13.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:13.528+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:13.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:13.528+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:13.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:13.528+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:13.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:13.339+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:13.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:13.339+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:13.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:13.339+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:14.067 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:13 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:13.709+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:14.067 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:13 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:13.709+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:14.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:13 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:13.751+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:14.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:13 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:13.751+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:14.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:13 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:13.751+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:14.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:13.737+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:14.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:13.737+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:14.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:13.737+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:14.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:14 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:14.066+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:14.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:14 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:14.066+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:14.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:14 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:14.066+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:14.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:14 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:14.342+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:14.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:14 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:14.342+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:14.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:14 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:14.342+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:14.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:14.530+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:14.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:14.530+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:14.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:14.530+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:14.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:14.367+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:14.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:14.367+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:14.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:14.367+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:15.095 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:14 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:14.721+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:15.095 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:14 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:14.721+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:15.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:14 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:14.747+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:15.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:14 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:14.747+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:15.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:14 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:14.747+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:15.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:14.766+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:15.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:14.766+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:15.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:14.766+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:15.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:15 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:15.094+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:15.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:15 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:15.094+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:15.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:15 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:15.094+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:15.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:15.346+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:15.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:15.346+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:15.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:15.346+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:15.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:15.518+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:15.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:15.518+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:15.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:15.518+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:15.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:15.318+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:15.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:15.318+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:15.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:15.318+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:16.046 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:15 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:15.748+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:16.047 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:15 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:15.748+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:16.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:15.716+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:16.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:15.716+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:16.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:15 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:15.716+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:16.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:15.743+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:16.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:15.743+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:16.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:15.743+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:16.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:16 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:16.045+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:16.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:16 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:16.045+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:16.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:16 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:16.045+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:16.561 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:16.302+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:16.562 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:16.302+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:16.562 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:16.302+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:16.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:16 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:16.337+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:16.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:16 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:16.337+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:16.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:16 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:16.337+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:16.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:16.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:16.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:16.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:16.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:16.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:16.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:16.754+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:16.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:16.754+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:16.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:16.754+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:17.049 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:16 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:16.720+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:17.049 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:16 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:16.720+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:17.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:16 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:16.731+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:17.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:16 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:16.731+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:17.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:16 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:16.731+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:17.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:17 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:17.048+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:17.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:17 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:17.048+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:17.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:17 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:17.048+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:17.576 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:17.255+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.119210+0000 front 2024-05-14T09:44:24.119280+0000 (oldest deadline 2024-05-14T09:44:49.419422+0000) 2024-05-14T09:45:17.576 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:17.255+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.926720+0000 front 2024-05-14T09:44:36.926782+0000 (oldest deadline 2024-05-14T09:45:03.328647+0000) 2024-05-14T09:45:17.576 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5[47359]: 2024-05-14T09:45:17.255+0000 7fd24aa00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:43.330006+0000 front 2024-05-14T09:44:43.329928+0000 (oldest deadline 2024-05-14T09:45:09.230190+0000) 2024-05-14T09:45:17.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:17 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:17.359+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:17.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:17 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:17.359+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:17.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:17 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:17.359+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:17.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:17.574+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:17.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:17.574+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:17.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:17.574+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:17.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:17.709+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:17.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:17.709+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:17.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:17 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:17.709+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:18.028 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:17 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:17.738+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:18.028 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:17 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:17.738+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:18.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:17 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:17.759+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:18.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:17 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:17.759+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:18.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:17 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:17.759+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:18.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:18 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:18.027+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:18.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:18 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:18.027+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:18.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:18 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:18.027+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:18.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:18 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:18.363+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:18.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:18 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:18.363+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:18.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:18 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:18.363+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:18.733 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:18 smithi175 podman[74516]: 2024-05-14 09:45:18.480015058 +0000 UTC m=+6.203605414 container died 81c2ec005abb40880c571255f0917788ffddf3bb63d5129fe70ea2ff24a2f2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T09:45:18.734 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:18.544+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:18.734 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:18.544+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:18.734 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:18.544+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:18.994 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:18.731+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:18.994 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:18.731+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:18.994 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:18 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:18.731+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:18.994 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:18 smithi175 podman[74516]: 2024-05-14 09:45:18.969724502 +0000 UTC m=+6.693314908 container cleanup 81c2ec005abb40880c571255f0917788ffddf3bb63d5129fe70ea2ff24a2f2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-14T09:45:18.994 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:18 smithi175 bash[74516]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5 2024-05-14T09:45:19.040 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:18 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:18.788+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:19.040 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:18 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:18.788+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:19.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:18 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:18.780+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:19.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:18 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:18.780+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:19.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:18 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:18.780+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:19.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:18 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:18.780+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:19.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:19.040+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:19.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:19.040+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:19.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:19.040+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:19.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:19.040+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:19.477 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:19 smithi175 podman[74533]: 2024-05-14 09:45:19.196249195 +0000 UTC m=+0.706472197 container remove 81c2ec005abb40880c571255f0917788ffddf3bb63d5129fe70ea2ff24a2f2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-14T09:45:19.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:19 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:19.332+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:19.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:19 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:19.332+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:19.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:19 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:19.332+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:19.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:19.542+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:19.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:19.542+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:19.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:19.542+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:19.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:19.782+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:19.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:19.782+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:19.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:19 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:19.782+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:20.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:19 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:19.777+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:20.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:19 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:19.777+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:20.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:19 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:19.777+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:20.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:19 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:19.777+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:20.208 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:19.819+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:20.208 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:19 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:19.819+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:20.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:20.029+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:20.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:20.029+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:20.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:20.029+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:20.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:20.029+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:20.354 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:20 smithi175 podman[74619]: 2024-05-14 09:45:19.909361761 +0000 UTC m=+0.033950375 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:45:20.354 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:20 smithi175 podman[74619]: 2024-05-14 09:45:20.064012181 +0000 UTC m=+0.188600827 container create e97fb8d69852ff38d0eb9fdfffa7b6a0e7ae54ff154366111f94091867b55085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:45:20.354 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:20 smithi175 podman[74619]: 2024-05-14 09:45:20.352867195 +0000 UTC m=+0.477455878 container init e97fb8d69852ff38d0eb9fdfffa7b6a0e7ae54ff154366111f94091867b55085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-14T09:45:20.502 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:20.283+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:20.502 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:20.283+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:20.503 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:20.283+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:20.503 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:20.283+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:20.727 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:20 smithi175 podman[74619]: 2024-05-14 09:45:20.367667002 +0000 UTC m=+0.492255620 container start e97fb8d69852ff38d0eb9fdfffa7b6a0e7ae54ff154366111f94091867b55085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-14T09:45:20.727 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:20 smithi175 podman[74619]: 2024-05-14 09:45:20.451668515 +0000 UTC m=+0.576257187 container attach e97fb8d69852ff38d0eb9fdfffa7b6a0e7ae54ff154366111f94091867b55085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-14T09:45:20.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:20.544+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:20.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:20.544+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:20.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:20.544+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:21.070 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:20.773+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:21.070 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:20 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:20.773+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:21.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:20.760+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:21.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:20.760+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:21.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:20.760+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:21.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:20 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:20.760+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:21.184 INFO:journalctl@ceph.osd.5.smithi175.stdout:May 14 09:45:20 smithi175 podman[74619]: 2024-05-14 09:45:20.793477879 +0000 UTC m=+0.918066510 container died e97fb8d69852ff38d0eb9fdfffa7b6a0e7ae54ff154366111f94091867b55085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-14T09:45:21.184 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:20.828+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:21.184 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:20.828+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:21.184 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:20.828+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:21.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:21.069+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:21.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:21.069+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:21.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:21.069+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:21.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:21.069+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:21.604 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.5.service' 2024-05-14T09:45:21.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:21.278+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:21.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:21.278+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:21.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:21.278+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:21.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:21.278+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:21.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:45:21.697 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-14T09:45:21.697 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-14T09:45:21.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.6 2024-05-14T09:45:21.791 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:21.520+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:21.791 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:21.520+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:21.791 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:21.520+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:22.055 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:21.795+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:22.055 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:21.795+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:22.055 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:21 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:21.795+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:22.134 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:21 smithi120 systemd[1]: Stopping Ceph osd.6 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:45:22.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:21.772+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:22.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:21.772+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:22.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:21.772+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:22.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:21.772+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:22.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:21.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:22.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:21.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:22.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:21.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:22.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:21 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:21.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:22.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:22.054+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:22.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:22.054+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:22.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:22.054+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:22.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:22.054+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:22.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:22.252+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:22.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:22.252+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:22.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:22.252+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:22.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:22.252+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:22.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:22.288+0000 7f9621200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:45:22.636 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:22.288+0000 7f9621200700 -1 osd.6 90 *** Got signal Terminated *** 2024-05-14T09:45:22.636 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:22.288+0000 7f9621200700 -1 osd.6 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:22.772+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:22.772+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:22.772+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:22.772+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:22.538+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:22.538+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:22.538+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:22.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:22 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:22.538+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:23.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:22.778+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:23.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:22.778+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:23.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:22.778+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:23.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:22 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:22.778+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:23.208 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:22.799+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:23.209 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:22.799+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:23.209 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:22 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:22.799+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:23.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:23.013+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:23.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:23.013+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:23.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:23.013+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:23.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:23.013+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:23.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:23.247+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:23.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:23.247+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:23.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:23.247+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:23.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:23.247+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:23.790 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:23.497+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:23.790 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:23.497+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:23.790 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:23.497+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:23.790 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:23.497+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:23.900 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:23.779+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:23.900 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:23.779+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:23.900 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:23 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:23.779+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:24.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:23.762+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:24.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:23.762+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:24.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:23.762+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:24.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:23 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:23.762+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:24.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.017+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:24.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.017+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:24.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.017+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:24.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.017+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:24.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:23.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:24.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:23.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:24.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:23.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:24.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:23 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:23.789+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:24.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:24.249+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:24.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:24.249+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:24.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:24.249+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:24.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:24.249+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:24.806 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:24.530+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:24.806 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:24.530+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:24.806 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:24.530+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:24.806 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:24.530+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:25.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:24.775+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:25.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:24.775+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:25.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:24.775+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:25.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:24 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:24.775+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:25.208 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:24.784+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:25.208 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:24.784+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:25.209 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:24.784+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:25.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.984+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:25.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.984+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:25.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.984+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:25.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:24 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:24.984+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:25.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:24.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:25.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:24.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:25.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:24.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:25.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:24 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:24.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:25.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:25.240+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:25.687 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:25.240+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:25.687 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:25.240+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:25.687 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:25.240+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:25.798 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:25.541+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:25.798 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:25.541+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:25.798 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:25.541+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:25.798 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:25.541+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:26.034 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:25 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:25.755+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:26.035 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:25 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:25.755+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:26.035 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:25 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:25.755+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:26.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:25.741+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:26.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:25.741+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:26.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:25.741+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:26.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:25 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:25.741+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:26.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:25.797+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:26.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:25.797+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:26.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:25.797+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:26.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:25 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:25.797+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:26.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:26.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:26.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:26.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:26.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:26.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:26.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:26.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:26.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:26.224+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:26.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:26.224+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:26.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:26.224+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:26.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:26.224+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:26.806 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:26.510+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:26.807 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:26.510+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:26.807 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:26.510+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:26.807 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:26.510+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:27.031 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:26.750+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:27.031 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:26.750+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:27.031 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:26 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:26.750+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:27.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:26.731+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:27.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:26.731+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:27.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:26.731+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:27.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:26 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:26.731+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:27.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:26.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:27.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:26.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:27.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:26.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:27.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:26 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:26.805+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:27.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:27.030+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:27.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:27.030+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:27.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:27.030+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:27.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:27.030+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:27.634 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:27.269+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:24.313308+0000 front 2024-05-14T09:44:24.313750+0000 (oldest deadline 2024-05-14T09:44:53.115069+0000) 2024-05-14T09:45:27.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:27.269+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.919334+0000 front 2024-05-14T09:44:35.919397+0000 (oldest deadline 2024-05-14T09:45:01.219474+0000) 2024-05-14T09:45:27.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:27.269+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.426671+0000 front 2024-05-14T09:44:44.426609+0000 (oldest deadline 2024-05-14T09:45:09.726894+0000) 2024-05-14T09:45:27.635 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6[58885]: 2024-05-14T09:45:27.269+0000 7f961ca00700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.633564+0000 front 2024-05-14T09:44:56.633649+0000 (oldest deadline 2024-05-14T09:45:20.133812+0000) 2024-05-14T09:45:27.787 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:27.502+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:27.787 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:27.502+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:27.787 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:27.502+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:27.787 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:27.502+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:28.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:27.767+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:28.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:27.767+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:28.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:27.767+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:28.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:27.767+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:28.208 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:27.796+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:28.208 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:27.796+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:28.209 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:27 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:27.796+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:28.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:28.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:28.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:28.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:28.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:28.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:28.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:28.034+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:28.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:27.786+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:28.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:27.786+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:28.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:27.786+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:28.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:27.786+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:28.439 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:28 smithi120 podman[115732]: 2024-05-14 09:45:28.16491205 +0000 UTC m=+6.029281005 container died dc319a5f960b80a02cbf3580e7d3015874ac382e16d89aa8bceeca15fc510ee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:45:28.784 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:28 smithi120 podman[115732]: 2024-05-14 09:45:28.574943243 +0000 UTC m=+6.439312221 container cleanup dc319a5f960b80a02cbf3580e7d3015874ac382e16d89aa8bceeca15fc510ee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-14T09:45:28.784 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:28 smithi120 bash[115732]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6 2024-05-14T09:45:28.821 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:28.521+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:28.821 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:28.521+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:28.821 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:28.521+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:28.821 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:28.521+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:28.821 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:28.521+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:29.042 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:28.757+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:29.042 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:28.757+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:29.042 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:28 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:28.757+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:29.134 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:28 smithi120 podman[115749]: 2024-05-14 09:45:28.78422369 +0000 UTC m=+0.589870284 container remove dc319a5f960b80a02cbf3580e7d3015874ac382e16d89aa8bceeca15fc510ee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-14T09:45:29.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:28 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:28.813+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:29.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:28 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:28.813+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:29.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:28 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:28.813+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:29.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:28 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:28.813+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:29.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:28.820+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:29.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:28.820+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:29.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:28.820+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:29.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:28.820+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:29.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:28 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:28.820+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:29.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:29 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:29.041+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:29.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:29 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:29.041+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:29.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:29 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:29.041+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:29.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:29 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:29.041+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:29.784 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:29.488+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:29.784 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:29.488+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:29.784 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:29.488+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:29.784 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:29.488+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:29.784 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:29.488+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:30.008 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:29 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:29.714+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:30.008 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:29 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:29.714+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:30.008 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:29 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:29.714+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:30.022 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:29 smithi120 podman[115836]: 2024-05-14 09:45:29.540721888 +0000 UTC m=+0.034988020 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:45:30.022 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:29 smithi120 podman[115836]: 2024-05-14 09:45:29.676840671 +0000 UTC m=+0.171106833 container create 0bb90063f81dd1b86211ca78b2da69ab20e2d82c5ff76c53be4f96b64eed7a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:45:30.022 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:30 smithi120 podman[115836]: 2024-05-14 09:45:30.021751512 +0000 UTC m=+0.516017657 container init 0bb90063f81dd1b86211ca78b2da69ab20e2d82c5ff76c53be4f96b64eed7a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T09:45:30.022 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:29 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:29.826+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:30.022 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:29 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:29.826+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:30.023 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:29 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:29.826+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:30.023 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:29 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:29.826+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:30.023 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:29 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:29.826+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:30.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:29.783+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:30.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:29.783+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:30.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:29.783+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:30.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:29.783+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:30.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:29 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:29.783+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:30.384 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:30 smithi120 podman[115836]: 2024-05-14 09:45:30.033569514 +0000 UTC m=+0.527835668 container start 0bb90063f81dd1b86211ca78b2da69ab20e2d82c5ff76c53be4f96b64eed7a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-14T09:45:30.384 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:30 smithi120 podman[115836]: 2024-05-14 09:45:30.137682094 +0000 UTC m=+0.631948303 container attach 0bb90063f81dd1b86211ca78b2da69ab20e2d82c5ff76c53be4f96b64eed7a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True) 2024-05-14T09:45:30.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:30 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:30.007+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:30.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:30 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:30.007+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:30.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:30 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:30.007+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:30.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:30 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:30.007+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:30.813 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:30 smithi120 podman[115836]: 2024-05-14 09:45:30.484372064 +0000 UTC m=+0.978638228 container died 0bb90063f81dd1b86211ca78b2da69ab20e2d82c5ff76c53be4f96b64eed7a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-14T09:45:30.828 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:30.482+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:30.828 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:30.482+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:30.828 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:30.482+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:30.828 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:30.482+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:30.828 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:30.482+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:31.036 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:30 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:30.726+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:31.037 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:30 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:30.726+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:31.037 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:30 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:30.726+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:31.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:30.811+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:31.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:30.811+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:31.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:30.811+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:31.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:30.811+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:31.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:30 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:30.811+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:31.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:30.826+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:31.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:30.826+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:31.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:30.826+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:31.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:30.827+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:31.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:30 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:30.827+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:31.328 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.6.service' 2024-05-14T09:45:31.406 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:31 smithi120 podman[115862]: 2024-05-14 09:45:31.274955576 +0000 UTC m=+0.771203625 container remove 0bb90063f81dd1b86211ca78b2da69ab20e2d82c5ff76c53be4f96b64eed7a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-14T09:45:31.406 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:31 smithi120 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.6.service: Deactivated successfully. 2024-05-14T09:45:31.406 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:31 smithi120 systemd[1]: Stopped Ceph osd.6 for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:45:31.406 INFO:journalctl@ceph.osd.6.smithi120.stdout:May 14 09:45:31 smithi120 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.6.service: Consumed 14min 2.937s CPU time. 2024-05-14T09:45:31.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:45:31.443 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-14T09:45:31.443 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-14T09:45:31.443 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.7 2024-05-14T09:45:31.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:31.035+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:31.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:31.035+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:31.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:31.035+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:31.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:31.035+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:31.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:31.447+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:31.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:31.447+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:31.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:31.447+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:31.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:31.447+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:31.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:31.447+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:31.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:31 smithi152 systemd[1]: Stopping Ceph osd.7 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:45:31.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:31.739+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:31.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:31.739+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:31.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:31.739+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:31.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:31 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:31.739+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:01.784156+0000 front 2024-05-14T09:45:01.783945+0000 (oldest deadline 2024-05-14T09:45:31.185644+0000) 2024-05-14T09:45:32.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:31.854+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:32.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:31.854+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:32.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:31.854+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:32.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:31.854+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:32.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:31.854+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:32.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:31.800+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:32.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:31.800+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:32.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:31.800+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:32.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:31.800+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:32.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:31 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:31.800+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:32.458 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:32.123+0000 7ff84d400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:45:32.458 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:32.123+0000 7ff84d400700 -1 osd.7 90 *** Got signal Terminated *** 2024-05-14T09:45:32.458 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:32.123+0000 7ff84d400700 -1 osd.7 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:45:32.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:32.068+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:32.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:32.068+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:32.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:32.068+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:32.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:32.068+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:32.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:32.423+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:32.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:32.423+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:32.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:32.423+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:32.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:32.423+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:32.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:32.423+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:33.058 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:32.717+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:33.059 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:32.717+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:33.059 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:32.717+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:33.059 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:32 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:32.717+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:01.784156+0000 front 2024-05-14T09:45:01.783945+0000 (oldest deadline 2024-05-14T09:45:31.185644+0000) 2024-05-14T09:45:33.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:32 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:32.835+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:33.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:32 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:32.835+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:33.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:32 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:32.835+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:33.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:32 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:32.835+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:33.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:32 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:32.835+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:33.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:32.759+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:33.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:32.759+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:33.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:32.759+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:33.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:32.759+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:33.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:32 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:32.759+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:33.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:33.057+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:33.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:33.057+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:33.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:33.057+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:33.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:33.057+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:33.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:33.057+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:33.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:33.445+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:33.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:33.445+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:33.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:33.445+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:33.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:33.445+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:33.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:33.445+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:33.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:33.671+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:33.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:33.671+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:33.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:33.671+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:33.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:33 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:33.671+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:01.784156+0000 front 2024-05-14T09:45:01.783945+0000 (oldest deadline 2024-05-14T09:45:31.185644+0000) 2024-05-14T09:45:34.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:33.864+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:34.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:33.864+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:34.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:33.864+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:34.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:33.864+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:34.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:33 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:33.864+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:34.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:33.775+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:34.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:33.775+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:34.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:33.775+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:34.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:33.775+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:34.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:33 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:33.775+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:34.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:34.076+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:34.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:34.076+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:34.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:34.076+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:34.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:34.076+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:34.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:34.076+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:34.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:34.463+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:34.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:34.463+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:34.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:34.463+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:34.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:34.463+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:34.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:34.463+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:34.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:34.648+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:34.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:34.648+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:34.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:34.648+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:34.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:34 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:34.648+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:01.784156+0000 front 2024-05-14T09:45:01.783945+0000 (oldest deadline 2024-05-14T09:45:31.185644+0000) 2024-05-14T09:45:35.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:34.823+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:35.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:34.823+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:35.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:34.823+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:35.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:34.823+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:35.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:34 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:34.823+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:35.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:34.815+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:35.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:34.815+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:35.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:34.815+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:35.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:34.815+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:35.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:34 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:34.815+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:35.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:35.084+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:35.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:35.084+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:35.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:35.084+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:35.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:35.084+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:35.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:35.084+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:35.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:35.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:35.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:35.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:35.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:35.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:35.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:35.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:35.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:35.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:35.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:35.676+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:35.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:35.676+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:35.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:35.676+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:35.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:35 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:35.676+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:01.784156+0000 front 2024-05-14T09:45:01.783945+0000 (oldest deadline 2024-05-14T09:45:31.185644+0000) 2024-05-14T09:45:36.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:35 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:35.803+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:36.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:35 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:35.803+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:36.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:35 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:35.803+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:36.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:35 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:35.803+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:36.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:35 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:35.803+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:36.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:35.784+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:36.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:35.784+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:36.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:35.784+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:36.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:35.784+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:36.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:35 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:35.784+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:36.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:36.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:36.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:36.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:36.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:36.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:36.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:36.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:36.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:36.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:36.766 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:36.477+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:36.767 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:36.477+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:36.767 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:36.477+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:36.767 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:36.477+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:36.767 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:36.477+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:36.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:36.670+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.673565+0000 front 2024-05-14T09:44:36.674044+0000 (oldest deadline 2024-05-14T09:45:01.373783+0000) 2024-05-14T09:45:36.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:36.670+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.276672+0000 front 2024-05-14T09:44:47.276465+0000 (oldest deadline 2024-05-14T09:45:10.176673+0000) 2024-05-14T09:45:36.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:36.670+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.581204+0000 front 2024-05-14T09:44:56.581281+0000 (oldest deadline 2024-05-14T09:45:21.281521+0000) 2024-05-14T09:45:36.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:36 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7[52590]: 2024-05-14T09:45:36.670+0000 7ff848c00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:01.784156+0000 front 2024-05-14T09:45:01.783945+0000 (oldest deadline 2024-05-14T09:45:31.185644+0000) 2024-05-14T09:45:37.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:36.804+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:37.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:36.804+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:37.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:36.804+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:37.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:36.804+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:37.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:36 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:36.804+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:37.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:36.765+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:37.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:36.765+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:37.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:36.765+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:37.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:36.765+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:37.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:36 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:36.765+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:37.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:37 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:37.072+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:37.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:37 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:37.072+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:37.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:37 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:37.072+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:37.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:37 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:37.072+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:37.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:37 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:37.072+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:37.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:37.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:37.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:37.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:37.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:37.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:37.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:37.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:37.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:37.437+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:38.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:37.833+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:38.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:37.833+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:38.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:37.833+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:38.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:37.833+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:38.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:37.833+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:38.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:37.729+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:38.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:37.729+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:38.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:37.729+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:38.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:37.729+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:38.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:37 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:37.729+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:38.458 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:38 smithi152 podman[72446]: 2024-05-14 09:45:38.238779123 +0000 UTC m=+6.343683525 container died b86b7ad08588ea840bde12b3b8a6180995912433381eb776f922e84392765f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507) 2024-05-14T09:45:38.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:38 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:38.080+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:38.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:38 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:38.080+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:38.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:38 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:38.080+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:38.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:38 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:38.080+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:38.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:38 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:38.080+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:38.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:38.469+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:38.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:38.469+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:38.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:38.469+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:38.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:38.469+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:38.728 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:38.469+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:38.958 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:38 smithi152 podman[72446]: 2024-05-14 09:45:38.722866904 +0000 UTC m=+6.827771343 container cleanup b86b7ad08588ea840bde12b3b8a6180995912433381eb776f922e84392765f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:45:38.959 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:38 smithi152 bash[72446]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7 2024-05-14T09:45:39.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:38.816+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:39.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:38.816+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:39.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:38.816+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:39.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:38.816+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:39.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:38 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:38.816+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:39.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:38.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:39.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:38.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:39.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:38.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:39.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:38.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:39.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:38 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:38.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:39.458 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:39 smithi152 podman[72465]: 2024-05-14 09:45:39.099123599 +0000 UTC m=+0.845520378 container remove b86b7ad08588ea840bde12b3b8a6180995912433381eb776f922e84392765f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-05-14T09:45:39.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:39 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:39.097+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:39.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:39 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:39.097+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:39.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:39 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:39.097+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:39.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:39 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:39.097+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:39.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:39 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:39.097+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:39.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:39.479+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:39.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:39.479+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:39.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:39.479+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:39.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:39.479+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:39.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:39.479+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:39.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:39.479+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:39.971 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:39 smithi152 podman[72549]: 2024-05-14 09:45:39.617798137 +0000 UTC m=+0.036015598 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:45:39.971 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:39 smithi152 podman[72549]: 2024-05-14 09:45:39.758319775 +0000 UTC m=+0.176537270 container create b0b4f0ee2746267a4f4f3e10ac897a908d3e1dd8d2d1063b5b989f05e3a5db21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:45:40.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:39 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:39.859+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:40.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:39 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:39.859+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:40.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:39 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:39.859+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:40.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:39 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:39.859+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:40.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:39 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:39.859+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:40.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:39.781+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:40.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:39.781+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:40.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:39.781+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:40.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:39.781+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:40.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:39.781+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:40.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:39 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:39.781+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:40.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:40 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:40.138+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:40.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:40 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:40.138+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:40.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:40 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:40.138+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:40.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:40 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:40.138+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:40.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:40 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:40.138+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:40.459 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:40 smithi152 podman[72549]: 2024-05-14 09:45:40.087187982 +0000 UTC m=+0.505405530 container init b0b4f0ee2746267a4f4f3e10ac897a908d3e1dd8d2d1063b5b989f05e3a5db21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-14T09:45:40.459 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:40 smithi152 podman[72549]: 2024-05-14 09:45:40.097932729 +0000 UTC m=+0.516150230 container start b0b4f0ee2746267a4f4f3e10ac897a908d3e1dd8d2d1063b5b989f05e3a5db21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-14T09:45:40.459 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:40 smithi152 podman[72549]: 2024-05-14 09:45:40.202790962 +0000 UTC m=+0.621008497 container attach b0b4f0ee2746267a4f4f3e10ac897a908d3e1dd8d2d1063b5b989f05e3a5db21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0) 2024-05-14T09:45:40.775 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:40.514+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:40.775 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:40.514+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:40.775 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:40.514+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:40.776 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:40.514+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:40.776 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:40.514+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:40.776 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:40.514+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:40.948 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:40 smithi152 podman[72575]: 2024-05-14 09:45:40.622649689 +0000 UTC m=+0.032497269 container died b0b4f0ee2746267a4f4f3e10ac897a908d3e1dd8d2d1063b5b989f05e3a5db21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-14T09:45:41.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:41 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:41.142+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:41.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:41 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:41.142+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:41.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:41 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:41.142+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:41.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:41 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:41.142+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:41.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:41 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:41.142+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:41.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:40.774+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:41.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:40.774+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:41.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:40.774+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:41.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:40.774+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:41.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:40.774+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:41.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:40 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:40.774+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:41.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:40.895+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:41.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:40.895+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:41.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:40.895+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:41.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:40.895+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:41.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:40.895+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:41.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:40 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:40.895+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:41.477 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.7.service' 2024-05-14T09:45:41.583 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:41 smithi152 podman[72575]: 2024-05-14 09:45:41.431339416 +0000 UTC m=+0.841186999 container remove b0b4f0ee2746267a4f4f3e10ac897a908d3e1dd8d2d1063b5b989f05e3a5db21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS) 2024-05-14T09:45:41.583 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:41 smithi152 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.7.service: Deactivated successfully. 2024-05-14T09:45:41.583 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:41 smithi152 systemd[1]: Stopped Ceph osd.7 for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:45:41.583 INFO:journalctl@ceph.osd.7.smithi152.stdout:May 14 09:45:41 smithi152 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.7.service: Consumed 16min 8.292s CPU time. 2024-05-14T09:45:41.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:45:41.614 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-14T09:45:41.614 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-14T09:45:41.614 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.8 2024-05-14T09:45:41.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:41.565+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:41.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:41.565+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:41.977 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:41.565+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:41.565+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:41.565+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:41.565+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:41 smithi175 systemd[1]: Stopping Ceph osd.8 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:41.803+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:41.803+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:41.803+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:41.803+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:41.803+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:41.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:41 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:41.803+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:42.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:41.913+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:42.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:41.913+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:42.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:41.913+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:42.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:41.913+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:42.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:41.913+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:42.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:41 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:41.913+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:42.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:42 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:42.153+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:42.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:42 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:42.153+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:42.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:42 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:42.153+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:42.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:42 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:42.153+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:42.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:42 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:42.153+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:42.477 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.206+0000 7fbdbfc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:45:42.477 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.206+0000 7fbdbfc00700 -1 osd.8 90 *** Got signal Terminated *** 2024-05-14T09:45:42.477 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.206+0000 7fbdbfc00700 -1 osd.8 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:45:42.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.607+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:42.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.607+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:42.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.607+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:42.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.607+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:42.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.607+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:42.978 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:42.607+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:42.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:42.836+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:42.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:42.836+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:42.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:42.836+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:42.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:42.836+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:42.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:42.836+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:42.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:42 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:42.836+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:43.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:42 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:42.946+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:43.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:42 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:42.946+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:43.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:42 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:42.946+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:43.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:42 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:42.946+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:43.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:42 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:42.946+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:43.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:42 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:42.946+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:43.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:43 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:43.128+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:43.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:43 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:43.128+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:43.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:43 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:43.128+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:43.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:43 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:43.128+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:43.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:43 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:43.128+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:43.862 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:43.568+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:43.863 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:43.568+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:43.863 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:43.568+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:43.863 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:43.568+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:43.863 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:43.568+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:43.863 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:43.568+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:44.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:43.969+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:44.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:43.969+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:44.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:43.969+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:44.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:43.969+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:44.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:43.969+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:44.135 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:43 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:43.970+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:44.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:43.862+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:44.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:43.862+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:44.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:43.862+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:44.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:43.862+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:44.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:43.862+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:44.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:43 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:43.862+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:44.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:44 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:44.111+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:44.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:44 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:44.111+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:44.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:44 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:44.111+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:44.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:44 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:44.111+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:44.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:44 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:44.111+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:44.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:44 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:44.111+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:44.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:44.573+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:44.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:44.573+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:44.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:44.573+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:44.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:44.573+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:44.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:44.573+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:44.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:44.573+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:45.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:44.873+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:45.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:44.873+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:45.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:44.873+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:45.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:44.873+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:45.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:44.873+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:45.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:44 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:44.873+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:45.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:45.017+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:45.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:45.017+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:45.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:45.017+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:45.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:45.017+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:45.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:45.017+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:45.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:45 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:45.017+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:45.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:45.157+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:45.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:45.157+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:45.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:45.157+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:45.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:45.157+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:45.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:45.157+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:45.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:45 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:45.157+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:45.866 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:45.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:45.866 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:45.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:45.866 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:45.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:45.866 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:45.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:45.866 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:45.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:45.866 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:45.559+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:46.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:45.865+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:46.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:45.865+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:46.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:45.865+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:46.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:45.865+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:46.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:45.865+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:46.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:45 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:45.865+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:46.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:46.063+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:46.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:46.063+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:46.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:46.063+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:46.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:46.063+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:46.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:46.063+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:46.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:46 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:46.063+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:46.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:46 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:46.200+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:46.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:46 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:46.200+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:46.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:46 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:46.200+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:46.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:46 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:46.200+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:46.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:46 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:46.200+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:46.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:46 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:46.200+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:46.832 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:46.551+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.310760+0000 front 2024-05-14T09:44:26.310846+0000 (oldest deadline 2024-05-14T09:44:51.611064+0000) 2024-05-14T09:45:46.832 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:46.551+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.314079+0000 front 2024-05-14T09:44:36.313602+0000 (oldest deadline 2024-05-14T09:44:58.613918+0000) 2024-05-14T09:45:46.832 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:46.551+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.319792+0000 front 2024-05-14T09:44:47.319862+0000 (oldest deadline 2024-05-14T09:45:13.220087+0000) 2024-05-14T09:45:46.832 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:46.551+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:56.023605+0000 front 2024-05-14T09:44:56.023769+0000 (oldest deadline 2024-05-14T09:45:22.424845+0000) 2024-05-14T09:45:46.832 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:46.551+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:02.426507+0000 front 2024-05-14T09:45:02.426043+0000 (oldest deadline 2024-05-14T09:45:28.226465+0000) 2024-05-14T09:45:46.832 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8[54283]: 2024-05-14T09:45:46.551+0000 7fbdb6400700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.928161+0000 front 2024-05-14T09:45:12.928084+0000 (oldest deadline 2024-05-14T09:45:38.828143+0000) 2024-05-14T09:45:47.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:46.831+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:47.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:46.831+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:47.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:46.831+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:47.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:46.831+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:47.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:46.831+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:47.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:46 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:46.831+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:47.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:47.096+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:47.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:47.096+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:47.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:47.096+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:47.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:47.096+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:47.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:47.096+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:47.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:47 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:47.096+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:47.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:47.177+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:47.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:47.177+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:47.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:47.177+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:47.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:47.177+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:47.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:47.177+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:47.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:47.177+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:48.129 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:47 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:47.810+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:48.130 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:47 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:47.810+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:48.130 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:47 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:47.810+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:48.130 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:47 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:47.810+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:48.130 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:47 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:47.810+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:48.130 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:47 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:47.810+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:48.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:48.101+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:48.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:48.101+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:48.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:48.101+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:48.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:48.101+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:48.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:48.101+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:48.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:48 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:48.101+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:48.387 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:48 smithi175 podman[74735]: 2024-05-14 09:45:48.200024988 +0000 UTC m=+6.135518411 container died 4918c78a2e02711e67ef44fd36b521eb419c74cacab1882b13acf17432f09fb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-14T09:45:48.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:48 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:48.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:48.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:48 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:48.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:48.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:48 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:48.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:48.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:48 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:48.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:48.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:48 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:48.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:48.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:48 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:48.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:48.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:48 smithi175 podman[74735]: 2024-05-14 09:45:48.590820351 +0000 UTC m=+6.526313789 container cleanup 4918c78a2e02711e67ef44fd36b521eb419c74cacab1882b13acf17432f09fb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T09:45:48.727 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:48 smithi175 bash[74735]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8 2024-05-14T09:45:49.069 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:48 smithi175 podman[74754]: 2024-05-14 09:45:48.867486524 +0000 UTC m=+0.659221103 container remove 4918c78a2e02711e67ef44fd36b521eb419c74cacab1882b13acf17432f09fb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-14T09:45:49.070 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:48 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:48.818+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:49.070 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:48 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:48.818+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:49.070 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:48 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:48.818+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:49.070 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:48 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:48.818+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:49.070 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:48 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:48.818+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:49.070 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:48 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:48.818+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:49.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:49.092+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:49.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:49.092+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:49.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:49.092+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:49.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:49.092+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:49.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:49.092+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:49.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:49 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:49.092+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:49.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:49 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:49.162+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:49.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:49 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:49.162+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:49.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:49 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:49.162+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:49.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:49 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:49.162+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:49.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:49 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:49.162+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:49.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:49 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:49.162+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:49.964 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:49 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:49.852+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:49.964 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:49 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:49.852+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:49.964 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:49 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:49.852+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:49.964 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:49 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:49.852+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:49.965 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:49 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:49.852+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:49.965 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:49 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:49.852+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:49.965 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:49 smithi175 podman[74851]: 2024-05-14 09:45:49.536338197 +0000 UTC m=+0.031840965 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:45:49.965 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:49 smithi175 podman[74851]: 2024-05-14 09:45:49.659945791 +0000 UTC m=+0.155448623 container create 69e2b7571734712e8ae025caeec92ebba946eab6945b7c85044eada000f984ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-14T09:45:50.227 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:49 smithi175 podman[74851]: 2024-05-14 09:45:49.96352517 +0000 UTC m=+0.459027976 container init 69e2b7571734712e8ae025caeec92ebba946eab6945b7c85044eada000f984ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:45:50.227 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:49 smithi175 podman[74851]: 2024-05-14 09:45:49.974576047 +0000 UTC m=+0.470078822 container start 69e2b7571734712e8ae025caeec92ebba946eab6945b7c85044eada000f984ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-14T09:45:50.227 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:50 smithi175 podman[74851]: 2024-05-14 09:45:50.087740472 +0000 UTC m=+0.583243337 container attach 69e2b7571734712e8ae025caeec92ebba946eab6945b7c85044eada000f984ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-14T09:45:50.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:50.091+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:50.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:50.091+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:50.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:50.091+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:50.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:50.091+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:50.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:50.091+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:50.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:50 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:50.091+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:50.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:50 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:50.163+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:50.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:50 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:50.163+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:50.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:50 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:50.163+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:50.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:50 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:50.163+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:50.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:50 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:50.163+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:50.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:50 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:50.163+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:50.695 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:50 smithi175 podman[74851]: 2024-05-14 09:45:50.417513497 +0000 UTC m=+0.913016312 container died 69e2b7571734712e8ae025caeec92ebba946eab6945b7c85044eada000f984ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:45:50.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:50.812+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:50.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:50.812+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:50.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:50.812+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:50.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:50.813+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:50.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:50.813+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:50.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:50 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:50.813+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:51.190 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.8.service' 2024-05-14T09:45:51.265 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:51 smithi175 podman[74878]: 2024-05-14 09:45:51.141390743 +0000 UTC m=+0.708681278 container remove 69e2b7571734712e8ae025caeec92ebba946eab6945b7c85044eada000f984ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True) 2024-05-14T09:45:51.266 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:51 smithi175 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.8.service: Deactivated successfully. 2024-05-14T09:45:51.266 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:51 smithi175 systemd[1]: Stopped Ceph osd.8 for 15b5acb4-11d1-11ef-bc98-c7b262605968. 2024-05-14T09:45:51.266 INFO:journalctl@ceph.osd.8.smithi175.stdout:May 14 09:45:51 smithi175 systemd[1]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.8.service: Consumed 11min 55.831s CPU time. 2024-05-14T09:45:51.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:45:51.303 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-14T09:45:51.303 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-14T09:45:51.303 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.9 2024-05-14T09:45:51.382 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:51.383 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:51.383 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:51.383 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:51.383 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:51.383 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:51.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:51 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:51.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:51.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:51 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:51.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:51.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:51 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:51.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:51.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:51 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:51.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:51.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:51 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:51.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:51.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:51 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:51.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:51.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:51 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:51.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:51.634 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 systemd[1]: Stopping Ceph osd.9 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:45:52.172 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.891+0000 7f9d4b600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:45:52.173 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.891+0000 7f9d4b600700 -1 osd.9 90 *** Got signal Terminated *** 2024-05-14T09:45:52.173 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:51 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:51.891+0000 7f9d4b600700 -1 osd.9 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:45:52.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:51.769+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:52.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:51.769+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:52.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:51.769+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:52.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:51.769+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:52.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:51.769+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:52.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:51 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:51.769+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:52.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:52.156+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:52.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:52.156+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:52.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:52.156+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:52.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:52.156+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:52.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:52.156+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:52.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:52.156+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:52.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:52 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:52.156+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:52.634 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:52.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:52.634 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:52.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:52.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:52.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:52.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:52.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:52.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:52.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:52.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:52 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:52.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:53.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:52.744+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:53.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:52.744+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:53.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:52.744+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:53.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:52.744+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:53.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:52.744+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:53.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:52.744+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:53.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:52 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:52.744+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:45:53.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:53.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:53.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:53.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:53.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:53.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:53.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:53.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:53.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:53.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:53.385 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:53 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:53.125+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:53.388 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:53.136+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:53.389 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:53.136+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:53.389 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:53.136+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:53.389 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:53.136+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:53.389 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:53.136+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:53.389 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:53.136+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:53.389 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:53.136+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:53.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:53.711+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:53.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:53.711+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:53.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:53.711+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:53.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:53.711+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:53.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:53.711+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:53.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:53.711+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:53.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:53 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:53.711+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:45:54.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:54.158+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:54.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:54.158+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:54.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:54.158+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:54.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:54.158+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:54.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:54.158+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:54.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:54.158+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:54.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:54 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:54.158+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:54.634 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:54.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:54.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:54.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:54.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:54.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:54.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:54.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:54.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:54.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:54.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:54 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:54.172+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:54.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:54.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:54.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:54.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:54.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:54.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:54.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:54.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:54.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:54.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:54.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:54.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:54.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:54 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:54.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:45:55.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:55.183+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:55.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:55.183+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:55.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:55.183+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:55.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:55.183+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:55.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:55.183+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:55.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:55.183+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:55.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:55 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:55.183+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:55.634 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:55.212+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:55.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:55.212+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:55.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:55.212+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:55.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:55.212+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:55.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:55.212+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:55.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:55 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:55.212+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:55.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:55.666+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:55.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:55.666+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:55.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:55.666+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:55.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:55.666+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:55.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:55.666+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:55.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:55.666+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:55.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:55 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:55.666+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:45:56.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:56.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:56.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:56.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:56.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:56.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:56.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:56.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:56.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:56.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:56.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:56.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:56.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:56 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:56.159+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:56.634 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:56.241+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.851535+0000 front 2024-05-14T09:44:26.851077+0000 (oldest deadline 2024-05-14T09:44:48.353568+0000) 2024-05-14T09:45:56.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:56.241+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:35.259145+0000 front 2024-05-14T09:44:35.258920+0000 (oldest deadline 2024-05-14T09:44:59.958893+0000) 2024-05-14T09:45:56.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:56.241+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:45.763630+0000 front 2024-05-14T09:44:45.763317+0000 (oldest deadline 2024-05-14T09:45:11.063591+0000) 2024-05-14T09:45:56.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:56.241+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.766786+0000 front 2024-05-14T09:44:55.766712+0000 (oldest deadline 2024-05-14T09:45:18.666858+0000) 2024-05-14T09:45:56.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:56.241+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.568787+0000 front 2024-05-14T09:45:04.568907+0000 (oldest deadline 2024-05-14T09:45:29.268514+0000) 2024-05-14T09:45:56.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:56 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9[65652]: 2024-05-14T09:45:56.241+0000 7f9d46e00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:16.673541+0000 front 2024-05-14T09:45:16.673505+0000 (oldest deadline 2024-05-14T09:45:40.073607+0000) 2024-05-14T09:45:56.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:56.662+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:56.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:56.662+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:56.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:56.662+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:56.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:56.662+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:56.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:56.662+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:56.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:56.662+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:56.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:56 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:56.662+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:45:57.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:57.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:57.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:57.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:57.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:57.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:57.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:57.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:57.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:57.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:57.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:57.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:57.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:57 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:57.118+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:57.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:57.684+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:57.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:57.684+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:57.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:57.684+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:57.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:57.684+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:57.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:57.684+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:57.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:57.684+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:57.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:57 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:57.684+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:45:58.384 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:58 smithi120 podman[115955]: 2024-05-14 09:45:58.073058802 +0000 UTC m=+6.336340931 container died d586a40015397513129a3273dbd60c69bd6663c1662a03c99eb57fdbeebcd2e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-14T09:45:58.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:58.087+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:58.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:58.087+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:58.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:58.087+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:58.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:58.087+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:58.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:58.087+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:58.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:58.087+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:58.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:58 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:58.087+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:58.752 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:58 smithi120 podman[115955]: 2024-05-14 09:45:58.534009145 +0000 UTC m=+6.797291267 container cleanup d586a40015397513129a3273dbd60c69bd6663c1662a03c99eb57fdbeebcd2e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T09:45:58.753 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:58 smithi120 bash[115955]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9 2024-05-14T09:45:58.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:58.705+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:58.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:58.705+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:58.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:58.705+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:58.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:58.705+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:58.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:58.705+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:58.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:58.705+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:58.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:58 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:58.705+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:45:59.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:58 smithi120 podman[115971]: 2024-05-14 09:45:58.751916716 +0000 UTC m=+0.669861334 container remove d586a40015397513129a3273dbd60c69bd6663c1662a03c99eb57fdbeebcd2e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-05-14T09:45:59.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:59.122+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:45:59.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:59.122+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:45:59.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:59.122+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:45:59.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:59.122+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:45:59.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:59.122+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:45:59.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:59.122+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:45:59.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:45:59 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:45:59.122+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:45:59.873 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:59 smithi120 podman[116055]: 2024-05-14 09:45:59.503943102 +0000 UTC m=+0.040888421 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:45:59.873 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:59 smithi120 podman[116055]: 2024-05-14 09:45:59.611197733 +0000 UTC m=+0.148143064 container create 1fb550469d1febf49ce31e37bc2ffc7859fd83e10cefe93aa8aa753ca25a6c0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T09:45:59.873 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:59 smithi120 podman[116055]: 2024-05-14 09:45:59.872996191 +0000 UTC m=+0.409941575 container init 1fb550469d1febf49ce31e37bc2ffc7859fd83e10cefe93aa8aa753ca25a6c0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-14T09:45:59.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:59.656+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:45:59.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:59.656+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:45:59.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:59.656+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:45:59.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:59.656+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:45:59.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:59.656+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:45:59.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:59.656+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:45:59.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:45:59 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:45:59.656+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:00.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:59 smithi120 podman[116055]: 2024-05-14 09:45:59.883932007 +0000 UTC m=+0.420877308 container start 1fb550469d1febf49ce31e37bc2ffc7859fd83e10cefe93aa8aa753ca25a6c0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:46:00.134 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:45:59 smithi120 podman[116055]: 2024-05-14 09:45:59.971786559 +0000 UTC m=+0.508731920 container attach 1fb550469d1febf49ce31e37bc2ffc7859fd83e10cefe93aa8aa753ca25a6c0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:46:00.458 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:00.145+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:46:00.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:00.145+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:46:00.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:00.145+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:46:00.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:00.145+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:46:00.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:00.145+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:46:00.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:00.145+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:46:00.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:00 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:00.145+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:46:00.635 INFO:journalctl@ceph.osd.9.smithi120.stdout:May 14 09:46:00 smithi120 podman[116055]: 2024-05-14 09:46:00.336524436 +0000 UTC m=+0.873469773 container died 1fb550469d1febf49ce31e37bc2ffc7859fd83e10cefe93aa8aa753ca25a6c0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507) 2024-05-14T09:46:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:00.669+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:00.669+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:00.669+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:00.669+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:00.669+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:00.669+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:00.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:00 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:00.669+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:01.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.9.service' 2024-05-14T09:46:01.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:01.190 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-14T09:46:01.190 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-14T09:46:01.190 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.10 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.141+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.141+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.141+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.141+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.141+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.141+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.141+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:46:01.459 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 systemd[1]: Stopping Ceph osd.10 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:01.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:01.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:01.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:01.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:01.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:01.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:01.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:01.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:01 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:01.653+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:02.188 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.739+0000 7f980fe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:02.188 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.739+0000 7f980fe00700 -1 osd.10 90 *** Got signal Terminated *** 2024-05-14T09:46:02.188 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:01 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:01.739+0000 7f980fe00700 -1 osd.10 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:46:02.188 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:02.186+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:46:02.188 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:02.186+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:46:02.188 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:02.186+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:46:02.188 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:02.186+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:46:02.189 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:02.186+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:46:02.189 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:02.186+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:46:02.189 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:02 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:02.186+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:46:02.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:02.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:02.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:02.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:02.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:02.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:02.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:02.979 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:02 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:02.681+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:03.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:03.234+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:46:03.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:03.234+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:46:03.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:03.234+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:46:03.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:03.234+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:46:03.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:03.234+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:46:03.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:03.234+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:46:03.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:03 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:03.234+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.648+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.648+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.648+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.648+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.648+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.648+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:03.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:03 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:03.648+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:04.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:04.252+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:46:04.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:04.252+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:46:04.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:04.252+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:46:04.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:04.252+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:46:04.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:04.252+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:46:04.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:04.252+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:46:04.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:04.253+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:04.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:04 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:04.688+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:05.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:05.277+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:46:05.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:05.277+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:46:05.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:05.277+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:46:05.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:05.277+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:46:05.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:05.277+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:46:05.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:05.277+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:46:05.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:05 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:05.277+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:05.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:05 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:05.710+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:06.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:06.319+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:26.755655+0000 front 2024-05-14T09:44:26.756084+0000 (oldest deadline 2024-05-14T09:44:52.655594+0000) 2024-05-14T09:46:06.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:06.319+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:32.656618+0000 front 2024-05-14T09:44:32.656547+0000 (oldest deadline 2024-05-14T09:45:01.959632+0000) 2024-05-14T09:46:06.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:06.319+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:47.063560+0000 front 2024-05-14T09:44:47.063664+0000 (oldest deadline 2024-05-14T09:45:12.363851+0000) 2024-05-14T09:46:06.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:06.319+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:55.266006+0000 front 2024-05-14T09:44:55.266120+0000 (oldest deadline 2024-05-14T09:45:18.766229+0000) 2024-05-14T09:46:06.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:06.319+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:06.869723+0000 front 2024-05-14T09:45:06.870271+0000 (oldest deadline 2024-05-14T09:45:32.769828+0000) 2024-05-14T09:46:06.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:06.319+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:12.770747+0000 front 2024-05-14T09:45:12.770972+0000 (oldest deadline 2024-05-14T09:45:43.972108+0000) 2024-05-14T09:46:06.709 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:06 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10[59398]: 2024-05-14T09:46:06.319+0000 7f980b600700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:23.973353+0000 front 2024-05-14T09:45:23.973298+0000 (oldest deadline 2024-05-14T09:45:50.374362+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:06.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:06 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:06.707+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:07.937 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:07 smithi152 podman[72679]: 2024-05-14 09:46:07.648031714 +0000 UTC m=+6.028507403 container died 59c05d5ad50f366c98f54c3c429c94b33d0e7abeec9f2a4a9d8d7b32fe4cf0ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-14T09:46:08.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:08 smithi152 podman[72679]: 2024-05-14 09:46:08.107729718 +0000 UTC m=+6.488205427 container cleanup 59c05d5ad50f366c98f54c3c429c94b33d0e7abeec9f2a4a9d8d7b32fe4cf0ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-14T09:46:08.208 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:08 smithi152 bash[72679]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10 2024-05-14T09:46:08.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:08.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:08.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:08.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:08.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:08.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:08.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:08.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:07 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:07.727+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:08.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:08 smithi152 podman[72699]: 2024-05-14 09:46:08.400681102 +0000 UTC m=+0.739983204 container remove 59c05d5ad50f366c98f54c3c429c94b33d0e7abeec9f2a4a9d8d7b32fe4cf0ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:09.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:08 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:08.768+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:09.421 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:09 smithi152 podman[72788]: 2024-05-14 09:46:08.929402818 +0000 UTC m=+0.034699920 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:46:09.421 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:09 smithi152 podman[72788]: 2024-05-14 09:46:09.042956609 +0000 UTC m=+0.148253736 container create ff0556b6d7f370a980e7c1331ef38ddc3ea746d8372dd77b8c5fa991129ad7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:46:09.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:09 smithi152 podman[72788]: 2024-05-14 09:46:09.421603072 +0000 UTC m=+0.526900272 container init ff0556b6d7f370a980e7c1331ef38ddc3ea746d8372dd77b8c5fa991129ad7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:46:09.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:09 smithi152 podman[72788]: 2024-05-14 09:46:09.433995384 +0000 UTC m=+0.539292521 container start ff0556b6d7f370a980e7c1331ef38ddc3ea746d8372dd77b8c5fa991129ad7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-14T09:46:09.708 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:09 smithi152 podman[72788]: 2024-05-14 09:46:09.520259473 +0000 UTC m=+0.625556630 container attach ff0556b6d7f370a980e7c1331ef38ddc3ea746d8372dd77b8c5fa991129ad7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-14T09:46:10.209 INFO:journalctl@ceph.osd.10.smithi152.stdout:May 14 09:46:09 smithi152 podman[72788]: 2024-05-14 09:46:09.883883948 +0000 UTC m=+0.989181082 container died ff0556b6d7f370a980e7c1331ef38ddc3ea746d8372dd77b8c5fa991129ad7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:10.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:09 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:09.736+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:10.739 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.10.service' 2024-05-14T09:46:10.845 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:10.845 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-14T09:46:10.846 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-14T09:46:10.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.11 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:10.954 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:10.689+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:11.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:10 smithi175 systemd[1]: Stopping Ceph osd.11 for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:11.675 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.417+0000 7fc426200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:11.675 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.417+0000 7fc426200700 -1 osd.11 90 *** Got signal Terminated *** 2024-05-14T09:46:11.676 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.417+0000 7fc426200700 -1 osd.11 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T09:46:11.676 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:11.676 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:11.676 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:11.676 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:11.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:11.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:11.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:11.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:11.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:11 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:11.675+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-05-14T09:45:44.902982+0000 front 2024-05-14T09:45:44.903090+0000 (oldest deadline 2024-05-14T09:46:10.802611+0000) 2024-05-14T09:46:12.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:12.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:12 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:12.697+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-05-14T09:45:44.902982+0000 front 2024-05-14T09:45:44.903090+0000 (oldest deadline 2024-05-14T09:46:10.802611+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:13.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:13 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:13.657+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-05-14T09:45:44.902982+0000 front 2024-05-14T09:45:44.903090+0000 (oldest deadline 2024-05-14T09:46:10.802611+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:14.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:14 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:14.647+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-05-14T09:45:44.902982+0000 front 2024-05-14T09:45:44.903090+0000 (oldest deadline 2024-05-14T09:46:10.802611+0000) 2024-05-14T09:46:15.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-05-14T09:44:22.173548+0000 front 2024-05-14T09:44:22.173641+0000 (oldest deadline 2024-05-14T09:44:50.974935+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-05-14T09:44:36.277025+0000 front 2024-05-14T09:44:36.277750+0000 (oldest deadline 2024-05-14T09:44:59.777248+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-05-14T09:44:44.281549+0000 front 2024-05-14T09:44:44.282270+0000 (oldest deadline 2024-05-14T09:45:10.082846+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-05-14T09:44:57.086623+0000 front 2024-05-14T09:44:57.086870+0000 (oldest deadline 2024-05-14T09:45:21.186547+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-05-14T09:45:04.689401+0000 front 2024-05-14T09:45:04.689254+0000 (oldest deadline 2024-05-14T09:45:28.789530+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-05-14T09:45:13.393464+0000 front 2024-05-14T09:45:13.393313+0000 (oldest deadline 2024-05-14T09:45:39.293563+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-05-14T09:45:26.297799+0000 front 2024-05-14T09:45:26.298029+0000 (oldest deadline 2024-05-14T09:45:52.198081+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-05-14T09:45:35.100035+0000 front 2024-05-14T09:45:35.100131+0000 (oldest deadline 2024-05-14T09:46:00.999777+0000) 2024-05-14T09:46:15.978 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:15 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11[61231]: 2024-05-14T09:46:15.609+0000 7fc421a00700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-05-14T09:45:44.902982+0000 front 2024-05-14T09:45:44.903090+0000 (oldest deadline 2024-05-14T09:46:10.802611+0000) 2024-05-14T09:46:17.658 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:17 smithi175 podman[74957]: 2024-05-14 09:46:17.325996503 +0000 UTC m=+6.050068083 container died 2a909d046f0b807529ef10a80bef54bad3f58a52496e8a8a7217e2ece9085314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-14T09:46:17.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:17 smithi175 podman[74957]: 2024-05-14 09:46:17.777640214 +0000 UTC m=+6.501711804 container cleanup 2a909d046f0b807529ef10a80bef54bad3f58a52496e8a8a7217e2ece9085314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-14T09:46:17.977 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:17 smithi175 bash[74957]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11 2024-05-14T09:46:18.477 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:18 smithi175 podman[74975]: 2024-05-14 09:46:18.053998987 +0000 UTC m=+0.707712030 container remove 2a909d046f0b807529ef10a80bef54bad3f58a52496e8a8a7217e2ece9085314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:46:19.227 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:18 smithi175 podman[75067]: 2024-05-14 09:46:18.819175975 +0000 UTC m=+0.035526585 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T09:46:19.228 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:18 smithi175 podman[75067]: 2024-05-14 09:46:18.963174463 +0000 UTC m=+0.179525110 container create 69ee94410f1c3e1fdb5f9311e6166cfbe6690ab1bc90e6808579bcd87e4cdf54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-14T09:46:19.727 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:19 smithi175 podman[75067]: 2024-05-14 09:46:19.257991139 +0000 UTC m=+0.474341793 container init 69ee94410f1c3e1fdb5f9311e6166cfbe6690ab1bc90e6808579bcd87e4cdf54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-05-14T09:46:19.727 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:19 smithi175 podman[75067]: 2024-05-14 09:46:19.268113568 +0000 UTC m=+0.484464185 container start 69ee94410f1c3e1fdb5f9311e6166cfbe6690ab1bc90e6808579bcd87e4cdf54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-14T09:46:19.727 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:19 smithi175 podman[75067]: 2024-05-14 09:46:19.357418541 +0000 UTC m=+0.573769211 container attach 69ee94410f1c3e1fdb5f9311e6166cfbe6690ab1bc90e6808579bcd87e4cdf54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-14T09:46:20.062 INFO:journalctl@ceph.osd.11.smithi175.stdout:May 14 09:46:19 smithi175 podman[75067]: 2024-05-14 09:46:19.742243899 +0000 UTC m=+0.958594509 container died 69ee94410f1c3e1fdb5f9311e6166cfbe6690ab1bc90e6808579bcd87e4cdf54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-14T09:46:20.445 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@osd.11.service' 2024-05-14T09:46:20.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:20.531 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-14T09:46:20.531 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-14T09:46:20.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.a 2024-05-14T09:46:20.884 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:46:20 smithi120 systemd[1]: Stopping Ceph mds.a for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:21.383 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:46:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a[72672]: 2024-05-14T09:46:21.139+0000 7fac14c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:21.383 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:46:21 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a[72672]: 2024-05-14T09:46:21.139+0000 7fac14c00700 -1 mds.a *** got signal Terminated *** 2024-05-14T09:46:25.631 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:46:25 smithi120 podman[116172]: 2024-05-14 09:46:25.313521301 +0000 UTC m=+4.345378511 container died 9297adf698af34bca5c181419b2e7f01169b597e7ffc96a3cc67b373a8ef199e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:46:25.884 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:46:25 smithi120 podman[116172]: 2024-05-14 09:46:25.750620496 +0000 UTC m=+4.782477716 container cleanup 9297adf698af34bca5c181419b2e7f01169b597e7ffc96a3cc67b373a8ef199e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-14T09:46:25.884 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:46:25 smithi120 bash[116172]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a 2024-05-14T09:46:26.384 INFO:journalctl@ceph.mds.a.smithi120.stdout:May 14 09:46:25 smithi120 podman[116194]: 2024-05-14 09:46:25.993492909 +0000 UTC m=+0.662645961 container remove 9297adf698af34bca5c181419b2e7f01169b597e7ffc96a3cc67b373a8ef199e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T09:46:26.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.a.service' 2024-05-14T09:46:26.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:26.634 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-14T09:46:26.634 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-14T09:46:26.635 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.d 2024-05-14T09:46:27.134 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:46:26 smithi120 systemd[1]: Stopping Ceph mds.d for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:27.634 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:46:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d[71266]: 2024-05-14T09:46:27.210+0000 7f05b3400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:27.635 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:46:27 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d[71266]: 2024-05-14T09:46:27.210+0000 7f05b3400700 -1 mds.d *** got signal Terminated *** 2024-05-14T09:46:30.342 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:46:30 smithi120 podman[116302]: 2024-05-14 09:46:30.012099924 +0000 UTC m=+2.933077289 container died a63a79f73d8b650ce37d283cfc8e6ed8584c897516cb08817193c94ee300e225 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T09:46:30.634 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:46:30 smithi120 podman[116302]: 2024-05-14 09:46:30.462236279 +0000 UTC m=+3.383213658 container cleanup a63a79f73d8b650ce37d283cfc8e6ed8584c897516cb08817193c94ee300e225 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:46:30.634 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:46:30 smithi120 bash[116302]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d 2024-05-14T09:46:31.134 INFO:journalctl@ceph.mds.d.smithi120.stdout:May 14 09:46:30 smithi120 podman[116315]: 2024-05-14 09:46:30.754934964 +0000 UTC m=+0.720895890 container remove a63a79f73d8b650ce37d283cfc8e6ed8584c897516cb08817193c94ee300e225 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-14T09:46:31.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.d.service' 2024-05-14T09:46:31.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:31.329 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-14T09:46:31.329 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-14T09:46:31.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.g 2024-05-14T09:46:31.884 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:46:31 smithi120 systemd[1]: Stopping Ceph mds.g for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:32.384 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:46:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g[72242]: 2024-05-14T09:46:31.931+0000 7f9b95600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:32.384 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:46:31 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g[72242]: 2024-05-14T09:46:31.931+0000 7f9b95600700 -1 mds.g *** got signal Terminated *** 2024-05-14T09:46:36.305 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:46:36 smithi120 podman[116422]: 2024-05-14 09:46:36.0547342 +0000 UTC m=+4.249464475 container died add6a555e5582969150ac5210db8903a4a4b2484b0fe5de3e5ac6f9681d0f5fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-14T09:46:36.634 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:46:36 smithi120 podman[116422]: 2024-05-14 09:46:36.432706328 +0000 UTC m=+4.627436623 container cleanup add6a555e5582969150ac5210db8903a4a4b2484b0fe5de3e5ac6f9681d0f5fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-14T09:46:36.634 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:46:36 smithi120 bash[116422]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g 2024-05-14T09:46:37.134 INFO:journalctl@ceph.mds.g.smithi120.stdout:May 14 09:46:36 smithi120 podman[116435]: 2024-05-14 09:46:36.700608985 +0000 UTC m=+0.629306775 container remove add6a555e5582969150ac5210db8903a4a4b2484b0fe5de3e5ac6f9681d0f5fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-g, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-14T09:46:37.233 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.g.service' 2024-05-14T09:46:37.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:37.335 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-14T09:46:37.335 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-14T09:46:37.336 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.j 2024-05-14T09:46:37.884 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:46:37 smithi120 systemd[1]: Stopping Ceph mds.j for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:38.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:46:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j[70848]: 2024-05-14T09:46:37.908+0000 7fa2fc600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:38.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:46:37 smithi120 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j[70848]: 2024-05-14T09:46:37.908+0000 7fa2fc600700 -1 mds.j *** got signal Terminated *** 2024-05-14T09:46:41.589 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:46:41 smithi120 podman[116543]: 2024-05-14 09:46:41.184173544 +0000 UTC m=+3.399916720 container died 89f1d5c8991d4e000b802491a7f253a6b75a334a01f7bf11939fbc030d331577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-14T09:46:41.884 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:46:41 smithi120 podman[116543]: 2024-05-14 09:46:41.710853808 +0000 UTC m=+3.926597037 container cleanup 89f1d5c8991d4e000b802491a7f253a6b75a334a01f7bf11939fbc030d331577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-14T09:46:41.884 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:46:41 smithi120 bash[116543]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j 2024-05-14T09:46:42.384 INFO:journalctl@ceph.mds.j.smithi120.stdout:May 14 09:46:41 smithi120 podman[116557]: 2024-05-14 09:46:41.978582834 +0000 UTC m=+0.776306961 container remove 89f1d5c8991d4e000b802491a7f253a6b75a334a01f7bf11939fbc030d331577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T09:46:42.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.j.service' 2024-05-14T09:46:42.610 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:42.610 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-14T09:46:42.611 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-14T09:46:42.611 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.b 2024-05-14T09:46:42.958 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:46:42 smithi152 systemd[1]: Stopping Ceph mds.b for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:43.458 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:46:43 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b[64871]: 2024-05-14T09:46:43.206+0000 7fa965a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:43.458 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:46:43 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b[64871]: 2024-05-14T09:46:43.206+0000 7fa965a00700 -1 mds.b *** got signal Terminated *** 2024-05-14T09:46:45.708 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:46:45 smithi152 podman[72891]: 2024-05-14 09:46:45.42316395 +0000 UTC m=+2.394980350 container died b1c50458a17207e578e25a084b8d95816ea45e03925a40abbdfa3ffe1eb914a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-14T09:46:46.208 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:46:45 smithi152 podman[72891]: 2024-05-14 09:46:45.891253977 +0000 UTC m=+2.863070370 container cleanup b1c50458a17207e578e25a084b8d95816ea45e03925a40abbdfa3ffe1eb914a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2) 2024-05-14T09:46:46.208 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:46:45 smithi152 bash[72891]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b 2024-05-14T09:46:46.708 INFO:journalctl@ceph.mds.b.smithi152.stdout:May 14 09:46:46 smithi152 podman[72903]: 2024-05-14 09:46:46.209070338 +0000 UTC m=+0.763369161 container remove b1c50458a17207e578e25a084b8d95816ea45e03925a40abbdfa3ffe1eb914a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-14T09:46:46.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.b.service' 2024-05-14T09:46:46.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:46.977 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-14T09:46:46.977 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-14T09:46:46.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.e 2024-05-14T09:46:47.458 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:47 smithi152 systemd[1]: Stopping Ceph mds.e for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:47.958 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e[64265]: 2024-05-14T09:46:47.574+0000 7f047d600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:47.958 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:47 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e[64265]: 2024-05-14T09:46:47.574+0000 7f047d600700 -1 mds.e *** got signal Terminated *** 2024-05-14T09:46:51.637 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:51 smithi152 podman[73012]: 2024-05-14 09:46:51.272506513 +0000 UTC m=+3.827599285 container stop a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-14T09:46:51.637 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:51 smithi152 podman[73012]: 2024-05-14 09:46:51.299766001 +0000 UTC m=+3.854858739 container died a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-14T09:46:51.958 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:51 smithi152 podman[73012]: 2024-05-14 09:46:51.802736041 +0000 UTC m=+4.357828797 container cleanup a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-14T09:46:51.958 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:51 smithi152 bash[73012]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e 2024-05-14T09:46:52.458 INFO:journalctl@ceph.mds.e.smithi152.stdout:May 14 09:46:52 smithi152 podman[73025]: 2024-05-14 09:46:52.029045243 +0000 UTC m=+0.736184953 container remove a6583a746bbd754776e318e8c064e51c5a43a55e548a1031bbccb20349ff8047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-14T09:46:52.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.e.service' 2024-05-14T09:46:52.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:46:52.632 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-14T09:46:52.633 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-14T09:46:52.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.h 2024-05-14T09:46:53.208 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:46:52 smithi152 systemd[1]: Stopping Ceph mds.h for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:46:53.708 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:46:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:46:53.252+0000 7f6fca800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:46:53.708 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:46:53 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h[64561]: 2024-05-14T09:46:53.252+0000 7f6fca800700 -1 mds.h *** got signal Terminated *** 2024-05-14T09:47:02.509 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:47:02 smithi152 podman[73131]: 2024-05-14 09:47:02.220193622 +0000 UTC m=+9.124859107 container died 4ba25ddb775a48c14447467aa9d5b731045c9f582d00a5b13e7e71bf21273dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T09:47:02.930 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:47:02 smithi152 podman[73131]: 2024-05-14 09:47:02.67888119 +0000 UTC m=+9.583546668 container cleanup 4ba25ddb775a48c14447467aa9d5b731045c9f582d00a5b13e7e71bf21273dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-14T09:47:02.930 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:47:02 smithi152 bash[73131]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h 2024-05-14T09:47:03.208 INFO:journalctl@ceph.mds.h.smithi152.stdout:May 14 09:47:02 smithi152 podman[73143]: 2024-05-14 09:47:02.929822077 +0000 UTC m=+0.688106618 container remove 4ba25ddb775a48c14447467aa9d5b731045c9f582d00a5b13e7e71bf21273dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-14T09:47:03.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.h.service' 2024-05-14T09:47:03.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:47:03.587 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-14T09:47:03.588 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-14T09:47:03.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.k 2024-05-14T09:47:04.208 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:47:03 smithi152 systemd[1]: Stopping Ceph mds.k for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:47:04.709 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:47:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k[63958]: 2024-05-14T09:47:04.212+0000 7f7644600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:47:04.709 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:47:04 smithi152 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k[63958]: 2024-05-14T09:47:04.213+0000 7f7644600700 -1 mds.k *** got signal Terminated *** 2024-05-14T09:47:08.538 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:47:08 smithi152 podman[73251]: 2024-05-14 09:47:08.244293978 +0000 UTC m=+4.157227523 container died 3ec99715c27d16d58e527a72527102c3b8032148b8c2469af6a44c81fac184ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:47:08.924 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:47:08 smithi152 podman[73251]: 2024-05-14 09:47:08.648892452 +0000 UTC m=+4.561826043 container cleanup 3ec99715c27d16d58e527a72527102c3b8032148b8c2469af6a44c81fac184ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-05-14T09:47:08.925 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:47:08 smithi152 bash[73251]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k 2024-05-14T09:47:09.208 INFO:journalctl@ceph.mds.k.smithi152.stdout:May 14 09:47:08 smithi152 podman[73263]: 2024-05-14 09:47:08.924817144 +0000 UTC m=+0.644135949 container remove 3ec99715c27d16d58e527a72527102c3b8032148b8c2469af6a44c81fac184ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-k, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:47:09.337 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.k.service' 2024-05-14T09:47:09.434 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:47:09.434 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-14T09:47:09.434 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-14T09:47:09.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.c 2024-05-14T09:47:09.969 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:47:09 smithi175 systemd[1]: Stopping Ceph mds.c for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:47:10.227 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:47:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c[66510]: 2024-05-14T09:47:10.043+0000 7ff5f5400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:47:10.227 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:47:10 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c[66510]: 2024-05-14T09:47:10.043+0000 7ff5f5400700 -1 mds.c *** got signal Terminated *** 2024-05-14T09:47:14.637 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:47:14 smithi175 podman[75185]: 2024-05-14 09:47:14.354729437 +0000 UTC m=+4.468458973 container died ef5aee604f06b7e89bcd93629591616554eaac74a0fe1ca568f8f3ed6fd17fe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-14T09:47:14.977 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:47:14 smithi175 podman[75185]: 2024-05-14 09:47:14.738756944 +0000 UTC m=+4.852486480 container cleanup ef5aee604f06b7e89bcd93629591616554eaac74a0fe1ca568f8f3ed6fd17fe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:47:14.977 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:47:14 smithi175 bash[75185]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c 2024-05-14T09:47:15.317 INFO:journalctl@ceph.mds.c.smithi175.stdout:May 14 09:47:15 smithi175 podman[75211]: 2024-05-14 09:47:15.031857663 +0000 UTC m=+0.666102422 container remove ef5aee604f06b7e89bcd93629591616554eaac74a0fe1ca568f8f3ed6fd17fe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-14T09:47:15.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.c.service' 2024-05-14T09:47:15.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:47:15.466 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-14T09:47:15.466 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-14T09:47:15.466 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.f 2024-05-14T09:47:15.977 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:15 smithi175 systemd[1]: Stopping Ceph mds.f for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:47:16.477 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f[66211]: 2024-05-14T09:47:16.124+0000 7f7eb8200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:47:16.477 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:16 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f[66211]: 2024-05-14T09:47:16.124+0000 7f7eb8200700 -1 mds.f *** got signal Terminated *** 2024-05-14T09:47:18.977 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:18 smithi175 podman[75318]: 2024-05-14 09:47:18.687627965 +0000 UTC m=+2.699906780 container stop 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-14T09:47:18.977 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:18 smithi175 podman[75318]: 2024-05-14 09:47:18.714262661 +0000 UTC m=+2.726541444 container died 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-14T09:47:19.369 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:19 smithi175 podman[75318]: 2024-05-14 09:47:19.159190324 +0000 UTC m=+3.171469133 container cleanup 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T09:47:19.369 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:19 smithi175 bash[75318]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f 2024-05-14T09:47:19.727 INFO:journalctl@ceph.mds.f.smithi175.stdout:May 14 09:47:19 smithi175 podman[75332]: 2024-05-14 09:47:19.368312942 +0000 UTC m=+0.659989709 container remove 306d3a69e921578f6f4224b49bb69a443ac1d95cad7bcc6c78991b4648bd1644 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, io.buildah.version=1.33.5) 2024-05-14T09:47:19.832 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.f.service' 2024-05-14T09:47:19.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:47:19.938 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-14T09:47:19.938 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-14T09:47:19.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.i 2024-05-14T09:47:20.477 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:47:20 smithi175 systemd[1]: Stopping Ceph mds.i for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:47:20.977 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:47:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i[66823]: 2024-05-14T09:47:20.568+0000 7f8f41400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:47:20.977 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:47:20 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i[66823]: 2024-05-14T09:47:20.568+0000 7f8f41400700 -1 mds.i *** got signal Terminated *** 2024-05-14T09:47:25.668 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:47:25 smithi175 podman[75437]: 2024-05-14 09:47:25.377803104 +0000 UTC m=+4.939191967 container died caf092ae6b786aba992c748afa961452399c9c665430d524dd91892e29b8ef66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T09:47:25.977 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:47:25 smithi175 podman[75437]: 2024-05-14 09:47:25.804206941 +0000 UTC m=+5.365595797 container cleanup caf092ae6b786aba992c748afa961452399c9c665430d524dd91892e29b8ef66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5) 2024-05-14T09:47:25.977 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:47:25 smithi175 bash[75437]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i 2024-05-14T09:47:26.413 INFO:journalctl@ceph.mds.i.smithi175.stdout:May 14 09:47:26 smithi175 podman[75453]: 2024-05-14 09:47:26.009932975 +0000 UTC m=+0.610173350 container remove caf092ae6b786aba992c748afa961452399c9c665430d524dd91892e29b8ef66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-i, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T09:47:26.442 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.i.service' 2024-05-14T09:47:26.539 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:47:26.539 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-14T09:47:26.539 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-14T09:47:26.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.l 2024-05-14T09:47:26.977 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:47:26 smithi175 systemd[1]: Stopping Ceph mds.l for 15b5acb4-11d1-11ef-bc98-c7b262605968... 2024-05-14T09:47:27.477 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:47:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l[65899]: 2024-05-14T09:47:27.137+0000 7f1a4cc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T09:47:27.477 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:47:27 smithi175 ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l[65899]: 2024-05-14T09:47:27.137+0000 7f1a4cc00700 -1 mds.l *** got signal Terminated *** 2024-05-14T09:47:28.703 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:47:28 smithi175 podman[75560]: 2024-05-14 09:47:28.414345636 +0000 UTC m=+1.405576293 container died 530e1f3503501dc4f81b0b81e0f855acb618da8892ccaa84100382c39b1bfa13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T09:47:28.977 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:47:28 smithi175 podman[75560]: 2024-05-14 09:47:28.815731649 +0000 UTC m=+1.806962333 container cleanup 530e1f3503501dc4f81b0b81e0f855acb618da8892ccaa84100382c39b1bfa13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-14T09:47:28.977 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:47:28 smithi175 bash[75560]: ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l 2024-05-14T09:47:29.457 INFO:journalctl@ceph.mds.l.smithi175.stdout:May 14 09:47:29 smithi175 podman[75573]: 2024-05-14 09:47:29.033488048 +0000 UTC m=+0.589667162 container remove 530e1f3503501dc4f81b0b81e0f855acb618da8892ccaa84100382c39b1bfa13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-15b5acb4-11d1-11ef-bc98-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-14T09:47:29.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-15b5acb4-11d1-11ef-bc98-c7b262605968@mds.l.service' 2024-05-14T09:47:29.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T09:47:29.592 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-14T09:47:29.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T09:47:29.909 INFO:teuthology.orchestra.run.smithi120.stdout:Deleting cluster with fsid: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:47:34.883 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T09:47:35.195 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:47:40.283 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T09:47:40.600 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T09:47:45.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:47:45.601 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:47:45.692 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T09:47:45.785 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-14T09:47:45.787 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi120/crash 2024-05-14T09:47:45.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash -- . 2024-05-14T09:47:45.898 INFO:teuthology.orchestra.run.smithi120.stderr:tar: /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T09:47:45.898 INFO:teuthology.orchestra.run.smithi120.stderr:tar: Error is not recoverable: exiting now 2024-05-14T09:47:45.903 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi152/crash 2024-05-14T09:47:45.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash -- . 2024-05-14T09:47:45.997 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T09:47:45.997 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2024-05-14T09:47:46.001 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi175/crash 2024-05-14T09:47:46.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash -- . 2024-05-14T09:47:46.102 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T09:47:46.103 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-05-14T09:47:46.107 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-14T09:47:46.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-14T09:47:46.284 INFO:teuthology.orchestra.run.smithi120.stdout:2024-05-14T09:24:45.773874+0000 mds.h (mds.0) 9 : cluster [WRN] Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/92af4004-749c-4392-ae36-0928c82dd90e/postgres/data/pg_logical) see mds.h log and `damage ls` output for details 2024-05-14T09:47:46.285 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-05-14T09:47:46.285 INFO:tasks.cephadm:Compressing logs... 2024-05-14T09:47:46.285 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T09:47:46.291 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T09:47:46.298 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T09:47:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-05-14T09:47:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:: No such file or directory 2024-05-14T09:47:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log 2024-05-14T09:47:46.386 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T09:47:46.387 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.g.log 2024-05-14T09:47:46.388 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.j.log 2024-05-14T09:47:46.389 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.3.log 2024-05-14T09:47:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.0.log 2024-05-14T09:47:46.391 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.x.log 2024-05-14T09:47:46.393 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T09:47:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.a.log 2024-05-14T09:47:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.6.log 2024-05-14T09:47:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T09:47:46.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.a.log 2024-05-14T09:47:46.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T09:47:46.397 INFO:teuthology.orchestra.run.smithi120.stderr: 94.5% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.j.log.gz 2024-05-14T09:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log 2024-05-14T09:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:: No such file or directory 2024-05-14T09:47:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.d.log 2024-05-14T09:47:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.9.log 2024-05-14T09:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T09:47:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T09:47:46.400 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.7.log 2024-05-14T09:47:46.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-05-14T09:47:46.401 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.b.log 2024-05-14T09:47:46.401 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log 2024-05-14T09:47:46.402 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-05-14T09:47:46.402 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.2.log 2024-05-14T09:47:46.402 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.4.log 2024-05-14T09:47:46.403 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.1.log 2024-05-14T09:47:46.404 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.f.log 2024-05-14T09:47:46.404 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.y.log 2024-05-14T09:47:46.405 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.h.log 2024-05-14T09:47:46.405 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T09:47:46.406 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 94.4% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.d.log.gz 2024-05-14T09:47:46.407 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.10.log 2024-05-14T09:47:46.407 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T09:47:46.407 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.5.log 2024-05-14T09:47:46.408 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.c.log 2024-05-14T09:47:46.409 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.e.log 2024-05-14T09:47:46.409 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T09:47:46.409 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.c.log 2024-05-14T09:47:46.409 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.z.log 2024-05-14T09:47:46.411 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.b.log 2024-05-14T09:47:46.411 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.k.log 2024-05-14T09:47:46.411 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.i.log 2024-05-14T09:47:46.411 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T09:47:46.412 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T09:47:46.413 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.11.log 2024-05-14T09:47:46.413 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.8.log 2024-05-14T09:47:46.414 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 93.3% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.y.log.gz 2024-05-14T09:47:46.414 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T09:47:46.414 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.l.log 2024-05-14T09:47:46.415 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T09:47:46.415 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T09:47:46.418 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 93.4% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.z.log.gz 2024-05-14T09:47:46.418 INFO:teuthology.orchestra.run.smithi175.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T09:47:46.452 INFO:teuthology.orchestra.run.smithi120.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-05-14T09:47:46.480 INFO:teuthology.orchestra.run.smithi152.stderr: 83.3% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T09:47:46.521 INFO:teuthology.orchestra.run.smithi120.stderr: 83.3% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T09:47:46.526 INFO:teuthology.orchestra.run.smithi175.stderr: 83.2% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T09:47:46.540 INFO:teuthology.orchestra.run.smithi175.stderr: 90.5% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T09:47:46.592 INFO:teuthology.orchestra.run.smithi120.stderr: 90.9% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T09:47:46.595 INFO:teuthology.orchestra.run.smithi175.stderr: 87.6% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T09:47:46.610 INFO:teuthology.orchestra.run.smithi120.stderr: 90.3% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T09:47:46.619 INFO:teuthology.orchestra.run.smithi152.stderr: 87.6% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T09:47:46.689 INFO:teuthology.orchestra.run.smithi152.stderr: 90.5% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T09:47:46.782 INFO:teuthology.orchestra.run.smithi120.stderr: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T09:47:46.806 INFO:teuthology.orchestra.run.smithi175.stderr: 90.9% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T09:47:46.877 INFO:teuthology.orchestra.run.smithi152.stderr: 90.9% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T09:47:47.196 INFO:teuthology.orchestra.run.smithi120.stderr: 94.1% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.g.log.gz 2024-05-14T09:47:47.519 INFO:teuthology.orchestra.run.smithi175.stderr: 94.2% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.l.log.gz 2024-05-14T09:47:48.085 INFO:teuthology.orchestra.run.smithi120.stderr: 94.0% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.a.log.gz 2024-05-14T09:47:48.188 INFO:teuthology.orchestra.run.smithi120.stderr: 90.3% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mgr.x.log.gz 2024-05-14T09:47:48.476 INFO:teuthology.orchestra.run.smithi175.stderr: 94.3% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.f.log.gz 2024-05-14T09:47:48.843 INFO:teuthology.orchestra.run.smithi152.stderr: 91.7% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.b.log.gz 2024-05-14T09:47:49.106 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.c.log.gz 2024-05-14T09:47:50.038 INFO:teuthology.orchestra.run.smithi152.stderr: 95.9% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.b.log.gz 2024-05-14T09:47:50.980 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.c.log.gz 2024-05-14T09:47:54.615 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.i.log.gz 2024-05-14T09:47:56.773 INFO:teuthology.orchestra.run.smithi120.stderr: 90.2% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mon.a.log.gz 2024-05-14T09:47:57.730 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.e.log.gz 2024-05-14T09:48:12.142 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.h.log.gz 2024-05-14T09:48:15.973 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-mds.k.log.gz 2024-05-14T09:50:50.269 INFO:teuthology.orchestra.run.smithi152.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.10.log.gz 2024-05-14T09:50:55.661 INFO:teuthology.orchestra.run.smithi175.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.8.log.gz 2024-05-14T09:51:31.373 INFO:teuthology.orchestra.run.smithi175.stderr: 90.9% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.11.log.gz 2024-05-14T09:51:54.120 INFO:teuthology.orchestra.run.smithi152.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.1.log.gz 2024-05-14T09:52:01.498 INFO:teuthology.orchestra.run.smithi175.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.2.log.gz 2024-05-14T09:52:27.390 INFO:teuthology.orchestra.run.smithi152.stderr: 90.7% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.7.log.gz 2024-05-14T09:52:35.013 INFO:teuthology.orchestra.run.smithi175.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.5.log.gz 2024-05-14T09:52:35.036 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-05-14T09:52:35.036 INFO:teuthology.orchestra.run.smithi175.stderr:real 4m48.685s 2024-05-14T09:52:35.036 INFO:teuthology.orchestra.run.smithi175.stderr:user 8m14.623s 2024-05-14T09:52:35.036 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m51.245s 2024-05-14T09:52:46.323 INFO:teuthology.orchestra.run.smithi152.stderr: 90.9% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.4.log.gz 2024-05-14T09:52:46.328 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-05-14T09:52:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:real 4m59.983s 2024-05-14T09:52:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:user 7m50.990s 2024-05-14T09:52:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m48.651s 2024-05-14T09:59:24.181 INFO:teuthology.orchestra.run.smithi120.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.0.log.gz 2024-05-14T09:59:44.576 INFO:teuthology.orchestra.run.smithi120.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.3.log.gz 2024-05-14T09:59:56.693 INFO:teuthology.orchestra.run.smithi120.stderr: 90.7% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.6.log.gz 2024-05-14T10:01:23.324 INFO:teuthology.orchestra.run.smithi120.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-05-14T10:01:44.818 INFO:teuthology.orchestra.run.smithi120.stderr: 90.8% -- replaced with /var/log/ceph/15b5acb4-11d1-11ef-bc98-c7b262605968/ceph-osd.9.log.gz 2024-05-14T10:01:44.822 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-05-14T10:01:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:real 13m58.492s 2024-05-14T10:01:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:user 16m52.684s 2024-05-14T10:01:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:sys 2m8.534s 2024-05-14T10:01:44.824 INFO:tasks.cephadm:Archiving logs... 2024-05-14T10:01:44.825 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi120/log 2024-05-14T10:01:44.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T10:02:57.688 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi152/log 2024-05-14T10:02:57.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T10:03:51.419 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi175/log 2024-05-14T10:03:51.420 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T10:04:46.725 INFO:tasks.cephadm:Removing cluster... 2024-05-14T10:04:46.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 --force 2024-05-14T10:04:47.611 INFO:teuthology.orchestra.run.smithi120.stdout:Deleting cluster with fsid: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T10:04:49.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 --force 2024-05-14T10:04:49.803 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T10:04:51.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 15b5acb4-11d1-11ef-bc98-c7b262605968 --force 2024-05-14T10:04:52.178 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 15b5acb4-11d1-11ef-bc98-c7b262605968 2024-05-14T10:04:53.924 INFO:tasks.cephadm:Removing cephadm ... 2024-05-14T10:04:53.925 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T10:04:53.994 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T10:04:54.052 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T10:04:54.107 INFO:tasks.cephadm:Teardown complete 2024-05-14T10:04:54.108 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-14T10:04:54.120 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T10:04:54.121 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-14T10:04:54.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T10:04:54.129 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T10:04:54.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T10:04:54.364 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-14T10:04:54.376 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-14T10:04:54.377 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T10:04:54.385 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T10:04:54.393 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T10:04:54.432 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-05-14T10:04:54.441 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-05-14T10:04:54.451 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-05-14T10:04:54.538 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T10:04:54.538 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-05-14T10:04:54.538 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +1025us[+1022us] +/- 51ms 2024-05-14T10:04:54.538 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -819us[ -819us] +/- 65ms 2024-05-14T10:04:54.538 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -579us[ -579us] +/- 71ms 2024-05-14T10:04:54.538 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T10:04:54.586 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T10:04:54.586 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-05-14T10:04:54.586 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +1052us[+1059us] +/- 51ms 2024-05-14T10:04:54.586 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 -791us[ -791us] +/- 65ms 2024-05-14T10:04:54.586 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -544us[ -544us] +/- 71ms 2024-05-14T10:04:54.586 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T10:04:54.589 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T10:04:54.589 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-05-14T10:04:54.589 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +1040us[+1041us] +/- 51ms 2024-05-14T10:04:54.589 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -823us[ -822us] +/- 65ms 2024-05-14T10:04:54.589 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -553us[ -552us] +/- 71ms 2024-05-14T10:04:54.589 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T10:04:54.599 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-14T10:04:54.609 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-14T10:04:54.610 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-14T10:04:54.842 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T10:04:55.122 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T10:04:55.350 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T10:04:55.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T10:04:55.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:04:55.670 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T10:04:55.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:04:55.764 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T10:04:55.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:04:55.857 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-14T10:04:55.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-14T10:04:55.908 INFO:teuthology.task.internal:Duration was 4108.856764 seconds 2024-05-14T10:04:55.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-14T10:04:56.035 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-14T10:04:56.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T10:04:56.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T10:04:56.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T10:04:56.196 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T10:04:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T10:04:56.218 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T10:04:56.591 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-14T10:04:56.591 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-05-14T10:04:56.591 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T10:04:56.682 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-05-14T10:04:56.682 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T10:04:56.760 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-05-14T10:04:56.761 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T10:04:56.839 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-14T10:04:56.840 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T10:04:56.847 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T10:04:56.855 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T10:04:56.937 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-14T10:04:56.937 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T10:04:56.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T10:04:56.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T10:04:57.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-14T10:04:57.944 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-14T10:04:57.945 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T10:04:58.023 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T10:04:58.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T10:04:58.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-14T10:04:58.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:04:58.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:04:58.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:04:58.340 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-05-14T10:04:58.366 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-05-14T10:04:58.370 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-05-14T10:04:58.419 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:04:58.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:04:58.474 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:04:58.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:04:58.525 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:04:58.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:04:58.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-14T10:04:58.590 INFO:teuthology.task.internal:Transferring archived files... 2024-05-14T10:04:58.592 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi120 2024-05-14T10:04:58.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T10:04:58.713 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi152 2024-05-14T10:04:58.713 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T10:04:58.815 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657/remote/smithi175 2024-05-14T10:04:58.815 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T10:04:58.916 INFO:teuthology.task.internal:Removing archive directory... 2024-05-14T10:04:58.917 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T10:04:58.925 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T10:04:58.932 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T10:04:58.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-14T10:04:59.005 INFO:teuthology.task.internal:Not uploading archives. 2024-05-14T10:04:59.005 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-14T10:04:59.066 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-14T10:04:59.067 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T10:04:59.074 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T10:04:59.082 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T10:04:59.126 INFO:teuthology.orchestra.run.smithi120.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 10:04 /home/ubuntu/cephtest 2024-05-14T10:04:59.131 INFO:teuthology.orchestra.run.smithi152.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 10:04 /home/ubuntu/cephtest 2024-05-14T10:04:59.135 INFO:teuthology.orchestra.run.smithi175.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 10:04 /home/ubuntu/cephtest 2024-05-14T10:04:59.138 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-14T10:04:59.149 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-14T10:04:59.229 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T10:04:59.229 INFO:teuthology.nuke:Checking targets against current locks 2024-05-14T10:04:59.258 DEBUG:teuthology.nuke:shortname: smithi120 2024-05-14T10:04:59.259 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T10:04:59.283 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 08:46:30.109943', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2p+UR98t+MYnbA6LmOisQwAus48sHU2XtZfQKIINlBNuoNayko8NMp3kK9MuLroG9P8Y49ZzRvDIA4vrjlgsU='} 2024-05-14T10:04:59.286 DEBUG:teuthology.nuke:shortname: smithi152 2024-05-14T10:04:59.286 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T10:04:59.310 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 08:46:30.111927', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5LN3hI4r8IdID0AGWS++wTcqbgAky2q5PyUJghdL+SkcoPE92Y6FxETVk+LDz+WszcUy8jRIMd+MVEgYv5Ph0='} 2024-05-14T10:04:59.314 DEBUG:teuthology.nuke:shortname: smithi175 2024-05-14T10:04:59.314 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T10:04:59.343 INFO:teuthology.orchestra.console.smithi120:Power off 2024-05-14T10:04:59.344 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T10:04:59.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 08:46:30.113272', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBkKODTgVpSecuLASI37Fag6v61hGrVG3tpACYrrfW2NK2qeygjGCFL2XYYnD3SNAmJVqwezg5RkiwEOekigDQ='} 2024-05-14T10:04:59.363 INFO:teuthology.orchestra.console.smithi152:Power off 2024-05-14T10:04:59.363 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T10:04:59.372 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-05-14T10:04:59.372 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:04:59.384 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-05-14T10:04:59.384 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:04:59.403 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-05-14T10:04:59.404 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-05-14T10:04:59.417 INFO:teuthology.orchestra.console.smithi175:Power off 2024-05-14T10:04:59.418 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T10:04:59.439 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-05-14T10:04:59.440 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:04:59.461 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-05-14T10:05:03.404 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:03.412 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:03.462 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:03.515 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-05-14T10:05:03.522 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-05-14T10:05:03.572 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-05-14T10:05:07.518 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:07.527 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:07.573 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:07.629 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-05-14T10:05:07.636 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-05-14T10:05:07.682 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-05-14T10:05:07.730 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-05-14T10:05:11.639 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:11.683 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:05:11.750 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-05-14T10:05:11.792 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-05-14T10:05:11.852 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-05-14T10:05:11.893 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-05-14T10:05:11.998 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} duration: 4108.85676407814 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default mon.a-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e mon.b-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e mon.c-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e owner: scheduled_vshankar@teuthology status: fail success: false 2024-05-14T10:05:11.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T10:05:12.076 INFO:teuthology.run:FAIL